2024-02-28T15:30:04.145 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-28T15:30:04.145 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi --verbose --archive /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579 --owner scheduled_vshankar@teuthology --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579/orig.config.yaml 2024-02-28T15:30:04.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T15:30:04.281 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579 branch: main description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: vshankar@redhat.com first_in_suite: false job_id: '7575579' kernel: flavor: default kdb: true sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2226 sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPj8QBAvN1t8YrFyzG2g7GrNfctFXTOXGpmb0PfpplNoq3rlpzGZRFTRxCkCkQcrd4pWRIRlQc87B+UIDbYRsh0= smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKL9ZoRu0zHniRHkNU7d2M8Q1i2NrrBRQHfVbC/Eqb6sWb+0uCI2RGnwbnIIlSz0shY26lSeuM+ZIIT2XiepQE0= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/vshankar/src/git.ceph.com_ceph-c_main/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-28_15:21:56 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-28T15:30:04.282 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa; will attempt to use it 2024-02-28T15:30:04.282 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks 2024-02-28T15:30:04.283 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-28T15:30:04.284 INFO:teuthology.task.internal:Checking packages... 2024-02-28T15:30:04.307 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1fb5d10608dccee73edd6ef8a2c7b804a097c324' 2024-02-28T15:30:04.307 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T15:30:04.307 INFO:teuthology.packaging:ref: None 2024-02-28T15:30:04.307 INFO:teuthology.packaging:tag: None 2024-02-28T15:30:04.307 INFO:teuthology.packaging:branch: main 2024-02-28T15:30:04.307 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:30:04.307 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-02-28T15:30:04.723 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1716.g4a1c26b5 2024-02-28T15:30:04.725 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-28T15:30:04.732 INFO:teuthology.task.internal:no buildpackages task found 2024-02-28T15:30:04.732 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-28T15:30:04.758 INFO:teuthology.task.internal:Saving configuration 2024-02-28T15:30:04.778 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-28T15:30:04.783 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T15:30:04.810 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:23:03.650037', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPj8QBAvN1t8YrFyzG2g7GrNfctFXTOXGpmb0PfpplNoq3rlpzGZRFTRxCkCkQcrd4pWRIRlQc87B+UIDbYRsh0='} 2024-02-28T15:30:04.836 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:23:03.651767', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKL9ZoRu0zHniRHkNU7d2M8Q1i2NrrBRQHfVbC/Eqb6sWb+0uCI2RGnwbnIIlSz0shY26lSeuM+ZIIT2XiepQE0='} 2024-02-28T15:30:04.836 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-28T15:30:04.843 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-28T15:30:04.843 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-28T15:30:04.843 INFO:teuthology.run_tasks:Running task console_log... 2024-02-28T15:30:04.973 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc9a48f2160>, signals=[15]) 2024-02-28T15:30:04.973 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-28T15:30:04.980 INFO:teuthology.task.internal:Opening connections... 2024-02-28T15:30:04.980 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:30:04.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:30:05.086 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-02-28T15:30:05.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:30:05.175 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-28T15:30:05.182 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-02-28T15:30:05.199 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-02-28T15:30:05.199 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-02-28T15:30:05.256 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-02-28T15:30:05.256 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-02-28T15:30:05.256 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-02-28T15:30:05.256 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-02-28T15:30:05.257 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-02-28T15:30:05.257 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-02-28T15:30:05.257 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T15:30:05.257 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-02-28T15:30:05.257 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-02-28T15:30:05.257 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T15:30:05.257 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-02-28T15:30:05.257 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T15:30:05.257 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T15:30:05.257 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T15:30:05.258 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-02-28T15:30:05.275 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-02-28T15:30:05.291 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-02-28T15:30:05.292 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-02-28T15:30:05.351 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-02-28T15:30:05.351 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-02-28T15:30:05.351 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-02-28T15:30:05.351 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-02-28T15:30:05.351 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-02-28T15:30:05.352 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-02-28T15:30:05.352 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T15:30:05.352 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-02-28T15:30:05.352 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-02-28T15:30:05.352 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T15:30:05.352 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-02-28T15:30:05.352 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T15:30:05.352 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T15:30:05.352 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T15:30:05.352 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-02-28T15:30:05.374 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-28T15:30:05.384 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-28T15:30:05.402 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-28T15:30:05.402 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-02-28T15:30:05.405 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-02-28T15:30:05.420 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-28T15:30:05.426 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-28T15:30:05.427 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-02-28T15:30:05.463 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-02-28T15:30:05.553 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-28T15:30:05.605 INFO:teuthology.run_tasks:Running task kernel... 2024-02-28T15:30:05.619 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'} 2024-02-28T15:30:05.620 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'}}, timeout 300 2024-02-28T15:30:05.620 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-28T15:30:05.620 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-28T15:30:05.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T15:30:05.636 DEBUG:teuthology.task.kernel:sha1 for host.b is bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:30:05.637 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "bd7d00fb724897dda560070d01bc6e5c80881f15"... 2024-02-28T15:30:05.637 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-02-28T15:30:05.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T15:30:05.638 DEBUG:teuthology.task.kernel:sha1 for host.a is bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:30:05.638 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "bd7d00fb724897dda560070d01bc6e5c80881f15"... 2024-02-28T15:30:05.638 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-02-28T15:30:05.696 INFO:teuthology.orchestra.run.smithi057.stdout:5.14.0-361.el9.x86_64 2024-02-28T15:30:05.696 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:30:05.697 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-28T15:30:05.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:30:05.701 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-361.el9.x86_64 2024-02-28T15:30:05.701 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:30:05.701 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-28T15:30:05.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:30:06.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum upgrade -y linux-firmware 2024-02-28T15:30:06.025 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum upgrade -y linux-firmware 2024-02-28T15:30:08.294 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - AppStream 12 MB/s | 8.1 MB 00:00 2024-02-28T15:30:08.384 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - AppStream 10 MB/s | 8.1 MB 00:00 2024-02-28T15:30:10.086 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.5 MB 00:00 2024-02-28T15:30:10.167 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.5 MB 00:00 2024-02-28T15:30:11.250 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-02-28T15:30:19.609 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 19 MB 00:07 2024-02-28T15:30:23.651 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.1 MB 00:00 2024-02-28T15:30:23.675 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 627 kB/s | 8.0 MB 00:13 2024-02-28T15:30:25.210 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 15 kB 00:00 2024-02-28T15:30:26.797 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-02-28T15:30:29.226 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 19 MB 00:04 2024-02-28T15:30:31.819 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-02-28T15:30:34.044 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:30:34.044 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:30:34.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:30:34.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:30:34.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:30:34.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:30:34.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:30:34.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.051 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:30:34.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.051 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:30:34.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.052 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:30:34.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.053 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:30:34.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.053 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:30:34.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.054 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:30:34.600 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:30:34.605 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:30:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-02-28T15:30:34.605 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:30:34.605 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-02-28T15:30:34.606 INFO:teuthology.orchestra.run.smithi087.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-02-28T15:30:34.606 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:30:34.606 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:30:34.606 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:30:34.606 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 1 Package 2024-02-28T15:30:34.606 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:30:34.606 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 376 M 2024-02-28T15:30:34.606 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:30:39.442 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 970 kB/s | 6.1 MB 00:06 2024-02-28T15:30:41.393 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 15 kB 00:00 2024-02-28T15:30:44.171 INFO:teuthology.orchestra.run.smithi087.stdout:linux-firmware-20240219-143.el9.noarch.rpm 40 MB/s | 376 MB 00:09 2024-02-28T15:30:44.171 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:30:44.171 INFO:teuthology.orchestra.run.smithi087.stdout:Total 39 MB/s | 376 MB 00:09 2024-02-28T15:30:47.206 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:30:47.372 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:30:47.373 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:30:50.605 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:30:50.606 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:30:54.779 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 1.5 MB/s | 20 MB 00:13 2024-02-28T15:30:58.022 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:30:58.362 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:30:58.440 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:30:59.612 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:30:59.612 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:30:59.942 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-02-28T15:31:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:31:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:31:00.042 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-02-28T15:31:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: linux-firmware-20240219-143.el9.noarch 2024-02-28T15:31:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:31:00.042 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:31:00.363 INFO:teuthology.task.kernel:Downloading kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.b... 2024-02-28T15:31:00.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:31:00.522 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ 2024-02-28T15:31:00.523 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-28T15:31:00.525 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi087.front.sepia.ceph.com to complete... 2024-02-28T15:31:02.261 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:31:02.261 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:31:02.261 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:31:02.261 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.261 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:31:02.262 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:31:02.263 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:31:02.264 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:31:02.265 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:31:02.266 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.267 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.268 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.269 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.270 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:31:02.841 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:31:02.854 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:31:02.854 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-02-28T15:31:02.854 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:31:02.854 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-02-28T15:31:02.855 INFO:teuthology.orchestra.run.smithi057.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-02-28T15:31:02.855 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:31:02.855 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:31:02.855 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:31:02.855 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 1 Package 2024-02-28T15:31:02.855 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:31:02.855 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 376 M 2024-02-28T15:31:02.855 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:32:01.645 INFO:teuthology.orchestra.run.smithi057.stdout:linux-firmware-20240219-143.el9.noarch.rpm 6.4 MB/s | 376 MB 00:58 2024-02-28T15:32:01.646 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:32:01.646 INFO:teuthology.orchestra.run.smithi057.stdout:Total 6.4 MB/s | 376 MB 00:58 2024-02-28T15:32:04.829 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:32:04.932 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:32:04.933 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:32:08.291 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:32:08.292 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:32:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:32:16.048 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:32:16.140 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:32:17.130 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:32:17.130 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:32:17.554 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:32:17.554 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:32:17.554 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-02-28T15:32:17.554 INFO:teuthology.orchestra.run.smithi057.stdout: linux-firmware-20240219-143.el9.noarch 2024-02-28T15:32:17.554 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:32:17.555 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:32:17.853 INFO:teuthology.task.kernel:Downloading kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.a... 2024-02-28T15:32:17.854 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:32:18.005 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ 2024-02-28T15:32:18.005 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-28T15:32:18.008 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi057.front.sepia.ceph.com to complete... 2024-02-28T15:33:57.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28 15:33:57 URL:https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm [335852831/335852831] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-28T15:33:57.173 INFO:teuthology.orchestra.run.smithi087.stderr:FINISHED --2024-02-28 15:33:57-- 2024-02-28T15:33:57.173 INFO:teuthology.orchestra.run.smithi087.stderr:Total wall clock time: 2m 57s 2024-02-28T15:33:57.174 INFO:teuthology.orchestra.run.smithi087.stderr:Downloaded: 1 files, 320M in 2m 55s (1.83 MB/s) 2024-02-28T15:33:57.177 INFO:teuthology.task.kernel:Installing kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.b... 2024-02-28T15:33:57.178 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-28T15:33:59.105 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying... ######################################## 2024-02-28T15:33:59.250 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing... ######################################## 2024-02-28T15:33:59.331 INFO:teuthology.orchestra.run.smithi087.stdout:Updating / installing... 2024-02-28T15:34:06.811 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-6.8.0_rc6_gbd7d00fb7248-1 ######################################## 2024-02-28T15:34:21.016 INFO:teuthology.orchestra.run.smithi087.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-28T15:34:37.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28 15:34:37 URL:https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm [335852831/335852831] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-28T15:34:37.123 INFO:teuthology.orchestra.run.smithi057.stderr:FINISHED --2024-02-28 15:34:37-- 2024-02-28T15:34:37.123 INFO:teuthology.orchestra.run.smithi057.stderr:Total wall clock time: 2m 19s 2024-02-28T15:34:37.123 INFO:teuthology.orchestra.run.smithi057.stderr:Downloaded: 1 files, 320M in 2m 18s (2.31 MB/s) 2024-02-28T15:34:37.127 INFO:teuthology.task.kernel:Installing kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.a... 2024-02-28T15:34:37.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-28T15:34:39.161 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying... ######################################## 2024-02-28T15:34:39.227 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing... ######################################## 2024-02-28T15:34:39.312 INFO:teuthology.orchestra.run.smithi057.stdout:Updating / installing... 2024-02-28T15:34:43.488 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-28T15:34:43.488 DEBUG:teuthology.orchestra.run.smithi087:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-28T15:34:43.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/System.map 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/config 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-28T15:34:43.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-28T15:34:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm.ko 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ansi_cprng.ko 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/anubis.ko 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/arc4.ko 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx 2024-02-28T15:34:43.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_memcpy.ko 2024-02-28T15:34:43.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_pq.ko 2024-02-28T15:34:43.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-28T15:34:43.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_tx.ko 2024-02-28T15:34:43.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_xor.ko 2024-02-28T15:34:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/raid6test.ko 2024-02-28T15:34:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authenc.ko 2024-02-28T15:34:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authencesn.ko 2024-02-28T15:34:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blake2b_generic.ko 2024-02-28T15:34:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_common.ko 2024-02-28T15:34:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_generic.ko 2024-02-28T15:34:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/camellia_generic.ko 2024-02-28T15:34:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast5_generic.ko 2024-02-28T15:34:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast6_generic.ko 2024-02-28T15:34:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast_common.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ccm.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cmac.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crc32_generic.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_engine.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_user.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cts.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/des_generic.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/dh_generic.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/echainiv.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/essiv.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/fcrypt.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/khazad.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4.ko 2024-02-28T15:34:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4hc.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/md4.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/michael_mic.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcbc.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcrypt.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/rmd160.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/seed.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/serpent_generic.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tcrypt.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tea.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_common.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_generic.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/vmac.ko 2024-02-28T15:34:43.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/wp512.ko 2024-02-28T15:34:43.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xcbc.ko 2024-02-28T15:34:43.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xor.ko 2024-02-28T15:34:43.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xxhash_generic.ko 2024-02-28T15:34:43.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers 2024-02-28T15:34:43.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi 2024-02-28T15:34:43.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-28T15:34:43.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_pad.ko 2024-02-28T15:34:43.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/custom_method.ko 2024-02-28T15:34:43.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/ec_sys.ko 2024-02-28T15:34:43.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/platform_profile.ko 2024-02-28T15:34:43.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbs.ko 2024-02-28T15:34:43.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbshc.ko 2024-02-28T15:34:43.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/video.ko 2024-02-28T15:34:43.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata 2024-02-28T15:34:43.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/acard-ahci.ko 2024-02-28T15:34:43.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ahci_platform.ko 2024-02-28T15:34:43.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ata_generic.ko 2024-02-28T15:34:43.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/libahci_platform.ko 2024-02-28T15:34:43.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_acpi.ko 2024-02-28T15:34:43.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ali.ko 2024-02-28T15:34:43.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_amd.ko 2024-02-28T15:34:43.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_artop.ko 2024-02-28T15:34:43.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atiixp.ko 2024-02-28T15:34:43.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atp867x.ko 2024-02-28T15:34:43.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd640.ko 2024-02-28T15:34:43.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd64x.ko 2024-02-28T15:34:43.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cypress.ko 2024-02-28T15:34:43.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_efar.ko 2024-02-28T15:34:43.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt366.ko 2024-02-28T15:34:43.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt37x.ko 2024-02-28T15:34:43.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-28T15:34:43.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-28T15:34:43.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it8213.ko 2024-02-28T15:34:43.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it821x.ko 2024-02-28T15:34:43.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_jmicron.ko 2024-02-28T15:34:43.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_marvell.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_mpiix.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_netcell.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ninja32.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87410.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87415.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_oldpiix.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_opti.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_optidma.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pcmcia.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-28T15:34:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_piccolo.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_rdc.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sch.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_serverworks.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sil680.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sis.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sl82c105.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_triflex.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_via.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pdc_adma.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_inic162x.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_mv.ko 2024-02-28T15:34:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_nv.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_promise.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_qstor.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil24.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sis.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_svw.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sx4.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_uli.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_via.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_vsc.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay/ks0108.ko 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base 2024-02-28T15:34:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap 2024-02-28T15:34:43.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-28T15:34:43.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-28T15:34:43.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma 2024-02-28T15:34:43.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma/bcma.ko 2024-02-28T15:34:43.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block 2024-02-28T15:34:43.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe 2024-02-28T15:34:43.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe/aoe.ko 2024-02-28T15:34:43.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/brd.ko 2024-02-28T15:34:43.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd 2024-02-28T15:34:43.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd/drbd.ko 2024-02-28T15:34:43.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/floppy.ko 2024-02-28T15:34:43.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/loop.ko 2024-02-28T15:34:43.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx 2024-02-28T15:34:43.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-28T15:34:43.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/nbd.ko 2024-02-28T15:34:43.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk 2024-02-28T15:34:43.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk/null_blk.ko 2024-02-28T15:34:43.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/pktcdvd.ko 2024-02-28T15:34:43.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/rbd.ko 2024-02-28T15:34:43.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/virtio_blk.ko 2024-02-28T15:34:43.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback 2024-02-28T15:34:43.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-28T15:34:43.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkfront.ko 2024-02-28T15:34:43.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram 2024-02-28T15:34:43.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram/zram.ko 2024-02-28T15:34:43.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char 2024-02-28T15:34:43.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hangcheck-timer.ko 2024-02-28T15:34:43.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/via-rng.ko 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-28T15:34:43.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-28T15:34:43.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/lp.ko 2024-02-28T15:34:43.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave 2024-02-28T15:34:43.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave/mwave.ko 2024-02-28T15:34:43.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ppdev.ko 2024-02-28T15:34:43.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tlclk.ko 2024-02-28T15:34:43.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/uv_mmtimer.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/virtio_console.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-28T15:34:43.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp.ko 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-28T15:34:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-aes.ko 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-sha.ko 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca/dca.ko 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-28T15:34:43.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac 2024-02-28T15:34:43.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/amd64_edac.ko 2024-02-28T15:34:43.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/e752x_edac.ko 2024-02-28T15:34:43.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/edac_mce_amd.ko 2024-02-28T15:34:43.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3000_edac.ko 2024-02-28T15:34:43.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3200_edac.ko 2024-02-28T15:34:43.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5100_edac.ko 2024-02-28T15:34:43.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5400_edac.ko 2024-02-28T15:34:43.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7300_edac.ko 2024-02-28T15:34:43.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7core_edac.ko 2024-02-28T15:34:43.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i82975x_edac.ko 2024-02-28T15:34:43.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/ie31200_edac.ko 2024-02-28T15:34:43.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/sb_edac.ko 2024-02-28T15:34:43.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/x38_edac.ko 2024-02-28T15:34:43.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware 2024-02-28T15:34:43.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/edd.ko 2024-02-28T15:34:43.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-28T15:34:43.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio 2024-02-28T15:34:43.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-ich.ko 2024-02-28T15:34:43.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-28T15:34:43.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid 2024-02-28T15:34:43.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-appleir.ko 2024-02-28T15:34:43.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-aureal.ko 2024-02-28T15:34:43.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-axff.ko 2024-02-28T15:34:43.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-dr.ko 2024-02-28T15:34:43.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elecom.ko 2024-02-28T15:34:43.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elo.ko 2024-02-28T15:34:43.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-emsff.ko 2024-02-28T15:34:43.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gaff.ko 2024-02-28T15:34:43.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gt683r.ko 2024-02-28T15:34:43.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gyration.ko 2024-02-28T15:34:43.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-28T15:34:43.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-28T15:34:43.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtekff.ko 2024-02-28T15:34:43.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-hyperv.ko 2024-02-28T15:34:43.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-icade.ko 2024-02-28T15:34:43.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-keytouch.ko 2024-02-28T15:34:43.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-kye.ko 2024-02-28T15:34:43.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lcpower.ko 2024-02-28T15:34:43.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-led.ko 2024-02-28T15:34:43.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lenovo.ko 2024-02-28T15:34:43.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-28T15:34:43.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-28T15:34:43.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-multitouch.ko 2024-02-28T15:34:43.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-ortek.ko 2024-02-28T15:34:43.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-penmount.ko 2024-02-28T15:34:43.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-petalynx.ko 2024-02-28T15:34:43.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-picolcd.ko 2024-02-28T15:34:43.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-pl.ko 2024-02-28T15:34:43.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-plantronics.ko 2024-02-28T15:34:43.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-primax.ko 2024-02-28T15:34:43.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-rmi.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-common.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat.ko 2024-02-28T15:34:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-saitek.ko 2024-02-28T15:34:43.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-samsung.ko 2024-02-28T15:34:43.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-28T15:34:43.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sjoy.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sony.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-speedlink.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-steelseries.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sunplus.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tivo.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tmff.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-topseed.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-twinhan.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-uclogic.ko 2024-02-28T15:34:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-waltop.ko 2024-02-28T15:34:43.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-wiimote.ko 2024-02-28T15:34:43.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-xinmo.ko 2024-02-28T15:34:43.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zpff.ko 2024-02-28T15:34:43.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zydacron.ko 2024-02-28T15:34:43.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/uhid.ko 2024-02-28T15:34:43.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/wacom.ko 2024-02-28T15:34:43.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv 2024-02-28T15:34:43.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_balloon.ko 2024-02-28T15:34:43.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_utils.ko 2024-02-28T15:34:43.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_vmbus.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru3.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7414.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7418.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adc128d818.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1025.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1026.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1029.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1031.ko 2024-02-28T15:34:43.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm9240.ko 2024-02-28T15:34:43.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ads7828.ko 2024-02-28T15:34:43.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7410.ko 2024-02-28T15:34:43.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7411.ko 2024-02-28T15:34:43.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7462.ko 2024-02-28T15:34:43.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7470.ko 2024-02-28T15:34:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7475.ko 2024-02-28T15:34:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7x10.ko 2024-02-28T15:34:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/amc6821.ko 2024-02-28T15:34:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/applesmc.ko 2024-02-28T15:34:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asb100.ko 2024-02-28T15:34:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asc7621.ko 2024-02-28T15:34:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-28T15:34:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/atxp1.ko 2024-02-28T15:34:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/coretemp.ko 2024-02-28T15:34:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-28T15:34:43.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dme1737.ko 2024-02-28T15:34:43.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds1621.ko 2024-02-28T15:34:43.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds620.ko 2024-02-28T15:34:43.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc1403.ko 2024-02-28T15:34:43.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc6w201.ko 2024-02-28T15:34:43.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71805f.ko 2024-02-28T15:34:43.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71882fg.ko 2024-02-28T15:34:43.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f75375s.ko 2024-02-28T15:34:43.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fam15h_power.ko 2024-02-28T15:34:43.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fschmd.ko 2024-02-28T15:34:43.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g760a.ko 2024-02-28T15:34:43.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g762.ko 2024-02-28T15:34:43.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl518sm.ko 2024-02-28T15:34:43.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl520sm.ko 2024-02-28T15:34:43.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-28T15:34:43.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5500_temp.ko 2024-02-28T15:34:43.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5k_amb.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmaem.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmpex.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina209.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina2xx.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/it87.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k10temp.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k8temp.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lineage-pem.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm63.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm73.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm75.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm77.ko 2024-02-28T15:34:43.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm78.ko 2024-02-28T15:34:43.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm80.ko 2024-02-28T15:34:43.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm83.ko 2024-02-28T15:34:43.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm85.ko 2024-02-28T15:34:43.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm87.ko 2024-02-28T15:34:43.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm90.ko 2024-02-28T15:34:43.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm92.ko 2024-02-28T15:34:43.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm93.ko 2024-02-28T15:34:43.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95234.ko 2024-02-28T15:34:43.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95241.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95245.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc2945.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4151.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4215.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4222.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4245.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4260.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4261.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max16065.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1619.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1668.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max197.ko 2024-02-28T15:34:43.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6639.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6650.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6697.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/mcp3021.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6683.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775-core.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct7802.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87360.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87427.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pcf8591.ko 2024-02-28T15:34:43.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-28T15:34:43.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/powr1220.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5627.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5636.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht15.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht21.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/shtc1.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sis5595.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47b397.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m1.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m192.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/thmc50.ko 2024-02-28T15:34:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp102.ko 2024-02-28T15:34:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp103.ko 2024-02-28T15:34:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp401.ko 2024-02-28T15:34:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp421.ko 2024-02-28T15:34:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via-cputemp.ko 2024-02-28T15:34:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via686a.ko 2024-02-28T15:34:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt1211.ko 2024-02-28T15:34:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt8231.ko 2024-02-28T15:34:43.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627ehf.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627hf.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83781d.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83791d.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83792d.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83793.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83795.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l785ts.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l786ng.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-28T15:34:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-28T15:34:43.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-dev.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-mux.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-28T15:34:43.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-smbus.ko 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-stub.ko 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_core.ko 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4 2024-02-28T15:34:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-28T15:34:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4 2024-02-28T15:34:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-28T15:34:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5 2024-02-28T15:34:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-28T15:34:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca 2024-02-28T15:34:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-28T15:34:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp 2024-02-28T15:34:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib 2024-02-28T15:34:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-28T15:34:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser 2024-02-28T15:34:43.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-28T15:34:43.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert 2024-02-28T15:34:43.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-28T15:34:43.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp 2024-02-28T15:34:43.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-28T15:34:43.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/gameport.ko 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/joydev.ko 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/appletouch.ko 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/bcm5974.ko 2024-02-28T15:34:43.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/cyapatp.ko 2024-02-28T15:34:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-28T15:34:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/sermouse.ko 2024-02-28T15:34:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-28T15:34:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-28T15:34:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-28T15:34:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4 2024-02-28T15:34:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-28T15:34:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio 2024-02-28T15:34:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/altera_ps2.ko 2024-02-28T15:34:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/arc_ps2.ko 2024-02-28T15:34:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-28T15:34:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/serio_raw.ko 2024-02-28T15:34:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/sparse-keymap.ko 2024-02-28T15:34:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds 2024-02-28T15:34:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-blinkm.ko 2024-02-28T15:34:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lm3530.ko 2024-02-28T15:34:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lp3944.ko 2024-02-28T15:34:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-ss4200.ko 2024-02-28T15:34:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger 2024-02-28T15:34:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-28T15:34:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-28T15:34:43.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-28T15:34:43.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-28T15:34:43.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-28T15:34:43.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-28T15:34:43.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-28T15:34:43.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-28T15:34:43.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-28T15:34:43.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md 2024-02-28T15:34:43.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache 2024-02-28T15:34:43.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache/bcache.ko 2024-02-28T15:34:43.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-bio-prison.ko 2024-02-28T15:34:43.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache-smq.ko 2024-02-28T15:34:43.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache.ko 2024-02-28T15:34:43.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-crypt.ko 2024-02-28T15:34:43.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-delay.ko 2024-02-28T15:34:43.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-flakey.ko 2024-02-28T15:34:43.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-log-userspace.ko 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-multipath.ko 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-queue-length.ko 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-raid.ko 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-round-robin.ko 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-service-time.ko 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-switch.ko 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-thin-pool.ko 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-verity.ko 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-28T15:34:43.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid0.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid1.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid10.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid456.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptbase.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptctl.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptfc.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptlan.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptsas.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptscsih.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptspi.ko 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd 2024-02-28T15:34:43.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_ich.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_sch.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/mfd-core.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/sm501.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/viperboard.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/vx855.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/wl1273-core.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds9802als.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds990x.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/bh1770glc.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710/cb710.ko 2024-02-28T15:34:43.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom 2024-02-28T15:34:43.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/at24.ko 2024-02-28T15:34:43.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-28T15:34:43.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/max6875.ko 2024-02-28T15:34:43.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/enclosure.ko 2024-02-28T15:34:43.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/hpilo.ko 2024-02-28T15:34:43.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29003.ko 2024-02-28T15:34:43.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29020.ko 2024-02-28T15:34:43.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d 2024-02-28T15:34:43.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-28T15:34:43.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-28T15:34:43.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei 2024-02-28T15:34:43.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-me.ko 2024-02-28T15:34:43.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-txe.ko 2024-02-28T15:34:43.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei.ko 2024-02-28T15:34:43.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru 2024-02-28T15:34:43.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-28T15:34:43.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp 2024-02-28T15:34:43.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_7xx1.ko 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_core.ko 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tsl2550.ko 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_balloon.ko 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding/bonding.ko 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53 2024-02-28T15:34:43.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dummy.ko 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/eql.ko 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390 2024-02-28T15:34:43.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-28T15:34:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-28T15:34:43.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros 2024-02-28T15:34:43.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx 2024-02-28T15:34:43.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-28T15:34:43.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-28T15:34:43.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-28T15:34:43.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-28T15:34:43.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-28T15:34:43.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx 2024-02-28T15:34:43.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-28T15:34:43.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-28T15:34:43.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom 2024-02-28T15:34:43.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-28T15:34:43.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-28T15:34:43.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-28T15:34:43.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-28T15:34:43.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-28T15:34:43.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet 2024-02-28T15:34:43.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-28T15:34:43.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-28T15:34:43.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade 2024-02-28T15:34:43.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna 2024-02-28T15:34:43.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-28T15:34:43.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio 2024-02-28T15:34:43.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-28T15:34:43.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-28T15:34:43.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-28T15:34:43.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-28T15:34:43.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dnet.ko 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ethoc.ko 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/fealnx.ko 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000 2024-02-28T15:34:43.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-28T15:34:43.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/jme.ko 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-28T15:34:43.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines 2024-02-28T15:34:43.818 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-28T15:34:43.820 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-28T15:34:43.820 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker 2024-02-28T15:34:43.821 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-28T15:34:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-28T15:34:43.823 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-28T15:34:43.824 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet 2024-02-28T15:34:43.825 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-28T15:34:43.827 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-28T15:34:43.827 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom 2024-02-28T15:34:43.827 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/geneve.ko 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ifb.ko 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvlan.ko 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvtap.ko 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio 2024-02-28T15:34:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mii.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/net_failover.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/netconsole.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/nlmon.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/amd.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-28T15:34:43.829 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-28T15:34:43.830 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-28T15:34:43.830 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm87xx.ko 2024-02-28T15:34:43.830 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/broadcom.ko 2024-02-28T15:34:43.830 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/cicada.ko 2024-02-28T15:34:43.830 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/davicom.ko 2024-02-28T15:34:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/dp83640.ko 2024-02-28T15:34:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/et1011c.ko 2024-02-28T15:34:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/icplus.ko 2024-02-28T15:34:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/lxt.ko 2024-02-28T15:34:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/marvell.ko 2024-02-28T15:34:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/micrel.ko 2024-02-28T15:34:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/national.ko 2024-02-28T15:34:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/phylink.ko 2024-02-28T15:34:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/qsemi.ko 2024-02-28T15:34:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/realtek.ko 2024-02-28T15:34:43.834 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/smsc.ko 2024-02-28T15:34:43.834 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/ste10Xp.ko 2024-02-28T15:34:43.834 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/vitesse.ko 2024-02-28T15:34:43.834 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp 2024-02-28T15:34:43.834 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-28T15:34:43.834 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_async.ko 2024-02-28T15:34:43.834 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-28T15:34:43.834 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-28T15:34:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-28T15:34:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-28T15:34:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppoe.ko 2024-02-28T15:34:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppox.ko 2024-02-28T15:34:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pptp.ko 2024-02-28T15:34:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip 2024-02-28T15:34:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slhc.ko 2024-02-28T15:34:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slip.ko 2024-02-28T15:34:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/sungem_phy.ko 2024-02-28T15:34:43.839 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tap.ko 2024-02-28T15:34:43.839 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team 2024-02-28T15:34:43.839 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team.ko 2024-02-28T15:34:43.839 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-28T15:34:43.839 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-28T15:34:43.839 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-28T15:34:43.839 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_random.ko 2024-02-28T15:34:43.839 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-28T15:34:43.839 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tun.ko 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/veth.ko 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/virtio_net.ko 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan/vxlan.ko 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netfront.ko 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb/ntb.ko 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host 2024-02-28T15:34:43.840 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme-core.ko 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme.ko 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport.ko 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_cs.ko 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_pc.ko 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_serial.ko 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/xen-pcifront.ko 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia 2024-02-28T15:34:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/i82092.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/pd6729.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acerhdf.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-28T15:34:43.842 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-28T15:34:43.843 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-28T15:34:43.843 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-28T15:34:43.854 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-28T15:34:43.854 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/hdaps.ko 2024-02-28T15:34:43.854 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel 2024-02-28T15:34:43.854 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-28T15:34:43.854 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel_ips.ko 2024-02-28T15:34:43.854 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-28T15:34:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps 2024-02-28T15:34:43.856 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients 2024-02-28T15:34:43.856 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-28T15:34:43.856 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-28T15:34:43.856 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps_parport.ko 2024-02-28T15:34:43.856 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/pps_core.ko 2024-02-28T15:34:43.856 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp 2024-02-28T15:34:43.856 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp.ko 2024-02-28T15:34:43.856 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp_kvm.ko 2024-02-28T15:34:43.856 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-em3027.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-28T15:34:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-max6900.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-28T15:34:43.858 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-28T15:34:43.859 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-28T15:34:43.859 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-28T15:34:43.859 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-28T15:34:43.859 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-x1205.ko 2024-02-28T15:34:43.859 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi 2024-02-28T15:34:43.859 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-9xxx.ko 2024-02-28T15:34:43.859 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-sas.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-xxxx.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/BusLogic.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/a100u2w.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/advansys.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/am53c974.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/atp870u.ko 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi 2024-02-28T15:34:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa/bfa.ko 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ch.ko 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-28T15:34:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-28T15:34:43.862 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dc395x.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dmx3191d.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esp_scsi.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-28T15:34:43.863 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-28T15:34:43.864 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic 2024-02-28T15:34:43.864 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic/fnic.ko 2024-02-28T15:34:43.864 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hpsa.ko 2024-02-28T15:34:43.864 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hptiop.ko 2024-02-28T15:34:43.864 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hv_storvsc.ko 2024-02-28T15:34:43.864 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/initio.ko 2024-02-28T15:34:43.864 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ipr.ko 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ips.ko 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci/isci.ko 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc/libfc.ko 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi.ko 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas/libsas.ko 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid 2024-02-28T15:34:43.865 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvumi.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pmcraid.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla1280.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-28T15:34:43.866 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/raid_class.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_debug.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ses.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/st.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/stex.ko 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2 2024-02-28T15:34:43.867 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/virtio_scsi.ko 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/wd719x.ko 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb/ssb.ko 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_file.ko 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_iblock.ko 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_mod.ko 2024-02-28T15:34:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_pscsi.ko 2024-02-28T15:34:43.869 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_user.ko 2024-02-28T15:34:43.869 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc 2024-02-28T15:34:43.869 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-28T15:34:43.869 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal 2024-02-28T15:34:43.869 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel 2024-02-28T15:34:43.869 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal 2024-02-28T15:34:43.869 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-28T15:34:43.869 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-28T15:34:43.870 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_gsm.ko 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_hdlc.ko 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/nozomi.ko 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-28T15:34:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/arc_uart.ko 2024-02-28T15:34:43.872 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm 2024-02-28T15:34:43.872 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-28T15:34:43.872 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs 2024-02-28T15:34:43.872 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core 2024-02-28T15:34:43.872 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-28T15:34:43.872 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host 2024-02-28T15:34:43.872 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-28T15:34:43.872 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio 2024-02-28T15:34:43.873 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio.ko 2024-02-28T15:34:43.873 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_aec.ko 2024-02-28T15:34:43.873 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_cif.ko 2024-02-28T15:34:43.873 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_pci_generic.ko 2024-02-28T15:34:43.873 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_sercos3.ko 2024-02-28T15:34:43.873 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb 2024-02-28T15:34:43.873 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class 2024-02-28T15:34:43.873 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-acm.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usblp.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usbtmc.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/mdc800.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/microtek.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/adutux.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/appledisplay.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi26.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi62.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ezusb.ko 2024-02-28T15:34:43.874 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/idmouse.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/iowarrior.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ldusb.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/legousbtower.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usb3503.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usblcd.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/uss720.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/yurex.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy/phy-generic.ko 2024-02-28T15:34:43.875 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial 2024-02-28T15:34:43.876 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/aircable.ko 2024-02-28T15:34:43.876 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ark3116.ko 2024-02-28T15:34:43.876 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-28T15:34:43.876 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ch341.ko 2024-02-28T15:34:43.876 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cp210x.ko 2024-02-28T15:34:43.876 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cyberjack.ko 2024-02-28T15:34:43.876 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-28T15:34:43.876 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-28T15:34:43.876 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/empeg.ko 2024-02-28T15:34:43.876 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_ti.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipaq.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipw.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ir-usb.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mct_u232.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7720.ko 2024-02-28T15:34:43.877 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7840.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/navman.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/omninet.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/opticon.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/option.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/oti6858.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/pl2303.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcaux.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcserial.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/quatech2.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/safe_serial.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/sierra.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ssu100.ko 2024-02-28T15:34:43.878 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/symbolserial.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_debug.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/visor.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/whiteheat.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/uas.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-28T15:34:43.879 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-28T15:34:43.880 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-28T15:34:43.880 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-28T15:34:43.880 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-28T15:34:43.880 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-28T15:34:43.880 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-karma.ko 2024-02-28T15:34:43.880 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-28T15:34:43.880 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-28T15:34:43.880 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/usb-storage.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-28T15:34:43.881 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost.ko 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_net.ko 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_scsi.ko 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/apple_bl.ko 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/lcd.ko 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio.ko 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_balloon.ko 2024-02-28T15:34:43.882 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_mmio.ko 2024-02-28T15:34:43.883 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci.ko 2024-02-28T15:34:43.883 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-28T15:34:43.883 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_ring.ko 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2482.ko 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2490.ko 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-28T15:34:43.884 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/wire.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/hpwdt.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/i6300esb.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-28T15:34:43.885 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ib700wdt.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ibmasr.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it87_wdt.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/machzwd.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/nv_tco.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/softdog.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-28T15:34:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/via_wdt.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/wdt_pci.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/xen_wdt.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-evtchn.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntalloc.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntdev.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-28T15:34:43.887 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-privcmd.ko 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p/9p.ko 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs/affs.ko 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs/befs.ko 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/binfmt_misc.ko 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs/btrfs.ko 2024-02-28T15:34:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles/cachefiles.ko 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph/ceph.ko 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda/coda.ko 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs/cramfs.ko 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm/dlm.ko 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs/f2fs.ko 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat 2024-02-28T15:34:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/fat.ko 2024-02-28T15:34:43.890 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/msdos.ko 2024-02-28T15:34:43.890 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/vfat.ko 2024-02-28T15:34:43.890 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse 2024-02-28T15:34:43.890 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/cuse.ko 2024-02-28T15:34:43.890 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/fuse.ko 2024-02-28T15:34:43.890 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2 2024-02-28T15:34:43.890 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2/gfs2.ko 2024-02-28T15:34:43.890 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs/hfs.ko 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus/hfsplus.ko 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs/isofs.ko 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs/jfs.ko 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd/lockd.ko 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix/minix.ko 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs 2024-02-28T15:34:43.891 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs/netfs.ko 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfs.ko 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv3.ko 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv4.ko 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/grace.ko 2024-02-28T15:34:43.892 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/nfs_acl.ko 2024-02-28T15:34:43.893 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd 2024-02-28T15:34:43.893 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd/nfsd.ko 2024-02-28T15:34:43.893 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2 2024-02-28T15:34:43.893 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2/nilfs2.ko 2024-02-28T15:34:43.893 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls 2024-02-28T15:34:43.893 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-celtic.ko 2024-02-28T15:34:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-centeuro.ko 2024-02-28T15:34:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-croatian.ko 2024-02-28T15:34:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-cyrillic.ko 2024-02-28T15:34:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-gaelic.ko 2024-02-28T15:34:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-greek.ko 2024-02-28T15:34:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-iceland.ko 2024-02-28T15:34:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-inuit.ko 2024-02-28T15:34:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-roman.ko 2024-02-28T15:34:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-romanian.ko 2024-02-28T15:34:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-turkish.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1250.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1251.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1255.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp737.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp775.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp850.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp852.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp855.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp857.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp860.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp861.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp862.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp863.ko 2024-02-28T15:34:43.895 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp864.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp865.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp866.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp869.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp874.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp932.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp936.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp949.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp950.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_euc-jp.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-1.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-13.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-14.ko 2024-02-28T15:34:43.896 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-15.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-2.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-3.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-4.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-5.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-6.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-7.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-9.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-r.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-ru.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-u.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-28T15:34:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_utf8.ko 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2.ko 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs 2024-02-28T15:34:43.898 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs/overlay.ko 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore/ramoops.ko 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs/reiserfs.ko 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs/romfs.ko 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client/cifs.ko 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_arc4.ko 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_md4.ko 2024-02-28T15:34:43.899 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs/squashfs.ko 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv/sysv.ko 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf/udf.ko 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs/ufs.ko 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs/xfs.ko 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel 2024-02-28T15:34:43.900 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu 2024-02-28T15:34:43.901 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu/rcutorture.ko 2024-02-28T15:34:43.901 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/torture.ko 2024-02-28T15:34:43.901 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace 2024-02-28T15:34:43.901 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-28T15:34:43.901 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib 2024-02-28T15:34:43.901 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/asn1_encoder.ko 2024-02-28T15:34:43.901 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc-itu-t.ko 2024-02-28T15:34:43.901 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc8.ko 2024-02-28T15:34:43.901 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libarc4.ko 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libdes.ko 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/libcrc32c.ko 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lru_cache.ko 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4_compress.ko 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4hc_compress.ko 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math/cordic.ko 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6/raid6_pq.ko 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon 2024-02-28T15:34:43.902 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_bm.ko 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_fsm.ko 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_kmp.ko 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd/zstd_compress.ko 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm/hwpoison-inject.ko 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/6lowpan.ko 2024-02-28T15:34:43.903 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_dest.ko 2024-02-28T15:34:43.904 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_fragment.ko 2024-02-28T15:34:43.904 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_hop.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_mobility.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_routing.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_udp.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/garp.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/mrp.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/p8022.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/psnap.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/stp.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q/8021q.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet.ko 2024-02-28T15:34:43.905 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_fd.ko 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_rdma.ko 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_virtio.ko 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv/batman-adv.ko 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/br_netfilter.ko 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/bridge.ko 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-28T15:34:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-28T15:34:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtables.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph/libceph.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/failover.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/pktgen.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp.ko 2024-02-28T15:34:43.908 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_diag.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv4.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv6.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver/dns_resolver.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/dsa_core.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_brcm.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_dsa.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_none.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_trailer.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154.ko 2024-02-28T15:34:43.909 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ah4.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/esp4.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/fou.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/gre.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/inet_diag.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_gre.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_tunnel.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_vti.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipcomp.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipip.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-28T15:34:43.910 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-28T15:34:43.911 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-28T15:34:43.911 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-28T15:34:43.911 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-28T15:34:43.911 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-28T15:34:43.911 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-28T15:34:43.911 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-28T15:34:43.911 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_bic.ko 2024-02-28T15:34:43.912 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_dctcp.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_diag.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_highspeed.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_htcp.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_hybla.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_illinois.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_lp.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_scalable.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_vegas.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_veno.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_westwood.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_yeah.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tunnel4.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_diag.ko 2024-02-28T15:34:43.913 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_tunnel.ko 2024-02-28T15:34:43.914 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-28T15:34:43.914 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6 2024-02-28T15:34:43.914 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ah6.ko 2024-02-28T15:34:43.914 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/esp6.ko 2024-02-28T15:34:43.914 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/fou6.ko 2024-02-28T15:34:43.914 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_tunnel.ko 2024-02-28T15:34:43.915 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-28T15:34:43.915 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_vti.ko 2024-02-28T15:34:43.915 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ipcomp6.ko 2024-02-28T15:34:43.915 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter 2024-02-28T15:34:43.915 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-28T15:34:43.915 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-28T15:34:43.915 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-28T15:34:43.915 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-28T15:34:43.915 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-28T15:34:43.915 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-28T15:34:43.916 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/sit.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/tunnel6.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key/af_key.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_core.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-28T15:34:43.917 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_eth.ko 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip.ko 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip6.ko 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_netlink.ko 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ppp.ko 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc/llc.ko 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154/mac802154.ko 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls/mpls_gso.ko 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set.ko 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-28T15:34:43.918 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs 2024-02-28T15:34:43.919 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-28T15:34:43.920 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conncount.ko 2024-02-28T15:34:43.921 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack.ko 2024-02-28T15:34:43.921 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-28T15:34:43.921 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-28T15:34:43.921 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-28T15:34:43.921 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-28T15:34:43.921 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-28T15:34:43.921 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-28T15:34:43.921 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-28T15:34:43.921 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_log_syslog.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-28T15:34:43.922 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_irc.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_sip.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_tables.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_log.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_chain_nat.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_compat.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_ct.ko 2024-02-28T15:34:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fib.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_hash.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_limit.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_log.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_masq.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_nat.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_numgen.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_queue.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_quota.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_redir.ko 2024-02-28T15:34:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject.ko 2024-02-28T15:34:43.925 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject_inet.ko 2024-02-28T15:34:43.925 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_socket.ko 2024-02-28T15:34:43.925 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_tunnel.ko 2024-02-28T15:34:43.925 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_AUDIT.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CT.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_DSCP.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HL.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HMARK.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LED.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LOG.ko 2024-02-28T15:34:43.926 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-28T15:34:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NETMAP.ko 2024-02-28T15:34:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFLOG.ko 2024-02-28T15:34:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-28T15:34:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_RATEEST.ko 2024-02-28T15:34:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-28T15:34:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_SECMARK.ko 2024-02-28T15:34:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-28T15:34:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-28T15:34:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TEE.ko 2024-02-28T15:34:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TPROXY.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TRACE.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_addrtype.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_bpf.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cgroup.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cluster.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_comment.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connbytes.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlabel.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlimit.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connmark.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_conntrack.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cpu.ko 2024-02-28T15:34:43.928 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dccp.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_devgroup.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dscp.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ecn.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_esp.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hashlimit.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_helper.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hl.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipcomp.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_iprange.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipvs.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_l2tp.ko 2024-02-28T15:34:43.929 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_length.ko 2024-02-28T15:34:43.930 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_limit.ko 2024-02-28T15:34:43.930 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mac.ko 2024-02-28T15:34:43.930 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mark.ko 2024-02-28T15:34:43.930 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_multiport.ko 2024-02-28T15:34:43.930 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nat.ko 2024-02-28T15:34:43.930 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nfacct.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_osf.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_owner.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_physdev.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_pkttype.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_policy.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_quota.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_rateest.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_realm.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_recent.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_sctp.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_set.ko 2024-02-28T15:34:43.933 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_socket.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_state.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_statistic.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_string.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_tcpmss.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_time.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_u32.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink/netlink_diag.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh/nsh.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/openvswitch.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-geneve.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-gre.ko 2024-02-28T15:34:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-vxlan.ko 2024-02-28T15:34:43.935 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet 2024-02-28T15:34:43.935 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet/af_packet_diag.ko 2024-02-28T15:34:43.935 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds 2024-02-28T15:34:43.935 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds.ko 2024-02-28T15:34:43.935 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_rdma.ko 2024-02-28T15:34:43.935 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_tcp.ko 2024-02-28T15:34:43.935 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched 2024-02-28T15:34:43.935 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_csum.ko 2024-02-28T15:34:43.935 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_gact.ko 2024-02-28T15:34:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_mirred.ko 2024-02-28T15:34:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_nat.ko 2024-02-28T15:34:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_pedit.ko 2024-02-28T15:34:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_police.ko 2024-02-28T15:34:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_simple.ko 2024-02-28T15:34:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_skbedit.ko 2024-02-28T15:34:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_vlan.ko 2024-02-28T15:34:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_basic.ko 2024-02-28T15:34:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_bpf.ko 2024-02-28T15:34:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_flow.ko 2024-02-28T15:34:43.939 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_fw.ko 2024-02-28T15:34:43.939 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_route.ko 2024-02-28T15:34:43.939 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_u32.ko 2024-02-28T15:34:43.939 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_cmp.ko 2024-02-28T15:34:43.939 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_ipset.ko 2024-02-28T15:34:43.939 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_meta.ko 2024-02-28T15:34:43.939 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_nbyte.ko 2024-02-28T15:34:43.939 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_text.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_u32.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_choke.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_codel.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_drr.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_fq.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_gred.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hfsc.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hhf.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_htb.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_ingress.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio_lib.ko 2024-02-28T15:34:43.940 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_multiq.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_netem.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_pie.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_plug.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_prio.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_qfq.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_red.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfb.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfq.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_tbf.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_teql.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp_diag.ko 2024-02-28T15:34:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/sunrpc.ko 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/diag.ko 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/tipc.ko 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix/unix_diag.ko 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-28T15:34:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock.ko 2024-02-28T15:34:43.943 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-28T15:34:43.943 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-28T15:34:43.943 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm 2024-02-28T15:34:43.943 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-28T15:34:43.943 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security 2024-02-28T15:34:43.943 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys 2024-02-28T15:34:43.943 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys 2024-02-28T15:34:43.943 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys/trusted.ko 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib/irqbypass.ko 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias.bin 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.alias.bin 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.bin 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.modinfo 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep.bin 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.devname 2024-02-28T15:34:43.944 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.order 2024-02-28T15:34:43.945 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.softdep 2024-02-28T15:34:43.945 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols 2024-02-28T15:34:43.945 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols.bin 2024-02-28T15:34:43.945 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:34:43.950 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:34:43.950 DEBUG:teuthology.orchestra.run.smithi087:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout:postinstall scriptlet (using /bin/sh): 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout: /usr/bin/kernel-install add 6.8.0-rc6-gbd7d00fb7248 /lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout:for file in vmlinuz System.map config; do 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248"; then 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout: cp "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248" 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout: fi 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout:done 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-28T15:34:43.978 INFO:teuthology.orchestra.run.smithi087.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-28T15:34:43.979 INFO:teuthology.orchestra.run.smithi087.stdout:new-kernel-pkg --remove 6.8.0-rc6-gbd7d00fb7248 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc6-gbd7d00fb7248.img 2024-02-28T15:34:43.979 INFO:teuthology.orchestra.run.smithi087.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:34:43.979 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-install remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:34:43.979 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-02-28T15:34:43.979 INFO:teuthology.orchestra.run.smithi087.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-28T15:34:43.979 INFO:teuthology.orchestra.run.smithi087.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-28T15:34:43.979 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/update-bootloader --remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:34:43.979 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-02-28T15:34:43.979 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2024-02-28T15:34:44.053 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2024-02-28T15:34:44.053 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2024-02-28T15:34:44.053 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.06 2024-02-28T15:34:44.053 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 68.el9 2024-02-28T15:34:44.053 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2024-02-28T15:34:44.053 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-28T15:34:44.053 INFO:teuthology.orchestra.run.smithi087.stdout:Group : Unspecified 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 8264254 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : builder@centos.org 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-28T15:34:44.054 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2024-02-28T15:34:44.055 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:34:44.055 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2024-02-28T15:34:44.055 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-28T15:34:44.056 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:34:44.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-28T15:34:44.672 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-02-28T15:34:46.143 INFO:teuthology.orchestra.run.smithi087.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-28T15:34:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-02-28T15:34:46.171 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-02-28T15:34:46.186 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.intjwV8YHn 2024-02-28T15:34:46.187 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.intjwV8YHn 2024-02-28T15:34:46.257 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.intjwV8YHn 2024-02-28T15:34:46.409 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.intjwV8YHn is 6KB 2024-02-28T15:34:46.463 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.intjwV8YHn 2024-02-28T15:34:46.477 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2024-02-28T15:34:46.541 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-28T15:34:46.542 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-28T15:34:46.542 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-28T15:34:46.542 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248.conf 2024-02-28T15:34:46.543 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:34:46.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-02-28T15:34:47.140 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-6.8.0_rc6_gbd7d00fb7248-1 ######################################## 2024-02-28T15:35:01.230 INFO:teuthology.orchestra.run.smithi057.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-28T15:35:16.684 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-28T15:35:16.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-02-28T15:35:16.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:35:24.385 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-28T15:35:24.385 DEBUG:teuthology.orchestra.run.smithi057:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-28T15:35:24.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:35:24.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/System.map 2024-02-28T15:35:24.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/config 2024-02-28T15:35:24.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel 2024-02-28T15:35:24.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch 2024-02-28T15:35:24.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86 2024-02-28T15:35:24.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-28T15:35:24.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-28T15:35:24.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ansi_cprng.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/anubis.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/arc4.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_memcpy.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_pq.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_tx.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_xor.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/raid6test.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authenc.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authencesn.ko 2024-02-28T15:35:24.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blake2b_generic.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_common.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_generic.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/camellia_generic.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast5_generic.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast6_generic.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast_common.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ccm.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cmac.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crc32_generic.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_engine.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_user.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cts.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/des_generic.ko 2024-02-28T15:35:24.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/dh_generic.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/echainiv.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/essiv.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/fcrypt.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/khazad.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4hc.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/md4.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/michael_mic.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcbc.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcrypt.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/rmd160.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/seed.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/serpent_generic.ko 2024-02-28T15:35:24.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tcrypt.ko 2024-02-28T15:35:24.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tea.ko 2024-02-28T15:35:24.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_common.ko 2024-02-28T15:35:24.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_generic.ko 2024-02-28T15:35:24.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/vmac.ko 2024-02-28T15:35:24.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/wp512.ko 2024-02-28T15:35:24.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xcbc.ko 2024-02-28T15:35:24.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xor.ko 2024-02-28T15:35:24.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xxhash_generic.ko 2024-02-28T15:35:24.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers 2024-02-28T15:35:24.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_pad.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/custom_method.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/ec_sys.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/platform_profile.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbs.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbshc.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/video.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/acard-ahci.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ahci_platform.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ata_generic.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/libahci_platform.ko 2024-02-28T15:35:24.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_acpi.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ali.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_amd.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_artop.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atiixp.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atp867x.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd640.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd64x.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cypress.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_efar.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt366.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt37x.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it8213.ko 2024-02-28T15:35:24.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it821x.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_jmicron.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_marvell.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_mpiix.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_netcell.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ninja32.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87410.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87415.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_oldpiix.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_opti.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_optidma.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pcmcia.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-28T15:35:24.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_piccolo.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_rdc.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sch.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_serverworks.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sil680.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sis.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sl82c105.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_triflex.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_via.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pdc_adma.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_inic162x.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_mv.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_nv.ko 2024-02-28T15:35:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_promise.ko 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_qstor.ko 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil.ko 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil24.ko 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sis.ko 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_svw.ko 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sx4.ko 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_uli.ko 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_via.ko 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_vsc.ko 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay 2024-02-28T15:35:24.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay/ks0108.ko 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma/bcma.ko 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe/aoe.ko 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/brd.ko 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd/drbd.ko 2024-02-28T15:35:24.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/floppy.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/loop.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/nbd.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk/null_blk.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/pktcdvd.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/rbd.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/virtio_blk.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkfront.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram/zram.ko 2024-02-28T15:35:24.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hangcheck-timer.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/via-rng.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-28T15:35:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/lp.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave/mwave.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ppdev.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tlclk.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/uv_mmtimer.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/virtio_console.ko 2024-02-28T15:35:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp.ko 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-28T15:35:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-aes.ko 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-sha.ko 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca/dca.ko 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat 2024-02-28T15:35:24.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/amd64_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/e752x_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/edac_mce_amd.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3000_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3200_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5100_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5400_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7300_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7core_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i82975x_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/ie31200_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/sb_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/x38_edac.ko 2024-02-28T15:35:24.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/edd.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-ich.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-appleir.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-aureal.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-axff.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-dr.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elecom.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elo.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-emsff.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gaff.ko 2024-02-28T15:35:24.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gt683r.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gyration.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtekff.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-hyperv.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-icade.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-keytouch.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-kye.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lcpower.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-led.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lenovo.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-28T15:35:24.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-multitouch.ko 2024-02-28T15:35:24.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-ortek.ko 2024-02-28T15:35:24.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-penmount.ko 2024-02-28T15:35:24.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-petalynx.ko 2024-02-28T15:35:24.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-picolcd.ko 2024-02-28T15:35:24.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-pl.ko 2024-02-28T15:35:24.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-plantronics.ko 2024-02-28T15:35:24.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-primax.ko 2024-02-28T15:35:24.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-rmi.ko 2024-02-28T15:35:24.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-28T15:35:24.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-common.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-saitek.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-samsung.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-28T15:35:24.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sjoy.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sony.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-speedlink.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-steelseries.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sunplus.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tivo.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tmff.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-topseed.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-twinhan.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-uclogic.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-waltop.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-wiimote.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-xinmo.ko 2024-02-28T15:35:24.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zpff.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zydacron.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/uhid.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/wacom.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_balloon.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_utils.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_vmbus.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru3.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7414.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7418.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adc128d818.ko 2024-02-28T15:35:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1025.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1026.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1029.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1031.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm9240.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ads7828.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7410.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7411.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7462.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7470.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7475.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7x10.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/amc6821.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/applesmc.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asb100.ko 2024-02-28T15:35:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asc7621.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/atxp1.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/coretemp.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dme1737.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds1621.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds620.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc1403.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc6w201.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71805f.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71882fg.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f75375s.ko 2024-02-28T15:35:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fam15h_power.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fschmd.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g760a.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g762.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl518sm.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl520sm.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5500_temp.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5k_amb.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmaem.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmpex.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina209.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina2xx.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/it87.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k10temp.ko 2024-02-28T15:35:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k8temp.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lineage-pem.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm63.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm73.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm75.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm77.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm78.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm80.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm83.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm85.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm87.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm90.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm92.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm93.ko 2024-02-28T15:35:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95234.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95241.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95245.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc2945.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4151.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4215.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4222.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4245.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4260.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4261.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max16065.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1619.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1668.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max197.ko 2024-02-28T15:35:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6639.ko 2024-02-28T15:35:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6650.ko 2024-02-28T15:35:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6697.ko 2024-02-28T15:35:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/mcp3021.ko 2024-02-28T15:35:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6683.ko 2024-02-28T15:35:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775-core.ko 2024-02-28T15:35:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775.ko 2024-02-28T15:35:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct7802.ko 2024-02-28T15:35:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87360.ko 2024-02-28T15:35:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87427.ko 2024-02-28T15:35:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pcf8591.ko 2024-02-28T15:35:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus 2024-02-28T15:35:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-28T15:35:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-28T15:35:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-28T15:35:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-28T15:35:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-28T15:35:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/powr1220.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5627.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5636.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht15.ko 2024-02-28T15:35:24.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht21.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/shtc1.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sis5595.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47b397.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m1.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m192.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/thmc50.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp102.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp103.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp401.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp421.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via-cputemp.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via686a.ko 2024-02-28T15:35:24.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt1211.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt8231.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627ehf.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627hf.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83781d.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83791d.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83792d.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83793.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83795.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l785ts.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l786ng.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-28T15:35:24.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-28T15:35:24.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-dev.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-mux.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-smbus.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-stub.ko 2024-02-28T15:35:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_core.ko 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5 2024-02-28T15:35:24.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-28T15:35:24.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca 2024-02-28T15:35:24.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-28T15:35:24.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp 2024-02-28T15:35:24.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib 2024-02-28T15:35:24.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-28T15:35:24.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser 2024-02-28T15:35:24.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-28T15:35:24.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert 2024-02-28T15:35:24.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-28T15:35:24.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/gameport.ko 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/joydev.ko 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/appletouch.ko 2024-02-28T15:35:24.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/bcm5974.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/cyapatp.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/sermouse.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/altera_ps2.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/arc_ps2.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/serio_raw.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/sparse-keymap.ko 2024-02-28T15:35:24.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-blinkm.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lm3530.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lp3944.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-ss4200.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-28T15:35:24.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache/bcache.ko 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-bio-prison.ko 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache-smq.ko 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache.ko 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-crypt.ko 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-delay.ko 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-flakey.ko 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-log-userspace.ko 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-multipath.ko 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-queue-length.ko 2024-02-28T15:35:24.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-raid.ko 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-round-robin.ko 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-service-time.ko 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-switch.ko 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-thin-pool.ko 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-verity.ko 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid0.ko 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid1.ko 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid10.ko 2024-02-28T15:35:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid456.ko 2024-02-28T15:35:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message 2024-02-28T15:35:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion 2024-02-28T15:35:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptbase.ko 2024-02-28T15:35:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptctl.ko 2024-02-28T15:35:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptfc.ko 2024-02-28T15:35:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptlan.ko 2024-02-28T15:35:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptsas.ko 2024-02-28T15:35:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptscsih.ko 2024-02-28T15:35:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptspi.ko 2024-02-28T15:35:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_ich.ko 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_sch.ko 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/mfd-core.ko 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/sm501.ko 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/viperboard.ko 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/vx855.ko 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/wl1273-core.ko 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds9802als.ko 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds990x.ko 2024-02-28T15:35:24.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/bh1770glc.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710/cb710.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/at24.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/max6875.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/enclosure.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/hpilo.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29003.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29020.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei 2024-02-28T15:35:24.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-me.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-txe.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_7xx1.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_core.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tsl2550.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_balloon.ko 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci 2024-02-28T15:35:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding/bonding.ko 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dummy.ko 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/eql.ko 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet 2024-02-28T15:35:24.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-28T15:35:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon 2024-02-28T15:35:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-28T15:35:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera 2024-02-28T15:35:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-28T15:35:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd 2024-02-28T15:35:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-28T15:35:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-28T15:35:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-28T15:35:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros 2024-02-28T15:35:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx 2024-02-28T15:35:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-28T15:35:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-28T15:35:24.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-28T15:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dnet.ko 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ethoc.ko 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/fealnx.ko 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000 2024-02-28T15:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-28T15:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/jme.ko 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-28T15:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-28T15:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-28T15:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-28T15:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-28T15:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/geneve.ko 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ifb.ko 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan 2024-02-28T15:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvlan.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvtap.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mii.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/net_failover.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/netconsole.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/nlmon.ko 2024-02-28T15:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs 2024-02-28T15:35:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-28T15:35:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-28T15:35:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy 2024-02-28T15:35:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/amd.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm87xx.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/broadcom.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/cicada.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/davicom.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/dp83640.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/et1011c.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/icplus.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/lxt.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/marvell.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/micrel.ko 2024-02-28T15:35:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/national.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/phylink.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/qsemi.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/realtek.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/smsc.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/ste10Xp.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/vitesse.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_async.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppoe.ko 2024-02-28T15:35:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppox.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pptp.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slhc.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slip.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/sungem_phy.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tap.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_random.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tun.ko 2024-02-28T15:35:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/veth.ko 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/virtio_net.ko 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan/vxlan.ko 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netfront.ko 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb/ntb.ko 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme-core.ko 2024-02-28T15:35:24.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme.ko 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport.ko 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_cs.ko 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_pc.ko 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_serial.ko 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/xen-pcifront.ko 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/i82092.ko 2024-02-28T15:35:24.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/pd6729.ko 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acerhdf.ko 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-28T15:35:24.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/hdaps.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel_ips.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-28T15:35:24.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi.ko 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps_parport.ko 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/pps_core.ko 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp.ko 2024-02-28T15:35:24.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp_kvm.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-em3027.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-28T15:35:24.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-max6900.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-28T15:35:24.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-28T15:35:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-28T15:35:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-28T15:35:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-x1205.ko 2024-02-28T15:35:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi 2024-02-28T15:35:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-9xxx.ko 2024-02-28T15:35:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-sas.ko 2024-02-28T15:35:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-xxxx.ko 2024-02-28T15:35:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/BusLogic.ko 2024-02-28T15:35:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/a100u2w.ko 2024-02-28T15:35:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/advansys.ko 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/am53c974.ko 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/atp870u.ko 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa/bfa.ko 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc 2024-02-28T15:35:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ch.ko 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dc395x.ko 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler 2024-02-28T15:35:24.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dmx3191d.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esp_scsi.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic/fnic.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hpsa.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hptiop.ko 2024-02-28T15:35:24.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hv_storvsc.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/initio.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ipr.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ips.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci/isci.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc/libfc.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas/libsas.ko 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc 2024-02-28T15:35:24.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid.ko 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvumi.ko 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pmcraid.ko 2024-02-28T15:35:24.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla1280.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/raid_class.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_debug.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ses.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/st.ko 2024-02-28T15:35:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/stex.ko 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/virtio_scsi.ko 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/wd719x.ko 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb/ssb.ko 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_file.ko 2024-02-28T15:35:24.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_iblock.ko 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_mod.ko 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_pscsi.ko 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_user.ko 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-28T15:35:24.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-28T15:35:24.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_gsm.ko 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_hdlc.ko 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/nozomi.ko 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/arc_uart.ko 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-28T15:35:24.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio.ko 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_aec.ko 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_cif.ko 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_pci_generic.ko 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_sercos3.ko 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-acm.ko 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-28T15:35:24.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usblp.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usbtmc.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/mdc800.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/microtek.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/adutux.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/appledisplay.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi26.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi62.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ezusb.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/idmouse.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/iowarrior.ko 2024-02-28T15:35:24.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ldusb.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/legousbtower.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usb3503.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usblcd.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/uss720.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/yurex.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy/phy-generic.ko 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial 2024-02-28T15:35:24.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/aircable.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ark3116.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ch341.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cp210x.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cyberjack.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/empeg.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_ti.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipaq.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipw.ko 2024-02-28T15:35:24.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ir-usb.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mct_u232.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7720.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7840.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/navman.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/omninet.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/opticon.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/option.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/oti6858.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/pl2303.ko 2024-02-28T15:35:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcaux.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcserial.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/quatech2.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/safe_serial.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/sierra.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ssu100.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/symbolserial.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_debug.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/visor.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/whiteheat.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-28T15:35:24.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/uas.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-karma.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-28T15:35:24.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-28T15:35:24.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/usb-storage.ko 2024-02-28T15:35:24.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip 2024-02-28T15:35:24.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-28T15:35:24.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-28T15:35:24.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-28T15:35:24.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio 2024-02-28T15:35:24.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci 2024-02-28T15:35:24.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-28T15:35:24.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-28T15:35:24.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio.ko 2024-02-28T15:35:24.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-28T15:35:24.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost.ko 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_net.ko 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_scsi.ko 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/apple_bl.ko 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/lcd.ko 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio.ko 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_balloon.ko 2024-02-28T15:35:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_mmio.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_ring.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2482.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2490.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-28T15:35:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/wire.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/hpwdt.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/i6300esb.ko 2024-02-28T15:35:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ib700wdt.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ibmasr.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it87_wdt.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/machzwd.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/nv_tco.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/softdog.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-28T15:35:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/via_wdt.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/wdt_pci.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/xen_wdt.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-evtchn.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntalloc.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntdev.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-privcmd.ko 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs 2024-02-28T15:35:24.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p/9p.ko 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs/affs.ko 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs/befs.ko 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/binfmt_misc.ko 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs/btrfs.ko 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles/cachefiles.ko 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph 2024-02-28T15:35:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph/ceph.ko 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda/coda.ko 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs/cramfs.ko 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm/dlm.ko 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs/f2fs.ko 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/fat.ko 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/msdos.ko 2024-02-28T15:35:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/vfat.ko 2024-02-28T15:35:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse 2024-02-28T15:35:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/cuse.ko 2024-02-28T15:35:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/fuse.ko 2024-02-28T15:35:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2 2024-02-28T15:35:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2/gfs2.ko 2024-02-28T15:35:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs 2024-02-28T15:35:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs/hfs.ko 2024-02-28T15:35:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus 2024-02-28T15:35:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus/hfsplus.ko 2024-02-28T15:35:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs/isofs.ko 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs/jfs.ko 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd/lockd.ko 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix/minix.ko 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs/netfs.ko 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout 2024-02-28T15:35:24.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfs.ko 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv3.ko 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv4.ko 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/grace.ko 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/nfs_acl.ko 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd/nfsd.ko 2024-02-28T15:35:24.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2/nilfs2.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-celtic.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-centeuro.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-croatian.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-cyrillic.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-gaelic.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-greek.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-iceland.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-inuit.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-roman.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-romanian.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-turkish.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1250.ko 2024-02-28T15:35:24.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1251.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1255.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp737.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp775.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp850.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp852.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp855.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp857.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp860.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp861.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp862.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp863.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp864.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp865.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp866.ko 2024-02-28T15:35:24.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp869.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp874.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp932.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp936.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp949.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp950.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_euc-jp.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-1.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-13.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-14.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-15.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-2.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-3.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-4.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-5.ko 2024-02-28T15:35:24.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-6.ko 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-7.ko 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-9.ko 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-r.ko 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-ru.ko 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-u.ko 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_utf8.ko 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs 2024-02-28T15:35:24.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2.ko 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs/overlay.ko 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore/ramoops.ko 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs/reiserfs.ko 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs/romfs.ko 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client 2024-02-28T15:35:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client/cifs.ko 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_arc4.ko 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_md4.ko 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs/squashfs.ko 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv/sysv.ko 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf/udf.ko 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs/ufs.ko 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs/xfs.ko 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel 2024-02-28T15:35:24.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu/rcutorture.ko 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/torture.ko 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/asn1_encoder.ko 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc-itu-t.ko 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc8.ko 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libarc4.ko 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libdes.ko 2024-02-28T15:35:24.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/libcrc32c.ko 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lru_cache.ko 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4_compress.ko 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4hc_compress.ko 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math/cordic.ko 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6/raid6_pq.ko 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_bm.ko 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_fsm.ko 2024-02-28T15:35:24.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_kmp.ko 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd/zstd_compress.ko 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm/hwpoison-inject.ko 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/6lowpan.ko 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_dest.ko 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_fragment.ko 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_hop.ko 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_mobility.ko 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_routing.ko 2024-02-28T15:35:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_udp.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/garp.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/mrp.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/p8022.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/psnap.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/stp.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q/8021q.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_fd.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_rdma.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_virtio.ko 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv 2024-02-28T15:35:24.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv/batman-adv.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/br_netfilter.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/bridge.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-28T15:35:24.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtables.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-28T15:35:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph/libceph.ko 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/failover.ko 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/pktgen.ko 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp.ko 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_diag.ko 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv4.ko 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv6.ko 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver/dns_resolver.ko 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/dsa_core.ko 2024-02-28T15:35:24.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_brcm.ko 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_dsa.ko 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_none.ko 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_trailer.ko 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154.ko 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ah4.ko 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/esp4.ko 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/fou.ko 2024-02-28T15:35:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/gre.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/inet_diag.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_gre.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_tunnel.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_vti.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipcomp.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipip.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-28T15:35:24.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-28T15:35:24.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-28T15:35:24.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-28T15:35:24.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-28T15:35:24.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-28T15:35:24.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-28T15:35:24.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-28T15:35:24.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-28T15:35:24.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-28T15:35:24.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-28T15:35:24.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-28T15:35:24.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-28T15:35:24.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-28T15:35:24.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-28T15:35:24.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-28T15:35:24.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_bic.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_dctcp.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_diag.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_highspeed.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_htcp.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_hybla.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_illinois.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_lp.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_scalable.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_vegas.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_veno.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_westwood.ko 2024-02-28T15:35:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_yeah.ko 2024-02-28T15:35:24.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tunnel4.ko 2024-02-28T15:35:24.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_diag.ko 2024-02-28T15:35:24.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_tunnel.ko 2024-02-28T15:35:24.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-28T15:35:24.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6 2024-02-28T15:35:24.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ah6.ko 2024-02-28T15:35:24.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/esp6.ko 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/fou6.ko 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_tunnel.ko 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_vti.ko 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ipcomp6.ko 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-28T15:35:24.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-28T15:35:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/sit.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/tunnel6.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key/af_key.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_core.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-28T15:35:24.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_eth.ko 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip.ko 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip6.ko 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_netlink.ko 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ppp.ko 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc/llc.ko 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154/mac802154.ko 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls/mpls_gso.ko 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set.ko 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-28T15:35:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-28T15:35:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-28T15:35:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-28T15:35:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-28T15:35:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-28T15:35:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-28T15:35:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-28T15:35:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-28T15:35:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-28T15:35:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-28T15:35:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-28T15:35:24.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conncount.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-28T15:35:24.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_log_syslog.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_irc.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_sip.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-28T15:35:24.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_tables.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_log.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_chain_nat.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_compat.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_ct.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fib.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_hash.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_limit.ko 2024-02-28T15:35:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_log.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_masq.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_nat.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_numgen.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_queue.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_quota.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_redir.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject_inet.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_socket.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_tunnel.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_AUDIT.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-28T15:35:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CT.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_DSCP.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HL.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HMARK.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LED.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LOG.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NETMAP.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFLOG.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_RATEEST.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_SECMARK.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-28T15:35:24.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TEE.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TPROXY.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TRACE.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_addrtype.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_bpf.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cgroup.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cluster.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_comment.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connbytes.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlabel.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlimit.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connmark.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_conntrack.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cpu.ko 2024-02-28T15:35:24.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dccp.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_devgroup.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dscp.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ecn.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_esp.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hashlimit.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_helper.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hl.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipcomp.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_iprange.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipvs.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_l2tp.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_length.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_limit.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mac.ko 2024-02-28T15:35:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mark.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_multiport.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nat.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nfacct.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_osf.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_owner.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_physdev.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_pkttype.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_policy.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_quota.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_rateest.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_realm.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_recent.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_sctp.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_set.ko 2024-02-28T15:35:24.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_socket.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_state.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_statistic.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_string.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_tcpmss.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_time.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_u32.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink/netlink_diag.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh/nsh.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/openvswitch.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-geneve.ko 2024-02-28T15:35:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-gre.ko 2024-02-28T15:35:24.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-vxlan.ko 2024-02-28T15:35:24.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet 2024-02-28T15:35:24.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet/af_packet_diag.ko 2024-02-28T15:35:24.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds 2024-02-28T15:35:24.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds.ko 2024-02-28T15:35:24.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_rdma.ko 2024-02-28T15:35:24.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_tcp.ko 2024-02-28T15:35:24.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched 2024-02-28T15:35:24.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_csum.ko 2024-02-28T15:35:24.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_gact.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_mirred.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_nat.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_pedit.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_police.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_simple.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_skbedit.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_vlan.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_basic.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_bpf.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_flow.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_fw.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_route.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_u32.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_cmp.ko 2024-02-28T15:35:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_ipset.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_meta.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_nbyte.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_text.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_u32.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_choke.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_codel.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_drr.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_fq.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_gred.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hfsc.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hhf.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_htb.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_ingress.ko 2024-02-28T15:35:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio_lib.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_multiq.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_netem.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_pie.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_plug.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_prio.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_qfq.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_red.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfb.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfq.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_tbf.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_teql.ko 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp 2024-02-28T15:35:24.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp.ko 2024-02-28T15:35:24.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp_diag.ko 2024-02-28T15:35:24.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc 2024-02-28T15:35:24.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss 2024-02-28T15:35:24.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-28T15:35:24.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-28T15:35:24.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/sunrpc.ko 2024-02-28T15:35:24.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma 2024-02-28T15:35:24.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-28T15:35:24.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc 2024-02-28T15:35:24.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/diag.ko 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/tipc.ko 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix/unix_diag.ko 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock.ko 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security 2024-02-28T15:35:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys 2024-02-28T15:35:24.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys 2024-02-28T15:35:24.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-28T15:35:24.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys 2024-02-28T15:35:24.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys/trusted.ko 2024-02-28T15:35:24.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt 2024-02-28T15:35:24.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib 2024-02-28T15:35:24.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib/irqbypass.ko 2024-02-28T15:35:24.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias 2024-02-28T15:35:24.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias.bin 2024-02-28T15:35:24.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.alias.bin 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.bin 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.modinfo 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep.bin 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.devname 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.order 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.softdep 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols.bin 2024-02-28T15:35:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:35:24.623 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:35:24.623 DEBUG:teuthology.orchestra.run.smithi057:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-28T15:35:24.648 INFO:teuthology.orchestra.run.smithi057.stdout:postinstall scriptlet (using /bin/sh): 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout: /usr/bin/kernel-install add 6.8.0-rc6-gbd7d00fb7248 /lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:for file in vmlinuz System.map config; do 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248"; then 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout: cp "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248" 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout: fi 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:done 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:new-kernel-pkg --remove 6.8.0-rc6-gbd7d00fb7248 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc6-gbd7d00fb7248.img 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-install remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:35:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2024-02-28T15:35:24.650 INFO:teuthology.orchestra.run.smithi057.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-28T15:35:24.650 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-28T15:35:24.650 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/update-bootloader --remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:35:24.650 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2024-02-28T15:35:24.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -qi grub2-tools 2024-02-28T15:35:24.727 INFO:teuthology.orchestra.run.smithi057.stdout:Name : grub2-tools 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Epoch : 1 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Version : 2.06 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Release : 68.el9 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: x86_64 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Group : Unspecified 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Size : 8264254 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:License : GPLv3+ 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Packager : builder@centos.org 2024-02-28T15:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:Vendor : CentOS 2024-02-28T15:35:24.729 INFO:teuthology.orchestra.run.smithi057.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-28T15:35:24.729 INFO:teuthology.orchestra.run.smithi057.stdout:Summary : Support tools for GRUB. 2024-02-28T15:35:24.729 INFO:teuthology.orchestra.run.smithi057.stdout:Description : 2024-02-28T15:35:24.729 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:35:24.729 INFO:teuthology.orchestra.run.smithi057.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-28T15:35:24.729 INFO:teuthology.orchestra.run.smithi057.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-28T15:35:24.729 INFO:teuthology.orchestra.run.smithi057.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-28T15:35:24.729 INFO:teuthology.orchestra.run.smithi057.stdout:hardware devices. 2024-02-28T15:35:24.729 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:35:24.729 INFO:teuthology.orchestra.run.smithi057.stdout:This subpackage provides tools for support of all platforms. 2024-02-28T15:35:24.730 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-28T15:35:24.730 INFO:teuthology.task.kernel:Updating grub on smithi057 to boot 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:35:24.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-28T15:35:25.319 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2024-02-28T15:35:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-28T15:35:26.776 INFO:teuthology.orchestra.run.smithi057.stderr:done 2024-02-28T15:35:26.787 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-02-28T15:35:26.802 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.ZShAx3BgMj 2024-02-28T15:35:26.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ZShAx3BgMj 2024-02-28T15:35:26.875 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.ZShAx3BgMj 2024-02-28T15:35:27.142 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.ZShAx3BgMj is 6KB 2024-02-28T15:35:27.190 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.ZShAx3BgMj 2024-02-28T15:35:27.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo /bin/ls /boot/loader/entries || true 2024-02-28T15:35:27.279 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-28T15:35:27.279 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-28T15:35:27.279 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-28T15:35:27.279 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248.conf 2024-02-28T15:35:27.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:35:27.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2024-02-28T15:35:57.496 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-28T15:35:57.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-02-28T15:35:57.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:36:16.711 DEBUG:teuthology.orchestra.remote:timed out 2024-02-28T15:36:25.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-02-28T15:36:25.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:36:32.060 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-02-28T15:36:33.258 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-02-28T15:36:33.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-02-28T15:36:33.899 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.8.0-rc6-gbd7d00fb7248"... 2024-02-28T15:36:33.900 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-02-28T15:36:33.937 INFO:teuthology.orchestra.run.smithi087.stdout:6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:36:33.937 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc6-gbd7d00fb7248 vs 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:36:33.937 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-28T15:36:33.937 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-28T15:36:34.938 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-28T15:36:34.938 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-28T15:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-02-28T15:36:35.101 DEBUG:teuthology.parallel:result is None 2024-02-28T15:36:41.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-02-28T15:36:41.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:37:41.064 DEBUG:teuthology.orchestra.remote:timed out 2024-02-28T15:37:53.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-02-28T15:37:53.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:37:53.433 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-02-28T15:37:54.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-02-28T15:37:54.131 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.8.0-rc6-gbd7d00fb7248"... 2024-02-28T15:37:54.131 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-02-28T15:37:54.187 INFO:teuthology.orchestra.run.smithi057.stdout:6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:37:54.188 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc6-gbd7d00fb7248 vs 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:37:54.188 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-28T15:37:54.188 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-28T15:37:55.189 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-28T15:37:55.189 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-28T15:37:55.338 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2024-02-28T15:37:55.401 DEBUG:teuthology.parallel:result is None 2024-02-28T15:37:55.402 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-28T15:37:55.410 INFO:teuthology.task.internal:Creating test directory... 2024-02-28T15:37:55.410 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-28T15:37:55.417 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-28T15:37:55.477 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-28T15:37:55.484 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-28T15:37:55.497 INFO:teuthology.task.internal:Creating archive directory... 2024-02-28T15:37:55.497 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-28T15:37:55.505 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-28T15:37:55.581 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-28T15:37:55.588 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-28T15:37:55.589 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-28T15:37:55.597 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-28T15:37:55.703 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T15:37:55.705 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T15:37:55.742 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T15:37:55.751 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T15:37:55.756 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-28T15:37:55.764 INFO:teuthology.task.internal:Configuring sudo... 2024-02-28T15:37:55.764 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-28T15:37:55.769 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-28T15:37:55.865 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-28T15:37:55.873 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-28T15:37:55.874 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-28T15:37:55.881 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-28T15:37:55.935 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T15:37:56.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T15:37:56.161 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T15:37:56.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T15:37:56.352 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:37:56.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-28T15:37:56.448 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T15:37:56.533 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T15:37:56.660 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T15:37:56.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T15:37:56.839 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:37:56.839 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-28T15:37:56.932 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-02-28T15:37:56.940 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-02-28T15:37:57.061 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T15:37:57.064 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T15:37:57.598 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-28T15:37:57.606 INFO:teuthology.task.internal:Starting timer... 2024-02-28T15:37:57.606 INFO:teuthology.run_tasks:Running task pcp... 2024-02-28T15:37:57.616 INFO:teuthology.run_tasks:Running task selinux... 2024-02-28T15:37:57.627 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-28T15:37:57.627 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2024-02-28T15:37:57.747 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2024-02-28T15:37:57.752 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-02-28T15:37:57.893 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-02-28T15:37:57.899 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-28T15:37:57.899 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2024-02-28T15:37:57.968 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2024-02-28T15:37:57.968 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-02-28T15:37:58.026 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-02-28T15:37:58.026 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi087.front.sepia.ceph.com': 'permissive'} 2024-02-28T15:37:58.026 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T15:37:58.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T15:37:58.106 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T15:37:58.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T15:37:58.188 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-28T15:37:58.189 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2024-02-28T15:37:58.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-02-28T15:37:58.383 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-28T15:37:58.393 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-28T15:37:58.398 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-28T15:37:58.513 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-28T15:37:58.531 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-28T15:37:58.533 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi087.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-28T15:44:20.171 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com')] 2024-02-28T15:44:20.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-02-28T15:44:20.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:44:20.342 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-02-28T15:44:20.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-02-28T15:44:20.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-02-28T15:44:20.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:44:20.633 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-02-28T15:44:20.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-02-28T15:44:20.783 INFO:teuthology.run_tasks:Running task clock... 2024-02-28T15:44:20.795 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-28T15:44:20.795 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-28T15:44:20.795 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T15:44:20.803 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-28T15:44:20.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T15:44:20.905 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-28T15:44:20.908 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-28T15:44:20.960 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-28T15:44:20.966 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-28T15:44:21.056 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-02-28T15:44:21.066 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2024-02-28T15:44:21.143 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-02-28T15:44:21.143 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2024-02-28T15:44:21.156 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-28T15:44:21.160 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-28T15:44:21.210 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-28T15:44:21.212 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-28T15:44:21.337 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-02-28T15:44:21.341 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2024-02-28T15:44:21.344 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T15:44:21.344 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-02-28T15:44:21.345 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T15:44:21.345 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T15:44:21.345 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T15:44:21.345 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T15:44:21.352 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T15:44:21.352 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-02-28T15:44:21.352 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T15:44:21.352 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T15:44:21.352 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T15:44:21.352 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T15:44:21.353 INFO:teuthology.run_tasks:Running task install... 2024-02-28T15:44:21.363 DEBUG:teuthology.task.install:project ceph 2024-02-28T15:44:21.363 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}} 2024-02-28T15:44:21.363 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-02-28T15:44:21.363 INFO:teuthology.task.install:Using flavor: default 2024-02-28T15:44:21.376 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-28T15:44:21.376 INFO:teuthology.task.install:extra packages: [] 2024-02-28T15:44:21.377 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': None, 'wait_for_package': False} 2024-02-28T15:44:21.377 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T15:44:21.377 INFO:teuthology.packaging:ref: None 2024-02-28T15:44:21.377 INFO:teuthology.packaging:tag: None 2024-02-28T15:44:21.377 INFO:teuthology.packaging:branch: quincy 2024-02-28T15:44:21.377 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:44:21.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-28T15:44:21.379 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': None, 'wait_for_package': False} 2024-02-28T15:44:21.380 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T15:44:21.380 INFO:teuthology.packaging:ref: None 2024-02-28T15:44:21.380 INFO:teuthology.packaging:tag: None 2024-02-28T15:44:21.380 INFO:teuthology.packaging:branch: quincy 2024-02-28T15:44:21.380 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:44:21.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-28T15:44:21.831 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/ 2024-02-28T15:44:21.831 INFO:teuthology.task.install.rpm:Package version is 17.2.7-535.gc0f02e60 2024-02-28T15:44:21.838 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/ 2024-02-28T15:44:21.839 INFO:teuthology.task.install.rpm:Package version is 17.2.7-535.gc0f02e60 2024-02-28T15:44:22.096 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-28T15:44:22.096 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:44:22.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-28T15:44:22.105 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-28T15:44:22.105 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:44:22.105 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-28T15:44:22.205 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-28T15:44:22.205 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T15:44:22.205 INFO:teuthology.packaging:ref: None 2024-02-28T15:44:22.205 INFO:teuthology.packaging:tag: None 2024-02-28T15:44:22.205 INFO:teuthology.packaging:branch: quincy 2024-02-28T15:44:22.205 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:44:22.205 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-28T15:44:22.206 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-28T15:44:22.206 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T15:44:22.206 INFO:teuthology.packaging:ref: None 2024-02-28T15:44:22.206 INFO:teuthology.packaging:tag: None 2024-02-28T15:44:22.207 INFO:teuthology.packaging:branch: quincy 2024-02-28T15:44:22.207 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:44:22.207 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-28T15:44:22.344 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-28T15:44:22.351 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-28T15:44:22.475 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-28T15:44:22.487 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-28T15:44:22.559 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-02-28T15:44:22.563 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-02-28T15:44:22.585 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2024-02-28T15:44:22.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2024-02-28T15:44:22.914 INFO:teuthology.orchestra.run.smithi087.stdout:74 files removed 2024-02-28T15:44:22.952 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw 2024-02-28T15:44:22.954 INFO:teuthology.orchestra.run.smithi057.stdout:74 files removed 2024-02-28T15:44:22.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw 2024-02-28T15:44:24.000 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 142 kB/s | 77 kB 00:00 2024-02-28T15:44:24.061 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 144 kB/s | 77 kB 00:00 2024-02-28T15:44:24.595 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 21 kB/s | 9.2 kB 00:00 2024-02-28T15:44:24.626 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 17 kB/s | 9.2 kB 00:00 2024-02-28T15:44:25.404 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 2.5 kB/s | 1.8 kB 00:00 2024-02-28T15:44:25.476 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 2.3 kB/s | 1.8 kB 00:00 2024-02-28T15:44:26.699 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - AppStream 7.1 MB/s | 8.1 MB 00:01 2024-02-28T15:44:26.874 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - AppStream 5.8 MB/s | 8.1 MB 00:01 2024-02-28T15:44:28.555 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.5 MB 00:00 2024-02-28T15:44:28.875 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - BaseOS 5.4 MB/s | 2.5 MB 00:00 2024-02-28T15:44:29.929 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-02-28T15:44:29.931 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.0 MB 00:00 2024-02-28T15:44:34.546 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 19 MB 00:03 2024-02-28T15:44:40.719 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.1 MB 00:02 2024-02-28T15:44:42.382 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 15 kB 00:00 2024-02-28T15:44:54.992 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 825 kB/s | 19 MB 00:23 2024-02-28T15:45:05.812 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 903 kB/s | 20 MB 00:23 2024-02-28T15:45:09.042 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 617 kB/s | 6.1 MB 00:10 2024-02-28T15:45:11.051 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 15 kB 00:00 2024-02-28T15:45:11.848 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-02-28T15:45:13.850 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 20 MB 00:02 2024-02-28T15:45:14.645 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:45:14.645 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:45:14.645 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:45:14.645 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.645 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:45:14.645 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.645 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:45:14.645 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.645 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:45:14.646 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.647 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.648 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:45:14.649 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.650 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:45:14.650 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.650 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:45:14.650 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.650 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:45:14.650 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.651 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.652 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.653 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:45:14.654 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.655 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.655 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:45:14.655 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:45:15.318 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:45:15.337 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:45:15.337 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-02-28T15:45:15.337 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:45:15.337 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:45:15.337 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 14 M 2024-02-28T15:45:15.337 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 3.1 M 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.9 M 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 5.0 M 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 23 M 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 25 k 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 636 k 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-28T15:45:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 458 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 4.9 M 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 45 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 116 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 156 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 320 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 293 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 99 k 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:15.339 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:45:15.340 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:45:15.340 INFO:teuthology.orchestra.run.smithi057.stdout:Install 22 Packages 2024-02-28T15:45:15.340 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 2 Packages 2024-02-28T15:45:15.340 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:15.340 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 58 M 2024-02-28T15:45:15.340 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:45:16.666 INFO:teuthology.orchestra.run.smithi057.stdout:(1/24): ceph-base-17.2.7-535.gc0f02e60.el9.x86_ 4.3 MB/s | 5.0 MB 00:01 2024-02-28T15:45:16.732 INFO:teuthology.orchestra.run.smithi057.stdout:(2/24): ceph-selinux-17.2.7-535.gc0f02e60.el9.x 385 kB/s | 25 kB 00:00 2024-02-28T15:45:16.941 INFO:teuthology.orchestra.run.smithi057.stdout:(3/24): ceph-radosgw-17.2.7-535.gc0f02e60.el9.x 9.8 MB/s | 14 MB 00:01 2024-02-28T15:45:16.991 INFO:teuthology.orchestra.run.smithi057.stdout:(4/24): libcephfs2-17.2.7-535.gc0f02e60.el9.x86 2.4 MB/s | 636 kB 00:00 2024-02-28T15:45:17.033 INFO:teuthology.orchestra.run.smithi057.stdout:(5/24): libradosstriper1-17.2.7-535.gc0f02e60.e 4.9 MB/s | 458 kB 00:00 2024-02-28T15:45:17.092 INFO:teuthology.orchestra.run.smithi057.stdout:(6/24): python3-ceph-argparse-17.2.7-535.gc0f02 785 kB/s | 45 kB 00:00 2024-02-28T15:45:17.159 INFO:teuthology.orchestra.run.smithi057.stdout:(7/24): python3-ceph-common-17.2.7-535.gc0f02e6 1.7 MB/s | 116 kB 00:00 2024-02-28T15:45:17.226 INFO:teuthology.orchestra.run.smithi057.stdout:(8/24): python3-cephfs-17.2.7-535.gc0f02e60.el9 2.3 MB/s | 156 kB 00:00 2024-02-28T15:45:17.301 INFO:teuthology.orchestra.run.smithi057.stdout:(9/24): python3-rados-17.2.7-535.gc0f02e60.el9. 4.2 MB/s | 320 kB 00:00 2024-02-28T15:45:17.376 INFO:teuthology.orchestra.run.smithi057.stdout:(10/24): python3-rbd-17.2.7-535.gc0f02e60.el9.x 3.9 MB/s | 293 kB 00:00 2024-02-28T15:45:17.435 INFO:teuthology.orchestra.run.smithi057.stdout:(11/24): python3-rgw-17.2.7-535.gc0f02e60.el9.x 1.7 MB/s | 99 kB 00:00 2024-02-28T15:45:17.519 INFO:teuthology.orchestra.run.smithi057.stdout:(12/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-02-28T15:45:17.636 INFO:teuthology.orchestra.run.smithi057.stdout:(13/24): librgw2-17.2.7-535.gc0f02e60.el9.x86_6 7.6 MB/s | 4.9 MB 00:00 2024-02-28T15:45:17.694 INFO:teuthology.orchestra.run.smithi057.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 260 kB/s | 45 kB 00:00 2024-02-28T15:45:17.778 INFO:teuthology.orchestra.run.smithi057.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-02-28T15:45:17.811 INFO:teuthology.orchestra.run.smithi057.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 292 kB 00:00 2024-02-28T15:45:17.862 INFO:teuthology.orchestra.run.smithi057.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 510 kB/s | 42 kB 00:00 2024-02-28T15:45:18.162 INFO:teuthology.orchestra.run.smithi057.stdout:(18/24): ceph-common-17.2.7-535.gc0f02e60.el9.x 8.5 MB/s | 23 MB 00:02 2024-02-28T15:45:18.187 INFO:teuthology.orchestra.run.smithi057.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 150 kB/s | 49 kB 00:00 2024-02-28T15:45:18.338 INFO:teuthology.orchestra.run.smithi057.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 387 kB/s | 67 kB 00:00 2024-02-28T15:45:18.396 INFO:teuthology.orchestra.run.smithi057.stdout:(21/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 529 kB/s | 309 kB 00:00 2024-02-28T15:45:18.480 INFO:teuthology.orchestra.run.smithi057.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-02-28T15:45:18.772 INFO:teuthology.orchestra.run.smithi057.stdout:(23/24): librbd1-17.2.7-535.gc0f02e60.el9.x86_6 7.8 MB/s | 2.9 MB 00:00 2024-02-28T15:45:18.864 INFO:teuthology.orchestra.run.smithi057.stdout:(24/24): librados2-17.2.7-535.gc0f02e60.el9.x86 5.9 MB/s | 3.1 MB 00:00 2024-02-28T15:45:18.869 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:45:18.869 INFO:teuthology.orchestra.run.smithi057.stdout:Total 16 MB/s | 58 MB 00:03 2024-02-28T15:45:19.073 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:45:19.156 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:45:19.156 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:45:19.695 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:45:19.695 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:45:19.736 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-02-28T15:45:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:45:21.454 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-28T15:45:21.507 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T15:45:21.634 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T15:45:21.767 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 3/26 2024-02-28T15:45:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T15:45:21.928 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T15:45:21.998 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-28T15:45:22.042 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-28T15:45:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:45:22.428 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:45:22.428 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:45:22.428 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.428 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:45:22.428 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.428 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:45:22.428 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.429 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:45:22.430 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:45:22.431 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:45:22.432 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.433 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.434 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.435 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.436 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:45:22.598 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-28T15:45:22.629 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 8/26 2024-02-28T15:45:22.728 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 8/26 2024-02-28T15:45:22.769 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-28T15:45:22.838 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x 10/26 2024-02-28T15:45:22.889 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 11/26 2024-02-28T15:45:22.991 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 12/26 2024-02-28T15:45:23.023 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T15:45:23.124 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T15:45:23.130 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:45:23.143 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:45:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-02-28T15:45:23.143 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:45:23.143 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 14 M 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 3.1 M 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.9 M 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 5.0 M 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 23 M 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 25 k 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 636 k 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-28T15:45:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 458 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 4.9 M 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 45 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 116 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 156 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 320 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 293 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 99 k 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-28T15:45:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:45:23.146 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:45:23.146 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:45:23.146 INFO:teuthology.orchestra.run.smithi087.stdout:Install 22 Packages 2024-02-28T15:45:23.146 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 2 Packages 2024-02-28T15:45:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:45:23.146 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 58 M 2024-02-28T15:45:23.146 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:45:23.195 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-28T15:45:23.253 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-28T15:45:23.303 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-28T15:45:23.701 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-28T15:45:23.736 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 18/26 2024-02-28T15:45:23.833 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 18/26 2024-02-28T15:45:23.932 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 19/26 2024-02-28T15:45:23.963 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86 20/26 2024-02-28T15:45:24.704 INFO:teuthology.orchestra.run.smithi087.stdout:(1/24): ceph-radosgw-17.2.7-535.gc0f02e60.el9.x 12 MB/s | 14 MB 00:01 2024-02-28T15:45:24.754 INFO:teuthology.orchestra.run.smithi087.stdout:(2/24): ceph-selinux-17.2.7-535.gc0f02e60.el9.x 513 kB/s | 25 kB 00:00 2024-02-28T15:45:24.871 INFO:teuthology.orchestra.run.smithi087.stdout:(3/24): ceph-base-17.2.7-535.gc0f02e60.el9.x86_ 3.8 MB/s | 5.0 MB 00:01 2024-02-28T15:45:24.921 INFO:teuthology.orchestra.run.smithi087.stdout:(4/24): libcephfs2-17.2.7-535.gc0f02e60.el9.x86 3.7 MB/s | 636 kB 00:00 2024-02-28T15:45:24.988 INFO:teuthology.orchestra.run.smithi087.stdout:(5/24): libradosstriper1-17.2.7-535.gc0f02e60.e 3.8 MB/s | 458 kB 00:00 2024-02-28T15:45:25.080 INFO:teuthology.orchestra.run.smithi087.stdout:(6/24): python3-ceph-argparse-17.2.7-535.gc0f02 496 kB/s | 45 kB 00:00 2024-02-28T15:45:25.247 INFO:teuthology.orchestra.run.smithi087.stdout:(7/24): librgw2-17.2.7-535.gc0f02e60.el9.x86_64 15 MB/s | 4.9 MB 00:00 2024-02-28T15:45:25.281 INFO:teuthology.orchestra.run.smithi087.stdout:(8/24): python3-ceph-common-17.2.7-535.gc0f02e6 582 kB/s | 116 kB 00:00 2024-02-28T15:45:25.315 INFO:teuthology.orchestra.run.smithi087.stdout:(9/24): python3-cephfs-17.2.7-535.gc0f02e60.el9 2.3 MB/s | 156 kB 00:00 2024-02-28T15:45:25.390 INFO:teuthology.orchestra.run.smithi087.stdout:(10/24): python3-rados-17.2.7-535.gc0f02e60.el9 2.9 MB/s | 320 kB 00:00 2024-02-28T15:45:25.424 INFO:teuthology.orchestra.run.smithi087.stdout:(11/24): python3-rbd-17.2.7-535.gc0f02e60.el9.x 2.6 MB/s | 293 kB 00:00 2024-02-28T15:45:25.457 INFO:teuthology.orchestra.run.smithi087.stdout:(12/24): python3-rgw-17.2.7-535.gc0f02e60.el9.x 1.5 MB/s | 99 kB 00:00 2024-02-28T15:45:25.691 INFO:teuthology.orchestra.run.smithi087.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 195 kB/s | 45 kB 00:00 2024-02-28T15:45:25.766 INFO:teuthology.orchestra.run.smithi087.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 469 kB/s | 160 kB 00:00 2024-02-28T15:45:25.975 INFO:teuthology.orchestra.run.smithi087.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-02-28T15:45:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 424 kB/s | 42 kB 00:00 2024-02-28T15:45:26.276 INFO:teuthology.orchestra.run.smithi087.stdout:(17/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-02-28T15:45:26.543 INFO:teuthology.orchestra.run.smithi087.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 663 kB/s | 309 kB 00:00 2024-02-28T15:45:26.618 INFO:teuthology.orchestra.run.smithi087.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 142 kB/s | 49 kB 00:00 2024-02-28T15:45:26.652 INFO:teuthology.orchestra.run.smithi087.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 625 kB/s | 67 kB 00:00 2024-02-28T15:45:26.757 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T15:45:26.827 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T15:45:26.944 INFO:teuthology.orchestra.run.smithi087.stdout:(21/24): ceph-common-17.2.7-535.gc0f02e60.el9.x 6.6 MB/s | 23 MB 00:03 2024-02-28T15:45:27.219 INFO:teuthology.orchestra.run.smithi087.stdout:(22/24): librbd1-17.2.7-535.gc0f02e60.el9.x86_6 11 MB/s | 2.9 MB 00:00 2024-02-28T15:45:27.344 INFO:teuthology.orchestra.run.smithi087.stdout:(23/24): librados2-17.2.7-535.gc0f02e60.el9.x86 4.4 MB/s | 3.1 MB 00:00 2024-02-28T15:45:27.502 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T15:45:27.544 INFO:teuthology.orchestra.run.smithi087.stdout:(24/24): thrift-0.15.0-2.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2024-02-28T15:45:27.547 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 22/26 2024-02-28T15:45:27.549 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:45:27.550 INFO:teuthology.orchestra.run.smithi087.stdout:Total 13 MB/s | 58 MB 00:04 2024-02-28T15:45:27.703 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 22/26 2024-02-28T15:45:27.704 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-28T15:45:27.704 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-28T15:45:27.704 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:27.740 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:45:27.740 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T15:45:27.814 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:45:27.814 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:45:28.372 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:45:28.373 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:45:29.790 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:45:30.390 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-28T15:45:30.421 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T15:45:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T15:45:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 3/26 2024-02-28T15:45:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T15:45:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T15:45:30.938 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-28T15:45:30.974 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-28T15:45:31.521 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-28T15:45:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 8/26 2024-02-28T15:45:31.709 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 8/26 2024-02-28T15:45:31.750 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-28T15:45:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x 10/26 2024-02-28T15:45:31.874 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 11/26 2024-02-28T15:45:31.979 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 12/26 2024-02-28T15:45:32.035 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T15:45:32.184 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T15:45:32.249 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-28T15:45:32.291 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-28T15:45:32.332 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-28T15:45:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-28T15:45:32.750 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 18/26 2024-02-28T15:45:32.922 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 18/26 2024-02-28T15:45:33.020 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 19/26 2024-02-28T15:45:33.061 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86 20/26 2024-02-28T15:45:35.992 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T15:45:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T15:45:36.677 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T15:45:36.725 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 22/26 2024-02-28T15:45:36.902 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 22/26 2024-02-28T15:45:36.903 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-28T15:45:36.903 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-28T15:45:36.903 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:45:36.943 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T15:45:39.138 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T15:45:39.138 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2024-02-28T15:45:39.138 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2024-02-28T15:45:39.138 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2024-02-28T15:45:39.138 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2024-02-28T15:45:39.138 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2024-02-28T15:45:39.138 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /root 2024-02-28T15:45:39.138 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2024-02-28T15:45:39.138 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:40.607 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 24/26 2024-02-28T15:45:40.743 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 24/26 2024-02-28T15:45:40.743 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:45:40.743 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-28T15:45:40.743 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T15:45:40.743 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T15:45:40.744 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:40.751 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-28T15:45:40.859 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-28T15:45:40.859 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T15:45:42.534 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T15:45:42.534 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 1/26 2024-02-28T15:45:42.534 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T15:45:42.534 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 3/26 2024-02-28T15:45:42.534 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T15:45:42.534 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 5/26 2024-02-28T15:45:42.534 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 6/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 7/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x 8/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86 9/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 10/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 11/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 12/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-28T15:45:42.535 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-28T15:45:42.536 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-28T15:45:42.536 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-28T15:45:42.536 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-28T15:45:42.536 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T15:45:42.536 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-28T15:45:42.536 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 25/26 2024-02-28T15:45:43.335 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T15:45:43.335 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:43.335 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-02-28T15:45:43.335 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.335 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.335 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:45:43.335 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.335 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.335 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.335 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.337 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-28T15:45:43.337 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.337 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.337 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:43.337 INFO:teuthology.orchestra.run.smithi057.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-28T15:45:43.337 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:43.337 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:45:43.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-test 2024-02-28T15:45:44.713 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:33 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:45:45.035 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.036 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:45:45.037 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:45:45.038 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.039 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:45:45.039 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.039 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:45:45.039 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.039 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:45:45.039 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.039 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:45:45.039 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.039 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:45:45.039 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.040 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:45:45.040 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.040 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:45:45.040 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.040 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:45:45.040 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.040 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:45:45.040 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.040 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:45:45.040 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.041 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:45:45.041 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.041 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:45:45.041 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.041 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:45:45.041 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.042 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.043 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.044 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.045 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:45:45.045 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.045 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.045 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.045 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.045 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:45:45.046 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.046 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.046 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.046 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.046 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:45:45.046 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.046 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.047 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.047 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.047 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:45:45.047 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.047 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.047 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.048 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:45:45.114 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:45:45.115 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:45:45.115 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-02-28T15:45:45.115 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:45:45.115 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 48 M 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 162 k 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout:Install 6 Packages 2024-02-28T15:45:45.116 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:45.117 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 49 M 2024-02-28T15:45:45.117 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 196 M 2024-02-28T15:45:45.117 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:45:45.552 INFO:teuthology.orchestra.run.smithi057.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 636 kB/s | 187 kB 00:00 2024-02-28T15:45:45.684 INFO:teuthology.orchestra.run.smithi057.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.6 MB/s | 218 kB 00:00 2024-02-28T15:45:45.802 INFO:teuthology.orchestra.run.smithi057.stdout:(3/6): libcephsqlite-17.2.7-535.gc0f02e60.el9.x 298 kB/s | 162 kB 00:00 2024-02-28T15:45:46.011 INFO:teuthology.orchestra.run.smithi057.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 307 kB/s | 64 kB 00:00 2024-02-28T15:45:46.044 INFO:teuthology.orchestra.run.smithi057.stdout:(5/6): socat-1.7.4.1-5.el9.x86_64.rpm 850 kB/s | 305 kB 00:00 2024-02-28T15:45:47.723 INFO:teuthology.orchestra.run.smithi057.stdout:(6/6): ceph-test-17.2.7-535.gc0f02e60.el9.x86_6 19 MB/s | 48 MB 00:02 2024-02-28T15:45:47.726 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:45:47.727 INFO:teuthology.orchestra.run.smithi057.stdout:Total 19 MB/s | 49 MB 00:02 2024-02-28T15:45:47.877 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:45:47.933 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:45:47.933 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:45:48.024 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T15:45:48.024 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-02-28T15:45:48.024 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-02-28T15:45:48.024 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-02-28T15:45:48.025 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-02-28T15:45:48.025 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-02-28T15:45:48.025 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-02-28T15:45:48.025 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-02-28T15:45:48.025 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:45:48.416 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:45:48.417 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:45:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:45:49.218 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-02-28T15:45:49.263 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-02-28T15:45:49.307 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-02-28T15:45:49.370 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-02-28T15:45:49.399 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 5/6 2024-02-28T15:45:49.516 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 24/26 2024-02-28T15:45:49.647 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 24/26 2024-02-28T15:45:49.647 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:45:49.647 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-28T15:45:49.647 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T15:45:49.647 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T15:45:49.648 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:45:49.652 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-28T15:45:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-28T15:45:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T15:45:51.548 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T15:45:51.548 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 1/26 2024-02-28T15:45:51.548 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T15:45:51.548 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 3/26 2024-02-28T15:45:51.548 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T15:45:51.548 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 5/26 2024-02-28T15:45:51.548 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 6/26 2024-02-28T15:45:51.548 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 7/26 2024-02-28T15:45:51.548 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x 8/26 2024-02-28T15:45:51.548 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86 9/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 10/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 11/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 12/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-28T15:45:51.549 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-28T15:45:51.550 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-28T15:45:51.550 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-28T15:45:51.550 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T15:45:51.550 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-28T15:45:51.550 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 25/26 2024-02-28T15:45:52.468 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T15:45:52.468 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:45:52.468 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-02-28T15:45:52.468 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.469 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.469 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:45:52.469 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.469 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.469 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.469 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.469 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-28T15:45:52.469 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.469 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-28T15:45:52.469 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-28T15:45:52.470 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-28T15:45:52.470 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.470 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-28T15:45:52.470 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.470 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-28T15:45:52.470 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-28T15:45:52.470 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.470 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.470 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.471 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-28T15:45:52.471 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.471 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.471 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:52.471 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-28T15:45:52.471 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:45:52.471 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:45:52.862 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-test 2024-02-28T15:45:53.734 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:34 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:45:54.039 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:45:54.039 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:45:54.039 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:45:54.039 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.039 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:45:54.039 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.039 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:45:54.039 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.039 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:45:54.039 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:45:54.040 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:45:54.041 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:45:54.042 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.043 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:45:54.043 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.043 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:45:54.043 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.043 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:45:54.043 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.043 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:45:54.043 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.043 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:45:54.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:45:54.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:45:54.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:45:54.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:45:54.109 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:45:54.109 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 48 M 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 162 k 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:45:54.110 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:45:54.111 INFO:teuthology.orchestra.run.smithi087.stdout:Install 6 Packages 2024-02-28T15:45:54.111 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:45:54.111 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 49 M 2024-02-28T15:45:54.111 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 196 M 2024-02-28T15:45:54.111 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:45:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 5/6 2024-02-28T15:45:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 6/6 2024-02-28T15:45:54.786 INFO:teuthology.orchestra.run.smithi087.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-02-28T15:45:54.861 INFO:teuthology.orchestra.run.smithi087.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.0 MB/s | 218 kB 00:00 2024-02-28T15:45:55.237 INFO:teuthology.orchestra.run.smithi087.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 815 kB/s | 305 kB 00:00 2024-02-28T15:45:55.329 INFO:teuthology.orchestra.run.smithi087.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 703 kB/s | 64 kB 00:00 2024-02-28T15:45:55.420 INFO:teuthology.orchestra.run.smithi087.stdout:(5/6): libcephsqlite-17.2.7-535.gc0f02e60.el9.x 200 kB/s | 162 kB 00:00 2024-02-28T15:45:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 6/6 2024-02-28T15:45:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 1/6 2024-02-28T15:45:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 2/6 2024-02-28T15:45:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-02-28T15:45:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-02-28T15:45:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-02-28T15:45:57.046 INFO:teuthology.orchestra.run.smithi087.stdout:(6/6): ceph-test-17.2.7-535.gc0f02e60.el9.x86_6 20 MB/s | 48 MB 00:02 2024-02-28T15:45:57.050 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:45:57.050 INFO:teuthology.orchestra.run.smithi087.stdout:Total 17 MB/s | 49 MB 00:02 2024-02-28T15:45:57.194 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:45:57.245 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:45:57.245 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: jq-1.6-16.el9.x86_64 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:57.388 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:45:57.723 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:45:57.723 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:45:57.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph 2024-02-28T15:45:58.449 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:45:58.593 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:47 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:45:58.606 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-02-28T15:45:58.657 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-02-28T15:45:58.730 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-02-28T15:45:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-02-28T15:45:58.840 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 5/6 2024-02-28T15:45:58.910 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:45:58.910 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:45:58.910 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:45:58.910 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.910 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:45:58.911 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.911 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:45:58.911 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.911 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:45:58.911 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.911 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:45:58.912 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.912 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:45:58.912 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.912 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:45:58.912 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.912 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:45:58.913 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.913 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:45:58.913 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.913 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:45:58.913 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.913 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:45:58.913 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.914 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:45:58.914 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.914 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:45:58.914 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.914 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:45:58.914 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.914 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:45:58.914 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.914 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:45:58.915 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.915 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:45:58.915 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.915 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:45:58.915 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.915 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:45:58.915 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:45:58.916 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:45:58.917 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.920 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:45:58.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.920 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.922 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:45:58.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:45:58.999 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:45:59.002 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:45:59.002 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-02-28T15:45:59.002 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:45:59.002 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:45:59.002 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 6.5 k 2024-02-28T15:45:59.002 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-02-28T15:45:59.002 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.1 M 2024-02-28T15:45:59.002 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 1.4 M 2024-02-28T15:45:59.002 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 239 k 2024-02-28T15:45:59.003 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 3.7 M 2024-02-28T15:45:59.003 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 15 M 2024-02-28T15:45:59.003 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-28T15:45:59.003 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-28T15:45:59.003 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-28T15:45:59.003 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-28T15:45:59.003 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-28T15:45:59.003 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-28T15:45:59.003 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-28T15:45:59.003 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-28T15:45:59.004 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-28T15:45:59.004 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-28T15:45:59.004 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-28T15:45:59.004 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-28T15:45:59.004 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-28T15:45:59.004 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-28T15:45:59.004 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-28T15:45:59.004 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-28T15:45:59.004 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout:Install 33 Packages 2024-02-28T15:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:45:59.006 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 27 M 2024-02-28T15:45:59.006 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 99 M 2024-02-28T15:45:59.006 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:46:00.106 INFO:teuthology.orchestra.run.smithi057.stdout:(1/33): ceph-17.2.7-535.gc0f02e60.el9.x86_64.rp 25 kB/s | 6.5 kB 00:00 2024-02-28T15:46:00.690 INFO:teuthology.orchestra.run.smithi057.stdout:(2/33): ceph-mon-17.2.7-535.gc0f02e60.el9.x86_6 6.4 MB/s | 3.7 MB 00:00 2024-02-28T15:46:01.298 INFO:teuthology.orchestra.run.smithi057.stdout:(3/33): ceph-mgr-17.2.7-535.gc0f02e60.el9.x86_6 995 kB/s | 1.4 MB 00:01 2024-02-28T15:46:01.574 INFO:teuthology.orchestra.run.smithi057.stdout:(4/33): ceph-osd-17.2.7-535.gc0f02e60.el9.x86_6 17 MB/s | 15 MB 00:00 2024-02-28T15:46:01.640 INFO:teuthology.orchestra.run.smithi057.stdout:(5/33): ceph-mgr-modules-core-17.2.7-535.gc0f02 701 kB/s | 239 kB 00:00 2024-02-28T15:46:02.049 INFO:teuthology.orchestra.run.smithi057.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 534 kB/s | 253 kB 00:00 2024-02-28T15:46:02.191 INFO:teuthology.orchestra.run.smithi057.stdout:(7/33): ceph-mds-17.2.7-535.gc0f02e60.el9.x86_6 905 kB/s | 2.1 MB 00:02 2024-02-28T15:46:02.266 INFO:teuthology.orchestra.run.smithi057.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 493 kB/s | 106 kB 00:00 2024-02-28T15:46:02.383 INFO:teuthology.orchestra.run.smithi057.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.1 MB/s | 125 kB 00:00 2024-02-28T15:46:02.450 INFO:teuthology.orchestra.run.smithi057.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 1.5 MB/s | 1.2 MB 00:00 2024-02-28T15:46:02.501 INFO:teuthology.orchestra.run.smithi057.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 438 kB/s | 135 kB 00:00 2024-02-28T15:46:02.584 INFO:teuthology.orchestra.run.smithi057.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 422 kB/s | 35 kB 00:00 2024-02-28T15:46:02.609 INFO:teuthology.orchestra.run.smithi057.stdout:(13/33): python3-urllib3-1.26.5-5.el9.noarch.rp 953 kB/s | 215 kB 00:00 2024-02-28T15:46:02.643 INFO:teuthology.orchestra.run.smithi057.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 881 kB/s | 51 kB 00:00 2024-02-28T15:46:02.677 INFO:teuthology.orchestra.run.smithi057.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 765 kB/s | 172 kB 00:00 2024-02-28T15:46:02.727 INFO:teuthology.orchestra.run.smithi057.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 358 kB/s | 42 kB 00:00 2024-02-28T15:46:03.002 INFO:teuthology.orchestra.run.smithi057.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 121 kB/s | 43 kB 00:00 2024-02-28T15:46:03.086 INFO:teuthology.orchestra.run.smithi057.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 129 kB/s | 11 kB 00:00 2024-02-28T15:46:03.169 INFO:teuthology.orchestra.run.smithi057.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 215 kB/s | 18 kB 00:00 2024-02-28T15:46:03.228 INFO:teuthology.orchestra.run.smithi057.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 312 kB/s | 172 kB 00:00 2024-02-28T15:46:03.253 INFO:teuthology.orchestra.run.smithi057.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 279 kB/s | 23 kB 00:00 2024-02-28T15:46:03.295 INFO:teuthology.orchestra.run.smithi057.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 295 kB/s | 19 kB 00:00 2024-02-28T15:46:03.345 INFO:teuthology.orchestra.run.smithi057.stdout:(23/33): python3-cherrypy-18.6.1-2.el9.noarch.r 730 kB/s | 358 kB 00:00 2024-02-28T15:46:03.371 INFO:teuthology.orchestra.run.smithi057.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 169 kB/s | 20 kB 00:00 2024-02-28T15:46:03.404 INFO:teuthology.orchestra.run.smithi057.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 428 kB/s | 46 kB 00:00 2024-02-28T15:46:03.421 INFO:teuthology.orchestra.run.smithi057.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-02-28T15:46:03.480 INFO:teuthology.orchestra.run.smithi057.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 220 kB/s | 16 kB 00:00 2024-02-28T15:46:03.537 INFO:teuthology.orchestra.run.smithi057.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2024-02-28T15:46:03.564 INFO:teuthology.orchestra.run.smithi057.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 433 kB/s | 36 kB 00:00 2024-02-28T15:46:03.597 INFO:teuthology.orchestra.run.smithi057.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-02-28T15:46:03.631 INFO:teuthology.orchestra.run.smithi057.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-02-28T15:46:03.673 INFO:teuthology.orchestra.run.smithi057.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 268 kB/s | 20 kB 00:00 2024-02-28T15:46:03.695 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 5/6 2024-02-28T15:46:03.748 INFO:teuthology.orchestra.run.smithi057.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.3 MB/s | 427 kB 00:00 2024-02-28T15:46:03.757 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:03.757 INFO:teuthology.orchestra.run.smithi057.stdout:Total 5.7 MB/s | 27 MB 00:04 2024-02-28T15:46:03.795 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 6/6 2024-02-28T15:46:04.127 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:46:04.215 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:46:04.215 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:46:04.649 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:46:04.649 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:46:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:46:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-28T15:46:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-28T15:46:06.175 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 6/6 2024-02-28T15:46:06.175 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 1/6 2024-02-28T15:46:06.175 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 2/6 2024-02-28T15:46:06.175 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-02-28T15:46:06.176 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-02-28T15:46:06.176 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-02-28T15:46:06.203 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-28T15:46:06.361 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-28T15:46:06.472 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-28T15:46:06.527 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-02-28T15:46:06.527 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:06.527 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:46:06.528 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:06.528 INFO:teuthology.orchestra.run.smithi087.stdout: jq-1.6-16.el9.x86_64 2024-02-28T15:46:06.528 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:06.528 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-28T15:46:06.528 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-28T15:46:06.528 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-28T15:46:06.528 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:06.528 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-28T15:46:06.568 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-28T15:46:06.604 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-02-28T15:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-02-28T15:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-02-28T15:46:06.729 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-02-28T15:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-02-28T15:46:06.819 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-02-28T15:46:06.873 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-02-28T15:46:06.886 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph 2024-02-28T15:46:07.019 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-02-28T15:46:07.236 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-02-28T15:46:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-02-28T15:46:07.394 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-02-28T15:46:07.428 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-02-28T15:46:07.491 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-02-28T15:46:07.566 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-02-28T15:46:07.773 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:48 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:46:07.820 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-02-28T15:46:07.882 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-02-28T15:46:07.976 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-02-28T15:46:08.078 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:46:08.078 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:46:08.078 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:46:08.078 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.078 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:46:08.078 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.078 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.079 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.080 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:46:08.081 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:46:08.082 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:46:08.083 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.084 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.085 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.086 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:08.087 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.087 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.087 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.087 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:08.091 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-02-28T15:46:08.146 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-02-28T15:46:08.154 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:46:08.157 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:08.157 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-02-28T15:46:08.157 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:08.157 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:46:08.157 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 6.5 k 2024-02-28T15:46:08.157 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-02-28T15:46:08.157 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.1 M 2024-02-28T15:46:08.157 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 1.4 M 2024-02-28T15:46:08.157 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 239 k 2024-02-28T15:46:08.157 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 3.7 M 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 15 M 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-28T15:46:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-28T15:46:08.159 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:08.160 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:46:08.160 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:08.160 INFO:teuthology.orchestra.run.smithi087.stdout:Install 33 Packages 2024-02-28T15:46:08.160 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:08.161 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 27 M 2024-02-28T15:46:08.161 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 99 M 2024-02-28T15:46:08.161 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:46:08.306 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-02-28T15:46:08.475 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.n 28/33 2024-02-28T15:46:08.503 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 29/33 2024-02-28T15:46:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 29/33 2024-02-28T15:46:08.602 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:46:08.602 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-28T15:46:08.602 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T15:46:08.602 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T15:46:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:09.023 INFO:teuthology.orchestra.run.smithi087.stdout:(1/33): ceph-17.2.7-535.gc0f02e60.el9.x86_64.rp 21 kB/s | 6.5 kB 00:00 2024-02-28T15:46:09.164 INFO:teuthology.orchestra.run.smithi087.stdout:(2/33): ceph-mgr-17.2.7-535.gc0f02e60.el9.x86_6 3.2 MB/s | 1.4 MB 00:00 2024-02-28T15:46:09.548 INFO:teuthology.orchestra.run.smithi087.stdout:(3/33): ceph-mds-17.2.7-535.gc0f02e60.el9.x86_6 2.5 MB/s | 2.1 MB 00:00 2024-02-28T15:46:09.673 INFO:teuthology.orchestra.run.smithi087.stdout:(4/33): ceph-mgr-modules-core-17.2.7-535.gc0f02 1.9 MB/s | 239 kB 00:00 2024-02-28T15:46:09.998 INFO:teuthology.orchestra.run.smithi087.stdout:(5/33): ceph-osd-17.2.7-535.gc0f02e60.el9.x86_6 18 MB/s | 15 MB 00:00 2024-02-28T15:46:10.032 INFO:teuthology.orchestra.run.smithi087.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 709 kB/s | 253 kB 00:00 2024-02-28T15:46:10.099 INFO:teuthology.orchestra.run.smithi087.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-02-28T15:46:10.162 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 30/33 2024-02-28T15:46:10.191 INFO:teuthology.orchestra.run.smithi087.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.5 MB/s | 135 kB 00:00 2024-02-28T15:46:10.267 INFO:teuthology.orchestra.run.smithi087.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.6 MB/s | 125 kB 00:00 2024-02-28T15:46:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 30/33 2024-02-28T15:46:10.269 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:46:10.269 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-28T15:46:10.270 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T15:46:10.270 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T15:46:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:10.383 INFO:teuthology.orchestra.run.smithi087.stdout:(10/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-02-28T15:46:10.525 INFO:teuthology.orchestra.run.smithi087.stdout:(11/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-02-28T15:46:10.567 INFO:teuthology.orchestra.run.smithi087.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 2.2 MB/s | 1.2 MB 00:00 2024-02-28T15:46:10.618 INFO:teuthology.orchestra.run.smithi087.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 377 kB/s | 35 kB 00:00 2024-02-28T15:46:10.709 INFO:teuthology.orchestra.run.smithi087.stdout:(14/33): ceph-mon-17.2.7-535.gc0f02e60.el9.x86_ 2.2 MB/s | 3.7 MB 00:01 2024-02-28T15:46:10.712 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 31/33 2024-02-28T15:46:10.734 INFO:teuthology.orchestra.run.smithi087.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 362 kB/s | 42 kB 00:00 2024-02-28T15:46:10.760 INFO:teuthology.orchestra.run.smithi087.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 266 kB/s | 51 kB 00:00 2024-02-28T15:46:10.807 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 31/33 2024-02-28T15:46:10.808 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:46:10.808 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-28T15:46:10.808 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T15:46:10.808 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T15:46:10.808 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:11.038 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 32/33 2024-02-28T15:46:11.120 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 32/33 2024-02-28T15:46:11.121 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:46:11.121 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-28T15:46:11.121 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T15:46:11.121 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T15:46:11.121 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:11.169 INFO:teuthology.orchestra.run.smithi087.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 95 kB/s | 43 kB 00:00 2024-02-28T15:46:11.236 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 33/33 2024-02-28T15:46:11.285 INFO:teuthology.orchestra.run.smithi087.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 93 kB/s | 11 kB 00:00 2024-02-28T15:46:11.311 INFO:teuthology.orchestra.run.smithi087.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 298 kB/s | 172 kB 00:00 2024-02-28T15:46:11.364 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 33/33 2024-02-28T15:46:11.364 INFO:teuthology.orchestra.run.smithi057.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-28T15:46:11.364 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:11.411 INFO:teuthology.orchestra.run.smithi087.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 142 kB/s | 18 kB 00:00 2024-02-28T15:46:11.453 INFO:teuthology.orchestra.run.smithi087.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 518 kB/s | 358 kB 00:00 2024-02-28T15:46:11.478 INFO:teuthology.orchestra.run.smithi087.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 139 kB/s | 23 kB 00:00 2024-02-28T15:46:11.520 INFO:teuthology.orchestra.run.smithi087.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 180 kB/s | 19 kB 00:00 2024-02-28T15:46:11.579 INFO:teuthology.orchestra.run.smithi087.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 468 kB/s | 46 kB 00:00 2024-02-28T15:46:11.604 INFO:teuthology.orchestra.run.smithi087.stdout:(25/33): python3-jaraco-text-3.2.0-6.el9.noarch 158 kB/s | 20 kB 00:00 2024-02-28T15:46:11.704 INFO:teuthology.orchestra.run.smithi087.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 166 kB/s | 16 kB 00:00 2024-02-28T15:46:11.738 INFO:teuthology.orchestra.run.smithi087.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 364 kB/s | 79 kB 00:00 2024-02-28T15:46:11.796 INFO:teuthology.orchestra.run.smithi087.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-02-28T15:46:11.830 INFO:teuthology.orchestra.run.smithi087.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 722 kB/s | 90 kB 00:00 2024-02-28T15:46:11.855 INFO:teuthology.orchestra.run.smithi087.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 307 kB/s | 36 kB 00:00 2024-02-28T15:46:11.939 INFO:teuthology.orchestra.run.smithi087.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-02-28T15:46:11.964 INFO:teuthology.orchestra.run.smithi087.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 185 kB/s | 20 kB 00:00 2024-02-28T15:46:12.089 INFO:teuthology.orchestra.run.smithi087.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.6 MB/s | 427 kB 00:00 2024-02-28T15:46:12.098 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:12.098 INFO:teuthology.orchestra.run.smithi087.stdout:Total 6.8 MB/s | 27 MB 00:03 2024-02-28T15:46:12.471 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:46:12.555 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:46:12.556 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:46:12.975 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:46:12.975 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:46:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 1/33 2024-02-28T15:46:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 2/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 3/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 4/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 5/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.n 6/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-28T15:46:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-28T15:46:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-28T15:46:13.147 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-28T15:46:13.147 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-28T15:46:13.147 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-28T15:46:14.203 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-28T15:46:14.203 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-28T15:46:14.204 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply-3.11-14.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-28T15:46:14.205 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-28T15:46:14.206 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-28T15:46:14.206 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-28T15:46:14.206 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-28T15:46:14.206 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-28T15:46:14.206 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-28T15:46:14.206 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-28T15:46:14.206 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-28T15:46:14.206 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:14.206 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:46:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:46:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-28T15:46:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-28T15:46:14.580 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-base 2024-02-28T15:46:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-28T15:46:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-28T15:46:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-28T15:46:14.932 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-28T15:46:14.983 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-28T15:46:15.020 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-02-28T15:46:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-02-28T15:46:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-02-28T15:46:15.162 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-02-28T15:46:15.222 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-02-28T15:46:15.300 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-02-28T15:46:15.360 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-02-28T15:46:15.477 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:04 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:46:15.502 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-02-28T15:46:15.688 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-02-28T15:46:15.799 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:46:15.799 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:46:15.799 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:46:15.799 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.799 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:46:15.799 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.799 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:46:15.799 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.800 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:46:15.800 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:46:15.801 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:46:15.802 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:46:15.803 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.804 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.805 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:15.806 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:15.807 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.808 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:15.809 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-02-28T15:46:15.809 INFO:teuthology.orchestra.run.smithi057.stdout:Package ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:46:15.868 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-02-28T15:46:15.874 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:46:15.875 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-02-28T15:46:15.875 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:46:15.911 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-02-28T15:46:15.953 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install cephadm 2024-02-28T15:46:15.976 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-02-28T15:46:16.048 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-02-28T15:46:16.321 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-02-28T15:46:16.382 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-02-28T15:46:16.476 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-02-28T15:46:16.595 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-02-28T15:46:16.648 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-02-28T15:46:16.799 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-02-28T15:46:16.832 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:05 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:46:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.n 28/33 2024-02-28T15:46:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 29/33 2024-02-28T15:46:17.062 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 29/33 2024-02-28T15:46:17.062 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:46:17.062 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-28T15:46:17.062 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T15:46:17.063 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T15:46:17.063 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:17.160 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:46:17.160 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:46:17.160 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:46:17.160 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.160 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:46:17.160 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.160 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:46:17.160 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.160 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:46:17.160 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:46:17.161 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:46:17.162 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.163 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.164 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.165 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.167 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.167 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:17.167 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.167 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.167 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.167 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.168 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:17.168 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.168 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.168 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.168 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.168 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:17.168 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.168 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.168 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:17.237 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:46:17.238 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:17.238 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-02-28T15:46:17.238 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:17.238 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:46:17.238 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 80 k 2024-02-28T15:46:17.238 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:17.238 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:46:17.238 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:17.238 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-02-28T15:46:17.239 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:17.239 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 80 k 2024-02-28T15:46:17.239 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 364 k 2024-02-28T15:46:17.239 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:46:17.821 INFO:teuthology.orchestra.run.smithi057.stdout:cephadm-17.2.7-535.gc0f02e60.el9.noarch.rpm 138 kB/s | 80 kB 00:00 2024-02-28T15:46:17.823 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:17.824 INFO:teuthology.orchestra.run.smithi057.stdout:Total 138 kB/s | 80 kB 00:00 2024-02-28T15:46:17.824 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:46:17.842 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:46:17.843 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:46:17.850 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:46:17.851 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:46:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:46:18.515 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T15:46:18.518 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 30/33 2024-02-28T15:46:18.605 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 30/33 2024-02-28T15:46:18.605 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:46:18.605 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-28T15:46:18.605 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T15:46:18.605 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T15:46:18.605 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:18.670 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T15:46:19.019 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 31/33 2024-02-28T15:46:19.069 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T15:46:19.097 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 31/33 2024-02-28T15:46:19.097 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:46:19.097 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-28T15:46:19.098 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T15:46:19.098 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T15:46:19.098 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 32/33 2024-02-28T15:46:19.412 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 32/33 2024-02-28T15:46:19.412 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:46:19.412 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-28T15:46:19.412 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T15:46:19.412 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T15:46:19.412 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:19.430 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T15:46:19.430 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:19.430 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:46:19.430 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:19.430 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:19.430 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:46:19.496 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 33/33 2024-02-28T15:46:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 33/33 2024-02-28T15:46:19.644 INFO:teuthology.orchestra.run.smithi087.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-28T15:46:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:19.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-immutable-object-cache 2024-02-28T15:46:20.595 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:09 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:46:20.917 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:46:20.917 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:46:20.918 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.919 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:46:20.920 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.921 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.922 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.923 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:20.924 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.925 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.925 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.925 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.925 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:20.925 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.925 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.925 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.925 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.925 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.926 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.927 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:20.927 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.927 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.927 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.927 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:20.990 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:46:20.991 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2024-02-28T15:46:20.991 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:20.991 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:46:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 137 k 2024-02-28T15:46:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:20.991 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:46:20.991 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:20.991 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-02-28T15:46:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:20.992 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 137 k 2024-02-28T15:46:20.992 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 379 k 2024-02-28T15:46:20.992 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:46:21.505 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-immutable-object-cache-17.2.7-535.gc0f02e6 268 kB/s | 137 kB 00:00 2024-02-28T15:46:21.506 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:21.507 INFO:teuthology.orchestra.run.smithi057.stdout:Total 266 kB/s | 137 kB 00:00 2024-02-28T15:46:21.508 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:46:21.536 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:46:21.536 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:46:21.568 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 1/33 2024-02-28T15:46:21.568 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 2/33 2024-02-28T15:46:21.568 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 3/33 2024-02-28T15:46:21.568 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 4/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 5/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.n 6/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-28T15:46:21.569 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-28T15:46:21.570 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-28T15:46:21.571 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-28T15:46:21.571 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-28T15:46:21.571 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-28T15:46:21.639 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:46:21.639 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:46:21.961 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:46:22.040 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T15:46:22.120 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T15:46:22.121 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:46:22.121 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-28T15:46:22.121 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-28T15:46:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:22.759 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:46:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-28T15:46:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-28T15:46:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-28T15:46:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-28T15:46:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:22.762 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:46:23.205 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-base 2024-02-28T15:46:23.400 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T15:46:23.401 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:23.401 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:46:23.401 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:23.401 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:23.401 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:46:23.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr 2024-02-28T15:46:24.073 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:05 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:46:24.383 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:46:24.383 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:46:24.383 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:46:24.383 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.383 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:46:24.383 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.384 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.385 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.386 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.387 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.388 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.389 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.390 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.391 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.392 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.392 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.392 INFO:teuthology.orchestra.run.smithi087.stdout:Package ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:46:24.456 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:46:24.457 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-02-28T15:46:24.457 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:46:24.529 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install cephadm 2024-02-28T15:46:24.641 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:13 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:46:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:46:24.970 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:46:24.970 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:46:24.970 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.970 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:46:24.970 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.970 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:46:24.970 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.970 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:46:24.970 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.971 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:46:24.972 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:46:24.973 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:46:24.974 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.975 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.976 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.977 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.978 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.979 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.979 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:24.979 INFO:teuthology.orchestra.run.smithi057.stdout:Package ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:46:25.047 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:46:25.048 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-02-28T15:46:25.048 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:46:25.125 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-dashboard 2024-02-28T15:46:25.408 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:06 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:46:25.719 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:46:25.719 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:46:25.719 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:46:25.719 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.719 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:46:25.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:46:25.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:46:25.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:46:25.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:46:25.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.728 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:25.791 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:46:25.792 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-02-28T15:46:25.792 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:25.793 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:46:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 80 k 2024-02-28T15:46:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:25.793 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:46:25.793 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:25.793 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-02-28T15:46:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:25.793 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 80 k 2024-02-28T15:46:25.793 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 364 k 2024-02-28T15:46:25.793 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:46:26.018 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:15 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:46:26.036 INFO:teuthology.orchestra.run.smithi087.stdout:cephadm-17.2.7-535.gc0f02e60.el9.noarch.rpm 333 kB/s | 80 kB 00:00 2024-02-28T15:46:26.037 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:26.038 INFO:teuthology.orchestra.run.smithi087.stdout:Total 329 kB/s | 80 kB 00:00 2024-02-28T15:46:26.038 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:46:26.055 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:46:26.055 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:46:26.061 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:46:26.063 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:46:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:46:26.339 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:46:26.339 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:46:26.339 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:46:26.339 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.339 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:46:26.339 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.339 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:46:26.339 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.339 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:46:26.339 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:46:26.340 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.341 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.342 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:46:26.343 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.344 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:46:26.344 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.344 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:46:26.344 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.344 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:46:26.344 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.344 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:46:26.344 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.344 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.345 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:26.346 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.347 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.348 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.348 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:26.348 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.348 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.348 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.348 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:26.413 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:46:26.414 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:26.414 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-02-28T15:46:26.414 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:26.414 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 1.7 M 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 23 k 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 15 k 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout:Installing weak dependencies: 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout:Install 7 Packages 2024-02-28T15:46:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:26.416 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 2.0 M 2024-02-28T15:46:26.416 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 8.1 M 2024-02-28T15:46:26.416 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:46:26.825 INFO:teuthology.orchestra.run.smithi057.stdout:(1/7): ceph-prometheus-alerts-17.2.7-535.gc0f02 46 kB/s | 15 kB 00:00 2024-02-28T15:46:26.841 INFO:teuthology.orchestra.run.smithi057.stdout:(2/7): ceph-grafana-dashboards-17.2.7-535.gc0f0 70 kB/s | 23 kB 00:00 2024-02-28T15:46:27.092 INFO:teuthology.orchestra.run.smithi057.stdout:(3/7): ceph-mgr-dashboard-17.2.7-535.gc0f02e60. 2.9 MB/s | 1.7 MB 00:00 2024-02-28T15:46:27.169 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T15:46:27.267 INFO:teuthology.orchestra.run.smithi057.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 21 kB/s | 9.0 kB 00:00 2024-02-28T15:46:27.359 INFO:teuthology.orchestra.run.smithi057.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 79 kB/s | 41 kB 00:00 2024-02-28T15:46:27.374 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T15:46:27.526 INFO:teuthology.orchestra.run.smithi057.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 71 kB/s | 31 kB 00:00 2024-02-28T15:46:27.667 INFO:teuthology.orchestra.run.smithi057.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 471 kB/s | 188 kB 00:00 2024-02-28T15:46:27.677 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:27.678 INFO:teuthology.orchestra.run.smithi057.stdout:Total 1.6 MB/s | 2.0 MB 00:01 2024-02-28T15:46:27.679 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:46:27.708 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:46:27.708 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:46:27.851 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:46:27.851 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:46:27.893 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T15:46:28.291 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:46:28.359 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T15:46:28.359 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:28.359 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:46:28.359 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:28.360 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:28.360 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:46:28.361 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-28T15:46:28.414 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-28T15:46:28.506 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-28T15:46:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-28T15:46:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.no 5/7 2024-02-28T15:46:28.787 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-immutable-object-cache 2024-02-28T15:46:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.n 6/7 2024-02-28T15:46:28.971 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 7/7 2024-02-28T15:46:29.545 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 7/7 2024-02-28T15:46:29.545 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.n 1/7 2024-02-28T15:46:29.545 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 2/7 2024-02-28T15:46:29.545 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.no 3/7 2024-02-28T15:46:29.545 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-28T15:46:29.545 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-28T15:46:29.545 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-28T15:46:29.652 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:10 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-28T15:46:29.950 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:29.951 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:46:29.964 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:46:29.964 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:46:29.964 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:46:29.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.964 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:46:29.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.964 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:46:29.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.964 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:46:29.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.966 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:46:29.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.966 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:46:29.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.966 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:46:29.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.966 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:46:29.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.966 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:46:29.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:46:29.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.968 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:46:29.969 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.970 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.971 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:29.972 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.972 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.972 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.972 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.972 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:29.972 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.972 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.973 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.973 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.973 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:29.973 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.973 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.973 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.973 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.974 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:29.974 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.974 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.974 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:29.974 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:30.035 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:46:30.035 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:30.036 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-02-28T15:46:30.036 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:30.036 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:46:30.036 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 137 k 2024-02-28T15:46:30.036 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:30.036 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:46:30.036 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:30.036 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-02-28T15:46:30.036 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:30.037 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 137 k 2024-02-28T15:46:30.037 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 379 k 2024-02-28T15:46:30.037 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:46:30.237 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-28T15:46:30.259 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-immutable-object-cache-17.2.7-535.gc0f02e6 619 kB/s | 137 kB 00:00 2024-02-28T15:46:30.260 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:30.261 INFO:teuthology.orchestra.run.smithi087.stdout:Total 610 kB/s | 137 kB 00:00 2024-02-28T15:46:30.262 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:46:30.290 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:46:30.291 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:46:30.382 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:46:30.383 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:46:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:46:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T15:46:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T15:46:30.758 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:46:30.758 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-28T15:46:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:20 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:46:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:46:31.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:46:31.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.493 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.494 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:46:31.495 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.496 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.497 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.498 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.498 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.498 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:31.498 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.498 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.498 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.498 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.498 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:31.498 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.499 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:31.500 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.500 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.500 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.500 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:31.570 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:46:31.571 INFO:teuthology.orchestra.run.smithi057.stdout:====================================================================================== 2024-02-28T15:46:31.571 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout:====================================================================================== 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 7.4 M 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-28T15:46:31.572 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-28T15:46:31.573 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-28T15:46:31.573 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-28T15:46:31.573 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:31.573 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:46:31.573 INFO:teuthology.orchestra.run.smithi057.stdout:====================================================================================== 2024-02-28T15:46:31.573 INFO:teuthology.orchestra.run.smithi057.stdout:Install 12 Packages 2024-02-28T15:46:31.573 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:31.573 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 38 M 2024-02-28T15:46:31.574 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 209 M 2024-02-28T15:46:31.574 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:46:32.165 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T15:46:32.166 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:32.166 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:46:32.166 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:46:32.166 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:32.166 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:46:32.488 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr 2024-02-28T15:46:32.658 INFO:teuthology.orchestra.run.smithi057.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 284 kB/s | 195 kB 00:00 2024-02-28T15:46:32.841 INFO:teuthology.orchestra.run.smithi057.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 179 kB/s | 33 kB 00:00 2024-02-28T15:46:32.933 INFO:teuthology.orchestra.run.smithi057.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 834 kB/s | 803 kB 00:00 2024-02-28T15:46:33.158 INFO:teuthology.orchestra.run.smithi057.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 81 kB/s | 18 kB 00:00 2024-02-28T15:46:33.300 INFO:teuthology.orchestra.run.smithi057.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 250 kB/s | 35 kB 00:00 2024-02-28T15:46:33.369 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:14 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.681 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:46:33.682 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.683 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:46:33.684 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:46:33.685 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:33.686 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.687 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.688 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.689 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:33.690 INFO:teuthology.orchestra.run.smithi087.stdout:Package ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:46:33.756 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:46:33.756 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-02-28T15:46:33.756 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:46:33.840 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-dashboard 2024-02-28T15:46:34.086 INFO:teuthology.orchestra.run.smithi057.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 6.0 MB/s | 4.7 MB 00:00 2024-02-28T15:46:34.159 INFO:teuthology.orchestra.run.smithi057.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 3.3 MB/s | 245 kB 00:00 2024-02-28T15:46:34.609 INFO:teuthology.orchestra.run.smithi057.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-02-28T15:46:34.676 INFO:teuthology.orchestra.run.smithi057.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.7 MB/s | 250 kB 00:00 2024-02-28T15:46:34.689 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:15 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:46:34.968 INFO:teuthology.orchestra.run.smithi057.stdout:(10/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 1.4 MB/s | 3.0 MB 00:02 2024-02-28T15:46:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:46:34.997 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:46:34.997 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:46:34.997 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:46:34.998 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:46:34.999 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.000 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.001 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:46:35.002 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.003 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.004 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.004 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.004 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.004 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:35.004 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.004 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.004 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.004 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.004 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:35.004 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.005 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:35.006 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.006 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.006 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.006 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.006 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:35.006 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.006 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.006 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.006 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:35.067 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 1.7 M 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 23 k 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 15 k 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-28T15:46:35.068 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2024-02-28T15:46:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-28T15:46:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:35.069 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:46:35.069 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:46:35.069 INFO:teuthology.orchestra.run.smithi087.stdout:Install 7 Packages 2024-02-28T15:46:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:35.070 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 2.0 M 2024-02-28T15:46:35.070 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 8.1 M 2024-02-28T15:46:35.070 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:46:35.518 INFO:teuthology.orchestra.run.smithi057.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-02-28T15:46:35.769 INFO:teuthology.orchestra.run.smithi057.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-5 2.0 MB/s | 7.4 MB 00:03 2024-02-28T15:46:35.771 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:35.772 INFO:teuthology.orchestra.run.smithi057.stdout:Total 9.1 MB/s | 38 MB 00:04 2024-02-28T15:46:35.800 INFO:teuthology.orchestra.run.smithi087.stdout:(1/7): ceph-prometheus-alerts-17.2.7-535.gc0f02 42 kB/s | 15 kB 00:00 2024-02-28T15:46:35.838 INFO:teuthology.orchestra.run.smithi087.stdout:(2/7): ceph-grafana-dashboards-17.2.7-535.gc0f0 60 kB/s | 23 kB 00:00 2024-02-28T15:46:35.897 INFO:teuthology.orchestra.run.smithi087.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 91 kB/s | 9.0 kB 00:00 2024-02-28T15:46:35.931 INFO:teuthology.orchestra.run.smithi087.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 450 kB/s | 41 kB 00:00 2024-02-28T15:46:35.956 INFO:teuthology.orchestra.run.smithi087.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 532 kB/s | 31 kB 00:00 2024-02-28T15:46:36.048 INFO:teuthology.orchestra.run.smithi087.stdout:(6/7): ceph-mgr-dashboard-17.2.7-535.gc0f02e60. 2.8 MB/s | 1.7 MB 00:00 2024-02-28T15:46:36.148 INFO:teuthology.orchestra.run.smithi087.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 872 kB/s | 188 kB 00:00 2024-02-28T15:46:36.152 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:36.153 INFO:teuthology.orchestra.run.smithi087.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2024-02-28T15:46:36.154 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:46:36.181 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:46:36.181 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:46:36.325 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:46:36.326 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:46:36.419 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:46:36.501 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:46:36.501 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:46:36.761 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:46:36.875 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-28T15:46:36.924 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-28T15:46:37.019 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-28T15:46:37.059 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-28T15:46:37.103 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.no 5/7 2024-02-28T15:46:37.137 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:46:37.138 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:46:37.410 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.n 6/7 2024-02-28T15:46:37.443 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 7/7 2024-02-28T15:46:38.047 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:46:38.124 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-02-28T15:46:38.144 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 7/7 2024-02-28T15:46:38.144 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.n 1/7 2024-02-28T15:46:38.144 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 2/7 2024-02-28T15:46:38.144 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.no 3/7 2024-02-28T15:46:38.144 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-28T15:46:38.144 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-28T15:46:38.145 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-28T15:46:38.216 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-02-28T15:46:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-02-28T15:46:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-28T15:46:38.545 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-28T15:46:38.545 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:38.545 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:46:38.545 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:38.546 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:38.546 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:38.546 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-28T15:46:38.546 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-28T15:46:38.546 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-28T15:46:38.546 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-28T15:46:38.547 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:38.547 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:46:38.677 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-28T15:46:38.709 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-28T15:46:38.817 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-28T15:46:38.887 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-28T15:46:39.734 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-28T15:46:39.781 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:20 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:46:39.873 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-28T15:46:40.091 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.092 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:46:40.093 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:46:40.094 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:46:40.095 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:46:40.096 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.097 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.098 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.099 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:40.100 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.100 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.100 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.100 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:40.167 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:46:40.168 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-02-28T15:46:40.168 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-02-28T15:46:40.168 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-02-28T15:46:40.168 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 7.4 M 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-28T15:46:40.169 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:40.170 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:46:40.170 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-02-28T15:46:40.170 INFO:teuthology.orchestra.run.smithi087.stdout:Install 12 Packages 2024-02-28T15:46:40.170 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:46:40.170 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 38 M 2024-02-28T15:46:40.170 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 209 M 2024-02-28T15:46:40.171 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:46:40.463 INFO:teuthology.orchestra.run.smithi087.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-02-28T15:46:40.588 INFO:teuthology.orchestra.run.smithi087.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-02-28T15:46:40.747 INFO:teuthology.orchestra.run.smithi087.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 116 kB/s | 33 kB 00:00 2024-02-28T15:46:40.856 INFO:teuthology.orchestra.run.smithi087.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 169 kB/s | 18 kB 00:00 2024-02-28T15:46:41.056 INFO:teuthology.orchestra.run.smithi087.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 177 kB/s | 35 kB 00:00 2024-02-28T15:46:41.207 INFO:teuthology.orchestra.run.smithi087.stdout:(6/12): ceph-mgr-diskprediction-local-17.2.7-53 8.1 MB/s | 7.4 MB 00:00 2024-02-28T15:46:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T15:46:41.565 INFO:teuthology.orchestra.run.smithi087.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.1 MB/s | 3.0 MB 00:00 2024-02-28T15:46:41.799 INFO:teuthology.orchestra.run.smithi087.stdout:(8/12): python3-devel-3.9.17-2.el9.x86_64.rpm 415 kB/s | 245 kB 00:00 2024-02-28T15:46:41.990 INFO:teuthology.orchestra.run.smithi087.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.3 MB/s | 250 kB 00:00 2024-02-28T15:46:42.516 INFO:teuthology.orchestra.run.smithi087.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 3.2 MB/s | 4.7 MB 00:01 2024-02-28T15:46:42.699 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-28T15:46:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 12/12 2024-02-28T15:46:45.136 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 12/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 1/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T15:46:45.137 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-02-28T15:46:45.585 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-02-28T15:46:45.585 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:45.586 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:46:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-28T15:46:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-28T15:46:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-28T15:46:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-28T15:46:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-28T15:46:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-28T15:46:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-28T15:46:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-28T15:46:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-28T15:46:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-28T15:46:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-28T15:46:45.588 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:45.588 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:46:45.899 INFO:teuthology.orchestra.run.smithi087.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.2 MB/s | 5.1 MB 00:04 2024-02-28T15:46:46.077 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-rook 2024-02-28T15:46:46.988 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:35 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.311 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.312 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:46:47.313 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:46:47.314 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:46:47.315 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.316 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:46:47.316 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.316 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:46:47.316 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.316 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:46:47.316 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.316 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:46:47.316 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.316 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.317 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.318 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:47.319 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.320 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.320 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.320 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.320 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:47.320 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.320 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.320 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.320 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:47.386 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:46:47.387 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:47.387 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-02-28T15:46:47.387 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:47.387 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:46:47.387 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 47 k 2024-02-28T15:46:47.387 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-02-28T15:46:47.387 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:47.388 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:46:47.389 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:47.389 INFO:teuthology.orchestra.run.smithi057.stdout:Install 13 Packages 2024-02-28T15:46:47.389 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:47.389 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 2.2 M 2024-02-28T15:46:47.389 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 26 M 2024-02-28T15:46:47.389 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:46:48.205 INFO:teuthology.orchestra.run.smithi057.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 58 kB/s | 19 kB 00:00 2024-02-28T15:46:48.231 INFO:teuthology.orchestra.run.smithi057.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 72 kB/s | 26 kB 00:00 2024-02-28T15:46:48.431 INFO:teuthology.orchestra.run.smithi057.stdout:(3/13): ceph-mgr-rook-17.2.7-535.gc0f02e60.el9. 85 kB/s | 47 kB 00:00 2024-02-28T15:46:48.573 INFO:teuthology.orchestra.run.smithi057.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 465 kB/s | 159 kB 00:00 2024-02-28T15:46:48.631 INFO:teuthology.orchestra.run.smithi057.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 523 kB/s | 222 kB 00:00 2024-02-28T15:46:48.682 INFO:teuthology.orchestra.run.smithi057.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 497 kB/s | 54 kB 00:00 2024-02-28T15:46:48.876 INFO:teuthology.orchestra.run.smithi057.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 133 kB/s | 32 kB 00:00 2024-02-28T15:46:48.924 INFO:teuthology.orchestra.run.smithi057.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 62 kB/s | 15 kB 00:00 2024-02-28T15:46:49.032 INFO:teuthology.orchestra.run.smithi057.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 464 kB/s | 279 kB 00:00 2024-02-28T15:46:49.116 INFO:teuthology.orchestra.run.smithi057.stdout:(10/13): python3-google-auth-2.28.0-1.el9.noarc 839 kB/s | 203 kB 00:00 2024-02-28T15:46:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 903 kB/s | 90 kB 00:00 2024-02-28T15:46:49.358 INFO:teuthology.orchestra.run.smithi057.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 182 kB/s | 59 kB 00:00 2024-02-28T15:46:49.483 INFO:teuthology.orchestra.run.smithi057.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2024-02-28T15:46:49.484 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:49.485 INFO:teuthology.orchestra.run.smithi057.stdout:Total 1.0 MB/s | 2.2 MB 00:02 2024-02-28T15:46:49.716 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:46:49.765 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:46:49.765 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:46:49.932 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:46:49.934 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:46:50.600 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:46:50.818 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-28T15:46:50.886 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-28T15:46:50.960 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-28T15:46:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-28T15:46:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-28T15:46:51.173 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-28T15:46:51.313 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 7/13 2024-02-28T15:46:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-28T15:46:52.355 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-28T15:46:52.419 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-28T15:46:52.453 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-28T15:46:52.508 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-28T15:46:52.536 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 13/13 2024-02-28T15:46:53.455 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 13/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 1/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 10/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-28T15:46:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-28T15:46:53.957 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-28T15:46:53.957 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:53.957 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:46:53.957 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:46:53.957 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-28T15:46:53.957 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-28T15:46:53.957 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-02-28T15:46:53.957 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-28T15:46:53.957 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-28T15:46:53.958 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-28T15:46:53.958 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-28T15:46:53.958 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-28T15:46:53.958 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-28T15:46:53.958 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-28T15:46:53.958 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-28T15:46:53.958 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-28T15:46:53.958 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:53.958 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:46:54.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-cephadm 2024-02-28T15:46:55.081 INFO:teuthology.orchestra.run.smithi087.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.2 MB/s | 16 MB 00:13 2024-02-28T15:46:55.083 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:55.084 INFO:teuthology.orchestra.run.smithi087.stdout:Total 2.5 MB/s | 38 MB 00:14 2024-02-28T15:46:55.183 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:44 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:46:55.506 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:46:55.506 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:46:55.506 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:46:55.507 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.508 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.509 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.510 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:46:55.511 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.512 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:46:55.513 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.514 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.515 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:46:55.584 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 121 k 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-28T15:46:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:55.586 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:46:55.586 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:46:55.586 INFO:teuthology.orchestra.run.smithi057.stdout:Install 6 Packages 2024-02-28T15:46:55.586 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:46:55.586 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 7.0 M 2024-02-28T15:46:55.586 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 33 M 2024-02-28T15:46:55.587 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:46:55.739 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:46:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:46:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:46:56.293 INFO:teuthology.orchestra.run.smithi057.stdout:(1/6): ceph-mgr-cephadm-17.2.7-535.gc0f02e60.el 420 kB/s | 121 kB 00:00 2024-02-28T15:46:56.376 INFO:teuthology.orchestra.run.smithi057.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 667 kB/s | 248 kB 00:00 2024-02-28T15:46:56.420 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:46:56.420 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:46:56.585 INFO:teuthology.orchestra.run.smithi057.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 278 kB/s | 58 kB 00:00 2024-02-28T15:46:56.668 INFO:teuthology.orchestra.run.smithi057.stdout:(4/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 1.4 MB/s | 548 kB 00:00 2024-02-28T15:46:56.694 INFO:teuthology.orchestra.run.smithi057.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 474 kB/s | 51 kB 00:00 2024-02-28T15:46:57.339 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:46:57.453 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-02-28T15:46:57.530 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-02-28T15:46:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-02-28T15:46:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-28T15:46:57.835 INFO:teuthology.orchestra.run.smithi057.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-02-28T15:46:57.836 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:46:57.838 INFO:teuthology.orchestra.run.smithi057.stdout:Total 3.1 MB/s | 7.0 MB 00:02 2024-02-28T15:46:57.970 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:46:58.010 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:46:58.010 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:46:58.036 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-28T15:46:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-28T15:46:58.172 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:46:58.172 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:46:58.179 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-28T15:46:58.573 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:46:58.802 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-28T15:46:58.869 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-28T15:46:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-28T15:46:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-28T15:46:59.606 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-28T15:46:59.715 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-28T15:46:59.786 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-28T15:46:59.815 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 6/6 2024-02-28T15:47:00.666 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T15:47:00.668 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 6/6 2024-02-28T15:47:00.668 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/6 2024-02-28T15:47:00.668 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-28T15:47:00.668 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-28T15:47:00.668 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-28T15:47:00.668 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-28T15:47:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-28T15:47:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:01.026 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:47:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:47:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-28T15:47:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-28T15:47:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-28T15:47:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-28T15:47:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-28T15:47:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:01.027 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:01.338 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-fuse 2024-02-28T15:47:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-28T15:47:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 12/12 2024-02-28T15:47:02.238 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:51 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:02.561 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:02.562 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.563 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:02.564 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.565 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.566 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.567 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.568 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:02.634 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:02.635 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:02.635 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-02-28T15:47:02.635 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:02.635 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:47:02.635 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 812 k 2024-02-28T15:47:02.635 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-02-28T15:47:02.635 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-28T15:47:02.635 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:02.635 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:47:02.636 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:02.636 INFO:teuthology.orchestra.run.smithi057.stdout:Install 2 Packages 2024-02-28T15:47:02.636 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:02.636 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 892 k 2024-02-28T15:47:02.636 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 2.6 M 2024-02-28T15:47:02.636 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:47:02.986 INFO:teuthology.orchestra.run.smithi057.stdout:(1/2): ceph-fuse-17.2.7-535.gc0f02e60.el9.x86_6 2.6 MB/s | 812 kB 00:00 2024-02-28T15:47:03.136 INFO:teuthology.orchestra.run.smithi057.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 178 kB/s | 80 kB 00:00 2024-02-28T15:47:03.138 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:03.139 INFO:teuthology.orchestra.run.smithi057.stdout:Total 1.7 MB/s | 892 kB 00:00 2024-02-28T15:47:03.180 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:47:03.255 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:47:03.255 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:47:03.369 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:47:03.370 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:47:03.653 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:47:03.840 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-28T15:47:03.935 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2/2 2024-02-28T15:47:04.487 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 12/12 2024-02-28T15:47:04.487 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 1/12 2024-02-28T15:47:04.488 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-28T15:47:04.488 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-02-28T15:47:04.488 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-02-28T15:47:04.488 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-02-28T15:47:04.488 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-02-28T15:47:04.488 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-02-28T15:47:04.488 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-02-28T15:47:04.488 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-02-28T15:47:04.488 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T15:47:04.488 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-02-28T15:47:04.914 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-02-28T15:47:04.914 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:04.914 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:47:04.914 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:47:04.914 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-28T15:47:04.914 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-28T15:47:04.914 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-28T15:47:04.914 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-28T15:47:04.914 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-28T15:47:04.915 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-28T15:47:04.915 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-28T15:47:04.915 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-28T15:47:04.915 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-28T15:47:04.915 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-28T15:47:04.915 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-28T15:47:04.915 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:04.915 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:04.977 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2/2 2024-02-28T15:47:04.977 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/2 2024-02-28T15:47:05.325 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-rook 2024-02-28T15:47:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-28T15:47:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:05.345 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:47:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-28T15:47:05.346 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:05.346 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:05.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados-devel 2024-02-28T15:47:06.237 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:47 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:06.544 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:06.544 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:06.545 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:06.546 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:06.547 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:06.548 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.549 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.550 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.551 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.552 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:06.553 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.553 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.553 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.553 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.614 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 47 k 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-28T15:47:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout:Install 13 Packages 2024-02-28T15:47:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:06.618 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 2.2 M 2024-02-28T15:47:06.618 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 26 M 2024-02-28T15:47:06.618 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:47:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:55 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:06.979 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:06.979 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:06.979 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:06.979 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.979 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:06.979 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.979 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:06.979 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.979 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:06.979 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.980 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:06.981 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.982 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:06.983 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.984 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:06.985 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.986 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.987 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:06.988 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:07.057 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 126 k 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 126 k 2024-02-28T15:47:07.058 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 448 k 2024-02-28T15:47:07.059 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:47:07.442 INFO:teuthology.orchestra.run.smithi087.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 181 kB/s | 26 kB 00:00 2024-02-28T15:47:07.470 INFO:teuthology.orchestra.run.smithi087.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 113 kB/s | 19 kB 00:00 2024-02-28T15:47:07.571 INFO:teuthology.orchestra.run.smithi087.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-02-28T15:47:07.573 INFO:teuthology.orchestra.run.smithi057.stdout:librados-devel-17.2.7-535.gc0f02e60.el9.x86_64. 246 kB/s | 126 kB 00:00 2024-02-28T15:47:07.575 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:07.576 INFO:teuthology.orchestra.run.smithi057.stdout:Total 244 kB/s | 126 kB 00:00 2024-02-28T15:47:07.576 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:47:07.595 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:47:07.596 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:47:07.596 INFO:teuthology.orchestra.run.smithi087.stdout:(4/13): ceph-mgr-rook-17.2.7-535.gc0f02e60.el9. 160 kB/s | 47 kB 00:00 2024-02-28T15:47:07.621 INFO:teuthology.orchestra.run.smithi087.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-02-28T15:47:07.655 INFO:teuthology.orchestra.run.smithi087.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.3 MB/s | 279 kB 00:00 2024-02-28T15:47:07.697 INFO:teuthology.orchestra.run.smithi087.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 538 kB/s | 54 kB 00:00 2024-02-28T15:47:07.711 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:47:07.711 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:47:07.915 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:47:08.020 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:08.056 INFO:teuthology.orchestra.run.smithi087.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 74 kB/s | 32 kB 00:00 2024-02-28T15:47:08.189 INFO:teuthology.orchestra.run.smithi087.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 28 kB/s | 15 kB 00:00 2024-02-28T15:47:08.489 INFO:teuthology.orchestra.run.smithi087.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 198 kB/s | 59 kB 00:00 2024-02-28T15:47:08.558 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:08.608 INFO:teuthology.orchestra.run.smithi087.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2024-02-28T15:47:08.640 INFO:teuthology.orchestra.run.smithi087.stdout:(12/13): python3-google-auth-2.28.0-1.el9.noarc 245 kB/s | 203 kB 00:00 2024-02-28T15:47:08.706 INFO:teuthology.orchestra.run.smithi087.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 415 kB/s | 90 kB 00:00 2024-02-28T15:47:08.713 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:08.713 INFO:teuthology.orchestra.run.smithi087.stdout:Total 1.0 MB/s | 2.2 MB 00:02 2024-02-28T15:47:08.906 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:08.906 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:08.907 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:47:08.907 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:47:08.907 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:08.907 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:08.911 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:47:08.957 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:47:08.957 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:47:09.113 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:47:09.114 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:47:09.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install libcephfs2 2024-02-28T15:47:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:47:10.034 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-28T15:47:10.101 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-28T15:47:10.155 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:59 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:10.209 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-28T15:47:10.247 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-28T15:47:10.294 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-28T15:47:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-28T15:47:10.483 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.484 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.485 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:10.487 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.489 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.490 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.491 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.492 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:10.493 INFO:teuthology.orchestra.run.smithi057.stdout:Package libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:10.558 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 7/13 2024-02-28T15:47:10.563 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:10.564 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-02-28T15:47:10.564 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:10.627 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-28T15:47:10.639 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install libcephfs-devel 2024-02-28T15:47:11.544 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-28T15:47:11.552 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:00 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:11.594 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-28T15:47:11.627 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-28T15:47:11.678 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-28T15:47:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 13/13 2024-02-28T15:47:11.875 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:11.875 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:11.875 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:11.875 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:11.876 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:11.877 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:11.878 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:11.879 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.880 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.881 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.882 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.883 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.884 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:11.952 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:11.953 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:11.953 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2024-02-28T15:47:11.953 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:11.953 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:47:11.953 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 25 k 2024-02-28T15:47:11.953 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:11.953 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:47:11.953 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:11.954 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-02-28T15:47:11.954 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:11.954 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 25 k 2024-02-28T15:47:11.954 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 110 k 2024-02-28T15:47:11.954 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:47:12.245 INFO:teuthology.orchestra.run.smithi057.stdout:libcephfs-devel-17.2.7-535.gc0f02e60.el9.x86_64 86 kB/s | 25 kB 00:00 2024-02-28T15:47:12.246 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:12.247 INFO:teuthology.orchestra.run.smithi057.stdout:Total 85 kB/s | 25 kB 00:00 2024-02-28T15:47:12.247 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:47:12.259 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:47:12.259 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:47:12.266 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:47:12.267 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:47:12.409 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:47:12.575 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:12.687 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 13/13 2024-02-28T15:47:12.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 1/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 10/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-28T15:47:12.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-28T15:47:12.990 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:13.203 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-28T15:47:13.203 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:13.203 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-28T15:47:13.204 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-28T15:47:13.205 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:13.205 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:13.295 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:13.295 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:13.295 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:47:13.295 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:47:13.295 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:13.295 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:13.501 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados2 2024-02-28T15:47:13.522 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-cephadm 2024-02-28T15:47:14.403 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:03 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:55 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:14.718 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:14.718 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:14.718 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:14.719 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:14.720 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:14.721 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:14.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:14.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:14.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:14.722 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.722 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.723 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.724 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.725 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.726 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.727 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:14.734 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:14.734 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:14.735 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.736 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.737 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:14.738 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.740 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.741 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.742 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.743 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.743 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:14.743 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.743 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.743 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.743 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:14.743 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:14.791 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:14.792 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-02-28T15:47:14.792 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:14.792 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:47:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 121 k 2024-02-28T15:47:14.792 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-02-28T15:47:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-28T15:47:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-28T15:47:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-28T15:47:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-28T15:47:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-28T15:47:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:14.793 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:47:14.793 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:14.793 INFO:teuthology.orchestra.run.smithi087.stdout:Install 6 Packages 2024-02-28T15:47:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:14.794 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 7.0 M 2024-02-28T15:47:14.794 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 33 M 2024-02-28T15:47:14.794 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:47:14.810 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:14.811 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-02-28T15:47:14.811 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:14.882 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librbd1 2024-02-28T15:47:15.727 INFO:teuthology.orchestra.run.smithi087.stdout:(1/6): ceph-mgr-cephadm-17.2.7-535.gc0f02e60.el 208 kB/s | 121 kB 00:00 2024-02-28T15:47:15.737 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:04 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:15.844 INFO:teuthology.orchestra.run.smithi087.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 354 kB/s | 248 kB 00:00 2024-02-28T15:47:16.063 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:16.063 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:16.063 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:16.063 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.064 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.066 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.067 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.068 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.069 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.070 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.071 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.072 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.072 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:16.072 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:16.139 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:16.140 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-02-28T15:47:16.140 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:16.194 INFO:teuthology.orchestra.run.smithi087.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 165 kB/s | 58 kB 00:00 2024-02-28T15:47:16.237 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rados 2024-02-28T15:47:16.352 INFO:teuthology.orchestra.run.smithi087.stdout:(4/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 877 kB/s | 548 kB 00:00 2024-02-28T15:47:16.552 INFO:teuthology.orchestra.run.smithi087.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 142 kB/s | 51 kB 00:00 2024-02-28T15:47:17.144 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:06 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:17.472 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:17.472 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.473 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.474 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:17.475 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:17.476 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:17.477 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.478 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.479 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.480 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.481 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:17.481 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.481 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.481 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.481 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:17.481 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:17.552 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:17.553 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-02-28T15:47:17.554 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:17.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rgw 2024-02-28T15:47:18.522 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:07 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:18.849 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:18.849 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:18.849 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:18.849 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.849 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:18.849 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.849 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:18.849 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.849 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:18.849 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:18.850 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.851 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:18.852 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.852 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:18.852 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.852 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:18.852 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.853 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:18.853 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.853 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:18.853 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.853 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:18.853 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.853 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:18.854 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.854 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:18.854 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.854 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:18.854 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.854 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:18.854 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.854 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:18.854 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.855 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:18.855 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.855 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:18.855 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.855 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:18.855 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.855 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:18.855 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.855 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.856 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:18.857 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.857 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.857 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.857 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.857 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.857 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.857 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:18.858 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.858 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.858 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.858 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.858 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:18.858 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.858 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:18.859 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.860 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.860 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.860 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.860 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:18.860 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.860 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.860 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.860 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:18.861 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:18.929 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:18.930 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-02-28T15:47:18.930 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:19.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-cephfs 2024-02-28T15:47:19.898 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:08 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:20.219 INFO:teuthology.orchestra.run.smithi087.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 1.2 MB/s | 6.0 MB 00:05 2024-02-28T15:47:20.221 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:20.221 INFO:teuthology.orchestra.run.smithi087.stdout:Total 1.3 MB/s | 7.0 MB 00:05 2024-02-28T15:47:20.231 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:20.231 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:20.231 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:20.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.231 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:20.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.231 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:20.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.232 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.233 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:20.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.235 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.236 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.237 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.238 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.239 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:20.240 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:20.309 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:20.310 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-02-28T15:47:20.310 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:20.351 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:47:20.389 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rbd 2024-02-28T15:47:20.389 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:47:20.390 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:47:20.546 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:47:20.546 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:47:20.945 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:47:21.187 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-28T15:47:21.243 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-28T15:47:21.258 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:10 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.593 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.594 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.595 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:21.596 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:21.597 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.598 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.599 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.600 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.601 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:21.602 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:21.672 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:21.674 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-02-28T15:47:21.674 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:21.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-fuse 2024-02-28T15:47:21.938 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-28T15:47:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-28T15:47:22.125 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-28T15:47:22.149 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 6/6 2024-02-28T15:47:22.628 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:11 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:22.958 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:22.958 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:22.958 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:22.958 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.958 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.959 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:22.960 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.961 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:22.962 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.963 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.964 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.965 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:22.966 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.967 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.967 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:22.967 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:23.034 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:23.035 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:23.035 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-02-28T15:47:23.035 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:23.035 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:47:23.035 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 81 k 2024-02-28T15:47:23.035 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:23.035 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:47:23.035 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:23.035 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-02-28T15:47:23.035 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:23.036 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 81 k 2024-02-28T15:47:23.036 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 222 k 2024-02-28T15:47:23.036 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:47:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 6/6 2024-02-28T15:47:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/6 2024-02-28T15:47:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-28T15:47:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-28T15:47:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-28T15:47:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-28T15:47:23.305 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-fuse-17.2.7-535.gc0f02e60.el9.x86_64.rpm 303 kB/s | 81 kB 00:00 2024-02-28T15:47:23.307 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:23.308 INFO:teuthology.orchestra.run.smithi057.stdout:Total 300 kB/s | 81 kB 00:00 2024-02-28T15:47:23.308 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:47:23.332 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:47:23.333 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:47:23.439 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:47:23.439 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:47:23.458 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-28T15:47:23.458 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:23.459 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:47:23.459 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T15:47:23.459 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-28T15:47:23.459 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-28T15:47:23.459 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-28T15:47:23.459 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-28T15:47:23.459 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-28T15:47:23.459 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:23.459 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:23.644 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:47:23.774 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:23.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-fuse 2024-02-28T15:47:24.347 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:24.657 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:24.657 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:24.657 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:47:24.657 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:47:24.657 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:24.657 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:24.704 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:05 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:24.966 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-mirror 2024-02-28T15:47:25.011 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:25.011 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:25.011 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:25.011 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.011 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:25.012 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.013 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:25.014 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:25.015 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:25.016 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.017 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.018 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.019 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.020 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:25.082 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:25.083 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:25.083 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-02-28T15:47:25.083 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:25.083 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:47:25.083 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 812 k 2024-02-28T15:47:25.083 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-02-28T15:47:25.083 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-28T15:47:25.083 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:25.083 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:47:25.084 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:25.084 INFO:teuthology.orchestra.run.smithi087.stdout:Install 2 Packages 2024-02-28T15:47:25.084 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:25.084 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 892 k 2024-02-28T15:47:25.084 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 2.6 M 2024-02-28T15:47:25.085 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:47:25.886 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:14 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:26.096 INFO:teuthology.orchestra.run.smithi087.stdout:(1/2): ceph-fuse-17.2.7-535.gc0f02e60.el9.x86_6 974 kB/s | 812 kB 00:00 2024-02-28T15:47:26.225 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:26.225 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:26.225 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:26.225 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.225 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:26.225 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.225 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.226 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.230 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.231 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.232 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.233 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.234 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:26.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.234 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:26.305 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:26.306 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2024-02-28T15:47:26.306 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:26.306 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:47:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.9 M 2024-02-28T15:47:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:26.306 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:47:26.306 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:26.306 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-02-28T15:47:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:26.307 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 2.9 M 2024-02-28T15:47:26.308 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 12 M 2024-02-28T15:47:26.308 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:47:26.354 INFO:teuthology.orchestra.run.smithi087.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 74 kB/s | 80 kB 00:01 2024-02-28T15:47:26.356 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:26.356 INFO:teuthology.orchestra.run.smithi087.stdout:Total 701 kB/s | 892 kB 00:01 2024-02-28T15:47:26.392 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:47:26.461 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:47:26.461 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:47:26.571 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:47:26.571 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:47:26.858 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:47:27.059 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-28T15:47:27.137 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2/2 2024-02-28T15:47:27.283 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-mirror-17.2.7-535.gc0f02e60.el9.x86_64.rpm 3.0 MB/s | 2.9 MB 00:00 2024-02-28T15:47:27.285 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:27.285 INFO:teuthology.orchestra.run.smithi057.stdout:Total 3.0 MB/s | 2.9 MB 00:00 2024-02-28T15:47:27.286 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:47:27.318 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:47:27.318 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:47:27.440 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:47:27.440 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:47:27.970 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:47:28.033 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:28.107 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:28.107 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:47:28.107 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-28T15:47:28.108 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T15:47:28.108 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T15:47:28.108 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2/2 2024-02-28T15:47:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/2 2024-02-28T15:47:28.546 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-28T15:47:28.546 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:47:28.546 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-28T15:47:28.546 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:28.936 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librados-devel 2024-02-28T15:47:29.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:29.636 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:29.636 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:47:29.636 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:47:29.636 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:29.636 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:29.820 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:10 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:29.940 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-nbd 2024-02-28T15:47:30.130 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:30.130 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:30.130 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:30.130 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.130 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:30.130 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.130 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.131 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:30.132 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.133 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:30.134 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.135 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.136 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.137 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.138 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.139 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:30.203 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:30.204 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-02-28T15:47:30.204 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:30.204 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:47:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 126 k 2024-02-28T15:47:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:30.204 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:47:30.204 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:30.204 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-02-28T15:47:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:30.205 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 126 k 2024-02-28T15:47:30.205 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 448 k 2024-02-28T15:47:30.205 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:47:30.758 INFO:teuthology.orchestra.run.smithi087.stdout:librados-devel-17.2.7-535.gc0f02e60.el9.x86_64. 228 kB/s | 126 kB 00:00 2024-02-28T15:47:30.760 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:30.760 INFO:teuthology.orchestra.run.smithi087.stdout:Total 227 kB/s | 126 kB 00:00 2024-02-28T15:47:30.761 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:47:30.773 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:47:30.773 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:47:30.843 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:19 ago on Wed 28 Feb 2024 03:45:11 PM UTC. 2024-02-28T15:47:30.844 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:47:30.845 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:47:31.010 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:47:31.168 INFO:teuthology.orchestra.run.smithi057.stderr:Modular dependency problems: 2024-02-28T15:47:31.168 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T15:47:31.168 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 1: conflicting requests 2024-02-28T15:47:31.168 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 2: conflicting requests 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 3: conflicting requests 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 4: conflicting requests 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 5: conflicting requests 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 6: conflicting requests 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 7: conflicting requests 2024-02-28T15:47:31.169 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.170 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 8: conflicting requests 2024-02-28T15:47:31.170 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.170 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 9: conflicting requests 2024-02-28T15:47:31.170 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.170 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 10: conflicting requests 2024-02-28T15:47:31.170 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.170 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 11: conflicting requests 2024-02-28T15:47:31.170 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 12: conflicting requests 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 13: conflicting requests 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 14: conflicting requests 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 15: conflicting requests 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 16: conflicting requests 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.171 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 17: conflicting requests 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 18: conflicting requests 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 19: conflicting requests 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 20: conflicting requests 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 21: conflicting requests 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 22: conflicting requests 2024-02-28T15:47:31.172 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 23: conflicting requests 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 24: conflicting requests 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 25: conflicting requests 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 26: conflicting requests 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 27: conflicting requests 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.173 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 28: conflicting requests 2024-02-28T15:47:31.174 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.174 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 29: conflicting requests 2024-02-28T15:47:31.174 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.174 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 30: conflicting requests 2024-02-28T15:47:31.174 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.174 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 31: conflicting requests 2024-02-28T15:47:31.174 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.174 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 32: conflicting requests 2024-02-28T15:47:31.174 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.174 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 33: conflicting requests 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 34: conflicting requests 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 35: conflicting requests 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 36: conflicting requests 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.175 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.176 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.176 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.176 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 38: conflicting requests 2024-02-28T15:47:31.176 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.176 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.176 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.176 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.176 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.176 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.176 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.177 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:31.178 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.179 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.179 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.179 INFO:teuthology.orchestra.run.smithi057.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:31.196 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:31.243 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-02-28T15:47:31.243 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:31.244 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-02-28T15:47:31.244 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:31.244 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-02-28T15:47:31.244 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 164 k 2024-02-28T15:47:31.244 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:31.244 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-02-28T15:47:31.244 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-02-28T15:47:31.244 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-02-28T15:47:31.244 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:31.245 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 164 k 2024-02-28T15:47:31.245 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 477 k 2024-02-28T15:47:31.245 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-02-28T15:47:31.485 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-nbd-17.2.7-535.gc0f02e60.el9.x86_64.rpm 689 kB/s | 164 kB 00:00 2024-02-28T15:47:31.486 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:31.487 INFO:teuthology.orchestra.run.smithi057.stdout:Total 679 kB/s | 164 kB 00:00 2024-02-28T15:47:31.487 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-02-28T15:47:31.514 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-02-28T15:47:31.514 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-02-28T15:47:31.620 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-02-28T15:47:31.620 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-02-28T15:47:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-02-28T15:47:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:32.215 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:32.215 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:32.215 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:47:32.215 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:47:32.215 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:32.215 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:32.529 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:32.580 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install libcephfs2 2024-02-28T15:47:32.873 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:32.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:32.873 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-02-28T15:47:32.873 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:47:32.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:47:32.873 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-02-28T15:47:33.196 DEBUG:teuthology.parallel:result is None 2024-02-28T15:47:33.477 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:14 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:33.792 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:33.792 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:33.792 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:33.792 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.792 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:33.793 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.794 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:33.795 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.796 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.797 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.798 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.799 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.800 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.801 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:33.802 INFO:teuthology.orchestra.run.smithi087.stdout:Package libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:33.867 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:33.868 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-02-28T15:47:33.868 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:33.939 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install libcephfs-devel 2024-02-28T15:47:34.795 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:15 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:35.106 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:35.106 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:35.106 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:35.106 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.106 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:35.106 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.106 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.107 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:35.108 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.109 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.110 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:35.111 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.112 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.113 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.114 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.115 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.115 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:35.115 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.115 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.115 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.115 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:35.178 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:35.179 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:35.179 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-02-28T15:47:35.179 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:35.179 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:47:35.179 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 25 k 2024-02-28T15:47:35.180 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:35.180 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:47:35.180 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:35.180 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-02-28T15:47:35.180 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:35.180 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 25 k 2024-02-28T15:47:35.180 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 110 k 2024-02-28T15:47:35.180 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:47:35.378 INFO:teuthology.orchestra.run.smithi087.stdout:libcephfs-devel-17.2.7-535.gc0f02e60.el9.x86_64 126 kB/s | 25 kB 00:00 2024-02-28T15:47:35.380 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:35.380 INFO:teuthology.orchestra.run.smithi087.stdout:Total 124 kB/s | 25 kB 00:00 2024-02-28T15:47:35.380 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:47:35.388 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:47:35.388 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:47:35.392 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:47:35.393 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:47:35.532 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:47:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:36.557 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:36.557 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:36.557 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:47:36.557 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:47:36.557 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:36.557 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:36.786 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librados2 2024-02-28T15:47:37.652 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:18 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:37.958 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:37.959 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.960 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:37.961 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:37.962 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.963 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.964 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.965 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.966 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.967 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:37.968 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:38.029 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:38.030 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-02-28T15:47:38.030 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:38.109 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librbd1 2024-02-28T15:47:38.963 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:19 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:39.268 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:39.269 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:39.269 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:39.269 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.270 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:39.270 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.270 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:39.270 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.270 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:39.270 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.271 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:39.271 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.271 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:39.271 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.271 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:39.272 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.272 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:39.272 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.272 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:39.272 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.273 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:39.273 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.273 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:39.273 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.273 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:39.273 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.273 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.274 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:39.275 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.276 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.277 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.278 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.279 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.279 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.279 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.279 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:39.279 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.279 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.279 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.279 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.279 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:39.279 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.280 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.280 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.280 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.280 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:39.280 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.280 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.280 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.280 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.280 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:39.280 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.281 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:39.282 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:39.340 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:39.341 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-02-28T15:47:39.341 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:39.412 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rados 2024-02-28T15:47:40.275 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:21 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:40.584 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.585 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.586 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.587 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:40.588 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:40.589 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.590 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.592 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.593 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:40.593 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.593 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.593 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.593 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.593 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:40.593 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.593 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.593 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.593 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:40.594 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:40.659 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:40.660 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-02-28T15:47:40.660 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:40.737 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rgw 2024-02-28T15:47:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:22 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:41.878 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:41.878 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:41.878 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:41.878 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.878 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:41.878 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:41.879 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.880 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.881 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.882 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:41.883 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.883 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:41.883 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.883 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:41.883 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.883 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:41.883 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.883 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:41.883 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.884 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.885 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:41.886 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.887 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:41.888 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:41.953 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:41.954 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-02-28T15:47:41.954 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:42.022 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-cephfs 2024-02-28T15:47:42.860 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:23 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:43.165 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.166 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.167 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:43.168 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.169 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:43.170 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.171 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.172 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.173 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.174 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.174 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.174 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:43.174 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.174 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.174 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.174 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.174 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:43.175 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.175 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.175 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.175 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:43.175 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:43.237 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:43.238 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-02-28T15:47:43.238 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:43.313 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rbd 2024-02-28T15:47:44.187 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:25 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:44.505 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:44.505 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:44.505 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:44.505 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.505 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:44.505 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.505 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:44.505 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.505 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.506 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.507 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:44.508 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.509 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.510 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.511 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.512 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.513 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:44.514 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T15:47:44.580 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:44.581 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-02-28T15:47:44.581 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:44.659 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-fuse 2024-02-28T15:47:45.525 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:26 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:45.830 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:45.830 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:45.830 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:45.830 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.830 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:45.830 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.830 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:45.831 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.834 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.835 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.836 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.837 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.838 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:45.839 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.840 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.840 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.840 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:45.899 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:45.900 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:45.900 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-02-28T15:47:45.900 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:45.901 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:47:45.901 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 81 k 2024-02-28T15:47:45.901 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:45.901 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:47:45.901 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:45.901 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-02-28T15:47:45.901 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:45.901 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 81 k 2024-02-28T15:47:45.901 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 222 k 2024-02-28T15:47:45.901 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:47:46.157 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-fuse-17.2.7-535.gc0f02e60.el9.x86_64.rpm 320 kB/s | 81 kB 00:00 2024-02-28T15:47:46.158 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:46.159 INFO:teuthology.orchestra.run.smithi087.stdout:Total 316 kB/s | 81 kB 00:00 2024-02-28T15:47:46.159 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:47:46.182 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:47:46.182 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:47:46.287 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:47:46.288 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:47:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:47:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:47.559 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:47:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:47:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:47.559 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:47.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-mirror 2024-02-28T15:47:48.726 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:29 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:49.044 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:49.044 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:49.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:49.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:49.044 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.044 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:49.045 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:49.046 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:49.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:49.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:49.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:49.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.047 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:49.047 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:49.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:49.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:49.048 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.048 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:49.049 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.050 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:49.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.050 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:49.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.050 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:49.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.050 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:49.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.050 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:49.050 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.051 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:49.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.051 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:49.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.051 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:49.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.051 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.051 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:49.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.052 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:49.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.052 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.053 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:49.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.053 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:49.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.053 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.054 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.054 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:49.054 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.054 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.054 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.054 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.054 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:49.054 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.054 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.054 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.055 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.055 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:49.055 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.055 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.055 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.055 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.055 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:49.055 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.055 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.055 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.056 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:49.119 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:49.120 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:49.120 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-02-28T15:47:49.120 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:49.120 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:47:49.120 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.9 M 2024-02-28T15:47:49.120 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:49.120 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:47:49.120 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:49.120 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-02-28T15:47:49.121 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:49.121 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 2.9 M 2024-02-28T15:47:49.121 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 12 M 2024-02-28T15:47:49.121 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:47:49.918 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-mirror-17.2.7-535.gc0f02e60.el9.x86_64.rpm 3.7 MB/s | 2.9 MB 00:00 2024-02-28T15:47:49.919 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:49.920 INFO:teuthology.orchestra.run.smithi087.stdout:Total 3.7 MB/s | 2.9 MB 00:00 2024-02-28T15:47:49.921 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:47:49.952 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:47:49.952 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:47:50.070 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:47:50.070 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:47:50.595 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:47:50.718 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:50.791 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T15:47:50.791 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-28T15:47:50.791 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T15:47:50.791 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T15:47:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:52.294 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:52.295 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:52.295 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:47:52.295 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:47:52.295 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:52.295 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:52.630 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-nbd 2024-02-28T15:47:53.500 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:02:34 ago on Wed 28 Feb 2024 03:45:19 PM UTC. 2024-02-28T15:47:53.814 INFO:teuthology.orchestra.run.smithi087.stderr:Modular dependency problems: 2024-02-28T15:47:53.814 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T15:47:53.814 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 1: conflicting requests 2024-02-28T15:47:53.814 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.814 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 2: conflicting requests 2024-02-28T15:47:53.814 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 3: conflicting requests 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 4: conflicting requests 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 5: conflicting requests 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 6: conflicting requests 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 7: conflicting requests 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 8: conflicting requests 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.815 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 9: conflicting requests 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 10: conflicting requests 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 11: conflicting requests 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 12: conflicting requests 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 13: conflicting requests 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 14: conflicting requests 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 15: conflicting requests 2024-02-28T15:47:53.816 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 16: conflicting requests 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 17: conflicting requests 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 18: conflicting requests 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 19: conflicting requests 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 20: conflicting requests 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 21: conflicting requests 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.817 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 22: conflicting requests 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 23: conflicting requests 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 24: conflicting requests 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 25: conflicting requests 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 26: conflicting requests 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 27: conflicting requests 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.818 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 28: conflicting requests 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 29: conflicting requests 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 30: conflicting requests 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 31: conflicting requests 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 32: conflicting requests 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 33: conflicting requests 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 34: conflicting requests 2024-02-28T15:47:53.819 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 35: conflicting requests 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 36: conflicting requests 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 38: conflicting requests 2024-02-28T15:47:53.820 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.821 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.822 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.823 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:47:53.823 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.823 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.823 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.823 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.823 INFO:teuthology.orchestra.run.smithi087.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:47:53.823 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.823 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.823 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.823 INFO:teuthology.orchestra.run.smithi087.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:47:53.885 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-02-28T15:47:53.886 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-02-28T15:47:53.886 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:53.887 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-02-28T15:47:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 164 k 2024-02-28T15:47:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:53.887 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-02-28T15:47:53.887 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-02-28T15:47:53.887 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-02-28T15:47:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:53.887 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 164 k 2024-02-28T15:47:53.887 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 477 k 2024-02-28T15:47:53.887 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-02-28T15:47:54.246 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-nbd-17.2.7-535.gc0f02e60.el9.x86_64.rpm 459 kB/s | 164 kB 00:00 2024-02-28T15:47:54.247 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:47:54.248 INFO:teuthology.orchestra.run.smithi087.stdout:Total 455 kB/s | 164 kB 00:00 2024-02-28T15:47:54.248 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-02-28T15:47:54.274 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-02-28T15:47:54.274 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-02-28T15:47:54.378 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-02-28T15:47:54.379 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-02-28T15:47:54.584 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-02-28T15:47:54.760 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:55.367 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:55.730 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T15:47:55.730 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:55.731 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-02-28T15:47:55.731 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T15:47:55.731 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:47:55.731 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-02-28T15:47:56.054 DEBUG:teuthology.parallel:result is None 2024-02-28T15:47:56.055 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T15:47:56.055 INFO:teuthology.packaging:ref: None 2024-02-28T15:47:56.055 INFO:teuthology.packaging:tag: None 2024-02-28T15:47:56.055 INFO:teuthology.packaging:branch: quincy 2024-02-28T15:47:56.055 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:47:56.055 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-28T15:47:56.452 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-28T15:47:56.525 INFO:teuthology.orchestra.run.smithi057.stdout:17.2.7-535.gc0f02e60.el9 2024-02-28T15:47:56.526 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-535.gc0f02e60.el9 2024-02-28T15:47:56.526 INFO:teuthology.task.install:The correct ceph version 17.2.7-535.gc0f02e60 is installed. 2024-02-28T15:47:56.528 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T15:47:56.528 INFO:teuthology.packaging:ref: None 2024-02-28T15:47:56.528 INFO:teuthology.packaging:tag: None 2024-02-28T15:47:56.528 INFO:teuthology.packaging:branch: quincy 2024-02-28T15:47:56.528 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:47:56.528 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-28T15:47:56.855 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-28T15:47:56.926 INFO:teuthology.orchestra.run.smithi087.stdout:17.2.7-535.gc0f02e60.el9 2024-02-28T15:47:56.927 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-535.gc0f02e60.el9 2024-02-28T15:47:56.927 INFO:teuthology.task.install:The correct ceph version 17.2.7-535.gc0f02e60 is installed. 2024-02-28T15:47:56.929 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-28T15:47:56.929 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:47:56.929 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-28T15:47:57.038 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:47:57.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-28T15:47:57.133 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-28T15:47:57.134 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:47:57.134 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-02-28T15:47:57.239 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-28T15:47:57.337 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:47:57.337 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-02-28T15:47:57.437 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-28T15:47:57.528 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-28T15:47:57.528 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:47:57.528 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-28T15:47:57.623 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-28T15:47:57.759 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:47:57.759 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-28T15:47:57.854 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-28T15:47:57.989 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-28T15:47:57.990 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:47:57.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-02-28T15:47:58.074 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-28T15:47:58.213 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:47:58.213 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-02-28T15:47:58.312 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-28T15:47:58.449 INFO:teuthology.run_tasks:Running task print... 2024-02-28T15:47:58.460 INFO:teuthology.task.print:**** done install task... 2024-02-28T15:47:58.460 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-28T15:47:58.555 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-02-28T15:47:58.555 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-02-28T15:47:58.555 INFO:tasks.cephadm:Cluster fsid is bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:47:58.556 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-28T15:47:58.556 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-28T15:47:58.556 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi057': '172.21.15.57', 'mon.smithi087': '172.21.15.87'} 2024-02-28T15:47:58.556 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-28T15:47:58.556 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname $(hostname -s) 2024-02-28T15:47:58.651 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname $(hostname -s) 2024-02-28T15:47:58.750 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-02-28T15:47:58.751 DEBUG:teuthology.orchestra.run.smithi057:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-28T15:47:59.016 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 28 15:47 /home/ubuntu/cephtest/cephadm 2024-02-28T15:47:59.017 DEBUG:teuthology.orchestra.run.smithi087:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-28T15:47:59.346 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 28 15:47 /home/ubuntu/cephtest/cephadm 2024-02-28T15:47:59.346 DEBUG:teuthology.orchestra.run.smithi057:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-28T15:47:59.404 DEBUG:teuthology.orchestra.run.smithi087:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-28T15:47:59.474 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-02-28T15:47:59.474 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-28T15:47:59.482 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-28T15:48:00.688 INFO:teuthology.orchestra.run.smithi057.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-28T15:48:00.742 INFO:teuthology.orchestra.run.smithi087.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-28T15:48:36.157 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-02-28T15:48:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)", 2024-02-28T15:48:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "image_id": "1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f", 2024-02-28T15:48:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "repo_digests": [ 2024-02-28T15:48:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13" 2024-02-28T15:48:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-02-28T15:48:36.157 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-02-28T15:48:41.013 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T15:48:41.013 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)", 2024-02-28T15:48:41.013 INFO:teuthology.orchestra.run.smithi057.stdout: "image_id": "1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f", 2024-02-28T15:48:41.013 INFO:teuthology.orchestra.run.smithi057.stdout: "repo_digests": [ 2024-02-28T15:48:41.013 INFO:teuthology.orchestra.run.smithi057.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13" 2024-02-28T15:48:41.013 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-02-28T15:48:41.013 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T15:48:41.070 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph 2024-02-28T15:48:41.177 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph 2024-02-28T15:48:41.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /etc/ceph 2024-02-28T15:48:41.383 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /etc/ceph 2024-02-28T15:48:41.470 INFO:tasks.cephadm:Writing seed config... 2024-02-28T15:48:41.471 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-28T15:48:41.471 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-28T15:48:41.471 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-28T15:48:41.471 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-28T15:48:41.471 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-28T15:48:41.471 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-28T15:48:41.471 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-28T15:48:41.471 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-28T15:48:41.472 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-28T15:48:41.472 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-28T15:48:41.472 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-28T15:48:41.472 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-28T15:48:41.472 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-28T15:48:41.472 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-28T15:48:41.472 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-28T15:48:41.472 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-28T15:48:41.472 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-28T15:48:41.473 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-28T15:48:41.474 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-28T15:48:41.474 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-28T15:48:41.474 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-28T15:48:41.474 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-28T15:48:41.474 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-28T15:48:41.474 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-28T15:48:41.474 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-28T15:48:41.474 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-28T15:48:41.475 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:48:41.475 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-28T15:48:41.534 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bf04dacc-d650-11ee-95c3-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-28T15:48:41.534 DEBUG:teuthology.orchestra.run.smithi057:mon.smithi057> sudo journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057.service 2024-02-28T15:48:41.581 INFO:tasks.cephadm:Bootstrapping... 2024-02-28T15:48:41.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid bf04dacc-d650-11ee-95c3-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.57 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-28T15:48:41.906 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:48:41.907 INFO:teuthology.orchestra.run.smithi057.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'bf04dacc-d650-11ee-95c3-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.57', '--skip-admin-label'] 2024-02-28T15:48:41.961 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T15:48:41.961 INFO:teuthology.orchestra.run.smithi057.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-28T15:48:41.962 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying podman|docker is present... 2024-02-28T15:48:42.013 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T15:48:42.013 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying lvm2 is present... 2024-02-28T15:48:42.014 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying time synchronization is in place... 2024-02-28T15:48:42.029 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-28T15:48:42.029 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-28T15:48:42.046 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-28T15:48:42.046 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2024-02-28T15:48:42.064 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout enabled 2024-02-28T15:48:42.084 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout active 2024-02-28T15:48:42.084 INFO:teuthology.orchestra.run.smithi057.stdout:Unit chronyd.service is enabled and running 2024-02-28T15:48:42.084 INFO:teuthology.orchestra.run.smithi057.stdout:Repeating the final host check... 2024-02-28T15:48:42.145 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T15:48:42.145 INFO:teuthology.orchestra.run.smithi057.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-28T15:48:42.145 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl is present 2024-02-28T15:48:42.145 INFO:teuthology.orchestra.run.smithi057.stdout:lvcreate is present 2024-02-28T15:48:42.164 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-28T15:48:42.164 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-28T15:48:42.182 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-28T15:48:42.326 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2024-02-28T15:48:42.329 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout enabled 2024-02-28T15:48:42.329 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout active 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:Unit chronyd.service is enabled and running 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:Host looks OK 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:Cluster fsid: bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:Acquiring lock 139722144288432 on /run/cephadm/bf04dacc-d650-11ee-95c3-87774f69a715.lock 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:Lock 139722144288432 acquired on /run/cephadm/bf04dacc-d650-11ee-95c3-87774f69a715.lock 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying IP 172.21.15.57 port 3300 ... 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying IP 172.21.15.57 port 6789 ... 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:Base mon IP(s) is [172.21.15.57:3300, 172.21.15.57:6789], mon addrv is [v2:172.21.15.57:3300,v1:172.21.15.57:6789] 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.57 metric 100 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.57 metric 100 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-02-28T15:48:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1562/64 scope link noprefixroute 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:Mon IP `172.21.15.57` is in CIDR network `172.21.0.0/20` 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:Mon IP `172.21.15.57` is in CIDR network `172.21.0.0/20` 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-28T15:48:42.331 INFO:teuthology.orchestra.run.smithi057.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-28T15:48:42.959 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stdout 1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f 2024-02-28T15:48:42.960 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-28T15:48:42.960 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Getting image source signatures 2024-02-28T15:48:42.960 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Copying blob sha256:71fe8a47461413e338d0747cd84d29e39028a8869d35ba198bca4ef00bae3782 2024-02-28T15:48:42.960 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-02-28T15:48:42.960 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Copying config sha256:1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f 2024-02-28T15:48:42.960 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-28T15:48:44.205 INFO:teuthology.orchestra.run.smithi057.stdout:ceph: stdout ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable) 2024-02-28T15:48:44.206 INFO:teuthology.orchestra.run.smithi057.stdout:Ceph version: ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable) 2024-02-28T15:48:44.206 INFO:teuthology.orchestra.run.smithi057.stdout:Extracting ceph user uid/gid from container image... 2024-02-28T15:48:45.308 INFO:teuthology.orchestra.run.smithi057.stdout:stat: stdout 167 167 2024-02-28T15:48:45.308 INFO:teuthology.orchestra.run.smithi057.stdout:Creating initial keys... 2024-02-28T15:48:46.533 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph-authtool: stdout AQDdVd9lfWhkMhAA6dqONCfXjW0I0s+thVlYjA== 2024-02-28T15:48:56.962 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph-authtool: stdout AQDeVd9lPlucOhAALB2fkG6bHrAnSjOSfq+0Dg== 2024-02-28T15:48:58.049 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph-authtool: stdout AQDpVd9l/BWdHBAAkB1gLhySWcRfIq3PtynkGQ== 2024-02-28T15:48:58.051 INFO:teuthology.orchestra.run.smithi057.stdout:Creating initial monmap... 2024-02-28T15:48:59.527 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-28T15:48:59.528 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-02-28T15:48:59.528 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:48:59.528 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-28T15:48:59.528 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool for smithi057 [v2:172.21.15.57:3300,v1:172.21.15.57:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-28T15:48:59.528 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = octopus 2024-02-28T15:48:59.528 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: set fsid to bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:48:59.529 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-28T15:48:59.529 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:48:59.529 INFO:teuthology.orchestra.run.smithi057.stdout:Creating mon... 2024-02-28T15:49:00.606 INFO:teuthology.orchestra.run.smithi057.stdout:create mon.smithi057 on 2024-02-28T15:49:00.946 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-28T15:49:01.187 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-28T15:49:01.447 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bf04dacc-d650-11ee-95c3-87774f69a715.target → /etc/systemd/system/ceph-bf04dacc-d650-11ee-95c3-87774f69a715.target. 2024-02-28T15:49:01.447 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bf04dacc-d650-11ee-95c3-87774f69a715.target → /etc/systemd/system/ceph-bf04dacc-d650-11ee-95c3-87774f69a715.target. 2024-02-28T15:49:01.751 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057 2024-02-28T15:49:01.751 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057.service: Unit ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057.service not loaded. 2024-02-28T15:49:02.315 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bf04dacc-d650-11ee-95c3-87774f69a715.target.wants/ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057.service → /etc/systemd/system/ceph-bf04dacc-d650-11ee-95c3-87774f69a715@.service. 2024-02-28T15:49:03.024 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:02 smithi057 podman[28380]: 2024-02-28 15:49:02.950444579 +0000 UTC m=+0.372073896 container start 033d6f0b662cebd6a0b0e1632657a0ee52f8483f74f6d1fbb67fd9ea595adfbf (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=quincy-c0f02e6, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-28T15:49:03.024 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:03 smithi057 bash[28380]: 033d6f0b662cebd6a0b0e1632657a0ee52f8483f74f6d1fbb67fd9ea595adfbf 2024-02-28T15:49:03.051 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T15:49:03.051 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout disabled 2024-02-28T15:49:03.067 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T15:49:03.067 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2024-02-28T15:49:03.068 INFO:teuthology.orchestra.run.smithi057.stdout:firewalld.service is not enabled 2024-02-28T15:49:03.068 INFO:teuthology.orchestra.run.smithi057.stdout:Not possible to enable service . firewalld.service is not available 2024-02-28T15:49:03.068 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mon to start... 2024-02-28T15:49:03.069 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mon... 2024-02-28T15:49:03.348 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:03 smithi057 systemd[1]: Started Ceph mon.smithi057 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T15:49:03.348 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:03 smithi057 ceph-mon[28398]: mkfs bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:49:03.348 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:03 smithi057 ceph-mon[28398]: mon.smithi057 is new leader, mons smithi057 in quorum (ranks 0) 2024-02-28T15:49:04.332 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:04 smithi057 ceph-mon[28398]: mon.smithi057 is new leader, mons smithi057 in quorum (ranks 0) 2024-02-28T15:49:04.332 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:04 smithi057 ceph-mon[28398]: monmap e1: 1 mons at {smithi057=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T15:49:04.332 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:04 smithi057 ceph-mon[28398]: fsmap 2024-02-28T15:49:04.333 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:04 smithi057 ceph-mon[28398]: osdmap e1: 0 total, 0 up, 0 in 2024-02-28T15:49:04.333 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:04 smithi057 ceph-mon[28398]: mgrmap e1: no daemons active 2024-02-28T15:49:04.333 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:04 smithi057 ceph-mon[28398]: from='client.? 172.21.15.57:0/3534729683' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-28T15:49:04.342 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout cluster: 2024-02-28T15:49:04.342 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout id: bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:49:04.343 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-28T15:49:04.343 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:04.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout services: 2024-02-28T15:49:04.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi057 (age 0.707198s) 2024-02-28T15:49:04.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-28T15:49:04.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-28T15:49:04.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:04.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout data: 2024-02-28T15:49:04.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-28T15:49:04.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-28T15:49:04.352 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout pgs: 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.647+0000 7fcada600700 1 Processor -- start 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.647+0000 7fcada600700 1 -- start start 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.647+0000 7fcada600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad407cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.648+0000 7fcada600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad407d0f0 con 0x7fcad407c7a0 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.648+0000 7fcad3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad407cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.649+0000 7fcad3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad407cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47990/0 (socket says 172.21.15.57:47990) 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.649+0000 7fcad3400700 1 -- 172.21.15.57:0/3255839728 learned_addr learned my addr 172.21.15.57:0/3255839728 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.649+0000 7fcad3400700 1 -- 172.21.15.57:0/3255839728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad407d230 con 0x7fcad407c7a0 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.649+0000 7fcad3400700 1 --2- 172.21.15.57:0/3255839728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad407cbb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcac40098e0 tx=0x7fcac4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba2b2c73e8735f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:04.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.650+0000 7fcad2a00700 1 -- 172.21.15.57:0/3255839728 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcac400b860 con 0x7fcad407c7a0 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.650+0000 7fcad2a00700 1 -- 172.21.15.57:0/3255839728 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac400b9c0 con 0x7fcad407c7a0 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.650+0000 7fcad2a00700 1 -- 172.21.15.57:0/3255839728 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcac400bc90 con 0x7fcad407c7a0 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.650+0000 7fcada600700 1 -- 172.21.15.57:0/3255839728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 msgr2=0x7fcad407cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.650+0000 7fcada600700 1 --2- 172.21.15.57:0/3255839728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad407cbb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcac40098e0 tx=0x7fcac4009250 comp rx=0 tx=0).stop 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.650+0000 7fcada600700 1 -- 172.21.15.57:0/3255839728 shutdown_connections 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.650+0000 7fcada600700 1 --2- 172.21.15.57:0/3255839728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad407cbb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.650+0000 7fcada600700 1 -- 172.21.15.57:0/3255839728 >> 172.21.15.57:0/3255839728 conn(0x7fcad4078030 msgr2=0x7fcad407a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.651+0000 7fcada600700 1 -- 172.21.15.57:0/3255839728 shutdown_connections 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.651+0000 7fcada600700 1 -- 172.21.15.57:0/3255839728 wait complete. 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.651+0000 7fcada600700 1 Processor -- start 2024-02-28T15:49:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.652+0000 7fcada600700 1 -- start start 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.652+0000 7fcada600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad41172e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.652+0000 7fcada600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad4117820 con 0x7fcad407c7a0 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.652+0000 7fcad3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad41172e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.652+0000 7fcad3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad41172e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47996/0 (socket says 172.21.15.57:47996) 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.652+0000 7fcad3400700 1 -- 172.21.15.57:0/3534729683 learned_addr learned my addr 172.21.15.57:0/3534729683 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.653+0000 7fcad3400700 1 -- 172.21.15.57:0/3534729683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40094f0 con 0x7fcad407c7a0 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.653+0000 7fcad3400700 1 --2- 172.21.15.57:0/3534729683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad41172e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009290 tx=0x7fcac4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.653+0000 7fcacb400700 1 -- 172.21.15.57:0/3534729683 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcac401c5c0 con 0x7fcad407c7a0 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.653+0000 7fcacb400700 1 -- 172.21.15.57:0/3534729683 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac401c740 con 0x7fcad407c7a0 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.653+0000 7fcada600700 1 -- 172.21.15.57:0/3534729683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad4117a20 con 0x7fcad407c7a0 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.653+0000 7fcacb400700 1 -- 172.21.15.57:0/3534729683 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcac401ca50 con 0x7fcad407c7a0 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.654+0000 7fcada600700 1 -- 172.21.15.57:0/3534729683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad41186c0 con 0x7fcad407c7a0 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.654+0000 7fcacb400700 1 -- 172.21.15.57:0/3534729683 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcac401a450 con 0x7fcad407c7a0 2024-02-28T15:49:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.654+0000 7fcacb400700 1 -- 172.21.15.57:0/3534729683 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcac402e790 con 0x7fcad407c7a0 2024-02-28T15:49:04.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.655+0000 7fcada600700 1 -- 172.21.15.57:0/3534729683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad405f5c0 con 0x7fcad407c7a0 2024-02-28T15:49:04.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.658+0000 7fcacb400700 1 -- 172.21.15.57:0/3534729683 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcac401ce30 con 0x7fcad407c7a0 2024-02-28T15:49:04.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.736+0000 7fcada600700 1 -- 172.21.15.57:0/3534729683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fcad4119190 con 0x7fcad407c7a0 2024-02-28T15:49:04.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.737+0000 7fcacb400700 1 -- 172.21.15.57:0/3534729683 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fcac401a840 con 0x7fcad407c7a0 2024-02-28T15:49:04.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.738+0000 7fcada600700 1 -- 172.21.15.57:0/3534729683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 msgr2=0x7fcad41172e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:04.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.738+0000 7fcada600700 1 --2- 172.21.15.57:0/3534729683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad41172e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009290 tx=0x7fcac4016000 comp rx=0 tx=0).stop 2024-02-28T15:49:04.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.738+0000 7fcada600700 1 -- 172.21.15.57:0/3534729683 shutdown_connections 2024-02-28T15:49:04.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.738+0000 7fcada600700 1 --2- 172.21.15.57:0/3534729683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad407c7a0 0x7fcad41172e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:04.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.738+0000 7fcada600700 1 -- 172.21.15.57:0/3534729683 >> 172.21.15.57:0/3534729683 conn(0x7fcad4078030 msgr2=0x7fcad410bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:04.357 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.739+0000 7fcada600700 1 -- 172.21.15.57:0/3534729683 shutdown_connections 2024-02-28T15:49:04.357 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:03.739+0000 7fcada600700 1 -- 172.21.15.57:0/3534729683 wait complete. 2024-02-28T15:49:04.357 INFO:teuthology.orchestra.run.smithi057.stdout:mon is available 2024-02-28T15:49:04.357 INFO:teuthology.orchestra.run.smithi057.stdout:Assimilating anything we can from ceph.conf... 2024-02-28T15:49:05.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:05 smithi057 ceph-mon[28398]: from='client.? 172.21.15.57:0/2295324731' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-28T15:49:05.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:05 smithi057 ceph-mon[28398]: from='client.? 172.21.15.57:0/2295324731' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-28T15:49:05.669 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [global] 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout fsid = bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.57:3300,v1:172.21.15.57:6789] 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [osd] 2024-02-28T15:49:05.670 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.901+0000 7f6ee6c00700 1 Processor -- start 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.902+0000 7f6ee6c00700 1 -- start start 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.902+0000 7f6ee6c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee00771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.902+0000 7f6ee6c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00790f0 con 0x7f6ee0078ce0 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.903+0000 7f6edfe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee00771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.903+0000 7f6edfe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee00771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48002/0 (socket says 172.21.15.57:48002) 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.903+0000 7f6edfe00700 1 -- 172.21.15.57:0/2694698115 learned_addr learned my addr 172.21.15.57:0/2694698115 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.904+0000 7f6edfe00700 1 -- 172.21.15.57:0/2694698115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0077730 con 0x7f6ee0078ce0 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.904+0000 7f6edfe00700 1 --2- 172.21.15.57:0/2694698115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee00771f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098e0 tx=0x7f6ed0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29f1d638e0b2dac server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.904+0000 7f6edf400700 1 -- 172.21.15.57:0/2694698115 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ed000b860 con 0x7f6ee0078ce0 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.904+0000 7f6edf400700 1 -- 172.21.15.57:0/2694698115 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed000b9c0 con 0x7f6ee0078ce0 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.904+0000 7f6edf400700 1 -- 172.21.15.57:0/2694698115 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ed000bc90 con 0x7f6ee0078ce0 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.905+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2694698115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 msgr2=0x7f6ee00771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.905+0000 7f6ee6c00700 1 --2- 172.21.15.57:0/2694698115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee00771f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098e0 tx=0x7f6ed0009250 comp rx=0 tx=0).stop 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.905+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2694698115 shutdown_connections 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.905+0000 7f6ee6c00700 1 --2- 172.21.15.57:0/2694698115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee00771f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.905+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2694698115 >> 172.21.15.57:0/2694698115 conn(0x7f6ee00fded0 msgr2=0x7f6ee0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.905+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2694698115 shutdown_connections 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.905+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2694698115 wait complete. 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.906+0000 7f6ee6c00700 1 Processor -- start 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.907+0000 7f6ee6c00700 1 -- start start 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.907+0000 7f6ee6c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee0112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:05.672 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.907+0000 7f6ee6c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee01134b0 con 0x7f6ee0078ce0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.907+0000 7f6edfe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee0112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.907+0000 7f6edfe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee0112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48014/0 (socket says 172.21.15.57:48014) 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.907+0000 7f6edfe00700 1 -- 172.21.15.57:0/2295324731 learned_addr learned my addr 172.21.15.57:0/2295324731 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.908+0000 7f6edfe00700 1 -- 172.21.15.57:0/2295324731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00094f0 con 0x7f6ee0078ce0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.908+0000 7f6edfe00700 1 --2- 172.21.15.57:0/2295324731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee0112f70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009290 tx=0x7f6ed0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.908+0000 7f6edcc00700 1 -- 172.21.15.57:0/2295324731 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ed001c5c0 con 0x7f6ee0078ce0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.908+0000 7f6edcc00700 1 -- 172.21.15.57:0/2295324731 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed001c740 con 0x7f6ee0078ce0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.908+0000 7f6edcc00700 1 -- 172.21.15.57:0/2295324731 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ed001ca50 con 0x7f6ee0078ce0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.908+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2295324731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee01136b0 con 0x7f6ee0078ce0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.909+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2295324731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee0114350 con 0x7f6ee0078ce0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.909+0000 7f6edcc00700 1 -- 172.21.15.57:0/2295324731 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6ed001a450 con 0x7f6ee0078ce0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.909+0000 7f6edcc00700 1 -- 172.21.15.57:0/2295324731 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6ed002e790 con 0x7f6ee0078ce0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.910+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2295324731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee005f5c0 con 0x7f6ee0078ce0 2024-02-28T15:49:05.673 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.913+0000 7f6edcc00700 1 -- 172.21.15.57:0/2295324731 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6ed001ce30 con 0x7f6ee0078ce0 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.988+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2295324731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6ee0077c30 con 0x7f6ee0078ce0 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.993+0000 7f6edcc00700 1 -- 172.21.15.57:0/2295324731 <== mon.0 v2:172.21.15.57:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6ed001b3e0 con 0x7f6ee0078ce0 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.993+0000 7f6edcc00700 1 -- 172.21.15.57:0/2295324731 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f6ee0077c30 con 0x7f6ee0078ce0 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.995+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2295324731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 msgr2=0x7f6ee0112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.995+0000 7f6ee6c00700 1 --2- 172.21.15.57:0/2295324731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee0112f70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009290 tx=0x7f6ed0016000 comp rx=0 tx=0).stop 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.995+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2295324731 shutdown_connections 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.995+0000 7f6ee6c00700 1 --2- 172.21.15.57:0/2295324731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ee0078ce0 0x7f6ee0112f70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.995+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2295324731 >> 172.21.15.57:0/2295324731 conn(0x7f6ee00fded0 msgr2=0x7f6ee01074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.995+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2295324731 shutdown_connections 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:04.995+0000 7f6ee6c00700 1 -- 172.21.15.57:0/2295324731 wait complete. 2024-02-28T15:49:05.674 INFO:teuthology.orchestra.run.smithi057.stdout:Generating new minimal ceph.conf... 2024-02-28T15:49:06.654 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:06 smithi057 ceph-mon[28398]: from='client.? 172.21.15.57:0/1365752326' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:49:06.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.237+0000 7f492fe00700 1 Processor -- start 2024-02-28T15:49:06.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.237+0000 7f492fe00700 1 -- start start 2024-02-28T15:49:06.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.238+0000 7f492fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930102980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:06.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.238+0000 7f492fe00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4930102ec0 con 0x7f4930102570 2024-02-28T15:49:06.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.238+0000 7f492ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.238+0000 7f492ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930102980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48024/0 (socket says 172.21.15.57:48024) 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.239+0000 7f492ea00700 1 -- 172.21.15.57:0/6885348 learned_addr learned my addr 172.21.15.57:0/6885348 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.239+0000 7f492ea00700 1 -- 172.21.15.57:0/6885348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4930103000 con 0x7f4930102570 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.239+0000 7f492ea00700 1 --2- 172.21.15.57:0/6885348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930102980 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49200098e0 tx=0x7f4920009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cdc40e9ad17000 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.240+0000 7f492e000700 1 -- 172.21.15.57:0/6885348 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f492000b860 con 0x7f4930102570 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.240+0000 7f492e000700 1 -- 172.21.15.57:0/6885348 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f492000be50 con 0x7f4930102570 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.240+0000 7f492e000700 1 -- 172.21.15.57:0/6885348 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4920010380 con 0x7f4930102570 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.240+0000 7f492fe00700 1 -- 172.21.15.57:0/6885348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 msgr2=0x7f4930102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.240+0000 7f492fe00700 1 --2- 172.21.15.57:0/6885348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930102980 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49200098e0 tx=0x7f4920009250 comp rx=0 tx=0).stop 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.240+0000 7f492fe00700 1 -- 172.21.15.57:0/6885348 shutdown_connections 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.240+0000 7f492fe00700 1 --2- 172.21.15.57:0/6885348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930102980 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.241+0000 7f492fe00700 1 -- 172.21.15.57:0/6885348 >> 172.21.15.57:0/6885348 conn(0x7f49300fdcf0 msgr2=0x7f4930100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.241+0000 7f492fe00700 1 -- 172.21.15.57:0/6885348 shutdown_connections 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.241+0000 7f492fe00700 1 -- 172.21.15.57:0/6885348 wait complete. 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.241+0000 7f492fe00700 1 Processor -- start 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.242+0000 7f492fe00700 1 -- start start 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.242+0000 7f492fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930111450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.242+0000 7f492fe00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4930111990 con 0x7f4930102570 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.242+0000 7f492ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930111450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.242+0000 7f492ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930111450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48040/0 (socket says 172.21.15.57:48040) 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.242+0000 7f492ea00700 1 -- 172.21.15.57:0/1365752326 learned_addr learned my addr 172.21.15.57:0/1365752326 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.243+0000 7f492ea00700 1 -- 172.21.15.57:0/1365752326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200094f0 con 0x7f4930102570 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.243+0000 7f492ea00700 1 --2- 172.21.15.57:0/1365752326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930111450 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4920006fd0 tx=0x7f4920009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.243+0000 7f4926a00700 1 -- 172.21.15.57:0/1365752326 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49200107c0 con 0x7f4930102570 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.243+0000 7f4926a00700 1 -- 172.21.15.57:0/1365752326 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4920010db0 con 0x7f4930102570 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.243+0000 7f492fe00700 1 -- 172.21.15.57:0/1365752326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4930111b90 con 0x7f4930102570 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.243+0000 7f4926a00700 1 -- 172.21.15.57:0/1365752326 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f492001ada0 con 0x7f4930102570 2024-02-28T15:49:06.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.243+0000 7f492fe00700 1 -- 172.21.15.57:0/1365752326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4930112830 con 0x7f4930102570 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.244+0000 7f4926a00700 1 -- 172.21.15.57:0/1365752326 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4920019690 con 0x7f4930102570 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.244+0000 7f4926a00700 1 -- 172.21.15.57:0/1365752326 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f49200248c0 con 0x7f4930102570 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.245+0000 7f492fe00700 1 -- 172.21.15.57:0/1365752326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493005f5c0 con 0x7f4930102570 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.247+0000 7f4926a00700 1 -- 172.21.15.57:0/1365752326 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4920029060 con 0x7f4930102570 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.324+0000 7f492fe00700 1 -- 172.21.15.57:0/1365752326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4930104480 con 0x7f4930102570 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.324+0000 7f4926a00700 1 -- 172.21.15.57:0/1365752326 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f4920020070 con 0x7f4930102570 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.326+0000 7f492fe00700 1 -- 172.21.15.57:0/1365752326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 msgr2=0x7f4930111450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.326+0000 7f492fe00700 1 --2- 172.21.15.57:0/1365752326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930111450 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4920006fd0 tx=0x7f4920009250 comp rx=0 tx=0).stop 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.326+0000 7f492fe00700 1 -- 172.21.15.57:0/1365752326 shutdown_connections 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.326+0000 7f492fe00700 1 --2- 172.21.15.57:0/1365752326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4930102570 0x7f4930111450 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.326+0000 7f492fe00700 1 -- 172.21.15.57:0/1365752326 >> 172.21.15.57:0/1365752326 conn(0x7f49300fdcf0 msgr2=0x7f49300ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.326+0000 7f492fe00700 1 -- 172.21.15.57:0/1365752326 shutdown_connections 2024-02-28T15:49:06.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:06.326+0000 7f492fe00700 1 -- 172.21.15.57:0/1365752326 wait complete. 2024-02-28T15:49:06.961 INFO:teuthology.orchestra.run.smithi057.stdout:Restarting the monitor... 2024-02-28T15:49:07.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:07 smithi057 systemd[1]: Stopping Ceph mon.smithi057 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T15:49:08.101 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:07 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057[28394]: 2024-02-28T15:49:07.682+0000 7f7fce600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi057 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T15:49:08.101 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:07 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057[28394]: 2024-02-28T15:49:07.682+0000 7f7fce600700 -1 mon.smithi057@0(leader) e1 *** Got Signal Terminated *** 2024-02-28T15:49:08.101 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:07 smithi057 podman[28639]: 2024-02-28 15:49:07.828243545 +0000 UTC m=+0.530916158 container died 033d6f0b662cebd6a0b0e1632657a0ee52f8483f74f6d1fbb67fd9ea595adfbf (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-c0f02e6, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T15:49:08.406 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:08 smithi057 podman[28639]: 2024-02-28 15:49:08.217909811 +0000 UTC m=+0.920582431 container cleanup 033d6f0b662cebd6a0b0e1632657a0ee52f8483f74f6d1fbb67fd9ea595adfbf (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=quincy-c0f02e6, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-02-28T15:49:08.406 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:08 smithi057 bash[28639]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057 2024-02-28T15:49:08.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:08 smithi057 podman[28652]: 2024-02-28 15:49:08.41048436 +0000 UTC m=+0.560485719 container remove 033d6f0b662cebd6a0b0e1632657a0ee52f8483f74f6d1fbb67fd9ea595adfbf (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, RELEASE=quincy-c0f02e6, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD) 2024-02-28T15:49:09.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:08 smithi057 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057.service: Deactivated successfully. 2024-02-28T15:49:09.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:08 smithi057 systemd[1]: Stopped Ceph mon.smithi057 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T15:49:09.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:08 smithi057 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057.service: Consumed 1.948s CPU time. 2024-02-28T15:49:09.181 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:08 smithi057 systemd[1]: Starting Ceph mon.smithi057 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T15:49:09.443 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 podman[28744]: 2024-02-28 15:49:09.319641502 +0000 UTC m=+0.125675434 container create 65a85703c36b0620b7086f65f5400683baf23c8c9e5f1ff394949767d8fff145 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, RELEASE=quincy-c0f02e6, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T15:49:09.443 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 podman[28744]: 2024-02-28 15:49:09.227270657 +0000 UTC m=+0.033304552 image pull 1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f quay.ceph.io/ceph-ci/ceph:quincy 2024-02-28T15:49:09.663 INFO:teuthology.orchestra.run.smithi057.stdout:Setting mon public_network to 172.21.0.0/20 2024-02-28T15:49:09.817 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 podman[28744]: 2024-02-28 15:49:09.548724909 +0000 UTC m=+0.354758891 container init 65a85703c36b0620b7086f65f5400683baf23c8c9e5f1ff394949767d8fff145 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, RELEASE=quincy-c0f02e6, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T15:49:09.817 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 podman[28744]: 2024-02-28 15:49:09.559347349 +0000 UTC m=+0.365381265 container start 65a85703c36b0620b7086f65f5400683baf23c8c9e5f1ff394949767d8fff145 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=quincy-c0f02e6, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True) 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable), process ceph-mon, pid 2 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: pidfile_write: ignore empty --pid-file 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: load: jerasure load: lrc 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: RocksDB version: 6.15.5 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Compile date Feb 26 2024 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: DB SUMMARY 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: DB Session ID: F73L79RTCIH3LSUEWFF3 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: CURRENT file: CURRENT 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi057/store.db dir, Total Num: 1, files: 000008.sst 2024-02-28T15:49:09.818 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi057/store.db: 000010.log size: 97286 ; 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.error_if_exists: 0 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.create_if_missing: 0 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.paranoid_checks: 1 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.env: 0x563fc0e72a80 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.fs: Posix File System 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.info_log: 0x563fc25a7cc0 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.statistics: (nil) 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.use_fsync: 0 2024-02-28T15:49:09.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_log_file_size: 0 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.allow_fallocate: 1 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.use_direct_reads: 0 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.db_log_dir: 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi057/store.db 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T15:49:09.820 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.write_buffer_manager: 0x563fc331cb40 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T15:49:09.821 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T15:49:09.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T15:49:09.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.unordered_write: 0 2024-02-28T15:49:09.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T15:49:09.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T15:49:09.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T15:49:09.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T15:49:09.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.row_cache: None 2024-02-28T15:49:09.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.wal_filter: None 2024-02-28T15:49:09.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T15:49:09.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T15:49:09.823 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.preserve_deletes: 0 2024-02-28T15:49:09.823 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.two_write_queues: 0 2024-02-28T15:49:09.823 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T15:49:09.823 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.atomic_flush: 0 2024-02-28T15:49:09.823 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T15:49:09.823 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T15:49:09.823 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T15:49:09.823 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.log_readahead_size: 0 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_background_jobs: 2 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_background_compactions: -1 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_subcompactions: 1 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T15:49:09.824 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_open_files: -1 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_background_flushes: -1 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Compression algorithms supported: 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: kZSTD supported: 0 2024-02-28T15:49:09.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: kXpressCompression supported: 0 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: kZlibCompression supported: 1 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: kSnappyCompression supported: 1 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: kLZ4Compression supported: 1 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: kBZip2Compression supported: 0 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi057/store.db/MANIFEST-000009 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.merge_operator: 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_filter: None 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T15:49:09.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563fc25fcf58) 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: cache_index_and_filter_blocks: 1 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: pin_top_level_index_and_filter: 1 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: index_type: 0 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: data_block_index_type: 0 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: index_shortening: 1 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: hash_index_allow_collision: 1 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: checksum: 1 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: no_block_cache: 0 2024-02-28T15:49:09.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_cache: 0x563fc262f090 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_cache_name: BinnedLRUCache 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_cache_options: 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: capacity : 536870912 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: num_shard_bits : 4 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: strict_capacity_limit : 0 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: high_pri_pool_ratio: 0.000 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_cache_compressed: (nil) 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: persistent_cache: (nil) 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_size: 4096 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_size_deviation: 10 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_restart_interval: 16 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: index_block_restart_interval: 1 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: metadata_block_size: 4096 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: partition_filters: 0 2024-02-28T15:49:09.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: use_delta_encoding: 1 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: whole_key_filtering: 1 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: verify_compression: 0 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: read_amp_bytes_per_bit: 0 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: format_version: 4 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: enable_index_compression: 1 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_align: 0 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compression: NoCompression 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.num_levels: 7 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T15:49:09.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T15:49:09.830 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T15:49:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.arena_block_size: 4194304 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T15:49:09.832 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.table_properties_collectors: 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.inplace_update_support: 0 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.bloom_locality: 0 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.max_successive_merges: 0 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T15:49:09.833 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.ttl: 2592000 2024-02-28T15:49:09.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T15:49:09.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.enable_blob_files: false 2024-02-28T15:49:09.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.min_blob_size: 0 2024-02-28T15:49:09.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T15:49:09.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T15:49:09.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T15:49:09.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T15:49:09.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi057/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-28T15:49:09.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-02-28T15:49:09.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-02-28T15:49:09.835 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709135349617321, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-02-28T15:49:09.835 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-02-28T15:49:09.835 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-28T15:49:09.835 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709135349618787, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92558, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 90653, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13356, "raw_average_key_size": 49, "raw_value_size": 83368, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1709135349, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "9ff9d74d-3e18-40bd-821f-47e14441b7b1", "db_session_id": "F73L79RTCIH3LSUEWFF3"}} 2024-02-28T15:49:09.835 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-02-28T15:49:09.835 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709135349619654, "job": 1, "event": "recovery_finished"} 2024-02-28T15:49:09.835 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi057/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T15:49:09.835 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x563fc25c3180 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: DB pointer 0x563fc2698000 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** DB Stats ** 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** Compaction Stats [default] ** 2024-02-28T15:49:09.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: L0 2/0 92.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.9 0.00 0.00 1 0.001 0 0 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Sum 2/0 92.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.9 0.00 0.00 1 0.001 0 0 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.9 0.00 0.00 1 0.001 0 0 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** Compaction Stats [default] ** 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 96.9 0.00 0.00 1 0.001 0 0 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T15:49:09.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Cumulative compaction: 0.00 GB write, 7.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Interval compaction: 0.00 GB write, 7.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** Compaction Stats [default] ** 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: L0 2/0 92.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.9 0.00 0.00 1 0.001 0 0 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Sum 2/0 92.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.9 0.00 0.00 1 0.001 0 0 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** Compaction Stats [default] ** 2024-02-28T15:49:09.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 96.9 0.00 0.00 1 0.001 0 0 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Cumulative compaction: 0.00 GB write, 7.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T15:49:09.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: starting mon.smithi057 rank 0 at public addrs [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] at bind addrs [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi057 fsid bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: mon.smithi057@-1(???) e1 preinit fsid bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: mon.smithi057@-1(???).mds e1 new map 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: mon.smithi057@-1(???).mds e1 print_map 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: e1 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: legacy client fscid: -1 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: No filesystems configured 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: mon.smithi057@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: mon.smithi057@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: mon.smithi057@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: mon.smithi057@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: mon.smithi057@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-28T15:49:09.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 bash[28744]: 65a85703c36b0620b7086f65f5400683baf23c8c9e5f1ff394949767d8fff145 2024-02-28T15:49:09.841 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 systemd[1]: Started Ceph mon.smithi057 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T15:49:09.841 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: mon.smithi057 is new leader, mons smithi057 in quorum (ranks 0) 2024-02-28T15:49:09.841 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: monmap e1: 1 mons at {smithi057=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T15:49:09.841 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: fsmap 2024-02-28T15:49:09.841 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: osdmap e1: 0 total, 0 up, 0 in 2024-02-28T15:49:09.841 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:09 smithi057 ceph-mon[28763]: mgrmap e1: no daemons active 2024-02-28T15:49:11.075 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.340+0000 7f4e2a000700 1 Processor -- start 2024-02-28T15:49:11.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.340+0000 7f4e2a000700 1 -- start start 2024-02-28T15:49:11.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.341+0000 7f4e2a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e24102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:11.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.341+0000 7f4e2a000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e241030c0 con 0x7f4e24102770 2024-02-28T15:49:11.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.341+0000 7f4e23400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e24102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:11.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.342+0000 7f4e23400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e24102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48048/0 (socket says 172.21.15.57:48048) 2024-02-28T15:49:11.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.342+0000 7f4e23400700 1 -- 172.21.15.57:0/3078912075 learned_addr learned my addr 172.21.15.57:0/3078912075 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:11.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.342+0000 7f4e23400700 1 -- 172.21.15.57:0/3078912075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e24103200 con 0x7f4e24102770 2024-02-28T15:49:11.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.343+0000 7f4e23400700 1 --2- 172.21.15.57:0/3078912075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e24102b80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4e140098e0 tx=0x7f4e14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b78c4febdb80e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:11.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.343+0000 7f4e22000700 1 -- 172.21.15.57:0/3078912075 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e1400b860 con 0x7f4e24102770 2024-02-28T15:49:11.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.343+0000 7f4e22000700 1 -- 172.21.15.57:0/3078912075 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4e1400be50 con 0x7f4e24102770 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.343+0000 7f4e22000700 1 -- 172.21.15.57:0/3078912075 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e14010380 con 0x7f4e24102770 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.344+0000 7f4e2a000700 1 -- 172.21.15.57:0/3078912075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 msgr2=0x7f4e24102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.344+0000 7f4e2a000700 1 --2- 172.21.15.57:0/3078912075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e24102b80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4e140098e0 tx=0x7f4e14009250 comp rx=0 tx=0).stop 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.344+0000 7f4e2a000700 1 -- 172.21.15.57:0/3078912075 shutdown_connections 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.344+0000 7f4e2a000700 1 --2- 172.21.15.57:0/3078912075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e24102b80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.344+0000 7f4e2a000700 1 -- 172.21.15.57:0/3078912075 >> 172.21.15.57:0/3078912075 conn(0x7f4e240fded0 msgr2=0x7f4e24100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.344+0000 7f4e2a000700 1 -- 172.21.15.57:0/3078912075 shutdown_connections 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.344+0000 7f4e2a000700 1 -- 172.21.15.57:0/3078912075 wait complete. 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.345+0000 7f4e2a000700 1 Processor -- start 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.345+0000 7f4e2a000700 1 -- start start 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.345+0000 7f4e2a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e241139c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.346+0000 7f4e2a000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24113f00 con 0x7f4e24102770 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.346+0000 7f4e23400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e241139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:11.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.346+0000 7f4e23400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e241139c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48062/0 (socket says 172.21.15.57:48062) 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.346+0000 7f4e23400700 1 -- 172.21.15.57:0/84852922 learned_addr learned my addr 172.21.15.57:0/84852922 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.346+0000 7f4e23400700 1 -- 172.21.15.57:0/84852922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140094f0 con 0x7f4e24102770 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.347+0000 7f4e23400700 1 --2- 172.21.15.57:0/84852922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e241139c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400b440 tx=0x7f4e14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.347+0000 7f4e1b400700 1 -- 172.21.15.57:0/84852922 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e14010760 con 0x7f4e24102770 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.347+0000 7f4e1b400700 1 -- 172.21.15.57:0/84852922 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4e14010d50 con 0x7f4e24102770 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.347+0000 7f4e2a000700 1 -- 172.21.15.57:0/84852922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e24114100 con 0x7f4e24102770 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.347+0000 7f4e1b400700 1 -- 172.21.15.57:0/84852922 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e14024d80 con 0x7f4e24102770 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.347+0000 7f4e2a000700 1 -- 172.21.15.57:0/84852922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e24114da0 con 0x7f4e24102770 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.348+0000 7f4e1b400700 1 -- 172.21.15.57:0/84852922 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4e1401a6b0 con 0x7f4e24102770 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.348+0000 7f4e1b400700 1 -- 172.21.15.57:0/84852922 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4e1402d860 con 0x7f4e24102770 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.349+0000 7f4e2a000700 1 -- 172.21.15.57:0/84852922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2405f5c0 con 0x7f4e24102770 2024-02-28T15:49:11.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.352+0000 7f4e1b400700 1 -- 172.21.15.57:0/84852922 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4e140108c0 con 0x7f4e24102770 2024-02-28T15:49:11.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.428+0000 7f4e2a000700 1 -- 172.21.15.57:0/84852922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f4e2404bed0 con 0x7f4e24102770 2024-02-28T15:49:11.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.432+0000 7f4e1b400700 1 -- 172.21.15.57:0/84852922 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4e14010a60 con 0x7f4e24102770 2024-02-28T15:49:11.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.434+0000 7f4e2a000700 1 -- 172.21.15.57:0/84852922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 msgr2=0x7f4e241139c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:11.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.434+0000 7f4e2a000700 1 --2- 172.21.15.57:0/84852922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e241139c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400b440 tx=0x7f4e14009250 comp rx=0 tx=0).stop 2024-02-28T15:49:11.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.434+0000 7f4e2a000700 1 -- 172.21.15.57:0/84852922 shutdown_connections 2024-02-28T15:49:11.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.434+0000 7f4e2a000700 1 --2- 172.21.15.57:0/84852922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e24102770 0x7f4e241139c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:11.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.434+0000 7f4e2a000700 1 -- 172.21.15.57:0/84852922 >> 172.21.15.57:0/84852922 conn(0x7f4e240fded0 msgr2=0x7f4e240fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:11.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.434+0000 7f4e2a000700 1 -- 172.21.15.57:0/84852922 shutdown_connections 2024-02-28T15:49:11.084 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:10.435+0000 7f4e2a000700 1 -- 172.21.15.57:0/84852922 wait complete. 2024-02-28T15:49:11.085 INFO:teuthology.orchestra.run.smithi057.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-28T15:49:11.085 INFO:teuthology.orchestra.run.smithi057.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-28T15:49:11.086 INFO:teuthology.orchestra.run.smithi057.stdout:Creating mgr... 2024-02-28T15:49:11.086 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying port 9283 ... 2024-02-28T15:49:11.383 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mgr.smithi057.upqerc 2024-02-28T15:49:11.383 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mgr.smithi057.upqerc.service: Unit ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mgr.smithi057.upqerc.service not loaded. 2024-02-28T15:49:11.631 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bf04dacc-d650-11ee-95c3-87774f69a715.target.wants/ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mgr.smithi057.upqerc.service → /etc/systemd/system/ceph-bf04dacc-d650-11ee-95c3-87774f69a715@.service. 2024-02-28T15:49:11.667 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:11 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/84852922' entity='client.admin' 2024-02-28T15:49:12.515 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T15:49:12.515 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout disabled 2024-02-28T15:49:12.537 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T15:49:12.537 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2024-02-28T15:49:12.537 INFO:teuthology.orchestra.run.smithi057.stdout:firewalld.service is not enabled 2024-02-28T15:49:12.538 INFO:teuthology.orchestra.run.smithi057.stdout:Not possible to enable service . firewalld.service is not available 2024-02-28T15:49:12.564 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T15:49:12.564 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout disabled 2024-02-28T15:49:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T15:49:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2024-02-28T15:49:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:firewalld.service is not enabled 2024-02-28T15:49:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-28T15:49:12.587 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mgr to start... 2024-02-28T15:49:12.587 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mgr... 2024-02-28T15:49:13.630 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:13 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/341140031' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T15:49:13.954 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:13.954 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2024-02-28T15:49:13.954 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsid": "bf04dacc-d650-11ee-95c3-87774f69a715", 2024-02-28T15:49:13.954 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T15:49:13.954 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 0 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "smithi057" 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:13.955 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-28T15:49:13.956 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T15:49:13.956 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:13.956 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T15:49:13.956 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:13.956 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T15:49:13.956 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T15:49:13.956 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T15:49:13.966 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T15:49:13.966 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T15:49:13.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T15:49:03.037341+0000", 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.222+0000 7fb0b1800700 1 Processor -- start 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.223+0000 7fb0b1800700 1 -- start start 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.223+0000 7fb0b1800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac102b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.223+0000 7fb0b1800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac1030b0 con 0x7fb0ac102760 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.224+0000 7fb0aaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.224+0000 7fb0aaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac102b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51122/0 (socket says 172.21.15.57:51122) 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.224+0000 7fb0aaa00700 1 -- 172.21.15.57:0/2300677382 learned_addr learned my addr 172.21.15.57:0/2300677382 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.224+0000 7fb0aaa00700 1 -- 172.21.15.57:0/2300677382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac1031f0 con 0x7fb0ac102760 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.224+0000 7fb0aaa00700 1 --2- 172.21.15.57:0/2300677382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac102b70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009e50 tx=0x7fb09c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbac99ec32ab206 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.225+0000 7fb0a9600700 1 -- 172.21.15.57:0/2300677382 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb09c0092e0 con 0x7fb0ac102760 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.225+0000 7fb0a9600700 1 -- 172.21.15.57:0/2300677382 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb09c012430 con 0x7fb0ac102760 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.225+0000 7fb0a9600700 1 -- 172.21.15.57:0/2300677382 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb09c0075c0 con 0x7fb0ac102760 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.225+0000 7fb0b1800700 1 -- 172.21.15.57:0/2300677382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 msgr2=0x7fb0ac102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.225+0000 7fb0b1800700 1 --2- 172.21.15.57:0/2300677382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac102b70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009e50 tx=0x7fb09c009840 comp rx=0 tx=0).stop 2024-02-28T15:49:13.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.226+0000 7fb0b1800700 1 -- 172.21.15.57:0/2300677382 shutdown_connections 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.226+0000 7fb0b1800700 1 --2- 172.21.15.57:0/2300677382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac102b70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.226+0000 7fb0b1800700 1 -- 172.21.15.57:0/2300677382 >> 172.21.15.57:0/2300677382 conn(0x7fb0ac0fdf00 msgr2=0x7fb0ac100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.226+0000 7fb0b1800700 1 -- 172.21.15.57:0/2300677382 shutdown_connections 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.226+0000 7fb0b1800700 1 -- 172.21.15.57:0/2300677382 wait complete. 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.227+0000 7fb0b1800700 1 Processor -- start 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.227+0000 7fb0b1800700 1 -- start start 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.227+0000 7fb0b1800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.227+0000 7fb0b1800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac113c80 con 0x7fb0ac102760 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.227+0000 7fb0aaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.227+0000 7fb0aaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51126/0 (socket says 172.21.15.57:51126) 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.227+0000 7fb0aaa00700 1 -- 172.21.15.57:0/341140031 learned_addr learned my addr 172.21.15.57:0/341140031 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:13.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.228+0000 7fb0aaa00700 1 -- 172.21.15.57:0/341140031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c009ae0 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.228+0000 7fb0aaa00700 1 --2- 172.21.15.57:0/341140031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac113740 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb09c000f80 tx=0x7fb09c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.228+0000 7fb0a2a00700 1 -- 172.21.15.57:0/341140031 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb09c0092e0 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.228+0000 7fb0a2a00700 1 -- 172.21.15.57:0/341140031 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb09c007cc0 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.228+0000 7fb0b1800700 1 -- 172.21.15.57:0/341140031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac113e80 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.229+0000 7fb0b1800700 1 -- 172.21.15.57:0/341140031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac114b20 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.228+0000 7fb0a2a00700 1 -- 172.21.15.57:0/341140031 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb09c01c990 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.229+0000 7fb0a2a00700 1 -- 172.21.15.57:0/341140031 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb09c019070 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.229+0000 7fb0a2a00700 1 -- 172.21.15.57:0/341140031 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb09c025ce0 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.230+0000 7fb0b1800700 1 -- 172.21.15.57:0/341140031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac05f5c0 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.233+0000 7fb0a2a00700 1 -- 172.21.15.57:0/341140031 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb09c02a060 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.341+0000 7fb0b1800700 1 -- 172.21.15.57:0/341140031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb0ac1045d0 con 0x7fb0ac102760 2024-02-28T15:49:13.972 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.341+0000 7fb0a2a00700 1 -- 172.21.15.57:0/341140031 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fb09c020070 con 0x7fb0ac102760 2024-02-28T15:49:13.973 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.343+0000 7fb0b1800700 1 -- 172.21.15.57:0/341140031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 msgr2=0x7fb0ac113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:13.973 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.343+0000 7fb0b1800700 1 --2- 172.21.15.57:0/341140031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac113740 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb09c000f80 tx=0x7fb09c009840 comp rx=0 tx=0).stop 2024-02-28T15:49:13.973 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.343+0000 7fb0b1800700 1 -- 172.21.15.57:0/341140031 shutdown_connections 2024-02-28T15:49:13.973 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.343+0000 7fb0b1800700 1 --2- 172.21.15.57:0/341140031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac102760 0x7fb0ac113740 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:13.973 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.343+0000 7fb0b1800700 1 -- 172.21.15.57:0/341140031 >> 172.21.15.57:0/341140031 conn(0x7fb0ac0fdf00 msgr2=0x7fb0ac0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:13.973 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.343+0000 7fb0b1800700 1 -- 172.21.15.57:0/341140031 shutdown_connections 2024-02-28T15:49:13.973 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:13.343+0000 7fb0b1800700 1 -- 172.21.15.57:0/341140031 wait complete. 2024-02-28T15:49:13.973 INFO:teuthology.orchestra.run.smithi057.stdout:mgr not available, waiting (1/15)... 2024-02-28T15:49:16.908 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:16 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/666738184' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T15:49:17.362 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:17.362 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2024-02-28T15:49:17.362 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsid": "bf04dacc-d650-11ee-95c3-87774f69a715", 2024-02-28T15:49:17.362 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 0 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "smithi057" 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-02-28T15:49:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T15:49:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-28T15:49:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T15:49:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T15:49:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T15:49:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T15:49:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T15:49:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T15:49:17.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T15:49:17.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T15:49:03.037341+0000", 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.532+0000 7f4e93800700 1 Processor -- start 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.532+0000 7f4e93800700 1 -- start start 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.532+0000 7f4e93800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c104d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.533+0000 7f4e93800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c1052b0 con 0x7f4e8c104960 2024-02-28T15:49:17.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.533+0000 7f4e90e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c104d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.533+0000 7f4e90e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c104d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51130/0 (socket says 172.21.15.57:51130) 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.533+0000 7f4e90e00700 1 -- 172.21.15.57:0/3203090383 learned_addr learned my addr 172.21.15.57:0/3203090383 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.533+0000 7f4e90e00700 1 -- 172.21.15.57:0/3203090383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c1053f0 con 0x7f4e8c104960 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.534+0000 7f4e90e00700 1 --2- 172.21.15.57:0/3203090383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c104d70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4e800098e0 tx=0x7f4e80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7306c1fb3539836f server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.534+0000 7f4e8b400700 1 -- 172.21.15.57:0/3203090383 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e8000b860 con 0x7f4e8c104960 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.534+0000 7f4e8b400700 1 -- 172.21.15.57:0/3203090383 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4e8000be50 con 0x7f4e8c104960 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.534+0000 7f4e8b400700 1 -- 172.21.15.57:0/3203090383 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e80010380 con 0x7f4e8c104960 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.535+0000 7f4e93800700 1 -- 172.21.15.57:0/3203090383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 msgr2=0x7f4e8c104d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.535+0000 7f4e93800700 1 --2- 172.21.15.57:0/3203090383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c104d70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4e800098e0 tx=0x7f4e80009250 comp rx=0 tx=0).stop 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.535+0000 7f4e93800700 1 -- 172.21.15.57:0/3203090383 shutdown_connections 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.535+0000 7f4e93800700 1 --2- 172.21.15.57:0/3203090383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c104d70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.535+0000 7f4e93800700 1 -- 172.21.15.57:0/3203090383 >> 172.21.15.57:0/3203090383 conn(0x7f4e8c100340 msgr2=0x7f4e8c102720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.535+0000 7f4e93800700 1 -- 172.21.15.57:0/3203090383 shutdown_connections 2024-02-28T15:49:17.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.535+0000 7f4e93800700 1 -- 172.21.15.57:0/3203090383 wait complete. 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.536+0000 7f4e93800700 1 Processor -- start 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.536+0000 7f4e93800700 1 -- start start 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.536+0000 7f4e93800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c113a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.536+0000 7f4e93800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c113f60 con 0x7f4e8c104960 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.536+0000 7f4e90e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c113a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.536+0000 7f4e90e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c113a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51146/0 (socket says 172.21.15.57:51146) 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.536+0000 7f4e90e00700 1 -- 172.21.15.57:0/666738184 learned_addr learned my addr 172.21.15.57:0/666738184 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.537+0000 7f4e90e00700 1 -- 172.21.15.57:0/666738184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800094f0 con 0x7f4e8c104960 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.537+0000 7f4e90e00700 1 --2- 172.21.15.57:0/666738184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c113a20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000b440 tx=0x7f4e80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.537+0000 7f4e88c00700 1 -- 172.21.15.57:0/666738184 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e800107c0 con 0x7f4e8c104960 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.537+0000 7f4e88c00700 1 -- 172.21.15.57:0/666738184 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4e80010db0 con 0x7f4e8c104960 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.537+0000 7f4e88c00700 1 -- 172.21.15.57:0/666738184 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e8001ada0 con 0x7f4e8c104960 2024-02-28T15:49:17.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.537+0000 7f4e93800700 1 -- 172.21.15.57:0/666738184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c114160 con 0x7f4e8c104960 2024-02-28T15:49:17.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.538+0000 7f4e93800700 1 -- 172.21.15.57:0/666738184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c114e00 con 0x7f4e8c104960 2024-02-28T15:49:17.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.538+0000 7f4e88c00700 1 -- 172.21.15.57:0/666738184 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4e8002e6c0 con 0x7f4e8c104960 2024-02-28T15:49:17.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.538+0000 7f4e88c00700 1 -- 172.21.15.57:0/666738184 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4e80024950 con 0x7f4e8c104960 2024-02-28T15:49:17.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.539+0000 7f4e93800700 1 -- 172.21.15.57:0/666738184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c05f5c0 con 0x7f4e8c104960 2024-02-28T15:49:17.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.541+0000 7f4e88c00700 1 -- 172.21.15.57:0/666738184 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4e80010920 con 0x7f4e8c104960 2024-02-28T15:49:17.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.618+0000 7f4e93800700 1 -- 172.21.15.57:0/666738184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4e8c064ad0 con 0x7f4e8c104960 2024-02-28T15:49:17.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.618+0000 7f4e88c00700 1 -- 172.21.15.57:0/666738184 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f4e80010ac0 con 0x7f4e8c104960 2024-02-28T15:49:17.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.619+0000 7f4e93800700 1 -- 172.21.15.57:0/666738184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 msgr2=0x7f4e8c113a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:17.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.620+0000 7f4e93800700 1 --2- 172.21.15.57:0/666738184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c113a20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000b440 tx=0x7f4e80009250 comp rx=0 tx=0).stop 2024-02-28T15:49:17.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.620+0000 7f4e93800700 1 -- 172.21.15.57:0/666738184 shutdown_connections 2024-02-28T15:49:17.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.620+0000 7f4e93800700 1 --2- 172.21.15.57:0/666738184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c104960 0x7f4e8c113a20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:17.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.620+0000 7f4e93800700 1 -- 172.21.15.57:0/666738184 >> 172.21.15.57:0/666738184 conn(0x7f4e8c100340 msgr2=0x7f4e8c102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:17.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.620+0000 7f4e93800700 1 -- 172.21.15.57:0/666738184 shutdown_connections 2024-02-28T15:49:17.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:16.620+0000 7f4e93800700 1 -- 172.21.15.57:0/666738184 wait complete. 2024-02-28T15:49:17.372 INFO:teuthology.orchestra.run.smithi057.stdout:mgr not available, waiting (2/15)... 2024-02-28T15:49:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:20 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1705274110' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T15:49:20.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:20.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2024-02-28T15:49:20.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsid": "bf04dacc-d650-11ee-95c3-87774f69a715", 2024-02-28T15:49:20.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T15:49:20.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T15:49:20.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T15:49:20.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 0 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "smithi057" 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T15:49:20.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:20.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T15:49:20.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T15:49:20.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T15:49:20.746 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T15:49:20.746 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:20.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:20.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T15:49:03.037341+0000", 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.949+0000 7f1b3f000700 1 Processor -- start 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.949+0000 7f1b3f000700 1 -- start start 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.949+0000 7f1b3f000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.949+0000 7f1b3f000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b381058a0 con 0x7f1b380714a0 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.950+0000 7f1b37e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:20.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.950+0000 7f1b37e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51152/0 (socket says 172.21.15.57:51152) 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.950+0000 7f1b37e00700 1 -- 172.21.15.57:0/595864467 learned_addr learned my addr 172.21.15.57:0/595864467 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.950+0000 7f1b37e00700 1 -- 172.21.15.57:0/595864467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b381059e0 con 0x7f1b380714a0 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.951+0000 7f1b37e00700 1 --2- 172.21.15.57:0/595864467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38105360 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1b280098e0 tx=0x7f1b28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715c23046a8f2953 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.951+0000 7f1b36a00700 1 -- 172.21.15.57:0/595864467 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b2800b860 con 0x7f1b380714a0 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.951+0000 7f1b36a00700 1 -- 172.21.15.57:0/595864467 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1b2800be50 con 0x7f1b380714a0 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.951+0000 7f1b36a00700 1 -- 172.21.15.57:0/595864467 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b28010380 con 0x7f1b380714a0 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.952+0000 7f1b3f000700 1 -- 172.21.15.57:0/595864467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 msgr2=0x7f1b38105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.952+0000 7f1b3f000700 1 --2- 172.21.15.57:0/595864467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38105360 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1b280098e0 tx=0x7f1b28009250 comp rx=0 tx=0).stop 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.952+0000 7f1b3f000700 1 -- 172.21.15.57:0/595864467 shutdown_connections 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.952+0000 7f1b3f000700 1 --2- 172.21.15.57:0/595864467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38105360 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.952+0000 7f1b3f000700 1 -- 172.21.15.57:0/595864467 >> 172.21.15.57:0/595864467 conn(0x7f1b380fcdd0 msgr2=0x7f1b380ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.952+0000 7f1b3f000700 1 -- 172.21.15.57:0/595864467 shutdown_connections 2024-02-28T15:49:20.750 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.952+0000 7f1b3f000700 1 -- 172.21.15.57:0/595864467 wait complete. 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.953+0000 7f1b3f000700 1 Processor -- start 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.953+0000 7f1b3f000700 1 -- start start 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.953+0000 7f1b3f000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.953+0000 7f1b3f000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38113cb0 con 0x7f1b380714a0 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.953+0000 7f1b37e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.953+0000 7f1b37e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51162/0 (socket says 172.21.15.57:51162) 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.953+0000 7f1b37e00700 1 -- 172.21.15.57:0/1705274110 learned_addr learned my addr 172.21.15.57:0/1705274110 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.954+0000 7f1b37e00700 1 -- 172.21.15.57:0/1705274110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280094f0 con 0x7f1b380714a0 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.954+0000 7f1b37e00700 1 --2- 172.21.15.57:0/1705274110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38113770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b28006b00 tx=0x7f1b28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.954+0000 7f1b2fe00700 1 -- 172.21.15.57:0/1705274110 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b280107c0 con 0x7f1b380714a0 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.954+0000 7f1b2fe00700 1 -- 172.21.15.57:0/1705274110 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1b28010db0 con 0x7f1b380714a0 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.954+0000 7f1b2fe00700 1 -- 172.21.15.57:0/1705274110 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b2801acf0 con 0x7f1b380714a0 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.954+0000 7f1b3f000700 1 -- 172.21.15.57:0/1705274110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b38113eb0 con 0x7f1b380714a0 2024-02-28T15:49:20.751 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.955+0000 7f1b3f000700 1 -- 172.21.15.57:0/1705274110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b38114b50 con 0x7f1b380714a0 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.955+0000 7f1b2fe00700 1 -- 172.21.15.57:0/1705274110 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1b28024440 con 0x7f1b380714a0 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.955+0000 7f1b2fe00700 1 -- 172.21.15.57:0/1705274110 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1b28019710 con 0x7f1b380714a0 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.956+0000 7f1b3f000700 1 -- 172.21.15.57:0/1705274110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3805f5c0 con 0x7f1b380714a0 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:19.958+0000 7f1b2fe00700 1 -- 172.21.15.57:0/1705274110 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1b2801a530 con 0x7f1b380714a0 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:20.036+0000 7f1b3f000700 1 -- 172.21.15.57:0/1705274110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1b381067f0 con 0x7f1b380714a0 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:20.037+0000 7f1b2fe00700 1 -- 172.21.15.57:0/1705274110 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f1b28010920 con 0x7f1b380714a0 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:20.039+0000 7f1b3f000700 1 -- 172.21.15.57:0/1705274110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 msgr2=0x7f1b38113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:20.039+0000 7f1b3f000700 1 --2- 172.21.15.57:0/1705274110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38113770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b28006b00 tx=0x7f1b28009250 comp rx=0 tx=0).stop 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:20.039+0000 7f1b3f000700 1 -- 172.21.15.57:0/1705274110 shutdown_connections 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:20.039+0000 7f1b3f000700 1 --2- 172.21.15.57:0/1705274110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b380714a0 0x7f1b38113770 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:20.039+0000 7f1b3f000700 1 -- 172.21.15.57:0/1705274110 >> 172.21.15.57:0/1705274110 conn(0x7f1b380fcdd0 msgr2=0x7f1b380fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:20.039+0000 7f1b3f000700 1 -- 172.21.15.57:0/1705274110 shutdown_connections 2024-02-28T15:49:20.752 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:20.039+0000 7f1b3f000700 1 -- 172.21.15.57:0/1705274110 wait complete. 2024-02-28T15:49:20.753 INFO:teuthology.orchestra.run.smithi057.stdout:mgr not available, waiting (3/15)... 2024-02-28T15:49:21.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: Activating manager daemon smithi057.upqerc 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: mgrmap e2: smithi057.upqerc(active, starting, since 0.0146012s) 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: from='mgr.14100 172.21.15.57:0/2441197159' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: from='mgr.14100 172.21.15.57:0/2441197159' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: from='mgr.14100 172.21.15.57:0/2441197159' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: from='mgr.14100 172.21.15.57:0/2441197159' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: from='mgr.14100 172.21.15.57:0/2441197159' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: Manager daemon smithi057.upqerc is now available 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: from='mgr.14100 172.21.15.57:0/2441197159' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: from='mgr.14100 172.21.15.57:0/2441197159' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: from='mgr.14100 172.21.15.57:0/2441197159' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: from='mgr.14100 172.21.15.57:0/2441197159' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:21.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:21 smithi057 ceph-mon[28763]: from='mgr.14100 172.21.15.57:0/2441197159' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:23.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:22 smithi057 ceph-mon[28763]: mgrmap e3: smithi057.upqerc(active, since 1.02559s) 2024-02-28T15:49:24.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:23 smithi057 ceph-mon[28763]: mgrmap e4: smithi057.upqerc(active, since 2s) 2024-02-28T15:49:24.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:23 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3761916219' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T15:49:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2024-02-28T15:49:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsid": "bf04dacc-d650-11ee-95c3-87774f69a715", 2024-02-28T15:49:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T15:49:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 0 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "smithi057" 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T15:49:24.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-28T15:49:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T15:49:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T15:49:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T15:49:24.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T15:49:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T15:49:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T15:49:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T15:49:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T15:49:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T15:49:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T15:49:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T15:49:24.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T15:49:03.037341+0000", 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2024-02-28T15:49:24.498 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.372+0000 7fa799e00700 1 Processor -- start 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.372+0000 7fa799e00700 1 -- start start 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.373+0000 7fa799e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa7940760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.373+0000 7fa799e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa794077fa0 con 0x7fa794077b90 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.373+0000 7fa792a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa7940760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.374+0000 7fa792a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa7940760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58304/0 (socket says 172.21.15.57:58304) 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.374+0000 7fa792a00700 1 -- 172.21.15.57:0/3151388127 learned_addr learned my addr 172.21.15.57:0/3151388127 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.374+0000 7fa792a00700 1 -- 172.21.15.57:0/3151388127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940765e0 con 0x7fa794077b90 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.374+0000 7fa792a00700 1 --2- 172.21.15.57:0/3151388127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa7940760a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa7840098e0 tx=0x7fa784009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a74b48e7e3e00e server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.375+0000 7fa791600700 1 -- 172.21.15.57:0/3151388127 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa78400b860 con 0x7fa794077b90 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.375+0000 7fa791600700 1 -- 172.21.15.57:0/3151388127 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa78400be50 con 0x7fa794077b90 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.375+0000 7fa791600700 1 -- 172.21.15.57:0/3151388127 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa784010380 con 0x7fa794077b90 2024-02-28T15:49:24.499 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.375+0000 7fa799e00700 1 -- 172.21.15.57:0/3151388127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 msgr2=0x7fa7940760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.375+0000 7fa799e00700 1 --2- 172.21.15.57:0/3151388127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa7940760a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa7840098e0 tx=0x7fa784009250 comp rx=0 tx=0).stop 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.376+0000 7fa799e00700 1 -- 172.21.15.57:0/3151388127 shutdown_connections 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.376+0000 7fa799e00700 1 --2- 172.21.15.57:0/3151388127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa7940760a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.376+0000 7fa799e00700 1 -- 172.21.15.57:0/3151388127 >> 172.21.15.57:0/3151388127 conn(0x7fa7940fded0 msgr2=0x7fa794100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.376+0000 7fa799e00700 1 -- 172.21.15.57:0/3151388127 shutdown_connections 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.376+0000 7fa799e00700 1 -- 172.21.15.57:0/3151388127 wait complete. 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.377+0000 7fa799e00700 1 Processor -- start 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.377+0000 7fa799e00700 1 -- start start 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.378+0000 7fa799e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa794113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.378+0000 7fa799e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa794113f70 con 0x7fa794077b90 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.378+0000 7fa792a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa794113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.378+0000 7fa792a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa794113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58312/0 (socket says 172.21.15.57:58312) 2024-02-28T15:49:24.500 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.378+0000 7fa792a00700 1 -- 172.21.15.57:0/3761916219 learned_addr learned my addr 172.21.15.57:0/3761916219 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.378+0000 7fa792a00700 1 -- 172.21.15.57:0/3761916219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7840094f0 con 0x7fa794077b90 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.379+0000 7fa792a00700 1 --2- 172.21.15.57:0/3761916219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa794113a30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa78400b440 tx=0x7fa784009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.379+0000 7fa78aa00700 1 -- 172.21.15.57:0/3761916219 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7840107c0 con 0x7fa794077b90 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.379+0000 7fa78aa00700 1 -- 172.21.15.57:0/3761916219 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa784010db0 con 0x7fa794077b90 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.379+0000 7fa799e00700 1 -- 172.21.15.57:0/3761916219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa794114170 con 0x7fa794077b90 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.379+0000 7fa78aa00700 1 -- 172.21.15.57:0/3761916219 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa78401ad30 con 0x7fa794077b90 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.379+0000 7fa799e00700 1 -- 172.21.15.57:0/3761916219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa794114e10 con 0x7fa794077b90 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.380+0000 7fa78aa00700 1 -- 172.21.15.57:0/3761916219 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fa784010920 con 0x7fa794077b90 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.381+0000 7fa799e00700 1 -- 172.21.15.57:0/3761916219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79405f5c0 con 0x7fa794077b90 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.381+0000 7fa78aa00700 1 --2- 172.21.15.57:0/3761916219 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa778036790 0x7fa778038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.381+0000 7fa78aa00700 1 -- 172.21.15.57:0/3761916219 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa78404aba0 con 0x7fa794077b90 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.381+0000 7fa792000700 1 --2- 172.21.15.57:0/3761916219 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa778036790 0x7fa778038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.382+0000 7fa792000700 1 --2- 172.21.15.57:0/3761916219 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa778036790 0x7fa778038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa780009990 tx=0x7fa780006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.389+0000 7fa78aa00700 1 -- 172.21.15.57:0/3761916219 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa78401a430 con 0x7fa794077b90 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.693+0000 7fa799e00700 1 -- 172.21.15.57:0/3761916219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa79404bed0 con 0x7fa794077b90 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.694+0000 7fa78aa00700 1 -- 172.21.15.57:0/3761916219 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fa784018350 con 0x7fa794077b90 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.697+0000 7fa799e00700 1 -- 172.21.15.57:0/3761916219 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa778036790 msgr2=0x7fa778038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.697+0000 7fa799e00700 1 --2- 172.21.15.57:0/3761916219 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa778036790 0x7fa778038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa780009990 tx=0x7fa780006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.697+0000 7fa799e00700 1 -- 172.21.15.57:0/3761916219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 msgr2=0x7fa794113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.697+0000 7fa799e00700 1 --2- 172.21.15.57:0/3761916219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa794113a30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa78400b440 tx=0x7fa784009250 comp rx=0 tx=0).stop 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.697+0000 7fa799e00700 1 -- 172.21.15.57:0/3761916219 shutdown_connections 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.697+0000 7fa799e00700 1 --2- 172.21.15.57:0/3761916219 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa778036790 0x7fa778038c40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.697+0000 7fa799e00700 1 --2- 172.21.15.57:0/3761916219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794077b90 0x7fa794113a30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.697+0000 7fa799e00700 1 -- 172.21.15.57:0/3761916219 >> 172.21.15.57:0/3761916219 conn(0x7fa7940fded0 msgr2=0x7fa7941001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.697+0000 7fa799e00700 1 -- 172.21.15.57:0/3761916219 shutdown_connections 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:23.697+0000 7fa799e00700 1 -- 172.21.15.57:0/3761916219 wait complete. 2024-02-28T15:49:24.502 INFO:teuthology.orchestra.run.smithi057.stdout:mgr is available 2024-02-28T15:49:25.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:25 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/634215125' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-28T15:49:25.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:25.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [global] 2024-02-28T15:49:25.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout fsid = bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:49:25.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-28T15:49:25.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-28T15:49:25.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-28T15:49:25.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-28T15:49:25.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:25.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-28T15:49:25.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-28T15:49:25.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2024-02-28T15:49:25.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [osd] 2024-02-28T15:49:25.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-28T15:49:25.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-28T15:49:25.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-28T15:49:25.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.049+0000 7fe5cc000700 1 Processor -- start 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.049+0000 7fe5cc000700 1 -- start start 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.051+0000 7fe5cc000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c40760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.051+0000 7fe5cc000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4077fa0 con 0x7fe5c4077b90 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.051+0000 7fe5c9600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c40760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.051+0000 7fe5c9600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c40760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58314/0 (socket says 172.21.15.57:58314) 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.051+0000 7fe5c9600700 1 -- 172.21.15.57:0/4223459920 learned_addr learned my addr 172.21.15.57:0/4223459920 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.051+0000 7fe5c9600700 1 -- 172.21.15.57:0/4223459920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40765e0 con 0x7fe5c4077b90 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.051+0000 7fe5c9600700 1 --2- 172.21.15.57:0/4223459920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c40760a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80098e0 tx=0x7fe5b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f765680067adfb3 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.051+0000 7fe5c3e00700 1 -- 172.21.15.57:0/4223459920 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5b800b860 con 0x7fe5c4077b90 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.052+0000 7fe5c3e00700 1 -- 172.21.15.57:0/4223459920 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe5b800be50 con 0x7fe5c4077b90 2024-02-28T15:49:25.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.052+0000 7fe5c3e00700 1 -- 172.21.15.57:0/4223459920 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5b8010380 con 0x7fe5c4077b90 2024-02-28T15:49:25.965 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.052+0000 7fe5cc000700 1 -- 172.21.15.57:0/4223459920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 msgr2=0x7fe5c40760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:25.965 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.052+0000 7fe5cc000700 1 --2- 172.21.15.57:0/4223459920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c40760a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80098e0 tx=0x7fe5b8009250 comp rx=0 tx=0).stop 2024-02-28T15:49:25.965 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.052+0000 7fe5cc000700 1 -- 172.21.15.57:0/4223459920 shutdown_connections 2024-02-28T15:49:25.965 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.052+0000 7fe5cc000700 1 --2- 172.21.15.57:0/4223459920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c40760a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:25.965 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.053+0000 7fe5cc000700 1 -- 172.21.15.57:0/4223459920 >> 172.21.15.57:0/4223459920 conn(0x7fe5c40fded0 msgr2=0x7fe5c4100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:25.965 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.053+0000 7fe5cc000700 1 -- 172.21.15.57:0/4223459920 shutdown_connections 2024-02-28T15:49:25.965 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.053+0000 7fe5cc000700 1 -- 172.21.15.57:0/4223459920 wait complete. 2024-02-28T15:49:25.965 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.053+0000 7fe5cc000700 1 Processor -- start 2024-02-28T15:49:25.968 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.054+0000 7fe5cc000700 1 -- start start 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.054+0000 7fe5cc000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c4113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.054+0000 7fe5cc000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4113f70 con 0x7fe5c4077b90 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.054+0000 7fe5c9600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c4113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.054+0000 7fe5c9600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c4113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58320/0 (socket says 172.21.15.57:58320) 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.054+0000 7fe5c9600700 1 -- 172.21.15.57:0/634215125 learned_addr learned my addr 172.21.15.57:0/634215125 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.055+0000 7fe5c9600700 1 -- 172.21.15.57:0/634215125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b80094f0 con 0x7fe5c4077b90 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.055+0000 7fe5c9600700 1 --2- 172.21.15.57:0/634215125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c4113a30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800b440 tx=0x7fe5b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.055+0000 7fe5c1600700 1 -- 172.21.15.57:0/634215125 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5b80107c0 con 0x7fe5c4077b90 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.055+0000 7fe5c1600700 1 -- 172.21.15.57:0/634215125 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe5b8010db0 con 0x7fe5c4077b90 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.055+0000 7fe5cc000700 1 -- 172.21.15.57:0/634215125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c4114170 con 0x7fe5c4077b90 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.055+0000 7fe5c1600700 1 -- 172.21.15.57:0/634215125 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5b801ad30 con 0x7fe5c4077b90 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.056+0000 7fe5cc000700 1 -- 172.21.15.57:0/634215125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c4114e10 con 0x7fe5c4077b90 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.057+0000 7fe5c1600700 1 -- 172.21.15.57:0/634215125 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fe5b8010920 con 0x7fe5c4077b90 2024-02-28T15:49:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.057+0000 7fe5cc000700 1 -- 172.21.15.57:0/634215125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c405f5c0 con 0x7fe5c4077b90 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.057+0000 7fe5c1600700 1 --2- 172.21.15.57:0/634215125 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fe5ac0367e0 0x7fe5ac038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.057+0000 7fe5c1600700 1 -- 172.21.15.57:0/634215125 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe5b804a7d0 con 0x7fe5c4077b90 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.058+0000 7fe5c8c00700 1 --2- 172.21.15.57:0/634215125 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fe5ac0367e0 0x7fe5ac038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.058+0000 7fe5c8c00700 1 --2- 172.21.15.57:0/634215125 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fe5ac0367e0 0x7fe5ac038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009990 tx=0x7fe5b0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.063+0000 7fe5c1600700 1 -- 172.21.15.57:0/634215125 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe5b801a430 con 0x7fe5c4077b90 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.274+0000 7fe5cc000700 1 -- 172.21.15.57:0/634215125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe5c404bed0 con 0x7fe5c4077b90 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.275+0000 7fe5c1600700 1 -- 172.21.15.57:0/634215125 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fe5b8023390 con 0x7fe5c4077b90 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.278+0000 7fe5cc000700 1 -- 172.21.15.57:0/634215125 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fe5ac0367e0 msgr2=0x7fe5ac038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.278+0000 7fe5cc000700 1 --2- 172.21.15.57:0/634215125 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fe5ac0367e0 0x7fe5ac038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009990 tx=0x7fe5b0006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.278+0000 7fe5cc000700 1 -- 172.21.15.57:0/634215125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 msgr2=0x7fe5c4113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.278+0000 7fe5cc000700 1 --2- 172.21.15.57:0/634215125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c4113a30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800b440 tx=0x7fe5b8009250 comp rx=0 tx=0).stop 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.278+0000 7fe5cc000700 1 -- 172.21.15.57:0/634215125 shutdown_connections 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.278+0000 7fe5cc000700 1 --2- 172.21.15.57:0/634215125 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fe5ac0367e0 0x7fe5ac038c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:25.970 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.278+0000 7fe5cc000700 1 --2- 172.21.15.57:0/634215125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c4077b90 0x7fe5c4113a30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:25.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.278+0000 7fe5cc000700 1 -- 172.21.15.57:0/634215125 >> 172.21.15.57:0/634215125 conn(0x7fe5c40fded0 msgr2=0x7fe5c41001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:25.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.279+0000 7fe5cc000700 1 -- 172.21.15.57:0/634215125 shutdown_connections 2024-02-28T15:49:25.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:25.279+0000 7fe5cc000700 1 -- 172.21.15.57:0/634215125 wait complete. 2024-02-28T15:49:25.971 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling cephadm module... 2024-02-28T15:49:27.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:26 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/779441752' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-28T15:49:27.595 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.550+0000 7fa8e3800700 1 Processor -- start 2024-02-28T15:49:27.595 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.551+0000 7fa8e3800700 1 -- start start 2024-02-28T15:49:27.595 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.551+0000 7fa8e3800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:27.595 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.551+0000 7fa8e3800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc1030c0 con 0x7fa8dc102770 2024-02-28T15:49:27.595 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.551+0000 7fa8e0e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:27.595 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.552+0000 7fa8e0e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58322/0 (socket says 172.21.15.57:58322) 2024-02-28T15:49:27.596 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.552+0000 7fa8e0e00700 1 -- 172.21.15.57:0/3556559365 learned_addr learned my addr 172.21.15.57:0/3556559365 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:27.596 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.552+0000 7fa8e0e00700 1 -- 172.21.15.57:0/3556559365 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc103200 con 0x7fa8dc102770 2024-02-28T15:49:27.596 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.552+0000 7fa8e0e00700 1 --2- 172.21.15.57:0/3556559365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc102b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00098e0 tx=0x7fa8d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d766aa93cd001c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:27.596 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.553+0000 7fa8db400700 1 -- 172.21.15.57:0/3556559365 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d000b860 con 0x7fa8dc102770 2024-02-28T15:49:27.596 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.553+0000 7fa8db400700 1 -- 172.21.15.57:0/3556559365 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa8d000be50 con 0x7fa8dc102770 2024-02-28T15:49:27.596 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.553+0000 7fa8db400700 1 -- 172.21.15.57:0/3556559365 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d0010380 con 0x7fa8dc102770 2024-02-28T15:49:27.596 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.553+0000 7fa8e3800700 1 -- 172.21.15.57:0/3556559365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 msgr2=0x7fa8dc102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:27.596 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.553+0000 7fa8e3800700 1 --2- 172.21.15.57:0/3556559365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc102b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00098e0 tx=0x7fa8d0009250 comp rx=0 tx=0).stop 2024-02-28T15:49:27.596 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.554+0000 7fa8e3800700 1 -- 172.21.15.57:0/3556559365 shutdown_connections 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.554+0000 7fa8e3800700 1 --2- 172.21.15.57:0/3556559365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc102b80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.554+0000 7fa8e3800700 1 -- 172.21.15.57:0/3556559365 >> 172.21.15.57:0/3556559365 conn(0x7fa8dc0fded0 msgr2=0x7fa8dc100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.554+0000 7fa8e3800700 1 -- 172.21.15.57:0/3556559365 shutdown_connections 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.554+0000 7fa8e3800700 1 -- 172.21.15.57:0/3556559365 wait complete. 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.555+0000 7fa8e3800700 1 Processor -- start 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.555+0000 7fa8e3800700 1 -- start start 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.555+0000 7fa8e3800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.555+0000 7fa8e3800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc113f90 con 0x7fa8dc102770 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.555+0000 7fa8e0e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.555+0000 7fa8e0e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58336/0 (socket says 172.21.15.57:58336) 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.555+0000 7fa8e0e00700 1 -- 172.21.15.57:0/779441752 learned_addr learned my addr 172.21.15.57:0/779441752 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.556+0000 7fa8e0e00700 1 -- 172.21.15.57:0/779441752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00094f0 con 0x7fa8dc102770 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.556+0000 7fa8e0e00700 1 --2- 172.21.15.57:0/779441752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc113a50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000b440 tx=0x7fa8d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.556+0000 7fa8d8c00700 1 -- 172.21.15.57:0/779441752 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d00107c0 con 0x7fa8dc102770 2024-02-28T15:49:27.597 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.556+0000 7fa8d8c00700 1 -- 172.21.15.57:0/779441752 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa8d0010db0 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.556+0000 7fa8e3800700 1 -- 172.21.15.57:0/779441752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc114190 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.556+0000 7fa8d8c00700 1 -- 172.21.15.57:0/779441752 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d001ada0 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.557+0000 7fa8e3800700 1 -- 172.21.15.57:0/779441752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc114e30 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.558+0000 7fa8d8c00700 1 -- 172.21.15.57:0/779441752 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fa8d0010920 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.558+0000 7fa8e3800700 1 -- 172.21.15.57:0/779441752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc05f5c0 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.558+0000 7fa8d8c00700 1 --2- 172.21.15.57:0/779441752 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa8c4036790 0x7fa8c4038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.558+0000 7fa8d8c00700 1 -- 172.21.15.57:0/779441752 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa8d004ac20 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.558+0000 7fa8dbe00700 1 --2- 172.21.15.57:0/779441752 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa8c4036790 0x7fa8c4038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.559+0000 7fa8dbe00700 1 --2- 172.21.15.57:0/779441752 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa8c4036790 0x7fa8c4038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009990 tx=0x7fa8c8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.563+0000 7fa8d8c00700 1 -- 172.21.15.57:0/779441752 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa8d002d3e0 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.831+0000 7fa8e3800700 1 -- 172.21.15.57:0/779441752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fa8dc04bed0 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.890+0000 7fa8d8c00700 1 -- 172.21.15.57:0/779441752 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fa8d002ece0 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.891+0000 7fa8d8c00700 1 -- 172.21.15.57:0/779441752 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fa8d004a630 con 0x7fa8dc102770 2024-02-28T15:49:27.598 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.894+0000 7fa8e3800700 1 -- 172.21.15.57:0/779441752 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa8c4036790 msgr2=0x7fa8c4038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:27.599 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.894+0000 7fa8e3800700 1 --2- 172.21.15.57:0/779441752 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa8c4036790 0x7fa8c4038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009990 tx=0x7fa8c8006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:27.599 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.894+0000 7fa8e3800700 1 -- 172.21.15.57:0/779441752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 msgr2=0x7fa8dc113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:27.599 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.894+0000 7fa8e3800700 1 --2- 172.21.15.57:0/779441752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc113a50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000b440 tx=0x7fa8d0009250 comp rx=0 tx=0).stop 2024-02-28T15:49:27.599 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.894+0000 7fa8e3800700 1 -- 172.21.15.57:0/779441752 shutdown_connections 2024-02-28T15:49:27.599 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.894+0000 7fa8e3800700 1 --2- 172.21.15.57:0/779441752 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7fa8c4036790 0x7fa8c4038c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:27.599 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.894+0000 7fa8e3800700 1 --2- 172.21.15.57:0/779441752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8dc102770 0x7fa8dc113a50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:27.599 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.894+0000 7fa8e3800700 1 -- 172.21.15.57:0/779441752 >> 172.21.15.57:0/779441752 conn(0x7fa8dc0fded0 msgr2=0x7fa8dc0fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:27.599 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.894+0000 7fa8e3800700 1 -- 172.21.15.57:0/779441752 shutdown_connections 2024-02-28T15:49:27.599 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:26.894+0000 7fa8e3800700 1 -- 172.21.15.57:0/779441752 wait complete. 2024-02-28T15:49:28.155 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:27 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/779441752' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-28T15:49:28.155 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:27 smithi057 ceph-mon[28763]: mgrmap e5: smithi057.upqerc(active, since 5s) 2024-02-28T15:49:29.013 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:28 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/627841920' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-28T15:49:29.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2024-02-28T15:49:29.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-28T15:49:29.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T15:49:29.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "active_name": "smithi057.upqerc", 2024-02-28T15:49:29.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-28T15:49:29.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2024-02-28T15:49:29.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.198+0000 7faf89600700 1 Processor -- start 2024-02-28T15:49:29.364 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.198+0000 7faf89600700 1 -- start start 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.199+0000 7faf89600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf840760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.199+0000 7faf89600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf84077fe0 con 0x7faf84077bd0 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.199+0000 7faf82a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf840760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.199+0000 7faf82a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf840760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58366/0 (socket says 172.21.15.57:58366) 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.200+0000 7faf82a00700 1 -- 172.21.15.57:0/2531788469 learned_addr learned my addr 172.21.15.57:0/2531788469 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.200+0000 7faf82a00700 1 -- 172.21.15.57:0/2531788469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84076620 con 0x7faf84077bd0 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.200+0000 7faf82a00700 1 --2- 172.21.15.57:0/2531788469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf840760e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faf740098e0 tx=0x7faf74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7855d874b6c291b server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.201+0000 7faf81600700 1 -- 172.21.15.57:0/2531788469 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf7400b860 con 0x7faf84077bd0 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.201+0000 7faf81600700 1 -- 172.21.15.57:0/2531788469 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7faf7400be50 con 0x7faf84077bd0 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.201+0000 7faf81600700 1 -- 172.21.15.57:0/2531788469 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf74010380 con 0x7faf84077bd0 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.201+0000 7faf89600700 1 -- 172.21.15.57:0/2531788469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 msgr2=0x7faf840760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.201+0000 7faf89600700 1 --2- 172.21.15.57:0/2531788469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf840760e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faf740098e0 tx=0x7faf74009250 comp rx=0 tx=0).stop 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.201+0000 7faf89600700 1 -- 172.21.15.57:0/2531788469 shutdown_connections 2024-02-28T15:49:29.365 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.201+0000 7faf89600700 1 --2- 172.21.15.57:0/2531788469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf840760e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.201+0000 7faf89600700 1 -- 172.21.15.57:0/2531788469 >> 172.21.15.57:0/2531788469 conn(0x7faf840fded0 msgr2=0x7faf84100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.202+0000 7faf89600700 1 -- 172.21.15.57:0/2531788469 shutdown_connections 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.202+0000 7faf89600700 1 -- 172.21.15.57:0/2531788469 wait complete. 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.202+0000 7faf89600700 1 Processor -- start 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.203+0000 7faf89600700 1 -- start start 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.203+0000 7faf89600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf84113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.203+0000 7faf89600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf84113fb0 con 0x7faf84077bd0 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.203+0000 7faf82a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf84113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.203+0000 7faf82a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf84113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58372/0 (socket says 172.21.15.57:58372) 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.203+0000 7faf82a00700 1 -- 172.21.15.57:0/627841920 learned_addr learned my addr 172.21.15.57:0/627841920 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.203+0000 7faf82a00700 1 -- 172.21.15.57:0/627841920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf740094f0 con 0x7faf84077bd0 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.204+0000 7faf82a00700 1 --2- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf84113a70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faf74006fd0 tx=0x7faf74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:29.366 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.204+0000 7faf7aa00700 1 -- 172.21.15.57:0/627841920 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf740107c0 con 0x7faf84077bd0 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.204+0000 7faf7aa00700 1 -- 172.21.15.57:0/627841920 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7faf74010db0 con 0x7faf84077bd0 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.204+0000 7faf7aa00700 1 -- 172.21.15.57:0/627841920 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf7401add0 con 0x7faf84077bd0 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.204+0000 7faf89600700 1 -- 172.21.15.57:0/627841920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf841141b0 con 0x7faf84077bd0 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.204+0000 7faf89600700 1 -- 172.21.15.57:0/627841920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf84114e50 con 0x7faf84077bd0 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.205+0000 7faf6fe00700 1 -- 172.21.15.57:0/627841920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c0052b0 con 0x7faf84077bd0 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.206+0000 7faf7aa00700 1 -- 172.21.15.57:0/627841920 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7faf74010920 con 0x7faf84077bd0 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.206+0000 7faf7aa00700 1 --2- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7faf68036790 0x7faf68038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.206+0000 7faf7aa00700 1 -- 172.21.15.57:0/627841920 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7faf7401e070 con 0x7faf84077bd0 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.206+0000 7faf82000700 1 -- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7faf68036790 msgr2=0x7faf68038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1609955238 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.206+0000 7faf82000700 1 --2- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7faf68036790 0x7faf68038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.211+0000 7faf7aa00700 1 -- 172.21.15.57:0/627841920 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7faf74029340 con 0x7faf84077bd0 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.407+0000 7faf82000700 1 -- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7faf68036790 msgr2=0x7faf68038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1609955238 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.407+0000 7faf82000700 1 --2- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7faf68036790 0x7faf68038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T15:49:29.367 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.472+0000 7faf6fe00700 1 -- 172.21.15.57:0/627841920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7faf5c005d70 con 0x7faf84077bd0 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.473+0000 7faf7aa00700 1 -- 172.21.15.57:0/627841920 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7faf7400ee60 con 0x7faf84077bd0 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.475+0000 7faf6fe00700 1 -- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7faf68036790 msgr2=0x7faf68038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.475+0000 7faf6fe00700 1 --2- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7faf68036790 0x7faf68038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.475+0000 7faf6fe00700 1 -- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 msgr2=0x7faf84113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.475+0000 7faf6fe00700 1 --2- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf84113a70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faf74006fd0 tx=0x7faf74009250 comp rx=0 tx=0).stop 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.475+0000 7faf6fe00700 1 -- 172.21.15.57:0/627841920 shutdown_connections 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.475+0000 7faf6fe00700 1 --2- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7faf68036790 0x7faf68038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.475+0000 7faf6fe00700 1 --2- 172.21.15.57:0/627841920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf84077bd0 0x7faf84113a70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.475+0000 7faf6fe00700 1 -- 172.21.15.57:0/627841920 >> 172.21.15.57:0/627841920 conn(0x7faf840fded0 msgr2=0x7faf841001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.476+0000 7faf6fe00700 1 -- 172.21.15.57:0/627841920 shutdown_connections 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:28.476+0000 7faf6fe00700 1 -- 172.21.15.57:0/627841920 wait complete. 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for the mgr to restart... 2024-02-28T15:49:29.368 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mgr epoch 5... 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: Active manager daemon smithi057.upqerc restarted 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: Activating manager daemon smithi057.upqerc 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: osdmap e2: 0 total, 0 up, 0 in 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: mgrmap e6: smithi057.upqerc(active, starting, since 0.0104777s) 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: Manager daemon smithi057.upqerc is now available 2024-02-28T15:49:35.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:35.932 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:35 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:36.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:36 smithi057 ceph-mon[28763]: Found migration_current of "None". Setting to last migration. 2024-02-28T15:49:36.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:36 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:49:36.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:36 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:49:36.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:36 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:49:36.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:36 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T15:49:36.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:36 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T15:49:36.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:36 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:36.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:36 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:49:36.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:36 smithi057 ceph-mon[28763]: mgrmap e7: smithi057.upqerc(active, since 1.01512s) 2024-02-28T15:49:37.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2024-02-28T15:49:37.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-28T15:49:37.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-28T15:49:37.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.899+0000 7f4395000700 1 Processor -- start 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.899+0000 7f4395000700 1 -- start start 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.900+0000 7f4395000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.900+0000 7f4395000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43901030c0 con 0x7f4390102770 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.900+0000 7f438de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.900+0000 7f438de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58382/0 (socket says 172.21.15.57:58382) 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.900+0000 7f438de00700 1 -- 172.21.15.57:0/4006029706 learned_addr learned my addr 172.21.15.57:0/4006029706 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.901+0000 7f438de00700 1 -- 172.21.15.57:0/4006029706 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4390103200 con 0x7f4390102770 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.901+0000 7f438de00700 1 --2- 172.21.15.57:0/4006029706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390102b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f43800098e0 tx=0x7f4380009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80fc35885882f32 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.901+0000 7f438ca00700 1 -- 172.21.15.57:0/4006029706 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f438000b860 con 0x7f4390102770 2024-02-28T15:49:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.901+0000 7f438ca00700 1 -- 172.21.15.57:0/4006029706 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f438000be50 con 0x7f4390102770 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.901+0000 7f438ca00700 1 -- 172.21.15.57:0/4006029706 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4380010380 con 0x7f4390102770 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.902+0000 7f4395000700 1 -- 172.21.15.57:0/4006029706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 msgr2=0x7f4390102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.902+0000 7f4395000700 1 --2- 172.21.15.57:0/4006029706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390102b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f43800098e0 tx=0x7f4380009250 comp rx=0 tx=0).stop 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.902+0000 7f4395000700 1 -- 172.21.15.57:0/4006029706 shutdown_connections 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.902+0000 7f4395000700 1 --2- 172.21.15.57:0/4006029706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390102b80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.902+0000 7f4395000700 1 -- 172.21.15.57:0/4006029706 >> 172.21.15.57:0/4006029706 conn(0x7f43900fded0 msgr2=0x7f4390100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.902+0000 7f4395000700 1 -- 172.21.15.57:0/4006029706 shutdown_connections 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.902+0000 7f4395000700 1 -- 172.21.15.57:0/4006029706 wait complete. 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.903+0000 7f4395000700 1 Processor -- start 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.903+0000 7f4395000700 1 -- start start 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.903+0000 7f4395000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.903+0000 7f4395000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4390113f40 con 0x7f4390102770 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.904+0000 7f438de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.904+0000 7f438de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58394/0 (socket says 172.21.15.57:58394) 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.904+0000 7f438de00700 1 -- 172.21.15.57:0/3656269040 learned_addr learned my addr 172.21.15.57:0/3656269040 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.904+0000 7f438de00700 1 -- 172.21.15.57:0/3656269040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800094f0 con 0x7f4390102770 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.904+0000 7f438de00700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390113a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f438000b440 tx=0x7f4380009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.904+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43800107c0 con 0x7f4390102770 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.904+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4380010db0 con 0x7f4390102770 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.904+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f438001ada0 con 0x7f4390102770 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.904+0000 7f4395000700 1 -- 172.21.15.57:0/3656269040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4390114140 con 0x7f4390102770 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.905+0000 7f4395000700 1 -- 172.21.15.57:0/3656269040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4390114de0 con 0x7f4390102770 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.906+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f4380010920 con 0x7f4390102770 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.906+0000 7f4386000700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 0x7f4374038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.906+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 --> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43740393a0 con 0x7f43740367e0 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.906+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f438004aca0 con 0x7f4390102770 2024-02-28T15:49:37.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.907+0000 7f438d400700 1 -- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 msgr2=0x7f4374038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1609955238 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:29.907+0000 7f438d400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 0x7f4374038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:30.108+0000 7f438d400700 1 -- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 msgr2=0x7f4374038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1609955238 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:30.108+0000 7f438d400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 0x7f4374038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:30.509+0000 7f438d400700 1 -- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 msgr2=0x7f4374038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1609955238 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:30.509+0000 7f438d400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 0x7f4374038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:31.310+0000 7f438d400700 1 -- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 msgr2=0x7f4374038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1609955238 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:31.310+0000 7f438d400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 0x7f4374038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:32.912+0000 7f438d400700 1 -- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 msgr2=0x7f4374038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1609955238 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:32.912+0000 7f438d400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 0x7f4374038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:35.644+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mgrmap(e 6) v1 ==== 43135+0+0 (secure 0 0 0) 0x7f438002d3e0 con 0x7f4390102770 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:35.645+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 msgr2=0x7f4374038c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:35.645+0000 7f4386000700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 0x7f4374038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.647+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7f4380023390 con 0x7f4390102770 2024-02-28T15:49:37.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.647+0000 7f4386000700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f4374039fc0 0x7f437403c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:37.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.648+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43740393a0 con 0x7f4374039fc0 2024-02-28T15:49:37.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.651+0000 7f438d400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f4374039fc0 0x7f437403c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:37.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.654+0000 7f438d400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f4374039fc0 0x7f437403c3a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f437c0039d0 tx=0x7f437c009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:37.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.657+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f43740393a0 con 0x7f4374039fc0 2024-02-28T15:49:37.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.664+0000 7f437b400700 1 -- 172.21.15.57:0/3656269040 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f43901145d0 con 0x7f4374039fc0 2024-02-28T15:49:37.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.665+0000 7f4386000700 1 -- 172.21.15.57:0/3656269040 <== mgr.14120 v2:172.21.15.57:6800/3389594762 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f43901145d0 con 0x7f4374039fc0 2024-02-28T15:49:37.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.665+0000 7f437b400700 1 -- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f4374039fc0 msgr2=0x7f437403c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:37.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.665+0000 7f437b400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f4374039fc0 0x7f437403c3a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f437c0039d0 tx=0x7f437c009350 comp rx=0 tx=0).stop 2024-02-28T15:49:37.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.665+0000 7f437b400700 1 -- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 msgr2=0x7f4390113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:37.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.665+0000 7f437b400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390113a00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f438000b440 tx=0x7f4380009250 comp rx=0 tx=0).stop 2024-02-28T15:49:37.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.666+0000 7f437b400700 1 -- 172.21.15.57:0/3656269040 shutdown_connections 2024-02-28T15:49:37.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.666+0000 7f437b400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f4374039fc0 0x7f437403c3a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:37.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.666+0000 7f437b400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4390102770 0x7f4390113a00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:37.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.666+0000 7f437b400700 1 --2- 172.21.15.57:0/3656269040 >> [v2:172.21.15.57:6800/1609955238,v1:172.21.15.57:6801/1609955238] conn(0x7f43740367e0 0x7f4374038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:37.401 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.666+0000 7f437b400700 1 -- 172.21.15.57:0/3656269040 >> 172.21.15.57:0/3656269040 conn(0x7f43900fded0 msgr2=0x7f43900fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:37.401 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.666+0000 7f437b400700 1 -- 172.21.15.57:0/3656269040 shutdown_connections 2024-02-28T15:49:37.401 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:36.666+0000 7f437b400700 1 -- 172.21.15.57:0/3656269040 wait complete. 2024-02-28T15:49:37.401 INFO:teuthology.orchestra.run.smithi057.stdout:mgr epoch 5 is available 2024-02-28T15:49:37.401 INFO:teuthology.orchestra.run.smithi057.stdout:Setting orchestrator backend to cephadm... 2024-02-28T15:49:37.977 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:37 smithi057 ceph-mon[28763]: [28/Feb/2024:15:49:36] ENGINE Bus STARTING 2024-02-28T15:49:37.977 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:37 smithi057 ceph-mon[28763]: [28/Feb/2024:15:49:36] ENGINE Serving on https://172.21.15.57:7150 2024-02-28T15:49:37.977 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:37 smithi057 ceph-mon[28763]: [28/Feb/2024:15:49:36] ENGINE Bus STARTED 2024-02-28T15:49:37.977 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:37 smithi057 ceph-mon[28763]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-28T15:49:37.977 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:37 smithi057 ceph-mon[28763]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-28T15:49:38.905 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:38 smithi057 ceph-mon[28763]: mgrmap e8: smithi057.upqerc(active, since 2s) 2024-02-28T15:49:38.905 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:38 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:38.905 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:38 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:49:38.914 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.982+0000 7f74dec00700 1 Processor -- start 2024-02-28T15:49:38.915 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.982+0000 7f74dec00700 1 -- start start 2024-02-28T15:49:38.915 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.982+0000 7f74dec00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:38.915 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.982+0000 7f74dec00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8101fc0 con 0x7f74d8101670 2024-02-28T15:49:38.915 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.983+0000 7f74d7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:38.915 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.983+0000 7f74d7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37750/0 (socket says 172.21.15.57:37750) 2024-02-28T15:49:38.915 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.983+0000 7f74d7e00700 1 -- 172.21.15.57:0/2504115717 learned_addr learned my addr 172.21.15.57:0/2504115717 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:38.916 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.983+0000 7f74d7e00700 1 -- 172.21.15.57:0/2504115717 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8102100 con 0x7f74d8101670 2024-02-28T15:49:38.916 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.984+0000 7f74d7e00700 1 --2- 172.21.15.57:0/2504115717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8101a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f74c80098e0 tx=0x7f74c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f804446fe044e8ea server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:38.916 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.984+0000 7f74d6a00700 1 -- 172.21.15.57:0/2504115717 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74c800b860 con 0x7f74d8101670 2024-02-28T15:49:38.918 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.984+0000 7f74d6a00700 1 -- 172.21.15.57:0/2504115717 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f74c800be50 con 0x7f74d8101670 2024-02-28T15:49:38.918 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.984+0000 7f74d6a00700 1 -- 172.21.15.57:0/2504115717 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74c8010380 con 0x7f74d8101670 2024-02-28T15:49:38.918 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.985+0000 7f74dec00700 1 -- 172.21.15.57:0/2504115717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 msgr2=0x7f74d8101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:38.918 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.985+0000 7f74dec00700 1 --2- 172.21.15.57:0/2504115717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8101a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f74c80098e0 tx=0x7f74c8009250 comp rx=0 tx=0).stop 2024-02-28T15:49:38.918 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.985+0000 7f74dec00700 1 -- 172.21.15.57:0/2504115717 shutdown_connections 2024-02-28T15:49:38.918 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.985+0000 7f74dec00700 1 --2- 172.21.15.57:0/2504115717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8101a80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:38.918 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.985+0000 7f74dec00700 1 -- 172.21.15.57:0/2504115717 >> 172.21.15.57:0/2504115717 conn(0x7f74d80fcdd0 msgr2=0x7f74d80ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.985+0000 7f74dec00700 1 -- 172.21.15.57:0/2504115717 shutdown_connections 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.985+0000 7f74dec00700 1 -- 172.21.15.57:0/2504115717 wait complete. 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.986+0000 7f74dec00700 1 Processor -- start 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.986+0000 7f74dec00700 1 -- start start 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.986+0000 7f74dec00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.986+0000 7f74dec00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8113c60 con 0x7f74d8101670 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.986+0000 7f74d7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.986+0000 7f74d7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37754/0 (socket says 172.21.15.57:37754) 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.986+0000 7f74d7e00700 1 -- 172.21.15.57:0/1243300985 learned_addr learned my addr 172.21.15.57:0/1243300985 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.987+0000 7f74d7e00700 1 -- 172.21.15.57:0/1243300985 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c80094f0 con 0x7f74d8101670 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.987+0000 7f74d7e00700 1 --2- 172.21.15.57:0/1243300985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8113720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f74c800b440 tx=0x7f74c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.987+0000 7f74cfe00700 1 -- 172.21.15.57:0/1243300985 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74c80107c0 con 0x7f74d8101670 2024-02-28T15:49:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.987+0000 7f74cfe00700 1 -- 172.21.15.57:0/1243300985 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f74c8010db0 con 0x7f74d8101670 2024-02-28T15:49:38.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.987+0000 7f74cfe00700 1 -- 172.21.15.57:0/1243300985 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74c801ada0 con 0x7f74d8101670 2024-02-28T15:49:38.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.987+0000 7f74dec00700 1 -- 172.21.15.57:0/1243300985 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d8113e60 con 0x7f74d8101670 2024-02-28T15:49:38.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.988+0000 7f74dec00700 1 -- 172.21.15.57:0/1243300985 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d8114b00 con 0x7f74d8101670 2024-02-28T15:49:38.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.989+0000 7f74cfe00700 1 -- 172.21.15.57:0/1243300985 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f74c8010920 con 0x7f74d8101670 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.989+0000 7f74dec00700 1 -- 172.21.15.57:0/1243300985 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d805f5c0 con 0x7f74d8101670 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.989+0000 7f74cfe00700 1 --2- 172.21.15.57:0/1243300985 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f74bc036770 0x7f74bc038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.989+0000 7f74cfe00700 1 -- 172.21.15.57:0/1243300985 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f74c804adf0 con 0x7f74d8101670 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.990+0000 7f74d7400700 1 --2- 172.21.15.57:0/1243300985 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f74bc036770 0x7f74bc038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.990+0000 7f74d7400700 1 --2- 172.21.15.57:0/1243300985 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f74bc036770 0x7f74bc038c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009990 tx=0x7f74c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:37.995+0000 7f74cfe00700 1 -- 172.21.15.57:0/1243300985 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f74c8018710 con 0x7f74d8101670 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.221+0000 7f74dec00700 1 -- 172.21.15.57:0/1243300985 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f74d81156e0 con 0x7f74bc036770 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.235+0000 7f74cfe00700 1 -- 172.21.15.57:0/1243300985 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f74d81156e0 con 0x7f74bc036770 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.238+0000 7f74dec00700 1 -- 172.21.15.57:0/1243300985 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f74bc036770 msgr2=0x7f74bc038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.238+0000 7f74dec00700 1 --2- 172.21.15.57:0/1243300985 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f74bc036770 0x7f74bc038c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009990 tx=0x7f74c4006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.238+0000 7f74dec00700 1 -- 172.21.15.57:0/1243300985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 msgr2=0x7f74d8113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.238+0000 7f74dec00700 1 --2- 172.21.15.57:0/1243300985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8113720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f74c800b440 tx=0x7f74c8009250 comp rx=0 tx=0).stop 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.238+0000 7f74dec00700 1 -- 172.21.15.57:0/1243300985 shutdown_connections 2024-02-28T15:49:38.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.238+0000 7f74dec00700 1 --2- 172.21.15.57:0/1243300985 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f74bc036770 0x7f74bc038c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:38.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.238+0000 7f74dec00700 1 --2- 172.21.15.57:0/1243300985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d8101670 0x7f74d8113720 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:38.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.238+0000 7f74dec00700 1 -- 172.21.15.57:0/1243300985 >> 172.21.15.57:0/1243300985 conn(0x7f74d80fcdd0 msgr2=0x7f74d81063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:38.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.239+0000 7f74dec00700 1 -- 172.21.15.57:0/1243300985 shutdown_connections 2024-02-28T15:49:38.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:38.239+0000 7f74dec00700 1 -- 172.21.15.57:0/1243300985 wait complete. 2024-02-28T15:49:39.763 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:39 smithi057 ceph-mon[28763]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:49:40.414 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-28T15:49:40.414 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.537+0000 7f9b4e000700 1 Processor -- start 2024-02-28T15:49:40.414 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.537+0000 7f9b4e000700 1 -- start start 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.538+0000 7f9b4e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b4807ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.538+0000 7f9b4e000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4807d010 con 0x7f9b4807c630 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.539+0000 7f9b4cc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b4807ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.539+0000 7f9b4cc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b4807ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37764/0 (socket says 172.21.15.57:37764) 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.539+0000 7f9b4cc00700 1 -- 172.21.15.57:0/1528394606 learned_addr learned my addr 172.21.15.57:0/1528394606 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.539+0000 7f9b4cc00700 1 -- 172.21.15.57:0/1528394606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b48109e10 con 0x7f9b4807c630 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.539+0000 7f9b4cc00700 1 --2- 172.21.15.57:0/1528394606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b4807ca40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0098e0 tx=0x7f9b3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd72d9e928d0334 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.540+0000 7f9b47400700 1 -- 172.21.15.57:0/1528394606 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b3c00b860 con 0x7f9b4807c630 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.540+0000 7f9b47400700 1 -- 172.21.15.57:0/1528394606 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9b3c00be50 con 0x7f9b4807c630 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.540+0000 7f9b47400700 1 -- 172.21.15.57:0/1528394606 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b3c010380 con 0x7f9b4807c630 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.540+0000 7f9b4e000700 1 -- 172.21.15.57:0/1528394606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 msgr2=0x7f9b4807ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.540+0000 7f9b4e000700 1 --2- 172.21.15.57:0/1528394606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b4807ca40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0098e0 tx=0x7f9b3c009250 comp rx=0 tx=0).stop 2024-02-28T15:49:40.415 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.541+0000 7f9b4e000700 1 -- 172.21.15.57:0/1528394606 shutdown_connections 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.541+0000 7f9b4e000700 1 --2- 172.21.15.57:0/1528394606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b4807ca40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.541+0000 7f9b4e000700 1 -- 172.21.15.57:0/1528394606 >> 172.21.15.57:0/1528394606 conn(0x7f9b48077dd0 msgr2=0x7f9b4807a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.541+0000 7f9b4e000700 1 -- 172.21.15.57:0/1528394606 shutdown_connections 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.541+0000 7f9b4e000700 1 -- 172.21.15.57:0/1528394606 wait complete. 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.542+0000 7f9b4e000700 1 Processor -- start 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.542+0000 7f9b4e000700 1 -- start start 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.542+0000 7f9b4e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b48117a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.542+0000 7f9b4e000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b48117f40 con 0x7f9b4807c630 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.542+0000 7f9b4cc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b48117a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.542+0000 7f9b4cc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b48117a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37766/0 (socket says 172.21.15.57:37766) 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.542+0000 7f9b4cc00700 1 -- 172.21.15.57:0/2473316289 learned_addr learned my addr 172.21.15.57:0/2473316289 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.543+0000 7f9b4cc00700 1 -- 172.21.15.57:0/2473316289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0094f0 con 0x7f9b4807c630 2024-02-28T15:49:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.543+0000 7f9b4cc00700 1 --2- 172.21.15.57:0/2473316289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b48117a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c000c00 tx=0x7f9b3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.543+0000 7f9b44c00700 1 -- 172.21.15.57:0/2473316289 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b3c0105b0 con 0x7f9b4807c630 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.543+0000 7f9b44c00700 1 -- 172.21.15.57:0/2473316289 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9b3c010ba0 con 0x7f9b4807c630 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.543+0000 7f9b4e000700 1 -- 172.21.15.57:0/2473316289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b48118140 con 0x7f9b4807c630 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.543+0000 7f9b44c00700 1 -- 172.21.15.57:0/2473316289 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b3c024bc0 con 0x7f9b4807c630 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.543+0000 7f9b4e000700 1 -- 172.21.15.57:0/2473316289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b48118de0 con 0x7f9b4807c630 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.544+0000 7f9b44c00700 1 -- 172.21.15.57:0/2473316289 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f9b3c010710 con 0x7f9b4807c630 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.545+0000 7f9b4e000700 1 -- 172.21.15.57:0/2473316289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b481185d0 con 0x7f9b4807c630 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.545+0000 7f9b44c00700 1 --2- 172.21.15.57:0/2473316289 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f9b300367e0 0x7f9b30038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.545+0000 7f9b44c00700 1 -- 172.21.15.57:0/2473316289 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9b3c04a670 con 0x7f9b4807c630 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.545+0000 7f9b47e00700 1 --2- 172.21.15.57:0/2473316289 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f9b300367e0 0x7f9b30038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.546+0000 7f9b47e00700 1 --2- 172.21.15.57:0/2473316289 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f9b300367e0 0x7f9b30038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009990 tx=0x7f9b34006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.550+0000 7f9b44c00700 1 -- 172.21.15.57:0/2473316289 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9b3c0239f0 con 0x7f9b4807c630 2024-02-28T15:49:40.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.768+0000 7f9b4e000700 1 -- 172.21.15.57:0/2473316289 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b4807a0a0 con 0x7f9b300367e0 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.769+0000 7f9b44c00700 1 -- 172.21.15.57:0/2473316289 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f9b4807a0a0 con 0x7f9b300367e0 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.773+0000 7f9b4e000700 1 -- 172.21.15.57:0/2473316289 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f9b300367e0 msgr2=0x7f9b30038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.773+0000 7f9b4e000700 1 --2- 172.21.15.57:0/2473316289 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f9b300367e0 0x7f9b30038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009990 tx=0x7f9b34006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.773+0000 7f9b4e000700 1 -- 172.21.15.57:0/2473316289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 msgr2=0x7f9b48117a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.773+0000 7f9b4e000700 1 --2- 172.21.15.57:0/2473316289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b48117a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c000c00 tx=0x7f9b3c009250 comp rx=0 tx=0).stop 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.773+0000 7f9b4e000700 1 -- 172.21.15.57:0/2473316289 shutdown_connections 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.773+0000 7f9b4e000700 1 --2- 172.21.15.57:0/2473316289 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f9b300367e0 0x7f9b30038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.773+0000 7f9b4e000700 1 --2- 172.21.15.57:0/2473316289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4807c630 0x7f9b48117a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.773+0000 7f9b4e000700 1 -- 172.21.15.57:0/2473316289 >> 172.21.15.57:0/2473316289 conn(0x7f9b48077dd0 msgr2=0x7f9b48079480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.773+0000 7f9b4e000700 1 -- 172.21.15.57:0/2473316289 shutdown_connections 2024-02-28T15:49:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:39.773+0000 7f9b4e000700 1 -- 172.21.15.57:0/2473316289 wait complete. 2024-02-28T15:49:40.419 INFO:teuthology.orchestra.run.smithi057.stdout:Generating ssh key... 2024-02-28T15:49:40.994 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:40 smithi057 ceph-mon[28763]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:49:42.629 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:40.999+0000 7f105ae00700 1 Processor -- start 2024-02-28T15:49:42.634 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:40.999+0000 7f105ae00700 1 -- start start 2024-02-28T15:49:42.634 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.000+0000 7f105ae00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.000+0000 7f105ae00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10541058a0 con 0x7f10540714a0 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.001+0000 7f1053e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.001+0000 7f1053e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37774/0 (socket says 172.21.15.57:37774) 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.001+0000 7f1053e00700 1 -- 172.21.15.57:0/468943307 learned_addr learned my addr 172.21.15.57:0/468943307 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.001+0000 7f1053e00700 1 -- 172.21.15.57:0/468943307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10541059e0 con 0x7f10540714a0 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.002+0000 7f1053e00700 1 --2- 172.21.15.57:0/468943307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054105360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f10440098e0 tx=0x7f1044009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fa8f75afd797db server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.002+0000 7f1053400700 1 -- 172.21.15.57:0/468943307 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f104400b860 con 0x7f10540714a0 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.002+0000 7f1053400700 1 -- 172.21.15.57:0/468943307 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f104400be50 con 0x7f10540714a0 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.002+0000 7f1053400700 1 -- 172.21.15.57:0/468943307 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1044010380 con 0x7f10540714a0 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.003+0000 7f105ae00700 1 -- 172.21.15.57:0/468943307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 msgr2=0x7f1054105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.003+0000 7f105ae00700 1 --2- 172.21.15.57:0/468943307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054105360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f10440098e0 tx=0x7f1044009250 comp rx=0 tx=0).stop 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.003+0000 7f105ae00700 1 -- 172.21.15.57:0/468943307 shutdown_connections 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.003+0000 7f105ae00700 1 --2- 172.21.15.57:0/468943307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054105360 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:42.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.003+0000 7f105ae00700 1 -- 172.21.15.57:0/468943307 >> 172.21.15.57:0/468943307 conn(0x7f10540fcdd0 msgr2=0x7f10540ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.003+0000 7f105ae00700 1 -- 172.21.15.57:0/468943307 shutdown_connections 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.003+0000 7f105ae00700 1 -- 172.21.15.57:0/468943307 wait complete. 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.004+0000 7f105ae00700 1 Processor -- start 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.004+0000 7f105ae00700 1 -- start start 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.004+0000 7f105ae00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.004+0000 7f105ae00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054113cb0 con 0x7f10540714a0 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.005+0000 7f1053e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.005+0000 7f1053e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37784/0 (socket says 172.21.15.57:37784) 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.005+0000 7f1053e00700 1 -- 172.21.15.57:0/2674781762 learned_addr learned my addr 172.21.15.57:0/2674781762 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.005+0000 7f1053e00700 1 -- 172.21.15.57:0/2674781762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10440094f0 con 0x7f10540714a0 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.005+0000 7f1053e00700 1 --2- 172.21.15.57:0/2674781762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054113770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1044006b00 tx=0x7f1044009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.006+0000 7f1050c00700 1 -- 172.21.15.57:0/2674781762 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10440107c0 con 0x7f10540714a0 2024-02-28T15:49:42.636 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.006+0000 7f1050c00700 1 -- 172.21.15.57:0/2674781762 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1044010db0 con 0x7f10540714a0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.006+0000 7f105ae00700 1 -- 172.21.15.57:0/2674781762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1054113eb0 con 0x7f10540714a0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.006+0000 7f1050c00700 1 -- 172.21.15.57:0/2674781762 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f104401acf0 con 0x7f10540714a0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.006+0000 7f105ae00700 1 -- 172.21.15.57:0/2674781762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1054114b50 con 0x7f10540714a0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.007+0000 7f1050c00700 1 -- 172.21.15.57:0/2674781762 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f1044010920 con 0x7f10540714a0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.007+0000 7f105ae00700 1 -- 172.21.15.57:0/2674781762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105405f5c0 con 0x7f10540714a0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.007+0000 7f1050c00700 1 --2- 172.21.15.57:0/2674781762 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f10380367e0 0x7f1038038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.008+0000 7f1050c00700 1 -- 172.21.15.57:0/2674781762 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f104404a5d0 con 0x7f10540714a0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.008+0000 7f104be00700 1 --2- 172.21.15.57:0/2674781762 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f10380367e0 0x7f1038038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.009+0000 7f104be00700 1 --2- 172.21.15.57:0/2674781762 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f10380367e0 0x7f1038038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f103c009990 tx=0x7f103c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.013+0000 7f1050c00700 1 -- 172.21.15.57:0/2674781762 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f104401a530 con 0x7f10540714a0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.231+0000 7f105ae00700 1 -- 172.21.15.57:0/2674781762 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1054115730 con 0x7f10380367e0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.965+0000 7f1050c00700 1 -- 172.21.15.57:0/2674781762 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1054115730 con 0x7f10380367e0 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.968+0000 7f105ae00700 1 -- 172.21.15.57:0/2674781762 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f10380367e0 msgr2=0x7f1038038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.968+0000 7f105ae00700 1 --2- 172.21.15.57:0/2674781762 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f10380367e0 0x7f1038038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f103c009990 tx=0x7f103c006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.968+0000 7f105ae00700 1 -- 172.21.15.57:0/2674781762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 msgr2=0x7f1054113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:42.638 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.968+0000 7f105ae00700 1 --2- 172.21.15.57:0/2674781762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054113770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1044006b00 tx=0x7f1044009250 comp rx=0 tx=0).stop 2024-02-28T15:49:42.638 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.968+0000 7f105ae00700 1 -- 172.21.15.57:0/2674781762 shutdown_connections 2024-02-28T15:49:42.638 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.968+0000 7f105ae00700 1 --2- 172.21.15.57:0/2674781762 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f10380367e0 0x7f1038038c90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:42.638 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.968+0000 7f105ae00700 1 --2- 172.21.15.57:0/2674781762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10540714a0 0x7f1054113770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:42.638 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.968+0000 7f105ae00700 1 -- 172.21.15.57:0/2674781762 >> 172.21.15.57:0/2674781762 conn(0x7f10540fcdd0 msgr2=0x7f10540fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:42.638 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.968+0000 7f105ae00700 1 -- 172.21.15.57:0/2674781762 shutdown_connections 2024-02-28T15:49:42.638 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:41.968+0000 7f105ae00700 1 -- 172.21.15.57:0/2674781762 wait complete. 2024-02-28T15:49:43.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:42 smithi057 ceph-mon[28763]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:49:43.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:42 smithi057 ceph-mon[28763]: Generating ssh key... 2024-02-28T15:49:43.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:42 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:43.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:42 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:44.142 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:44 smithi057 ceph-mon[28763]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:49:44.154 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSJdIWODTOtKqbTbENyUkNq/FUQRvMDJZIJdE3D93RFyyvtNOv9YPqwmvwqnTllJfJWHxGonmMNTbZrZseE5txSEA7eBgTCl1isI/9dudoCsQXQaPJTpAdutjOQK0h6sNH7/MxwSgr+DPzOkKMzj3LcscYQsgANyo99e4aURCniycR6VThhgg336fs97Xxbli2+t/6Nx3Xm+x+HLEMFLvnNQm7ep/jTedqXdNFMWmLEEz7DJ1n4RxIdF/1vrJhDMqG+RV7zUUyjf30CwyFR/Ae2L27uqToWBCkWLsrkw64ONmVm6beNehg01tK+m6n+CBMXV76S+nMcTTPnC9DdZN3FIaPGeFtKKt3E1Qcus57yxKWDU4xMPCO23xIKu1aIOmX5kTPIdmM4fkJppNYeMcEVkqIrPZShipnEePQuWjw0IYNuy+HbD3HypOcp+W3AwptsjkrqhfCh0cfIyUUL/gjy18AZly1CbfUvQpCb0vT2zijPkTt+qppC+ubF8PR+W0= ceph-bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:49:44.154 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.235+0000 7f8dcb200700 1 Processor -- start 2024-02-28T15:49:44.154 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.235+0000 7f8dcb200700 1 -- start start 2024-02-28T15:49:44.154 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.236+0000 7f8dcb200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4104d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:44.155 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.236+0000 7f8dcb200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc41052b0 con 0x7f8dc4104960 2024-02-28T15:49:44.155 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.236+0000 7f8dc3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4104d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:44.155 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.237+0000 7f8dc3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4104d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51452/0 (socket says 172.21.15.57:51452) 2024-02-28T15:49:44.155 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.237+0000 7f8dc3e00700 1 -- 172.21.15.57:0/4000095248 learned_addr learned my addr 172.21.15.57:0/4000095248 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:44.156 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.237+0000 7f8dc3e00700 1 -- 172.21.15.57:0/4000095248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc41053f0 con 0x7f8dc4104960 2024-02-28T15:49:44.156 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.238+0000 7f8dc3e00700 1 --2- 172.21.15.57:0/4000095248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4104d70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8db40098e0 tx=0x7f8db4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319f1597c009bc23 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:44.162 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.238+0000 7f8dc2a00700 1 -- 172.21.15.57:0/4000095248 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8db400b860 con 0x7f8dc4104960 2024-02-28T15:49:44.162 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.238+0000 7f8dc2a00700 1 -- 172.21.15.57:0/4000095248 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8db400be50 con 0x7f8dc4104960 2024-02-28T15:49:44.162 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.238+0000 7f8dc2a00700 1 -- 172.21.15.57:0/4000095248 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8db4010380 con 0x7f8dc4104960 2024-02-28T15:49:44.162 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.238+0000 7f8dcb200700 1 -- 172.21.15.57:0/4000095248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 msgr2=0x7f8dc4104d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:44.162 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.238+0000 7f8dcb200700 1 --2- 172.21.15.57:0/4000095248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4104d70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8db40098e0 tx=0x7f8db4009250 comp rx=0 tx=0).stop 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.239+0000 7f8dcb200700 1 -- 172.21.15.57:0/4000095248 shutdown_connections 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.239+0000 7f8dcb200700 1 --2- 172.21.15.57:0/4000095248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4104d70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.239+0000 7f8dcb200700 1 -- 172.21.15.57:0/4000095248 >> 172.21.15.57:0/4000095248 conn(0x7f8dc4078070 msgr2=0x7f8dc4078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.239+0000 7f8dcb200700 1 -- 172.21.15.57:0/4000095248 shutdown_connections 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.239+0000 7f8dcb200700 1 -- 172.21.15.57:0/4000095248 wait complete. 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.240+0000 7f8dcb200700 1 Processor -- start 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.240+0000 7f8dcb200700 1 -- start start 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.241+0000 7f8dcb200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.241+0000 7f8dcb200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc4113c50 con 0x7f8dc4104960 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.241+0000 7f8dc3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.241+0000 7f8dc3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51466/0 (socket says 172.21.15.57:51466) 2024-02-28T15:49:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.241+0000 7f8dc3e00700 1 -- 172.21.15.57:0/2444330567 learned_addr learned my addr 172.21.15.57:0/2444330567 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.241+0000 7f8dc3e00700 1 -- 172.21.15.57:0/2444330567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db40094f0 con 0x7f8dc4104960 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.242+0000 7f8dc3e00700 1 --2- 172.21.15.57:0/2444330567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4113710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8db400b440 tx=0x7f8db4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.242+0000 7f8dbbe00700 1 -- 172.21.15.57:0/2444330567 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8db40107c0 con 0x7f8dc4104960 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.242+0000 7f8dbbe00700 1 -- 172.21.15.57:0/2444330567 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8db4010db0 con 0x7f8dc4104960 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.242+0000 7f8dcb200700 1 -- 172.21.15.57:0/2444330567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc4113e50 con 0x7f8dc4104960 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.242+0000 7f8dbbe00700 1 -- 172.21.15.57:0/2444330567 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8db401ada0 con 0x7f8dc4104960 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.242+0000 7f8dcb200700 1 -- 172.21.15.57:0/2444330567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc4114af0 con 0x7f8dc4104960 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.243+0000 7f8dcb200700 1 -- 172.21.15.57:0/2444330567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc405f5c0 con 0x7f8dc4104960 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.243+0000 7f8dbbe00700 1 -- 172.21.15.57:0/2444330567 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f8db4010920 con 0x7f8dc4104960 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.244+0000 7f8dbbe00700 1 --2- 172.21.15.57:0/2444330567 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8da80367e0 0x7f8da8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.244+0000 7f8dbbe00700 1 -- 172.21.15.57:0/2444330567 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8db404ad60 con 0x7f8dc4104960 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.244+0000 7f8dc3400700 1 --2- 172.21.15.57:0/2444330567 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8da80367e0 0x7f8da8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:44.164 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.245+0000 7f8dc3400700 1 --2- 172.21.15.57:0/2444330567 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8da80367e0 0x7f8da8038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009990 tx=0x7f8db0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.249+0000 7f8dbbe00700 1 -- 172.21.15.57:0/2444330567 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8db4018940 con 0x7f8dc4104960 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.462+0000 7f8dcb200700 1 -- 172.21.15.57:0/2444330567 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8dc4102f10 con 0x7f8da80367e0 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.464+0000 7f8dbbe00700 1 -- 172.21.15.57:0/2444330567 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f8dc4102f10 con 0x7f8da80367e0 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.466+0000 7f8dcb200700 1 -- 172.21.15.57:0/2444330567 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8da80367e0 msgr2=0x7f8da8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.466+0000 7f8dcb200700 1 --2- 172.21.15.57:0/2444330567 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8da80367e0 0x7f8da8038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009990 tx=0x7f8db0006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.466+0000 7f8dcb200700 1 -- 172.21.15.57:0/2444330567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 msgr2=0x7f8dc4113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.466+0000 7f8dcb200700 1 --2- 172.21.15.57:0/2444330567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4113710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8db400b440 tx=0x7f8db4009250 comp rx=0 tx=0).stop 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.467+0000 7f8dcb200700 1 -- 172.21.15.57:0/2444330567 shutdown_connections 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.467+0000 7f8dcb200700 1 --2- 172.21.15.57:0/2444330567 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8da80367e0 0x7f8da8038c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.467+0000 7f8dcb200700 1 --2- 172.21.15.57:0/2444330567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc4104960 0x7f8dc4113710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.467+0000 7f8dcb200700 1 -- 172.21.15.57:0/2444330567 >> 172.21.15.57:0/2444330567 conn(0x7f8dc4078070 msgr2=0x7f8dc4102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.467+0000 7f8dcb200700 1 -- 172.21.15.57:0/2444330567 shutdown_connections 2024-02-28T15:49:44.165 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:43.467+0000 7f8dcb200700 1 -- 172.21.15.57:0/2444330567 wait complete. 2024-02-28T15:49:44.166 INFO:teuthology.orchestra.run.smithi057.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-28T15:49:44.166 INFO:teuthology.orchestra.run.smithi057.stdout:Adding key to root@localhost authorized_keys... 2024-02-28T15:49:44.166 INFO:teuthology.orchestra.run.smithi057.stdout:Adding host smithi057... 2024-02-28T15:49:46.313 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:46 smithi057 ceph-mon[28763]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi057", "addr": "172.21.15.57", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:49:47.348 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:47 smithi057 ceph-mon[28763]: Deploying cephadm binary to smithi057 2024-02-28T15:49:50.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Added host 'smithi057' with addr '172.21.15.57' 2024-02-28T15:49:50.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.776+0000 7fd464400700 1 Processor -- start 2024-02-28T15:49:50.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.776+0000 7fd464400700 1 -- start start 2024-02-28T15:49:50.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.777+0000 7fd464400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:50.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.777+0000 7fd464400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c1030c0 con 0x7fd45c102770 2024-02-28T15:49:50.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.777+0000 7fd461a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:50.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.777+0000 7fd461a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51472/0 (socket says 172.21.15.57:51472) 2024-02-28T15:49:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.777+0000 7fd461a00700 1 -- 172.21.15.57:0/1918462079 learned_addr learned my addr 172.21.15.57:0/1918462079 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.778+0000 7fd461a00700 1 -- 172.21.15.57:0/1918462079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c103200 con 0x7fd45c102770 2024-02-28T15:49:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.778+0000 7fd461a00700 1 --2- 172.21.15.57:0/1918462079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c102b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098e0 tx=0x7fd450009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0dad39e998f1082 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.779+0000 7fd45be00700 1 -- 172.21.15.57:0/1918462079 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd45000b860 con 0x7fd45c102770 2024-02-28T15:49:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.779+0000 7fd45be00700 1 -- 172.21.15.57:0/1918462079 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd45000be50 con 0x7fd45c102770 2024-02-28T15:49:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.779+0000 7fd45be00700 1 -- 172.21.15.57:0/1918462079 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd450010380 con 0x7fd45c102770 2024-02-28T15:49:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.779+0000 7fd464400700 1 -- 172.21.15.57:0/1918462079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 msgr2=0x7fd45c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.779+0000 7fd464400700 1 --2- 172.21.15.57:0/1918462079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c102b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098e0 tx=0x7fd450009250 comp rx=0 tx=0).stop 2024-02-28T15:49:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.780+0000 7fd464400700 1 -- 172.21.15.57:0/1918462079 shutdown_connections 2024-02-28T15:49:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.780+0000 7fd464400700 1 --2- 172.21.15.57:0/1918462079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c102b80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.780+0000 7fd464400700 1 -- 172.21.15.57:0/1918462079 >> 172.21.15.57:0/1918462079 conn(0x7fd45c0fded0 msgr2=0x7fd45c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.780+0000 7fd464400700 1 -- 172.21.15.57:0/1918462079 shutdown_connections 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.780+0000 7fd464400700 1 -- 172.21.15.57:0/1918462079 wait complete. 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.781+0000 7fd464400700 1 Processor -- start 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.781+0000 7fd464400700 1 -- start start 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.781+0000 7fd464400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.781+0000 7fd464400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c113c50 con 0x7fd45c102770 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.781+0000 7fd461a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.781+0000 7fd461a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51474/0 (socket says 172.21.15.57:51474) 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.781+0000 7fd461a00700 1 -- 172.21.15.57:0/1740616346 learned_addr learned my addr 172.21.15.57:0/1740616346 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:50.073 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.782+0000 7fd461a00700 1 -- 172.21.15.57:0/1740616346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500094f0 con 0x7fd45c102770 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.782+0000 7fd461a00700 1 --2- 172.21.15.57:0/1740616346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c113710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd45000b440 tx=0x7fd450009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.782+0000 7fd459600700 1 -- 172.21.15.57:0/1740616346 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4500107c0 con 0x7fd45c102770 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.782+0000 7fd459600700 1 -- 172.21.15.57:0/1740616346 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd450010db0 con 0x7fd45c102770 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.782+0000 7fd459600700 1 -- 172.21.15.57:0/1740616346 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd45001ada0 con 0x7fd45c102770 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.782+0000 7fd464400700 1 -- 172.21.15.57:0/1740616346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45c113e50 con 0x7fd45c102770 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.783+0000 7fd464400700 1 -- 172.21.15.57:0/1740616346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45c114af0 con 0x7fd45c102770 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.784+0000 7fd459600700 1 -- 172.21.15.57:0/1740616346 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fd450010920 con 0x7fd45c102770 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.784+0000 7fd464400700 1 -- 172.21.15.57:0/1740616346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45c05f5c0 con 0x7fd45c102770 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.784+0000 7fd459600700 1 --2- 172.21.15.57:0/1740616346 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd4440367e0 0x7fd444038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.784+0000 7fd459600700 1 -- 172.21.15.57:0/1740616346 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd45004adb0 con 0x7fd45c102770 2024-02-28T15:49:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.784+0000 7fd461000700 1 --2- 172.21.15.57:0/1740616346 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd4440367e0 0x7fd444038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:50.075 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.785+0000 7fd461000700 1 --2- 172.21.15.57:0/1740616346 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd4440367e0 0x7fd444038c90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd448009990 tx=0x7fd448006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:50.075 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:44.790+0000 7fd459600700 1 -- 172.21.15.57:0/1740616346 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd450018940 con 0x7fd45c102770 2024-02-28T15:49:50.075 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:45.006+0000 7fd464400700 1 -- 172.21.15.57:0/1740616346 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi057", "addr": "172.21.15.57", "target": ["mon-mgr", ""]}) v1 -- 0x7fd45c0ff320 con 0x7fd4440367e0 2024-02-28T15:49:50.075 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.328+0000 7fd459600700 1 -- 172.21.15.57:0/1740616346 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fd45c0ff320 con 0x7fd4440367e0 2024-02-28T15:49:50.075 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.332+0000 7fd464400700 1 -- 172.21.15.57:0/1740616346 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd4440367e0 msgr2=0x7fd444038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:50.075 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.332+0000 7fd464400700 1 --2- 172.21.15.57:0/1740616346 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd4440367e0 0x7fd444038c90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd448009990 tx=0x7fd448006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:50.075 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.332+0000 7fd464400700 1 -- 172.21.15.57:0/1740616346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 msgr2=0x7fd45c113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:50.075 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.332+0000 7fd464400700 1 --2- 172.21.15.57:0/1740616346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c113710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd45000b440 tx=0x7fd450009250 comp rx=0 tx=0).stop 2024-02-28T15:49:50.075 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.332+0000 7fd464400700 1 -- 172.21.15.57:0/1740616346 shutdown_connections 2024-02-28T15:49:50.076 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.332+0000 7fd464400700 1 --2- 172.21.15.57:0/1740616346 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd4440367e0 0x7fd444038c90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:50.076 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.332+0000 7fd464400700 1 --2- 172.21.15.57:0/1740616346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd45c102770 0x7fd45c113710 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:50.076 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.332+0000 7fd464400700 1 -- 172.21.15.57:0/1740616346 >> 172.21.15.57:0/1740616346 conn(0x7fd45c0fded0 msgr2=0x7fd45c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:50.076 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.332+0000 7fd464400700 1 -- 172.21.15.57:0/1740616346 shutdown_connections 2024-02-28T15:49:50.076 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:49.333+0000 7fd464400700 1 -- 172.21.15.57:0/1740616346 wait complete. 2024-02-28T15:49:50.076 INFO:teuthology.orchestra.run.smithi057.stdout:Deploying mon service with default placement... 2024-02-28T15:49:50.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:50 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:50.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:50 smithi057 ceph-mon[28763]: Added host smithi057 2024-02-28T15:49:50.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:50 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:49:52.409 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:52 smithi057 ceph-mon[28763]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:49:52.409 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:52 smithi057 ceph-mon[28763]: Saving service mon spec with placement count:5 2024-02-28T15:49:52.409 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:52 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:52.425 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-28T15:49:52.425 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.962+0000 7fd545c00700 1 Processor -- start 2024-02-28T15:49:52.425 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.962+0000 7fd545c00700 1 -- start start 2024-02-28T15:49:52.425 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.962+0000 7fd545c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd5401053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:52.425 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.962+0000 7fd545c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd540105900 con 0x7fd540071440 2024-02-28T15:49:52.425 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.963+0000 7fd53ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd5401053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:52.425 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.963+0000 7fd53ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd5401053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51488/0 (socket says 172.21.15.57:51488) 2024-02-28T15:49:52.425 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.963+0000 7fd53ea00700 1 -- 172.21.15.57:0/3094835350 learned_addr learned my addr 172.21.15.57:0/3094835350 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:52.425 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.963+0000 7fd53ea00700 1 -- 172.21.15.57:0/3094835350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540105a40 con 0x7fd540071440 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.964+0000 7fd53ea00700 1 --2- 172.21.15.57:0/3094835350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd5401053c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd5300098e0 tx=0x7fd530009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc1a081fb1e4d12 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.964+0000 7fd53d600700 1 -- 172.21.15.57:0/3094835350 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd53000b860 con 0x7fd540071440 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.964+0000 7fd53d600700 1 -- 172.21.15.57:0/3094835350 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd53000be50 con 0x7fd540071440 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.964+0000 7fd53d600700 1 -- 172.21.15.57:0/3094835350 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd530010380 con 0x7fd540071440 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.965+0000 7fd545c00700 1 -- 172.21.15.57:0/3094835350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 msgr2=0x7fd5401053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.965+0000 7fd545c00700 1 --2- 172.21.15.57:0/3094835350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd5401053c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd5300098e0 tx=0x7fd530009250 comp rx=0 tx=0).stop 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.965+0000 7fd545c00700 1 -- 172.21.15.57:0/3094835350 shutdown_connections 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.965+0000 7fd545c00700 1 --2- 172.21.15.57:0/3094835350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd5401053c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.965+0000 7fd545c00700 1 -- 172.21.15.57:0/3094835350 >> 172.21.15.57:0/3094835350 conn(0x7fd5400fcdd0 msgr2=0x7fd5400ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.965+0000 7fd545c00700 1 -- 172.21.15.57:0/3094835350 shutdown_connections 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.965+0000 7fd545c00700 1 -- 172.21.15.57:0/3094835350 wait complete. 2024-02-28T15:49:52.426 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.966+0000 7fd545c00700 1 Processor -- start 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.966+0000 7fd545c00700 1 -- start start 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.967+0000 7fd545c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd540102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.967+0000 7fd545c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5401012c0 con 0x7fd540071440 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.967+0000 7fd53ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd540102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.967+0000 7fd53ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd540102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51502/0 (socket says 172.21.15.57:51502) 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.967+0000 7fd53ea00700 1 -- 172.21.15.57:0/3875315093 learned_addr learned my addr 172.21.15.57:0/3875315093 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.967+0000 7fd53ea00700 1 -- 172.21.15.57:0/3875315093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5300094f0 con 0x7fd540071440 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.968+0000 7fd53ea00700 1 --2- 172.21.15.57:0/3875315093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd540102e40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd530006b00 tx=0x7fd530009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.968+0000 7fd536a00700 1 -- 172.21.15.57:0/3875315093 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5300107c0 con 0x7fd540071440 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.968+0000 7fd536a00700 1 -- 172.21.15.57:0/3875315093 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd530010db0 con 0x7fd540071440 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.968+0000 7fd536a00700 1 -- 172.21.15.57:0/3875315093 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd53001acf0 con 0x7fd540071440 2024-02-28T15:49:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.968+0000 7fd545c00700 1 -- 172.21.15.57:0/3875315093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5401014c0 con 0x7fd540071440 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.968+0000 7fd545c00700 1 -- 172.21.15.57:0/3875315093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd540101950 con 0x7fd540071440 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.969+0000 7fd536a00700 1 -- 172.21.15.57:0/3875315093 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fd530010920 con 0x7fd540071440 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.969+0000 7fd545c00700 1 -- 172.21.15.57:0/3875315093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54004bed0 con 0x7fd540071440 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.970+0000 7fd536a00700 1 --2- 172.21.15.57:0/3875315093 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd524036790 0x7fd524038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.970+0000 7fd536a00700 1 -- 172.21.15.57:0/3875315093 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd53004a6b0 con 0x7fd540071440 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.970+0000 7fd53e000700 1 --2- 172.21.15.57:0/3875315093 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd524036790 0x7fd524038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.971+0000 7fd53e000700 1 --2- 172.21.15.57:0/3875315093 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd524036790 0x7fd524038c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009990 tx=0x7fd52c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:50.975+0000 7fd536a00700 1 -- 172.21.15.57:0/3875315093 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd53001a530 con 0x7fd540071440 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.211+0000 7fd545c00700 1 -- 172.21.15.57:0/3875315093 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fd540102190 con 0x7fd524036790 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.219+0000 7fd536a00700 1 -- 172.21.15.57:0/3875315093 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd540102190 con 0x7fd524036790 2024-02-28T15:49:52.428 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.222+0000 7fd545c00700 1 -- 172.21.15.57:0/3875315093 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd524036790 msgr2=0x7fd524038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:52.429 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.222+0000 7fd545c00700 1 --2- 172.21.15.57:0/3875315093 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd524036790 0x7fd524038c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009990 tx=0x7fd52c006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:52.429 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.222+0000 7fd545c00700 1 -- 172.21.15.57:0/3875315093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 msgr2=0x7fd540102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:52.429 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.222+0000 7fd545c00700 1 --2- 172.21.15.57:0/3875315093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd540102e40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd530006b00 tx=0x7fd530009250 comp rx=0 tx=0).stop 2024-02-28T15:49:52.429 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.222+0000 7fd545c00700 1 -- 172.21.15.57:0/3875315093 shutdown_connections 2024-02-28T15:49:52.429 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.222+0000 7fd545c00700 1 --2- 172.21.15.57:0/3875315093 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fd524036790 0x7fd524038c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:52.429 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.222+0000 7fd545c00700 1 --2- 172.21.15.57:0/3875315093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd540071440 0x7fd540102e40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:52.429 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.222+0000 7fd545c00700 1 -- 172.21.15.57:0/3875315093 >> 172.21.15.57:0/3875315093 conn(0x7fd5400fcdd0 msgr2=0x7fd5400fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:52.429 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.223+0000 7fd545c00700 1 -- 172.21.15.57:0/3875315093 shutdown_connections 2024-02-28T15:49:52.429 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:51.223+0000 7fd545c00700 1 -- 172.21.15.57:0/3875315093 wait complete. 2024-02-28T15:49:52.429 INFO:teuthology.orchestra.run.smithi057.stdout:Deploying mgr service with default placement... 2024-02-28T15:49:53.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:53 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:53 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:53 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:54.302 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-28T15:49:54.302 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.390+0000 7fab99200700 1 Processor -- start 2024-02-28T15:49:54.302 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.390+0000 7fab99200700 1 -- start start 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.390+0000 7fab99200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94104d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.390+0000 7fab99200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab941052d0 con 0x7fab94104980 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.391+0000 7fab91e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94104d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.391+0000 7fab91e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94104d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59924/0 (socket says 172.21.15.57:59924) 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.391+0000 7fab91e00700 1 -- 172.21.15.57:0/2022015528 learned_addr learned my addr 172.21.15.57:0/2022015528 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.391+0000 7fab91e00700 1 -- 172.21.15.57:0/2022015528 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94105410 con 0x7fab94104980 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.391+0000 7fab91e00700 1 --2- 172.21.15.57:0/2022015528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94104d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab840098e0 tx=0x7fab84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ef55cf50195b3a server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.392+0000 7fab90a00700 1 -- 172.21.15.57:0/2022015528 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab8400b860 con 0x7fab94104980 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.392+0000 7fab90a00700 1 -- 172.21.15.57:0/2022015528 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab8400be90 con 0x7fab94104980 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.392+0000 7fab90a00700 1 -- 172.21.15.57:0/2022015528 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab840103c0 con 0x7fab94104980 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.392+0000 7fab99200700 1 -- 172.21.15.57:0/2022015528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 msgr2=0x7fab94104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.392+0000 7fab99200700 1 --2- 172.21.15.57:0/2022015528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94104d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab840098e0 tx=0x7fab84009250 comp rx=0 tx=0).stop 2024-02-28T15:49:54.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.393+0000 7fab99200700 1 -- 172.21.15.57:0/2022015528 shutdown_connections 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.393+0000 7fab99200700 1 --2- 172.21.15.57:0/2022015528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94104d90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.393+0000 7fab99200700 1 -- 172.21.15.57:0/2022015528 >> 172.21.15.57:0/2022015528 conn(0x7fab94078030 msgr2=0x7fab94078450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.393+0000 7fab99200700 1 -- 172.21.15.57:0/2022015528 shutdown_connections 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.393+0000 7fab99200700 1 -- 172.21.15.57:0/2022015528 wait complete. 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.394+0000 7fab99200700 1 Processor -- start 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.394+0000 7fab99200700 1 -- start start 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.394+0000 7fab99200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.394+0000 7fab99200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab94113fa0 con 0x7fab94104980 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.394+0000 7fab91e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.394+0000 7fab91e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59928/0 (socket says 172.21.15.57:59928) 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.394+0000 7fab91e00700 1 -- 172.21.15.57:0/2542020202 learned_addr learned my addr 172.21.15.57:0/2542020202 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.395+0000 7fab91e00700 1 -- 172.21.15.57:0/2542020202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab840094f0 con 0x7fab94104980 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.395+0000 7fab91e00700 1 --2- 172.21.15.57:0/2542020202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94113a60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fab84006b00 tx=0x7fab84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:54.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.395+0000 7fab8a000700 1 -- 172.21.15.57:0/2542020202 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab840109a0 con 0x7fab94104980 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.396+0000 7fab8a000700 1 -- 172.21.15.57:0/2542020202 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab8401a430 con 0x7fab94104980 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.396+0000 7fab99200700 1 -- 172.21.15.57:0/2542020202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab941141a0 con 0x7fab94104980 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.396+0000 7fab8a000700 1 -- 172.21.15.57:0/2542020202 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab840245b0 con 0x7fab94104980 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.396+0000 7fab99200700 1 -- 172.21.15.57:0/2542020202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab94114e40 con 0x7fab94104980 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.397+0000 7fab8a000700 1 -- 172.21.15.57:0/2542020202 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fab8401aaa0 con 0x7fab94104980 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.397+0000 7fab99200700 1 -- 172.21.15.57:0/2542020202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9405f5c0 con 0x7fab94104980 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.397+0000 7fab8a000700 1 --2- 172.21.15.57:0/2542020202 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fab780367e0 0x7fab78038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.398+0000 7fab8a000700 1 -- 172.21.15.57:0/2542020202 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fab8404a650 con 0x7fab94104980 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.398+0000 7fab91400700 1 --2- 172.21.15.57:0/2542020202 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fab780367e0 0x7fab78038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.399+0000 7fab91400700 1 --2- 172.21.15.57:0/2542020202 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fab780367e0 0x7fab78038c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fab80009990 tx=0x7fab80006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.403+0000 7fab8a000700 1 -- 172.21.15.57:0/2542020202 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fab8402c340 con 0x7fab94104980 2024-02-28T15:49:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.635+0000 7fab99200700 1 -- 172.21.15.57:0/2542020202 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fab941068d0 con 0x7fab780367e0 2024-02-28T15:49:54.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.646+0000 7fab8a000700 1 -- 172.21.15.57:0/2542020202 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fab941068d0 con 0x7fab780367e0 2024-02-28T15:49:54.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.649+0000 7fab99200700 1 -- 172.21.15.57:0/2542020202 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fab780367e0 msgr2=0x7fab78038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:54.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.649+0000 7fab99200700 1 --2- 172.21.15.57:0/2542020202 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fab780367e0 0x7fab78038c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fab80009990 tx=0x7fab80006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:54.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.649+0000 7fab99200700 1 -- 172.21.15.57:0/2542020202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 msgr2=0x7fab94113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:54.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.649+0000 7fab99200700 1 --2- 172.21.15.57:0/2542020202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94113a60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fab84006b00 tx=0x7fab84009250 comp rx=0 tx=0).stop 2024-02-28T15:49:54.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.649+0000 7fab99200700 1 -- 172.21.15.57:0/2542020202 shutdown_connections 2024-02-28T15:49:54.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.649+0000 7fab99200700 1 --2- 172.21.15.57:0/2542020202 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fab780367e0 0x7fab78038c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:54.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.649+0000 7fab99200700 1 --2- 172.21.15.57:0/2542020202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab94104980 0x7fab94113a60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:54.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.649+0000 7fab99200700 1 -- 172.21.15.57:0/2542020202 >> 172.21.15.57:0/2542020202 conn(0x7fab94078030 msgr2=0x7fab94102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:54.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.649+0000 7fab99200700 1 -- 172.21.15.57:0/2542020202 shutdown_connections 2024-02-28T15:49:54.307 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:53.649+0000 7fab99200700 1 -- 172.21.15.57:0/2542020202 wait complete. 2024-02-28T15:49:54.307 INFO:teuthology.orchestra.run.smithi057.stdout:Deploying crash service with default placement... 2024-02-28T15:49:55.060 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:54 smithi057 ceph-mon[28763]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:49:55.060 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:54 smithi057 ceph-mon[28763]: Saving service mgr spec with placement count:2 2024-02-28T15:49:56.161 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-28T15:49:56.161 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.836+0000 7fc72a200700 1 Processor -- start 2024-02-28T15:49:56.162 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.837+0000 7fc72a200700 1 -- start start 2024-02-28T15:49:56.162 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.837+0000 7fc72a200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc7240760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:56.162 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.837+0000 7fc72a200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc724077fc0 con 0x7fc724077bb0 2024-02-28T15:49:56.162 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.837+0000 7fc723400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc7240760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.837+0000 7fc723400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc7240760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59944/0 (socket says 172.21.15.57:59944) 2024-02-28T15:49:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.837+0000 7fc723400700 1 -- 172.21.15.57:0/2157790418 learned_addr learned my addr 172.21.15.57:0/2157790418 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.838+0000 7fc723400700 1 -- 172.21.15.57:0/2157790418 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724076600 con 0x7fc724077bb0 2024-02-28T15:49:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.838+0000 7fc723400700 1 --2- 172.21.15.57:0/2157790418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc7240760c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc7140098e0 tx=0x7fc714009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1672ff48d5e07ec8 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.838+0000 7fc722000700 1 -- 172.21.15.57:0/2157790418 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc71400b860 con 0x7fc724077bb0 2024-02-28T15:49:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.839+0000 7fc722000700 1 -- 172.21.15.57:0/2157790418 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc71400be90 con 0x7fc724077bb0 2024-02-28T15:49:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.839+0000 7fc722000700 1 -- 172.21.15.57:0/2157790418 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7140103c0 con 0x7fc724077bb0 2024-02-28T15:49:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.839+0000 7fc72a200700 1 -- 172.21.15.57:0/2157790418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 msgr2=0x7fc7240760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.839+0000 7fc72a200700 1 --2- 172.21.15.57:0/2157790418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc7240760c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc7140098e0 tx=0x7fc714009250 comp rx=0 tx=0).stop 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.839+0000 7fc72a200700 1 -- 172.21.15.57:0/2157790418 shutdown_connections 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.839+0000 7fc72a200700 1 --2- 172.21.15.57:0/2157790418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc7240760c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.839+0000 7fc72a200700 1 -- 172.21.15.57:0/2157790418 >> 172.21.15.57:0/2157790418 conn(0x7fc7240fded0 msgr2=0x7fc724100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.840+0000 7fc72a200700 1 -- 172.21.15.57:0/2157790418 shutdown_connections 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.840+0000 7fc72a200700 1 -- 172.21.15.57:0/2157790418 wait complete. 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.841+0000 7fc72a200700 1 Processor -- start 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.841+0000 7fc72a200700 1 -- start start 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.841+0000 7fc72a200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc724113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.841+0000 7fc72a200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc724113fc0 con 0x7fc724077bb0 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.842+0000 7fc723400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc724113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.842+0000 7fc723400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc724113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59954/0 (socket says 172.21.15.57:59954) 2024-02-28T15:49:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.842+0000 7fc723400700 1 -- 172.21.15.57:0/1049289485 learned_addr learned my addr 172.21.15.57:0/1049289485 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.842+0000 7fc723400700 1 -- 172.21.15.57:0/1049289485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7140094f0 con 0x7fc724077bb0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.843+0000 7fc723400700 1 --2- 172.21.15.57:0/1049289485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc724113a80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc7140090b0 tx=0x7fc714009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.843+0000 7fc71b400700 1 -- 172.21.15.57:0/1049289485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7140118f0 con 0x7fc724077bb0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.843+0000 7fc71b400700 1 -- 172.21.15.57:0/1049289485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc714010d10 con 0x7fc724077bb0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.843+0000 7fc72a200700 1 -- 172.21.15.57:0/1049289485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7241141c0 con 0x7fc724077bb0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.843+0000 7fc71b400700 1 -- 172.21.15.57:0/1049289485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc714024e70 con 0x7fc724077bb0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.843+0000 7fc72a200700 1 -- 172.21.15.57:0/1049289485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc724114e60 con 0x7fc724077bb0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.844+0000 7fc71b400700 1 -- 172.21.15.57:0/1049289485 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fc71401a550 con 0x7fc724077bb0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.844+0000 7fc72a200700 1 -- 172.21.15.57:0/1049289485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72405f5c0 con 0x7fc724077bb0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.845+0000 7fc71b400700 1 --2- 172.21.15.57:0/1049289485 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fc708036790 0x7fc708038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.845+0000 7fc71b400700 1 -- 172.21.15.57:0/1049289485 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc71404b6d0 con 0x7fc724077bb0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.845+0000 7fc722a00700 1 --2- 172.21.15.57:0/1049289485 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fc708036790 0x7fc708038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:56.169 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.846+0000 7fc722a00700 1 --2- 172.21.15.57:0/1049289485 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fc708036790 0x7fc708038c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc710009990 tx=0x7fc710006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:54.855+0000 7fc71b400700 1 -- 172.21.15.57:0/1049289485 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc71401a800 con 0x7fc724077bb0 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.085+0000 7fc72a200700 1 -- 172.21.15.57:0/1049289485 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fc724108bc0 con 0x7fc708036790 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.094+0000 7fc71b400700 1 -- 172.21.15.57:0/1049289485 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fc724108bc0 con 0x7fc708036790 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.097+0000 7fc72a200700 1 -- 172.21.15.57:0/1049289485 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fc708036790 msgr2=0x7fc708038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.097+0000 7fc72a200700 1 --2- 172.21.15.57:0/1049289485 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fc708036790 0x7fc708038c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc710009990 tx=0x7fc710006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.097+0000 7fc72a200700 1 -- 172.21.15.57:0/1049289485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 msgr2=0x7fc724113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.097+0000 7fc72a200700 1 --2- 172.21.15.57:0/1049289485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc724113a80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc7140090b0 tx=0x7fc714009250 comp rx=0 tx=0).stop 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.097+0000 7fc72a200700 1 -- 172.21.15.57:0/1049289485 shutdown_connections 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.097+0000 7fc72a200700 1 --2- 172.21.15.57:0/1049289485 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7fc708036790 0x7fc708038c40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.097+0000 7fc72a200700 1 --2- 172.21.15.57:0/1049289485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc724077bb0 0x7fc724113a80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:56.170 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.097+0000 7fc72a200700 1 -- 172.21.15.57:0/1049289485 >> 172.21.15.57:0/1049289485 conn(0x7fc7240fded0 msgr2=0x7fc724100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:56.171 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.098+0000 7fc72a200700 1 -- 172.21.15.57:0/1049289485 shutdown_connections 2024-02-28T15:49:56.171 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:55.098+0000 7fc72a200700 1 -- 172.21.15.57:0/1049289485 wait complete. 2024-02-28T15:49:56.171 INFO:teuthology.orchestra.run.smithi057.stdout:Deploying prometheus service with default placement... 2024-02-28T15:49:56.368 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:56 smithi057 ceph-mon[28763]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:49:56.369 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:56 smithi057 ceph-mon[28763]: Saving service crash spec with placement * 2024-02-28T15:49:56.369 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:56 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:56.369 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:56 smithi057 ceph-mon[28763]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:49:56.369 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:56 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:57.649 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-28T15:49:57.649 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.758+0000 7f499e600700 1 Processor -- start 2024-02-28T15:49:57.649 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.758+0000 7f499e600700 1 -- start start 2024-02-28T15:49:57.649 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.758+0000 7f499e600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f4998107780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:57.649 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.759+0000 7f499e600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4998103170 con 0x7f4998071480 2024-02-28T15:49:57.649 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.759+0000 7f4997400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f4998107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:57.649 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.759+0000 7f4997400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f4998107780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59962/0 (socket says 172.21.15.57:59962) 2024-02-28T15:49:57.649 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.759+0000 7f4997400700 1 -- 172.21.15.57:0/3922539893 learned_addr learned my addr 172.21.15.57:0/3922539893 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.760+0000 7f4997400700 1 -- 172.21.15.57:0/3922539893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998107cc0 con 0x7f4998071480 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.760+0000 7f4997400700 1 --2- 172.21.15.57:0/3922539893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f4998107780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f49880098e0 tx=0x7f4988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf455c35c859c67 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.760+0000 7f4996000700 1 -- 172.21.15.57:0/3922539893 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f498800b860 con 0x7f4998071480 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.760+0000 7f4996000700 1 -- 172.21.15.57:0/3922539893 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f498800be90 con 0x7f4998071480 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.760+0000 7f4996000700 1 -- 172.21.15.57:0/3922539893 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49880103c0 con 0x7f4998071480 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.761+0000 7f499e600700 1 -- 172.21.15.57:0/3922539893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 msgr2=0x7f4998107780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.761+0000 7f499e600700 1 --2- 172.21.15.57:0/3922539893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f4998107780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f49880098e0 tx=0x7f4988009250 comp rx=0 tx=0).stop 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.761+0000 7f499e600700 1 -- 172.21.15.57:0/3922539893 shutdown_connections 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.761+0000 7f499e600700 1 --2- 172.21.15.57:0/3922539893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f4998107780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.761+0000 7f499e600700 1 -- 172.21.15.57:0/3922539893 >> 172.21.15.57:0/3922539893 conn(0x7f49980fcdd0 msgr2=0x7f49980ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:57.650 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.761+0000 7f499e600700 1 -- 172.21.15.57:0/3922539893 shutdown_connections 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.761+0000 7f499e600700 1 -- 172.21.15.57:0/3922539893 wait complete. 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.762+0000 7f499e600700 1 Processor -- start 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.762+0000 7f499e600700 1 -- start start 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.763+0000 7f499e600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f49981137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.763+0000 7f499e600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4998113cf0 con 0x7f4998071480 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.763+0000 7f4997400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f49981137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.763+0000 7f4997400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f49981137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59972/0 (socket says 172.21.15.57:59972) 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.763+0000 7f4997400700 1 -- 172.21.15.57:0/4238906222 learned_addr learned my addr 172.21.15.57:0/4238906222 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.763+0000 7f4997400700 1 -- 172.21.15.57:0/4238906222 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49880094f0 con 0x7f4998071480 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.764+0000 7f4997400700 1 --2- 172.21.15.57:0/4238906222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f49981137b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4988006d40 tx=0x7f4988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.764+0000 7f498f400700 1 -- 172.21.15.57:0/4238906222 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4988010840 con 0x7f4998071480 2024-02-28T15:49:57.651 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.764+0000 7f499e600700 1 -- 172.21.15.57:0/4238906222 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4998113ef0 con 0x7f4998071480 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.764+0000 7f498f400700 1 -- 172.21.15.57:0/4238906222 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4988010e70 con 0x7f4998071480 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.764+0000 7f498f400700 1 -- 172.21.15.57:0/4238906222 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4988024ea0 con 0x7f4998071480 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.764+0000 7f499e600700 1 -- 172.21.15.57:0/4238906222 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4998114b90 con 0x7f4998071480 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.766+0000 7f498f400700 1 -- 172.21.15.57:0/4238906222 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f4988024780 con 0x7f4998071480 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.766+0000 7f499e600700 1 -- 172.21.15.57:0/4238906222 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499805f5c0 con 0x7f4998071480 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.766+0000 7f498f400700 1 --2- 172.21.15.57:0/4238906222 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f497c036790 0x7f497c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.766+0000 7f498f400700 1 -- 172.21.15.57:0/4238906222 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f498804a740 con 0x7f4998071480 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.767+0000 7f4996a00700 1 --2- 172.21.15.57:0/4238906222 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f497c036790 0x7f497c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.767+0000 7f4996a00700 1 --2- 172.21.15.57:0/4238906222 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f497c036790 0x7f497c038c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4984009990 tx=0x7f4984006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.774+0000 7f498f400700 1 -- 172.21.15.57:0/4238906222 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f498802c930 con 0x7f4998071480 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:56.998+0000 7f499e600700 1 -- 172.21.15.57:0/4238906222 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f49980ff0a0 con 0x7f497c036790 2024-02-28T15:49:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.005+0000 7f498f400700 1 -- 172.21.15.57:0/4238906222 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f49980ff0a0 con 0x7f497c036790 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.007+0000 7f499e600700 1 -- 172.21.15.57:0/4238906222 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f497c036790 msgr2=0x7f497c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.007+0000 7f499e600700 1 --2- 172.21.15.57:0/4238906222 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f497c036790 0x7f497c038c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4984009990 tx=0x7f4984006e40 comp rx=0 tx=0).stop 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.007+0000 7f499e600700 1 -- 172.21.15.57:0/4238906222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 msgr2=0x7f49981137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.007+0000 7f499e600700 1 --2- 172.21.15.57:0/4238906222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f49981137b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4988006d40 tx=0x7f4988009250 comp rx=0 tx=0).stop 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.008+0000 7f499e600700 1 -- 172.21.15.57:0/4238906222 shutdown_connections 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.008+0000 7f499e600700 1 --2- 172.21.15.57:0/4238906222 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f497c036790 0x7f497c038c40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.008+0000 7f499e600700 1 --2- 172.21.15.57:0/4238906222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4998071480 0x7f49981137b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.008+0000 7f499e600700 1 -- 172.21.15.57:0/4238906222 >> 172.21.15.57:0/4238906222 conn(0x7f49980fcdd0 msgr2=0x7f49980fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.008+0000 7f499e600700 1 -- 172.21.15.57:0/4238906222 shutdown_connections 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:57.008+0000 7f499e600700 1 -- 172.21.15.57:0/4238906222 wait complete. 2024-02-28T15:49:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:Deploying grafana service with default placement... 2024-02-28T15:49:58.296 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:58 smithi057 ceph-mon[28763]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:49:58.296 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:58 smithi057 ceph-mon[28763]: Saving service prometheus spec with placement count:1 2024-02-28T15:49:58.296 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:58 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:58.296 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:58 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:49:59.350 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:59 smithi057 ceph-mon[28763]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:49:59.351 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:49:59 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.300+0000 7f966a800700 1 Processor -- start 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.300+0000 7f966a800700 1 -- start start 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.300+0000 7f966a800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.300+0000 7f966a800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9664078000 con 0x7f9664077bf0 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.301+0000 7f9663400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.301+0000 7f9663400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59982/0 (socket says 172.21.15.57:59982) 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.301+0000 7f9663400700 1 -- 172.21.15.57:0/3923179477 learned_addr learned my addr 172.21.15.57:0/3923179477 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.301+0000 7f9663400700 1 -- 172.21.15.57:0/3923179477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9664076640 con 0x7f9664077bf0 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.302+0000 7f9663400700 1 --2- 172.21.15.57:0/3923179477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664076100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96540098e0 tx=0x7f9654009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23123129726ad81f server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.302+0000 7f9662000700 1 -- 172.21.15.57:0/3923179477 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f965400b860 con 0x7f9664077bf0 2024-02-28T15:50:00.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.302+0000 7f9662000700 1 -- 172.21.15.57:0/3923179477 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f965400be90 con 0x7f9664077bf0 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.302+0000 7f9662000700 1 -- 172.21.15.57:0/3923179477 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96540103c0 con 0x7f9664077bf0 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.303+0000 7f966a800700 1 -- 172.21.15.57:0/3923179477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 msgr2=0x7f9664076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.303+0000 7f966a800700 1 --2- 172.21.15.57:0/3923179477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664076100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96540098e0 tx=0x7f9654009250 comp rx=0 tx=0).stop 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.303+0000 7f966a800700 1 -- 172.21.15.57:0/3923179477 shutdown_connections 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.303+0000 7f966a800700 1 --2- 172.21.15.57:0/3923179477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664076100 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.303+0000 7f966a800700 1 -- 172.21.15.57:0/3923179477 >> 172.21.15.57:0/3923179477 conn(0x7f96640fded0 msgr2=0x7f9664100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.303+0000 7f966a800700 1 -- 172.21.15.57:0/3923179477 shutdown_connections 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.303+0000 7f966a800700 1 -- 172.21.15.57:0/3923179477 wait complete. 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.304+0000 7f966a800700 1 Processor -- start 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.304+0000 7f966a800700 1 -- start start 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.304+0000 7f966a800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.304+0000 7f966a800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9664113fb0 con 0x7f9664077bf0 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.305+0000 7f9663400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:00.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.305+0000 7f9663400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59984/0 (socket says 172.21.15.57:59984) 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.305+0000 7f9663400700 1 -- 172.21.15.57:0/3083503920 learned_addr learned my addr 172.21.15.57:0/3083503920 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.305+0000 7f9663400700 1 -- 172.21.15.57:0/3083503920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540094f0 con 0x7f9664077bf0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.305+0000 7f9663400700 1 --2- 172.21.15.57:0/3083503920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664113a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96540090b0 tx=0x7f9654009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.306+0000 7f965b400700 1 -- 172.21.15.57:0/3083503920 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96540118f0 con 0x7f9664077bf0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.306+0000 7f965b400700 1 -- 172.21.15.57:0/3083503920 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9654010d10 con 0x7f9664077bf0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.306+0000 7f965b400700 1 -- 172.21.15.57:0/3083503920 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96540193c0 con 0x7f9664077bf0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.306+0000 7f966a800700 1 -- 172.21.15.57:0/3083503920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96641141b0 con 0x7f9664077bf0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.306+0000 7f966a800700 1 -- 172.21.15.57:0/3083503920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9664114e50 con 0x7f9664077bf0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.307+0000 7f965b400700 1 -- 172.21.15.57:0/3083503920 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f9654010840 con 0x7f9664077bf0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.307+0000 7f966a800700 1 -- 172.21.15.57:0/3083503920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966405f5c0 con 0x7f9664077bf0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.308+0000 7f965b400700 1 --2- 172.21.15.57:0/3083503920 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f96480367e0 0x7f9648038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.308+0000 7f965b400700 1 -- 172.21.15.57:0/3083503920 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f965404a630 con 0x7f9664077bf0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.308+0000 7f9662a00700 1 --2- 172.21.15.57:0/3083503920 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f96480367e0 0x7f9648038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:00.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.309+0000 7f9662a00700 1 --2- 172.21.15.57:0/3083503920 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f96480367e0 0x7f9648038c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9650009990 tx=0x7f9650006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.313+0000 7f965b400700 1 -- 172.21.15.57:0/3083503920 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f965401a6c0 con 0x7f9664077bf0 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.556+0000 7f966a800700 1 -- 172.21.15.57:0/3083503920 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f9664108b80 con 0x7f96480367e0 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.568+0000 7f965b400700 1 -- 172.21.15.57:0/3083503920 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f9664108b80 con 0x7f96480367e0 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.571+0000 7f966a800700 1 -- 172.21.15.57:0/3083503920 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f96480367e0 msgr2=0x7f9648038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.571+0000 7f966a800700 1 --2- 172.21.15.57:0/3083503920 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f96480367e0 0x7f9648038c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9650009990 tx=0x7f9650006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.571+0000 7f966a800700 1 -- 172.21.15.57:0/3083503920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 msgr2=0x7f9664113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.571+0000 7f966a800700 1 --2- 172.21.15.57:0/3083503920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664113a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96540090b0 tx=0x7f9654009250 comp rx=0 tx=0).stop 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.571+0000 7f966a800700 1 -- 172.21.15.57:0/3083503920 shutdown_connections 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.571+0000 7f966a800700 1 --2- 172.21.15.57:0/3083503920 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f96480367e0 0x7f9648038c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.571+0000 7f966a800700 1 --2- 172.21.15.57:0/3083503920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9664077bf0 0x7f9664113a70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.571+0000 7f966a800700 1 -- 172.21.15.57:0/3083503920 >> 172.21.15.57:0/3083503920 conn(0x7f96640fded0 msgr2=0x7f96641001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.571+0000 7f966a800700 1 -- 172.21.15.57:0/3083503920 shutdown_connections 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:49:58.571+0000 7f966a800700 1 -- 172.21.15.57:0/3083503920 wait complete. 2024-02-28T15:50:00.185 INFO:teuthology.orchestra.run.smithi057.stdout:Deploying node-exporter service with default placement... 2024-02-28T15:50:00.337 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:00 smithi057 ceph-mon[28763]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:50:00.337 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:00 smithi057 ceph-mon[28763]: Saving service grafana spec with placement count:1 2024-02-28T15:50:01.367 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:01 smithi057 ceph-mon[28763]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:01.368 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:01 smithi057 ceph-mon[28763]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:50:01.368 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:01 smithi057 ceph-mon[28763]: Saving service node-exporter spec with placement * 2024-02-28T15:50:01.368 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:01 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:01.697 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.757+0000 7f86eaa00700 1 Processor -- start 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.758+0000 7f86eaa00700 1 -- start start 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.758+0000 7f86eaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e4104d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.758+0000 7f86eaa00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4105250 con 0x7f86e4104900 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.759+0000 7f86e3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e4104d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.759+0000 7f86e3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e4104d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59998/0 (socket says 172.21.15.57:59998) 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.759+0000 7f86e3e00700 1 -- 172.21.15.57:0/3437233138 learned_addr learned my addr 172.21.15.57:0/3437233138 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.759+0000 7f86e3e00700 1 -- 172.21.15.57:0/3437233138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4105390 con 0x7f86e4104900 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.759+0000 7f86e3e00700 1 --2- 172.21.15.57:0/3437233138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e4104d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86d40098e0 tx=0x7f86d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9162c931946d33 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.760+0000 7f86e3400700 1 -- 172.21.15.57:0/3437233138 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86d400b860 con 0x7f86e4104900 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.760+0000 7f86e3400700 1 -- 172.21.15.57:0/3437233138 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86d400be90 con 0x7f86e4104900 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.760+0000 7f86e3400700 1 -- 172.21.15.57:0/3437233138 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86d40103c0 con 0x7f86e4104900 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.760+0000 7f86eaa00700 1 -- 172.21.15.57:0/3437233138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 msgr2=0x7f86e4104d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:01.698 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.760+0000 7f86eaa00700 1 --2- 172.21.15.57:0/3437233138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e4104d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86d40098e0 tx=0x7f86d4009250 comp rx=0 tx=0).stop 2024-02-28T15:50:01.699 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.760+0000 7f86eaa00700 1 -- 172.21.15.57:0/3437233138 shutdown_connections 2024-02-28T15:50:01.699 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.760+0000 7f86eaa00700 1 --2- 172.21.15.57:0/3437233138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e4104d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:01.702 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.760+0000 7f86eaa00700 1 -- 172.21.15.57:0/3437233138 >> 172.21.15.57:0/3437233138 conn(0x7f86e4078010 msgr2=0x7f86e4078430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.761+0000 7f86eaa00700 1 -- 172.21.15.57:0/3437233138 shutdown_connections 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.761+0000 7f86eaa00700 1 -- 172.21.15.57:0/3437233138 wait complete. 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.761+0000 7f86eaa00700 1 Processor -- start 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.762+0000 7f86eaa00700 1 -- start start 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.762+0000 7f86eaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e41136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.762+0000 7f86eaa00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4113bf0 con 0x7f86e4104900 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.762+0000 7f86e3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e41136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.762+0000 7f86e3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e41136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60014/0 (socket says 172.21.15.57:60014) 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.762+0000 7f86e3e00700 1 -- 172.21.15.57:0/2928856905 learned_addr learned my addr 172.21.15.57:0/2928856905 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.763+0000 7f86e3e00700 1 -- 172.21.15.57:0/2928856905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40094f0 con 0x7f86e4104900 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.763+0000 7f86e3e00700 1 --2- 172.21.15.57:0/2928856905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e41136b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86d4006b00 tx=0x7f86d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.763+0000 7f86e0c00700 1 -- 172.21.15.57:0/2928856905 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86d40109a0 con 0x7f86e4104900 2024-02-28T15:50:01.703 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.763+0000 7f86e0c00700 1 -- 172.21.15.57:0/2928856905 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86d401a430 con 0x7f86e4104900 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.763+0000 7f86eaa00700 1 -- 172.21.15.57:0/2928856905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e4113df0 con 0x7f86e4104900 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.763+0000 7f86e0c00700 1 -- 172.21.15.57:0/2928856905 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86d40245b0 con 0x7f86e4104900 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.763+0000 7f86eaa00700 1 -- 172.21.15.57:0/2928856905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e4114a90 con 0x7f86e4104900 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.765+0000 7f86e0c00700 1 -- 172.21.15.57:0/2928856905 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f86d401aaa0 con 0x7f86e4104900 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.765+0000 7f86eaa00700 1 -- 172.21.15.57:0/2928856905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e405f5c0 con 0x7f86e4104900 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.765+0000 7f86e0c00700 1 --2- 172.21.15.57:0/2928856905 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f86c80367e0 0x7f86c8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.765+0000 7f86e0c00700 1 -- 172.21.15.57:0/2928856905 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f86d404a740 con 0x7f86e4104900 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.765+0000 7f86db400700 1 --2- 172.21.15.57:0/2928856905 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f86c80367e0 0x7f86c8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.766+0000 7f86db400700 1 --2- 172.21.15.57:0/2928856905 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f86c80367e0 0x7f86c8038c90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009990 tx=0x7f86cc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.771+0000 7f86e0c00700 1 -- 172.21.15.57:0/2928856905 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f86d4018940 con 0x7f86e4104900 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:00.991+0000 7f86eaa00700 1 -- 172.21.15.57:0/2928856905 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f86e4102eb0 con 0x7f86c80367e0 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.005+0000 7f86e0c00700 1 -- 172.21.15.57:0/2928856905 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f86e4102eb0 con 0x7f86c80367e0 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.008+0000 7f86eaa00700 1 -- 172.21.15.57:0/2928856905 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f86c80367e0 msgr2=0x7f86c8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.008+0000 7f86eaa00700 1 --2- 172.21.15.57:0/2928856905 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f86c80367e0 0x7f86c8038c90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009990 tx=0x7f86cc006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:01.705 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.008+0000 7f86eaa00700 1 -- 172.21.15.57:0/2928856905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 msgr2=0x7f86e41136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:01.705 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.008+0000 7f86eaa00700 1 --2- 172.21.15.57:0/2928856905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e41136b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86d4006b00 tx=0x7f86d4009250 comp rx=0 tx=0).stop 2024-02-28T15:50:01.705 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.008+0000 7f86eaa00700 1 -- 172.21.15.57:0/2928856905 shutdown_connections 2024-02-28T15:50:01.705 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.008+0000 7f86eaa00700 1 --2- 172.21.15.57:0/2928856905 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f86c80367e0 0x7f86c8038c90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:01.705 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.008+0000 7f86eaa00700 1 --2- 172.21.15.57:0/2928856905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86e4104900 0x7f86e41136b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:01.705 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.008+0000 7f86eaa00700 1 -- 172.21.15.57:0/2928856905 >> 172.21.15.57:0/2928856905 conn(0x7f86e4078010 msgr2=0x7f86e41027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:01.705 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.009+0000 7f86eaa00700 1 -- 172.21.15.57:0/2928856905 shutdown_connections 2024-02-28T15:50:01.705 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:01.009+0000 7f86eaa00700 1 -- 172.21.15.57:0/2928856905 wait complete. 2024-02-28T15:50:01.705 INFO:teuthology.orchestra.run.smithi057.stdout:Deploying alertmanager service with default placement... 2024-02-28T15:50:02.295 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:02 smithi057 ceph-mon[28763]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:03.212 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-28T15:50:03.212 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.299+0000 7f01cb400700 1 Processor -- start 2024-02-28T15:50:03.217 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.299+0000 7f01cb400700 1 -- start start 2024-02-28T15:50:03.217 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.299+0000 7f01cb400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c41077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.299+0000 7f01cb400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c41031d0 con 0x7f01c4071420 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.299+0000 7f01c8a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c41077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.300+0000 7f01c8a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c41077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33768/0 (socket says 172.21.15.57:33768) 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.300+0000 7f01c8a00700 1 -- 172.21.15.57:0/2849780555 learned_addr learned my addr 172.21.15.57:0/2849780555 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.300+0000 7f01c8a00700 1 -- 172.21.15.57:0/2849780555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c4107d20 con 0x7f01c4071420 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.300+0000 7f01c8a00700 1 --2- 172.21.15.57:0/2849780555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c41077e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009e50 tx=0x7f01b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6f9e0fac264ed5 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.300+0000 7f01c3e00700 1 -- 172.21.15.57:0/2849780555 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01b40092e0 con 0x7f01c4071420 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.301+0000 7f01c3e00700 1 -- 172.21.15.57:0/2849780555 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01b4012430 con 0x7f01c4071420 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.301+0000 7f01c3e00700 1 -- 172.21.15.57:0/2849780555 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01b40075a0 con 0x7f01c4071420 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.301+0000 7f01cb400700 1 -- 172.21.15.57:0/2849780555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 msgr2=0x7f01c41077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.301+0000 7f01cb400700 1 --2- 172.21.15.57:0/2849780555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c41077e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009e50 tx=0x7f01b4009840 comp rx=0 tx=0).stop 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.301+0000 7f01cb400700 1 -- 172.21.15.57:0/2849780555 shutdown_connections 2024-02-28T15:50:03.218 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.301+0000 7f01cb400700 1 --2- 172.21.15.57:0/2849780555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c41077e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.301+0000 7f01cb400700 1 -- 172.21.15.57:0/2849780555 >> 172.21.15.57:0/2849780555 conn(0x7f01c40fcdd0 msgr2=0x7f01c40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.302+0000 7f01cb400700 1 -- 172.21.15.57:0/2849780555 shutdown_connections 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.302+0000 7f01cb400700 1 -- 172.21.15.57:0/2849780555 wait complete. 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.302+0000 7f01cb400700 1 Processor -- start 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.303+0000 7f01cb400700 1 -- start start 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.303+0000 7f01cb400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c4113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.303+0000 7f01cb400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4113d60 con 0x7f01c4071420 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.303+0000 7f01c8a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c4113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.303+0000 7f01c8a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c4113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33772/0 (socket says 172.21.15.57:33772) 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.303+0000 7f01c8a00700 1 -- 172.21.15.57:0/3278691723 learned_addr learned my addr 172.21.15.57:0/3278691723 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:03.219 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.304+0000 7f01c8a00700 1 -- 172.21.15.57:0/3278691723 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4009ae0 con 0x7f01c4071420 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.304+0000 7f01c8a00700 1 --2- 172.21.15.57:0/3278691723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c4113820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f01b4012de0 tx=0x7f01b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.304+0000 7f01c1600700 1 -- 172.21.15.57:0/3278691723 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01b40092e0 con 0x7f01c4071420 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.304+0000 7f01c1600700 1 -- 172.21.15.57:0/3278691723 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01b4007d30 con 0x7f01c4071420 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.304+0000 7f01c1600700 1 -- 172.21.15.57:0/3278691723 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01b4025a00 con 0x7f01c4071420 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.304+0000 7f01cb400700 1 -- 172.21.15.57:0/3278691723 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c4113f60 con 0x7f01c4071420 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.305+0000 7f01cb400700 1 -- 172.21.15.57:0/3278691723 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c4114c00 con 0x7f01c4071420 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.306+0000 7f01c1600700 1 -- 172.21.15.57:0/3278691723 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f01b4019050 con 0x7f01c4071420 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.306+0000 7f01cb400700 1 -- 172.21.15.57:0/3278691723 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c405f5c0 con 0x7f01c4071420 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.306+0000 7f01c1600700 1 --2- 172.21.15.57:0/3278691723 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f01a80367e0 0x7f01a8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.306+0000 7f01c1600700 1 -- 172.21.15.57:0/3278691723 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f01b4049ff0 con 0x7f01c4071420 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.307+0000 7f01bbe00700 1 --2- 172.21.15.57:0/3278691723 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f01a80367e0 0x7f01a8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.307+0000 7f01bbe00700 1 --2- 172.21.15.57:0/3278691723 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f01a80367e0 0x7f01a8038c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009990 tx=0x7f01ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:03.220 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.313+0000 7f01c1600700 1 -- 172.21.15.57:0/3278691723 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f01b4025410 con 0x7f01c4071420 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.537+0000 7f01cb400700 1 -- 172.21.15.57:0/3278691723 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f01c41157e0 con 0x7f01a80367e0 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.551+0000 7f01c1600700 1 -- 172.21.15.57:0/3278691723 <== mgr.14120 v2:172.21.15.57:6800/3389594762 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f01c41157e0 con 0x7f01a80367e0 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.554+0000 7f01cb400700 1 -- 172.21.15.57:0/3278691723 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f01a80367e0 msgr2=0x7f01a8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.554+0000 7f01cb400700 1 --2- 172.21.15.57:0/3278691723 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f01a80367e0 0x7f01a8038c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009990 tx=0x7f01ac006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.554+0000 7f01cb400700 1 -- 172.21.15.57:0/3278691723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 msgr2=0x7f01c4113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.554+0000 7f01cb400700 1 --2- 172.21.15.57:0/3278691723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c4113820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f01b4012de0 tx=0x7f01b4009840 comp rx=0 tx=0).stop 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.555+0000 7f01cb400700 1 -- 172.21.15.57:0/3278691723 shutdown_connections 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.555+0000 7f01cb400700 1 --2- 172.21.15.57:0/3278691723 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f01a80367e0 0x7f01a8038c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.555+0000 7f01cb400700 1 --2- 172.21.15.57:0/3278691723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01c4071420 0x7f01c4113820 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.555+0000 7f01cb400700 1 -- 172.21.15.57:0/3278691723 >> 172.21.15.57:0/3278691723 conn(0x7f01c40fcdd0 msgr2=0x7f01c40fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.555+0000 7f01cb400700 1 -- 172.21.15.57:0/3278691723 shutdown_connections 2024-02-28T15:50:03.221 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:02.555+0000 7f01cb400700 1 -- 172.21.15.57:0/3278691723 wait complete. 2024-02-28T15:50:03.816 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:03 smithi057 ceph-mon[28763]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:50:03.816 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:03 smithi057 ceph-mon[28763]: Saving service alertmanager spec with placement count:1 2024-02-28T15:50:03.816 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:03 smithi057 ceph-mon[28763]: from='mgr.14120 172.21.15.57:0/4215982952' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:04.583 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.819+0000 7f29fa800700 1 Processor -- start 2024-02-28T15:50:04.583 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.820+0000 7f29fa800700 1 -- start start 2024-02-28T15:50:04.583 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.820+0000 7f29fa800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:04.583 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.820+0000 7f29fa800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f41030c0 con 0x7f29f4102770 2024-02-28T15:50:04.583 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.821+0000 7f29f3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.821+0000 7f29f3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33784/0 (socket says 172.21.15.57:33784) 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.821+0000 7f29f3400700 1 -- 172.21.15.57:0/1853709308 learned_addr learned my addr 172.21.15.57:0/1853709308 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.821+0000 7f29f3400700 1 -- 172.21.15.57:0/1853709308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f4103200 con 0x7f29f4102770 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.822+0000 7f29f3400700 1 --2- 172.21.15.57:0/1853709308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4102b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29e40098e0 tx=0x7f29e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c79fef208e3a32 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.822+0000 7f29f2a00700 1 -- 172.21.15.57:0/1853709308 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29e400b860 con 0x7f29f4102770 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.822+0000 7f29f2a00700 1 -- 172.21.15.57:0/1853709308 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29e400be90 con 0x7f29f4102770 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.822+0000 7f29f2a00700 1 -- 172.21.15.57:0/1853709308 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29e40103c0 con 0x7f29f4102770 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.823+0000 7f29fa800700 1 -- 172.21.15.57:0/1853709308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 msgr2=0x7f29f4102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.823+0000 7f29fa800700 1 --2- 172.21.15.57:0/1853709308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4102b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29e40098e0 tx=0x7f29e4009250 comp rx=0 tx=0).stop 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.823+0000 7f29fa800700 1 -- 172.21.15.57:0/1853709308 shutdown_connections 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.823+0000 7f29fa800700 1 --2- 172.21.15.57:0/1853709308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4102b80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.823+0000 7f29fa800700 1 -- 172.21.15.57:0/1853709308 >> 172.21.15.57:0/1853709308 conn(0x7f29f40fded0 msgr2=0x7f29f4100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.823+0000 7f29fa800700 1 -- 172.21.15.57:0/1853709308 shutdown_connections 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.823+0000 7f29fa800700 1 -- 172.21.15.57:0/1853709308 wait complete. 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.824+0000 7f29fa800700 1 Processor -- start 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.824+0000 7f29fa800700 1 -- start start 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.825+0000 7f29fa800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.825+0000 7f29fa800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f4111aa0 con 0x7f29f4102770 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.825+0000 7f29f3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.825+0000 7f29f3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33796/0 (socket says 172.21.15.57:33796) 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.825+0000 7f29f3400700 1 -- 172.21.15.57:0/749037091 learned_addr learned my addr 172.21.15.57:0/749037091 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.825+0000 7f29f3400700 1 -- 172.21.15.57:0/749037091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e40094f0 con 0x7f29f4102770 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.826+0000 7f29f3400700 1 --2- 172.21.15.57:0/749037091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4111560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f29e4006b00 tx=0x7f29e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.826+0000 7f29eb400700 1 -- 172.21.15.57:0/749037091 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29e40109a0 con 0x7f29f4102770 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.826+0000 7f29eb400700 1 -- 172.21.15.57:0/749037091 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29e401a430 con 0x7f29f4102770 2024-02-28T15:50:04.585 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.826+0000 7f29fa800700 1 -- 172.21.15.57:0/749037091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f4111ca0 con 0x7f29f4102770 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.826+0000 7f29eb400700 1 -- 172.21.15.57:0/749037091 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29e40245b0 con 0x7f29f4102770 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.826+0000 7f29fa800700 1 -- 172.21.15.57:0/749037091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f4112940 con 0x7f29f4102770 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.827+0000 7f29eb400700 1 -- 172.21.15.57:0/749037091 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f29e401aaa0 con 0x7f29f4102770 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.827+0000 7f29fa800700 1 -- 172.21.15.57:0/749037091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f405f5c0 con 0x7f29f4102770 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.828+0000 7f29eb400700 1 --2- 172.21.15.57:0/749037091 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f29d80367e0 0x7f29d8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.828+0000 7f29eb400700 1 -- 172.21.15.57:0/749037091 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f29e404a740 con 0x7f29f4102770 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.828+0000 7f29ebe00700 1 --2- 172.21.15.57:0/749037091 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f29d80367e0 0x7f29d8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.829+0000 7f29ebe00700 1 --2- 172.21.15.57:0/749037091 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f29d80367e0 0x7f29d8038c90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009990 tx=0x7f29dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:03.833+0000 7f29eb400700 1 -- 172.21.15.57:0/749037091 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f29e4018940 con 0x7f29f4102770 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.042+0000 7f29fa800700 1 -- 172.21.15.57:0/749037091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f29f404bed0 con 0x7f29f4102770 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.049+0000 7f29eb400700 1 -- 172.21.15.57:0/749037091 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f29e4018350 con 0x7f29f4102770 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.052+0000 7f29fa800700 1 -- 172.21.15.57:0/749037091 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f29d80367e0 msgr2=0x7f29d8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.052+0000 7f29fa800700 1 --2- 172.21.15.57:0/749037091 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f29d80367e0 0x7f29d8038c90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009990 tx=0x7f29dc006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:04.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.052+0000 7f29fa800700 1 -- 172.21.15.57:0/749037091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 msgr2=0x7f29f4111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:04.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.052+0000 7f29fa800700 1 --2- 172.21.15.57:0/749037091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4111560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f29e4006b00 tx=0x7f29e4009250 comp rx=0 tx=0).stop 2024-02-28T15:50:04.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.052+0000 7f29fa800700 1 -- 172.21.15.57:0/749037091 shutdown_connections 2024-02-28T15:50:04.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.052+0000 7f29fa800700 1 --2- 172.21.15.57:0/749037091 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f29d80367e0 0x7f29d8038c90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:04.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.052+0000 7f29fa800700 1 --2- 172.21.15.57:0/749037091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f4102770 0x7f29f4111560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:04.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.052+0000 7f29fa800700 1 -- 172.21.15.57:0/749037091 >> 172.21.15.57:0/749037091 conn(0x7f29f40fded0 msgr2=0x7f29f40fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:04.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.052+0000 7f29fa800700 1 -- 172.21.15.57:0/749037091 shutdown_connections 2024-02-28T15:50:04.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:04.053+0000 7f29fa800700 1 -- 172.21.15.57:0/749037091 wait complete. 2024-02-28T15:50:04.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:04 smithi057 ceph-mon[28763]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:04.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:04 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/749037091' entity='client.admin' 2024-02-28T15:50:06.144 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.248+0000 7f87a1800700 1 Processor -- start 2024-02-28T15:50:06.144 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.248+0000 7f87a1800700 1 -- start start 2024-02-28T15:50:06.144 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.248+0000 7f87a1800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c104d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:06.144 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.248+0000 7f87a1800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c1052d0 con 0x7f879c104980 2024-02-28T15:50:06.144 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.249+0000 7f879aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c104d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.249+0000 7f879aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c104d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33800/0 (socket says 172.21.15.57:33800) 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.249+0000 7f879aa00700 1 -- 172.21.15.57:0/185232325 learned_addr learned my addr 172.21.15.57:0/185232325 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.249+0000 7f879aa00700 1 -- 172.21.15.57:0/185232325 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c105410 con 0x7f879c104980 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.250+0000 7f879aa00700 1 --2- 172.21.15.57:0/185232325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c104d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f878c0098e0 tx=0x7f878c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b147e5690ca279 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.250+0000 7f8799600700 1 -- 172.21.15.57:0/185232325 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f878c00b860 con 0x7f879c104980 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.250+0000 7f8799600700 1 -- 172.21.15.57:0/185232325 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f878c00be90 con 0x7f879c104980 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.250+0000 7f8799600700 1 -- 172.21.15.57:0/185232325 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f878c0103c0 con 0x7f879c104980 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.251+0000 7f87a1800700 1 -- 172.21.15.57:0/185232325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 msgr2=0x7f879c104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.251+0000 7f87a1800700 1 --2- 172.21.15.57:0/185232325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c104d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f878c0098e0 tx=0x7f878c009250 comp rx=0 tx=0).stop 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.251+0000 7f87a1800700 1 -- 172.21.15.57:0/185232325 shutdown_connections 2024-02-28T15:50:06.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.251+0000 7f87a1800700 1 --2- 172.21.15.57:0/185232325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c104d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.251+0000 7f87a1800700 1 -- 172.21.15.57:0/185232325 >> 172.21.15.57:0/185232325 conn(0x7f879c078030 msgr2=0x7f879c078450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.251+0000 7f87a1800700 1 -- 172.21.15.57:0/185232325 shutdown_connections 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.251+0000 7f87a1800700 1 -- 172.21.15.57:0/185232325 wait complete. 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.252+0000 7f87a1800700 1 Processor -- start 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.252+0000 7f87a1800700 1 -- start start 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.252+0000 7f87a1800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c1137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.252+0000 7f87a1800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c113d00 con 0x7f879c104980 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.253+0000 7f879aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c1137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.253+0000 7f879aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c1137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33812/0 (socket says 172.21.15.57:33812) 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.253+0000 7f879aa00700 1 -- 172.21.15.57:0/3987780047 learned_addr learned my addr 172.21.15.57:0/3987780047 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.253+0000 7f879aa00700 1 -- 172.21.15.57:0/3987780047 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c0094f0 con 0x7f879c104980 2024-02-28T15:50:06.146 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.253+0000 7f879aa00700 1 --2- 172.21.15.57:0/3987780047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c1137c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f878c0090b0 tx=0x7f878c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.254+0000 7f8792a00700 1 -- 172.21.15.57:0/3987780047 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f878c010840 con 0x7f879c104980 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.254+0000 7f8792a00700 1 -- 172.21.15.57:0/3987780047 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f878c010e70 con 0x7f879c104980 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.254+0000 7f8792a00700 1 -- 172.21.15.57:0/3987780047 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f878c024e40 con 0x7f879c104980 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.254+0000 7f87a1800700 1 -- 172.21.15.57:0/3987780047 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c113f00 con 0x7f879c104980 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.254+0000 7f87a1800700 1 -- 172.21.15.57:0/3987780047 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c114ba0 con 0x7f879c104980 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.255+0000 7f8792a00700 1 -- 172.21.15.57:0/3987780047 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f878c024430 con 0x7f879c104980 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.255+0000 7f87a1800700 1 -- 172.21.15.57:0/3987780047 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c05f5c0 con 0x7f879c104980 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.256+0000 7f8792a00700 1 --2- 172.21.15.57:0/3987780047 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8780036790 0x7f8780038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.256+0000 7f8792a00700 1 -- 172.21.15.57:0/3987780047 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f878c04a820 con 0x7f879c104980 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.256+0000 7f879a000700 1 --2- 172.21.15.57:0/3987780047 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8780036790 0x7f8780038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.257+0000 7f879a000700 1 --2- 172.21.15.57:0/3987780047 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8780036790 0x7f8780038c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8788009990 tx=0x7f8788006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:06.147 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.261+0000 7f8792a00700 1 -- 172.21.15.57:0/3987780047 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f878c02c930 con 0x7f879c104980 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.473+0000 7f87a1800700 1 -- 172.21.15.57:0/3987780047 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f879c04bed0 con 0x7f879c104980 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.478+0000 7f8792a00700 1 -- 172.21.15.57:0/3987780047 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f878c02c340 con 0x7f879c104980 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.480+0000 7f87a1800700 1 -- 172.21.15.57:0/3987780047 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8780036790 msgr2=0x7f8780038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.480+0000 7f87a1800700 1 --2- 172.21.15.57:0/3987780047 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8780036790 0x7f8780038c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8788009990 tx=0x7f8788006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.480+0000 7f87a1800700 1 -- 172.21.15.57:0/3987780047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 msgr2=0x7f879c1137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.480+0000 7f87a1800700 1 --2- 172.21.15.57:0/3987780047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c1137c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f878c0090b0 tx=0x7f878c009250 comp rx=0 tx=0).stop 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.481+0000 7f87a1800700 1 -- 172.21.15.57:0/3987780047 shutdown_connections 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.481+0000 7f87a1800700 1 --2- 172.21.15.57:0/3987780047 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8780036790 0x7f8780038c40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.481+0000 7f87a1800700 1 --2- 172.21.15.57:0/3987780047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879c104980 0x7f879c1137c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.481+0000 7f87a1800700 1 -- 172.21.15.57:0/3987780047 >> 172.21.15.57:0/3987780047 conn(0x7f879c078030 msgr2=0x7f879c1030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.481+0000 7f87a1800700 1 -- 172.21.15.57:0/3987780047 shutdown_connections 2024-02-28T15:50:06.148 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:05.481+0000 7f87a1800700 1 -- 172.21.15.57:0/3987780047 wait complete. 2024-02-28T15:50:06.149 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling the dashboard module... 2024-02-28T15:50:06.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:06 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3987780047' entity='client.admin' 2024-02-28T15:50:06.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:06 smithi057 ceph-mon[28763]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:07.866 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:07 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1002976100' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-28T15:50:08.203 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.727+0000 7f55bd600700 1 Processor -- start 2024-02-28T15:50:08.203 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.727+0000 7f55bd600700 1 -- start start 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.728+0000 7f55bd600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b8105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.728+0000 7f55bd600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b81058a0 con 0x7f55b8076c40 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.728+0000 7f55b6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b8105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.728+0000 7f55b6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b8105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33816/0 (socket says 172.21.15.57:33816) 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.728+0000 7f55b6a00700 1 -- 172.21.15.57:0/3470881133 learned_addr learned my addr 172.21.15.57:0/3470881133 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.729+0000 7f55b6a00700 1 -- 172.21.15.57:0/3470881133 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b81059e0 con 0x7f55b8076c40 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.729+0000 7f55b6a00700 1 --2- 172.21.15.57:0/3470881133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b8105360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f55a80098e0 tx=0x7f55a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3606f79d2ebaabc server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.729+0000 7f55b5600700 1 -- 172.21.15.57:0/3470881133 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55a800b860 con 0x7f55b8076c40 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.729+0000 7f55b5600700 1 -- 172.21.15.57:0/3470881133 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55a800be90 con 0x7f55b8076c40 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.729+0000 7f55b5600700 1 -- 172.21.15.57:0/3470881133 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55a80103c0 con 0x7f55b8076c40 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.730+0000 7f55bd600700 1 -- 172.21.15.57:0/3470881133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 msgr2=0x7f55b8105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.730+0000 7f55bd600700 1 --2- 172.21.15.57:0/3470881133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b8105360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f55a80098e0 tx=0x7f55a8009250 comp rx=0 tx=0).stop 2024-02-28T15:50:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.730+0000 7f55bd600700 1 -- 172.21.15.57:0/3470881133 shutdown_connections 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.730+0000 7f55bd600700 1 --2- 172.21.15.57:0/3470881133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b8105360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.730+0000 7f55bd600700 1 -- 172.21.15.57:0/3470881133 >> 172.21.15.57:0/3470881133 conn(0x7f55b80fcdd0 msgr2=0x7f55b80ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.730+0000 7f55bd600700 1 -- 172.21.15.57:0/3470881133 shutdown_connections 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.730+0000 7f55bd600700 1 -- 172.21.15.57:0/3470881133 wait complete. 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.731+0000 7f55bd600700 1 Processor -- start 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.731+0000 7f55bd600700 1 -- start start 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.732+0000 7f55bd600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b81115a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.732+0000 7f55bd600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b8111ae0 con 0x7f55b8076c40 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.732+0000 7f55b6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b81115a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.732+0000 7f55b6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b81115a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33830/0 (socket says 172.21.15.57:33830) 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.732+0000 7f55b6a00700 1 -- 172.21.15.57:0/1002976100 learned_addr learned my addr 172.21.15.57:0/1002976100 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.733+0000 7f55b6a00700 1 -- 172.21.15.57:0/1002976100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a80094f0 con 0x7f55b8076c40 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.733+0000 7f55b6a00700 1 --2- 172.21.15.57:0/1002976100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b81115a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55a8006d40 tx=0x7f55a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:08.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.733+0000 7f55aea00700 1 -- 172.21.15.57:0/1002976100 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55a8010840 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.733+0000 7f55aea00700 1 -- 172.21.15.57:0/1002976100 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55a8010e70 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.733+0000 7f55bd600700 1 -- 172.21.15.57:0/1002976100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b8111ce0 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.733+0000 7f55aea00700 1 -- 172.21.15.57:0/1002976100 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55a8024ea0 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.733+0000 7f55bd600700 1 -- 172.21.15.57:0/1002976100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b8112980 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.734+0000 7f55aea00700 1 -- 172.21.15.57:0/1002976100 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f55a801a4c0 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.735+0000 7f55bd600700 1 -- 172.21.15.57:0/1002976100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55980052e0 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.735+0000 7f55aea00700 1 --2- 172.21.15.57:0/1002976100 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f559c036790 0x7f559c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.735+0000 7f55aea00700 1 -- 172.21.15.57:0/1002976100 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f55a804a610 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.735+0000 7f55b6000700 1 --2- 172.21.15.57:0/1002976100 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f559c036790 0x7f559c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.736+0000 7f55b6000700 1 --2- 172.21.15.57:0/1002976100 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f559c036790 0x7f559c038c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009990 tx=0x7f55a4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:06.740+0000 7f55aea00700 1 -- 172.21.15.57:0/1002976100 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f55a8018940 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.011+0000 7f55bd600700 1 -- 172.21.15.57:0/1002976100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f5598005590 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.502+0000 7f55aea00700 1 -- 172.21.15.57:0/1002976100 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f55a802e440 con 0x7f55b8076c40 2024-02-28T15:50:08.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.503+0000 7f55aea00700 1 -- 172.21.15.57:0/1002976100 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f55a801ac40 con 0x7f55b8076c40 2024-02-28T15:50:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.507+0000 7f55bd600700 1 -- 172.21.15.57:0/1002976100 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f559c036790 msgr2=0x7f559c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.507+0000 7f55bd600700 1 --2- 172.21.15.57:0/1002976100 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f559c036790 0x7f559c038c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009990 tx=0x7f55a4006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.507+0000 7f55bd600700 1 -- 172.21.15.57:0/1002976100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 msgr2=0x7f55b81115a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.507+0000 7f55bd600700 1 --2- 172.21.15.57:0/1002976100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b81115a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55a8006d40 tx=0x7f55a8009250 comp rx=0 tx=0).stop 2024-02-28T15:50:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.507+0000 7f55bd600700 1 -- 172.21.15.57:0/1002976100 shutdown_connections 2024-02-28T15:50:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.507+0000 7f55bd600700 1 --2- 172.21.15.57:0/1002976100 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f559c036790 0x7f559c038c40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.507+0000 7f55bd600700 1 --2- 172.21.15.57:0/1002976100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55b8076c40 0x7f55b81115a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.507+0000 7f55bd600700 1 -- 172.21.15.57:0/1002976100 >> 172.21.15.57:0/1002976100 conn(0x7f55b80fcdd0 msgr2=0x7f55b80fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.507+0000 7f55bd600700 1 -- 172.21.15.57:0/1002976100 shutdown_connections 2024-02-28T15:50:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:07.507+0000 7f55bd600700 1 -- 172.21.15.57:0/1002976100 wait complete. 2024-02-28T15:50:08.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:08 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1002976100' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-28T15:50:08.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:08 smithi057 ceph-mon[28763]: mgrmap e9: smithi057.upqerc(active, since 31s) 2024-02-28T15:50:09.755 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:09 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/758576606' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-28T15:50:09.863 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "active_name": "smithi057.upqerc", 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.840+0000 7f8079200700 1 Processor -- start 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.840+0000 7f8079200700 1 -- start start 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.841+0000 7f8079200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074104d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.841+0000 7f8079200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80741052b0 con 0x7f8074104960 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.842+0000 7f8071e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074104d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:09.864 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.842+0000 7f8071e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074104d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33852/0 (socket says 172.21.15.57:33852) 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.842+0000 7f8071e00700 1 -- 172.21.15.57:0/3650674873 learned_addr learned my addr 172.21.15.57:0/3650674873 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.842+0000 7f8071e00700 1 -- 172.21.15.57:0/3650674873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80741053f0 con 0x7f8074104960 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.842+0000 7f8071e00700 1 --2- 172.21.15.57:0/3650674873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074104d70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80640098e0 tx=0x7f8064009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81d602440b3008 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.843+0000 7f8070a00700 1 -- 172.21.15.57:0/3650674873 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f806400b860 con 0x7f8074104960 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.843+0000 7f8070a00700 1 -- 172.21.15.57:0/3650674873 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f806400be90 con 0x7f8074104960 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.843+0000 7f8070a00700 1 -- 172.21.15.57:0/3650674873 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80640103c0 con 0x7f8074104960 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.844+0000 7f8079200700 1 -- 172.21.15.57:0/3650674873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 msgr2=0x7f8074104d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.844+0000 7f8079200700 1 --2- 172.21.15.57:0/3650674873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074104d70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80640098e0 tx=0x7f8064009250 comp rx=0 tx=0).stop 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.844+0000 7f8079200700 1 -- 172.21.15.57:0/3650674873 shutdown_connections 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.844+0000 7f8079200700 1 --2- 172.21.15.57:0/3650674873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074104d70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.844+0000 7f8079200700 1 -- 172.21.15.57:0/3650674873 >> 172.21.15.57:0/3650674873 conn(0x7f8074100340 msgr2=0x7f8074102720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.844+0000 7f8079200700 1 -- 172.21.15.57:0/3650674873 shutdown_connections 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.844+0000 7f8079200700 1 -- 172.21.15.57:0/3650674873 wait complete. 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.845+0000 7f8079200700 1 Processor -- start 2024-02-28T15:50:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.846+0000 7f8079200700 1 -- start start 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.846+0000 7f8079200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.846+0000 7f8079200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8074113fa0 con 0x7f8074104960 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.846+0000 7f8071e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.846+0000 7f8071e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33862/0 (socket says 172.21.15.57:33862) 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.846+0000 7f8071e00700 1 -- 172.21.15.57:0/758576606 learned_addr learned my addr 172.21.15.57:0/758576606 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.847+0000 7f8071e00700 1 -- 172.21.15.57:0/758576606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80640094f0 con 0x7f8074104960 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.847+0000 7f8071e00700 1 --2- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074113a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8064006b00 tx=0x7f8064009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.847+0000 7f806a000700 1 -- 172.21.15.57:0/758576606 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80640109a0 con 0x7f8074104960 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.847+0000 7f806a000700 1 -- 172.21.15.57:0/758576606 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f806401a430 con 0x7f8074104960 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.847+0000 7f8079200700 1 -- 172.21.15.57:0/758576606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80741141a0 con 0x7f8074104960 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.847+0000 7f806a000700 1 -- 172.21.15.57:0/758576606 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80640245b0 con 0x7f8074104960 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.848+0000 7f8079200700 1 -- 172.21.15.57:0/758576606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8074114e40 con 0x7f8074104960 2024-02-28T15:50:09.866 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.849+0000 7f8079200700 1 -- 172.21.15.57:0/758576606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807405f5c0 con 0x7f8074104960 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.849+0000 7f806a000700 1 -- 172.21.15.57:0/758576606 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f806401aaa0 con 0x7f8074104960 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.850+0000 7f806a000700 1 --2- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8058036830 0x7f8058038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.850+0000 7f806a000700 1 -- 172.21.15.57:0/758576606 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f806404a7b0 con 0x7f8074104960 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.850+0000 7f8071400700 1 -- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8058036830 msgr2=0x7f8058038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3389594762 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.850+0000 7f8071400700 1 --2- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8058036830 0x7f8058038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:08.858+0000 7f806a000700 1 -- 172.21.15.57:0/758576606 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8064018940 con 0x7f8074104960 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.051+0000 7f8071400700 1 -- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8058036830 msgr2=0x7f8058038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3389594762 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.051+0000 7f8071400700 1 --2- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8058036830 0x7f8058038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.123+0000 7f8079200700 1 -- 172.21.15.57:0/758576606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f8074106840 con 0x7f8074104960 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.125+0000 7f806a000700 1 -- 172.21.15.57:0/758576606 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f8064018350 con 0x7f8074104960 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.128+0000 7f8079200700 1 -- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8058036830 msgr2=0x7f8058038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.128+0000 7f8079200700 1 --2- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8058036830 0x7f8058038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.128+0000 7f8079200700 1 -- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 msgr2=0x7f8074113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:09.867 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.128+0000 7f8079200700 1 --2- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074113a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8064006b00 tx=0x7f8064009250 comp rx=0 tx=0).stop 2024-02-28T15:50:09.868 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.128+0000 7f8079200700 1 -- 172.21.15.57:0/758576606 shutdown_connections 2024-02-28T15:50:09.868 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.128+0000 7f8079200700 1 --2- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8058036830 0x7f8058038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:09.868 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.128+0000 7f8079200700 1 --2- 172.21.15.57:0/758576606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8074104960 0x7f8074113a60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:09.868 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.128+0000 7f8079200700 1 -- 172.21.15.57:0/758576606 >> 172.21.15.57:0/758576606 conn(0x7f8074100340 msgr2=0x7f80741035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:09.868 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.128+0000 7f8079200700 1 -- 172.21.15.57:0/758576606 shutdown_connections 2024-02-28T15:50:09.868 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:09.128+0000 7f8079200700 1 -- 172.21.15.57:0/758576606 wait complete. 2024-02-28T15:50:09.868 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for the mgr to restart... 2024-02-28T15:50:09.868 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mgr epoch 9... 2024-02-28T15:50:16.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:16 smithi057 ceph-mon[28763]: Active manager daemon smithi057.upqerc restarted 2024-02-28T15:50:16.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:16 smithi057 ceph-mon[28763]: Activating manager daemon smithi057.upqerc 2024-02-28T15:50:16.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:16 smithi057 ceph-mon[28763]: osdmap e3: 0 total, 0 up, 0 in 2024-02-28T15:50:16.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:16 smithi057 ceph-mon[28763]: mgrmap e10: smithi057.upqerc(active, starting, since 0.00812832s) 2024-02-28T15:50:16.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:16 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:50:16.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:16 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T15:50:16.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:16 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T15:50:16.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:16 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T15:50:16.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:16 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T15:50:16.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:16 smithi057 ceph-mon[28763]: Manager daemon smithi057.upqerc is now available 2024-02-28T15:50:17.454 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:17 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:50:17.454 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:17 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:50:17.454 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:17 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T15:50:17.454 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:17 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T15:50:17.454 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:17 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:17.454 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:17 smithi057 ceph-mon[28763]: mgrmap e11: smithi057.upqerc(active, since 1.01242s) 2024-02-28T15:50:18.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:18 smithi057 ceph-mon[28763]: [28/Feb/2024:15:50:16] ENGINE Bus STARTING 2024-02-28T15:50:18.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:18 smithi057 ceph-mon[28763]: [28/Feb/2024:15:50:16] ENGINE Serving on https://172.21.15.57:7150 2024-02-28T15:50:18.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:18 smithi057 ceph-mon[28763]: [28/Feb/2024:15:50:16] ENGINE Bus STARTED 2024-02-28T15:50:18.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:18 smithi057 ceph-mon[28763]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-28T15:50:18.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:18 smithi057 ceph-mon[28763]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-28T15:50:18.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:18 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:18.475 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2024-02-28T15:50:18.475 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-28T15:50:18.475 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-28T15:50:18.476 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2024-02-28T15:50:18.476 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.386+0000 7f8866800700 1 Processor -- start 2024-02-28T15:50:18.477 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.386+0000 7f8866800700 1 -- start start 2024-02-28T15:50:18.477 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.386+0000 7f8866800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:18.477 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.386+0000 7f8866800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88601030c0 con 0x7f8860102770 2024-02-28T15:50:18.477 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.387+0000 7f885f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:18.478 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.387+0000 7f885f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33874/0 (socket says 172.21.15.57:33874) 2024-02-28T15:50:18.479 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.387+0000 7f885f400700 1 -- 172.21.15.57:0/413424523 learned_addr learned my addr 172.21.15.57:0/413424523 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:18.479 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.387+0000 7f885f400700 1 -- 172.21.15.57:0/413424523 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860103200 con 0x7f8860102770 2024-02-28T15:50:18.479 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.388+0000 7f885f400700 1 --2- 172.21.15.57:0/413424523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860102b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f88500098e0 tx=0x7f8850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76cdf151ba270c server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:18.480 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.388+0000 7f885e000700 1 -- 172.21.15.57:0/413424523 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f885000b860 con 0x7f8860102770 2024-02-28T15:50:18.480 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.388+0000 7f885e000700 1 -- 172.21.15.57:0/413424523 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f885000be90 con 0x7f8860102770 2024-02-28T15:50:18.480 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.388+0000 7f885e000700 1 -- 172.21.15.57:0/413424523 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88500103c0 con 0x7f8860102770 2024-02-28T15:50:18.480 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.389+0000 7f8866800700 1 -- 172.21.15.57:0/413424523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 msgr2=0x7f8860102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:18.480 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.389+0000 7f8866800700 1 --2- 172.21.15.57:0/413424523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860102b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f88500098e0 tx=0x7f8850009250 comp rx=0 tx=0).stop 2024-02-28T15:50:18.480 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.389+0000 7f8866800700 1 -- 172.21.15.57:0/413424523 shutdown_connections 2024-02-28T15:50:18.482 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.389+0000 7f8866800700 1 --2- 172.21.15.57:0/413424523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860102b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:18.482 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.389+0000 7f8866800700 1 -- 172.21.15.57:0/413424523 >> 172.21.15.57:0/413424523 conn(0x7f88600fded0 msgr2=0x7f8860100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:18.483 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.389+0000 7f8866800700 1 -- 172.21.15.57:0/413424523 shutdown_connections 2024-02-28T15:50:18.483 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.389+0000 7f8866800700 1 -- 172.21.15.57:0/413424523 wait complete. 2024-02-28T15:50:18.483 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.390+0000 7f8866800700 1 Processor -- start 2024-02-28T15:50:18.483 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.390+0000 7f8866800700 1 -- start start 2024-02-28T15:50:18.483 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.390+0000 7f8866800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860111860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:18.483 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.390+0000 7f8866800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8860111da0 con 0x7f8860102770 2024-02-28T15:50:18.483 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.390+0000 7f885f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860111860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:18.483 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.391+0000 7f885f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860111860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33888/0 (socket says 172.21.15.57:33888) 2024-02-28T15:50:18.483 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.391+0000 7f885f400700 1 -- 172.21.15.57:0/2992587786 learned_addr learned my addr 172.21.15.57:0/2992587786 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:18.484 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.391+0000 7f885f400700 1 -- 172.21.15.57:0/2992587786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88500094f0 con 0x7f8860102770 2024-02-28T15:50:18.484 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.391+0000 7f885f400700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860111860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8850006b00 tx=0x7f8850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:18.493 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.391+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88500109a0 con 0x7f8860102770 2024-02-28T15:50:18.493 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.392+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f885001a430 con 0x7f8860102770 2024-02-28T15:50:18.493 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.392+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88500245b0 con 0x7f8860102770 2024-02-28T15:50:18.493 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.392+0000 7f8866800700 1 -- 172.21.15.57:0/2992587786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8860111fa0 con 0x7f8860102770 2024-02-28T15:50:18.493 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.392+0000 7f8866800700 1 -- 172.21.15.57:0/2992587786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8860112c40 con 0x7f8860102770 2024-02-28T15:50:18.493 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.393+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f885001aaa0 con 0x7f8860102770 2024-02-28T15:50:18.493 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.393+0000 7f8857400700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 0x7f8844038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:18.494 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.393+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 --> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88440393f0 con 0x7f8844036830 2024-02-28T15:50:18.494 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.393+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f885004a7a0 con 0x7f8860102770 2024-02-28T15:50:18.494 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.394+0000 7f885ea00700 1 -- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 msgr2=0x7f8844038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3389594762 2024-02-28T15:50:18.494 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.394+0000 7f885ea00700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 0x7f8844038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T15:50:18.494 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.595+0000 7f885ea00700 1 -- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 msgr2=0x7f8844038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3389594762 2024-02-28T15:50:18.494 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.595+0000 7f885ea00700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 0x7f8844038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T15:50:18.494 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.996+0000 7f885ea00700 1 -- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 msgr2=0x7f8844038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3389594762 2024-02-28T15:50:18.494 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:10.996+0000 7f885ea00700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 0x7f8844038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-28T15:50:18.494 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:11.797+0000 7f885ea00700 1 -- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 msgr2=0x7f8844038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3389594762 2024-02-28T15:50:18.495 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:11.797+0000 7f885ea00700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 0x7f8844038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-28T15:50:18.495 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:13.399+0000 7f885ea00700 1 -- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 msgr2=0x7f8844038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3389594762 2024-02-28T15:50:18.495 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:13.399+0000 7f885ea00700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 0x7f8844038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-28T15:50:18.495 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:16.198+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mgrmap(e 10) v1 ==== 43148+0+0 (secure 0 0 0) 0x7f8850010b00 con 0x7f8860102770 2024-02-28T15:50:18.495 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:16.198+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 msgr2=0x7f8844038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T15:50:18.495 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:16.198+0000 7f8857400700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 0x7f8844038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:18.495 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.203+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7f885000ed00 con 0x7f8860102770 2024-02-28T15:50:18.495 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.203+0000 7f8857400700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f884403a070 0x7f884403c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:18.495 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.203+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 --> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88440393f0 con 0x7f884403a070 2024-02-28T15:50:18.495 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.204+0000 7f885ea00700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f884403a070 0x7f884403c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:18.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.206+0000 7f885ea00700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f884403a070 0x7f884403c450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f884c0039d0 tx=0x7f884c009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:18.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.207+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 <== mgr.14162 v2:172.21.15.57:6800/4162336432 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f88440393f0 con 0x7f884403a070 2024-02-28T15:50:18.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.214+0000 7f8866800700 1 -- 172.21.15.57:0/2992587786 --> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8860112430 con 0x7f884403a070 2024-02-28T15:50:18.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.215+0000 7f8857400700 1 -- 172.21.15.57:0/2992587786 <== mgr.14162 v2:172.21.15.57:6800/4162336432 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f8860112430 con 0x7f884403a070 2024-02-28T15:50:18.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.215+0000 7f8866800700 1 -- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f884403a070 msgr2=0x7f884403c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:18.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.215+0000 7f8866800700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f884403a070 0x7f884403c450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f884c0039d0 tx=0x7f884c009350 comp rx=0 tx=0).stop 2024-02-28T15:50:18.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.216+0000 7f8866800700 1 -- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 msgr2=0x7f8860111860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:18.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.216+0000 7f8866800700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860111860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8850006b00 tx=0x7f8850009250 comp rx=0 tx=0).stop 2024-02-28T15:50:18.496 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.216+0000 7f8866800700 1 -- 172.21.15.57:0/2992587786 shutdown_connections 2024-02-28T15:50:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.216+0000 7f8866800700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f884403a070 0x7f884403c450 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.216+0000 7f8866800700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8860102770 0x7f8860111860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.216+0000 7f8866800700 1 --2- 172.21.15.57:0/2992587786 >> [v2:172.21.15.57:6800/3389594762,v1:172.21.15.57:6801/3389594762] conn(0x7f8844036830 0x7f8844038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.216+0000 7f8866800700 1 -- 172.21.15.57:0/2992587786 >> 172.21.15.57:0/2992587786 conn(0x7f88600fded0 msgr2=0x7f88600fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.216+0000 7f8866800700 1 -- 172.21.15.57:0/2992587786 shutdown_connections 2024-02-28T15:50:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:17.216+0000 7f8866800700 1 -- 172.21.15.57:0/2992587786 wait complete. 2024-02-28T15:50:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:mgr epoch 9 is available 2024-02-28T15:50:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:Generating a dashboard self-signed certificate... 2024-02-28T15:50:20.154 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:20 smithi057 ceph-mon[28763]: mgrmap e12: smithi057.upqerc(active, since 2s) 2024-02-28T15:50:20.154 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:20 smithi057 ceph-mon[28763]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:50:20.154 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:20 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:20.154 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:20 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:20.154 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:20 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:20.173 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-28T15:50:20.173 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.162+0000 7f13d4a00700 1 Processor -- start 2024-02-28T15:50:20.173 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.162+0000 7f13d4a00700 1 -- start start 2024-02-28T15:50:20.173 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.162+0000 7f13d4a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0104d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:20.173 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.162+0000 7f13d4a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d01052b0 con 0x7f13d0104960 2024-02-28T15:50:20.173 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.163+0000 7f13cde00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0104d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:20.173 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.163+0000 7f13cde00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0104d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47876/0 (socket says 172.21.15.57:47876) 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.163+0000 7f13cde00700 1 -- 172.21.15.57:0/2224110956 learned_addr learned my addr 172.21.15.57:0/2224110956 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.163+0000 7f13cde00700 1 -- 172.21.15.57:0/2224110956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d01053f0 con 0x7f13d0104960 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.163+0000 7f13cde00700 1 --2- 172.21.15.57:0/2224110956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0104d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13c00098e0 tx=0x7f13c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d633af7c5de60ac server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.164+0000 7f13cca00700 1 -- 172.21.15.57:0/2224110956 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13c000b860 con 0x7f13d0104960 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.164+0000 7f13cca00700 1 -- 172.21.15.57:0/2224110956 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13c000be90 con 0x7f13d0104960 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.164+0000 7f13cca00700 1 -- 172.21.15.57:0/2224110956 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13c00103c0 con 0x7f13d0104960 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.164+0000 7f13d4a00700 1 -- 172.21.15.57:0/2224110956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 msgr2=0x7f13d0104d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.164+0000 7f13d4a00700 1 --2- 172.21.15.57:0/2224110956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0104d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13c00098e0 tx=0x7f13c0009250 comp rx=0 tx=0).stop 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.165+0000 7f13d4a00700 1 -- 172.21.15.57:0/2224110956 shutdown_connections 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.165+0000 7f13d4a00700 1 --2- 172.21.15.57:0/2224110956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0104d70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.165+0000 7f13d4a00700 1 -- 172.21.15.57:0/2224110956 >> 172.21.15.57:0/2224110956 conn(0x7f13d0100340 msgr2=0x7f13d0102720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.165+0000 7f13d4a00700 1 -- 172.21.15.57:0/2224110956 shutdown_connections 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.165+0000 7f13d4a00700 1 -- 172.21.15.57:0/2224110956 wait complete. 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.166+0000 7f13d4a00700 1 Processor -- start 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.166+0000 7f13d4a00700 1 -- start start 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.166+0000 7f13d4a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.166+0000 7f13d4a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0113fa0 con 0x7f13d0104960 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.166+0000 7f13cde00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.167+0000 7f13cde00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47880/0 (socket says 172.21.15.57:47880) 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.167+0000 7f13cde00700 1 -- 172.21.15.57:0/4235377711 learned_addr learned my addr 172.21.15.57:0/4235377711 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.167+0000 7f13cde00700 1 -- 172.21.15.57:0/4235377711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00094f0 con 0x7f13d0104960 2024-02-28T15:50:20.180 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.167+0000 7f13cde00700 1 --2- 172.21.15.57:0/4235377711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0113a60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13c0006b00 tx=0x7f13c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.167+0000 7f13c6000700 1 -- 172.21.15.57:0/4235377711 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13c00109a0 con 0x7f13d0104960 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.168+0000 7f13c6000700 1 -- 172.21.15.57:0/4235377711 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13c001a430 con 0x7f13d0104960 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.168+0000 7f13d4a00700 1 -- 172.21.15.57:0/4235377711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d01141a0 con 0x7f13d0104960 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.168+0000 7f13c6000700 1 -- 172.21.15.57:0/4235377711 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13c00245b0 con 0x7f13d0104960 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.168+0000 7f13d4a00700 1 -- 172.21.15.57:0/4235377711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d0114e40 con 0x7f13d0104960 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.169+0000 7f13c6000700 1 -- 172.21.15.57:0/4235377711 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f13c0024870 con 0x7f13d0104960 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.169+0000 7f13d4a00700 1 -- 172.21.15.57:0/4235377711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d005f5c0 con 0x7f13d0104960 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.169+0000 7f13c6000700 1 --2- 172.21.15.57:0/4235377711 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f13b4036830 0x7f13b4038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.170+0000 7f13c6000700 1 -- 172.21.15.57:0/4235377711 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f13c004a8c0 con 0x7f13d0104960 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.170+0000 7f13cd400700 1 --2- 172.21.15.57:0/4235377711 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f13b4036830 0x7f13b4038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.171+0000 7f13cd400700 1 --2- 172.21.15.57:0/4235377711 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f13b4036830 0x7f13b4038ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009990 tx=0x7f13bc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.175+0000 7f13c6000700 1 -- 172.21.15.57:0/4235377711 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f13c0018940 con 0x7f13d0104960 2024-02-28T15:50:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.395+0000 7f13d4a00700 1 -- 172.21.15.57:0/4235377711 --> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f13d0106910 con 0x7f13b4036830 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.486+0000 7f13c6000700 1 -- 172.21.15.57:0/4235377711 <== mgr.14162 v2:172.21.15.57:6800/4162336432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f13d0106910 con 0x7f13b4036830 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.489+0000 7f13d4a00700 1 -- 172.21.15.57:0/4235377711 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f13b4036830 msgr2=0x7f13b4038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.489+0000 7f13d4a00700 1 --2- 172.21.15.57:0/4235377711 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f13b4036830 0x7f13b4038ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009990 tx=0x7f13bc006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.489+0000 7f13d4a00700 1 -- 172.21.15.57:0/4235377711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 msgr2=0x7f13d0113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.489+0000 7f13d4a00700 1 --2- 172.21.15.57:0/4235377711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0113a60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13c0006b00 tx=0x7f13c0009250 comp rx=0 tx=0).stop 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.489+0000 7f13d4a00700 1 -- 172.21.15.57:0/4235377711 shutdown_connections 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.489+0000 7f13d4a00700 1 --2- 172.21.15.57:0/4235377711 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f13b4036830 0x7f13b4038ce0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.489+0000 7f13d4a00700 1 --2- 172.21.15.57:0/4235377711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13d0104960 0x7f13d0113a60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.489+0000 7f13d4a00700 1 -- 172.21.15.57:0/4235377711 >> 172.21.15.57:0/4235377711 conn(0x7f13d0100340 msgr2=0x7f13d01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.490+0000 7f13d4a00700 1 -- 172.21.15.57:0/4235377711 shutdown_connections 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:19.490+0000 7f13d4a00700 1 -- 172.21.15.57:0/4235377711 wait complete. 2024-02-28T15:50:20.182 INFO:teuthology.orchestra.run.smithi057.stdout:Creating initial admin user... 2024-02-28T15:50:22.197 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$AXB6iEAifgGCRixGH/QF6.ZF1Y9ZyPuq6UNyCq.QSq.GEOaSH9PHO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1709135421, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-28T15:50:22.197 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.776+0000 7fa10e000700 1 Processor -- start 2024-02-28T15:50:22.197 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.777+0000 7fa10e000700 1 -- start start 2024-02-28T15:50:22.197 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.777+0000 7fa10e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:22.197 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.777+0000 7fa10e000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1081030d0 con 0x7fa108102780 2024-02-28T15:50:22.197 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.778+0000 7fa107400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:22.197 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.778+0000 7fa107400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47892/0 (socket says 172.21.15.57:47892) 2024-02-28T15:50:22.197 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.778+0000 7fa107400700 1 -- 172.21.15.57:0/1937970355 learned_addr learned my addr 172.21.15.57:0/1937970355 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:22.197 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.779+0000 7fa107400700 1 -- 172.21.15.57:0/1937970355 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa108103210 con 0x7fa108102780 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.779+0000 7fa107400700 1 --2- 172.21.15.57:0/1937970355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108102b90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80098e0 tx=0x7fa0f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467c7cdc13e1fa7e server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.780+0000 7fa106000700 1 -- 172.21.15.57:0/1937970355 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0f800b860 con 0x7fa108102780 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.780+0000 7fa106000700 1 -- 172.21.15.57:0/1937970355 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0f800be90 con 0x7fa108102780 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.780+0000 7fa106000700 1 -- 172.21.15.57:0/1937970355 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0f80103c0 con 0x7fa108102780 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.780+0000 7fa10e000700 1 -- 172.21.15.57:0/1937970355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 msgr2=0x7fa108102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.780+0000 7fa10e000700 1 --2- 172.21.15.57:0/1937970355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108102b90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80098e0 tx=0x7fa0f8009250 comp rx=0 tx=0).stop 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.781+0000 7fa10e000700 1 -- 172.21.15.57:0/1937970355 shutdown_connections 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.781+0000 7fa10e000700 1 --2- 172.21.15.57:0/1937970355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108102b90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.781+0000 7fa10e000700 1 -- 172.21.15.57:0/1937970355 >> 172.21.15.57:0/1937970355 conn(0x7fa1080fdf00 msgr2=0x7fa108100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.781+0000 7fa10e000700 1 -- 172.21.15.57:0/1937970355 shutdown_connections 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.781+0000 7fa10e000700 1 -- 172.21.15.57:0/1937970355 wait complete. 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.782+0000 7fa10e000700 1 Processor -- start 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.782+0000 7fa10e000700 1 -- start start 2024-02-28T15:50:22.198 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.782+0000 7fa10e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.782+0000 7fa10e000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa108077190 con 0x7fa108102780 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.782+0000 7fa107400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.782+0000 7fa107400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47902/0 (socket says 172.21.15.57:47902) 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.782+0000 7fa107400700 1 -- 172.21.15.57:0/2014650409 learned_addr learned my addr 172.21.15.57:0/2014650409 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.783+0000 7fa107400700 1 -- 172.21.15.57:0/2014650409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f80094f0 con 0x7fa108102780 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.783+0000 7fa107400700 1 --2- 172.21.15.57:0/2014650409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108078d10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80090b0 tx=0x7fa0f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.783+0000 7fa0ff400700 1 -- 172.21.15.57:0/2014650409 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0f8010840 con 0x7fa108102780 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.783+0000 7fa0ff400700 1 -- 172.21.15.57:0/2014650409 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0f8010e70 con 0x7fa108102780 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.783+0000 7fa10e000700 1 -- 172.21.15.57:0/2014650409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa108077390 con 0x7fa108102780 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.783+0000 7fa0ff400700 1 -- 172.21.15.57:0/2014650409 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0f8024e40 con 0x7fa108102780 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.784+0000 7fa10e000700 1 -- 172.21.15.57:0/2014650409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa108077820 con 0x7fa108102780 2024-02-28T15:50:22.199 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.785+0000 7fa0ff400700 1 -- 172.21.15.57:0/2014650409 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fa0f80109a0 con 0x7fa108102780 2024-02-28T15:50:22.200 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.785+0000 7fa10e000700 1 -- 172.21.15.57:0/2014650409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10804bed0 con 0x7fa108102780 2024-02-28T15:50:22.200 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.785+0000 7fa0ff400700 1 --2- 172.21.15.57:0/2014650409 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa0ec0367e0 0x7fa0ec038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:22.200 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.785+0000 7fa0ff400700 1 -- 172.21.15.57:0/2014650409 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa0f804a960 con 0x7fa108102780 2024-02-28T15:50:22.200 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.786+0000 7fa106a00700 1 --2- 172.21.15.57:0/2014650409 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa0ec0367e0 0x7fa0ec038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:22.200 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.787+0000 7fa106a00700 1 --2- 172.21.15.57:0/2014650409 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa0ec0367e0 0x7fa0ec038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009990 tx=0x7fa0f4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:22.200 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:20.791+0000 7fa0ff400700 1 -- 172.21.15.57:0/2014650409 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa0f802e440 con 0x7fa108102780 2024-02-28T15:50:22.200 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.025+0000 7fa10e000700 1 -- 172.21.15.57:0/2014650409 --> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa10805f3e0 con 0x7fa0ec0367e0 2024-02-28T15:50:22.200 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.287+0000 7fa0ff400700 1 -- 172.21.15.57:0/2014650409 <== mgr.14162 v2:172.21.15.57:6800/4162336432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fa10805f3e0 con 0x7fa0ec0367e0 2024-02-28T15:50:22.200 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.292+0000 7fa10e000700 1 -- 172.21.15.57:0/2014650409 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa0ec0367e0 msgr2=0x7fa0ec038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:22.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.292+0000 7fa10e000700 1 --2- 172.21.15.57:0/2014650409 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa0ec0367e0 0x7fa0ec038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009990 tx=0x7fa0f4006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:22.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.292+0000 7fa10e000700 1 -- 172.21.15.57:0/2014650409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 msgr2=0x7fa108078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:22.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.292+0000 7fa10e000700 1 --2- 172.21.15.57:0/2014650409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108078d10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80090b0 tx=0x7fa0f8009250 comp rx=0 tx=0).stop 2024-02-28T15:50:22.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.292+0000 7fa10e000700 1 -- 172.21.15.57:0/2014650409 shutdown_connections 2024-02-28T15:50:22.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.292+0000 7fa10e000700 1 --2- 172.21.15.57:0/2014650409 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa0ec0367e0 0x7fa0ec038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:22.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.292+0000 7fa10e000700 1 --2- 172.21.15.57:0/2014650409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108102780 0x7fa108078d10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:22.202 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.292+0000 7fa10e000700 1 -- 172.21.15.57:0/2014650409 >> 172.21.15.57:0/2014650409 conn(0x7fa1080fdf00 msgr2=0x7fa1080ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:22.202 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.292+0000 7fa10e000700 1 -- 172.21.15.57:0/2014650409 shutdown_connections 2024-02-28T15:50:22.202 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:21.292+0000 7fa10e000700 1 -- 172.21.15.57:0/2014650409 wait complete. 2024-02-28T15:50:22.202 INFO:teuthology.orchestra.run.smithi057.stdout:Fetching dashboard port number... 2024-02-28T15:50:22.454 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:22 smithi057 ceph-mon[28763]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:50:22.454 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:22 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:23.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:23 smithi057 ceph-mon[28763]: mgrmap e13: smithi057.upqerc(active, since 6s) 2024-02-28T15:50:24.176 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 8443 2024-02-28T15:50:24.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.240+0000 7f191ce00700 1 Processor -- start 2024-02-28T15:50:24.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.240+0000 7f191ce00700 1 -- start start 2024-02-28T15:50:24.181 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.240+0000 7f191ce00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.240+0000 7f191ce00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918079130 con 0x7f1918078d20 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.241+0000 7f1915e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.241+0000 7f1915e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51580/0 (socket says 172.21.15.57:51580) 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.241+0000 7f1915e00700 1 -- 172.21.15.57:0/173470077 learned_addr learned my addr 172.21.15.57:0/173470077 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.242+0000 7f1915e00700 1 -- 172.21.15.57:0/173470077 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1918077770 con 0x7f1918078d20 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.242+0000 7f1915e00700 1 --2- 172.21.15.57:0/173470077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918077230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19080098e0 tx=0x7f1908009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bc10d75cfb78a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.242+0000 7f1914a00700 1 -- 172.21.15.57:0/173470077 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f190800b860 con 0x7f1918078d20 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.242+0000 7f1914a00700 1 -- 172.21.15.57:0/173470077 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f190800be90 con 0x7f1918078d20 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.242+0000 7f1914a00700 1 -- 172.21.15.57:0/173470077 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19080103c0 con 0x7f1918078d20 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.243+0000 7f191ce00700 1 -- 172.21.15.57:0/173470077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 msgr2=0x7f1918077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.243+0000 7f191ce00700 1 --2- 172.21.15.57:0/173470077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918077230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19080098e0 tx=0x7f1908009250 comp rx=0 tx=0).stop 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.243+0000 7f191ce00700 1 -- 172.21.15.57:0/173470077 shutdown_connections 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.243+0000 7f191ce00700 1 --2- 172.21.15.57:0/173470077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918077230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:24.182 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.243+0000 7f191ce00700 1 -- 172.21.15.57:0/173470077 >> 172.21.15.57:0/173470077 conn(0x7f19180fdf00 msgr2=0x7f1918100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.243+0000 7f191ce00700 1 -- 172.21.15.57:0/173470077 shutdown_connections 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.243+0000 7f191ce00700 1 -- 172.21.15.57:0/173470077 wait complete. 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.244+0000 7f191ce00700 1 Processor -- start 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.244+0000 7f191ce00700 1 -- start start 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.244+0000 7f191ce00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918117cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.244+0000 7f191ce00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918118210 con 0x7f1918078d20 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.245+0000 7f1915e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918117cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.245+0000 7f1915e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918117cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51584/0 (socket says 172.21.15.57:51584) 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.245+0000 7f1915e00700 1 -- 172.21.15.57:0/1957585068 learned_addr learned my addr 172.21.15.57:0/1957585068 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.245+0000 7f1915e00700 1 -- 172.21.15.57:0/1957585068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080094f0 con 0x7f1918078d20 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.246+0000 7f1915e00700 1 --2- 172.21.15.57:0/1957585068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918117cd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1908006fd0 tx=0x7f1908009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.246+0000 7f190e000700 1 -- 172.21.15.57:0/1957585068 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1908010630 con 0x7f1918078d20 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.246+0000 7f190e000700 1 -- 172.21.15.57:0/1957585068 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1908010c60 con 0x7f1918078d20 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.246+0000 7f190e000700 1 -- 172.21.15.57:0/1957585068 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f190801ad40 con 0x7f1918078d20 2024-02-28T15:50:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.246+0000 7f191ce00700 1 -- 172.21.15.57:0/1957585068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1918118410 con 0x7f1918078d20 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.246+0000 7f191ce00700 1 -- 172.21.15.57:0/1957585068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1918118f70 con 0x7f1918078d20 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.247+0000 7f190e000700 1 -- 172.21.15.57:0/1957585068 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f190801a5f0 con 0x7f1918078d20 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.247+0000 7f191ce00700 1 -- 172.21.15.57:0/1957585068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191805f5c0 con 0x7f1918078d20 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.248+0000 7f190e000700 1 --2- 172.21.15.57:0/1957585068 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f18fc036920 0x7f18fc038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.248+0000 7f190e000700 1 -- 172.21.15.57:0/1957585068 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f190804a1c0 con 0x7f1918078d20 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.248+0000 7f1915400700 1 --2- 172.21.15.57:0/1957585068 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f18fc036920 0x7f18fc038dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.249+0000 7f1915400700 1 --2- 172.21.15.57:0/1957585068 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f18fc036920 0x7f18fc038dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1904009990 tx=0x7f1904006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.254+0000 7f190e000700 1 -- 172.21.15.57:0/1957585068 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1908023950 con 0x7f1918078d20 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.467+0000 7f191ce00700 1 -- 172.21.15.57:0/1957585068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f191804bed0 con 0x7f1918078d20 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.468+0000 7f190e000700 1 -- 172.21.15.57:0/1957585068 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f1908020030 con 0x7f1918078d20 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.471+0000 7f191ce00700 1 -- 172.21.15.57:0/1957585068 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f18fc036920 msgr2=0x7f18fc038dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.471+0000 7f191ce00700 1 --2- 172.21.15.57:0/1957585068 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f18fc036920 0x7f18fc038dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1904009990 tx=0x7f1904006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:24.184 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.471+0000 7f191ce00700 1 -- 172.21.15.57:0/1957585068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 msgr2=0x7f1918117cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:24.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.471+0000 7f191ce00700 1 --2- 172.21.15.57:0/1957585068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918117cd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1908006fd0 tx=0x7f1908009250 comp rx=0 tx=0).stop 2024-02-28T15:50:24.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.471+0000 7f191ce00700 1 -- 172.21.15.57:0/1957585068 shutdown_connections 2024-02-28T15:50:24.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.471+0000 7f191ce00700 1 --2- 172.21.15.57:0/1957585068 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f18fc036920 0x7f18fc038dd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:24.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.471+0000 7f191ce00700 1 --2- 172.21.15.57:0/1957585068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918078d20 0x7f1918117cd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:24.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.471+0000 7f191ce00700 1 -- 172.21.15.57:0/1957585068 >> 172.21.15.57:0/1957585068 conn(0x7f19180fdf00 msgr2=0x7f19181002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:24.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.471+0000 7f191ce00700 1 -- 172.21.15.57:0/1957585068 shutdown_connections 2024-02-28T15:50:24.185 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:23.471+0000 7f191ce00700 1 -- 172.21.15.57:0/1957585068 wait complete. 2024-02-28T15:50:24.213 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T15:50:24.213 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout disabled 2024-02-28T15:50:24.236 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T15:50:24.236 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2024-02-28T15:50:24.236 INFO:teuthology.orchestra.run.smithi057.stdout:firewalld.service is not enabled 2024-02-28T15:50:24.236 INFO:teuthology.orchestra.run.smithi057.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-28T15:50:24.244 INFO:teuthology.orchestra.run.smithi057.stdout:Ceph Dashboard is now available at: 2024-02-28T15:50:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: URL: https://smithi057.front.sepia.ceph.com:8443/ 2024-02-28T15:50:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: User: admin 2024-02-28T15:50:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: Password: rcztifs7y6 2024-02-28T15:50:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:24.245 INFO:teuthology.orchestra.run.smithi057.stdout:Saving cluster configuration to /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config directory 2024-02-28T15:50:24.247 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling autotune for osd_memory_target 2024-02-28T15:50:24.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:24 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1957585068' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-28T15:50:25.736 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.907+0000 7f9df0000700 1 Processor -- start 2024-02-28T15:50:25.736 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.907+0000 7f9df0000700 1 -- start start 2024-02-28T15:50:25.736 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.907+0000 7f9df0000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8104d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:25.736 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.908+0000 7f9df0000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de81052b0 con 0x7f9de8104960 2024-02-28T15:50:25.736 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.908+0000 7f9ded600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8104d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:25.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.908+0000 7f9ded600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8104d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51594/0 (socket says 172.21.15.57:51594) 2024-02-28T15:50:25.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.908+0000 7f9ded600700 1 -- 172.21.15.57:0/497510523 learned_addr learned my addr 172.21.15.57:0/497510523 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:25.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.909+0000 7f9ded600700 1 -- 172.21.15.57:0/497510523 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de81053f0 con 0x7f9de8104960 2024-02-28T15:50:25.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.909+0000 7f9ded600700 1 --2- 172.21.15.57:0/497510523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8104d70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009e50 tx=0x7f9ddc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9761c586ca93cb1 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:25.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.909+0000 7f9de7e00700 1 -- 172.21.15.57:0/497510523 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ddc0092e0 con 0x7f9de8104960 2024-02-28T15:50:25.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.909+0000 7f9de7e00700 1 -- 172.21.15.57:0/497510523 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ddc012430 con 0x7f9de8104960 2024-02-28T15:50:25.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.909+0000 7f9de7e00700 1 -- 172.21.15.57:0/497510523 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ddc0075a0 con 0x7f9de8104960 2024-02-28T15:50:25.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.910+0000 7f9df0000700 1 -- 172.21.15.57:0/497510523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 msgr2=0x7f9de8104d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:25.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.910+0000 7f9df0000700 1 --2- 172.21.15.57:0/497510523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8104d70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009e50 tx=0x7f9ddc009840 comp rx=0 tx=0).stop 2024-02-28T15:50:25.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.910+0000 7f9df0000700 1 -- 172.21.15.57:0/497510523 shutdown_connections 2024-02-28T15:50:25.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.910+0000 7f9df0000700 1 --2- 172.21.15.57:0/497510523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8104d70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:25.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.910+0000 7f9df0000700 1 -- 172.21.15.57:0/497510523 >> 172.21.15.57:0/497510523 conn(0x7f9de8100340 msgr2=0x7f9de8102720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:25.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.910+0000 7f9df0000700 1 -- 172.21.15.57:0/497510523 shutdown_connections 2024-02-28T15:50:25.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.910+0000 7f9df0000700 1 -- 172.21.15.57:0/497510523 wait complete. 2024-02-28T15:50:25.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.911+0000 7f9df0000700 1 Processor -- start 2024-02-28T15:50:25.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.911+0000 7f9df0000700 1 -- start start 2024-02-28T15:50:25.738 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.912+0000 7f9df0000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:25.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.912+0000 7f9df0000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de8113ff0 con 0x7f9de8104960 2024-02-28T15:50:25.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.912+0000 7f9ded600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:25.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.912+0000 7f9ded600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51602/0 (socket says 172.21.15.57:51602) 2024-02-28T15:50:25.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.912+0000 7f9ded600700 1 -- 172.21.15.57:0/2585495809 learned_addr learned my addr 172.21.15.57:0/2585495809 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:25.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.913+0000 7f9ded600700 1 -- 172.21.15.57:0/2585495809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc009ae0 con 0x7f9de8104960 2024-02-28T15:50:25.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.913+0000 7f9ded600700 1 --2- 172.21.15.57:0/2585495809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8113ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc012800 tx=0x7f9ddc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:25.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.913+0000 7f9de5600700 1 -- 172.21.15.57:0/2585495809 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ddc00bc30 con 0x7f9de8104960 2024-02-28T15:50:25.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.913+0000 7f9de5600700 1 -- 172.21.15.57:0/2585495809 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ddc00bd90 con 0x7f9de8104960 2024-02-28T15:50:25.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.913+0000 7f9de5600700 1 -- 172.21.15.57:0/2585495809 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ddc025aa0 con 0x7f9de8104960 2024-02-28T15:50:25.739 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.913+0000 7f9df0000700 1 -- 172.21.15.57:0/2585495809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de81141f0 con 0x7f9de8104960 2024-02-28T15:50:25.740 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.913+0000 7f9df0000700 1 -- 172.21.15.57:0/2585495809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de8114e90 con 0x7f9de8104960 2024-02-28T15:50:25.740 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.914+0000 7f9de5600700 1 -- 172.21.15.57:0/2585495809 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f9ddc019050 con 0x7f9de8104960 2024-02-28T15:50:25.740 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.914+0000 7f9df0000700 1 -- 172.21.15.57:0/2585495809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de805f5c0 con 0x7f9de8104960 2024-02-28T15:50:25.740 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.915+0000 7f9de5600700 1 --2- 172.21.15.57:0/2585495809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9dd00368d0 0x7f9dd0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:25.740 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.915+0000 7f9de5600700 1 -- 172.21.15.57:0/2585495809 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9ddc04a4c0 con 0x7f9de8104960 2024-02-28T15:50:25.740 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.915+0000 7f9decc00700 1 --2- 172.21.15.57:0/2585495809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9dd00368d0 0x7f9dd0038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:25.740 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.916+0000 7f9decc00700 1 --2- 172.21.15.57:0/2585495809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9dd00368d0 0x7f9dd0038d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009990 tx=0x7f9dd4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:25.740 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:24.921+0000 7f9de5600700 1 -- 172.21.15.57:0/2585495809 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9ddc007810 con 0x7f9de8104960 2024-02-28T15:50:25.740 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.132+0000 7f9df0000700 1 -- 172.21.15.57:0/2585495809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f9de81068b0 con 0x7f9de8104960 2024-02-28T15:50:25.741 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.133+0000 7f9de5600700 1 -- 172.21.15.57:0/2585495809 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f9ddc020020 con 0x7f9de8104960 2024-02-28T15:50:25.741 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.136+0000 7f9df0000700 1 -- 172.21.15.57:0/2585495809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9dd00368d0 msgr2=0x7f9dd0038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:25.741 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.136+0000 7f9df0000700 1 --2- 172.21.15.57:0/2585495809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9dd00368d0 0x7f9dd0038d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009990 tx=0x7f9dd4006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:25.741 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.136+0000 7f9df0000700 1 -- 172.21.15.57:0/2585495809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 msgr2=0x7f9de8113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:25.741 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.136+0000 7f9df0000700 1 --2- 172.21.15.57:0/2585495809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8113ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc012800 tx=0x7f9ddc009840 comp rx=0 tx=0).stop 2024-02-28T15:50:25.741 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.136+0000 7f9df0000700 1 -- 172.21.15.57:0/2585495809 shutdown_connections 2024-02-28T15:50:25.741 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.136+0000 7f9df0000700 1 --2- 172.21.15.57:0/2585495809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9dd00368d0 0x7f9dd0038d80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:25.741 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.136+0000 7f9df0000700 1 --2- 172.21.15.57:0/2585495809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de8104960 0x7f9de8113ab0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:25.742 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.136+0000 7f9df0000700 1 -- 172.21.15.57:0/2585495809 >> 172.21.15.57:0/2585495809 conn(0x7f9de8100340 msgr2=0x7f9de8103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:25.742 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.136+0000 7f9df0000700 1 -- 172.21.15.57:0/2585495809 shutdown_connections 2024-02-28T15:50:25.742 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:25.136+0000 7f9df0000700 1 -- 172.21.15.57:0/2585495809 wait complete. 2024-02-28T15:50:27.449 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.322+0000 7fe7df800700 1 Processor -- start 2024-02-28T15:50:27.449 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.322+0000 7fe7df800700 1 -- start start 2024-02-28T15:50:27.450 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.323+0000 7fe7df800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:27.450 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.323+0000 7fe7df800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d8077fc0 con 0x7fe7d8077bb0 2024-02-28T15:50:27.450 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.323+0000 7fe7dce00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:27.450 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.323+0000 7fe7dce00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51604/0 (socket says 172.21.15.57:51604) 2024-02-28T15:50:27.450 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.324+0000 7fe7dce00700 1 -- 172.21.15.57:0/1118363855 learned_addr learned my addr 172.21.15.57:0/1118363855 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:27.450 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.324+0000 7fe7dce00700 1 -- 172.21.15.57:0/1118363855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8076600 con 0x7fe7d8077bb0 2024-02-28T15:50:27.452 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.324+0000 7fe7dce00700 1 --2- 172.21.15.57:0/1118363855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d80760c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0098e0 tx=0x7fe7cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f028d922d2ef7599 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:27.452 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.324+0000 7fe7d7400700 1 -- 172.21.15.57:0/1118363855 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7cc00b860 con 0x7fe7d8077bb0 2024-02-28T15:50:27.452 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.325+0000 7fe7d7400700 1 -- 172.21.15.57:0/1118363855 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7cc00be90 con 0x7fe7d8077bb0 2024-02-28T15:50:27.452 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.325+0000 7fe7d7400700 1 -- 172.21.15.57:0/1118363855 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7cc0103c0 con 0x7fe7d8077bb0 2024-02-28T15:50:27.452 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.325+0000 7fe7df800700 1 -- 172.21.15.57:0/1118363855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 msgr2=0x7fe7d80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:27.452 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.325+0000 7fe7df800700 1 --2- 172.21.15.57:0/1118363855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d80760c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0098e0 tx=0x7fe7cc009250 comp rx=0 tx=0).stop 2024-02-28T15:50:27.452 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.325+0000 7fe7df800700 1 -- 172.21.15.57:0/1118363855 shutdown_connections 2024-02-28T15:50:27.452 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.325+0000 7fe7df800700 1 --2- 172.21.15.57:0/1118363855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d80760c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:27.453 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.325+0000 7fe7df800700 1 -- 172.21.15.57:0/1118363855 >> 172.21.15.57:0/1118363855 conn(0x7fe7d80fded0 msgr2=0x7fe7d8100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:27.453 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.326+0000 7fe7df800700 1 -- 172.21.15.57:0/1118363855 shutdown_connections 2024-02-28T15:50:27.455 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.326+0000 7fe7df800700 1 -- 172.21.15.57:0/1118363855 wait complete. 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.327+0000 7fe7df800700 1 Processor -- start 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.327+0000 7fe7df800700 1 -- start start 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.327+0000 7fe7df800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d8113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.327+0000 7fe7df800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d8113fc0 con 0x7fe7d8077bb0 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.328+0000 7fe7dce00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d8113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.328+0000 7fe7dce00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d8113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51610/0 (socket says 172.21.15.57:51610) 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.328+0000 7fe7dce00700 1 -- 172.21.15.57:0/2551439338 learned_addr learned my addr 172.21.15.57:0/2551439338 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.328+0000 7fe7dce00700 1 -- 172.21.15.57:0/2551439338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc0094f0 con 0x7fe7d8077bb0 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.328+0000 7fe7dce00700 1 --2- 172.21.15.57:0/2551439338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d8113a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0090b0 tx=0x7fe7cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.329+0000 7fe7d4c00700 1 -- 172.21.15.57:0/2551439338 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7cc0118f0 con 0x7fe7d8077bb0 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.329+0000 7fe7d4c00700 1 -- 172.21.15.57:0/2551439338 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7cc010d10 con 0x7fe7d8077bb0 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.329+0000 7fe7d4c00700 1 -- 172.21.15.57:0/2551439338 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7cc024e70 con 0x7fe7d8077bb0 2024-02-28T15:50:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.329+0000 7fe7df800700 1 -- 172.21.15.57:0/2551439338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d81141c0 con 0x7fe7d8077bb0 2024-02-28T15:50:27.457 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.329+0000 7fe7df800700 1 -- 172.21.15.57:0/2551439338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d8114e60 con 0x7fe7d8077bb0 2024-02-28T15:50:27.457 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.330+0000 7fe7d4c00700 1 -- 172.21.15.57:0/2551439338 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7fe7cc024440 con 0x7fe7d8077bb0 2024-02-28T15:50:27.457 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.330+0000 7fe7df800700 1 -- 172.21.15.57:0/2551439338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d805f5c0 con 0x7fe7d8077bb0 2024-02-28T15:50:27.457 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.331+0000 7fe7d4c00700 1 --2- 172.21.15.57:0/2551439338 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fe7c0036880 0x7fe7c0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:27.457 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.331+0000 7fe7d4c00700 1 -- 172.21.15.57:0/2551439338 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe7cc04a690 con 0x7fe7d8077bb0 2024-02-28T15:50:27.457 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.331+0000 7fe7d7e00700 1 --2- 172.21.15.57:0/2551439338 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fe7c0036880 0x7fe7c0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:27.457 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.332+0000 7fe7d7e00700 1 --2- 172.21.15.57:0/2551439338 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fe7c0036880 0x7fe7c0038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009990 tx=0x7fe7c4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:27.457 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.336+0000 7fe7d4c00700 1 -- 172.21.15.57:0/2551439338 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe7cc010e80 con 0x7fe7d8077bb0 2024-02-28T15:50:27.457 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.661+0000 7fe7df800700 1 -- 172.21.15.57:0/2551439338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fe7d804bed0 con 0x7fe7d8077bb0 2024-02-28T15:50:27.459 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.666+0000 7fe7d4c00700 1 -- 172.21.15.57:0/2551439338 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fe7cc022340 con 0x7fe7d8077bb0 2024-02-28T15:50:27.459 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.670+0000 7fe7df800700 1 -- 172.21.15.57:0/2551439338 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fe7c0036880 msgr2=0x7fe7c0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:27.459 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.670+0000 7fe7df800700 1 --2- 172.21.15.57:0/2551439338 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fe7c0036880 0x7fe7c0038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009990 tx=0x7fe7c4006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:27.459 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.670+0000 7fe7df800700 1 -- 172.21.15.57:0/2551439338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 msgr2=0x7fe7d8113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:27.459 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.670+0000 7fe7df800700 1 --2- 172.21.15.57:0/2551439338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d8113a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0090b0 tx=0x7fe7cc009250 comp rx=0 tx=0).stop 2024-02-28T15:50:27.459 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.671+0000 7fe7df800700 1 -- 172.21.15.57:0/2551439338 shutdown_connections 2024-02-28T15:50:27.459 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.671+0000 7fe7df800700 1 --2- 172.21.15.57:0/2551439338 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fe7c0036880 0x7fe7c0038d30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:27.459 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.671+0000 7fe7df800700 1 --2- 172.21.15.57:0/2551439338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d8077bb0 0x7fe7d8113a80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:27.459 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.671+0000 7fe7df800700 1 -- 172.21.15.57:0/2551439338 >> 172.21.15.57:0/2551439338 conn(0x7fe7d80fded0 msgr2=0x7fe7d80fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.671+0000 7fe7df800700 1 -- 172.21.15.57:0/2551439338 shutdown_connections 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2024-02-28T15:50:26.671+0000 7fe7df800700 1 -- 172.21.15.57:0/2551439338 wait complete. 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout:Or, if you are only running a single cluster on this host: 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:27.460 INFO:teuthology.orchestra.run.smithi057.stdout: ceph telemetry on 2024-02-28T15:50:27.461 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:27.461 INFO:teuthology.orchestra.run.smithi057.stdout:For more information see: 2024-02-28T15:50:27.461 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:27.461 INFO:teuthology.orchestra.run.smithi057.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-02-28T15:50:27.461 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:27.461 INFO:teuthology.orchestra.run.smithi057.stdout:Bootstrap complete. 2024-02-28T15:50:27.585 INFO:tasks.cephadm:Fetching config... 2024-02-28T15:50:27.586 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:50:27.586 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-28T15:50:27.670 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-28T15:50:27.670 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:50:27.670 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-28T15:50:27.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:27 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2551439338' entity='client.admin' 2024-02-28T15:50:27.726 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-28T15:50:27.726 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:50:27.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/keyring of=/dev/stdout 2024-02-28T15:50:27.867 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-28T15:50:27.867 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:50:27.868 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-28T15:50:27.923 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-28T15:50:27.924 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSJdIWODTOtKqbTbENyUkNq/FUQRvMDJZIJdE3D93RFyyvtNOv9YPqwmvwqnTllJfJWHxGonmMNTbZrZseE5txSEA7eBgTCl1isI/9dudoCsQXQaPJTpAdutjOQK0h6sNH7/MxwSgr+DPzOkKMzj3LcscYQsgANyo99e4aURCniycR6VThhgg336fs97Xxbli2+t/6Nx3Xm+x+HLEMFLvnNQm7ep/jTedqXdNFMWmLEEz7DJ1n4RxIdF/1vrJhDMqG+RV7zUUyjf30CwyFR/Ae2L27uqToWBCkWLsrkw64ONmVm6beNehg01tK+m6n+CBMXV76S+nMcTTPnC9DdZN3FIaPGeFtKKt3E1Qcus57yxKWDU4xMPCO23xIKu1aIOmX5kTPIdmM4fkJppNYeMcEVkqIrPZShipnEePQuWjw0IYNuy+HbD3HypOcp+W3AwptsjkrqhfCh0cfIyUUL/gjy18AZly1CbfUvQpCb0vT2zijPkTt+qppC+ubF8PR+W0= ceph-bf04dacc-d650-11ee-95c3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-28T15:50:28.043 INFO:teuthology.orchestra.run.smithi057.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSJdIWODTOtKqbTbENyUkNq/FUQRvMDJZIJdE3D93RFyyvtNOv9YPqwmvwqnTllJfJWHxGonmMNTbZrZseE5txSEA7eBgTCl1isI/9dudoCsQXQaPJTpAdutjOQK0h6sNH7/MxwSgr+DPzOkKMzj3LcscYQsgANyo99e4aURCniycR6VThhgg336fs97Xxbli2+t/6Nx3Xm+x+HLEMFLvnNQm7ep/jTedqXdNFMWmLEEz7DJ1n4RxIdF/1vrJhDMqG+RV7zUUyjf30CwyFR/Ae2L27uqToWBCkWLsrkw64ONmVm6beNehg01tK+m6n+CBMXV76S+nMcTTPnC9DdZN3FIaPGeFtKKt3E1Qcus57yxKWDU4xMPCO23xIKu1aIOmX5kTPIdmM4fkJppNYeMcEVkqIrPZShipnEePQuWjw0IYNuy+HbD3HypOcp+W3AwptsjkrqhfCh0cfIyUUL/gjy18AZly1CbfUvQpCb0vT2zijPkTt+qppC+ubF8PR+W0= ceph-bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:50:28.102 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSJdIWODTOtKqbTbENyUkNq/FUQRvMDJZIJdE3D93RFyyvtNOv9YPqwmvwqnTllJfJWHxGonmMNTbZrZseE5txSEA7eBgTCl1isI/9dudoCsQXQaPJTpAdutjOQK0h6sNH7/MxwSgr+DPzOkKMzj3LcscYQsgANyo99e4aURCniycR6VThhgg336fs97Xxbli2+t/6Nx3Xm+x+HLEMFLvnNQm7ep/jTedqXdNFMWmLEEz7DJ1n4RxIdF/1vrJhDMqG+RV7zUUyjf30CwyFR/Ae2L27uqToWBCkWLsrkw64ONmVm6beNehg01tK+m6n+CBMXV76S+nMcTTPnC9DdZN3FIaPGeFtKKt3E1Qcus57yxKWDU4xMPCO23xIKu1aIOmX5kTPIdmM4fkJppNYeMcEVkqIrPZShipnEePQuWjw0IYNuy+HbD3HypOcp+W3AwptsjkrqhfCh0cfIyUUL/gjy18AZly1CbfUvQpCb0vT2zijPkTt+qppC+ubF8PR+W0= ceph-bf04dacc-d650-11ee-95c3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-28T15:50:28.238 INFO:teuthology.orchestra.run.smithi087.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSJdIWODTOtKqbTbENyUkNq/FUQRvMDJZIJdE3D93RFyyvtNOv9YPqwmvwqnTllJfJWHxGonmMNTbZrZseE5txSEA7eBgTCl1isI/9dudoCsQXQaPJTpAdutjOQK0h6sNH7/MxwSgr+DPzOkKMzj3LcscYQsgANyo99e4aURCniycR6VThhgg336fs97Xxbli2+t/6Nx3Xm+x+HLEMFLvnNQm7ep/jTedqXdNFMWmLEEz7DJ1n4RxIdF/1vrJhDMqG+RV7zUUyjf30CwyFR/Ae2L27uqToWBCkWLsrkw64ONmVm6beNehg01tK+m6n+CBMXV76S+nMcTTPnC9DdZN3FIaPGeFtKKt3E1Qcus57yxKWDU4xMPCO23xIKu1aIOmX5kTPIdmM4fkJppNYeMcEVkqIrPZShipnEePQuWjw0IYNuy+HbD3HypOcp+W3AwptsjkrqhfCh0cfIyUUL/gjy18AZly1CbfUvQpCb0vT2zijPkTt+qppC+ubF8PR+W0= ceph-bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:50:28.304 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-28T15:50:28.767 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:50:31.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.532+0000 7fbf88200700 1 -- 172.21.15.57:0/2199484306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf800fb4f0 msgr2=0x7fbf800fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:31.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.532+0000 7fbf88200700 1 --2- 172.21.15.57:0/2199484306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf800fb4f0 0x7fbf800fb900 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbf740048c0 tx=0x7fbf74009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:31.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.533+0000 7fbf88200700 1 -- 172.21.15.57:0/2199484306 shutdown_connections 2024-02-28T15:50:31.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.533+0000 7fbf88200700 1 --2- 172.21.15.57:0/2199484306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf800fb4f0 0x7fbf800fb900 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.533+0000 7fbf88200700 1 -- 172.21.15.57:0/2199484306 >> 172.21.15.57:0/2199484306 conn(0x7fbf800f71a0 msgr2=0x7fbf800f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.533+0000 7fbf88200700 1 -- 172.21.15.57:0/2199484306 shutdown_connections 2024-02-28T15:50:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.533+0000 7fbf88200700 1 -- 172.21.15.57:0/2199484306 wait complete. 2024-02-28T15:50:31.530 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:31 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:31.530 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:31 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:31.530 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:31 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:50:31.530 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:31 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:31.530 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:31 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi057", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T15:50:31.530 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:31 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi057", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T15:50:31.530 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:31 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:50:31.531 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:31 smithi057 ceph-mon[28763]: Deploying daemon crash.smithi057 on smithi057 2024-02-28T15:50:31.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.534+0000 7fbf88200700 1 Processor -- start 2024-02-28T15:50:31.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.534+0000 7fbf88200700 1 -- start start 2024-02-28T15:50:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.534+0000 7fbf88200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf800fb4f0 0x7fbf8010f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.535+0000 7fbf88200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8010f610 con 0x7fbf800fb4f0 2024-02-28T15:50:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.535+0000 7fbf85800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf800fb4f0 0x7fbf8010f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.535+0000 7fbf85800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf800fb4f0 0x7fbf8010f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51626/0 (socket says 172.21.15.57:51626) 2024-02-28T15:50:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.535+0000 7fbf85800700 1 -- 172.21.15.57:0/2500566729 learned_addr learned my addr 172.21.15.57:0/2500566729 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.535+0000 7fbf85800700 1 -- 172.21.15.57:0/2500566729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf74005040 con 0x7fbf800fb4f0 2024-02-28T15:50:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.536+0000 7fbf85800700 1 --2- 172.21.15.57:0/2500566729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf800fb4f0 0x7fbf8010f0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009b80 tx=0x7fbf74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.536+0000 7fbf7d600700 1 -- 172.21.15.57:0/2500566729 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf7400b5c0 con 0x7fbf800fb4f0 2024-02-28T15:50:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.536+0000 7fbf7d600700 1 -- 172.21.15.57:0/2500566729 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf7400be70 con 0x7fbf800fb4f0 2024-02-28T15:50:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.536+0000 7fbf88200700 1 -- 172.21.15.57:0/2500566729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8010f810 con 0x7fbf800fb4f0 2024-02-28T15:50:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.536+0000 7fbf7d600700 1 -- 172.21.15.57:0/2500566729 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf7401c660 con 0x7fbf800fb4f0 2024-02-28T15:50:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.536+0000 7fbf88200700 1 -- 172.21.15.57:0/2500566729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf801104b0 con 0x7fbf800fb4f0 2024-02-28T15:50:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.538+0000 7fbf88200700 1 -- 172.21.15.57:0/2500566729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8005f5c0 con 0x7fbf800fb4f0 2024-02-28T15:50:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.538+0000 7fbf7d600700 1 -- 172.21.15.57:0/2500566729 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7fbf7401c7c0 con 0x7fbf800fb4f0 2024-02-28T15:50:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.538+0000 7fbf7d600700 1 --2- 172.21.15.57:0/2500566729 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fbf680368c0 0x7fbf68038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.538+0000 7fbf7d600700 1 -- 172.21.15.57:0/2500566729 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbf74049b90 con 0x7fbf800fb4f0 2024-02-28T15:50:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.539+0000 7fbf84e00700 1 --2- 172.21.15.57:0/2500566729 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fbf680368c0 0x7fbf68038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.539+0000 7fbf84e00700 1 --2- 172.21.15.57:0/2500566729 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fbf680368c0 0x7fbf68038d70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009990 tx=0x7fbf6c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:31.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.544+0000 7fbf7d600700 1 -- 172.21.15.57:0/2500566729 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fbf74011550 con 0x7fbf800fb4f0 2024-02-28T15:50:31.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.765+0000 7fbf88200700 1 -- 172.21.15.57:0/2500566729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fbf8005f5c0 con 0x7fbf800fb4f0 2024-02-28T15:50:31.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.772+0000 7fbf7d600700 1 -- 172.21.15.57:0/2500566729 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbf74011370 con 0x7fbf800fb4f0 2024-02-28T15:50:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.775+0000 7fbf88200700 1 -- 172.21.15.57:0/2500566729 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fbf680368c0 msgr2=0x7fbf68038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.775+0000 7fbf88200700 1 --2- 172.21.15.57:0/2500566729 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fbf680368c0 0x7fbf68038d70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009990 tx=0x7fbf6c006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.775+0000 7fbf88200700 1 -- 172.21.15.57:0/2500566729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf800fb4f0 msgr2=0x7fbf8010f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.775+0000 7fbf88200700 1 --2- 172.21.15.57:0/2500566729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf800fb4f0 0x7fbf8010f0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009b80 tx=0x7fbf74009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.775+0000 7fbf88200700 1 -- 172.21.15.57:0/2500566729 shutdown_connections 2024-02-28T15:50:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.775+0000 7fbf88200700 1 --2- 172.21.15.57:0/2500566729 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fbf680368c0 0x7fbf68038d70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.776+0000 7fbf88200700 1 --2- 172.21.15.57:0/2500566729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf800fb4f0 0x7fbf8010f0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.776+0000 7fbf88200700 1 -- 172.21.15.57:0/2500566729 >> 172.21.15.57:0/2500566729 conn(0x7fbf800f71a0 msgr2=0x7fbf800f7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.776+0000 7fbf88200700 1 -- 172.21.15.57:0/2500566729 shutdown_connections 2024-02-28T15:50:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:31.776+0000 7fbf88200700 1 -- 172.21.15.57:0/2500566729 wait complete. 2024-02-28T15:50:32.562 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-28T15:50:32.562 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-28T15:50:33.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:32 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2500566729' entity='client.admin' 2024-02-28T15:50:33.343 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:50:36.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.456+0000 7f1cbda00700 1 -- 172.21.15.57:0/2290158439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb80fcbd0 msgr2=0x7f1cb80fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:36.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.456+0000 7f1cbda00700 1 --2- 172.21.15.57:0/2290158439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb80fcbd0 0x7f1cb80fcfe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80048c0 tx=0x7f1ca8009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:36.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.456+0000 7f1cbda00700 1 -- 172.21.15.57:0/2290158439 shutdown_connections 2024-02-28T15:50:36.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.456+0000 7f1cbda00700 1 --2- 172.21.15.57:0/2290158439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb80fcbd0 0x7f1cb80fcfe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.456+0000 7f1cbda00700 1 -- 172.21.15.57:0/2290158439 >> 172.21.15.57:0/2290158439 conn(0x7f1cb80f8270 msgr2=0x7f1cb80fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.456+0000 7f1cbda00700 1 -- 172.21.15.57:0/2290158439 shutdown_connections 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.457+0000 7f1cbda00700 1 -- 172.21.15.57:0/2290158439 wait complete. 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.457+0000 7f1cbda00700 1 Processor -- start 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.458+0000 7f1cbda00700 1 -- start start 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.458+0000 7f1cbda00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb810f260 0x7f1cb810f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.458+0000 7f1cbda00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb810fbb0 con 0x7f1cb810f260 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.458+0000 7f1cb6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb810f260 0x7f1cb810f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.458+0000 7f1cb6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb810f260 0x7f1cb810f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46932/0 (socket says 172.21.15.57:46932) 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.458+0000 7f1cb6a00700 1 -- 172.21.15.57:0/1861032541 learned_addr learned my addr 172.21.15.57:0/1861032541 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.459+0000 7f1cb6a00700 1 -- 172.21.15.57:0/1861032541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca8005040 con 0x7f1cb810f260 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.459+0000 7f1cb6a00700 1 --2- 172.21.15.57:0/1861032541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb810f260 0x7f1cb810f670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009b80 tx=0x7f1ca8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.459+0000 7f1caea00700 1 -- 172.21.15.57:0/1861032541 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ca800b5c0 con 0x7f1cb810f260 2024-02-28T15:50:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.459+0000 7f1caea00700 1 -- 172.21.15.57:0/1861032541 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ca8004e60 con 0x7f1cb810f260 2024-02-28T15:50:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.459+0000 7f1caea00700 1 -- 172.21.15.57:0/1861032541 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ca801c5b0 con 0x7f1cb810f260 2024-02-28T15:50:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.459+0000 7f1cbda00700 1 -- 172.21.15.57:0/1861032541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb810fdb0 con 0x7f1cb810f260 2024-02-28T15:50:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.459+0000 7f1cbda00700 1 -- 172.21.15.57:0/1861032541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb81108c0 con 0x7f1cb810f260 2024-02-28T15:50:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.460+0000 7f1caea00700 1 -- 172.21.15.57:0/1861032541 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f1ca8013980 con 0x7f1cb810f260 2024-02-28T15:50:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.460+0000 7f1cbda00700 1 -- 172.21.15.57:0/1861032541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb804bed0 con 0x7f1cb810f260 2024-02-28T15:50:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.461+0000 7f1caea00700 1 --2- 172.21.15.57:0/1861032541 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1c9c036910 0x7f1c9c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.461+0000 7f1caea00700 1 -- 172.21.15.57:0/1861032541 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1ca80498b0 con 0x7f1cb810f260 2024-02-28T15:50:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.461+0000 7f1cb6000700 1 --2- 172.21.15.57:0/1861032541 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1c9c036910 0x7f1c9c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.462+0000 7f1cb6000700 1 --2- 172.21.15.57:0/1861032541 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1c9c036910 0x7f1c9c038dc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009990 tx=0x7f1ca4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.466+0000 7f1caea00700 1 -- 172.21.15.57:0/1861032541 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1ca800be50 con 0x7f1cb810f260 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.685+0000 7f1cbda00700 1 -- 172.21.15.57:0/1861032541 --> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cb8108860 con 0x7f1c9c036910 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.698+0000 7f1caea00700 1 -- 172.21.15.57:0/1861032541 <== mgr.14162 v2:172.21.15.57:6800/4162336432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1cb8108860 con 0x7f1c9c036910 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.701+0000 7f1cbda00700 1 -- 172.21.15.57:0/1861032541 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1c9c036910 msgr2=0x7f1c9c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.701+0000 7f1cbda00700 1 --2- 172.21.15.57:0/1861032541 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1c9c036910 0x7f1c9c038dc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009990 tx=0x7f1ca4006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.701+0000 7f1cbda00700 1 -- 172.21.15.57:0/1861032541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb810f260 msgr2=0x7f1cb810f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.701+0000 7f1cbda00700 1 --2- 172.21.15.57:0/1861032541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb810f260 0x7f1cb810f670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009b80 tx=0x7f1ca8009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.701+0000 7f1cbda00700 1 -- 172.21.15.57:0/1861032541 shutdown_connections 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.701+0000 7f1cbda00700 1 --2- 172.21.15.57:0/1861032541 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1c9c036910 0x7f1c9c038dc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.701+0000 7f1cbda00700 1 --2- 172.21.15.57:0/1861032541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb810f260 0x7f1cb810f670 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.701+0000 7f1cbda00700 1 -- 172.21.15.57:0/1861032541 >> 172.21.15.57:0/1861032541 conn(0x7f1cb80f8270 msgr2=0x7f1cb80f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.701+0000 7f1cbda00700 1 -- 172.21.15.57:0/1861032541 shutdown_connections 2024-02-28T15:50:36.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:35.702+0000 7f1cbda00700 1 -- 172.21.15.57:0/1861032541 wait complete. 2024-02-28T15:50:36.837 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi087 2024-02-28T15:50:36.837 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:50:36.837 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/etc/ceph/ceph.conf 2024-02-28T15:50:36.894 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:50:36.894 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T15:50:36.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:36 smithi057 ceph-mon[28763]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:50:36.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:36 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:36.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:36 smithi057 ceph-mon[28763]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:36.987 INFO:tasks.cephadm:Adding host smithi087 to orchestrator... 2024-02-28T15:50:36.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph orch host add smithi087 2024-02-28T15:50:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:50:38.749 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:38 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:38.749 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:38 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:38.749 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:38 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:38.749 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:38 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:38.749 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:38 smithi057 ceph-mon[28763]: Deploying daemon node-exporter.smithi057 on smithi057 2024-02-28T15:50:39.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.536+0000 7fd9ade00700 1 -- 172.21.15.57:0/3064466802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9a80fcbc0 msgr2=0x7fd9a80fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:39.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.536+0000 7fd9ade00700 1 --2- 172.21.15.57:0/3064466802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9a80fcbc0 0x7fd9a80fcfd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd9980048c0 tx=0x7fd998009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:39.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.536+0000 7fd9ade00700 1 -- 172.21.15.57:0/3064466802 shutdown_connections 2024-02-28T15:50:39.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.536+0000 7fd9ade00700 1 --2- 172.21.15.57:0/3064466802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9a80fcbc0 0x7fd9a80fcfd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:39.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.536+0000 7fd9ade00700 1 -- 172.21.15.57:0/3064466802 >> 172.21.15.57:0/3064466802 conn(0x7fd9a80f82a0 msgr2=0x7fd9a80fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:39.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.536+0000 7fd9ade00700 1 -- 172.21.15.57:0/3064466802 shutdown_connections 2024-02-28T15:50:39.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.536+0000 7fd9ade00700 1 -- 172.21.15.57:0/3064466802 wait complete. 2024-02-28T15:50:39.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.537+0000 7fd9ade00700 1 Processor -- start 2024-02-28T15:50:39.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.537+0000 7fd9ade00700 1 -- start start 2024-02-28T15:50:39.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.538+0000 7fd9ade00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9a80fcbc0 0x7fd9a8071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:39.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.538+0000 7fd9ade00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80702e0 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.538+0000 7fd9a6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9a80fcbc0 0x7fd9a8071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.538+0000 7fd9a6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9a80fcbc0 0x7fd9a8071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46970/0 (socket says 172.21.15.57:46970) 2024-02-28T15:50:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.538+0000 7fd9a6a00700 1 -- 172.21.15.57:0/2246786619 learned_addr learned my addr 172.21.15.57:0/2246786619 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.538+0000 7fd9a6a00700 1 -- 172.21.15.57:0/2246786619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998005040 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.539+0000 7fd9a6a00700 1 --2- 172.21.15.57:0/2246786619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9a80fcbc0 0x7fd9a8071e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd998009b80 tx=0x7fd998009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.539+0000 7fd99ea00700 1 -- 172.21.15.57:0/2246786619 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd99800b5c0 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.539+0000 7fd99ea00700 1 -- 172.21.15.57:0/2246786619 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd99800be70 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.539+0000 7fd9ade00700 1 -- 172.21.15.57:0/2246786619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a80704e0 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.539+0000 7fd99ea00700 1 -- 172.21.15.57:0/2246786619 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd99801c660 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.539+0000 7fd9ade00700 1 -- 172.21.15.57:0/2246786619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a80709d0 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.540+0000 7fd99ea00700 1 -- 172.21.15.57:0/2246786619 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7fd998004d30 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.540+0000 7fd9ade00700 1 -- 172.21.15.57:0/2246786619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a8106990 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.541+0000 7fd99ea00700 1 --2- 172.21.15.57:0/2246786619 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fd98c0368c0 0x7fd98c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.541+0000 7fd99ea00700 1 -- 172.21.15.57:0/2246786619 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd998049ac0 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.541+0000 7fd9a6000700 1 --2- 172.21.15.57:0/2246786619 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fd98c0368c0 0x7fd98c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.542+0000 7fd9a6000700 1 --2- 172.21.15.57:0/2246786619 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fd98c0368c0 0x7fd98c038d70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd994009990 tx=0x7fd994006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:39.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.546+0000 7fd99ea00700 1 -- 172.21.15.57:0/2246786619 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd998011370 con 0x7fd9a80fcbc0 2024-02-28T15:50:39.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:39.777+0000 7fd9ade00700 1 -- 172.21.15.57:0/2246786619 --> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi087", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9a802b310 con 0x7fd98c0368c0 2024-02-28T15:50:39.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:39 smithi057 ceph-mon[28763]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:40.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:40 smithi057 ceph-mon[28763]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi087", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:50:40.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:40 smithi057 ceph-mon[28763]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:42.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:42 smithi057 ceph-mon[28763]: Deploying cephadm binary to smithi087 2024-02-28T15:50:42.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:42 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:43.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:43 smithi057 ceph-mon[28763]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:43.834 INFO:teuthology.orchestra.run.smithi057.stdout:Added host 'smithi087' with addr '172.21.15.87' 2024-02-28T15:50:43.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.837+0000 7fd99ea00700 1 -- 172.21.15.57:0/2246786619 <== mgr.14162 v2:172.21.15.57:6800/4162336432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fd9a802b310 con 0x7fd98c0368c0 2024-02-28T15:50:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.841+0000 7fd9ade00700 1 -- 172.21.15.57:0/2246786619 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fd98c0368c0 msgr2=0x7fd98c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.841+0000 7fd9ade00700 1 --2- 172.21.15.57:0/2246786619 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fd98c0368c0 0x7fd98c038d70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd994009990 tx=0x7fd994006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.841+0000 7fd9ade00700 1 -- 172.21.15.57:0/2246786619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9a80fcbc0 msgr2=0x7fd9a8071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.841+0000 7fd9ade00700 1 --2- 172.21.15.57:0/2246786619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9a80fcbc0 0x7fd9a8071e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd998009b80 tx=0x7fd998009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.841+0000 7fd9ade00700 1 -- 172.21.15.57:0/2246786619 shutdown_connections 2024-02-28T15:50:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.841+0000 7fd9ade00700 1 --2- 172.21.15.57:0/2246786619 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fd98c0368c0 0x7fd98c038d70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.841+0000 7fd9ade00700 1 --2- 172.21.15.57:0/2246786619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9a80fcbc0 0x7fd9a8071e60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:43.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.841+0000 7fd9ade00700 1 -- 172.21.15.57:0/2246786619 >> 172.21.15.57:0/2246786619 conn(0x7fd9a80f82a0 msgr2=0x7fd9a80f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:43.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.842+0000 7fd9ade00700 1 -- 172.21.15.57:0/2246786619 shutdown_connections 2024-02-28T15:50:43.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:43.842+0000 7fd9ade00700 1 -- 172.21.15.57:0/2246786619 wait complete. 2024-02-28T15:50:44.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph orch host ls --format=json 2024-02-28T15:50:45.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:44 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:45.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:44 smithi057 ceph-mon[28763]: Added host smithi087 2024-02-28T15:50:45.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:44 smithi057 ceph-mon[28763]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:45.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:44 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:45.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:44 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:45.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:44 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:45.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:44 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:45.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:44 smithi057 ceph-mon[28763]: Deploying daemon alertmanager.smithi057 on smithi057 2024-02-28T15:50:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:50:47.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:47 smithi057 ceph-mon[28763]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:47.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:47 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.394+0000 7f6218600700 1 -- 172.21.15.57:0/89158760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62100fcbc0 msgr2=0x7f62100fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.394+0000 7f6218600700 1 --2- 172.21.15.57:0/89158760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62100fcbc0 0x7f62100fcfd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62040048c0 tx=0x7f6204009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.394+0000 7f6218600700 1 -- 172.21.15.57:0/89158760 shutdown_connections 2024-02-28T15:50:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.394+0000 7f6218600700 1 --2- 172.21.15.57:0/89158760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62100fcbc0 0x7f62100fcfd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.394+0000 7f6218600700 1 -- 172.21.15.57:0/89158760 >> 172.21.15.57:0/89158760 conn(0x7f62100f82a0 msgr2=0x7f62100fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.394+0000 7f6218600700 1 -- 172.21.15.57:0/89158760 shutdown_connections 2024-02-28T15:50:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.394+0000 7f6218600700 1 -- 172.21.15.57:0/89158760 wait complete. 2024-02-28T15:50:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.395+0000 7f6218600700 1 Processor -- start 2024-02-28T15:50:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.395+0000 7f6218600700 1 -- start start 2024-02-28T15:50:48.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.396+0000 7f6218600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62100fcbc0 0x7f621010ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:48.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.396+0000 7f6218600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621010d3d0 con 0x7f62100fcbc0 2024-02-28T15:50:48.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.396+0000 7f6215c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62100fcbc0 0x7f621010ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:48.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.396+0000 7f6215c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62100fcbc0 0x7f621010ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58794/0 (socket says 172.21.15.57:58794) 2024-02-28T15:50:48.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.396+0000 7f6215c00700 1 -- 172.21.15.57:0/74688336 learned_addr learned my addr 172.21.15.57:0/74688336 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:48.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.397+0000 7f6215c00700 1 -- 172.21.15.57:0/74688336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204005040 con 0x7f62100fcbc0 2024-02-28T15:50:48.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.397+0000 7f6215c00700 1 --2- 172.21.15.57:0/74688336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62100fcbc0 0x7f621010ce90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6204009b80 tx=0x7f6204009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:48.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.397+0000 7f620d600700 1 -- 172.21.15.57:0/74688336 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f620400b5c0 con 0x7f62100fcbc0 2024-02-28T15:50:48.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.397+0000 7f620d600700 1 -- 172.21.15.57:0/74688336 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f620400be70 con 0x7f62100fcbc0 2024-02-28T15:50:48.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.397+0000 7f6218600700 1 -- 172.21.15.57:0/74688336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621010d5d0 con 0x7f62100fcbc0 2024-02-28T15:50:48.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.397+0000 7f620d600700 1 -- 172.21.15.57:0/74688336 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f620401c660 con 0x7f62100fcbc0 2024-02-28T15:50:48.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.398+0000 7f6218600700 1 -- 172.21.15.57:0/74688336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621010e270 con 0x7f62100fcbc0 2024-02-28T15:50:48.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.399+0000 7f620d600700 1 -- 172.21.15.57:0/74688336 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f6204013420 con 0x7f62100fcbc0 2024-02-28T15:50:48.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.399+0000 7f6218600700 1 -- 172.21.15.57:0/74688336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621005f5c0 con 0x7f62100fcbc0 2024-02-28T15:50:48.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.399+0000 7f620d600700 1 --2- 172.21.15.57:0/74688336 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f61f80368c0 0x7f61f8038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:48.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.399+0000 7f620d600700 1 -- 172.21.15.57:0/74688336 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6204049950 con 0x7f62100fcbc0 2024-02-28T15:50:48.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.399+0000 7f6215200700 1 --2- 172.21.15.57:0/74688336 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f61f80368c0 0x7f61f8038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:48.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.400+0000 7f6215200700 1 --2- 172.21.15.57:0/74688336 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f61f80368c0 0x7f61f8038d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f61fc009990 tx=0x7f61fc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.404+0000 7f620d600700 1 -- 172.21.15.57:0/74688336 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6204011550 con 0x7f62100fcbc0 2024-02-28T15:50:48.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.644+0000 7f6218600700 1 -- 172.21.15.57:0/74688336 --> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f621010ee30 con 0x7f61f80368c0 2024-02-28T15:50:48.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.646+0000 7f620d600700 1 -- 172.21.15.57:0/74688336 <== mgr.14162 v2:172.21.15.57:6800/4162336432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f621010ee30 con 0x7f61f80368c0 2024-02-28T15:50:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:50:48.641 INFO:teuthology.orchestra.run.smithi057.stdout:[{"addr": "172.21.15.57", "hostname": "smithi057", "labels": [], "status": ""}, {"addr": "172.21.15.87", "hostname": "smithi087", "labels": [], "status": ""}] 2024-02-28T15:50:48.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.650+0000 7f6218600700 1 -- 172.21.15.57:0/74688336 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f61f80368c0 msgr2=0x7f61f8038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:48.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.650+0000 7f6218600700 1 --2- 172.21.15.57:0/74688336 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f61f80368c0 0x7f61f8038d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f61fc009990 tx=0x7f61fc006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:48.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.650+0000 7f6218600700 1 -- 172.21.15.57:0/74688336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62100fcbc0 msgr2=0x7f621010ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:48.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.650+0000 7f6218600700 1 --2- 172.21.15.57:0/74688336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62100fcbc0 0x7f621010ce90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6204009b80 tx=0x7f6204009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:48.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.650+0000 7f6218600700 1 -- 172.21.15.57:0/74688336 shutdown_connections 2024-02-28T15:50:48.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.650+0000 7f6218600700 1 --2- 172.21.15.57:0/74688336 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f61f80368c0 0x7f61f8038d70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:48.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.650+0000 7f6218600700 1 --2- 172.21.15.57:0/74688336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62100fcbc0 0x7f621010ce90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:48.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.650+0000 7f6218600700 1 -- 172.21.15.57:0/74688336 >> 172.21.15.57:0/74688336 conn(0x7f62100f82a0 msgr2=0x7f62100f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:48.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.650+0000 7f6218600700 1 -- 172.21.15.57:0/74688336 shutdown_connections 2024-02-28T15:50:48.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:48.651+0000 7f6218600700 1 -- 172.21.15.57:0/74688336 wait complete. 2024-02-28T15:50:49.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:49 smithi057 ceph-mon[28763]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:50.241 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-28T15:50:50.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd crush tunables default 2024-02-28T15:50:50.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:50 smithi057 ceph-mon[28763]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T15:50:51.447 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:50:51.616 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:51 smithi057 ceph-mon[28763]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:53.599 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:53 smithi057 ceph-mon[28763]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:54.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.308+0000 7f5034200700 1 -- 172.21.15.57:0/148163454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f502c071f10 msgr2=0x7f502c070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:54.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.308+0000 7f5034200700 1 --2- 172.21.15.57:0/148163454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f502c071f10 0x7f502c070380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f50200048c0 tx=0x7f5020009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:54.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.308+0000 7f5034200700 1 -- 172.21.15.57:0/148163454 shutdown_connections 2024-02-28T15:50:54.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.308+0000 7f5034200700 1 --2- 172.21.15.57:0/148163454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f502c071f10 0x7f502c070380 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:54.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.308+0000 7f5034200700 1 -- 172.21.15.57:0/148163454 >> 172.21.15.57:0/148163454 conn(0x7f502c0f82a0 msgr2=0x7f502c0fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:54.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.308+0000 7f5034200700 1 -- 172.21.15.57:0/148163454 shutdown_connections 2024-02-28T15:50:54.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.308+0000 7f5034200700 1 -- 172.21.15.57:0/148163454 wait complete. 2024-02-28T15:50:54.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.309+0000 7f5034200700 1 Processor -- start 2024-02-28T15:50:54.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.309+0000 7f5034200700 1 -- start start 2024-02-28T15:50:54.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.310+0000 7f5034200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f502c071f10 0x7f502c10f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:54.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.310+0000 7f5034200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c10f5e0 con 0x7f502c071f10 2024-02-28T15:50:54.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.310+0000 7f5031800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f502c071f10 0x7f502c10f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:54.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.310+0000 7f5031800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f502c071f10 0x7f502c10f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48992/0 (socket says 172.21.15.57:48992) 2024-02-28T15:50:54.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.310+0000 7f5031800700 1 -- 172.21.15.57:0/1377811901 learned_addr learned my addr 172.21.15.57:0/1377811901 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:50:54.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.310+0000 7f5031800700 1 -- 172.21.15.57:0/1377811901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020005040 con 0x7f502c071f10 2024-02-28T15:50:54.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.311+0000 7f5031800700 1 --2- 172.21.15.57:0/1377811901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f502c071f10 0x7f502c10f0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5020009b80 tx=0x7f5020009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:54.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.311+0000 7f5029600700 1 -- 172.21.15.57:0/1377811901 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f502000b5c0 con 0x7f502c071f10 2024-02-28T15:50:54.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.311+0000 7f5029600700 1 -- 172.21.15.57:0/1377811901 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f502000be70 con 0x7f502c071f10 2024-02-28T15:50:54.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.311+0000 7f5029600700 1 -- 172.21.15.57:0/1377811901 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f502001c660 con 0x7f502c071f10 2024-02-28T15:50:54.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.311+0000 7f5034200700 1 -- 172.21.15.57:0/1377811901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502c10f7e0 con 0x7f502c071f10 2024-02-28T15:50:54.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.311+0000 7f5034200700 1 -- 172.21.15.57:0/1377811901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502c110480 con 0x7f502c071f10 2024-02-28T15:50:54.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.312+0000 7f5034200700 1 -- 172.21.15.57:0/1377811901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502c05f5c0 con 0x7f502c071f10 2024-02-28T15:50:54.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.312+0000 7f5029600700 1 -- 172.21.15.57:0/1377811901 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f5020004d30 con 0x7f502c071f10 2024-02-28T15:50:54.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.313+0000 7f5029600700 1 --2- 172.21.15.57:0/1377811901 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f50140368c0 0x7f5014038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:54.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.313+0000 7f5029600700 1 -- 172.21.15.57:0/1377811901 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5020049a40 con 0x7f502c071f10 2024-02-28T15:50:54.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.313+0000 7f5030e00700 1 --2- 172.21.15.57:0/1377811901 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f50140368c0 0x7f5014038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:54.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.314+0000 7f5030e00700 1 --2- 172.21.15.57:0/1377811901 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f50140368c0 0x7f5014038d70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5018009990 tx=0x7f5018006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:54.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.318+0000 7f5029600700 1 -- 172.21.15.57:0/1377811901 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5020025400 con 0x7f502c071f10 2024-02-28T15:50:54.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:54.553+0000 7f5034200700 1 -- 172.21.15.57:0/1377811901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f502c110fd0 con 0x7f502c071f10 2024-02-28T15:50:55.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.324+0000 7f5029600700 1 -- 172.21.15.57:0/1377811901 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5020023300 con 0x7f502c071f10 2024-02-28T15:50:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.328+0000 7f5034200700 1 -- 172.21.15.57:0/1377811901 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f50140368c0 msgr2=0x7f5014038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.328+0000 7f5034200700 1 --2- 172.21.15.57:0/1377811901 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f50140368c0 0x7f5014038d70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5018009990 tx=0x7f5018006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.328+0000 7f5034200700 1 -- 172.21.15.57:0/1377811901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f502c071f10 msgr2=0x7f502c10f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.328+0000 7f5034200700 1 --2- 172.21.15.57:0/1377811901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f502c071f10 0x7f502c10f0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5020009b80 tx=0x7f5020009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.328+0000 7f5034200700 1 -- 172.21.15.57:0/1377811901 shutdown_connections 2024-02-28T15:50:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.328+0000 7f5034200700 1 --2- 172.21.15.57:0/1377811901 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f50140368c0 0x7f5014038d70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:55.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.329+0000 7f5034200700 1 --2- 172.21.15.57:0/1377811901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f502c071f10 0x7f502c10f0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:55.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.329+0000 7f5034200700 1 -- 172.21.15.57:0/1377811901 >> 172.21.15.57:0/1377811901 conn(0x7f502c0f82a0 msgr2=0x7f502c0f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:55.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.329+0000 7f5034200700 1 -- 172.21.15.57:0/1377811901 shutdown_connections 2024-02-28T15:50:55.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:50:55.329+0000 7f5034200700 1 -- 172.21.15.57:0/1377811901 wait complete. 2024-02-28T15:50:55.325 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2024-02-28T15:50:55.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:55 smithi057 ceph-mon[28763]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:55.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:55 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1377811901' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-28T15:50:56.475 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:56 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1377811901' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-28T15:50:56.476 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:56 smithi057 ceph-mon[28763]: osdmap e4: 0 total, 0 up, 0 in 2024-02-28T15:50:56.480 INFO:tasks.cephadm:Adding mon.smithi057 on smithi057 2024-02-28T15:50:56.481 INFO:tasks.cephadm:Adding mon.smithi087 on smithi087 2024-02-28T15:50:56.481 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph orch apply mon '2;smithi057:172.21.15.57=smithi057;smithi087:172.21.15.87=smithi087' 2024-02-28T15:50:56.922 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:50:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:50:57.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:57 smithi057 ceph-mon[28763]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:58.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:58 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:58.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:58 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:58.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:58 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:58.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:58 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:58.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:58 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:58.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:58 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:58.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:58 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-28T15:50:58.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:58 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:50:59.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.070+0000 7f9949a00700 1 -- 172.21.15.87:0/2914759310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99440fcbc0 msgr2=0x7f99440fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:59.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.070+0000 7f9949a00700 1 --2- 172.21.15.87:0/2914759310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99440fcbc0 0x7f99440fcfd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f99340048c0 tx=0x7f9934009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:59.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.070+0000 7f9949a00700 1 -- 172.21.15.87:0/2914759310 shutdown_connections 2024-02-28T15:50:59.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.070+0000 7f9949a00700 1 --2- 172.21.15.87:0/2914759310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99440fcbc0 0x7f99440fcfd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:59.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.070+0000 7f9949a00700 1 -- 172.21.15.87:0/2914759310 >> 172.21.15.87:0/2914759310 conn(0x7f99440f82a0 msgr2=0x7f99440fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:59.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.070+0000 7f9949a00700 1 -- 172.21.15.87:0/2914759310 shutdown_connections 2024-02-28T15:50:59.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.070+0000 7f9949a00700 1 -- 172.21.15.87:0/2914759310 wait complete. 2024-02-28T15:50:59.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.071+0000 7f9949a00700 1 Processor -- start 2024-02-28T15:50:59.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.071+0000 7f9949a00700 1 -- start start 2024-02-28T15:50:59.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.072+0000 7f9949a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99440fcbc0 0x7f994410f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:59.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.072+0000 7f9949a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994410f610 con 0x7f99440fcbc0 2024-02-28T15:50:59.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.072+0000 7f9942a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99440fcbc0 0x7f994410f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:59.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.072+0000 7f9942a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99440fcbc0 0x7f994410f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:45210/0 (socket says 172.21.15.87:45210) 2024-02-28T15:50:59.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.072+0000 7f9942a00700 1 -- 172.21.15.87:0/2093900130 learned_addr learned my addr 172.21.15.87:0/2093900130 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:50:59.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.073+0000 7f9942a00700 1 -- 172.21.15.87:0/2093900130 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9934005040 con 0x7f99440fcbc0 2024-02-28T15:50:59.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.073+0000 7f9942a00700 1 --2- 172.21.15.87:0/2093900130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99440fcbc0 0x7f994410f0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9934009b80 tx=0x7f9934009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:59.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.074+0000 7f993aa00700 1 -- 172.21.15.87:0/2093900130 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f993400b5c0 con 0x7f99440fcbc0 2024-02-28T15:50:59.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.074+0000 7f9949a00700 1 -- 172.21.15.87:0/2093900130 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994410f810 con 0x7f99440fcbc0 2024-02-28T15:50:59.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.074+0000 7f9949a00700 1 -- 172.21.15.87:0/2093900130 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99441104b0 con 0x7f99440fcbc0 2024-02-28T15:50:59.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.074+0000 7f993aa00700 1 -- 172.21.15.87:0/2093900130 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f993400be70 con 0x7f99440fcbc0 2024-02-28T15:50:59.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.074+0000 7f993aa00700 1 -- 172.21.15.87:0/2093900130 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99340255c0 con 0x7f99440fcbc0 2024-02-28T15:50:59.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.075+0000 7f9949a00700 1 -- 172.21.15.87:0/2093900130 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994405f5c0 con 0x7f99440fcbc0 2024-02-28T15:50:59.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.076+0000 7f993aa00700 1 -- 172.21.15.87:0/2093900130 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f9934004d30 con 0x7f99440fcbc0 2024-02-28T15:50:59.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.076+0000 7f993aa00700 1 --2- 172.21.15.87:0/2093900130 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9928036820 0x7f9928038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:50:59.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.076+0000 7f993aa00700 1 -- 172.21.15.87:0/2093900130 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9934049e50 con 0x7f99440fcbc0 2024-02-28T15:50:59.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.077+0000 7f9942000700 1 --2- 172.21.15.87:0/2093900130 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9928036820 0x7f9928038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:50:59.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.078+0000 7f9942000700 1 --2- 172.21.15.87:0/2093900130 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9928036820 0x7f9928038cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9930009990 tx=0x7f9930006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:50:59.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.090+0000 7f993aa00700 1 -- 172.21.15.87:0/2093900130 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9934011db0 con 0x7f99440fcbc0 2024-02-28T15:50:59.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.304+0000 7f9949a00700 1 -- 172.21.15.87:0/2093900130 --> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi057:172.21.15.57=smithi057;smithi087:172.21.15.87=smithi087", "target": ["mon-mgr", ""]}) v1 -- 0x7f9944070980 con 0x7f9928036820 2024-02-28T15:50:59.316 INFO:teuthology.orchestra.run.smithi087.stdout:Scheduled mon update... 2024-02-28T15:50:59.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.321+0000 7f993aa00700 1 -- 172.21.15.87:0/2093900130 <== mgr.14162 v2:172.21.15.57:6800/4162336432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9944070980 con 0x7f9928036820 2024-02-28T15:50:59.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.323+0000 7f9949a00700 1 -- 172.21.15.87:0/2093900130 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9928036820 msgr2=0x7f9928038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:59.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.323+0000 7f9949a00700 1 --2- 172.21.15.87:0/2093900130 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9928036820 0x7f9928038cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9930009990 tx=0x7f9930006e40 comp rx=0 tx=0).stop 2024-02-28T15:50:59.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.323+0000 7f9949a00700 1 -- 172.21.15.87:0/2093900130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99440fcbc0 msgr2=0x7f994410f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:50:59.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.323+0000 7f9949a00700 1 --2- 172.21.15.87:0/2093900130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99440fcbc0 0x7f994410f0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9934009b80 tx=0x7f9934009e30 comp rx=0 tx=0).stop 2024-02-28T15:50:59.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.324+0000 7f9949a00700 1 -- 172.21.15.87:0/2093900130 shutdown_connections 2024-02-28T15:50:59.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.324+0000 7f9949a00700 1 --2- 172.21.15.87:0/2093900130 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9928036820 0x7f9928038cd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:59.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.324+0000 7f9949a00700 1 --2- 172.21.15.87:0/2093900130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99440fcbc0 0x7f994410f0d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:50:59.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.324+0000 7f9949a00700 1 -- 172.21.15.87:0/2093900130 >> 172.21.15.87:0/2093900130 conn(0x7f99440f82a0 msgr2=0x7f99440701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:50:59.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.324+0000 7f9949a00700 1 -- 172.21.15.87:0/2093900130 shutdown_connections 2024-02-28T15:50:59.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:50:59.324+0000 7f9949a00700 1 -- 172.21.15.87:0/2093900130 wait complete. 2024-02-28T15:50:59.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:59 smithi057 ceph-mon[28763]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-28T15:50:59.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:59 smithi057 ceph-mon[28763]: Deploying daemon grafana.smithi057 on smithi057 2024-02-28T15:50:59.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:59 smithi057 ceph-mon[28763]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:50:59.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:50:59 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:00.093 DEBUG:teuthology.orchestra.run.smithi087:mon.smithi087> sudo journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi087.service 2024-02-28T15:51:00.100 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:00.101 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:00.545 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:00.640 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:00 smithi057 ceph-mon[28763]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi057:172.21.15.57=smithi057;smithi087:172.21.15.87=smithi087", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:51:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:00 smithi057 ceph-mon[28763]: Saving service mon spec with placement smithi057:172.21.15.57=smithi057;smithi087:172.21.15.87=smithi087;count:2 2024-02-28T15:51:01.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:01 smithi057 ceph-mon[28763]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:01.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:01 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:02.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.786+0000 7f7f1ee00700 1 -- 172.21.15.87:0/3221756597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f180fedd0 msgr2=0x7f7f180ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:02.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.786+0000 7f7f1ee00700 1 --2- 172.21.15.87:0/3221756597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f180fedd0 0x7f7f180ff1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f080048c0 tx=0x7f7f08009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:02.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.786+0000 7f7f1ee00700 1 -- 172.21.15.87:0/3221756597 shutdown_connections 2024-02-28T15:51:02.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.786+0000 7f7f1ee00700 1 --2- 172.21.15.87:0/3221756597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f180fedd0 0x7f7f180ff1e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:02.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.786+0000 7f7f1ee00700 1 -- 172.21.15.87:0/3221756597 >> 172.21.15.87:0/3221756597 conn(0x7f7f180fa5a0 msgr2=0x7f7f180fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:02.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.786+0000 7f7f1ee00700 1 -- 172.21.15.87:0/3221756597 shutdown_connections 2024-02-28T15:51:02.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.786+0000 7f7f1ee00700 1 -- 172.21.15.87:0/3221756597 wait complete. 2024-02-28T15:51:02.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.788+0000 7f7f1ee00700 1 Processor -- start 2024-02-28T15:51:02.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.788+0000 7f7f1ee00700 1 -- start start 2024-02-28T15:51:02.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.789+0000 7f7f1ee00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f180fedd0 0x7f7f1810f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:02.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.789+0000 7f7f1ee00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1810f650 con 0x7f7f180fedd0 2024-02-28T15:51:02.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.789+0000 7f7f17e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f180fedd0 0x7f7f1810f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:02.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.789+0000 7f7f17e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f180fedd0 0x7f7f1810f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:42828/0 (socket says 172.21.15.87:42828) 2024-02-28T15:51:02.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.789+0000 7f7f17e00700 1 -- 172.21.15.87:0/2525610400 learned_addr learned my addr 172.21.15.87:0/2525610400 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:02.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.790+0000 7f7f17e00700 1 -- 172.21.15.87:0/2525610400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08005040 con 0x7f7f180fedd0 2024-02-28T15:51:02.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.791+0000 7f7f17e00700 1 --2- 172.21.15.87:0/2525610400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f180fedd0 0x7f7f1810f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009b80 tx=0x7f7f08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:02.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.791+0000 7f7f0fe00700 1 -- 172.21.15.87:0/2525610400 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f0800b5c0 con 0x7f7f180fedd0 2024-02-28T15:51:02.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.791+0000 7f7f0fe00700 1 -- 172.21.15.87:0/2525610400 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f0800be70 con 0x7f7f180fedd0 2024-02-28T15:51:02.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.791+0000 7f7f0fe00700 1 -- 172.21.15.87:0/2525610400 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f0801c660 con 0x7f7f180fedd0 2024-02-28T15:51:02.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.791+0000 7f7f1ee00700 1 -- 172.21.15.87:0/2525610400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1810f850 con 0x7f7f180fedd0 2024-02-28T15:51:02.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.791+0000 7f7f1ee00700 1 -- 172.21.15.87:0/2525610400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f181104f0 con 0x7f7f180fedd0 2024-02-28T15:51:02.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.792+0000 7f7f1ee00700 1 -- 172.21.15.87:0/2525610400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1805f5c0 con 0x7f7f180fedd0 2024-02-28T15:51:02.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.793+0000 7f7f0fe00700 1 -- 172.21.15.87:0/2525610400 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f7f08004d30 con 0x7f7f180fedd0 2024-02-28T15:51:02.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.794+0000 7f7f0fe00700 1 --2- 172.21.15.87:0/2525610400 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f7efc036870 0x7f7efc038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:02.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.794+0000 7f7f0fe00700 1 -- 172.21.15.87:0/2525610400 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7f0804a490 con 0x7f7f180fedd0 2024-02-28T15:51:02.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.794+0000 7f7f17400700 1 --2- 172.21.15.87:0/2525610400 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f7efc036870 0x7f7efc038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:02.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.795+0000 7f7f17400700 1 --2- 172.21.15.87:0/2525610400 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f7efc036870 0x7f7efc038d20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009990 tx=0x7f7f04006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:02.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:02.809+0000 7f7f0fe00700 1 -- 172.21.15.87:0/2525610400 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7f0801bbb0 con 0x7f7f180fedd0 2024-02-28T15:51:03.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.101+0000 7f7f1ee00700 1 -- 172.21.15.87:0/2525610400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7f18111040 con 0x7f7f180fedd0 2024-02-28T15:51:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.102+0000 7f7f0fe00700 1 -- 172.21.15.87:0/2525610400 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7f0801bbb0 con 0x7f7f180fedd0 2024-02-28T15:51:03.097 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:03.097 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:03.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.105+0000 7f7f1ee00700 1 -- 172.21.15.87:0/2525610400 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f7efc036870 msgr2=0x7f7efc038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:03.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.105+0000 7f7f1ee00700 1 --2- 172.21.15.87:0/2525610400 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f7efc036870 0x7f7efc038d20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009990 tx=0x7f7f04006e40 comp rx=0 tx=0).stop 2024-02-28T15:51:03.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.105+0000 7f7f1ee00700 1 -- 172.21.15.87:0/2525610400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f180fedd0 msgr2=0x7f7f1810f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:03.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.105+0000 7f7f1ee00700 1 --2- 172.21.15.87:0/2525610400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f180fedd0 0x7f7f1810f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009b80 tx=0x7f7f08009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.106+0000 7f7f1ee00700 1 -- 172.21.15.87:0/2525610400 shutdown_connections 2024-02-28T15:51:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.106+0000 7f7f1ee00700 1 --2- 172.21.15.87:0/2525610400 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f7efc036870 0x7f7efc038d20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.106+0000 7f7f1ee00700 1 --2- 172.21.15.87:0/2525610400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f180fedd0 0x7f7f1810f110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.106+0000 7f7f1ee00700 1 -- 172.21.15.87:0/2525610400 >> 172.21.15.87:0/2525610400 conn(0x7f7f180fa5a0 msgr2=0x7f7f180fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.106+0000 7f7f1ee00700 1 -- 172.21.15.87:0/2525610400 shutdown_connections 2024-02-28T15:51:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:03.106+0000 7f7f1ee00700 1 -- 172.21.15.87:0/2525610400 wait complete. 2024-02-28T15:51:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:03.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:03 smithi057 ceph-mon[28763]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:03.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:03 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/2525610400' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:05.046 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:05.046 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:05.594 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:05.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:05 smithi057 ceph-mon[28763]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:07.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.857+0000 7f8ef3c00700 1 -- 172.21.15.87:0/1369008227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eec0fedd0 msgr2=0x7f8eec0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:07.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.857+0000 7f8ef3c00700 1 --2- 172.21.15.87:0/1369008227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eec0fedd0 0x7f8eec0ff1e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8edc0048c0 tx=0x7f8edc009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:07.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.857+0000 7f8ef3c00700 1 -- 172.21.15.87:0/1369008227 shutdown_connections 2024-02-28T15:51:07.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.857+0000 7f8ef3c00700 1 --2- 172.21.15.87:0/1369008227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eec0fedd0 0x7f8eec0ff1e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:07.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.857+0000 7f8ef3c00700 1 -- 172.21.15.87:0/1369008227 >> 172.21.15.87:0/1369008227 conn(0x7f8eec0fa5a0 msgr2=0x7f8eec0fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:07.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.858+0000 7f8ef3c00700 1 -- 172.21.15.87:0/1369008227 shutdown_connections 2024-02-28T15:51:07.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.858+0000 7f8ef3c00700 1 -- 172.21.15.87:0/1369008227 wait complete. 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.858+0000 7f8ef3c00700 1 Processor -- start 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.859+0000 7f8ef3c00700 1 -- start start 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.859+0000 7f8ef3c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eec0fedd0 0x7f8eec10f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.859+0000 7f8ef3c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec10f650 con 0x7f8eec0fedd0 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.859+0000 7f8ef1200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eec0fedd0 0x7f8eec10f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.860+0000 7f8ef1200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eec0fedd0 0x7f8eec10f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:42854/0 (socket says 172.21.15.87:42854) 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.860+0000 7f8ef1200700 1 -- 172.21.15.87:0/59672941 learned_addr learned my addr 172.21.15.87:0/59672941 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.860+0000 7f8ef1200700 1 -- 172.21.15.87:0/59672941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc005040 con 0x7f8eec0fedd0 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.860+0000 7f8ef1200700 1 --2- 172.21.15.87:0/59672941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eec0fedd0 0x7f8eec10f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009b80 tx=0x7f8edc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.861+0000 7f8ee9600700 1 -- 172.21.15.87:0/59672941 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8edc00b5c0 con 0x7f8eec0fedd0 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.861+0000 7f8ef3c00700 1 -- 172.21.15.87:0/59672941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eec10f850 con 0x7f8eec0fedd0 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.861+0000 7f8ee9600700 1 -- 172.21.15.87:0/59672941 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8edc00be70 con 0x7f8eec0fedd0 2024-02-28T15:51:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.861+0000 7f8ee9600700 1 -- 172.21.15.87:0/59672941 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8edc01c660 con 0x7f8eec0fedd0 2024-02-28T15:51:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.861+0000 7f8ef3c00700 1 -- 172.21.15.87:0/59672941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eec1104f0 con 0x7f8eec0fedd0 2024-02-28T15:51:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.862+0000 7f8ef3c00700 1 -- 172.21.15.87:0/59672941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eec05f5c0 con 0x7f8eec0fedd0 2024-02-28T15:51:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.862+0000 7f8ee9600700 1 -- 172.21.15.87:0/59672941 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f8edc004d30 con 0x7f8eec0fedd0 2024-02-28T15:51:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.863+0000 7f8ee9600700 1 --2- 172.21.15.87:0/59672941 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f8ecc0368c0 0x7f8ecc038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.863+0000 7f8ee9600700 1 -- 172.21.15.87:0/59672941 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8edc0499a0 con 0x7f8eec0fedd0 2024-02-28T15:51:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.863+0000 7f8ee3e00700 1 --2- 172.21.15.87:0/59672941 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f8ecc0368c0 0x7f8ecc038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.865+0000 7f8ee3e00700 1 --2- 172.21.15.87:0/59672941 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f8ecc0368c0 0x7f8ecc038d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009990 tx=0x7f8ed4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:07.884+0000 7f8ee9600700 1 -- 172.21.15.87:0/59672941 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8edc025400 con 0x7f8eec0fedd0 2024-02-28T15:51:07.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:07 smithi057 ceph-mon[28763]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:08.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.151+0000 7f8ef3c00700 1 -- 172.21.15.87:0/59672941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8eec111040 con 0x7f8eec0fedd0 2024-02-28T15:51:08.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.152+0000 7f8ee9600700 1 -- 172.21.15.87:0/59672941 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8edc023300 con 0x7f8eec0fedd0 2024-02-28T15:51:08.147 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:08.147 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:08.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.154+0000 7f8ef3c00700 1 -- 172.21.15.87:0/59672941 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f8ecc0368c0 msgr2=0x7f8ecc038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:08.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.154+0000 7f8ef3c00700 1 --2- 172.21.15.87:0/59672941 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f8ecc0368c0 0x7f8ecc038d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009990 tx=0x7f8ed4006e40 comp rx=0 tx=0).stop 2024-02-28T15:51:08.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.154+0000 7f8ef3c00700 1 -- 172.21.15.87:0/59672941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eec0fedd0 msgr2=0x7f8eec10f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:08.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.154+0000 7f8ef3c00700 1 --2- 172.21.15.87:0/59672941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eec0fedd0 0x7f8eec10f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009b80 tx=0x7f8edc009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:08.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.154+0000 7f8ef3c00700 1 -- 172.21.15.87:0/59672941 shutdown_connections 2024-02-28T15:51:08.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.154+0000 7f8ef3c00700 1 --2- 172.21.15.87:0/59672941 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f8ecc0368c0 0x7f8ecc038d70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:08.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.154+0000 7f8ef3c00700 1 --2- 172.21.15.87:0/59672941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eec0fedd0 0x7f8eec10f110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:08.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.154+0000 7f8ef3c00700 1 -- 172.21.15.87:0/59672941 >> 172.21.15.87:0/59672941 conn(0x7f8eec0fa5a0 msgr2=0x7f8eec0fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:08.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.154+0000 7f8ef3c00700 1 -- 172.21.15.87:0/59672941 shutdown_connections 2024-02-28T15:51:08.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:08.154+0000 7f8ef3c00700 1 -- 172.21.15.87:0/59672941 wait complete. 2024-02-28T15:51:08.151 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:08.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:08 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/59672941' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:09.831 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:09 smithi057 ceph-mon[28763]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:10.253 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:10.253 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:10.677 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:10.768 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:10.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:10 smithi057 ceph-mon[28763]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:12.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.765+0000 7f654f600700 1 -- 172.21.15.87:0/1657625263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6548071f10 msgr2=0x7f6548070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:12.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.765+0000 7f654f600700 1 --2- 172.21.15.87:0/1657625263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6548071f10 0x7f6548070380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f653c0048c0 tx=0x7f653c009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:12.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.766+0000 7f654f600700 1 -- 172.21.15.87:0/1657625263 shutdown_connections 2024-02-28T15:51:12.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.766+0000 7f654f600700 1 --2- 172.21.15.87:0/1657625263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6548071f10 0x7f6548070380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:12.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.766+0000 7f654f600700 1 -- 172.21.15.87:0/1657625263 >> 172.21.15.87:0/1657625263 conn(0x7f65480f82a0 msgr2=0x7f65480fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:12.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.766+0000 7f654f600700 1 -- 172.21.15.87:0/1657625263 shutdown_connections 2024-02-28T15:51:12.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.766+0000 7f654f600700 1 -- 172.21.15.87:0/1657625263 wait complete. 2024-02-28T15:51:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.767+0000 7f654f600700 1 Processor -- start 2024-02-28T15:51:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.767+0000 7f654f600700 1 -- start start 2024-02-28T15:51:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.767+0000 7f654f600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6548071f10 0x7f654810f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.767+0000 7f654f600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654810f5c0 con 0x7f6548071f10 2024-02-28T15:51:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.768+0000 7f654cc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6548071f10 0x7f654810f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.768+0000 7f654cc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6548071f10 0x7f654810f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:60948/0 (socket says 172.21.15.87:60948) 2024-02-28T15:51:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.768+0000 7f654cc00700 1 -- 172.21.15.87:0/2897529216 learned_addr learned my addr 172.21.15.87:0/2897529216 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:12.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.768+0000 7f654cc00700 1 -- 172.21.15.87:0/2897529216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c005040 con 0x7f6548071f10 2024-02-28T15:51:12.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.768+0000 7f654cc00700 1 --2- 172.21.15.87:0/2897529216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6548071f10 0x7f654810f080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f653c009b80 tx=0x7f653c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:12.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.769+0000 7f6544c00700 1 -- 172.21.15.87:0/2897529216 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f653c00b5c0 con 0x7f6548071f10 2024-02-28T15:51:12.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.769+0000 7f654f600700 1 -- 172.21.15.87:0/2897529216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654810f7c0 con 0x7f6548071f10 2024-02-28T15:51:12.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.769+0000 7f6544c00700 1 -- 172.21.15.87:0/2897529216 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f653c00be70 con 0x7f6548071f10 2024-02-28T15:51:12.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.769+0000 7f6544c00700 1 -- 172.21.15.87:0/2897529216 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f653c01c660 con 0x7f6548071f10 2024-02-28T15:51:12.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.769+0000 7f654f600700 1 -- 172.21.15.87:0/2897529216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6548110460 con 0x7f6548071f10 2024-02-28T15:51:12.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.770+0000 7f654f600700 1 -- 172.21.15.87:0/2897529216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654805f5c0 con 0x7f6548071f10 2024-02-28T15:51:12.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.770+0000 7f6544c00700 1 -- 172.21.15.87:0/2897529216 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f653c004d30 con 0x7f6548071f10 2024-02-28T15:51:12.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.771+0000 7f6544c00700 1 --2- 172.21.15.87:0/2897529216 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f6530036870 0x7f6530038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:12.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.771+0000 7f6544c00700 1 -- 172.21.15.87:0/2897529216 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f653c049af0 con 0x7f6548071f10 2024-02-28T15:51:12.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.771+0000 7f6547e00700 1 --2- 172.21.15.87:0/2897529216 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f6530036870 0x7f6530038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:12.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.772+0000 7f6547e00700 1 --2- 172.21.15.87:0/2897529216 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f6530036870 0x7f6530038d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6534009990 tx=0x7f6534006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:12.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:12.789+0000 7f6544c00700 1 -- 172.21.15.87:0/2897529216 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f653c025400 con 0x7f6548071f10 2024-02-28T15:51:13.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.079+0000 7f654f600700 1 -- 172.21.15.87:0/2897529216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6548110fb0 con 0x7f6548071f10 2024-02-28T15:51:13.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.080+0000 7f6544c00700 1 -- 172.21.15.87:0/2897529216 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f653c023300 con 0x7f6548071f10 2024-02-28T15:51:13.076 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:13.076 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:13.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.083+0000 7f654f600700 1 -- 172.21.15.87:0/2897529216 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f6530036870 msgr2=0x7f6530038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:13.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.083+0000 7f654f600700 1 --2- 172.21.15.87:0/2897529216 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f6530036870 0x7f6530038d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6534009990 tx=0x7f6534006e40 comp rx=0 tx=0).stop 2024-02-28T15:51:13.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.083+0000 7f654f600700 1 -- 172.21.15.87:0/2897529216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6548071f10 msgr2=0x7f654810f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:13.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.083+0000 7f654f600700 1 --2- 172.21.15.87:0/2897529216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6548071f10 0x7f654810f080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f653c009b80 tx=0x7f653c009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:13.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.083+0000 7f654f600700 1 -- 172.21.15.87:0/2897529216 shutdown_connections 2024-02-28T15:51:13.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.083+0000 7f654f600700 1 --2- 172.21.15.87:0/2897529216 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f6530036870 0x7f6530038d20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:13.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.083+0000 7f654f600700 1 --2- 172.21.15.87:0/2897529216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6548071f10 0x7f654810f080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:13.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.083+0000 7f654f600700 1 -- 172.21.15.87:0/2897529216 >> 172.21.15.87:0/2897529216 conn(0x7f65480f82a0 msgr2=0x7f65480f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:13.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.084+0000 7f654f600700 1 -- 172.21.15.87:0/2897529216 shutdown_connections 2024-02-28T15:51:13.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:13.084+0000 7f654f600700 1 -- 172.21.15.87:0/2897529216 wait complete. 2024-02-28T15:51:13.080 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:13.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:13 smithi057 ceph-mon[28763]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:13.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:13 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/2897529216' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:14.768 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:14.769 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:15.224 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:15.327 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:15.618 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:15 smithi057 ceph-mon[28763]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:17.370 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:17 smithi057 ceph-mon[28763]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:17.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.394+0000 7febcc800700 1 -- 172.21.15.87:0/1507053450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc40fedd0 msgr2=0x7febc40ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:17.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.394+0000 7febcc800700 1 --2- 172.21.15.87:0/1507053450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc40fedd0 0x7febc40ff1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7febb80048c0 tx=0x7febb8009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:17.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.394+0000 7febcc800700 1 -- 172.21.15.87:0/1507053450 shutdown_connections 2024-02-28T15:51:17.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.394+0000 7febcc800700 1 --2- 172.21.15.87:0/1507053450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc40fedd0 0x7febc40ff1e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:17.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.394+0000 7febcc800700 1 -- 172.21.15.87:0/1507053450 >> 172.21.15.87:0/1507053450 conn(0x7febc40fa5a0 msgr2=0x7febc40fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:17.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.394+0000 7febcc800700 1 -- 172.21.15.87:0/1507053450 shutdown_connections 2024-02-28T15:51:17.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.394+0000 7febcc800700 1 -- 172.21.15.87:0/1507053450 wait complete. 2024-02-28T15:51:17.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.395+0000 7febcc800700 1 Processor -- start 2024-02-28T15:51:17.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.396+0000 7febcc800700 1 -- start start 2024-02-28T15:51:17.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.396+0000 7febcc800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc40fedd0 0x7febc410f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:17.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.396+0000 7febcc800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc410f650 con 0x7febc40fedd0 2024-02-28T15:51:17.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.397+0000 7febc9e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc40fedd0 0x7febc410f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:17.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.397+0000 7febc9e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc40fedd0 0x7febc410f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:60976/0 (socket says 172.21.15.87:60976) 2024-02-28T15:51:17.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.397+0000 7febc9e00700 1 -- 172.21.15.87:0/2927340498 learned_addr learned my addr 172.21.15.87:0/2927340498 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:17.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.397+0000 7febc9e00700 1 -- 172.21.15.87:0/2927340498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb8005040 con 0x7febc40fedd0 2024-02-28T15:51:17.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.398+0000 7febc9e00700 1 --2- 172.21.15.87:0/2927340498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc40fedd0 0x7febc410f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7febb8009b80 tx=0x7febb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:17.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.398+0000 7febbe000700 1 -- 172.21.15.87:0/2927340498 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febb800b5c0 con 0x7febc40fedd0 2024-02-28T15:51:17.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.398+0000 7febcc800700 1 -- 172.21.15.87:0/2927340498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc410f850 con 0x7febc40fedd0 2024-02-28T15:51:17.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.398+0000 7febbe000700 1 -- 172.21.15.87:0/2927340498 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7febb800be70 con 0x7febc40fedd0 2024-02-28T15:51:17.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.398+0000 7febbe000700 1 -- 172.21.15.87:0/2927340498 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febb801c660 con 0x7febc40fedd0 2024-02-28T15:51:17.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.398+0000 7febcc800700 1 -- 172.21.15.87:0/2927340498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc41104f0 con 0x7febc40fedd0 2024-02-28T15:51:17.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.399+0000 7febcc800700 1 -- 172.21.15.87:0/2927340498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc405f5c0 con 0x7febc40fedd0 2024-02-28T15:51:17.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.400+0000 7febbe000700 1 -- 172.21.15.87:0/2927340498 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7febb8004d30 con 0x7febc40fedd0 2024-02-28T15:51:17.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.400+0000 7febbe000700 1 --2- 172.21.15.87:0/2927340498 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7febac0368c0 0x7febac038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:17.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.400+0000 7febbe000700 1 -- 172.21.15.87:0/2927340498 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7febb80499a0 con 0x7febc40fedd0 2024-02-28T15:51:17.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.401+0000 7febc9400700 1 --2- 172.21.15.87:0/2927340498 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7febac0368c0 0x7febac038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:17.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.402+0000 7febc9400700 1 --2- 172.21.15.87:0/2927340498 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7febac0368c0 0x7febac038d70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7febb0009990 tx=0x7febb0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:17.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.415+0000 7febbe000700 1 -- 172.21.15.87:0/2927340498 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7febb8025400 con 0x7febc40fedd0 2024-02-28T15:51:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.704+0000 7febcc800700 1 -- 172.21.15.87:0/2927340498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7febc4111040 con 0x7febc40fedd0 2024-02-28T15:51:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.705+0000 7febbe000700 1 -- 172.21.15.87:0/2927340498 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7febb8023300 con 0x7febc40fedd0 2024-02-28T15:51:17.701 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:17.701 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:17.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.708+0000 7febcc800700 1 -- 172.21.15.87:0/2927340498 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7febac0368c0 msgr2=0x7febac038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:17.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.708+0000 7febcc800700 1 --2- 172.21.15.87:0/2927340498 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7febac0368c0 0x7febac038d70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7febb0009990 tx=0x7febb0006e40 comp rx=0 tx=0).stop 2024-02-28T15:51:17.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.708+0000 7febcc800700 1 -- 172.21.15.87:0/2927340498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc40fedd0 msgr2=0x7febc410f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:17.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.708+0000 7febcc800700 1 --2- 172.21.15.87:0/2927340498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc40fedd0 0x7febc410f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7febb8009b80 tx=0x7febb8009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:17.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.708+0000 7febcc800700 1 -- 172.21.15.87:0/2927340498 shutdown_connections 2024-02-28T15:51:17.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.708+0000 7febcc800700 1 --2- 172.21.15.87:0/2927340498 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7febac0368c0 0x7febac038d70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:17.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.708+0000 7febcc800700 1 --2- 172.21.15.87:0/2927340498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc40fedd0 0x7febc410f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:17.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.708+0000 7febcc800700 1 -- 172.21.15.87:0/2927340498 >> 172.21.15.87:0/2927340498 conn(0x7febc40fa5a0 msgr2=0x7febc40fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:17.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.708+0000 7febcc800700 1 -- 172.21.15.87:0/2927340498 shutdown_connections 2024-02-28T15:51:17.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:17.708+0000 7febcc800700 1 -- 172.21.15.87:0/2927340498 wait complete. 2024-02-28T15:51:17.705 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:18.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:18 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/2927340498' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:19.428 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:19.429 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:19.439 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:19 smithi057 ceph-mon[28763]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:19.871 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:19.972 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:20.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:20 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:20 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:20 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:20 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:20 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:20 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:20 smithi057 ceph-mon[28763]: Deploying daemon prometheus.smithi057 on smithi057 2024-02-28T15:51:21.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.923+0000 7fb272c00700 1 -- 172.21.15.87:0/2392503959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb26c0fcbc0 msgr2=0x7fb26c0fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:21.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.923+0000 7fb272c00700 1 --2- 172.21.15.87:0/2392503959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb26c0fcbc0 0x7fb26c0fcfd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0048c0 tx=0x7fb25c009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:21.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.923+0000 7fb272c00700 1 -- 172.21.15.87:0/2392503959 shutdown_connections 2024-02-28T15:51:21.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.923+0000 7fb272c00700 1 --2- 172.21.15.87:0/2392503959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb26c0fcbc0 0x7fb26c0fcfd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:21.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.923+0000 7fb272c00700 1 -- 172.21.15.87:0/2392503959 >> 172.21.15.87:0/2392503959 conn(0x7fb26c0f82a0 msgr2=0x7fb26c0fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:21.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.923+0000 7fb272c00700 1 -- 172.21.15.87:0/2392503959 shutdown_connections 2024-02-28T15:51:21.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.923+0000 7fb272c00700 1 -- 172.21.15.87:0/2392503959 wait complete. 2024-02-28T15:51:21.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.924+0000 7fb272c00700 1 Processor -- start 2024-02-28T15:51:21.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.924+0000 7fb272c00700 1 -- start start 2024-02-28T15:51:21.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.925+0000 7fb272c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb26c0fcbc0 0x7fb26c10f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:21.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.925+0000 7fb272c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c10f5c0 con 0x7fb26c0fcbc0 2024-02-28T15:51:21.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.925+0000 7fb26be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb26c0fcbc0 0x7fb26c10f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:21.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.925+0000 7fb26be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb26c0fcbc0 0x7fb26c10f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:41770/0 (socket says 172.21.15.87:41770) 2024-02-28T15:51:21.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.925+0000 7fb26be00700 1 -- 172.21.15.87:0/1033860959 learned_addr learned my addr 172.21.15.87:0/1033860959 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:21.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.926+0000 7fb26be00700 1 -- 172.21.15.87:0/1033860959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c005040 con 0x7fb26c0fcbc0 2024-02-28T15:51:21.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.926+0000 7fb26be00700 1 --2- 172.21.15.87:0/1033860959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb26c0fcbc0 0x7fb26c10f080 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009b80 tx=0x7fb25c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:21.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.927+0000 7fb263e00700 1 -- 172.21.15.87:0/1033860959 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb25c00b5c0 con 0x7fb26c0fcbc0 2024-02-28T15:51:21.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.927+0000 7fb272c00700 1 -- 172.21.15.87:0/1033860959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c10f7c0 con 0x7fb26c0fcbc0 2024-02-28T15:51:21.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.927+0000 7fb263e00700 1 -- 172.21.15.87:0/1033860959 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb25c00be70 con 0x7fb26c0fcbc0 2024-02-28T15:51:21.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.927+0000 7fb263e00700 1 -- 172.21.15.87:0/1033860959 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb25c0255c0 con 0x7fb26c0fcbc0 2024-02-28T15:51:21.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.927+0000 7fb272c00700 1 -- 172.21.15.87:0/1033860959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c110460 con 0x7fb26c0fcbc0 2024-02-28T15:51:21.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.928+0000 7fb272c00700 1 -- 172.21.15.87:0/1033860959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c05f5c0 con 0x7fb26c0fcbc0 2024-02-28T15:51:21.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.928+0000 7fb263e00700 1 -- 172.21.15.87:0/1033860959 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7fb25c004d30 con 0x7fb26c0fcbc0 2024-02-28T15:51:21.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.929+0000 7fb263e00700 1 --2- 172.21.15.87:0/1033860959 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fb250036820 0x7fb250038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:21.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.929+0000 7fb263e00700 1 -- 172.21.15.87:0/1033860959 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb25c049ed0 con 0x7fb26c0fcbc0 2024-02-28T15:51:21.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.930+0000 7fb26b400700 1 --2- 172.21.15.87:0/1033860959 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fb250036820 0x7fb250038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:21.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.931+0000 7fb26b400700 1 --2- 172.21.15.87:0/1033860959 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fb250036820 0x7fb250038cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb258009990 tx=0x7fb258006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:21.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:21 smithi057 ceph-mon[28763]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:21.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:21 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:21.946+0000 7fb263e00700 1 -- 172.21.15.87:0/1033860959 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb25c011dd0 con 0x7fb26c0fcbc0 2024-02-28T15:51:22.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.238+0000 7fb272c00700 1 -- 172.21.15.87:0/1033860959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb26c102980 con 0x7fb26c0fcbc0 2024-02-28T15:51:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.239+0000 7fb263e00700 1 -- 172.21.15.87:0/1033860959 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb25c011370 con 0x7fb26c0fcbc0 2024-02-28T15:51:22.235 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:22.235 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.242+0000 7fb272c00700 1 -- 172.21.15.87:0/1033860959 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fb250036820 msgr2=0x7fb250038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.242+0000 7fb272c00700 1 --2- 172.21.15.87:0/1033860959 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fb250036820 0x7fb250038cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb258009990 tx=0x7fb258006e40 comp rx=0 tx=0).stop 2024-02-28T15:51:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.242+0000 7fb272c00700 1 -- 172.21.15.87:0/1033860959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb26c0fcbc0 msgr2=0x7fb26c10f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.242+0000 7fb272c00700 1 --2- 172.21.15.87:0/1033860959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb26c0fcbc0 0x7fb26c10f080 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009b80 tx=0x7fb25c009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.242+0000 7fb272c00700 1 -- 172.21.15.87:0/1033860959 shutdown_connections 2024-02-28T15:51:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.242+0000 7fb272c00700 1 --2- 172.21.15.87:0/1033860959 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fb250036820 0x7fb250038cd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.242+0000 7fb272c00700 1 --2- 172.21.15.87:0/1033860959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb26c0fcbc0 0x7fb26c10f080 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.242+0000 7fb272c00700 1 -- 172.21.15.87:0/1033860959 >> 172.21.15.87:0/1033860959 conn(0x7fb26c0f82a0 msgr2=0x7fb26c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.242+0000 7fb272c00700 1 -- 172.21.15.87:0/1033860959 shutdown_connections 2024-02-28T15:51:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:22.242+0000 7fb272c00700 1 -- 172.21.15.87:0/1033860959 wait complete. 2024-02-28T15:51:22.239 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:22.826 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:22 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/1033860959' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:23.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:23 smithi057 ceph-mon[28763]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:24.014 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:24.014 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:24.461 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:24.558 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:25.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:25 smithi057 ceph-mon[28763]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:26.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.457+0000 7f4c0be00700 1 -- 172.21.15.87:0/3517594197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c040fd700 msgr2=0x7f4c040ffae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:26.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.457+0000 7f4c0be00700 1 --2- 172.21.15.87:0/3517594197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c040fd700 0x7f4c040ffae0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80048c0 tx=0x7f4bf8009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:26.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.457+0000 7f4c0be00700 1 -- 172.21.15.87:0/3517594197 shutdown_connections 2024-02-28T15:51:26.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.457+0000 7f4c0be00700 1 --2- 172.21.15.87:0/3517594197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c040fd700 0x7f4c040ffae0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:26.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.457+0000 7f4c0be00700 1 -- 172.21.15.87:0/3517594197 >> 172.21.15.87:0/3517594197 conn(0x7f4c040f71a0 msgr2=0x7f4c040f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:26.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.457+0000 7f4c0be00700 1 -- 172.21.15.87:0/3517594197 shutdown_connections 2024-02-28T15:51:26.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.457+0000 7f4c0be00700 1 -- 172.21.15.87:0/3517594197 wait complete. 2024-02-28T15:51:26.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.458+0000 7f4c0be00700 1 Processor -- start 2024-02-28T15:51:26.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.459+0000 7f4c0be00700 1 -- start start 2024-02-28T15:51:26.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.459+0000 7f4c0be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c040fd700 0x7f4c0410f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:26.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.459+0000 7f4c0be00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0410f5d0 con 0x7f4c040fd700 2024-02-28T15:51:26.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.460+0000 7f4c09400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c040fd700 0x7f4c0410f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:26.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.460+0000 7f4c09400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c040fd700 0x7f4c0410f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:41796/0 (socket says 172.21.15.87:41796) 2024-02-28T15:51:26.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.460+0000 7f4c09400700 1 -- 172.21.15.87:0/3335348969 learned_addr learned my addr 172.21.15.87:0/3335348969 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:26.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.460+0000 7f4c09400700 1 -- 172.21.15.87:0/3335348969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8005040 con 0x7f4c040fd700 2024-02-28T15:51:26.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.461+0000 7f4c09400700 1 --2- 172.21.15.87:0/3335348969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c040fd700 0x7f4c0410f090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009b80 tx=0x7f4bf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:26.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.461+0000 7f4c01600700 1 -- 172.21.15.87:0/3335348969 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4bf800b5c0 con 0x7f4c040fd700 2024-02-28T15:51:26.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.461+0000 7f4c0be00700 1 -- 172.21.15.87:0/3335348969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0410f7d0 con 0x7f4c040fd700 2024-02-28T15:51:26.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.461+0000 7f4c01600700 1 -- 172.21.15.87:0/3335348969 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bf800be70 con 0x7f4c040fd700 2024-02-28T15:51:26.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.462+0000 7f4c01600700 1 -- 172.21.15.87:0/3335348969 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4bf801c660 con 0x7f4c040fd700 2024-02-28T15:51:26.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.462+0000 7f4c0be00700 1 -- 172.21.15.87:0/3335348969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c04110470 con 0x7f4c040fd700 2024-02-28T15:51:26.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.463+0000 7f4c0be00700 1 -- 172.21.15.87:0/3335348969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0405f5c0 con 0x7f4c040fd700 2024-02-28T15:51:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.463+0000 7f4c01600700 1 -- 172.21.15.87:0/3335348969 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f4bf8004d30 con 0x7f4c040fd700 2024-02-28T15:51:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.464+0000 7f4c01600700 1 --2- 172.21.15.87:0/3335348969 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f4bec036870 0x7f4bec038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.464+0000 7f4c01600700 1 -- 172.21.15.87:0/3335348969 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4bf804a010 con 0x7f4c040fd700 2024-02-28T15:51:26.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.465+0000 7f4c08a00700 1 --2- 172.21.15.87:0/3335348969 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f4bec036870 0x7f4bec038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:26.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.466+0000 7f4c08a00700 1 --2- 172.21.15.87:0/3335348969 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f4bec036870 0x7f4bec038d20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009990 tx=0x7f4bf0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:26.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.482+0000 7f4c01600700 1 -- 172.21.15.87:0/3335348969 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4bf80249b0 con 0x7f4c040fd700 2024-02-28T15:51:26.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.766+0000 7f4c0be00700 1 -- 172.21.15.87:0/3335348969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4c04110fc0 con 0x7f4c040fd700 2024-02-28T15:51:26.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.767+0000 7f4c01600700 1 -- 172.21.15.87:0/3335348969 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4bf8024360 con 0x7f4c040fd700 2024-02-28T15:51:26.762 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:26.762 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:26.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.770+0000 7f4c0be00700 1 -- 172.21.15.87:0/3335348969 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f4bec036870 msgr2=0x7f4bec038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:26.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.770+0000 7f4c0be00700 1 --2- 172.21.15.87:0/3335348969 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f4bec036870 0x7f4bec038d20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009990 tx=0x7f4bf0006e40 comp rx=0 tx=0).stop 2024-02-28T15:51:26.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.770+0000 7f4c0be00700 1 -- 172.21.15.87:0/3335348969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c040fd700 msgr2=0x7f4c0410f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:26.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.770+0000 7f4c0be00700 1 --2- 172.21.15.87:0/3335348969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c040fd700 0x7f4c0410f090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009b80 tx=0x7f4bf8009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:26.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.770+0000 7f4c0be00700 1 -- 172.21.15.87:0/3335348969 shutdown_connections 2024-02-28T15:51:26.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.771+0000 7f4c0be00700 1 --2- 172.21.15.87:0/3335348969 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f4bec036870 0x7f4bec038d20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:26.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.771+0000 7f4c0be00700 1 --2- 172.21.15.87:0/3335348969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c040fd700 0x7f4c0410f090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:26.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.771+0000 7f4c0be00700 1 -- 172.21.15.87:0/3335348969 >> 172.21.15.87:0/3335348969 conn(0x7f4c040f71a0 msgr2=0x7f4c040f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:26.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.771+0000 7f4c0be00700 1 -- 172.21.15.87:0/3335348969 shutdown_connections 2024-02-28T15:51:26.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:26.771+0000 7f4c0be00700 1 -- 172.21.15.87:0/3335348969 wait complete. 2024-02-28T15:51:26.766 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:27.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:27 smithi057 ceph-mon[28763]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:27.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:27 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/3335348969' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:28.476 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:28.477 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:28.914 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:29.016 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:29.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:29 smithi057 ceph-mon[28763]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:31.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.071+0000 7fa768200700 1 -- 172.21.15.87:0/3371231226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7600fee20 msgr2=0x7fa7600ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:31.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.071+0000 7fa768200700 1 --2- 172.21.15.87:0/3371231226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7600fee20 0x7fa7600ff230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa7540048c0 tx=0x7fa754009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:31.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.071+0000 7fa768200700 1 -- 172.21.15.87:0/3371231226 shutdown_connections 2024-02-28T15:51:31.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.071+0000 7fa768200700 1 --2- 172.21.15.87:0/3371231226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7600fee20 0x7fa7600ff230 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:31.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.071+0000 7fa768200700 1 -- 172.21.15.87:0/3371231226 >> 172.21.15.87:0/3371231226 conn(0x7fa7600fa760 msgr2=0x7fa7600fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:31.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.071+0000 7fa768200700 1 -- 172.21.15.87:0/3371231226 shutdown_connections 2024-02-28T15:51:31.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.071+0000 7fa768200700 1 -- 172.21.15.87:0/3371231226 wait complete. 2024-02-28T15:51:31.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.072+0000 7fa768200700 1 Processor -- start 2024-02-28T15:51:31.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.072+0000 7fa768200700 1 -- start start 2024-02-28T15:51:31.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.073+0000 7fa768200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7600fee20 0x7fa76010f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:31.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.073+0000 7fa768200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76010f5d0 con 0x7fa7600fee20 2024-02-28T15:51:31.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.073+0000 7fa765800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7600fee20 0x7fa76010f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:31.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.073+0000 7fa765800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7600fee20 0x7fa76010f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:45658/0 (socket says 172.21.15.87:45658) 2024-02-28T15:51:31.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.073+0000 7fa765800700 1 -- 172.21.15.87:0/915793604 learned_addr learned my addr 172.21.15.87:0/915793604 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:31.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.074+0000 7fa765800700 1 -- 172.21.15.87:0/915793604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754005040 con 0x7fa7600fee20 2024-02-28T15:51:31.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.074+0000 7fa765800700 1 --2- 172.21.15.87:0/915793604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7600fee20 0x7fa76010f090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa754009b80 tx=0x7fa754009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:31.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.075+0000 7fa75d600700 1 -- 172.21.15.87:0/915793604 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa75400b5c0 con 0x7fa7600fee20 2024-02-28T15:51:31.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.075+0000 7fa768200700 1 -- 172.21.15.87:0/915793604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76010f7d0 con 0x7fa7600fee20 2024-02-28T15:51:31.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.075+0000 7fa75d600700 1 -- 172.21.15.87:0/915793604 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa75400be70 con 0x7fa7600fee20 2024-02-28T15:51:31.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.075+0000 7fa75d600700 1 -- 172.21.15.87:0/915793604 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa75401c660 con 0x7fa7600fee20 2024-02-28T15:51:31.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.075+0000 7fa768200700 1 -- 172.21.15.87:0/915793604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa760110470 con 0x7fa7600fee20 2024-02-28T15:51:31.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.076+0000 7fa768200700 1 -- 172.21.15.87:0/915793604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76005f5c0 con 0x7fa7600fee20 2024-02-28T15:51:31.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.076+0000 7fa75d600700 1 -- 172.21.15.87:0/915793604 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7fa754004d30 con 0x7fa7600fee20 2024-02-28T15:51:31.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.077+0000 7fa75d600700 1 --2- 172.21.15.87:0/915793604 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa7480368c0 0x7fa748038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:31.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.077+0000 7fa75d600700 1 -- 172.21.15.87:0/915793604 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa7540499a0 con 0x7fa7600fee20 2024-02-28T15:51:31.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.077+0000 7fa764e00700 1 --2- 172.21.15.87:0/915793604 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa7480368c0 0x7fa748038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:31.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.078+0000 7fa764e00700 1 --2- 172.21.15.87:0/915793604 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa7480368c0 0x7fa748038d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009990 tx=0x7fa74c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:31.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.089+0000 7fa75d600700 1 -- 172.21.15.87:0/915793604 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa754025400 con 0x7fa7600fee20 2024-02-28T15:51:31.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:30 smithi057 ceph-mon[28763]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:31.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.368+0000 7fa768200700 1 -- 172.21.15.87:0/915793604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa760110fc0 con 0x7fa7600fee20 2024-02-28T15:51:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.370+0000 7fa75d600700 1 -- 172.21.15.87:0/915793604 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa754023300 con 0x7fa7600fee20 2024-02-28T15:51:31.364 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:31.365 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.372+0000 7fa768200700 1 -- 172.21.15.87:0/915793604 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa7480368c0 msgr2=0x7fa748038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.372+0000 7fa768200700 1 --2- 172.21.15.87:0/915793604 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa7480368c0 0x7fa748038d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009990 tx=0x7fa74c006e40 comp rx=0 tx=0).stop 2024-02-28T15:51:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.372+0000 7fa768200700 1 -- 172.21.15.87:0/915793604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7600fee20 msgr2=0x7fa76010f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.372+0000 7fa768200700 1 --2- 172.21.15.87:0/915793604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7600fee20 0x7fa76010f090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa754009b80 tx=0x7fa754009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.372+0000 7fa768200700 1 -- 172.21.15.87:0/915793604 shutdown_connections 2024-02-28T15:51:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.372+0000 7fa768200700 1 --2- 172.21.15.87:0/915793604 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7fa7480368c0 0x7fa748038d70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.372+0000 7fa768200700 1 --2- 172.21.15.87:0/915793604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7600fee20 0x7fa76010f090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.372+0000 7fa768200700 1 -- 172.21.15.87:0/915793604 >> 172.21.15.87:0/915793604 conn(0x7fa7600fa760 msgr2=0x7fa7600fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.372+0000 7fa768200700 1 -- 172.21.15.87:0/915793604 shutdown_connections 2024-02-28T15:51:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:31.373+0000 7fa768200700 1 -- 172.21.15.87:0/915793604 wait complete. 2024-02-28T15:51:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:32.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:31 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/915793604' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:33.033 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:33.033 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:33.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:32 smithi057 ceph-mon[28763]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:33.482 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:33.593 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:35.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:35 smithi057 ceph-mon[28763]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:35.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.688+0000 7f03b2e00700 1 -- 172.21.15.87:0/3400037250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1031d0 msgr2=0x7f03ac1035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:35.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.688+0000 7f03b2e00700 1 --2- 172.21.15.87:0/3400037250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1031d0 0x7f03ac1035e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f039c0048c0 tx=0x7f039c009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:35.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.688+0000 7f03b2e00700 1 -- 172.21.15.87:0/3400037250 shutdown_connections 2024-02-28T15:51:35.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.688+0000 7f03b2e00700 1 --2- 172.21.15.87:0/3400037250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1031d0 0x7f03ac1035e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:35.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.688+0000 7f03b2e00700 1 -- 172.21.15.87:0/3400037250 >> 172.21.15.87:0/3400037250 conn(0x7f03ac0722d0 msgr2=0x7f03ac0746e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:35.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.688+0000 7f03b2e00700 1 -- 172.21.15.87:0/3400037250 shutdown_connections 2024-02-28T15:51:35.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.688+0000 7f03b2e00700 1 -- 172.21.15.87:0/3400037250 wait complete. 2024-02-28T15:51:35.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.690+0000 7f03b2e00700 1 Processor -- start 2024-02-28T15:51:35.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.690+0000 7f03b2e00700 1 -- start start 2024-02-28T15:51:35.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.691+0000 7f03b2e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1031d0 0x7f03ac1134e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:35.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.691+0000 7f03b2e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac113a20 con 0x7f03ac1031d0 2024-02-28T15:51:35.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.691+0000 7f03abe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1031d0 0x7f03ac1134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:35.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.691+0000 7f03abe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1031d0 0x7f03ac1134e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:45662/0 (socket says 172.21.15.87:45662) 2024-02-28T15:51:35.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.691+0000 7f03abe00700 1 -- 172.21.15.87:0/392753774 learned_addr learned my addr 172.21.15.87:0/392753774 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:35.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.692+0000 7f03abe00700 1 -- 172.21.15.87:0/392753774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c005040 con 0x7f03ac1031d0 2024-02-28T15:51:35.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.692+0000 7f03abe00700 1 --2- 172.21.15.87:0/392753774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1031d0 0x7f03ac1134e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f039c009680 tx=0x7f039c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:35.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.693+0000 7f03a3e00700 1 -- 172.21.15.87:0/392753774 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f039c00bed0 con 0x7f03ac1031d0 2024-02-28T15:51:35.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.693+0000 7f03a3e00700 1 -- 172.21.15.87:0/392753774 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f039c00b5c0 con 0x7f03ac1031d0 2024-02-28T15:51:35.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.693+0000 7f03a3e00700 1 -- 172.21.15.87:0/392753774 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f039c01c5b0 con 0x7f03ac1031d0 2024-02-28T15:51:35.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.693+0000 7f03b2e00700 1 -- 172.21.15.87:0/392753774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac113c20 con 0x7f03ac1031d0 2024-02-28T15:51:35.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.693+0000 7f03b2e00700 1 -- 172.21.15.87:0/392753774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac1148c0 con 0x7f03ac1031d0 2024-02-28T15:51:35.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.694+0000 7f03b2e00700 1 -- 172.21.15.87:0/392753774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac05f5c0 con 0x7f03ac1031d0 2024-02-28T15:51:35.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.695+0000 7f03a3e00700 1 -- 172.21.15.87:0/392753774 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f039c013a80 con 0x7f03ac1031d0 2024-02-28T15:51:35.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.695+0000 7f03a3e00700 1 --2- 172.21.15.87:0/392753774 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f0390036820 0x7f0390038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:35.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.695+0000 7f03a3e00700 1 -- 172.21.15.87:0/392753774 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f039c04a050 con 0x7f03ac1031d0 2024-02-28T15:51:35.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.696+0000 7f03ab400700 1 --2- 172.21.15.87:0/392753774 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f0390036820 0x7f0390038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:35.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.697+0000 7f03ab400700 1 --2- 172.21.15.87:0/392753774 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f0390036820 0x7f0390038cd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0398009990 tx=0x7f0398006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.710+0000 7f03a3e00700 1 -- 172.21.15.87:0/392753774 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f039c0249b0 con 0x7f03ac1031d0 2024-02-28T15:51:35.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.996+0000 7f03b2e00700 1 -- 172.21.15.87:0/392753774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f03ac115410 con 0x7f03ac1031d0 2024-02-28T15:51:35.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:35.997+0000 7f03a3e00700 1 -- 172.21.15.87:0/392753774 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f039c024360 con 0x7f03ac1031d0 2024-02-28T15:51:35.992 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:35.992 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:35.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:36.000+0000 7f03b2e00700 1 -- 172.21.15.87:0/392753774 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f0390036820 msgr2=0x7f0390038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:35.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:36.000+0000 7f03b2e00700 1 --2- 172.21.15.87:0/392753774 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f0390036820 0x7f0390038cd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0398009990 tx=0x7f0398006e40 comp rx=0 tx=0).stop 2024-02-28T15:51:35.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:36.000+0000 7f03b2e00700 1 -- 172.21.15.87:0/392753774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1031d0 msgr2=0x7f03ac1134e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:35.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:36.000+0000 7f03b2e00700 1 --2- 172.21.15.87:0/392753774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1031d0 0x7f03ac1134e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f039c009680 tx=0x7f039c009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:35.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:36.000+0000 7f03b2e00700 1 -- 172.21.15.87:0/392753774 shutdown_connections 2024-02-28T15:51:35.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:36.000+0000 7f03b2e00700 1 --2- 172.21.15.87:0/392753774 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f0390036820 0x7f0390038cd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:35.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:36.000+0000 7f03b2e00700 1 --2- 172.21.15.87:0/392753774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1031d0 0x7f03ac1134e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:35.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:36.000+0000 7f03b2e00700 1 -- 172.21.15.87:0/392753774 >> 172.21.15.87:0/392753774 conn(0x7f03ac0722d0 msgr2=0x7f03ac073030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:35.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:36.000+0000 7f03b2e00700 1 -- 172.21.15.87:0/392753774 shutdown_connections 2024-02-28T15:51:35.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:36.000+0000 7f03b2e00700 1 -- 172.21.15.87:0/392753774 wait complete. 2024-02-28T15:51:35.996 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:36.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:36 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/392753774' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:37.555 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:37 smithi057 ceph-mon[28763]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:37.738 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:37.739 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:38.292 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:39.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:39 smithi057 ceph-mon[28763]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.285+0000 7f9b6c800700 1 -- 172.21.15.87:0/1237060084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b640fedd0 msgr2=0x7f9b640ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.285+0000 7f9b6c800700 1 --2- 172.21.15.87:0/1237060084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b640fedd0 0x7f9b640ff1e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b580048c0 tx=0x7f9b58009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.285+0000 7f9b6c800700 1 -- 172.21.15.87:0/1237060084 shutdown_connections 2024-02-28T15:51:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.285+0000 7f9b6c800700 1 --2- 172.21.15.87:0/1237060084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b640fedd0 0x7f9b640ff1e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.285+0000 7f9b6c800700 1 -- 172.21.15.87:0/1237060084 >> 172.21.15.87:0/1237060084 conn(0x7f9b640fa5a0 msgr2=0x7f9b640fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.286+0000 7f9b6c800700 1 -- 172.21.15.87:0/1237060084 shutdown_connections 2024-02-28T15:51:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.286+0000 7f9b6c800700 1 -- 172.21.15.87:0/1237060084 wait complete. 2024-02-28T15:51:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.286+0000 7f9b6c800700 1 Processor -- start 2024-02-28T15:51:40.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.287+0000 7f9b6c800700 1 -- start start 2024-02-28T15:51:40.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.287+0000 7f9b6c800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b640fedd0 0x7f9b6410f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:40.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.287+0000 7f9b6c800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6410f630 con 0x7f9b640fedd0 2024-02-28T15:51:40.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.287+0000 7f9b69e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b640fedd0 0x7f9b6410f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:40.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.287+0000 7f9b69e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b640fedd0 0x7f9b6410f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:45680/0 (socket says 172.21.15.87:45680) 2024-02-28T15:51:40.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.287+0000 7f9b69e00700 1 -- 172.21.15.87:0/168832809 learned_addr learned my addr 172.21.15.87:0/168832809 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.288+0000 7f9b69e00700 1 -- 172.21.15.87:0/168832809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b58005040 con 0x7f9b640fedd0 2024-02-28T15:51:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.288+0000 7f9b69e00700 1 --2- 172.21.15.87:0/168832809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b640fedd0 0x7f9b6410f0f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009b80 tx=0x7f9b58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.288+0000 7f9b5e000700 1 -- 172.21.15.87:0/168832809 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b5800b5c0 con 0x7f9b640fedd0 2024-02-28T15:51:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.288+0000 7f9b5e000700 1 -- 172.21.15.87:0/168832809 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b5800be70 con 0x7f9b640fedd0 2024-02-28T15:51:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.288+0000 7f9b5e000700 1 -- 172.21.15.87:0/168832809 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b5801c660 con 0x7f9b640fedd0 2024-02-28T15:51:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.288+0000 7f9b6c800700 1 -- 172.21.15.87:0/168832809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6410f830 con 0x7f9b640fedd0 2024-02-28T15:51:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.289+0000 7f9b6c800700 1 -- 172.21.15.87:0/168832809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b641104d0 con 0x7f9b640fedd0 2024-02-28T15:51:40.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.290+0000 7f9b5e000700 1 -- 172.21.15.87:0/168832809 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43424+0+0 (secure 0 0 0) 0x7f9b58004d30 con 0x7f9b640fedd0 2024-02-28T15:51:40.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.290+0000 7f9b6c800700 1 -- 172.21.15.87:0/168832809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6405f5c0 con 0x7f9b640fedd0 2024-02-28T15:51:40.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.290+0000 7f9b5e000700 1 --2- 172.21.15.87:0/168832809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9b4c0368c0 0x7f9b4c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:40.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.290+0000 7f9b5e000700 1 -- 172.21.15.87:0/168832809 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9b58049a60 con 0x7f9b640fedd0 2024-02-28T15:51:40.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.291+0000 7f9b69400700 1 --2- 172.21.15.87:0/168832809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9b4c0368c0 0x7f9b4c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:40.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.292+0000 7f9b69400700 1 --2- 172.21.15.87:0/168832809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9b4c0368c0 0x7f9b4c038d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009990 tx=0x7f9b50006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:40.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.296+0000 7f9b5e000700 1 -- 172.21.15.87:0/168832809 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9b58025400 con 0x7f9b640fedd0 2024-02-28T15:51:40.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.584+0000 7f9b6c800700 1 -- 172.21.15.87:0/168832809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9b64111040 con 0x7f9b640fedd0 2024-02-28T15:51:40.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.585+0000 7f9b5e000700 1 -- 172.21.15.87:0/168832809 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9b58023300 con 0x7f9b640fedd0 2024-02-28T15:51:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:40.580 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.588+0000 7f9b6c800700 1 -- 172.21.15.87:0/168832809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9b4c0368c0 msgr2=0x7f9b4c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.588+0000 7f9b6c800700 1 --2- 172.21.15.87:0/168832809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9b4c0368c0 0x7f9b4c038d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009990 tx=0x7f9b50006e40 comp rx=0 tx=0).stop 2024-02-28T15:51:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.588+0000 7f9b6c800700 1 -- 172.21.15.87:0/168832809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b640fedd0 msgr2=0x7f9b6410f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.588+0000 7f9b6c800700 1 --2- 172.21.15.87:0/168832809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b640fedd0 0x7f9b6410f0f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009b80 tx=0x7f9b58009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.588+0000 7f9b6c800700 1 -- 172.21.15.87:0/168832809 shutdown_connections 2024-02-28T15:51:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.588+0000 7f9b6c800700 1 --2- 172.21.15.87:0/168832809 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f9b4c0368c0 0x7f9b4c038d70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.588+0000 7f9b6c800700 1 --2- 172.21.15.87:0/168832809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b640fedd0 0x7f9b6410f0f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.588+0000 7f9b6c800700 1 -- 172.21.15.87:0/168832809 >> 172.21.15.87:0/168832809 conn(0x7f9b640fa5a0 msgr2=0x7f9b640fc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.588+0000 7f9b6c800700 1 -- 172.21.15.87:0/168832809 shutdown_connections 2024-02-28T15:51:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:40.589+0000 7f9b6c800700 1 -- 172.21.15.87:0/168832809 wait complete. 2024-02-28T15:51:40.584 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:40.916 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:40 smithi057 ceph-mon[28763]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:51:40.916 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:40 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/168832809' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:42.272 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:42.272 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:42.733 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:42.833 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:42.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:42 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:42.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:42 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:42.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:42 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:42.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:42 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-28T15:51:43.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:43 smithi057 ceph-mon[28763]: from='mgr.14162 172.21.15.57:0/420974734' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-28T15:51:43.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:43 smithi057 ceph-mon[28763]: mgrmap e14: smithi057.upqerc(active, since 86s) 2024-02-28T15:51:44.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.922+0000 7faaabe00700 1 -- 172.21.15.87:0/3271684706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0fec60 msgr2=0x7faaac0ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:44.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.922+0000 7faaabe00700 1 --2- 172.21.15.87:0/3271684706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0fec60 0x7faaac0ff070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009c60 tx=0x7faa9c004d10 comp rx=0 tx=0).stop 2024-02-28T15:51:44.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.922+0000 7faaabe00700 1 -- 172.21.15.87:0/3271684706 shutdown_connections 2024-02-28T15:51:44.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.922+0000 7faaabe00700 1 --2- 172.21.15.87:0/3271684706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0fec60 0x7faaac0ff070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:44.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.922+0000 7faaabe00700 1 -- 172.21.15.87:0/3271684706 >> 172.21.15.87:0/3271684706 conn(0x7faaac0fa5a0 msgr2=0x7faaac0fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:44.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.922+0000 7faaabe00700 1 -- 172.21.15.87:0/3271684706 shutdown_connections 2024-02-28T15:51:44.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.922+0000 7faaabe00700 1 -- 172.21.15.87:0/3271684706 wait complete. 2024-02-28T15:51:44.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.923+0000 7faaabe00700 1 Processor -- start 2024-02-28T15:51:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.923+0000 7faaabe00700 1 -- start start 2024-02-28T15:51:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.924+0000 7faaabe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0fec60 0x7faaac10eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.924+0000 7faaabe00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac10f410 con 0x7faaac0fec60 2024-02-28T15:51:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.924+0000 7faaaaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0fec60 0x7faaac10eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.924+0000 7faaaaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0fec60 0x7faaac10eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:55644/0 (socket says 172.21.15.87:55644) 2024-02-28T15:51:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.924+0000 7faaaaa00700 1 -- 172.21.15.87:0/4003039713 learned_addr learned my addr 172.21.15.87:0/4003039713 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.925+0000 7faaaaa00700 1 -- 172.21.15.87:0/4003039713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c009940 con 0x7faaac0fec60 2024-02-28T15:51:44.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.926+0000 7faaaaa00700 1 --2- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0fec60 0x7faaac10eed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0097d0 tx=0x7faa9c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:44.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.926+0000 7faaa3400700 1 -- 172.21.15.87:0/4003039713 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa9c01d440 con 0x7faaac0fec60 2024-02-28T15:51:44.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.926+0000 7faaa3400700 1 -- 172.21.15.87:0/4003039713 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa9c01da70 con 0x7faaac0fec60 2024-02-28T15:51:44.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.926+0000 7faaabe00700 1 -- 172.21.15.87:0/4003039713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac10f610 con 0x7faaac0fec60 2024-02-28T15:51:44.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.926+0000 7faaa3400700 1 -- 172.21.15.87:0/4003039713 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa9c012a10 con 0x7faaac0fec60 2024-02-28T15:51:44.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.926+0000 7faaabe00700 1 -- 172.21.15.87:0/4003039713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac1102b0 con 0x7faaac0fec60 2024-02-28T15:51:44.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.927+0000 7faaabe00700 1 -- 172.21.15.87:0/4003039713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac05f5c0 con 0x7faaac0fec60 2024-02-28T15:51:44.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.927+0000 7faaa3400700 1 -- 172.21.15.87:0/4003039713 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 14) v1 ==== 43438+0+0 (secure 0 0 0) 0x7faa9c019040 con 0x7faaac0fec60 2024-02-28T15:51:44.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.928+0000 7faaa3400700 1 --2- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7faa90036910 0x7faa90038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:44.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.928+0000 7faaa3400700 1 -- 172.21.15.87:0/4003039713 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7faa9c04a2f0 con 0x7faaac0fec60 2024-02-28T15:51:44.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.928+0000 7faaa2000700 1 -- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7faa90036910 msgr2=0x7faa90038dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/4162336432 2024-02-28T15:51:44.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.928+0000 7faaa2000700 1 --2- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7faa90036910 0x7faa90038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T15:51:44.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:44.933+0000 7faaa3400700 1 -- 172.21.15.87:0/4003039713 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7faa9c012410 con 0x7faaac0fec60 2024-02-28T15:51:45.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.129+0000 7faaa2000700 1 -- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7faa90036910 msgr2=0x7faa90038dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/4162336432 2024-02-28T15:51:45.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.129+0000 7faaa2000700 1 --2- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7faa90036910 0x7faa90038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T15:51:45.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.220+0000 7faaabe00700 1 -- 172.21.15.87:0/4003039713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faaac110da0 con 0x7faaac0fec60 2024-02-28T15:51:45.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.221+0000 7faaa3400700 1 -- 172.21.15.87:0/4003039713 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7faa9c017020 con 0x7faaac0fec60 2024-02-28T15:51:45.215 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:45.215 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.223+0000 7faaabe00700 1 -- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7faa90036910 msgr2=0x7faa90038dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T15:51:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.223+0000 7faaabe00700 1 --2- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7faa90036910 0x7faa90038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.223+0000 7faaabe00700 1 -- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0fec60 msgr2=0x7faaac10eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.223+0000 7faaabe00700 1 --2- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0fec60 0x7faaac10eed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0097d0 tx=0x7faa9c004d10 comp rx=0 tx=0).stop 2024-02-28T15:51:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.224+0000 7faaabe00700 1 -- 172.21.15.87:0/4003039713 shutdown_connections 2024-02-28T15:51:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.224+0000 7faaabe00700 1 --2- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7faa90036910 0x7faa90038dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.224+0000 7faaabe00700 1 --2- 172.21.15.87:0/4003039713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0fec60 0x7faaac10eed0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:45.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.224+0000 7faaabe00700 1 -- 172.21.15.87:0/4003039713 >> 172.21.15.87:0/4003039713 conn(0x7faaac0fa5a0 msgr2=0x7faaac0fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:45.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.224+0000 7faaabe00700 1 -- 172.21.15.87:0/4003039713 shutdown_connections 2024-02-28T15:51:45.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:45.224+0000 7faaabe00700 1 -- 172.21.15.87:0/4003039713 wait complete. 2024-02-28T15:51:45.219 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:46.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:45 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/4003039713' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:46.916 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:46.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:47.362 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:47.465 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:49.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.353+0000 7f1447400700 1 -- 172.21.15.87:0/667403767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1440071f10 msgr2=0x7f1440070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:49.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.353+0000 7f1447400700 1 --2- 172.21.15.87:0/667403767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1440071f10 0x7f1440070380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f14340048c0 tx=0x7f1434009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:49.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.353+0000 7f1447400700 1 -- 172.21.15.87:0/667403767 shutdown_connections 2024-02-28T15:51:49.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.353+0000 7f1447400700 1 --2- 172.21.15.87:0/667403767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1440071f10 0x7f1440070380 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:49.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.353+0000 7f1447400700 1 -- 172.21.15.87:0/667403767 >> 172.21.15.87:0/667403767 conn(0x7f14400f82a0 msgr2=0x7f14400fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:49.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.353+0000 7f1447400700 1 -- 172.21.15.87:0/667403767 shutdown_connections 2024-02-28T15:51:49.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.353+0000 7f1447400700 1 -- 172.21.15.87:0/667403767 wait complete. 2024-02-28T15:51:49.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.354+0000 7f1447400700 1 Processor -- start 2024-02-28T15:51:49.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.354+0000 7f1447400700 1 -- start start 2024-02-28T15:51:49.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.354+0000 7f1447400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1440071f10 0x7f1440113480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:49.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.354+0000 7f1447400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14401139c0 con 0x7f1440071f10 2024-02-28T15:51:49.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.355+0000 7f1444a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1440071f10 0x7f1440113480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:49.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.355+0000 7f1444a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1440071f10 0x7f1440113480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:55662/0 (socket says 172.21.15.87:55662) 2024-02-28T15:51:49.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.355+0000 7f1444a00700 1 -- 172.21.15.87:0/1808526258 learned_addr learned my addr 172.21.15.87:0/1808526258 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:49.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.355+0000 7f1444a00700 1 -- 172.21.15.87:0/1808526258 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434005040 con 0x7f1440071f10 2024-02-28T15:51:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.356+0000 7f1444a00700 1 --2- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1440071f10 0x7f1440113480 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1434009b80 tx=0x7f1434009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.356+0000 7f143cc00700 1 -- 172.21.15.87:0/1808526258 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f143400b5c0 con 0x7f1440071f10 2024-02-28T15:51:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.356+0000 7f1447400700 1 -- 172.21.15.87:0/1808526258 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1440113bc0 con 0x7f1440071f10 2024-02-28T15:51:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.356+0000 7f143cc00700 1 -- 172.21.15.87:0/1808526258 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f143400be70 con 0x7f1440071f10 2024-02-28T15:51:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.356+0000 7f143cc00700 1 -- 172.21.15.87:0/1808526258 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f143401c660 con 0x7f1440071f10 2024-02-28T15:51:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.356+0000 7f1447400700 1 -- 172.21.15.87:0/1808526258 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1440114860 con 0x7f1440071f10 2024-02-28T15:51:49.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.357+0000 7f1447400700 1 -- 172.21.15.87:0/1808526258 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144005f5c0 con 0x7f1440071f10 2024-02-28T15:51:49.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.357+0000 7f143cc00700 1 -- 172.21.15.87:0/1808526258 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 14) v1 ==== 43438+0+0 (secure 0 0 0) 0x7f1434004d30 con 0x7f1440071f10 2024-02-28T15:51:49.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.358+0000 7f143cc00700 1 --2- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1428036910 0x7f1428038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:49.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.358+0000 7f143cc00700 1 -- 172.21.15.87:0/1808526258 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1434049b40 con 0x7f1440071f10 2024-02-28T15:51:49.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.358+0000 7f143fe00700 1 -- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1428036910 msgr2=0x7f1428038dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/4162336432 2024-02-28T15:51:49.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.358+0000 7f143fe00700 1 --2- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1428036910 0x7f1428038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T15:51:49.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.372+0000 7f143cc00700 1 -- 172.21.15.87:0/1808526258 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1434025400 con 0x7f1440071f10 2024-02-28T15:51:49.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.559+0000 7f143fe00700 1 -- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1428036910 msgr2=0x7f1428038dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/4162336432 2024-02-28T15:51:49.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.559+0000 7f143fe00700 1 --2- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1428036910 0x7f1428038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T15:51:49.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.660+0000 7f1447400700 1 -- 172.21.15.87:0/1808526258 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f14401153d0 con 0x7f1440071f10 2024-02-28T15:51:49.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.661+0000 7f143cc00700 1 -- 172.21.15.87:0/1808526258 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1434011370 con 0x7f1440071f10 2024-02-28T15:51:49.655 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:49.655 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:49.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.663+0000 7f1447400700 1 -- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1428036910 msgr2=0x7f1428038dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T15:51:49.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.663+0000 7f1447400700 1 --2- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1428036910 0x7f1428038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:49.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.663+0000 7f1447400700 1 -- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1440071f10 msgr2=0x7f1440113480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:49.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.663+0000 7f1447400700 1 --2- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1440071f10 0x7f1440113480 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1434009b80 tx=0x7f1434009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:49.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.664+0000 7f1447400700 1 -- 172.21.15.87:0/1808526258 shutdown_connections 2024-02-28T15:51:49.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.664+0000 7f1447400700 1 --2- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:6800/4162336432,v1:172.21.15.57:6801/4162336432] conn(0x7f1428036910 0x7f1428038dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:49.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.664+0000 7f1447400700 1 --2- 172.21.15.87:0/1808526258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1440071f10 0x7f1440113480 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:49.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.664+0000 7f1447400700 1 -- 172.21.15.87:0/1808526258 >> 172.21.15.87:0/1808526258 conn(0x7f14400f82a0 msgr2=0x7f14400f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:49.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.664+0000 7f1447400700 1 -- 172.21.15.87:0/1808526258 shutdown_connections 2024-02-28T15:51:49.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:49.664+0000 7f1447400700 1 -- 172.21.15.87:0/1808526258 wait complete. 2024-02-28T15:51:49.659 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:50.131 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:49 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/1808526258' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:51.451 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:51.451 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: Active manager daemon smithi057.upqerc restarted 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: Activating manager daemon smithi057.upqerc 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: mgrmap e15: smithi057.upqerc(active, starting, since 0.00491405s) 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: Manager daemon smithi057.upqerc is now available 2024-02-28T15:51:51.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:51:51.915 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:52.018 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:52.544 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:51:52.544 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:52.544 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:51:52.544 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T15:51:52.544 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T15:51:52.545 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:52 smithi057 ceph-mon[28763]: [28/Feb/2024:15:51:51] ENGINE Bus STARTING 2024-02-28T15:51:52.545 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:52.545 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:52.545 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:52 smithi057 ceph-mon[28763]: mgrmap e16: smithi057.upqerc(active, since 1.0129s) 2024-02-28T15:51:53.617 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:53 smithi057 ceph-mon[28763]: [28/Feb/2024:15:51:51] ENGINE Serving on https://172.21.15.57:7150 2024-02-28T15:51:53.618 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:53 smithi057 ceph-mon[28763]: [28/Feb/2024:15:51:51] ENGINE Bus STARTED 2024-02-28T15:51:54.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.132+0000 7fbc2ae00700 1 -- 172.21.15.87:0/3588310130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc24071f10 msgr2=0x7fbc24070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:54.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.132+0000 7fbc2ae00700 1 --2- 172.21.15.87:0/3588310130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc24071f10 0x7fbc24070380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbc180048c0 tx=0x7fbc18009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:54.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.132+0000 7fbc2ae00700 1 -- 172.21.15.87:0/3588310130 shutdown_connections 2024-02-28T15:51:54.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.132+0000 7fbc2ae00700 1 --2- 172.21.15.87:0/3588310130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc24071f10 0x7fbc24070380 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:54.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.132+0000 7fbc2ae00700 1 -- 172.21.15.87:0/3588310130 >> 172.21.15.87:0/3588310130 conn(0x7fbc240f80c0 msgr2=0x7fbc240fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:54.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.133+0000 7fbc2ae00700 1 -- 172.21.15.87:0/3588310130 shutdown_connections 2024-02-28T15:51:54.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.133+0000 7fbc2ae00700 1 -- 172.21.15.87:0/3588310130 wait complete. 2024-02-28T15:51:54.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.133+0000 7fbc2ae00700 1 Processor -- start 2024-02-28T15:51:54.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.134+0000 7fbc2ae00700 1 -- start start 2024-02-28T15:51:54.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.134+0000 7fbc2ae00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc24071f10 0x7fbc2410eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:54.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.134+0000 7fbc2ae00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2410f420 con 0x7fbc24071f10 2024-02-28T15:51:54.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.134+0000 7fbc29a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc24071f10 0x7fbc2410eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:54.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.135+0000 7fbc29a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc24071f10 0x7fbc2410eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:44152/0 (socket says 172.21.15.87:44152) 2024-02-28T15:51:54.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.135+0000 7fbc29a00700 1 -- 172.21.15.87:0/1342422760 learned_addr learned my addr 172.21.15.87:0/1342422760 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:54.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.135+0000 7fbc29a00700 1 -- 172.21.15.87:0/1342422760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc18005040 con 0x7fbc24071f10 2024-02-28T15:51:54.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.136+0000 7fbc29a00700 1 --2- 172.21.15.87:0/1342422760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc24071f10 0x7fbc2410eee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009680 tx=0x7fbc18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:54.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.136+0000 7fbc21600700 1 -- 172.21.15.87:0/1342422760 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc1800b5c0 con 0x7fbc24071f10 2024-02-28T15:51:54.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.136+0000 7fbc2ae00700 1 -- 172.21.15.87:0/1342422760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2410f620 con 0x7fbc24071f10 2024-02-28T15:51:54.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.136+0000 7fbc21600700 1 -- 172.21.15.87:0/1342422760 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc18004e60 con 0x7fbc24071f10 2024-02-28T15:51:54.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.136+0000 7fbc21600700 1 -- 172.21.15.87:0/1342422760 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc1801c590 con 0x7fbc24071f10 2024-02-28T15:51:54.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.137+0000 7fbc2ae00700 1 -- 172.21.15.87:0/1342422760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc241102c0 con 0x7fbc24071f10 2024-02-28T15:51:54.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.138+0000 7fbc2ae00700 1 -- 172.21.15.87:0/1342422760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2405f5c0 con 0x7fbc24071f10 2024-02-28T15:51:54.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.138+0000 7fbc21600700 1 -- 172.21.15.87:0/1342422760 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7fbc18013a80 con 0x7fbc24071f10 2024-02-28T15:51:54.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.139+0000 7fbc21600700 1 --2- 172.21.15.87:0/1342422760 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fbc0c036960 0x7fbc0c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:54.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.139+0000 7fbc21600700 1 -- 172.21.15.87:0/1342422760 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fbc18049b50 con 0x7fbc24071f10 2024-02-28T15:51:54.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.140+0000 7fbc29000700 1 --2- 172.21.15.87:0/1342422760 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fbc0c036960 0x7fbc0c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:54.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.141+0000 7fbc29000700 1 --2- 172.21.15.87:0/1342422760 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fbc0c036960 0x7fbc0c038e10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009990 tx=0x7fbc10006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:54.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.147+0000 7fbc21600700 1 -- 172.21.15.87:0/1342422760 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fbc1801c810 con 0x7fbc24071f10 2024-02-28T15:51:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.433+0000 7fbc2ae00700 1 -- 172.21.15.87:0/1342422760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbc24110e30 con 0x7fbc24071f10 2024-02-28T15:51:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.434+0000 7fbc21600700 1 -- 172.21.15.87:0/1342422760 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fbc18024b50 con 0x7fbc24071f10 2024-02-28T15:51:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:51:54.430 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:51:54.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.437+0000 7fbc2ae00700 1 -- 172.21.15.87:0/1342422760 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fbc0c036960 msgr2=0x7fbc0c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:54.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.437+0000 7fbc2ae00700 1 --2- 172.21.15.87:0/1342422760 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fbc0c036960 0x7fbc0c038e10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009990 tx=0x7fbc10006e40 comp rx=0 tx=0).stop 2024-02-28T15:51:54.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.437+0000 7fbc2ae00700 1 -- 172.21.15.87:0/1342422760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc24071f10 msgr2=0x7fbc2410eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:54.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.437+0000 7fbc2ae00700 1 --2- 172.21.15.87:0/1342422760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc24071f10 0x7fbc2410eee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009680 tx=0x7fbc18009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:54.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.437+0000 7fbc2ae00700 1 -- 172.21.15.87:0/1342422760 shutdown_connections 2024-02-28T15:51:54.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.437+0000 7fbc2ae00700 1 --2- 172.21.15.87:0/1342422760 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fbc0c036960 0x7fbc0c038e10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:54.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.437+0000 7fbc2ae00700 1 --2- 172.21.15.87:0/1342422760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc24071f10 0x7fbc2410eee0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:54.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.437+0000 7fbc2ae00700 1 -- 172.21.15.87:0/1342422760 >> 172.21.15.87:0/1342422760 conn(0x7fbc240f80c0 msgr2=0x7fbc240f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:54.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.437+0000 7fbc2ae00700 1 -- 172.21.15.87:0/1342422760 shutdown_connections 2024-02-28T15:51:54.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:54.437+0000 7fbc2ae00700 1 -- 172.21.15.87:0/1342422760 wait complete. 2024-02-28T15:51:54.435 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:51:54.624 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:54 smithi057 ceph-mon[28763]: mgrmap e17: smithi057.upqerc(active, since 2s) 2024-02-28T15:51:54.624 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:54 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:55.624 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:55 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/1342422760' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:51:55.624 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:55 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:56.287 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:51:56.288 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:51:56.982 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:57.502 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T15:51:58.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:57 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:58.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:57 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:59.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.755+0000 7f77f6400700 1 -- 172.21.15.87:0/2663651373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77f00fedd0 msgr2=0x7f77f00ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:51:59.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.755+0000 7f77f6400700 1 --2- 172.21.15.87:0/2663651373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77f00fedd0 0x7f77f00ff1e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f77e00048c0 tx=0x7f77e0009e30 comp rx=0 tx=0).stop 2024-02-28T15:51:59.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.755+0000 7f77f6400700 1 -- 172.21.15.87:0/2663651373 shutdown_connections 2024-02-28T15:51:59.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.755+0000 7f77f6400700 1 --2- 172.21.15.87:0/2663651373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77f00fedd0 0x7f77f00ff1e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:51:59.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.755+0000 7f77f6400700 1 -- 172.21.15.87:0/2663651373 >> 172.21.15.87:0/2663651373 conn(0x7f77f00fa5a0 msgr2=0x7f77f00fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:51:59.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.755+0000 7f77f6400700 1 -- 172.21.15.87:0/2663651373 shutdown_connections 2024-02-28T15:51:59.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.755+0000 7f77f6400700 1 -- 172.21.15.87:0/2663651373 wait complete. 2024-02-28T15:51:59.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.756+0000 7f77f6400700 1 Processor -- start 2024-02-28T15:51:59.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.756+0000 7f77f6400700 1 -- start start 2024-02-28T15:51:59.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.756+0000 7f77f6400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77f00fedd0 0x7f77f010f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:59.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.756+0000 7f77f6400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f010f650 con 0x7f77f00fedd0 2024-02-28T15:51:59.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.757+0000 7f77ef400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77f00fedd0 0x7f77f010f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:59.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.757+0000 7f77ef400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77f00fedd0 0x7f77f010f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:44180/0 (socket says 172.21.15.87:44180) 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.757+0000 7f77ef400700 1 -- 172.21.15.87:0/810193394 learned_addr learned my addr 172.21.15.87:0/810193394 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.757+0000 7f77ef400700 1 -- 172.21.15.87:0/810193394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0005040 con 0x7f77f00fedd0 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.758+0000 7f77ef400700 1 --2- 172.21.15.87:0/810193394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77f00fedd0 0x7f77f010f110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009680 tx=0x7f77e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.758+0000 7f77e7400700 1 -- 172.21.15.87:0/810193394 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77e000bed0 con 0x7f77f00fedd0 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.758+0000 7f77f6400700 1 -- 172.21.15.87:0/810193394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f010f850 con 0x7f77f00fedd0 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.759+0000 7f77e7400700 1 -- 172.21.15.87:0/810193394 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77e000b5c0 con 0x7f77f00fedd0 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.759+0000 7f77f6400700 1 -- 172.21.15.87:0/810193394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f01104f0 con 0x7f77f00fedd0 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.759+0000 7f77e7400700 1 -- 172.21.15.87:0/810193394 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77e00255c0 con 0x7f77f00fedd0 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.759+0000 7f77f6400700 1 -- 172.21.15.87:0/810193394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f005f5c0 con 0x7f77f00fedd0 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.760+0000 7f77e7400700 1 -- 172.21.15.87:0/810193394 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7f77e0004d30 con 0x7f77f00fedd0 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.761+0000 7f77e7400700 1 --2- 172.21.15.87:0/810193394 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f77d4036a00 0x7f77d4038eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.761+0000 7f77e7400700 1 -- 172.21.15.87:0/810193394 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f77e0049dc0 con 0x7f77f00fedd0 2024-02-28T15:51:59.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.761+0000 7f77eea00700 1 --2- 172.21.15.87:0/810193394 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f77d4036a00 0x7f77d4038eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:51:59.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.762+0000 7f77eea00700 1 --2- 172.21.15.87:0/810193394 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f77d4036a00 0x7f77d4038eb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009990 tx=0x7f77d8006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:51:59.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:51:59.775+0000 7f77e7400700 1 -- 172.21.15.87:0/810193394 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f77e00238f0 con 0x7f77f00fedd0 2024-02-28T15:51:59.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:59 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:59.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:59 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:51:59.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:51:59 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:52:00.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.065+0000 7f77f6400700 1 -- 172.21.15.87:0/810193394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f77f004bed0 con 0x7f77f00fedd0 2024-02-28T15:52:00.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.067+0000 7f77e7400700 1 -- 172.21.15.87:0/810193394 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f77e0023300 con 0x7f77f00fedd0 2024-02-28T15:52:00.062 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:52:00.062 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:52:00.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.069+0000 7f77f6400700 1 -- 172.21.15.87:0/810193394 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f77d4036a00 msgr2=0x7f77d4038eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:00.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.069+0000 7f77f6400700 1 --2- 172.21.15.87:0/810193394 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f77d4036a00 0x7f77d4038eb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009990 tx=0x7f77d8006e40 comp rx=0 tx=0).stop 2024-02-28T15:52:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.069+0000 7f77f6400700 1 -- 172.21.15.87:0/810193394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77f00fedd0 msgr2=0x7f77f010f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.069+0000 7f77f6400700 1 --2- 172.21.15.87:0/810193394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77f00fedd0 0x7f77f010f110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009680 tx=0x7f77e0009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.069+0000 7f77f6400700 1 -- 172.21.15.87:0/810193394 shutdown_connections 2024-02-28T15:52:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.069+0000 7f77f6400700 1 --2- 172.21.15.87:0/810193394 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f77d4036a00 0x7f77d4038eb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.069+0000 7f77f6400700 1 --2- 172.21.15.87:0/810193394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77f00fedd0 0x7f77f010f110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.069+0000 7f77f6400700 1 -- 172.21.15.87:0/810193394 >> 172.21.15.87:0/810193394 conn(0x7f77f00fa5a0 msgr2=0x7f77f00fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.069+0000 7f77f6400700 1 -- 172.21.15.87:0/810193394 shutdown_connections 2024-02-28T15:52:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:00.069+0000 7f77f6400700 1 -- 172.21.15.87:0/810193394 wait complete. 2024-02-28T15:52:00.066 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:52:01.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:00 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/810193394' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:01.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:01.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:01.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:01.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:01.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi087", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:52:01.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:01.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:52:01.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:00 smithi057 ceph-mon[28763]: Updating smithi057:/etc/ceph/ceph.conf 2024-02-28T15:52:01.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:00 smithi057 ceph-mon[28763]: Updating smithi087:/etc/ceph/ceph.conf 2024-02-28T15:52:01.898 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:52:01.899 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:52:02.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:01 smithi057 ceph-mon[28763]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:02.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:01 smithi057 ceph-mon[28763]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:02.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:01 smithi057 ceph-mon[28763]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-02-28T15:52:02.339 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:03.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:02 smithi057 ceph-mon[28763]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2024-02-28T15:52:03.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:02 smithi057 ceph-mon[28763]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T15:52:03.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:02 smithi057 ceph-mon[28763]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T15:52:04.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:04.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:04.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:04.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:04.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:04.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T15:52:04.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T15:52:04.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:04.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:03 smithi057 ceph-mon[28763]: Deploying daemon crash.smithi087 on smithi087 2024-02-28T15:52:04.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.406+0000 7f673c400700 1 -- 172.21.15.87:0/1882141703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6734104de0 msgr2=0x7f67341051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.406+0000 7f673c400700 1 --2- 172.21.15.87:0/1882141703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6734104de0 0x7f67341051b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f67280048c0 tx=0x7f6728009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.407+0000 7f673c400700 1 -- 172.21.15.87:0/1882141703 shutdown_connections 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.407+0000 7f673c400700 1 --2- 172.21.15.87:0/1882141703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6734104de0 0x7f67341051b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.407+0000 7f673c400700 1 -- 172.21.15.87:0/1882141703 >> 172.21.15.87:0/1882141703 conn(0x7f67340fa950 msgr2=0x7f67340fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.407+0000 7f673c400700 1 -- 172.21.15.87:0/1882141703 shutdown_connections 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.407+0000 7f673c400700 1 -- 172.21.15.87:0/1882141703 wait complete. 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.408+0000 7f673c400700 1 Processor -- start 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.408+0000 7f673c400700 1 -- start start 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.408+0000 7f673c400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6734104de0 0x7f6734115150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.408+0000 7f673c400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6734115690 con 0x7f6734104de0 2024-02-28T15:52:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.409+0000 7f6739a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6734104de0 0x7f6734115150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.409+0000 7f6739a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6734104de0 0x7f6734115150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:43942/0 (socket says 172.21.15.87:43942) 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.409+0000 7f6739a00700 1 -- 172.21.15.87:0/2572412929 learned_addr learned my addr 172.21.15.87:0/2572412929 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.409+0000 7f6739a00700 1 -- 172.21.15.87:0/2572412929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6728005040 con 0x7f6734104de0 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.410+0000 7f6739a00700 1 --2- 172.21.15.87:0/2572412929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6734104de0 0x7f6734115150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6728009300 tx=0x7f6728009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.410+0000 7f6731600700 1 -- 172.21.15.87:0/2572412929 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6728004e60 con 0x7f6734104de0 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.410+0000 7f673c400700 1 -- 172.21.15.87:0/2572412929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6734115890 con 0x7f6734104de0 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.410+0000 7f6731600700 1 -- 172.21.15.87:0/2572412929 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6728013420 con 0x7f6734104de0 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.410+0000 7f673c400700 1 -- 172.21.15.87:0/2572412929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6734115d80 con 0x7f6734104de0 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.410+0000 7f6731600700 1 -- 172.21.15.87:0/2572412929 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6728025560 con 0x7f6734104de0 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.412+0000 7f673c400700 1 -- 172.21.15.87:0/2572412929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673405f5c0 con 0x7f6734104de0 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.412+0000 7f6731600700 1 -- 172.21.15.87:0/2572412929 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7f6728013a90 con 0x7f6734104de0 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.412+0000 7f6731600700 1 --2- 172.21.15.87:0/2572412929 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f671c036960 0x7f671c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:04.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.412+0000 7f6731600700 1 -- 172.21.15.87:0/2572412929 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6728049bf0 con 0x7f6734104de0 2024-02-28T15:52:04.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.413+0000 7f6739000700 1 --2- 172.21.15.87:0/2572412929 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f671c036960 0x7f671c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:04.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.414+0000 7f6739000700 1 --2- 172.21.15.87:0/2572412929 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f671c036960 0x7f671c038e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6720009990 tx=0x7f6720006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:04.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.426+0000 7f6731600700 1 -- 172.21.15.87:0/2572412929 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6728023300 con 0x7f6734104de0 2024-02-28T15:52:04.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.722+0000 7f673c400700 1 -- 172.21.15.87:0/2572412929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6734110900 con 0x7f6734104de0 2024-02-28T15:52:04.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.723+0000 7f6731600700 1 -- 172.21.15.87:0/2572412929 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6728011b60 con 0x7f6734104de0 2024-02-28T15:52:04.718 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:52:04.719 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:52:04.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.725+0000 7f673c400700 1 -- 172.21.15.87:0/2572412929 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f671c036960 msgr2=0x7f671c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:04.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.725+0000 7f673c400700 1 --2- 172.21.15.87:0/2572412929 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f671c036960 0x7f671c038e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6720009990 tx=0x7f6720006e40 comp rx=0 tx=0).stop 2024-02-28T15:52:04.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.725+0000 7f673c400700 1 -- 172.21.15.87:0/2572412929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6734104de0 msgr2=0x7f6734115150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:04.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.725+0000 7f673c400700 1 --2- 172.21.15.87:0/2572412929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6734104de0 0x7f6734115150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6728009300 tx=0x7f6728009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:04.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.726+0000 7f673c400700 1 -- 172.21.15.87:0/2572412929 shutdown_connections 2024-02-28T15:52:04.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.726+0000 7f673c400700 1 --2- 172.21.15.87:0/2572412929 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f671c036960 0x7f671c038e10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:04.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.726+0000 7f673c400700 1 --2- 172.21.15.87:0/2572412929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6734104de0 0x7f6734115150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:04.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.726+0000 7f673c400700 1 -- 172.21.15.87:0/2572412929 >> 172.21.15.87:0/2572412929 conn(0x7f67340fa950 msgr2=0x7f67340fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:04.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.726+0000 7f673c400700 1 -- 172.21.15.87:0/2572412929 shutdown_connections 2024-02-28T15:52:04.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:04.726+0000 7f673c400700 1 -- 172.21.15.87:0/2572412929 wait complete. 2024-02-28T15:52:04.722 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:52:06.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:05 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/2572412929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:07.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:06 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:52:07.215 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:52:07.216 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:52:08.074 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:09.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:09 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:09.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:09 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:09.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:09 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:09.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:09 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:09.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:09 smithi057 ceph-mon[28763]: Deploying daemon node-exporter.smithi087 on smithi087 2024-02-28T15:52:10.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.220+0000 7f6822400700 1 -- 172.21.15.87:0/186134955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f681c102bd0 msgr2=0x7f681c102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:10.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.220+0000 7f6822400700 1 --2- 172.21.15.87:0/186134955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f681c102bd0 0x7f681c102fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f680c0048c0 tx=0x7f680c009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:10.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.220+0000 7f6822400700 1 -- 172.21.15.87:0/186134955 shutdown_connections 2024-02-28T15:52:10.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.220+0000 7f6822400700 1 --2- 172.21.15.87:0/186134955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f681c102bd0 0x7f681c102fa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:10.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.220+0000 7f6822400700 1 -- 172.21.15.87:0/186134955 >> 172.21.15.87:0/186134955 conn(0x7f681c0f8760 msgr2=0x7f681c0fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:10.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.221+0000 7f6822400700 1 -- 172.21.15.87:0/186134955 shutdown_connections 2024-02-28T15:52:10.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.221+0000 7f6822400700 1 -- 172.21.15.87:0/186134955 wait complete. 2024-02-28T15:52:10.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.221+0000 7f6822400700 1 Processor -- start 2024-02-28T15:52:10.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.222+0000 7f6822400700 1 -- start start 2024-02-28T15:52:10.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.222+0000 7f6822400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f681c102bd0 0x7f681c115110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:10.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.222+0000 7f6822400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c115650 con 0x7f681c102bd0 2024-02-28T15:52:10.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.223+0000 7f681b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f681c102bd0 0x7f681c115110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:10.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.223+0000 7f681b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f681c102bd0 0x7f681c115110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:43960/0 (socket says 172.21.15.87:43960) 2024-02-28T15:52:10.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.223+0000 7f681b400700 1 -- 172.21.15.87:0/3911993280 learned_addr learned my addr 172.21.15.87:0/3911993280 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:52:10.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.223+0000 7f681b400700 1 -- 172.21.15.87:0/3911993280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c005040 con 0x7f681c102bd0 2024-02-28T15:52:10.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.224+0000 7f681b400700 1 --2- 172.21.15.87:0/3911993280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f681c102bd0 0x7f681c115110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f680c009300 tx=0x7f680c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:10.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.224+0000 7f6813400700 1 -- 172.21.15.87:0/3911993280 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f680c004e60 con 0x7f681c102bd0 2024-02-28T15:52:10.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.224+0000 7f6822400700 1 -- 172.21.15.87:0/3911993280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681c115850 con 0x7f681c102bd0 2024-02-28T15:52:10.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.224+0000 7f6822400700 1 -- 172.21.15.87:0/3911993280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681c115d40 con 0x7f681c102bd0 2024-02-28T15:52:10.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.224+0000 7f6813400700 1 -- 172.21.15.87:0/3911993280 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f680c013420 con 0x7f681c102bd0 2024-02-28T15:52:10.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.224+0000 7f6813400700 1 -- 172.21.15.87:0/3911993280 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f680c01c5b0 con 0x7f681c102bd0 2024-02-28T15:52:10.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.225+0000 7f6822400700 1 -- 172.21.15.87:0/3911993280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f80052e0 con 0x7f681c102bd0 2024-02-28T15:52:10.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.226+0000 7f6813400700 1 -- 172.21.15.87:0/3911993280 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7f680c013a90 con 0x7f681c102bd0 2024-02-28T15:52:10.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.226+0000 7f6813400700 1 --2- 172.21.15.87:0/3911993280 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f68000369b0 0x7f6800038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:10.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.226+0000 7f6813400700 1 -- 172.21.15.87:0/3911993280 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f680c049ba0 con 0x7f681c102bd0 2024-02-28T15:52:10.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.227+0000 7f6813e00700 1 --2- 172.21.15.87:0/3911993280 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f68000369b0 0x7f6800038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:10.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.228+0000 7f6813e00700 1 --2- 172.21.15.87:0/3911993280 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f68000369b0 0x7f6800038e60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6804009990 tx=0x7f6804006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:10.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.241+0000 7f6813400700 1 -- 172.21.15.87:0/3911993280 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f680c011960 con 0x7f681c102bd0 2024-02-28T15:52:10.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.522+0000 7f6822400700 1 -- 172.21.15.87:0/3911993280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f67f8005590 con 0x7f681c102bd0 2024-02-28T15:52:10.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.523+0000 7f6813400700 1 -- 172.21.15.87:0/3911993280 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f680c011370 con 0x7f681c102bd0 2024-02-28T15:52:10.517 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:52:10.517 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:52:10.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.525+0000 7f6822400700 1 -- 172.21.15.87:0/3911993280 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f68000369b0 msgr2=0x7f6800038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:10.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.525+0000 7f6822400700 1 --2- 172.21.15.87:0/3911993280 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f68000369b0 0x7f6800038e60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6804009990 tx=0x7f6804006e40 comp rx=0 tx=0).stop 2024-02-28T15:52:10.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.525+0000 7f6822400700 1 -- 172.21.15.87:0/3911993280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f681c102bd0 msgr2=0x7f681c115110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:10.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.525+0000 7f6822400700 1 --2- 172.21.15.87:0/3911993280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f681c102bd0 0x7f681c115110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f680c009300 tx=0x7f680c009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:10.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.525+0000 7f6822400700 1 -- 172.21.15.87:0/3911993280 shutdown_connections 2024-02-28T15:52:10.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.525+0000 7f6822400700 1 --2- 172.21.15.87:0/3911993280 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f68000369b0 0x7f6800038e60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:10.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.525+0000 7f6822400700 1 --2- 172.21.15.87:0/3911993280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f681c102bd0 0x7f681c115110 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:10.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.525+0000 7f6822400700 1 -- 172.21.15.87:0/3911993280 >> 172.21.15.87:0/3911993280 conn(0x7f681c0f8760 msgr2=0x7f681c0fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:10.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.526+0000 7f6822400700 1 -- 172.21.15.87:0/3911993280 shutdown_connections 2024-02-28T15:52:10.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:10.526+0000 7f6822400700 1 -- 172.21.15.87:0/3911993280 wait complete. 2024-02-28T15:52:10.521 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:52:11.069 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:10 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/3911993280' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:12.229 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:52:12.230 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:52:12.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:12 smithi057 ceph-mon[28763]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:12.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:12 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:12.800 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:14.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:14 smithi057 ceph-mon[28763]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.799+0000 7f8b9a600700 1 -- 172.21.15.87:0/3192106626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b94102bd0 msgr2=0x7f8b94102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.799+0000 7f8b9a600700 1 --2- 172.21.15.87:0/3192106626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b94102bd0 0x7f8b94102fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009c60 tx=0x7f8b84004d10 comp rx=0 tx=0).stop 2024-02-28T15:52:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.799+0000 7f8b9a600700 1 -- 172.21.15.87:0/3192106626 shutdown_connections 2024-02-28T15:52:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.799+0000 7f8b9a600700 1 --2- 172.21.15.87:0/3192106626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b94102bd0 0x7f8b94102fa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.799+0000 7f8b9a600700 1 -- 172.21.15.87:0/3192106626 >> 172.21.15.87:0/3192106626 conn(0x7f8b940f8760 msgr2=0x7f8b940fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.799+0000 7f8b9a600700 1 -- 172.21.15.87:0/3192106626 shutdown_connections 2024-02-28T15:52:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.799+0000 7f8b9a600700 1 -- 172.21.15.87:0/3192106626 wait complete. 2024-02-28T15:52:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.800+0000 7f8b9a600700 1 Processor -- start 2024-02-28T15:52:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.800+0000 7f8b9a600700 1 -- start start 2024-02-28T15:52:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.801+0000 7f8b9a600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b94102bd0 0x7f8b94112ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.801+0000 7f8b9a600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94113430 con 0x7f8b94102bd0 2024-02-28T15:52:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.801+0000 7f8b93400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b94102bd0 0x7f8b94112ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.801+0000 7f8b93400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b94102bd0 0x7f8b94112ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:42836/0 (socket says 172.21.15.87:42836) 2024-02-28T15:52:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.802+0000 7f8b93400700 1 -- 172.21.15.87:0/709513938 learned_addr learned my addr 172.21.15.87:0/709513938 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:52:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.802+0000 7f8b93400700 1 -- 172.21.15.87:0/709513938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009940 con 0x7f8b94102bd0 2024-02-28T15:52:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.803+0000 7f8b93400700 1 --2- 172.21.15.87:0/709513938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b94102bd0 0x7f8b94112ef0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8b84004e60 tx=0x7f8b84004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.803+0000 7f8b8be00700 1 -- 172.21.15.87:0/709513938 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b84007c00 con 0x7f8b94102bd0 2024-02-28T15:52:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.803+0000 7f8b9a600700 1 -- 172.21.15.87:0/709513938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b94113630 con 0x7f8b94102bd0 2024-02-28T15:52:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.803+0000 7f8b9a600700 1 -- 172.21.15.87:0/709513938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b94113b20 con 0x7f8b94102bd0 2024-02-28T15:52:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.803+0000 7f8b8be00700 1 -- 172.21.15.87:0/709513938 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b8401d910 con 0x7f8b94102bd0 2024-02-28T15:52:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.803+0000 7f8b8be00700 1 -- 172.21.15.87:0/709513938 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b840126f0 con 0x7f8b94102bd0 2024-02-28T15:52:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.804+0000 7f8b9a600700 1 -- 172.21.15.87:0/709513938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b700052e0 con 0x7f8b94102bd0 2024-02-28T15:52:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.805+0000 7f8b8be00700 1 -- 172.21.15.87:0/709513938 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7f8b84019040 con 0x7f8b94102bd0 2024-02-28T15:52:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.805+0000 7f8b8be00700 1 --2- 172.21.15.87:0/709513938 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b780369b0 0x7f8b78038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.805+0000 7f8b8be00700 1 -- 172.21.15.87:0/709513938 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f8b84049d70 con 0x7f8b94102bd0 2024-02-28T15:52:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.806+0000 7f8b8aa00700 1 --2- 172.21.15.87:0/709513938 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b780369b0 0x7f8b78038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.807+0000 7f8b8aa00700 1 --2- 172.21.15.87:0/709513938 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b780369b0 0x7f8b78038e60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009990 tx=0x7f8b7c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:15.820+0000 7f8b8be00700 1 -- 172.21.15.87:0/709513938 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8b8404e070 con 0x7f8b94102bd0 2024-02-28T15:52:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.111+0000 7f8b9a600700 1 -- 172.21.15.87:0/709513938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8b70005590 con 0x7f8b94102bd0 2024-02-28T15:52:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.112+0000 7f8b8be00700 1 -- 172.21.15.87:0/709513938 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8b84017090 con 0x7f8b94102bd0 2024-02-28T15:52:16.107 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:52:16.107 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:52:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.115+0000 7f8b9a600700 1 -- 172.21.15.87:0/709513938 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b780369b0 msgr2=0x7f8b78038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.115+0000 7f8b9a600700 1 --2- 172.21.15.87:0/709513938 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b780369b0 0x7f8b78038e60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009990 tx=0x7f8b7c006e40 comp rx=0 tx=0).stop 2024-02-28T15:52:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.115+0000 7f8b9a600700 1 -- 172.21.15.87:0/709513938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b94102bd0 msgr2=0x7f8b94112ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.115+0000 7f8b9a600700 1 --2- 172.21.15.87:0/709513938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b94102bd0 0x7f8b94112ef0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8b84004e60 tx=0x7f8b84004d10 comp rx=0 tx=0).stop 2024-02-28T15:52:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.115+0000 7f8b9a600700 1 -- 172.21.15.87:0/709513938 shutdown_connections 2024-02-28T15:52:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.115+0000 7f8b9a600700 1 --2- 172.21.15.87:0/709513938 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b780369b0 0x7f8b78038e60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.115+0000 7f8b9a600700 1 --2- 172.21.15.87:0/709513938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b94102bd0 0x7f8b94112ef0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.115+0000 7f8b9a600700 1 -- 172.21.15.87:0/709513938 >> 172.21.15.87:0/709513938 conn(0x7f8b940f8760 msgr2=0x7f8b940fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.116+0000 7f8b9a600700 1 -- 172.21.15.87:0/709513938 shutdown_connections 2024-02-28T15:52:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:16.116+0000 7f8b9a600700 1 -- 172.21.15.87:0/709513938 wait complete. 2024-02-28T15:52:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:52:16.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:15 smithi057 ceph-mon[28763]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:17.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/709513938' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:17.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:17.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:17.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:17.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:17.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T15:52:17.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-28T15:52:17.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T15:52:17.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:17.181 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: Deploying daemon mgr.smithi087.ewrszc on smithi087 2024-02-28T15:52:17.181 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:17.893 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:52:17.893 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:52:18.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:17 smithi057 ceph-mon[28763]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:20.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:20 smithi057 ceph-mon[28763]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.130+0000 7f57bd000700 1 -- 172.21.15.87:0/90434816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57b80702d0 msgr2=0x7f57b80706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.130+0000 7f57bd000700 1 --2- 172.21.15.87:0/90434816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57b80702d0 0x7f57b80706a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f57a80048c0 tx=0x7f57a8009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.130+0000 7f57bd000700 1 -- 172.21.15.87:0/90434816 shutdown_connections 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.130+0000 7f57bd000700 1 --2- 172.21.15.87:0/90434816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57b80702d0 0x7f57b80706a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.130+0000 7f57bd000700 1 -- 172.21.15.87:0/90434816 >> 172.21.15.87:0/90434816 conn(0x7f57b80f85b0 msgr2=0x7f57b80fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.131+0000 7f57bd000700 1 -- 172.21.15.87:0/90434816 shutdown_connections 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.131+0000 7f57bd000700 1 -- 172.21.15.87:0/90434816 wait complete. 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.131+0000 7f57bd000700 1 Processor -- start 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.132+0000 7f57bd000700 1 -- start start 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.132+0000 7f57bd000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57b80702d0 0x7f57b8115040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.132+0000 7f57bd000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8115580 con 0x7f57b80702d0 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.133+0000 7f57b7400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57b80702d0 0x7f57b8115040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.133+0000 7f57b7400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57b80702d0 0x7f57b8115040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:45286/0 (socket says 172.21.15.87:45286) 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.133+0000 7f57b7400700 1 -- 172.21.15.87:0/1128982041 learned_addr learned my addr 172.21.15.87:0/1128982041 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.133+0000 7f57b7400700 1 -- 172.21.15.87:0/1128982041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a8005040 con 0x7f57b80702d0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.134+0000 7f57b7400700 1 --2- 172.21.15.87:0/1128982041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57b80702d0 0x7f57b8115040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009330 tx=0x7f57a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.134+0000 7f57af400700 1 -- 172.21.15.87:0/1128982041 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57a800be50 con 0x7f57b80702d0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.134+0000 7f57bd000700 1 -- 172.21.15.87:0/1128982041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b8115780 con 0x7f57b80702d0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.134+0000 7f57af400700 1 -- 172.21.15.87:0/1128982041 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57a8009630 con 0x7f57b80702d0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.134+0000 7f57af400700 1 -- 172.21.15.87:0/1128982041 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57a801c3f0 con 0x7f57b80702d0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.134+0000 7f57bd000700 1 -- 172.21.15.87:0/1128982041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b8115bf0 con 0x7f57b80702d0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.135+0000 7f57bd000700 1 -- 172.21.15.87:0/1128982041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b805f5c0 con 0x7f57b80702d0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.136+0000 7f57af400700 1 -- 172.21.15.87:0/1128982041 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7f57a80097a0 con 0x7f57b80702d0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.136+0000 7f57af400700 1 --2- 172.21.15.87:0/1128982041 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f579c0369b0 0x7f579c038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.136+0000 7f57af400700 1 -- 172.21.15.87:0/1128982041 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f57a8049b40 con 0x7f57b80702d0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.137+0000 7f57b6a00700 1 --2- 172.21.15.87:0/1128982041 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f579c0369b0 0x7f579c038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.138+0000 7f57b6a00700 1 --2- 172.21.15.87:0/1128982041 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f579c0369b0 0x7f579c038e60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009990 tx=0x7f57a4006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:21.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.152+0000 7f57af400700 1 -- 172.21.15.87:0/1128982041 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f57a8011960 con 0x7f57b80702d0 2024-02-28T15:52:21.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.444+0000 7f57bd000700 1 -- 172.21.15.87:0/1128982041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f57b8110650 con 0x7f57b80702d0 2024-02-28T15:52:21.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.445+0000 7f57af400700 1 -- 172.21.15.87:0/1128982041 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f57a8049e60 con 0x7f57b80702d0 2024-02-28T15:52:21.440 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:52:21.440 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:48:58.522047Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T15:52:21.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.449+0000 7f57bd000700 1 -- 172.21.15.87:0/1128982041 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f579c0369b0 msgr2=0x7f579c038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:21.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.449+0000 7f57bd000700 1 --2- 172.21.15.87:0/1128982041 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f579c0369b0 0x7f579c038e60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009990 tx=0x7f57a4006e40 comp rx=0 tx=0).stop 2024-02-28T15:52:21.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.449+0000 7f57bd000700 1 -- 172.21.15.87:0/1128982041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57b80702d0 msgr2=0x7f57b8115040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:21.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.449+0000 7f57bd000700 1 --2- 172.21.15.87:0/1128982041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57b80702d0 0x7f57b8115040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009330 tx=0x7f57a8009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:21.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.449+0000 7f57bd000700 1 -- 172.21.15.87:0/1128982041 shutdown_connections 2024-02-28T15:52:21.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.449+0000 7f57bd000700 1 --2- 172.21.15.87:0/1128982041 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f579c0369b0 0x7f579c038e60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:21.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.449+0000 7f57bd000700 1 --2- 172.21.15.87:0/1128982041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57b80702d0 0x7f57b8115040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:21.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.449+0000 7f57bd000700 1 -- 172.21.15.87:0/1128982041 >> 172.21.15.87:0/1128982041 conn(0x7f57b80f85b0 msgr2=0x7f57b81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:21.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.449+0000 7f57bd000700 1 -- 172.21.15.87:0/1128982041 shutdown_connections 2024-02-28T15:52:21.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:21.449+0000 7f57bd000700 1 -- 172.21.15.87:0/1128982041 wait complete. 2024-02-28T15:52:21.445 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2024-02-28T15:52:22.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:22.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:22.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:22.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:22.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T15:52:22.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:22.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: Deploying daemon mon.smithi087 on smithi087 2024-02-28T15:52:22.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:22.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:52:22.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:22.181 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:21 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/1128982041' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:23.217 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T15:52:23.217 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T15:52:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:24.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:24 smithi057 ceph-mon[28763]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:25.822 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:25 smithi087 systemd[1]: Starting Ceph mon.smithi087 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T15:52:26.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:25 smithi057 ceph-mon[28763]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:26.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:26 smithi087 podman[37056]: 2024-02-28 15:52:26.617826226 +0000 UTC m=+0.285549926 image pull 1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13 2024-02-28T15:52:26.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:26 smithi087 podman[37056]: 2024-02-28 15:52:26.779993112 +0000 UTC m=+0.447716789 container create 5b73e8cf88cdd565834f15c7184d5b9d35a974dbe5afb299fb279043a205f8bc (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=quincy-c0f02e6, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240222) 2024-02-28T15:52:27.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.155+0000 7f62ef000700 1 -- 172.21.15.87:0/752572056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e8101b60 msgr2=0x7f62e8101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:27.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.155+0000 7f62ef000700 1 --2- 172.21.15.87:0/752572056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e8101b60 0x7f62e8101f30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f62d80048c0 tx=0x7f62d8009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:27.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.155+0000 7f62ef000700 1 -- 172.21.15.87:0/752572056 shutdown_connections 2024-02-28T15:52:27.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.155+0000 7f62ef000700 1 --2- 172.21.15.87:0/752572056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e8101b60 0x7f62e8101f30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:27.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.155+0000 7f62ef000700 1 -- 172.21.15.87:0/752572056 >> 172.21.15.87:0/752572056 conn(0x7f62e8072850 msgr2=0x7f62e8072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:27.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.155+0000 7f62ef000700 1 -- 172.21.15.87:0/752572056 shutdown_connections 2024-02-28T15:52:27.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.155+0000 7f62ef000700 1 -- 172.21.15.87:0/752572056 wait complete. 2024-02-28T15:52:27.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.156+0000 7f62ef000700 1 Processor -- start 2024-02-28T15:52:27.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.156+0000 7f62ef000700 1 -- start start 2024-02-28T15:52:27.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.157+0000 7f62ef000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e8101b60 0x7f62e80fd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:27.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.157+0000 7f62ef000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80fdc10 con 0x7f62e8101b60 2024-02-28T15:52:27.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.157+0000 7f62e7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e8101b60 0x7f62e80fd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:27.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.157+0000 7f62e7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e8101b60 0x7f62e80fd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:45302/0 (socket says 172.21.15.87:45302) 2024-02-28T15:52:27.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.157+0000 7f62e7e00700 1 -- 172.21.15.87:0/2299594163 learned_addr learned my addr 172.21.15.87:0/2299594163 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:52:27.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.158+0000 7f62e7e00700 1 -- 172.21.15.87:0/2299594163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d8005040 con 0x7f62e8101b60 2024-02-28T15:52:27.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.159+0000 7f62e7e00700 1 --2- 172.21.15.87:0/2299594163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e8101b60 0x7f62e80fd6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009b80 tx=0x7f62d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:27.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.159+0000 7f62dfe00700 1 -- 172.21.15.87:0/2299594163 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62d800be50 con 0x7f62e8101b60 2024-02-28T15:52:27.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.159+0000 7f62ef000700 1 -- 172.21.15.87:0/2299594163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e80fde10 con 0x7f62e8101b60 2024-02-28T15:52:27.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.159+0000 7f62ef000700 1 -- 172.21.15.87:0/2299594163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e80fe280 con 0x7f62e8101b60 2024-02-28T15:52:27.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.159+0000 7f62dfe00700 1 -- 172.21.15.87:0/2299594163 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62d8009620 con 0x7f62e8101b60 2024-02-28T15:52:27.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.159+0000 7f62dfe00700 1 -- 172.21.15.87:0/2299594163 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62d80255c0 con 0x7f62e8101b60 2024-02-28T15:52:27.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.160+0000 7f62ef000700 1 -- 172.21.15.87:0/2299594163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c80052e0 con 0x7f62e8101b60 2024-02-28T15:52:27.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.161+0000 7f62dfe00700 1 -- 172.21.15.87:0/2299594163 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 43481+0+0 (secure 0 0 0) 0x7f62d8009790 con 0x7f62e8101b60 2024-02-28T15:52:27.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.161+0000 7f62dfe00700 1 --2- 172.21.15.87:0/2299594163 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f62cc036960 0x7f62cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:27.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.161+0000 7f62dfe00700 1 -- 172.21.15.87:0/2299594163 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f62d8049b90 con 0x7f62e8101b60 2024-02-28T15:52:27.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.162+0000 7f62e7400700 1 --2- 172.21.15.87:0/2299594163 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f62cc036960 0x7f62cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:27.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.163+0000 7f62e7400700 1 --2- 172.21.15.87:0/2299594163 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f62cc036960 0x7f62cc038e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009990 tx=0x7f62d4006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:27.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.177+0000 7f62dfe00700 1 -- 172.21.15.87:0/2299594163 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f62d80238f0 con 0x7f62e8101b60 2024-02-28T15:52:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.355+0000 7f62dfe00700 1 -- 172.21.15.87:0/2299594163 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d804e020 con 0x7f62e8101b60 2024-02-28T15:52:27.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:27.472+0000 7f62ef000700 1 -- 172.21.15.87:0/2299594163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f62c8005590 con 0x7f62e8101b60 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 podman[37056]: 2024-02-28 15:52:27.250656314 +0000 UTC m=+0.918379987 container init 5b73e8cf88cdd565834f15c7184d5b9d35a974dbe5afb299fb279043a205f8bc (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-c0f02e6, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 podman[37056]: 2024-02-28 15:52:27.258931806 +0000 UTC m=+0.926655454 container start 5b73e8cf88cdd565834f15c7184d5b9d35a974dbe5afb299fb279043a205f8bc (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-c0f02e6, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable), process ceph-mon, pid 2 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: pidfile_write: ignore empty --pid-file 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: load: jerasure load: lrc 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: RocksDB version: 6.15.5 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Compile date Feb 26 2024 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: DB SUMMARY 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: DB Session ID: CYYQXNDNRVH5YQVU67N0 2024-02-28T15:52:27.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: CURRENT file: CURRENT 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi087/store.db dir, Total Num: 0, files: 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi087/store.db: 000004.log size: 511 ; 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.error_if_exists: 0 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.create_if_missing: 0 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.paranoid_checks: 1 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.env: 0x55e62fe88a80 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.fs: Posix File System 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.info_log: 0x55e631f61cc0 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.statistics: (nil) 2024-02-28T15:52:27.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.use_fsync: 0 2024-02-28T15:52:27.721 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_log_file_size: 0 2024-02-28T15:52:27.721 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T15:52:27.721 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T15:52:27.721 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T15:52:27.721 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T15:52:27.721 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.allow_fallocate: 1 2024-02-28T15:52:27.721 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.use_direct_reads: 0 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.db_log_dir: 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi087/store.db 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T15:52:27.722 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.write_buffer_manager: 0x55e632cd6b40 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.unordered_write: 0 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T15:52:27.723 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T15:52:27.724 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T15:52:27.724 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.row_cache: None 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.wal_filter: None 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.preserve_deletes: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.two_write_queues: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.atomic_flush: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.log_readahead_size: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T15:52:27.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_background_jobs: 2 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_background_compactions: -1 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_subcompactions: 1 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T15:52:27.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_open_files: -1 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_background_flushes: -1 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Compression algorithms supported: 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: kZSTD supported: 0 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: kXpressCompression supported: 0 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: kZlibCompression supported: 1 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: kSnappyCompression supported: 1 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: kLZ4Compression supported: 1 2024-02-28T15:52:27.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: kBZip2Compression supported: 0 2024-02-28T15:52:27.729 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T15:52:27.729 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi087/store.db/MANIFEST-000003 2024-02-28T15:52:27.729 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-02-28T15:52:27.729 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T15:52:27.729 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.merge_operator: 2024-02-28T15:52:27.729 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_filter: None 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e631fb6f58) 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: cache_index_and_filter_blocks: 1 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: pin_top_level_index_and_filter: 1 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_type: 0 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: data_block_index_type: 0 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_shortening: 1 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T15:52:27.730 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: hash_index_allow_collision: 1 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: checksum: 1 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: no_block_cache: 0 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache: 0x55e631fe9090 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_name: BinnedLRUCache 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_options: 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: capacity : 536870912 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: num_shard_bits : 4 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: strict_capacity_limit : 0 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: high_pri_pool_ratio: 0.000 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_compressed: (nil) 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: persistent_cache: (nil) 2024-02-28T15:52:27.731 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_size: 4096 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_size_deviation: 10 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_restart_interval: 16 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_block_restart_interval: 1 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: metadata_block_size: 4096 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: partition_filters: 0 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: use_delta_encoding: 1 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: whole_key_filtering: 1 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: verify_compression: 0 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: read_amp_bytes_per_bit: 0 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: format_version: 4 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: enable_index_compression: 1 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_align: 0 2024-02-28T15:52:27.732 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compression: NoCompression 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.num_levels: 7 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T15:52:27.733 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T15:52:27.734 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.arena_block_size: 4194304 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T15:52:27.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T15:52:27.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.table_properties_collectors: 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.inplace_update_support: 0 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.bloom_locality: 0 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.max_successive_merges: 0 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T15:52:27.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.ttl: 2592000 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.enable_blob_files: false 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.min_blob_size: 0 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi087/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709135547302880, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-02-28T15:52:27.739 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709135547303413, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1709135547, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "c0285d63-bb73-4eba-a7c6-892f61a19f02", "db_session_id": "CYYQXNDNRVH5YQVU67N0"}} 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709135547304010, "job": 1, "event": "recovery_finished"} 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi087/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55e631f7d180 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: DB pointer 0x55e632052000 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** DB Stats ** 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T15:52:27.740 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T15:52:27.741 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-02-28T15:52:27.742 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T15:52:27.743 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087 does not exist in monmap, will attempt to join an existing cluster 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: using public_addr v2:172.21.15.87:0/0 -> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: starting mon.smithi087 rank -1 at public addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] at bind addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi087 fsid bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(???) e0 preinit fsid bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).mds e1 new map 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).mds e1 print_map 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: e1 2024-02-28T15:52:27.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: legacy client fscid: -1 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: No filesystems configured 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T15:52:27.745 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Active manager daemon smithi057.upqerc restarted 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Activating manager daemon smithi057.upqerc 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mgrmap e15: smithi057.upqerc(active, starting, since 0.00491405s) 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Manager daemon smithi057.upqerc is now available 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:52:27.746 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: [28/Feb/2024:15:51:51] ENGINE Bus STARTING 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mgrmap e16: smithi057.upqerc(active, since 1.0129s) 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: [28/Feb/2024:15:51:51] ENGINE Serving on https://172.21.15.57:7150 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: [28/Feb/2024:15:51:51] ENGINE Bus STARTED 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mgrmap e17: smithi057.upqerc(active, since 2s) 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/1342422760' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.747 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/810193394' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi087", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:52:27.748 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Updating smithi057:/etc/ceph/ceph.conf 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Updating smithi087:/etc/ceph/ceph.conf 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T15:52:27.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T15:52:27.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:27.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Deploying daemon crash.smithi087 on smithi087 2024-02-28T15:52:27.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/2572412929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:27.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:52:27.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Deploying daemon node-exporter.smithi087 on smithi087 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/3911993280' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/709513938' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.751 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Deploying daemon mgr.smithi087.ewrszc on smithi087 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.752 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: Deploying daemon mon.smithi087 on smithi087 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/1128982041' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 ceph-mon[37122]: mon.smithi087@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 bash[37056]: 5b73e8cf88cdd565834f15c7184d5b9d35a974dbe5afb299fb279043a205f8bc 2024-02-28T15:52:27.753 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:27 smithi087 systemd[1]: Started Ceph mon.smithi087 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T15:52:32.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.383+0000 7f62dfe00700 1 -- 172.21.15.87:0/2299594163 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1013 (secure 0 0 0) 0x7f62d8023300 con 0x7f62e8101b60 2024-02-28T15:52:32.378 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-02-28T15:52:32.378 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":2,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","modified":"2024-02-28T15:52:27.353286Z","created":"2024-02-28T15:48:58.522047Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi057","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-28T15:52:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.387+0000 7f62ef000700 1 -- 172.21.15.87:0/2299594163 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f62cc036960 msgr2=0x7f62cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.387+0000 7f62ef000700 1 --2- 172.21.15.87:0/2299594163 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f62cc036960 0x7f62cc038e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009990 tx=0x7f62d4006e40 comp rx=0 tx=0).stop 2024-02-28T15:52:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.387+0000 7f62ef000700 1 -- 172.21.15.87:0/2299594163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e8101b60 msgr2=0x7f62e80fd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.387+0000 7f62ef000700 1 --2- 172.21.15.87:0/2299594163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e8101b60 0x7f62e80fd6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009b80 tx=0x7f62d8009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.387+0000 7f62ef000700 1 -- 172.21.15.87:0/2299594163 shutdown_connections 2024-02-28T15:52:32.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.387+0000 7f62ef000700 1 --2- 172.21.15.87:0/2299594163 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f62cc036960 0x7f62cc038e10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:32.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.387+0000 7f62ef000700 1 --2- 172.21.15.87:0/2299594163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e8101b60 0x7f62e80fd6d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:32.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.387+0000 7f62ef000700 1 -- 172.21.15.87:0/2299594163 >> 172.21.15.87:0/2299594163 conn(0x7f62e8072850 msgr2=0x7f62e80ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:32.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.387+0000 7f62ef000700 1 -- 172.21.15.87:0/2299594163 shutdown_connections 2024-02-28T15:52:32.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:52:32.388+0000 7f62ef000700 1 -- 172.21.15.87:0/2299594163 wait complete. 2024-02-28T15:52:32.384 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 2 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: mon.smithi057 calling monitor election 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/2299594163' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/3855073281' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/crt"}]: dispatch 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: mon.smithi087 calling monitor election 2024-02-28T15:52:32.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: mon.smithi057 is new leader, mons smithi057,smithi087 in quorum (ranks 0,1) 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: monmap e2: 2 mons at {smithi057=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: fsmap 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: mgrmap e17: smithi057.upqerc(active, since 41s) 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: Standby manager daemon smithi087.ewrszc started 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/3855073281' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: overall HEALTH_OK 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/3855073281' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/key"}]: dispatch 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:32.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/3855073281' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T15:52:32.720 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:32.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:32.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:52:32.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: mon.smithi057 calling monitor election 2024-02-28T15:52:32.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/2299594163' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/3855073281' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/crt"}]: dispatch 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: mon.smithi087 calling monitor election 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: mon.smithi057 is new leader, mons smithi057,smithi087 in quorum (ranks 0,1) 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: monmap e2: 2 mons at {smithi057=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: fsmap 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T15:52:32.931 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: mgrmap e17: smithi057.upqerc(active, since 41s) 2024-02-28T15:52:32.932 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: Standby manager daemon smithi087.ewrszc started 2024-02-28T15:52:32.932 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/3855073281' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T15:52:32.932 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: overall HEALTH_OK 2024-02-28T15:52:32.932 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/3855073281' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/key"}]: dispatch 2024-02-28T15:52:32.932 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:32.932 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/3855073281' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T15:52:32.932 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:33.189 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-28T15:52:33.189 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph config generate-minimal-conf 2024-02-28T15:52:33.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:33 smithi057 ceph-mon[28763]: mgrmap e18: smithi057.upqerc(active, since 41s), standbys: smithi087.ewrszc 2024-02-28T15:52:33.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:33 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:33.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:33 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi087.ewrszc", "id": "smithi087.ewrszc"}]: dispatch 2024-02-28T15:52:33.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:33 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:33.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:33 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:33.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:33 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:52:33.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:33 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:33.700 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:52:33.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:33 smithi087 ceph-mon[37122]: mgrmap e18: smithi057.upqerc(active, since 41s), standbys: smithi087.ewrszc 2024-02-28T15:52:33.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:33 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:33.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:33 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi087.ewrszc", "id": "smithi087.ewrszc"}]: dispatch 2024-02-28T15:52:33.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:33 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:33.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:33 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:33.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:33 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:52:33.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:33 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:52:34.866 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:34 smithi087 ceph-mon[37122]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:34.910 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:34 smithi057 ceph-mon[28763]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:35.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.713+0000 7f64a1200700 1 -- 172.21.15.57:0/2831215931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f649c0fdc50 msgr2=0x7f649c0fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:35.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.713+0000 7f64a1200700 1 --2- 172.21.15.57:0/2831215931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f649c0fdc50 0x7f649c0fe020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f648c0048c0 tx=0x7f648c009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:35.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.713+0000 7f64a1200700 1 -- 172.21.15.57:0/2831215931 shutdown_connections 2024-02-28T15:52:35.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.713+0000 7f64a1200700 1 --2- 172.21.15.57:0/2831215931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f649c0fdc50 0x7f649c0fe020 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:35.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.713+0000 7f64a1200700 1 -- 172.21.15.57:0/2831215931 >> 172.21.15.57:0/2831215931 conn(0x7f649c072850 msgr2=0x7f649c072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:35.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.713+0000 7f64a1200700 1 -- 172.21.15.57:0/2831215931 shutdown_connections 2024-02-28T15:52:35.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.713+0000 7f64a1200700 1 -- 172.21.15.57:0/2831215931 wait complete. 2024-02-28T15:52:35.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.714+0000 7f64a1200700 1 Processor -- start 2024-02-28T15:52:35.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.715+0000 7f64a1200700 1 -- start start 2024-02-28T15:52:35.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.715+0000 7f64a1200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f649c0fdc50 0x7f649c0fba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:35.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.715+0000 7f64a1200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f649c0fbfc0 0x7f649c0fc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:35.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.715+0000 7f64a1200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c1193d0 con 0x7f649c0fbfc0 2024-02-28T15:52:35.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.715+0000 7f64a1200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c119510 con 0x7f649c0fdc50 2024-02-28T15:52:35.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.715+0000 7f6499400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f649c0fbfc0 0x7f649c0fc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:35.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.715+0000 7f6499400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f649c0fbfc0 0x7f649c0fc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52702/0 (socket says 172.21.15.57:52702) 2024-02-28T15:52:35.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.715+0000 7f6499400700 1 -- 172.21.15.57:0/886666224 learned_addr learned my addr 172.21.15.57:0/886666224 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:52:35.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.716+0000 7f6499e00700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f649c0fdc50 0x7f649c0fba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:35.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.716+0000 7f6499e00700 1 -- 172.21.15.57:0/886666224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f649c0fdc50 msgr2=0x7f649c0fba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-28T15:52:35.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.716+0000 7f6499e00700 1 -- 172.21.15.57:0/886666224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f649c0fdc50 msgr2=0x7f649c0fba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-28T15:52:35.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.716+0000 7f6499e00700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f649c0fdc50 0x7f649c0fba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-28T15:52:35.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.716+0000 7f6499e00700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f649c0fdc50 0x7f649c0fba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T15:52:35.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.716+0000 7f6499400700 1 -- 172.21.15.57:0/886666224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f649c0fdc50 msgr2=0x7f649c0fba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T15:52:35.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.716+0000 7f6499400700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f649c0fdc50 0x7f649c0fba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:35.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.716+0000 7f6499400700 1 -- 172.21.15.57:0/886666224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c005040 con 0x7f649c0fbfc0 2024-02-28T15:52:35.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.716+0000 7f6499400700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f649c0fbfc0 0x7f649c0fc430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f648800b790 tx=0x7f6488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:35.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.717+0000 7f6492000700 1 -- 172.21.15.57:0/886666224 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6488010870 con 0x7f649c0fbfc0 2024-02-28T15:52:35.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.717+0000 7f6492000700 1 -- 172.21.15.57:0/886666224 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f648800f3e0 con 0x7f649c0fbfc0 2024-02-28T15:52:35.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.717+0000 7f64a1200700 1 -- 172.21.15.57:0/886666224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649c119770 con 0x7f649c0fbfc0 2024-02-28T15:52:35.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.717+0000 7f6492000700 1 -- 172.21.15.57:0/886666224 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6488010ea0 con 0x7f649c0fbfc0 2024-02-28T15:52:35.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.717+0000 7f64a1200700 1 -- 172.21.15.57:0/886666224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c119c80 con 0x7f649c0fbfc0 2024-02-28T15:52:35.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.718+0000 7f64a1200700 1 -- 172.21.15.57:0/886666224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649c104350 con 0x7f649c0fbfc0 2024-02-28T15:52:35.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.719+0000 7f6492000700 1 -- 172.21.15.57:0/886666224 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7f648800f550 con 0x7f649c0fbfc0 2024-02-28T15:52:35.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.720+0000 7f6492000700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6480069450 0x7f648006b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:35.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.720+0000 7f6492000700 1 -- 172.21.15.57:0/886666224 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6488086660 con 0x7f649c0fbfc0 2024-02-28T15:52:35.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.720+0000 7f6499e00700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6480069450 0x7f648006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:35.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.721+0000 7f6499e00700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6480069450 0x7f648006b900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f648c00b3b0 tx=0x7f648c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:35.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.725+0000 7f6492000700 1 -- 172.21.15.57:0/886666224 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f64880539d0 con 0x7f649c0fbfc0 2024-02-28T15:52:35.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.956+0000 7f64a1200700 1 -- 172.21.15.57:0/886666224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f649c05f5c0 con 0x7f649c0fbfc0 2024-02-28T15:52:35.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.956+0000 7f6492000700 1 -- 172.21.15.57:0/886666224 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7f64880140f0 con 0x7f649c0fbfc0 2024-02-28T15:52:35.952 INFO:teuthology.orchestra.run.smithi057.stdout:# minimal ceph.conf for bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:52:35.952 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-02-28T15:52:35.952 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T15:52:35.952 INFO:teuthology.orchestra.run.smithi057.stdout: mon_host = [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] 2024-02-28T15:52:35.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 -- 172.21.15.57:0/886666224 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6480069450 msgr2=0x7f648006b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:35.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6480069450 0x7f648006b900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f648c00b3b0 tx=0x7f648c009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:35.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 -- 172.21.15.57:0/886666224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f649c0fbfc0 msgr2=0x7f649c0fc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:35.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f649c0fbfc0 0x7f649c0fc430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f648800b790 tx=0x7f6488009250 comp rx=0 tx=0).stop 2024-02-28T15:52:35.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 -- 172.21.15.57:0/886666224 shutdown_connections 2024-02-28T15:52:35.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6480069450 0x7f648006b900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:35.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f649c0fdc50 0x7f649c0fba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:35.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 --2- 172.21.15.57:0/886666224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f649c0fbfc0 0x7f649c0fc430 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:35.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 -- 172.21.15.57:0/886666224 >> 172.21.15.57:0/886666224 conn(0x7f649c072850 msgr2=0x7f649c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:35.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 -- 172.21.15.57:0/886666224 shutdown_connections 2024-02-28T15:52:35.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:35.959+0000 7f64a1200700 1 -- 172.21.15.57:0/886666224 wait complete. 2024-02-28T15:52:36.754 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-28T15:52:36.754 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:52:36.754 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.conf 2024-02-28T15:52:36.828 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:52:36.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T15:52:36.932 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:36 smithi057 ceph-mon[28763]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:36.932 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:36.933 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:36.933 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:36.933 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:52:36.933 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:36 smithi057 ceph-mon[28763]: Updating smithi057:/etc/ceph/ceph.conf 2024-02-28T15:52:36.933 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:36 smithi057 ceph-mon[28763]: Updating smithi087:/etc/ceph/ceph.conf 2024-02-28T15:52:36.933 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:36 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/886666224' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:36.933 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:52:36.933 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:36.959 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:52:36.960 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.conf 2024-02-28T15:52:36.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:36 smithi087 ceph-mon[37122]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:36.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:36.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:36.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:36.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:52:36.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:36 smithi087 ceph-mon[37122]: Updating smithi057:/etc/ceph/ceph.conf 2024-02-28T15:52:36.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:36 smithi087 ceph-mon[37122]: Updating smithi087:/etc/ceph/ceph.conf 2024-02-28T15:52:36.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:36 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/886666224' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:36.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:52:36.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.042 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:52:37.042 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T15:52:37.177 INFO:tasks.cephadm:Deploying OSDs... 2024-02-28T15:52:37.177 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:52:37.177 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2024-02-28T15:52:37.224 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-28T15:52:37.224 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2024-02-28T15:52:37.319 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-28T15:52:37.319 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T15:52:37.319 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-02-28T15:52:37.319 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T15:52:37.319 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T15:52:37.319 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-02-28 15:51:40.445388289 +0000 2024-02-28T15:52:37.320 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-02-28 15:43:45.865153709 +0000 2024-02-28T15:52:37.320 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-02-28 15:43:45.865153709 +0000 2024-02-28T15:52:37.320 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-02-28 15:43:45.865153709 +0000 2024-02-28T15:52:37.320 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-28T15:52:37.392 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-02-28T15:52:37.392 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-02-28T15:52:37.392 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000360331 s, 1.4 MB/s 2024-02-28T15:52:37.396 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-28T15:52:37.441 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2024-02-28T15:52:37.522 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-28T15:52:37.522 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T15:52:37.522 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-02-28T15:52:37.522 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T15:52:37.522 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T15:52:37.522 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-02-28 15:51:40.446388274 +0000 2024-02-28T15:52:37.523 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-02-28 15:43:46.469144994 +0000 2024-02-28T15:52:37.523 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-02-28 15:43:46.469144994 +0000 2024-02-28T15:52:37.523 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-02-28 15:43:46.469144994 +0000 2024-02-28T15:52:37.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-28T15:52:37.643 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-02-28T15:52:37.644 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-02-28T15:52:37.644 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000361769 s, 1.4 MB/s 2024-02-28T15:52:37.647 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-28T15:52:37.689 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2024-02-28T15:52:37.769 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-28T15:52:37.769 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T15:52:37.769 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-02-28T15:52:37.770 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T15:52:37.770 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T15:52:37.770 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-02-28 15:51:40.447388260 +0000 2024-02-28T15:52:37.770 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-02-28 15:43:47.073136279 +0000 2024-02-28T15:52:37.770 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-02-28 15:43:47.073136279 +0000 2024-02-28T15:52:37.770 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-02-28 15:43:47.073136279 +0000 2024-02-28T15:52:37.770 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-28T15:52:37.882 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-02-28T15:52:37.882 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-02-28T15:52:37.882 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000619567 s, 826 kB/s 2024-02-28T15:52:37.884 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-28T15:52:37.889 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:37 smithi057 ceph-mon[28763]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:37.889 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:37 smithi057 ceph-mon[28763]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:37.889 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.889 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.889 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.889 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.889 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.889 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T15:52:37.890 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T15:52:37.890 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:37.931 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2024-02-28T15:52:37.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:37 smithi087 ceph-mon[37122]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:37.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:37 smithi087 ceph-mon[37122]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T15:52:37.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:37.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T15:52:37.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T15:52:37.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:37.973 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-28T15:52:37.974 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T15:52:37.974 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-02-28T15:52:37.974 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T15:52:37.974 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T15:52:37.974 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-02-28 15:51:40.448388245 +0000 2024-02-28T15:52:37.974 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-02-28 15:43:47.677127565 +0000 2024-02-28T15:52:37.974 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-02-28 15:43:47.677127565 +0000 2024-02-28T15:52:37.974 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-02-28 15:43:47.677127565 +0000 2024-02-28T15:52:37.974 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-28T15:52:38.103 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-02-28T15:52:38.103 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-02-28T15:52:38.103 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000578358 s, 885 kB/s 2024-02-28T15:52:38.106 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-28T15:52:38.157 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:52:38.157 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-02-28T15:52:38.214 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-28T15:52:38.214 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-02-28T15:52:38.263 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-28T15:52:38.264 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T15:52:38.264 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-02-28T15:52:38.264 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T15:52:38.264 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T15:52:38.264 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-02-28 15:52:25.442191548 +0000 2024-02-28T15:52:38.264 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-02-28 15:43:37.269735117 +0000 2024-02-28T15:52:38.264 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-02-28 15:43:37.269735117 +0000 2024-02-28T15:52:38.264 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-02-28 15:43:37.269735117 +0000 2024-02-28T15:52:38.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-28T15:52:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-02-28T15:52:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-02-28T15:52:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000399928 s, 1.3 MB/s 2024-02-28T15:52:38.345 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-28T15:52:38.396 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-02-28T15:52:38.441 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-28T15:52:38.441 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T15:52:38.441 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-02-28T15:52:38.441 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T15:52:38.441 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T15:52:38.441 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-02-28 15:52:25.443191525 +0000 2024-02-28T15:52:38.441 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-02-28 15:43:37.822722460 +0000 2024-02-28T15:52:38.441 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-02-28 15:43:37.822722460 +0000 2024-02-28T15:52:38.441 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-02-28 15:43:37.822722460 +0000 2024-02-28T15:52:38.442 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-28T15:52:38.573 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-02-28T15:52:38.573 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-02-28T15:52:38.573 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000353023 s, 1.5 MB/s 2024-02-28T15:52:38.576 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-28T15:52:38.632 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-02-28T15:52:38.683 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-28T15:52:38.683 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T15:52:38.683 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-02-28T15:52:38.683 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T15:52:38.683 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T15:52:38.683 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-02-28 15:52:25.443191525 +0000 2024-02-28T15:52:38.683 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-02-28 15:43:38.396709322 +0000 2024-02-28T15:52:38.683 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-02-28 15:43:38.396709322 +0000 2024-02-28T15:52:38.683 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-02-28 15:43:38.396709322 +0000 2024-02-28T15:52:38.684 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-28T15:52:38.770 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-02-28T15:52:38.770 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-02-28T15:52:38.770 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000328141 s, 1.6 MB/s 2024-02-28T15:52:38.774 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-28T15:52:38.826 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-02-28T15:52:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-28T15:52:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T15:52:38.876 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-02-28T15:52:38.876 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T15:52:38.876 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T15:52:38.876 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-02-28 15:52:25.444191502 +0000 2024-02-28T15:52:38.876 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-02-28 15:43:38.971696162 +0000 2024-02-28T15:52:38.876 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-02-28 15:43:38.971696162 +0000 2024-02-28T15:52:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-02-28 15:43:38.971696162 +0000 2024-02-28T15:52:38.876 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-28T15:52:38.880 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:38 smithi057 ceph-mon[28763]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:38.880 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:38 smithi057 ceph-mon[28763]: Reconfiguring mon.smithi057 (unknown last config time)... 2024-02-28T15:52:38.880 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:38 smithi057 ceph-mon[28763]: Reconfiguring daemon mon.smithi057 on smithi057 2024-02-28T15:52:38.952 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:38 smithi087 ceph-mon[37122]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:38.952 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:38 smithi087 ceph-mon[37122]: Reconfiguring mon.smithi057 (unknown last config time)... 2024-02-28T15:52:38.952 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:38 smithi087 ceph-mon[37122]: Reconfiguring daemon mon.smithi057 on smithi057 2024-02-28T15:52:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-02-28T15:52:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-02-28T15:52:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00029838 s, 1.7 MB/s 2024-02-28T15:52:38.963 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-28T15:52:39.016 INFO:tasks.cephadm:Deploying osd.0 on smithi057 with /dev/vg_nvme/lv_4... 2024-02-28T15:52:39.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-28T15:52:39.527 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:52:40.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:40 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:40.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:40 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:40.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:40 smithi057 ceph-mon[28763]: Reconfiguring mgr.smithi057.upqerc (unknown last config time)... 2024-02-28T15:52:40.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:40 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi057.upqerc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T15:52:40.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:40 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T15:52:40.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:40 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:40.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:40 smithi057 ceph-mon[28763]: Reconfiguring daemon mgr.smithi057.upqerc on smithi057 2024-02-28T15:52:40.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:40 smithi057 ceph-mon[28763]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:40.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:40 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:40.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:40 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:40.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:40 smithi087 ceph-mon[37122]: Reconfiguring mgr.smithi057.upqerc (unknown last config time)... 2024-02-28T15:52:40.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:40 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi057.upqerc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T15:52:40.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:40 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T15:52:40.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:40 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:40.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:40 smithi087 ceph-mon[37122]: Reconfiguring daemon mgr.smithi057.upqerc on smithi057 2024-02-28T15:52:40.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:40 smithi087 ceph-mon[37122]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:42.369 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:42 smithi057 ceph-mon[28763]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:42.370 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:42.370 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:42.370 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi057", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T15:52:42.370 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:42.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:42 smithi087 ceph-mon[37122]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:42.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:42.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:42.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi057", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T15:52:42.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:43.266 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-28T15:52:43.267 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-28T15:52:43.267 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2024-02-28T15:52:43.267 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2024-02-28T15:52:43.267 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0514461 s, 204 MB/s 2024-02-28T15:52:43.267 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2024-02-28T15:52:43.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:43 smithi057 ceph-mon[28763]: Reconfiguring crash.smithi057 (monmap changed)... 2024-02-28T15:52:43.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:43 smithi057 ceph-mon[28763]: Reconfiguring daemon crash.smithi057 on smithi057 2024-02-28T15:52:43.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:43 smithi087 ceph-mon[37122]: Reconfiguring crash.smithi057 (monmap changed)... 2024-02-28T15:52:43.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:43 smithi087 ceph-mon[37122]: Reconfiguring daemon crash.smithi057 on smithi057 2024-02-28T15:52:44.217 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi057:vg_nvme/lv_4 2024-02-28T15:52:44.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:44 smithi057 ceph-mon[28763]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:44.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:44 smithi087 ceph-mon[37122]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:44.806 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:52:45.991 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:45 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:45.991 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:45 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:45.991 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:45 smithi057 ceph-mon[28763]: Reconfiguring alertmanager.smithi057 (dependencies changed)... 2024-02-28T15:52:45.991 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:45 smithi057 ceph-mon[28763]: Reconfiguring daemon alertmanager.smithi057 on smithi057 2024-02-28T15:52:45.991 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:45 smithi057 ceph-mon[28763]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:46.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:45 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:46.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:45 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:46.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:45 smithi087 ceph-mon[37122]: Reconfiguring alertmanager.smithi057 (dependencies changed)... 2024-02-28T15:52:46.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:45 smithi087 ceph-mon[37122]: Reconfiguring daemon alertmanager.smithi057 on smithi057 2024-02-28T15:52:46.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:45 smithi087 ceph-mon[37122]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.231+0000 7f137aa00700 1 -- 172.21.15.57:0/2213259575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1374103540 msgr2=0x7f1374103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.231+0000 7f137aa00700 1 --2- 172.21.15.57:0/2213259575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1374103540 0x7f1374103950 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1364004940 tx=0x7f1364009e30 comp rx=0 tx=0).stop 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.231+0000 7f137aa00700 1 -- 172.21.15.57:0/2213259575 shutdown_connections 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.231+0000 7f137aa00700 1 --2- 172.21.15.57:0/2213259575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1374104750 0x7f1374104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.231+0000 7f137aa00700 1 --2- 172.21.15.57:0/2213259575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1374103540 0x7f1374103950 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.231+0000 7f137aa00700 1 -- 172.21.15.57:0/2213259575 >> 172.21.15.57:0/2213259575 conn(0x7f13740727d0 msgr2=0x7f1374074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.231+0000 7f137aa00700 1 -- 172.21.15.57:0/2213259575 shutdown_connections 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.231+0000 7f137aa00700 1 -- 172.21.15.57:0/2213259575 wait complete. 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.232+0000 7f137aa00700 1 Processor -- start 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.232+0000 7f137aa00700 1 -- start start 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.232+0000 7f137aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1374103540 0x7f1374113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.232+0000 7f137aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1374104750 0x7f13741144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.232+0000 7f137aa00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1374114aa0 con 0x7f1374104750 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.233+0000 7f137aa00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1374115340 con 0x7f1374103540 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.233+0000 7f1373400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1374104750 0x7f13741144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.233+0000 7f1373400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1374104750 0x7f13741144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40464/0 (socket says 172.21.15.57:40464) 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.233+0000 7f1373400700 1 -- 172.21.15.57:0/2152425750 learned_addr learned my addr 172.21.15.57:0/2152425750 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.233+0000 7f1373e00700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1374103540 0x7f1374113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.233+0000 7f1373400700 1 -- 172.21.15.57:0/2152425750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1374103540 msgr2=0x7f1374113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.233+0000 7f1373400700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1374103540 0x7f1374113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.233+0000 7f1373400700 1 -- 172.21.15.57:0/2152425750 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364005040 con 0x7f1374104750 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.233+0000 7f1373e00700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1374103540 0x7f1374113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.233+0000 7f1373400700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1374104750 0x7f13741144a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1360002a50 tx=0x7f13600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.234+0000 7f136be00700 1 -- 172.21.15.57:0/2152425750 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1360007cc0 con 0x7f1374104750 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.234+0000 7f136be00700 1 -- 172.21.15.57:0/2152425750 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f136000f040 con 0x7f1374104750 2024-02-28T15:52:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.234+0000 7f137aa00700 1 -- 172.21.15.57:0/2152425750 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1374115620 con 0x7f1374104750 2024-02-28T15:52:48.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.234+0000 7f136be00700 1 -- 172.21.15.57:0/2152425750 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1360009640 con 0x7f1374104750 2024-02-28T15:52:48.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.234+0000 7f137aa00700 1 -- 172.21.15.57:0/2152425750 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1374115b60 con 0x7f1374104750 2024-02-28T15:52:48.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.235+0000 7f137aa00700 1 -- 172.21.15.57:0/2152425750 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137404bed0 con 0x7f1374104750 2024-02-28T15:52:48.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.236+0000 7f136be00700 1 -- 172.21.15.57:0/2152425750 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7f13600097a0 con 0x7f1374104750 2024-02-28T15:52:48.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.237+0000 7f136be00700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f13580692e0 0x7f135806b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:52:48.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.237+0000 7f136be00700 1 -- 172.21.15.57:0/2152425750 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1360085e40 con 0x7f1374104750 2024-02-28T15:52:48.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.238+0000 7f1373e00700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f13580692e0 0x7f135806b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:52:48.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.238+0000 7f1373e00700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f13580692e0 0x7f135806b790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f136400b840 tx=0x7f1364009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:52:48.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.243+0000 7f136be00700 1 -- 172.21.15.57:0/2152425750 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1360056c40 con 0x7f1374104750 2024-02-28T15:52:48.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:48 smithi057 ceph-mon[28763]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:48.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:52:48.474+0000 7f137aa00700 1 -- 172.21.15.57:0/2152425750 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1374116000 con 0x7f13580692e0 2024-02-28T15:52:48.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:48 smithi087 ceph-mon[37122]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:49.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:49 smithi057 ceph-mon[28763]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:52:49.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:49 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:52:49.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:49 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:52:49.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:49 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:49.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:49 smithi087 ceph-mon[37122]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:52:49.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:49 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:52:49.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:49 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:52:49.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:49 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:52:50.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:50 smithi057 ceph-mon[28763]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:50.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:50 smithi087 ceph-mon[37122]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:51.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:52:51.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:52:52.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:52 smithi057 ceph-mon[28763]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:52.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:52 smithi087 ceph-mon[37122]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:54.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:54 smithi057 ceph-mon[28763]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:54.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:54 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:54.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:54 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:54.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:54 smithi057 ceph-mon[28763]: Reconfiguring grafana.smithi057 (dependencies changed)... 2024-02-28T15:52:54.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:54 smithi057 ceph-mon[28763]: Reconfiguring daemon grafana.smithi057 on smithi057 2024-02-28T15:52:54.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:54 smithi087 ceph-mon[37122]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:54.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:54 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:54.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:54 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:52:54.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:54 smithi087 ceph-mon[37122]: Reconfiguring grafana.smithi057 (dependencies changed)... 2024-02-28T15:52:54.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:54 smithi087 ceph-mon[37122]: Reconfiguring daemon grafana.smithi057 on smithi057 2024-02-28T15:52:55.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:55 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/55549907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a78e2ba-3bfe-4677-b633-f2095c44065f"}]: dispatch 2024-02-28T15:52:55.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:55 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/55549907' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a78e2ba-3bfe-4677-b633-f2095c44065f"}]': finished 2024-02-28T15:52:55.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:55 smithi087 ceph-mon[37122]: osdmap e6: 1 total, 0 up, 1 in 2024-02-28T15:52:55.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:55 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:52:55.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:55 smithi087 ceph-mon[37122]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:56.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:55 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/55549907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a78e2ba-3bfe-4677-b633-f2095c44065f"}]: dispatch 2024-02-28T15:52:56.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:55 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/55549907' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a78e2ba-3bfe-4677-b633-f2095c44065f"}]': finished 2024-02-28T15:52:56.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:55 smithi057 ceph-mon[28763]: osdmap e6: 1 total, 0 up, 1 in 2024-02-28T15:52:56.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:55 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:52:56.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:55 smithi057 ceph-mon[28763]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:57.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:56 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3615694251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:52:57.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:56 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3615694251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:52:58.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:52:57 smithi087 ceph-mon[37122]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:52:58.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:52:57 smithi057 ceph-mon[28763]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:00.570 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:00 smithi057 ceph-mon[28763]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:00 smithi087 ceph-mon[37122]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:02.620 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:02 smithi057 ceph-mon[28763]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:02.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:02 smithi087 ceph-mon[37122]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:04.615 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:04 smithi057 ceph-mon[28763]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:04.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:04 smithi087 ceph-mon[37122]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:05.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:05 smithi057 ceph-mon[28763]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:06.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:05 smithi087 ceph-mon[37122]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:07.118 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:06 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:53:07.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:06 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:53:08.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:08 smithi057 ceph-mon[28763]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:08.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:08 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:08.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:08 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:08.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:08 smithi057 ceph-mon[28763]: Reconfiguring prometheus.smithi057 (dependencies changed)... 2024-02-28T15:53:08.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:08 smithi057 ceph-mon[28763]: Reconfiguring daemon prometheus.smithi057 on smithi057 2024-02-28T15:53:08.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:08 smithi087 ceph-mon[37122]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:08.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:08 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:08.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:08 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:08.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:08 smithi087 ceph-mon[37122]: Reconfiguring prometheus.smithi057 (dependencies changed)... 2024-02-28T15:53:08.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:08 smithi087 ceph-mon[37122]: Reconfiguring daemon prometheus.smithi057 on smithi057 2024-02-28T15:53:09.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:09 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T15:53:09.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:09 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:09.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:09 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T15:53:09.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:09 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:10.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:10 smithi057 ceph-mon[28763]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:10.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:10 smithi057 ceph-mon[28763]: Deploying daemon osd.0 on smithi057 2024-02-28T15:53:10.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:10 smithi087 ceph-mon[37122]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:10.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:10 smithi087 ceph-mon[37122]: Deploying daemon osd.0 on smithi057 2024-02-28T15:53:12.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:12 smithi057 ceph-mon[28763]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:12.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:12 smithi087 ceph-mon[37122]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:14.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:14 smithi057 ceph-mon[28763]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:14.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:14 smithi087 ceph-mon[37122]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:16.874 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:16 smithi057 ceph-mon[28763]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:16.874 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:16.874 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:16.874 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:16 smithi057 ceph-mon[28763]: Reconfiguring crash.smithi087 (monmap changed)... 2024-02-28T15:53:16.874 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T15:53:16.874 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:16.874 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:16 smithi057 ceph-mon[28763]: Reconfiguring daemon crash.smithi087 on smithi087 2024-02-28T15:53:16.930 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:16 smithi087 ceph-mon[37122]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:16.930 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:16 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:16.930 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:16 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:16.930 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:16 smithi087 ceph-mon[37122]: Reconfiguring crash.smithi087 (monmap changed)... 2024-02-28T15:53:16.930 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:16 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T15:53:16.930 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:16 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:16.930 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:16 smithi087 ceph-mon[37122]: Reconfiguring daemon crash.smithi087 on smithi087 2024-02-28T15:53:18.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:18 smithi057 ceph-mon[28763]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:18.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:18.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:18.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:18 smithi057 ceph-mon[28763]: Reconfiguring mgr.smithi087.ewrszc (monmap changed)... 2024-02-28T15:53:18.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T15:53:18.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T15:53:18.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:18.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:18 smithi057 ceph-mon[28763]: Reconfiguring daemon mgr.smithi087.ewrszc on smithi087 2024-02-28T15:53:18.691 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:18 smithi087 ceph-mon[37122]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:18.691 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:18.691 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:18.692 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:18 smithi087 ceph-mon[37122]: Reconfiguring mgr.smithi087.ewrszc (monmap changed)... 2024-02-28T15:53:18.692 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T15:53:18.692 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T15:53:18.692 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:18.692 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:18 smithi087 ceph-mon[37122]: Reconfiguring daemon mgr.smithi087.ewrszc on smithi087 2024-02-28T15:53:20.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:20 smithi087 ceph-mon[37122]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:20.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:20 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:20.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:20 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:20.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:20 smithi087 ceph-mon[37122]: Reconfiguring mon.smithi087 (monmap changed)... 2024-02-28T15:53:20.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:20 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T15:53:20.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:20 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T15:53:20.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:20 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:20.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:20 smithi087 ceph-mon[37122]: Reconfiguring daemon mon.smithi087 on smithi087 2024-02-28T15:53:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:20 smithi057 ceph-mon[28763]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:20 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:20 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:20 smithi057 ceph-mon[28763]: Reconfiguring mon.smithi087 (monmap changed)... 2024-02-28T15:53:20.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:20 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T15:53:20.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:20 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T15:53:20.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:20 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:20.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:20 smithi057 ceph-mon[28763]: Reconfiguring daemon mon.smithi087 on smithi087 2024-02-28T15:53:21.496 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:53:21.496 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:21.496 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:21.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:21 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:53:21.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:21 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:21.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:21 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:22.577 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:22.577 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T15:53:22.577 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T15:53:22.577 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi057.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T15:53:22.577 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi057.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi057.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi057.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi057.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi057.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:22.578 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:53:22.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:22.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T15:53:22.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T15:53:22.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi057.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T15:53:22.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi057.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T15:53:22.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:22.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T15:53:22.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T15:53:22.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi057.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T15:53:22.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi057.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T15:53:22.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:22.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T15:53:22.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T15:53:22.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi057.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T15:53:22.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi057.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T15:53:22.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:22.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:53:23.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:23.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:23.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:23 smithi057 ceph-mon[28763]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:24.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:24.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:24.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:23 smithi087 ceph-mon[37122]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:25.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:25 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:25.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:25 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:25.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:25 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:25.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:25 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:26.605 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:26 smithi057 ceph-mon[28763]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:26.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:26 smithi087 ceph-mon[37122]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:27.551 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:27 smithi057 ceph-mon[28763]: from='osd.0 [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T15:53:27.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.683+0000 7f136be00700 1 -- 172.21.15.57:0/2152425750 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1374116000 con 0x7f13580692e0 2024-02-28T15:53:27.678 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 0 on host 'smithi057' 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.687+0000 7f137aa00700 1 -- 172.21.15.57:0/2152425750 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f13580692e0 msgr2=0x7f135806b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.687+0000 7f137aa00700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f13580692e0 0x7f135806b790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f136400b840 tx=0x7f1364009e30 comp rx=0 tx=0).stop 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.687+0000 7f137aa00700 1 -- 172.21.15.57:0/2152425750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1374104750 msgr2=0x7f13741144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.687+0000 7f137aa00700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1374104750 0x7f13741144a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1360002a50 tx=0x7f13600046b0 comp rx=0 tx=0).stop 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.687+0000 7f137aa00700 1 -- 172.21.15.57:0/2152425750 shutdown_connections 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.687+0000 7f137aa00700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f13580692e0 0x7f135806b790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.687+0000 7f137aa00700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1374103540 0x7f1374113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.687+0000 7f137aa00700 1 --2- 172.21.15.57:0/2152425750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1374104750 0x7f13741144a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.687+0000 7f137aa00700 1 -- 172.21.15.57:0/2152425750 >> 172.21.15.57:0/2152425750 conn(0x7f13740727d0 msgr2=0x7f1374107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.688+0000 7f137aa00700 1 -- 172.21.15.57:0/2152425750 shutdown_connections 2024-02-28T15:53:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:27.688+0000 7f137aa00700 1 -- 172.21.15.57:0/2152425750 wait complete. 2024-02-28T15:53:27.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:27 smithi087 ceph-mon[37122]: from='osd.0 [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T15:53:28.607 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:28 smithi057 ceph-mon[28763]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:28.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:28 smithi057 ceph-mon[28763]: from='osd.0 [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T15:53:28.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:28 smithi057 ceph-mon[28763]: osdmap e7: 1 total, 0 up, 1 in 2024-02-28T15:53:28.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:28 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:53:28.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:28 smithi057 ceph-mon[28763]: from='osd.0 [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T15:53:28.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:28 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:28.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:28 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:28.661 DEBUG:teuthology.orchestra.run.smithi057:osd.0> sudo journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.0.service 2024-02-28T15:53:28.670 INFO:tasks.cephadm:Deploying osd.1 on smithi057 with /dev/vg_nvme/lv_3... 2024-02-28T15:53:28.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-28T15:53:28.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:28 smithi087 ceph-mon[37122]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:28.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:28 smithi087 ceph-mon[37122]: from='osd.0 [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T15:53:28.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:28 smithi087 ceph-mon[37122]: osdmap e7: 1 total, 0 up, 1 in 2024-02-28T15:53:28.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:28 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:53:28.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:28 smithi087 ceph-mon[37122]: from='osd.0 [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T15:53:28.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:28 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:28.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:28 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:29.269 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:53:29.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:29 smithi057 ceph-mon[28763]: from='osd.0 [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-02-28T15:53:29.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:29 smithi057 ceph-mon[28763]: osdmap e8: 1 total, 0 up, 1 in 2024-02-28T15:53:29.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:29 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:53:29.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:29 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:53:29.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:29 smithi087 ceph-mon[37122]: from='osd.0 [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-02-28T15:53:29.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:29 smithi087 ceph-mon[37122]: osdmap e8: 1 total, 0 up, 1 in 2024-02-28T15:53:29.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:29 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:53:29.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:29 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:53:30.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:30 smithi057 ceph-mon[28763]: purged_snaps scrub starts 2024-02-28T15:53:30.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:30 smithi057 ceph-mon[28763]: purged_snaps scrub ok 2024-02-28T15:53:30.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:30 smithi057 ceph-mon[28763]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:30.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:30 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:53:30.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:30 smithi057 ceph-mon[28763]: osd.0 [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986] boot 2024-02-28T15:53:30.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:30 smithi057 ceph-mon[28763]: osdmap e9: 1 total, 1 up, 1 in 2024-02-28T15:53:30.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:30 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:53:30.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:30 smithi087 ceph-mon[37122]: purged_snaps scrub starts 2024-02-28T15:53:30.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:30 smithi087 ceph-mon[37122]: purged_snaps scrub ok 2024-02-28T15:53:30.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:30 smithi087 ceph-mon[37122]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T15:53:30.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:30 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:53:30.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:30 smithi087 ceph-mon[37122]: osd.0 [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986] boot 2024-02-28T15:53:30.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:30 smithi087 ceph-mon[37122]: osdmap e9: 1 total, 1 up, 1 in 2024-02-28T15:53:30.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:30 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T15:53:31.617 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:31 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:31.617 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:31 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:31.617 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:31 smithi057 ceph-mon[28763]: osdmap e10: 1 total, 1 up, 1 in 2024-02-28T15:53:31.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:31 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:31.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:31 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:31.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:31 smithi087 ceph-mon[37122]: osdmap e10: 1 total, 1 up, 1 in 2024-02-28T15:53:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-28T15:53:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-28T15:53:32.486 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2024-02-28T15:53:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2024-02-28T15:53:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0475249 s, 221 MB/s 2024-02-28T15:53:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2024-02-28T15:53:32.520 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:32 smithi057 ceph-mon[28763]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:32.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:32 smithi087 ceph-mon[37122]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:33.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi057:vg_nvme/lv_3 2024-02-28T15:53:34.282 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:53:34.668 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:34 smithi057 ceph-mon[28763]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:34.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:34 smithi087 ceph-mon[37122]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:36.067 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:35 smithi057 ceph-mon[28763]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:36.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:35 smithi087 ceph-mon[37122]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:37.087 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:53:37.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.091+0000 7fe3fae00700 1 -- 172.21.15.57:0/1916085182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3f40fcfb0 msgr2=0x7fe3f40fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:53:37.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.091+0000 7fe3fae00700 1 --2- 172.21.15.57:0/1916085182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3f40fcfb0 0x7fe3f40fd420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc004940 tx=0x7fe3dc009e30 comp rx=0 tx=0).stop 2024-02-28T15:53:37.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.091+0000 7fe3fae00700 1 -- 172.21.15.57:0/1916085182 shutdown_connections 2024-02-28T15:53:37.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.091+0000 7fe3fae00700 1 --2- 172.21.15.57:0/1916085182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3f40fcfb0 0x7fe3f40fd420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.091+0000 7fe3fae00700 1 --2- 172.21.15.57:0/1916085182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f40fbe40 0x7fe3f40fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.091+0000 7fe3fae00700 1 -- 172.21.15.57:0/1916085182 >> 172.21.15.57:0/1916085182 conn(0x7fe3f40f74e0 msgr2=0x7fe3f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.092+0000 7fe3fae00700 1 -- 172.21.15.57:0/1916085182 shutdown_connections 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.092+0000 7fe3fae00700 1 -- 172.21.15.57:0/1916085182 wait complete. 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.093+0000 7fe3fae00700 1 Processor -- start 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.093+0000 7fe3fae00700 1 -- start start 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.094+0000 7fe3fae00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f40fbe40 0x7fe3f410d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.094+0000 7fe3fae00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3f40fcfb0 0x7fe3f410de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.094+0000 7fe3fae00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f410e490 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.094+0000 7fe3fae00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f410ed30 con 0x7fe3f40fbe40 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.094+0000 7fe3ebe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3f40fcfb0 0x7fe3f410de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:53:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.094+0000 7fe3ebe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3f40fcfb0 0x7fe3f410de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51470/0 (socket says 172.21.15.57:51470) 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.094+0000 7fe3ebe00700 1 -- 172.21.15.57:0/1593831571 learned_addr learned my addr 172.21.15.57:0/1593831571 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.095+0000 7fe3f3e00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f40fbe40 0x7fe3f410d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.095+0000 7fe3ebe00700 1 -- 172.21.15.57:0/1593831571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f40fbe40 msgr2=0x7fe3f410d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.095+0000 7fe3ebe00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f40fbe40 0x7fe3f410d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.095+0000 7fe3ebe00700 1 -- 172.21.15.57:0/1593831571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc005040 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.095+0000 7fe3ebe00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3f40fcfb0 0x7fe3f410de90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00b3b0 tx=0x7fe3dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.096+0000 7fe3f0c00700 1 -- 172.21.15.57:0/1593831571 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3dc00e040 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.096+0000 7fe3f0c00700 1 -- 172.21.15.57:0/1593831571 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3dc00bd90 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.096+0000 7fe3f0c00700 1 -- 172.21.15.57:0/1593831571 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3dc01c630 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.096+0000 7fe3fae00700 1 -- 172.21.15.57:0/1593831571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f410efb0 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.096+0000 7fe3fae00700 1 -- 172.21.15.57:0/1593831571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f410f4f0 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.097+0000 7fe3fae00700 1 -- 172.21.15.57:0/1593831571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f404bed0 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.098+0000 7fe3f0c00700 1 -- 172.21.15.57:0/1593831571 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7fe3dc013980 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.099+0000 7fe3f0c00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3d8069210 0x7fe3d806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:53:37.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.099+0000 7fe3f0c00700 1 -- 172.21.15.57:0/1593831571 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fe3dc087740 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.099+0000 7fe3f3e00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3d8069210 0x7fe3d806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:53:37.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.100+0000 7fe3f3e00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3d8069210 0x7fe3d806b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4004f60 tx=0x7fe3e400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:53:37.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.104+0000 7fe3f0c00700 1 -- 172.21.15.57:0/1593831571 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe3dc058360 con 0x7fe3f40fcfb0 2024-02-28T15:53:37.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:53:37.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:53:37.329+0000 7fe3fae00700 1 -- 172.21.15.57:0/1593831571 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3f410f990 con 0x7fe3d8069210 2024-02-28T15:53:38.054 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:38.054 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: Detected new or changed devices on smithi057 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: Adjusting osd_memory_target on smithi057 to 12871M 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:38.055 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:53:38.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: Detected new or changed devices on smithi057 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: Adjusting osd_memory_target on smithi057 to 12871M 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:53:38.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:38.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:53:40.590 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:40 smithi087 ceph-mon[37122]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:40.590 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:40 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:40.590 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:40 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:40.604 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:40 smithi057 ceph-mon[28763]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:40.604 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:40 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:40.604 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:40 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:41.460 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:41 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/569556525' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fccab799-0840-4050-9ead-4ad9e7e69fce"}]: dispatch 2024-02-28T15:53:41.460 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:41 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/569556525' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fccab799-0840-4050-9ead-4ad9e7e69fce"}]': finished 2024-02-28T15:53:41.461 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:41 smithi057 ceph-mon[28763]: osdmap e11: 2 total, 1 up, 2 in 2024-02-28T15:53:41.461 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:41 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T15:53:41.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:41 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/569556525' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fccab799-0840-4050-9ead-4ad9e7e69fce"}]: dispatch 2024-02-28T15:53:41.815 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:41 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/569556525' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fccab799-0840-4050-9ead-4ad9e7e69fce"}]': finished 2024-02-28T15:53:41.815 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:41 smithi087 ceph-mon[37122]: osdmap e11: 2 total, 1 up, 2 in 2024-02-28T15:53:41.815 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:41 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T15:53:42.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:42 smithi057 ceph-mon[28763]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:42.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:42 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2585158586' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:53:42.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:42 smithi087 ceph-mon[37122]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:42.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:42 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2585158586' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:53:44.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:44 smithi057 ceph-mon[28763]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:44.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:44 smithi087 ceph-mon[37122]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:45.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:45 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:45.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:45 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:45.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:45 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:45.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:45 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:53:45.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:45 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:46.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:45 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:46.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:45 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:46.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:45 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:46.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:45 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:53:46.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:45 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:53:46.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:46 smithi087 ceph-mon[37122]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:47.136 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:46 smithi057 ceph-mon[28763]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:48.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:48 smithi087 ceph-mon[37122]: pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:49.008 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:48 smithi057 ceph-mon[28763]: pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:50.157 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:49 smithi057 ceph-mon[28763]: pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:50.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:49 smithi087 ceph-mon[37122]: pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:51.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T15:53:51.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:51.264 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T15:53:51.264 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:53:52.062 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:52 smithi057 ceph-mon[28763]: Deploying daemon osd.1 on smithi057 2024-02-28T15:53:52.063 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:52 smithi057 ceph-mon[28763]: pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:52.063 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:53:52.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:52 smithi087 ceph-mon[37122]: Deploying daemon osd.1 on smithi057 2024-02-28T15:53:52.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:52 smithi087 ceph-mon[37122]: pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:52.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:52 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:53:54.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:54 smithi057 ceph-mon[28763]: pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:54.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:54 smithi087 ceph-mon[37122]: pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:56.067 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:55 smithi057 ceph-mon[28763]: pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:56.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:55 smithi087 ceph-mon[37122]: pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:58.617 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:58 smithi057 ceph-mon[28763]: pgmap v62: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:53:58.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:58 smithi087 ceph-mon[37122]: pgmap v62: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:54:00.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:59 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:00.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:59 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:00.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:59 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:54:00.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:53:59 smithi057 ceph-mon[28763]: pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:54:00.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:59 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:00.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:59 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:00.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:59 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:54:00.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:53:59 smithi087 ceph-mon[37122]: pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:54:02.803 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:02 smithi057 ceph-mon[28763]: pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:54:02.803 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:02 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:02.803 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:02 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:02.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:02 smithi087 ceph-mon[37122]: pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:54:02.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:02 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:02.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:02 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:03.753 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:03 smithi057 ceph-mon[28763]: from='osd.1 [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T15:54:03.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:03 smithi087 ceph-mon[37122]: from='osd.1 [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T15:54:04.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.229+0000 7fe3f0c00700 1 -- 172.21.15.57:0/1593831571 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe3f410f990 con 0x7fe3d8069210 2024-02-28T15:54:04.224 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 1 on host 'smithi057' 2024-02-28T15:54:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 -- 172.21.15.57:0/1593831571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3d8069210 msgr2=0x7fe3d806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:54:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3d8069210 0x7fe3d806b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4004f60 tx=0x7fe3e400b040 comp rx=0 tx=0).stop 2024-02-28T15:54:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 -- 172.21.15.57:0/1593831571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3f40fcfb0 msgr2=0x7fe3f410de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:54:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3f40fcfb0 0x7fe3f410de90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00b3b0 tx=0x7fe3dc009e30 comp rx=0 tx=0).stop 2024-02-28T15:54:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 -- 172.21.15.57:0/1593831571 shutdown_connections 2024-02-28T15:54:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3d8069210 0x7fe3d806b6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:04.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f40fbe40 0x7fe3f410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:04.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 --2- 172.21.15.57:0/1593831571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3f40fcfb0 0x7fe3f410de90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:04.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 -- 172.21.15.57:0/1593831571 >> 172.21.15.57:0/1593831571 conn(0x7fe3f40f74e0 msgr2=0x7fe3f4100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:54:04.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 -- 172.21.15.57:0/1593831571 shutdown_connections 2024-02-28T15:54:04.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:04.234+0000 7fe3fae00700 1 -- 172.21.15.57:0/1593831571 wait complete. 2024-02-28T15:54:04.776 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:04 smithi057 ceph-mon[28763]: pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:54:04.776 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:04 smithi057 ceph-mon[28763]: from='osd.1 [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T15:54:04.776 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:04 smithi057 ceph-mon[28763]: osdmap e12: 2 total, 1 up, 2 in 2024-02-28T15:54:04.776 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T15:54:04.776 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:04 smithi057 ceph-mon[28763]: from='osd.1 [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T15:54:04.776 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:04.776 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:04 smithi087 ceph-mon[37122]: pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:54:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:04 smithi087 ceph-mon[37122]: from='osd.1 [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T15:54:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:04 smithi087 ceph-mon[37122]: osdmap e12: 2 total, 1 up, 2 in 2024-02-28T15:54:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T15:54:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:04 smithi087 ceph-mon[37122]: from='osd.1 [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T15:54:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:05.169 DEBUG:teuthology.orchestra.run.smithi057:osd.1> sudo journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.1.service 2024-02-28T15:54:05.177 INFO:tasks.cephadm:Deploying osd.2 on smithi057 with /dev/vg_nvme/lv_2... 2024-02-28T15:54:05.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-28T15:54:05.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:05 smithi057 ceph-mon[28763]: from='osd.1 [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-02-28T15:54:05.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:05 smithi057 ceph-mon[28763]: osdmap e13: 2 total, 1 up, 2 in 2024-02-28T15:54:05.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:05 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T15:54:05.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:05 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T15:54:05.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:05 smithi087 ceph-mon[37122]: from='osd.1 [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-02-28T15:54:05.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:05 smithi087 ceph-mon[37122]: osdmap e13: 2 total, 1 up, 2 in 2024-02-28T15:54:05.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:05 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T15:54:05.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:05 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T15:54:06.129 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:54:06.654 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:06 smithi057 ceph-mon[28763]: purged_snaps scrub starts 2024-02-28T15:54:06.654 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:06 smithi057 ceph-mon[28763]: purged_snaps scrub ok 2024-02-28T15:54:06.654 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:06 smithi057 ceph-mon[28763]: pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:54:06.655 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:06 smithi057 ceph-mon[28763]: osd.1 [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257] boot 2024-02-28T15:54:06.655 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:06 smithi057 ceph-mon[28763]: osdmap e14: 2 total, 2 up, 2 in 2024-02-28T15:54:06.655 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:06 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T15:54:06.655 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:06 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:54:06.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:06 smithi087 ceph-mon[37122]: purged_snaps scrub starts 2024-02-28T15:54:06.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:06 smithi087 ceph-mon[37122]: purged_snaps scrub ok 2024-02-28T15:54:06.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:06 smithi087 ceph-mon[37122]: pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T15:54:06.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:06 smithi087 ceph-mon[37122]: osd.1 [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257] boot 2024-02-28T15:54:06.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:06 smithi087 ceph-mon[37122]: osdmap e14: 2 total, 2 up, 2 in 2024-02-28T15:54:06.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:06 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T15:54:06.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:06 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:54:08.148 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:07 smithi057 ceph-mon[28763]: osdmap e15: 2 total, 2 up, 2 in 2024-02-28T15:54:08.148 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:07 smithi057 ceph-mon[28763]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:07 smithi087 ceph-mon[37122]: osdmap e15: 2 total, 2 up, 2 in 2024-02-28T15:54:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:07 smithi087 ceph-mon[37122]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:09.437 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-28T15:54:09.437 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-28T15:54:09.437 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2024-02-28T15:54:09.437 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2024-02-28T15:54:09.437 INFO:teuthology.orchestra.run.smithi057.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0356653 s, 294 MB/s 2024-02-28T15:54:09.437 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2024-02-28T15:54:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:09 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:09 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:09 smithi057 ceph-mon[28763]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:09 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:09 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:09 smithi087 ceph-mon[37122]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:10.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi057:vg_nvme/lv_2 2024-02-28T15:54:11.514 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:54:12.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:12 smithi057 ceph-mon[28763]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:12.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:12 smithi087 ceph-mon[37122]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:13.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.977+0000 7f9208000700 1 -- 172.21.15.57:0/1570249619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92000fe0e0 msgr2=0x7f92000fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:54:13.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.977+0000 7f9208000700 1 --2- 172.21.15.57:0/1570249619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92000fe0e0 0x7f92000fe550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f91ec004940 tx=0x7f91ec009e30 comp rx=0 tx=0).stop 2024-02-28T15:54:13.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.977+0000 7f9208000700 1 -- 172.21.15.57:0/1570249619 shutdown_connections 2024-02-28T15:54:13.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.977+0000 7f9208000700 1 --2- 172.21.15.57:0/1570249619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92000fe0e0 0x7f92000fe550 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:13.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.977+0000 7f9208000700 1 --2- 172.21.15.57:0/1570249619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92000fcef0 0x7f92000fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:13.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.977+0000 7f9208000700 1 -- 172.21.15.57:0/1570249619 >> 172.21.15.57:0/1570249619 conn(0x7f92000f8620 msgr2=0x7f92000faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:54:13.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.977+0000 7f9208000700 1 -- 172.21.15.57:0/1570249619 shutdown_connections 2024-02-28T15:54:13.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.977+0000 7f9208000700 1 -- 172.21.15.57:0/1570249619 wait complete. 2024-02-28T15:54:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.978+0000 7f9208000700 1 Processor -- start 2024-02-28T15:54:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.978+0000 7f9208000700 1 -- start start 2024-02-28T15:54:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9208000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92000fcef0 0x7f920010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:54:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9208000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92000fe0e0 0x7f92001100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:54:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9208000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92001106a0 con 0x7f92000fe0e0 2024-02-28T15:54:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9208000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9200110f40 con 0x7f92000fcef0 2024-02-28T15:54:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9204c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92000fe0e0 0x7f92001100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:54:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9204c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92000fe0e0 0x7f92001100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32948/0 (socket says 172.21.15.57:32948) 2024-02-28T15:54:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9204c00700 1 -- 172.21.15.57:0/52199333 learned_addr learned my addr 172.21.15.57:0/52199333 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:54:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9205600700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92000fcef0 0x7f920010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:54:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9204c00700 1 -- 172.21.15.57:0/52199333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92000fcef0 msgr2=0x7f920010fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:54:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9204c00700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92000fcef0 0x7f920010fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.979+0000 7f9204c00700 1 -- 172.21.15.57:0/52199333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec005040 con 0x7f92000fe0e0 2024-02-28T15:54:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.980+0000 7f9204c00700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92000fe0e0 0x7f92001100a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009fd0 tx=0x7f91ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:54:13.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.980+0000 7f91fd600700 1 -- 172.21.15.57:0/52199333 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91ec00e040 con 0x7f92000fe0e0 2024-02-28T15:54:13.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.980+0000 7f91fd600700 1 -- 172.21.15.57:0/52199333 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91ec00bcc0 con 0x7f92000fe0e0 2024-02-28T15:54:13.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.980+0000 7f9208000700 1 -- 172.21.15.57:0/52199333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92001111c0 con 0x7f92000fe0e0 2024-02-28T15:54:13.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.980+0000 7f91fd600700 1 -- 172.21.15.57:0/52199333 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91ec01c630 con 0x7f92000fe0e0 2024-02-28T15:54:13.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.981+0000 7f9208000700 1 -- 172.21.15.57:0/52199333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9200111700 con 0x7f92000fe0e0 2024-02-28T15:54:13.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.982+0000 7f9208000700 1 -- 172.21.15.57:0/52199333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9200102210 con 0x7f92000fe0e0 2024-02-28T15:54:13.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.984+0000 7f91fd600700 1 -- 172.21.15.57:0/52199333 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7f91ec013980 con 0x7f92000fe0e0 2024-02-28T15:54:13.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.984+0000 7f91fd600700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f91e8069210 0x7f91e806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:54:13.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.985+0000 7f91fd600700 1 -- 172.21.15.57:0/52199333 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f91ec087750 con 0x7f92000fe0e0 2024-02-28T15:54:13.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.985+0000 7f9205600700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f91e8069210 0x7f91e806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:54:13.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.986+0000 7f9205600700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f91e8069210 0x7f91e806b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009fd0 tx=0x7f91f4009f00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:54:13.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:13.990+0000 7f91fd600700 1 -- 172.21.15.57:0/52199333 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f91ec058140 con 0x7f92000fe0e0 2024-02-28T15:54:14.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:14.231+0000 7f9208000700 1 -- 172.21.15.57:0/52199333 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9200111a50 con 0x7f91e8069210 2024-02-28T15:54:14.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:14 smithi057 ceph-mon[28763]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:14.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:14 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:54:14.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:14 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:54:14.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:14 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:14 smithi087 ceph-mon[37122]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:14 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:54:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:14 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:54:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:14 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:15.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:15 smithi057 ceph-mon[28763]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:54:15.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:15 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:15.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:15 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:15.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:15 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:54:15.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:15 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:54:15.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:15 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:15.608 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:15 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:15.609 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:15 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:54:15.609 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:15 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:15.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:15 smithi087 ceph-mon[37122]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:54:15.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:15 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:15.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:15 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:15.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:15 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:54:15.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:15 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:54:15.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:15 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:15.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:15 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:15.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:15 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:54:15.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:15 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:16 smithi057 ceph-mon[28763]: Detected new or changed devices on smithi057 2024-02-28T15:54:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:16 smithi057 ceph-mon[28763]: Adjusting osd_memory_target on smithi057 to 6435M 2024-02-28T15:54:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:16 smithi057 ceph-mon[28763]: pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:54:16.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:16 smithi087 ceph-mon[37122]: Detected new or changed devices on smithi057 2024-02-28T15:54:16.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:16 smithi087 ceph-mon[37122]: Adjusting osd_memory_target on smithi057 to 6435M 2024-02-28T15:54:16.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:16 smithi087 ceph-mon[37122]: pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:16.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:16 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:54:18.635 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:18 smithi057 ceph-mon[28763]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:18.636 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:18 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/346882440' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0a7b1d-f096-4698-b27a-6b5aa2239eb0"}]: dispatch 2024-02-28T15:54:18.636 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:18 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/346882440' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b0a7b1d-f096-4698-b27a-6b5aa2239eb0"}]': finished 2024-02-28T15:54:18.636 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:18 smithi057 ceph-mon[28763]: osdmap e16: 3 total, 2 up, 3 in 2024-02-28T15:54:18.636 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T15:54:18.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:18 smithi087 ceph-mon[37122]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:18.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:18 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/346882440' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0a7b1d-f096-4698-b27a-6b5aa2239eb0"}]: dispatch 2024-02-28T15:54:18.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:18 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/346882440' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b0a7b1d-f096-4698-b27a-6b5aa2239eb0"}]': finished 2024-02-28T15:54:18.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:18 smithi087 ceph-mon[37122]: osdmap e16: 3 total, 2 up, 3 in 2024-02-28T15:54:18.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T15:54:20.128 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:19 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/922990432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:54:20.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:19 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/922990432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:54:21.127 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:20 smithi057 ceph-mon[28763]: pgmap v78: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:21.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:20 smithi087 ceph-mon[37122]: pgmap v78: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:22.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:21 smithi057 ceph-mon[28763]: pgmap v79: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:22.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:54:22.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:21 smithi087 ceph-mon[37122]: pgmap v79: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:22.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:21 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:54:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:54:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:54:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:24.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:23 smithi057 ceph-mon[28763]: pgmap v80: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:24.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:23 smithi087 ceph-mon[37122]: pgmap v80: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:26.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:26 smithi057 ceph-mon[28763]: pgmap v81: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:26.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:26 smithi087 ceph-mon[37122]: pgmap v81: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:28.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:28 smithi057 ceph-mon[28763]: pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:28.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:28 smithi087 ceph-mon[37122]: pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:29.582 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:29 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T15:54:29.582 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:29 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:29.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:29 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T15:54:29.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:29 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:30.595 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:30 smithi057 ceph-mon[28763]: Deploying daemon osd.2 on smithi057 2024-02-28T15:54:30.595 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:30 smithi057 ceph-mon[28763]: pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:30.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:30 smithi087 ceph-mon[37122]: Deploying daemon osd.2 on smithi057 2024-02-28T15:54:30.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:30 smithi087 ceph-mon[37122]: pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:32.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:32 smithi057 ceph-mon[28763]: pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:32.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:32 smithi087 ceph-mon[37122]: pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:34 smithi057 ceph-mon[28763]: pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:34 smithi087 ceph-mon[37122]: pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:36.304 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:36 smithi057 ceph-mon[28763]: pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:36.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:36 smithi087 ceph-mon[37122]: pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:37.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:54:37.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:37.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:37.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:54:37.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:54:37.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:37.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:37.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:54:38.300 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:38 smithi057 ceph-mon[28763]: pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:38.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:38 smithi087 ceph-mon[37122]: pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:40.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:40 smithi057 ceph-mon[28763]: pgmap v88: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:40.618 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:40 smithi087 ceph-mon[37122]: pgmap v88: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:41.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.526+0000 7f91fd600700 1 -- 172.21.15.57:0/52199333 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9200111a50 con 0x7f91e8069210 2024-02-28T15:54:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 2 on host 'smithi057' 2024-02-28T15:54:41.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.530+0000 7f9208000700 1 -- 172.21.15.57:0/52199333 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f91e8069210 msgr2=0x7f91e806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:54:41.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.530+0000 7f9208000700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f91e8069210 0x7f91e806b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009fd0 tx=0x7f91f4009f00 comp rx=0 tx=0).stop 2024-02-28T15:54:41.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.530+0000 7f9208000700 1 -- 172.21.15.57:0/52199333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92000fe0e0 msgr2=0x7f92001100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:54:41.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.530+0000 7f9208000700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92000fe0e0 0x7f92001100a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009fd0 tx=0x7f91ec009e30 comp rx=0 tx=0).stop 2024-02-28T15:54:41.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.531+0000 7f9208000700 1 -- 172.21.15.57:0/52199333 shutdown_connections 2024-02-28T15:54:41.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.531+0000 7f9208000700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f91e8069210 0x7f91e806b6c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:41.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.531+0000 7f9208000700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92000fcef0 0x7f920010fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:41.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.531+0000 7f9208000700 1 --2- 172.21.15.57:0/52199333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92000fe0e0 0x7f92001100a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:41.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.531+0000 7f9208000700 1 -- 172.21.15.57:0/52199333 >> 172.21.15.57:0/52199333 conn(0x7f92000f8620 msgr2=0x7f92000ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:54:41.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.531+0000 7f9208000700 1 -- 172.21.15.57:0/52199333 shutdown_connections 2024-02-28T15:54:41.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:54:41.531+0000 7f9208000700 1 -- 172.21.15.57:0/52199333 wait complete. 2024-02-28T15:54:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:41 smithi057 ceph-mon[28763]: from='osd.2 [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T15:54:41.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:41 smithi087 ceph-mon[37122]: from='osd.2 [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T15:54:42.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:42 smithi057 ceph-mon[28763]: pgmap v89: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:42.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:42 smithi057 ceph-mon[28763]: from='osd.2 [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T15:54:42.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:42 smithi057 ceph-mon[28763]: osdmap e17: 3 total, 2 up, 3 in 2024-02-28T15:54:42.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T15:54:42.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:42 smithi057 ceph-mon[28763]: from='osd.2 [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T15:54:42.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:42.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:42.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:42 smithi087 ceph-mon[37122]: pgmap v89: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:42.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:42 smithi087 ceph-mon[37122]: from='osd.2 [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T15:54:42.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:42 smithi087 ceph-mon[37122]: osdmap e17: 3 total, 2 up, 3 in 2024-02-28T15:54:42.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T15:54:42.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:42 smithi087 ceph-mon[37122]: from='osd.2 [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T15:54:42.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:42.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:42.958 DEBUG:teuthology.orchestra.run.smithi057:osd.2> sudo journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.2.service 2024-02-28T15:54:42.963 INFO:tasks.cephadm:Deploying osd.3 on smithi087 with /dev/vg_nvme/lv_4... 2024-02-28T15:54:42.963 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-28T15:54:43.414 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi087/config 2024-02-28T15:54:43.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:43 smithi057 ceph-mon[28763]: from='osd.2 [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-02-28T15:54:43.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:43 smithi057 ceph-mon[28763]: osdmap e18: 3 total, 2 up, 3 in 2024-02-28T15:54:43.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:43 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T15:54:43.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:43 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T15:54:43.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:43 smithi087 ceph-mon[37122]: from='osd.2 [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-02-28T15:54:43.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:43 smithi087 ceph-mon[37122]: osdmap e18: 3 total, 2 up, 3 in 2024-02-28T15:54:43.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:43 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T15:54:43.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:43 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T15:54:44.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:44 smithi057 ceph-mon[28763]: purged_snaps scrub starts 2024-02-28T15:54:44.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:44 smithi057 ceph-mon[28763]: purged_snaps scrub ok 2024-02-28T15:54:44.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:44 smithi057 ceph-mon[28763]: pgmap v92: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:44.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:44 smithi057 ceph-mon[28763]: osd.2 [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967] boot 2024-02-28T15:54:44.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:44 smithi057 ceph-mon[28763]: osdmap e19: 3 total, 3 up, 3 in 2024-02-28T15:54:44.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:44 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T15:54:44.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:44 smithi087 ceph-mon[37122]: purged_snaps scrub starts 2024-02-28T15:54:44.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:44 smithi087 ceph-mon[37122]: purged_snaps scrub ok 2024-02-28T15:54:44.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:44 smithi087 ceph-mon[37122]: pgmap v92: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T15:54:44.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:44 smithi087 ceph-mon[37122]: osd.2 [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967] boot 2024-02-28T15:54:44.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:44 smithi087 ceph-mon[37122]: osdmap e19: 3 total, 3 up, 3 in 2024-02-28T15:54:44.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:44 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T15:54:46.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:45 smithi057 ceph-mon[28763]: osdmap e20: 3 total, 3 up, 3 in 2024-02-28T15:54:46.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:45 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:46.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:45 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:46.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:45 smithi087 ceph-mon[37122]: osdmap e20: 3 total, 3 up, 3 in 2024-02-28T15:54:46.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:45 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:46.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:45 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-28T15:54:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-28T15:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-02-28T15:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-02-28T15:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0332293 s, 316 MB/s 2024-02-28T15:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-02-28T15:54:46.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:46 smithi087 ceph-mon[37122]: pgmap v95: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:46.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:46 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-28T15:54:46.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:46 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-28T15:54:46.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:46 smithi087 ceph-mon[37122]: osdmap e21: 3 total, 3 up, 3 in 2024-02-28T15:54:46.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:46 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-28T15:54:47.124 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi087:vg_nvme/lv_4 2024-02-28T15:54:47.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:46 smithi057 ceph-mon[28763]: pgmap v95: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:47.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:46 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-28T15:54:47.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:46 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-28T15:54:47.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:46 smithi057 ceph-mon[28763]: osdmap e21: 3 total, 3 up, 3 in 2024-02-28T15:54:47.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:46 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-28T15:54:47.599 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi087/config 2024-02-28T15:54:48.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:48 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-28T15:54:48.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:48 smithi057 ceph-mon[28763]: osdmap e22: 3 total, 3 up, 3 in 2024-02-28T15:54:48.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:48 smithi057 ceph-mon[28763]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:48.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:48 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-28T15:54:48.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:48 smithi087 ceph-mon[37122]: osdmap e22: 3 total, 3 up, 3 in 2024-02-28T15:54:48.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:48 smithi087 ceph-mon[37122]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:48.680 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 15:54:48 smithi057 sudo[63698]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T15:54:48.680 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 15:54:48 smithi057 sudo[63698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T15:54:48.680 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 15:54:48 smithi057 sudo[63698]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T15:54:48.681 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 15:54:48 smithi057 sudo[63698]: pam_unix(sudo:session): session closed for user root 2024-02-28T15:54:49.331 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:49 smithi087 ceph-mon[37122]: osdmap e23: 3 total, 3 up, 3 in 2024-02-28T15:54:49.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:49 smithi057 ceph-mon[28763]: osdmap e23: 3 total, 3 up, 3 in 2024-02-28T15:54:49.429 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 15:54:49 smithi057 sudo[63711]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T15:54:49.429 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 15:54:49 smithi057 sudo[63711]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T15:54:49.429 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 15:54:49 smithi057 sudo[63711]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T15:54:49.430 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 15:54:49 smithi057 sudo[63711]: pam_unix(sudo:session): session closed for user root 2024-02-28T15:54:49.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.690+0000 7fc906600700 1 -- 172.21.15.87:0/3864066342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900070840 msgr2=0x7fc900070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:54:49.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.690+0000 7fc906600700 1 --2- 172.21.15.87:0/3864066342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900070840 0x7fc900070cb0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec004940 tx=0x7fc8ec009e30 comp rx=0 tx=0).stop 2024-02-28T15:54:49.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.690+0000 7fc906600700 1 -- 172.21.15.87:0/3864066342 shutdown_connections 2024-02-28T15:54:49.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.690+0000 7fc906600700 1 --2- 172.21.15.87:0/3864066342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900070840 0x7fc900070cb0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:49.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.690+0000 7fc906600700 1 --2- 172.21.15.87:0/3864066342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc900071e90 0x7fc900070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:49.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.690+0000 7fc906600700 1 -- 172.21.15.87:0/3864066342 >> 172.21.15.87:0/3864066342 conn(0x7fc9000f8620 msgr2=0x7fc9000faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:54:49.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.690+0000 7fc906600700 1 -- 172.21.15.87:0/3864066342 shutdown_connections 2024-02-28T15:54:49.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.690+0000 7fc906600700 1 -- 172.21.15.87:0/3864066342 wait complete. 2024-02-28T15:54:49.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.691+0000 7fc906600700 1 Processor -- start 2024-02-28T15:54:49.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.692+0000 7fc906600700 1 -- start start 2024-02-28T15:54:49.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.692+0000 7fc906600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900070840 0x7fc90010fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:54:49.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.692+0000 7fc906600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc900071e90 0x7fc900110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:54:49.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.692+0000 7fc906600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc900110680 con 0x7fc900071e90 2024-02-28T15:54:49.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.692+0000 7fc906600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc900110f20 con 0x7fc900070840 2024-02-28T15:54:49.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.693+0000 7fc8fea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc900071e90 0x7fc900110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:54:49.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.693+0000 7fc8fea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc900071e90 0x7fc900110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.87:60888/0 (socket says 172.21.15.87:60888) 2024-02-28T15:54:49.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.693+0000 7fc8fea00700 1 -- 172.21.15.87:0/4178078576 learned_addr learned my addr 172.21.15.87:0/4178078576 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:54:49.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.693+0000 7fc8ff400700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900070840 0x7fc90010fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:54:49.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.693+0000 7fc8fea00700 1 -- 172.21.15.87:0/4178078576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900070840 msgr2=0x7fc90010fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:54:49.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.693+0000 7fc8fea00700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900070840 0x7fc90010fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:54:49.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.693+0000 7fc8fea00700 1 -- 172.21.15.87:0/4178078576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec005040 con 0x7fc900071e90 2024-02-28T15:54:49.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.694+0000 7fc8fea00700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc900071e90 0x7fc900110080 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00b3b0 tx=0x7fc8ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:54:49.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.694+0000 7fc8f7400700 1 -- 172.21.15.87:0/4178078576 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8ec00e040 con 0x7fc900071e90 2024-02-28T15:54:49.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.694+0000 7fc906600700 1 -- 172.21.15.87:0/4178078576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9001111a0 con 0x7fc900071e90 2024-02-28T15:54:49.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.695+0000 7fc906600700 1 -- 172.21.15.87:0/4178078576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9001116e0 con 0x7fc900071e90 2024-02-28T15:54:49.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.695+0000 7fc8f7400700 1 -- 172.21.15.87:0/4178078576 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8ec004290 con 0x7fc900071e90 2024-02-28T15:54:49.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.695+0000 7fc8f7400700 1 -- 172.21.15.87:0/4178078576 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8ec025640 con 0x7fc900071e90 2024-02-28T15:54:49.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.696+0000 7fc906600700 1 -- 172.21.15.87:0/4178078576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90004bed0 con 0x7fc900071e90 2024-02-28T15:54:49.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.698+0000 7fc8f7400700 1 -- 172.21.15.87:0/4178078576 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 86565+0+0 (secure 0 0 0) 0x7fc8ec013420 con 0x7fc900071e90 2024-02-28T15:54:49.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.698+0000 7fc8f7400700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc8e4069210 0x7fc8e406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:54:49.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.699+0000 7fc8f7400700 1 -- 172.21.15.87:0/4178078576 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3228+0+0 (secure 0 0 0) 0x7fc8ec0881b0 con 0x7fc900071e90 2024-02-28T15:54:49.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.699+0000 7fc8ff400700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc8e4069210 0x7fc8e406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:54:49.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.700+0000 7fc8ff400700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc8e4069210 0x7fc8e406b6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00041d0 tx=0x7fc8f00043c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:54:49.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.713+0000 7fc8f7400700 1 -- 172.21.15.87:0/4178078576 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc8ec0589b0 con 0x7fc900071e90 2024-02-28T15:54:49.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:49.926+0000 7fc906600700 1 -- 172.21.15.87:0/4178078576 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc900111b90 con 0x7fc8e4069210 2024-02-28T15:54:49.928 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 15:54:49 smithi057 sudo[63737]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T15:54:49.929 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 15:54:49 smithi057 sudo[63737]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T15:54:49.929 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 15:54:49 smithi057 sudo[63737]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T15:54:49.929 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 15:54:49 smithi057 sudo[63737]: pam_unix(sudo:session): session closed for user root 2024-02-28T15:54:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:54:50.084+0000 7fc8f7400700 1 -- 172.21.15.87:0/4178078576 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fc8ec0552f0 con 0x7fc900071e90 2024-02-28T15:54:50.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:50 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:50.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:50 smithi087 ceph-mon[37122]: pgmap v100: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:50.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:50 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:54:50.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:50 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:54:50.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:50 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:50.342 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 15:54:50 smithi057 sudo[65809]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T15:54:50.342 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 15:54:50 smithi057 sudo[65809]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T15:54:50.342 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 15:54:50 smithi057 sudo[65809]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T15:54:50.342 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 15:54:50 smithi057 sudo[65809]: pam_unix(sudo:session): session closed for user root 2024-02-28T15:54:50.342 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:50 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:50.342 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:50 smithi057 ceph-mon[28763]: pgmap v100: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:50.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:50 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:54:50.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:50 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:54:50.343 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:50 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:51.074 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 15:54:50 smithi057 sudo[66439]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T15:54:51.074 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 15:54:50 smithi057 sudo[66439]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T15:54:51.074 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 15:54:50 smithi057 sudo[66439]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T15:54:51.074 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 15:54:50 smithi057 sudo[66439]: pam_unix(sudo:session): session closed for user root 2024-02-28T15:54:51.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:51 smithi087 ceph-mon[37122]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:54:51.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:51 smithi087 ceph-mon[37122]: mgrmap e19: smithi057.upqerc(active, since 2m), standbys: smithi087.ewrszc 2024-02-28T15:54:51.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:51 smithi057 ceph-mon[28763]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:54:51.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:51 smithi057 ceph-mon[28763]: mgrmap e19: smithi057.upqerc(active, since 2m), standbys: smithi087.ewrszc 2024-02-28T15:54:51.928 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 15:54:51 smithi057 sudo[66452]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T15:54:51.929 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 15:54:51 smithi057 sudo[66452]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T15:54:51.929 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 15:54:51 smithi057 sudo[66452]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T15:54:51.929 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 15:54:51 smithi057 sudo[66452]: pam_unix(sudo:session): session closed for user root 2024-02-28T15:54:52.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:52 smithi057 sudo[66478]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T15:54:52.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:52 smithi057 sudo[66478]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T15:54:52.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:52 smithi057 sudo[66478]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T15:54:52.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:52 smithi057 sudo[66478]: pam_unix(sudo:session): session closed for user root 2024-02-28T15:54:52.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:52 smithi057 sudo[66481]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T15:54:52.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:52 smithi057 sudo[66481]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T15:54:52.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:52 smithi057 sudo[66481]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T15:54:52.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:52 smithi057 sudo[66481]: pam_unix(sudo:session): session closed for user root 2024-02-28T15:54:53.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 sudo[40433]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T15:54:53.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 sudo[40433]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T15:54:53.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 sudo[40433]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T15:54:53.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 sudo[40433]: pam_unix(sudo:session): session closed for user root 2024-02-28T15:54:53.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:53 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:54:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:53 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:53 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:53 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:54:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:53 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:54:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:53 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:54:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:53 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:53 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:53 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:54:53.930 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:53 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:53.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 sudo[40458]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T15:54:53.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 sudo[40458]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T15:54:53.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 sudo[40458]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T15:54:53.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 sudo[40458]: pam_unix(sudo:session): session closed for user root 2024-02-28T15:54:53.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:54:53.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:53.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:53.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:54:53.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:54:53.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:54:53.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:53.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:53.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:54:53.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:53 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:54.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: pgmap v101: 1 pgs: 1 creating+peering; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:54.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: Detected new or changed devices on smithi057 2024-02-28T15:54:54.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: Adjusting osd_memory_target on smithi057 to 4290M 2024-02-28T15:54:54.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T15:54:54.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/2299094695' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c67654a-1d10-422e-9540-a348cff2d828"}]: dispatch 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c67654a-1d10-422e-9540-a348cff2d828"}]: dispatch 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c67654a-1d10-422e-9540-a348cff2d828"}]': finished 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: osdmap e24: 4 total, 3 up, 4 in 2024-02-28T15:54:54.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:54 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:54:55.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: pgmap v101: 1 pgs: 1 creating+peering; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:55.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: Detected new or changed devices on smithi057 2024-02-28T15:54:55.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: Adjusting osd_memory_target on smithi057 to 4290M 2024-02-28T15:54:55.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/2299094695' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c67654a-1d10-422e-9540-a348cff2d828"}]: dispatch 2024-02-28T15:54:55.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c67654a-1d10-422e-9540-a348cff2d828"}]: dispatch 2024-02-28T15:54:55.181 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c67654a-1d10-422e-9540-a348cff2d828"}]': finished 2024-02-28T15:54:55.181 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: osdmap e24: 4 total, 3 up, 4 in 2024-02-28T15:54:55.181 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:54 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:54:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:55 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/2014824988' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:54:55.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:55 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/2014824988' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:54:56.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:56 smithi057 ceph-mon[28763]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:56.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:56 smithi087 ceph-mon[37122]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:54:58.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:58 smithi087 ceph-mon[37122]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-02-28T15:54:58.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:58 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:58.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:58 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:58.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:58 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:58.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:58 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:54:58.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:58 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:59.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:58 smithi057 ceph-mon[28763]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-02-28T15:54:59.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:58 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:59.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:58 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:54:59.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:58 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:54:59.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:58 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:54:59.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:58 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:00.080 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:54:59 smithi087 ceph-mon[37122]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-02-28T15:55:00.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:54:59 smithi057 ceph-mon[28763]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-02-28T15:55:02.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:02 smithi057 ceph-mon[28763]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-02-28T15:55:02.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:02 smithi087 ceph-mon[37122]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-02-28T15:55:03.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T15:55:03.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:55:03.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:03 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T15:55:03.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:03 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:55:04.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:04 smithi057 ceph-mon[28763]: Deploying daemon osd.3 on smithi087 2024-02-28T15:55:04.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:04 smithi057 ceph-mon[28763]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T15:55:04.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:04 smithi087 ceph-mon[37122]: Deploying daemon osd.3 on smithi087 2024-02-28T15:55:04.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:04 smithi087 ceph-mon[37122]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T15:55:06.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:06 smithi087 ceph-mon[37122]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.6 KiB/s rd, 69 KiB/s wr, 4 op/s 2024-02-28T15:55:06.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:06 smithi057 ceph-mon[28763]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.6 KiB/s rd, 69 KiB/s wr, 4 op/s 2024-02-28T15:55:07.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:07 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:55:07.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:07 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:55:08.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:08 smithi087 ceph-mon[37122]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-28T15:55:08.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:08 smithi057 ceph-mon[28763]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-28T15:55:10.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:10 smithi087 ceph-mon[37122]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:55:10.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:10 smithi057 ceph-mon[28763]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:55:12.386 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:11 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:12.386 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:11 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:12.386 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:11 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:55:12.386 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:11 smithi057 ceph-mon[28763]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:55:12.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:11 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:12.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:11 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:12.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:11 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:55:12.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:11 smithi087 ceph-mon[37122]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:55:14.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:14 smithi087 ceph-mon[37122]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:55:14.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:14 smithi057 ceph-mon[28763]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:55:15.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:15 smithi087 ceph-mon[37122]: from='osd.3 [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T15:55:15.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:15 smithi087 ceph-mon[37122]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T15:55:15.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:15 smithi057 ceph-mon[28763]: from='osd.3 [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T15:55:15.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:15 smithi057 ceph-mon[28763]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T15:55:16.026 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 3 on host 'smithi087' 2024-02-28T15:55:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.032+0000 7fc8f7400700 1 -- 172.21.15.87:0/4178078576 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc900111b90 con 0x7fc8e4069210 2024-02-28T15:55:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.034+0000 7fc906600700 1 -- 172.21.15.87:0/4178078576 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc8e4069210 msgr2=0x7fc8e406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:55:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.034+0000 7fc906600700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc8e4069210 0x7fc8e406b6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00041d0 tx=0x7fc8f00043c0 comp rx=0 tx=0).stop 2024-02-28T15:55:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.035+0000 7fc906600700 1 -- 172.21.15.87:0/4178078576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc900071e90 msgr2=0x7fc900110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:55:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.035+0000 7fc906600700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc900071e90 0x7fc900110080 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00b3b0 tx=0x7fc8ec009e30 comp rx=0 tx=0).stop 2024-02-28T15:55:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.035+0000 7fc906600700 1 -- 172.21.15.87:0/4178078576 shutdown_connections 2024-02-28T15:55:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.035+0000 7fc906600700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc8e4069210 0x7fc8e406b6c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.035+0000 7fc906600700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900070840 0x7fc90010fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.035+0000 7fc906600700 1 --2- 172.21.15.87:0/4178078576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc900071e90 0x7fc900110080 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.035+0000 7fc906600700 1 -- 172.21.15.87:0/4178078576 >> 172.21.15.87:0/4178078576 conn(0x7fc9000f8620 msgr2=0x7fc900102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:55:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.035+0000 7fc906600700 1 -- 172.21.15.87:0/4178078576 shutdown_connections 2024-02-28T15:55:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:16.035+0000 7fc906600700 1 -- 172.21.15.87:0/4178078576 wait complete. 2024-02-28T15:55:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:16 smithi057 ceph-mon[28763]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:55:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:16 smithi057 ceph-mon[28763]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T15:55:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:16 smithi057 ceph-mon[28763]: osdmap e25: 4 total, 3 up, 4 in 2024-02-28T15:55:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:55:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:16 smithi057 ceph-mon[28763]: from='osd.3 [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:55:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:16 smithi057 ceph-mon[28763]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:55:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:16.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:16 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:16.694 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:16 smithi087 ceph-mon[37122]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:55:16.694 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:16 smithi087 ceph-mon[37122]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T15:55:16.694 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:16 smithi087 ceph-mon[37122]: osdmap e25: 4 total, 3 up, 4 in 2024-02-28T15:55:16.694 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:16 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:55:16.694 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:16 smithi087 ceph-mon[37122]: from='osd.3 [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:55:16.694 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:16 smithi087 ceph-mon[37122]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:55:16.694 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:16 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:16.694 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:16 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:16.694 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:16 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:16.694 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:16 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:16.760 DEBUG:teuthology.orchestra.run.smithi087:osd.3> sudo journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.3.service 2024-02-28T15:55:16.765 INFO:tasks.cephadm:Deploying osd.4 on smithi087 with /dev/vg_nvme/lv_3... 2024-02-28T15:55:16.765 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-28T15:55:17.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:17 smithi057 ceph-mon[28763]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-02-28T15:55:17.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:17 smithi057 ceph-mon[28763]: osdmap e26: 4 total, 3 up, 4 in 2024-02-28T15:55:17.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:17 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:55:17.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:17 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:55:17.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:17 smithi087 ceph-mon[37122]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-02-28T15:55:17.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:17 smithi087 ceph-mon[37122]: osdmap e26: 4 total, 3 up, 4 in 2024-02-28T15:55:17.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:17 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:55:17.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:17 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:55:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi087/config 2024-02-28T15:55:18.492 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:18 smithi087 ceph-mon[37122]: purged_snaps scrub starts 2024-02-28T15:55:18.492 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:18 smithi087 ceph-mon[37122]: purged_snaps scrub ok 2024-02-28T15:55:18.492 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:18 smithi087 ceph-mon[37122]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:55:18.493 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:55:18.493 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:18 smithi087 ceph-mon[37122]: osd.3 [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641] boot 2024-02-28T15:55:18.493 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:18 smithi087 ceph-mon[37122]: osdmap e27: 4 total, 4 up, 4 in 2024-02-28T15:55:18.493 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:55:18.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:18 smithi057 ceph-mon[28763]: purged_snaps scrub starts 2024-02-28T15:55:18.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:18 smithi057 ceph-mon[28763]: purged_snaps scrub ok 2024-02-28T15:55:18.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:18 smithi057 ceph-mon[28763]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-28T15:55:18.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:55:18.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:18 smithi057 ceph-mon[28763]: osd.3 [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641] boot 2024-02-28T15:55:18.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:18 smithi057 ceph-mon[28763]: osdmap e27: 4 total, 4 up, 4 in 2024-02-28T15:55:18.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T15:55:19.459 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:19 smithi087 ceph-mon[37122]: osdmap e28: 4 total, 4 up, 4 in 2024-02-28T15:55:19.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:19 smithi057 ceph-mon[28763]: osdmap e28: 4 total, 4 up, 4 in 2024-02-28T15:55:20.437 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:20 smithi087 ceph-mon[37122]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:20.437 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:20 smithi087 ceph-mon[37122]: osdmap e29: 4 total, 4 up, 4 in 2024-02-28T15:55:20.437 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:20 smithi087 ceph-mon[37122]: osdmap e30: 4 total, 4 up, 4 in 2024-02-28T15:55:20.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:20 smithi057 ceph-mon[28763]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:20.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:20 smithi057 ceph-mon[28763]: osdmap e29: 4 total, 4 up, 4 in 2024-02-28T15:55:20.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:20 smithi057 ceph-mon[28763]: osdmap e30: 4 total, 4 up, 4 in 2024-02-28T15:55:21.352 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-28T15:55:21.353 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-28T15:55:21.353 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-02-28T15:55:21.353 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-02-28T15:55:21.353 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0314615 s, 333 MB/s 2024-02-28T15:55:21.353 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-02-28T15:55:22.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:22 smithi087 ceph-mon[37122]: osdmap e31: 4 total, 4 up, 4 in 2024-02-28T15:55:22.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:22 smithi087 ceph-mon[37122]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:22.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:55:22.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:22 smithi057 ceph-mon[28763]: osdmap e31: 4 total, 4 up, 4 in 2024-02-28T15:55:22.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:22 smithi057 ceph-mon[28763]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:22.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:55:22.548 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi087:vg_nvme/lv_3 2024-02-28T15:55:23.009 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi087/config 2024-02-28T15:55:23.344 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: Detected new or changed devices on smithi087 2024-02-28T15:55:23.344 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:23.345 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:23.345 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:55:23.345 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: Adjusting osd_memory_target on smithi087 to 15939M 2024-02-28T15:55:23.345 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:23.345 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:55:23.345 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:55:23.345 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:23.346 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:55:23.346 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:55:23.346 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:55:23.346 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: Detected new or changed devices on smithi087 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: Adjusting osd_memory_target on smithi087 to 15939M 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:55:23.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:24.329 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:24 smithi087 ceph-mon[37122]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-02-28T15:55:24.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:24 smithi057 ceph-mon[28763]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-02-28T15:55:25.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.148+0000 7f868d800700 1 -- 172.21.15.87:0/4118075185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86880fcef0 msgr2=0x7f86880fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:55:25.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.148+0000 7f868d800700 1 --2- 172.21.15.87:0/4118075185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86880fcef0 0x7f86880fd320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8678004970 tx=0x7f8678009e30 comp rx=0 tx=0).stop 2024-02-28T15:55:25.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.148+0000 7f868d800700 1 -- 172.21.15.87:0/4118075185 shutdown_connections 2024-02-28T15:55:25.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.148+0000 7f868d800700 1 --2- 172.21.15.87:0/4118075185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86880fe0e0 0x7f86880fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:25.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.148+0000 7f868d800700 1 --2- 172.21.15.87:0/4118075185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86880fcef0 0x7f86880fd320 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:25.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.148+0000 7f868d800700 1 -- 172.21.15.87:0/4118075185 >> 172.21.15.87:0/4118075185 conn(0x7f86880f8620 msgr2=0x7f86880faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:55:25.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.148+0000 7f868d800700 1 -- 172.21.15.87:0/4118075185 shutdown_connections 2024-02-28T15:55:25.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.148+0000 7f868d800700 1 -- 172.21.15.87:0/4118075185 wait complete. 2024-02-28T15:55:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.149+0000 7f868d800700 1 Processor -- start 2024-02-28T15:55:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.149+0000 7f868d800700 1 -- start start 2024-02-28T15:55:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.149+0000 7f868d800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86880fcef0 0x7f868810fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:55:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.149+0000 7f868d800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86880fe0e0 0x7f8688110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:55:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.149+0000 7f868d800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8688110620 con 0x7f86880fe0e0 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.149+0000 7f868d800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8688110ec0 con 0x7f86880fcef0 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.149+0000 7f8686a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86880fcef0 0x7f868810fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.150+0000 7f8686a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86880fcef0 0x7f868810fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56208/0 (socket says 172.21.15.87:56208) 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.150+0000 7f8686a00700 1 -- 172.21.15.87:0/4215241481 learned_addr learned my addr 172.21.15.87:0/4215241481 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.150+0000 7f8686a00700 1 -- 172.21.15.87:0/4215241481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86880fe0e0 msgr2=0x7f8688110020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.150+0000 7f867e000700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86880fe0e0 0x7f8688110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.150+0000 7f8686a00700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86880fe0e0 0x7f8688110020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.150+0000 7f8686a00700 1 -- 172.21.15.87:0/4215241481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8678005040 con 0x7f86880fcef0 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.150+0000 7f8686a00700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86880fcef0 0x7f868810fae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8678004f50 tx=0x7f8678009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.150+0000 7f867f400700 1 -- 172.21.15.87:0/4215241481 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f867800e040 con 0x7f86880fcef0 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.151+0000 7f867f400700 1 -- 172.21.15.87:0/4215241481 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f867800bce0 con 0x7f86880fcef0 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.151+0000 7f868d800700 1 -- 172.21.15.87:0/4215241481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8688111140 con 0x7f86880fcef0 2024-02-28T15:55:25.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.151+0000 7f867f400700 1 -- 172.21.15.87:0/4215241481 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8678013660 con 0x7f86880fcef0 2024-02-28T15:55:25.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.151+0000 7f868d800700 1 -- 172.21.15.87:0/4215241481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8688111680 con 0x7f86880fcef0 2024-02-28T15:55:25.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.152+0000 7f868d800700 1 -- 172.21.15.87:0/4215241481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8688102210 con 0x7f86880fcef0 2024-02-28T15:55:25.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.153+0000 7f867f400700 1 -- 172.21.15.87:0/4215241481 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f867801ca90 con 0x7f86880fcef0 2024-02-28T15:55:25.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.154+0000 7f867f400700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f866c0692a0 0x7f866c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:55:25.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.154+0000 7f867f400700 1 -- 172.21.15.87:0/4215241481 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f8678087870 con 0x7f86880fcef0 2024-02-28T15:55:25.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.154+0000 7f867e000700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f866c0692a0 0x7f866c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:55:25.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.155+0000 7f867e000700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f866c0692a0 0x7f866c06b750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8670004d60 tx=0x7f867000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:55:25.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.159+0000 7f867f400700 1 -- 172.21.15.87:0/4215241481 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8678057c60 con 0x7f86880fcef0 2024-02-28T15:55:25.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:25.376+0000 7f868d800700 1 -- 172.21.15.87:0/4215241481 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f868802b340 con 0x7f866c0692a0 2024-02-28T15:55:26.336 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:26 smithi087 ceph-mon[37122]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-28T15:55:26.337 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:26 smithi087 ceph-mon[37122]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:55:26.337 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:26 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:55:26.337 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:26 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:55:26.337 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:26 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:55:26.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:26 smithi057 ceph-mon[28763]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-28T15:55:26.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:26 smithi057 ceph-mon[28763]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:55:26.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:26 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:55:26.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:26 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:55:26.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:26 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:55:28.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:28 smithi057 ceph-mon[28763]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-02-28T15:55:28.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:28 smithi087 ceph-mon[37122]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-02-28T15:55:29.672 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:29 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/1688215379' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f988788-349d-4afd-adca-af474c7bb8ff"}]: dispatch 2024-02-28T15:55:29.672 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:29 smithi087 ceph-mon[37122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f988788-349d-4afd-adca-af474c7bb8ff"}]: dispatch 2024-02-28T15:55:29.672 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:29 smithi087 ceph-mon[37122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f988788-349d-4afd-adca-af474c7bb8ff"}]': finished 2024-02-28T15:55:29.672 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:29 smithi087 ceph-mon[37122]: osdmap e32: 5 total, 4 up, 5 in 2024-02-28T15:55:29.672 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:29 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T15:55:29.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:29 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/1688215379' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f988788-349d-4afd-adca-af474c7bb8ff"}]: dispatch 2024-02-28T15:55:29.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:29 smithi057 ceph-mon[28763]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f988788-349d-4afd-adca-af474c7bb8ff"}]: dispatch 2024-02-28T15:55:29.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:29 smithi057 ceph-mon[28763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f988788-349d-4afd-adca-af474c7bb8ff"}]': finished 2024-02-28T15:55:29.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:29 smithi057 ceph-mon[28763]: osdmap e32: 5 total, 4 up, 5 in 2024-02-28T15:55:29.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:29 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T15:55:30.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:30 smithi057 ceph-mon[28763]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-02-28T15:55:30.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:30 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/1406238431' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:55:30.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:30 smithi087 ceph-mon[37122]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-02-28T15:55:30.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:30 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/1406238431' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:55:32.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:32 smithi057 ceph-mon[28763]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-28T15:55:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:32 smithi087 ceph-mon[37122]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-28T15:55:34.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:34 smithi087 ceph-mon[37122]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:34 smithi057 ceph-mon[28763]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:36.420 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:36 smithi087 ceph-mon[37122]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:36.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:36 smithi057 ceph-mon[28763]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:37.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:55:37.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:55:38.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:38 smithi057 ceph-mon[28763]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:38.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:38 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T15:55:38.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:38 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:55:38.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:38 smithi087 ceph-mon[37122]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:38.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:38 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T15:55:38.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:38 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:55:39.339 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:39 smithi087 ceph-mon[37122]: Deploying daemon osd.4 on smithi087 2024-02-28T15:55:39.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:39 smithi057 ceph-mon[28763]: Deploying daemon osd.4 on smithi087 2024-02-28T15:55:40.331 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:40 smithi057 ceph-mon[28763]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:40.451 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:40 smithi087 ceph-mon[37122]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:42.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:42 smithi087 ceph-mon[37122]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:42.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:42 smithi057 ceph-mon[28763]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:44.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:44 smithi087 ceph-mon[37122]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:44.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:44 smithi057 ceph-mon[28763]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:46.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:46 smithi057 ceph-mon[28763]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:46.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:46 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:46.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:46 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:46.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:46 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:55:46.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:46 smithi087 ceph-mon[37122]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:46.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:46 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:46.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:46 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:46.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:46 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:55:48.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:48 smithi087 ceph-mon[37122]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:48.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:48 smithi057 ceph-mon[28763]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:50.555 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:50 smithi087 ceph-mon[37122]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:50.555 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:50 smithi087 ceph-mon[37122]: from='osd.4 [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T15:55:50.555 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:50 smithi087 ceph-mon[37122]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T15:55:50.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.681+0000 7f867f400700 1 -- 172.21.15.87:0/4215241481 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f868802b340 con 0x7f866c0692a0 2024-02-28T15:55:50.675 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 4 on host 'smithi087' 2024-02-28T15:55:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:50 smithi057 ceph-mon[28763]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:50 smithi057 ceph-mon[28763]: from='osd.4 [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T15:55:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:50 smithi057 ceph-mon[28763]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T15:55:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 -- 172.21.15.87:0/4215241481 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f866c0692a0 msgr2=0x7f866c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:55:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f866c0692a0 0x7f866c06b750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8670004d60 tx=0x7f867000b040 comp rx=0 tx=0).stop 2024-02-28T15:55:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 -- 172.21.15.87:0/4215241481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86880fcef0 msgr2=0x7f868810fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:55:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86880fcef0 0x7f868810fae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8678004f50 tx=0x7f8678009e30 comp rx=0 tx=0).stop 2024-02-28T15:55:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 -- 172.21.15.87:0/4215241481 shutdown_connections 2024-02-28T15:55:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f866c0692a0 0x7f866c06b750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86880fcef0 0x7f868810fae0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 --2- 172.21.15.87:0/4215241481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86880fe0e0 0x7f8688110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 -- 172.21.15.87:0/4215241481 >> 172.21.15.87:0/4215241481 conn(0x7f86880f8620 msgr2=0x7f86880ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:55:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 -- 172.21.15.87:0/4215241481 shutdown_connections 2024-02-28T15:55:50.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:50.685+0000 7f868d800700 1 -- 172.21.15.87:0/4215241481 wait complete. 2024-02-28T15:55:51.538 DEBUG:teuthology.orchestra.run.smithi087:osd.4> sudo journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.4.service 2024-02-28T15:55:51.543 INFO:tasks.cephadm:Deploying osd.5 on smithi087 with /dev/vg_nvme/lv_2... 2024-02-28T15:55:51.543 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-28T15:55:51.647 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:51 smithi087 ceph-mon[37122]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T15:55:51.647 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:51 smithi087 ceph-mon[37122]: osdmap e33: 5 total, 4 up, 5 in 2024-02-28T15:55:51.647 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T15:55:51.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:51 smithi087 ceph-mon[37122]: from='osd.4 [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:55:51.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:51 smithi087 ceph-mon[37122]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:55:51.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:51.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:51.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:51.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:51.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:55:51.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:51 smithi057 ceph-mon[28763]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T15:55:51.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:51 smithi057 ceph-mon[28763]: osdmap e33: 5 total, 4 up, 5 in 2024-02-28T15:55:51.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T15:55:51.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:51 smithi057 ceph-mon[28763]: from='osd.4 [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:55:51.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:51 smithi057 ceph-mon[28763]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:55:51.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:51.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:51.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:51.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:55:51.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:55:52.017 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi087/config 2024-02-28T15:55:52.419 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:52 smithi087 ceph-mon[37122]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:52.419 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:52 smithi087 ceph-mon[37122]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-02-28T15:55:52.419 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:52 smithi087 ceph-mon[37122]: osdmap e34: 5 total, 4 up, 5 in 2024-02-28T15:55:52.419 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:52 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T15:55:52.419 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:52 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T15:55:52.419 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:52 smithi087 ceph-mon[37122]: osd.4 [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885] boot 2024-02-28T15:55:52.419 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:52 smithi087 ceph-mon[37122]: osdmap e35: 5 total, 5 up, 5 in 2024-02-28T15:55:52.419 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:52 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T15:55:52.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:52 smithi057 ceph-mon[28763]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T15:55:52.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:52 smithi057 ceph-mon[28763]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-02-28T15:55:52.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:52 smithi057 ceph-mon[28763]: osdmap e34: 5 total, 4 up, 5 in 2024-02-28T15:55:52.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T15:55:52.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T15:55:52.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:52 smithi057 ceph-mon[28763]: osd.4 [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885] boot 2024-02-28T15:55:52.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:52 smithi057 ceph-mon[28763]: osdmap e35: 5 total, 5 up, 5 in 2024-02-28T15:55:52.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:52 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T15:55:53.593 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:53 smithi087 ceph-mon[37122]: purged_snaps scrub starts 2024-02-28T15:55:53.594 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:53 smithi087 ceph-mon[37122]: purged_snaps scrub ok 2024-02-28T15:55:53.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:53 smithi057 ceph-mon[28763]: purged_snaps scrub starts 2024-02-28T15:55:53.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:53 smithi057 ceph-mon[28763]: purged_snaps scrub ok 2024-02-28T15:55:54.665 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:54 smithi087 ceph-mon[37122]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:55:54.666 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:54 smithi087 ceph-mon[37122]: osdmap e36: 5 total, 5 up, 5 in 2024-02-28T15:55:54.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:54 smithi057 ceph-mon[28763]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:55:54.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:54 smithi057 ceph-mon[28763]: osdmap e36: 5 total, 5 up, 5 in 2024-02-28T15:55:55.036 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-28T15:55:55.037 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-28T15:55:55.037 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-02-28T15:55:55.037 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-02-28T15:55:55.037 INFO:teuthology.orchestra.run.smithi087.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0477036 s, 220 MB/s 2024-02-28T15:55:55.037 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-02-28T15:55:56.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi087:vg_nvme/lv_2 2024-02-28T15:55:56.391 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:56 smithi087 ceph-mon[37122]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:55:56.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:56 smithi057 ceph-mon[28763]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:55:56.755 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi087/config 2024-02-28T15:55:58.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:55:58 smithi057 ceph-mon[28763]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:55:58.697 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:55:58 smithi087 ceph-mon[37122]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:55:59.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.806+0000 7f1f5f200700 1 -- 172.21.15.87:0/963925523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58071e90 msgr2=0x7f1f58070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:55:59.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.806+0000 7f1f5f200700 1 --2- 172.21.15.87:0/963925523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58071e90 0x7f1f58070300 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f48004940 tx=0x7f1f48009e30 comp rx=0 tx=0).stop 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.807+0000 7f1f5f200700 1 -- 172.21.15.87:0/963925523 shutdown_connections 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.807+0000 7f1f5f200700 1 --2- 172.21.15.87:0/963925523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58070840 0x7f1f58070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.807+0000 7f1f5f200700 1 --2- 172.21.15.87:0/963925523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58071e90 0x7f1f58070300 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.807+0000 7f1f5f200700 1 -- 172.21.15.87:0/963925523 >> 172.21.15.87:0/963925523 conn(0x7f1f580f8620 msgr2=0x7f1f580faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.807+0000 7f1f5f200700 1 -- 172.21.15.87:0/963925523 shutdown_connections 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.807+0000 7f1f5f200700 1 -- 172.21.15.87:0/963925523 wait complete. 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.808+0000 7f1f5f200700 1 Processor -- start 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.808+0000 7f1f5f200700 1 -- start start 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.808+0000 7f1f5f200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58070840 0x7f1f5810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f5f200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58071e90 0x7f1f58110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f5f200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58110680 con 0x7f1f58071e90 2024-02-28T15:55:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f5f200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58110f20 con 0x7f1f58070840 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f57e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58070840 0x7f1f5810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f57e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58070840 0x7f1f5810fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52520/0 (socket says 172.21.15.87:52520) 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f57e00700 1 -- 172.21.15.87:0/3913526294 learned_addr learned my addr 172.21.15.87:0/3913526294 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f57400700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58071e90 0x7f1f58110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f57e00700 1 -- 172.21.15.87:0/3913526294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58071e90 msgr2=0x7f1f58110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f57e00700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58071e90 0x7f1f58110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f57e00700 1 -- 172.21.15.87:0/3913526294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48005040 con 0x7f1f58070840 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.809+0000 7f1f57e00700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58070840 0x7f1f5810fb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1f480093b0 tx=0x7f1f48009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.810+0000 7f1f4fe00700 1 -- 172.21.15.87:0/3913526294 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f4800e040 con 0x7f1f58070840 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.810+0000 7f1f5f200700 1 -- 172.21.15.87:0/3913526294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f581111a0 con 0x7f1f58070840 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.810+0000 7f1f4fe00700 1 -- 172.21.15.87:0/3913526294 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f4800bcc0 con 0x7f1f58070840 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.810+0000 7f1f4fe00700 1 -- 172.21.15.87:0/3913526294 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f4801c630 con 0x7f1f58070840 2024-02-28T15:55:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.810+0000 7f1f5f200700 1 -- 172.21.15.87:0/3913526294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f581116e0 con 0x7f1f58070840 2024-02-28T15:55:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.811+0000 7f1f5f200700 1 -- 172.21.15.87:0/3913526294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5804bed0 con 0x7f1f58070840 2024-02-28T15:55:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.812+0000 7f1f4fe00700 1 -- 172.21.15.87:0/3913526294 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f1f480139f0 con 0x7f1f58070840 2024-02-28T15:55:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.813+0000 7f1f4fe00700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f1f3c0692a0 0x7f1f3c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:55:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.813+0000 7f1f4fe00700 1 -- 172.21.15.87:0/3913526294 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f1f48088140 con 0x7f1f58070840 2024-02-28T15:55:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.813+0000 7f1f57400700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f1f3c0692a0 0x7f1f3c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:55:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.814+0000 7f1f57400700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f1f3c0692a0 0x7f1f3c06b750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f44004d60 tx=0x7f1f4400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:55:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:55:59.817+0000 7f1f4fe00700 1 -- 172.21.15.87:0/3913526294 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1f48058350 con 0x7f1f58070840 2024-02-28T15:56:00.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:00.034+0000 7f1f5f200700 1 -- 172.21.15.87:0/3913526294 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f58104570 con 0x7f1f3c0692a0 2024-02-28T15:56:00.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: Detected new or changed devices on smithi087 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: Adjusting osd_memory_target on smithi087 to 7969M 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:56:00.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:56:00.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:56:00.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:00 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: Detected new or changed devices on smithi087 2024-02-28T15:56:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:56:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:56:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: Adjusting osd_memory_target on smithi087 to 7969M 2024-02-28T15:56:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:56:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:00.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:00.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:56:00.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T15:56:00.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T15:56:00.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:00 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:01.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:01 smithi087 ceph-mon[37122]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:56:01.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:01.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:56:01.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:01.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:01 smithi057 ceph-mon[28763]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:56:01.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:01.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:56:01.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:02.377 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:02 smithi087 ceph-mon[37122]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:02.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:02 smithi057 ceph-mon[28763]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:04.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:04 smithi057 ceph-mon[28763]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:04.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:04 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/2870622455' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "83e02849-bd1f-4fa8-893e-1bfd8b2cfe42"}]: dispatch 2024-02-28T15:56:04.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:04 smithi057 ceph-mon[28763]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "83e02849-bd1f-4fa8-893e-1bfd8b2cfe42"}]: dispatch 2024-02-28T15:56:04.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:04 smithi057 ceph-mon[28763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83e02849-bd1f-4fa8-893e-1bfd8b2cfe42"}]': finished 2024-02-28T15:56:04.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:04 smithi057 ceph-mon[28763]: osdmap e37: 6 total, 5 up, 6 in 2024-02-28T15:56:04.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T15:56:04.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:04 smithi087 ceph-mon[37122]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:04.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:04 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/2870622455' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "83e02849-bd1f-4fa8-893e-1bfd8b2cfe42"}]: dispatch 2024-02-28T15:56:04.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:04 smithi087 ceph-mon[37122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "83e02849-bd1f-4fa8-893e-1bfd8b2cfe42"}]: dispatch 2024-02-28T15:56:04.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:04 smithi087 ceph-mon[37122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83e02849-bd1f-4fa8-893e-1bfd8b2cfe42"}]': finished 2024-02-28T15:56:04.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:04 smithi087 ceph-mon[37122]: osdmap e37: 6 total, 5 up, 6 in 2024-02-28T15:56:04.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T15:56:05.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:05 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/511645800' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:56:05.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:05 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/511645800' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T15:56:06.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:06 smithi057 ceph-mon[28763]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:06.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:06 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:56:06.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:06 smithi087 ceph-mon[37122]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:06.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:06 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:56:08.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:08 smithi087 ceph-mon[37122]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:08.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:08 smithi057 ceph-mon[28763]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:10.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:10 smithi087 ceph-mon[37122]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:10.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:10 smithi057 ceph-mon[28763]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:12.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:12 smithi057 ceph-mon[28763]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:12.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:12 smithi087 ceph-mon[37122]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:13.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:13 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T15:56:13.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:13 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:13.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:13 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T15:56:13.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:13 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:14.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:14 smithi057 ceph-mon[28763]: Deploying daemon osd.5 on smithi087 2024-02-28T15:56:14.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:14 smithi057 ceph-mon[28763]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:14 smithi087 ceph-mon[37122]: Deploying daemon osd.5 on smithi087 2024-02-28T15:56:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:14 smithi087 ceph-mon[37122]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:16.380 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:16 smithi087 ceph-mon[37122]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:16.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:16 smithi057 ceph-mon[28763]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:18.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:18 smithi087 ceph-mon[37122]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:18.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:18 smithi057 ceph-mon[28763]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:20.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:20 smithi087 ceph-mon[37122]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:20.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:20 smithi057 ceph-mon[28763]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:21.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:56:21.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:21 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:56:22.674 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:22 smithi087 ceph-mon[37122]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:22.674 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:22.674 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:22.674 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:56:22.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:22 smithi057 ceph-mon[28763]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:22.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:22.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:22.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:56:24.674 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:24 smithi087 ceph-mon[37122]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:24 smithi057 ceph-mon[28763]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:26.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.256+0000 7f1f4fe00700 1 -- 172.21.15.87:0/3913526294 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1f58104570 con 0x7f1f3c0692a0 2024-02-28T15:56:26.250 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 5 on host 'smithi087' 2024-02-28T15:56:26.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 -- 172.21.15.87:0/3913526294 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f1f3c0692a0 msgr2=0x7f1f3c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:26.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f1f3c0692a0 0x7f1f3c06b750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f44004d60 tx=0x7f1f4400b040 comp rx=0 tx=0).stop 2024-02-28T15:56:26.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 -- 172.21.15.87:0/3913526294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58070840 msgr2=0x7f1f5810fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:26.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58070840 0x7f1f5810fb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1f480093b0 tx=0x7f1f48009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:26.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 -- 172.21.15.87:0/3913526294 shutdown_connections 2024-02-28T15:56:26.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f1f3c0692a0 0x7f1f3c06b750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:26.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58070840 0x7f1f5810fb40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:26.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 --2- 172.21.15.87:0/3913526294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58071e90 0x7f1f58110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:26.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 -- 172.21.15.87:0/3913526294 >> 172.21.15.87:0/3913526294 conn(0x7f1f580f8620 msgr2=0x7f1f58102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:26.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 -- 172.21.15.87:0/3913526294 shutdown_connections 2024-02-28T15:56:26.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:26.259+0000 7f1f5f200700 1 -- 172.21.15.87:0/3913526294 wait complete. 2024-02-28T15:56:26.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:26 smithi057 ceph-mon[28763]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:26.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:26 smithi057 ceph-mon[28763]: from='osd.5 [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T15:56:26.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:26 smithi057 ceph-mon[28763]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T15:56:26.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:26 smithi087 ceph-mon[37122]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:26.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:26 smithi087 ceph-mon[37122]: from='osd.5 [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T15:56:26.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:26 smithi087 ceph-mon[37122]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T15:56:27.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:27 smithi087 ceph-mon[37122]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T15:56:27.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:27 smithi087 ceph-mon[37122]: osdmap e38: 6 total, 5 up, 6 in 2024-02-28T15:56:27.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T15:56:27.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:27 smithi087 ceph-mon[37122]: from='osd.5 [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:56:27.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:27 smithi087 ceph-mon[37122]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:56:27.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:27.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:27.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:27 smithi057 ceph-mon[28763]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T15:56:27.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:27 smithi057 ceph-mon[28763]: osdmap e38: 6 total, 5 up, 6 in 2024-02-28T15:56:27.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:27 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T15:56:27.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:27 smithi057 ceph-mon[28763]: from='osd.5 [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:56:27.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:27 smithi057 ceph-mon[28763]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T15:56:27.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:27 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:27.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:27 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:27.480 DEBUG:teuthology.orchestra.run.smithi087:osd.5> sudo journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.5.service 2024-02-28T15:56:27.486 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-28T15:56:27.486 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd stat -f json 2024-02-28T15:56:28.024 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:28.377 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:28 smithi057 ceph-mon[28763]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-02-28T15:56:28.377 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:28 smithi057 ceph-mon[28763]: osdmap e39: 6 total, 5 up, 6 in 2024-02-28T15:56:28.378 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:28 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T15:56:28.378 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:28 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T15:56:28.378 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:28 smithi057 ceph-mon[28763]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:28.378 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:28 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:28.378 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:28 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:28.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:28 smithi087 ceph-mon[37122]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-02-28T15:56:28.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:28 smithi087 ceph-mon[37122]: osdmap e39: 6 total, 5 up, 6 in 2024-02-28T15:56:28.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:28 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T15:56:28.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:28 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T15:56:28.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:28 smithi087 ceph-mon[37122]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T15:56:28.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:28 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:28.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:28 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:29.236 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:29 smithi057 ceph-mon[28763]: purged_snaps scrub starts 2024-02-28T15:56:29.236 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:29 smithi057 ceph-mon[28763]: purged_snaps scrub ok 2024-02-28T15:56:29.236 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:29 smithi057 ceph-mon[28763]: osd.5 [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025] boot 2024-02-28T15:56:29.236 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:29 smithi057 ceph-mon[28763]: osdmap e40: 6 total, 6 up, 6 in 2024-02-28T15:56:29.236 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:29 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T15:56:29.339 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:29 smithi087 ceph-mon[37122]: purged_snaps scrub starts 2024-02-28T15:56:29.339 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:29 smithi087 ceph-mon[37122]: purged_snaps scrub ok 2024-02-28T15:56:29.339 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:29 smithi087 ceph-mon[37122]: osd.5 [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025] boot 2024-02-28T15:56:29.339 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:29 smithi087 ceph-mon[37122]: osdmap e40: 6 total, 6 up, 6 in 2024-02-28T15:56:29.339 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:29 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T15:56:30.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.195+0000 7f5d8e000700 1 -- 172.21.15.57:0/2225251447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d88100360 msgr2=0x7f5d881007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:30.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.195+0000 7f5d8e000700 1 --2- 172.21.15.57:0/2225251447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d88100360 0x7f5d881007b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5d74004940 tx=0x7f5d74009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:30.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.195+0000 7f5d8e000700 1 -- 172.21.15.57:0/2225251447 shutdown_connections 2024-02-28T15:56:30.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.195+0000 7f5d8e000700 1 --2- 172.21.15.57:0/2225251447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d88100360 0x7f5d881007b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:30.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.195+0000 7f5d8e000700 1 --2- 172.21.15.57:0/2225251447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d880ff150 0x7f5d880ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:30.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.195+0000 7f5d8e000700 1 -- 172.21.15.57:0/2225251447 >> 172.21.15.57:0/2225251447 conn(0x7f5d880fa920 msgr2=0x7f5d880fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:30.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.195+0000 7f5d8e000700 1 -- 172.21.15.57:0/2225251447 shutdown_connections 2024-02-28T15:56:30.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.195+0000 7f5d8e000700 1 -- 172.21.15.57:0/2225251447 wait complete. 2024-02-28T15:56:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.196+0000 7f5d8e000700 1 Processor -- start 2024-02-28T15:56:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.196+0000 7f5d8e000700 1 -- start start 2024-02-28T15:56:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d8e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d880ff150 0x7f5d8810fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d8e000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d88100360 0x7f5d88110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d8e000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d88110610 con 0x7f5d880ff150 2024-02-28T15:56:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d8e000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d88110eb0 con 0x7f5d88100360 2024-02-28T15:56:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d87400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d880ff150 0x7f5d8810fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d87400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d880ff150 0x7f5d8810fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57194/0 (socket says 172.21.15.57:57194) 2024-02-28T15:56:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d87400700 1 -- 172.21.15.57:0/2189028195 learned_addr learned my addr 172.21.15.57:0/2189028195 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:56:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d86a00700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d88100360 0x7f5d88110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:30.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d87400700 1 -- 172.21.15.57:0/2189028195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d88100360 msgr2=0x7f5d88110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:30.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d87400700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d88100360 0x7f5d88110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:30.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d87400700 1 -- 172.21.15.57:0/2189028195 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74005040 con 0x7f5d880ff150 2024-02-28T15:56:30.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.197+0000 7f5d86a00700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d88100360 0x7f5d88110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T15:56:30.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.198+0000 7f5d87400700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d880ff150 0x7f5d8810fad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800eb70 tx=0x7f5d7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:30.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.198+0000 7f5d7f400700 1 -- 172.21.15.57:0/2189028195 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d78007cc0 con 0x7f5d880ff150 2024-02-28T15:56:30.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.198+0000 7f5d7f400700 1 -- 172.21.15.57:0/2189028195 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d7800f040 con 0x7f5d880ff150 2024-02-28T15:56:30.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.198+0000 7f5d8e000700 1 -- 172.21.15.57:0/2189028195 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d88111130 con 0x7f5d880ff150 2024-02-28T15:56:30.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.198+0000 7f5d7f400700 1 -- 172.21.15.57:0/2189028195 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d7800cbd0 con 0x7f5d880ff150 2024-02-28T15:56:30.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.198+0000 7f5d8e000700 1 -- 172.21.15.57:0/2189028195 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d88111670 con 0x7f5d880ff150 2024-02-28T15:56:30.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.200+0000 7f5d8e000700 1 -- 172.21.15.57:0/2189028195 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8804bed0 con 0x7f5d880ff150 2024-02-28T15:56:30.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.200+0000 7f5d7f400700 1 -- 172.21.15.57:0/2189028195 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f5d7800cd30 con 0x7f5d880ff150 2024-02-28T15:56:30.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.201+0000 7f5d7f400700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5d6c0692b0 0x7f5d6c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.201+0000 7f5d7f400700 1 -- 172.21.15.57:0/2189028195 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5d780869f0 con 0x7f5d880ff150 2024-02-28T15:56:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.202+0000 7f5d86a00700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5d6c0692b0 0x7f5d6c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.202+0000 7f5d86a00700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5d6c0692b0 0x7f5d6c06b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400b0d0 tx=0x7f5d74009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:30.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.207+0000 7f5d7f400700 1 -- 172.21.15.57:0/2189028195 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5d7804dbd0 con 0x7f5d880ff150 2024-02-28T15:56:30.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:30 smithi087 ceph-mon[37122]: osdmap e41: 6 total, 6 up, 6 in 2024-02-28T15:56:30.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:30 smithi087 ceph-mon[37122]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:30.410 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:30 smithi057 ceph-mon[28763]: osdmap e41: 6 total, 6 up, 6 in 2024-02-28T15:56:30.410 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:30 smithi057 ceph-mon[28763]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:30.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.416+0000 7f5d8e000700 1 -- 172.21.15.57:0/2189028195 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f5d88111a50 con 0x7f5d880ff150 2024-02-28T15:56:30.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.417+0000 7f5d7f400700 1 -- 172.21.15.57:0/2189028195 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f5d78056a80 con 0x7f5d880ff150 2024-02-28T15:56:30.411 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:56:30.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.420+0000 7f5d8e000700 1 -- 172.21.15.57:0/2189028195 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5d6c0692b0 msgr2=0x7f5d6c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:30.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.420+0000 7f5d8e000700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5d6c0692b0 0x7f5d6c06b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400b0d0 tx=0x7f5d74009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:30.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.420+0000 7f5d8e000700 1 -- 172.21.15.57:0/2189028195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d880ff150 msgr2=0x7f5d8810fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:30.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.420+0000 7f5d8e000700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d880ff150 0x7f5d8810fad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800eb70 tx=0x7f5d7800b040 comp rx=0 tx=0).stop 2024-02-28T15:56:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.420+0000 7f5d8e000700 1 -- 172.21.15.57:0/2189028195 shutdown_connections 2024-02-28T15:56:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.420+0000 7f5d8e000700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5d6c0692b0 0x7f5d6c06b760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.420+0000 7f5d8e000700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d880ff150 0x7f5d8810fad0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.420+0000 7f5d8e000700 1 --2- 172.21.15.57:0/2189028195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d88100360 0x7f5d88110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.420+0000 7f5d8e000700 1 -- 172.21.15.57:0/2189028195 >> 172.21.15.57:0/2189028195 conn(0x7f5d880fa920 msgr2=0x7f5d88103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.420+0000 7f5d8e000700 1 -- 172.21.15.57:0/2189028195 shutdown_connections 2024-02-28T15:56:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:30.421+0000 7f5d8e000700 1 -- 172.21.15.57:0/2189028195 wait complete. 2024-02-28T15:56:31.205 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1709135788,"num_in_osds":6,"osd_in_since":1709135763,"num_remapped_pgs":0} 2024-02-28T15:56:31.206 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T15:56:31.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:31 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2189028195' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-28T15:56:31.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:31 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2189028195' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-28T15:56:31.684 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:32.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:32 smithi057 ceph-mon[28763]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:32.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:32 smithi087 ceph-mon[37122]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:33.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.678+0000 7fcdfb800700 1 -- 172.21.15.57:0/2361006262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdf41038f0 msgr2=0x7fcdf40fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:33.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.678+0000 7fcdfb800700 1 --2- 172.21.15.57:0/2361006262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdf41038f0 0x7fcdf40fcf60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcde0004940 tx=0x7fcde0009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:33.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.678+0000 7fcdfb800700 1 -- 172.21.15.57:0/2361006262 shutdown_connections 2024-02-28T15:56:33.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.678+0000 7fcdfb800700 1 --2- 172.21.15.57:0/2361006262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdf41038f0 0x7fcdf40fcf60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:33.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.678+0000 7fcdfb800700 1 --2- 172.21.15.57:0/2361006262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf4102f50 0x7fcdf4103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:33.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.678+0000 7fcdfb800700 1 -- 172.21.15.57:0/2361006262 >> 172.21.15.57:0/2361006262 conn(0x7fcdf40f8ae0 msgr2=0x7fcdf40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:33.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.679+0000 7fcdfb800700 1 -- 172.21.15.57:0/2361006262 shutdown_connections 2024-02-28T15:56:33.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.679+0000 7fcdfb800700 1 -- 172.21.15.57:0/2361006262 wait complete. 2024-02-28T15:56:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.680+0000 7fcdfb800700 1 Processor -- start 2024-02-28T15:56:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.680+0000 7fcdfb800700 1 -- start start 2024-02-28T15:56:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.680+0000 7fcdfb800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf4102f50 0x7fcdf4115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.680+0000 7fcdfb800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdf41038f0 0x7fcdf41161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.680+0000 7fcdfb800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf4116810 con 0x7fcdf41038f0 2024-02-28T15:56:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.680+0000 7fcdfb800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf410fb40 con 0x7fcdf4102f50 2024-02-28T15:56:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.681+0000 7fcdf3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdf41038f0 0x7fcdf41161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.681+0000 7fcdf3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdf41038f0 0x7fcdf41161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37448/0 (socket says 172.21.15.57:37448) 2024-02-28T15:56:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.681+0000 7fcdf3e00700 1 -- 172.21.15.57:0/2605576013 learned_addr learned my addr 172.21.15.57:0/2605576013 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:56:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.681+0000 7fcdf8e00700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf4102f50 0x7fcdf4115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.681+0000 7fcdf3e00700 1 -- 172.21.15.57:0/2605576013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf4102f50 msgr2=0x7fcdf4115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.681+0000 7fcdf3e00700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf4102f50 0x7fcdf4115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.681+0000 7fcdf3e00700 1 -- 172.21.15.57:0/2605576013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0005040 con 0x7fcdf41038f0 2024-02-28T15:56:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.681+0000 7fcdf8e00700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf4102f50 0x7fcdf4115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T15:56:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.682+0000 7fcdf3e00700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdf41038f0 0x7fcdf41161c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009030 tx=0x7fcde0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.682+0000 7fcdf0c00700 1 -- 172.21.15.57:0/2605576013 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcde000e040 con 0x7fcdf41038f0 2024-02-28T15:56:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.682+0000 7fcdf0c00700 1 -- 172.21.15.57:0/2605576013 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcde000bbf0 con 0x7fcdf41038f0 2024-02-28T15:56:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.682+0000 7fcdf0c00700 1 -- 172.21.15.57:0/2605576013 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcde001c630 con 0x7fcdf41038f0 2024-02-28T15:56:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.682+0000 7fcdfb800700 1 -- 172.21.15.57:0/2605576013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf410fdc0 con 0x7fcdf41038f0 2024-02-28T15:56:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.682+0000 7fcdfb800700 1 -- 172.21.15.57:0/2605576013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf4110300 con 0x7fcdf41038f0 2024-02-28T15:56:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.683+0000 7fcdfb800700 1 -- 172.21.15.57:0/2605576013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf40fc6e0 con 0x7fcdf41038f0 2024-02-28T15:56:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.685+0000 7fcdf0c00700 1 -- 172.21.15.57:0/2605576013 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fcde000bd60 con 0x7fcdf41038f0 2024-02-28T15:56:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.686+0000 7fcdf0c00700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcddc0692b0 0x7fcddc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.686+0000 7fcdf0c00700 1 -- 172.21.15.57:0/2605576013 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcde0088190 con 0x7fcdf41038f0 2024-02-28T15:56:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.687+0000 7fcdf8e00700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcddc0692b0 0x7fcddc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.687+0000 7fcdf8e00700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcddc0692b0 0x7fcddc06b760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcde80041d0 tx=0x7fcde8009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:33.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.691+0000 7fcdf0c00700 1 -- 172.21.15.57:0/2605576013 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcde0058320 con 0x7fcdf41038f0 2024-02-28T15:56:33.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.909+0000 7fcdfb800700 1 -- 172.21.15.57:0/2605576013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdf410a030 con 0x7fcdf41038f0 2024-02-28T15:56:33.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.910+0000 7fcdf0c00700 1 -- 172.21.15.57:0/2605576013 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11035 (secure 0 0 0) 0x7fcde0057eb0 con 0x7fcdf41038f0 2024-02-28T15:56:33.904 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:56:33.904 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","created":"2024-02-28T15:49:03.036724+0000","modified":"2024-02-28T15:56:29.114177+0000","last_up_change":"2024-02-28T15:56:28.099575+0000","last_in_change":"2024-02-28T15:56:03.811536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T15:54:45.908218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7a78e2ba-3bfe-4677-b633-f2095c44065f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6803","nonce":3134303986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6805","nonce":3134303986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3134303986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6807","nonce":3134303986}]},"public_addr":"172.21.15.57:6803/3134303986","cluster_addr":"172.21.15.57:6805/3134303986","heartbeat_back_addr":"172.21.15.57:6809/3134303986","heartbeat_front_addr":"172.21.15.57:6807/3134303986","state":["exists","up"]},{"osd":1,"uuid":"fccab799-0840-4050-9ead-4ad9e7e69fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6811","nonce":37973257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6813","nonce":37973257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6817","nonce":37973257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6815","nonce":37973257}]},"public_addr":"172.21.15.57:6811/37973257","cluster_addr":"172.21.15.57:6813/37973257","heartbeat_back_addr":"172.21.15.57:6817/37973257","heartbeat_front_addr":"172.21.15.57:6815/37973257","state":["exists","up"]},{"osd":2,"uuid":"4b0a7b1d-f096-4698-b27a-6b5aa2239eb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6819","nonce":2276135967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6821","nonce":2276135967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6825","nonce":2276135967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6823","nonce":2276135967}]},"public_addr":"172.21.15.57:6819/2276135967","cluster_addr":"172.21.15.57:6821/2276135967","heartbeat_back_addr":"172.21.15.57:6825/2276135967","heartbeat_front_addr":"172.21.15.57:6823/2276135967","state":["exists","up"]},{"osd":3,"uuid":"1c67654a-1d10-422e-9540-a348cff2d828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6801","nonce":1839102641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6803","nonce":1839102641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6807","nonce":1839102641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6805","nonce":1839102641}]},"public_addr":"172.21.15.87:6801/1839102641","cluster_addr":"172.21.15.87:6803/1839102641","heartbeat_back_addr":"172.21.15.87:6807/1839102641","heartbeat_front_addr":"172.21.15.87:6805/1839102641","state":["exists","up"]},{"osd":4,"uuid":"7f988788-349d-4afd-adca-af474c7bb8ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6809","nonce":3382559885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6811","nonce":3382559885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6815","nonce":3382559885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6813","nonce":3382559885}]},"public_addr":"172.21.15.87:6809/3382559885","cluster_addr":"172.21.15.87:6811/3382559885","heartbeat_back_addr":"172.21.15.87:6815/3382559885","heartbeat_front_addr":"172.21.15.87:6813/3382559885","state":["exists","up"]},{"osd":5,"uuid":"83e02849-bd1f-4fa8-893e-1bfd8b2cfe42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6817","nonce":2535835025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6819","nonce":2535835025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6823","nonce":2535835025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6821","nonce":2535835025}]},"public_addr":"172.21.15.87:6817/2535835025","cluster_addr":"172.21.15.87:6819/2535835025","heartbeat_back_addr":"172.21.15.87:6823/2535835025","heartbeat_front_addr":"172.21.15.87:6821/2535835025","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:53:27.750469+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:03.782911+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:41.785278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:15.986058+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:50.819979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:56:26.433957+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/2044423401":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/429066936":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6800/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6801/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6801/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/509992026":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6800/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/4184139864":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3955176243":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6800/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3171524924":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/1871958144":"2024-02-29T15:49:35.637547+0000","172.21.15.57:6801/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/4078846536":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/2729792809":"2024-02-29T15:50:16.193611+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T15:56:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.914+0000 7fcdfb800700 1 -- 172.21.15.57:0/2605576013 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcddc0692b0 msgr2=0x7fcddc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.914+0000 7fcdfb800700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcddc0692b0 0x7fcddc06b760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcde80041d0 tx=0x7fcde8009040 comp rx=0 tx=0).stop 2024-02-28T15:56:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.914+0000 7fcdfb800700 1 -- 172.21.15.57:0/2605576013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdf41038f0 msgr2=0x7fcdf41161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.914+0000 7fcdfb800700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdf41038f0 0x7fcdf41161c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009030 tx=0x7fcde0009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.915+0000 7fcdfb800700 1 -- 172.21.15.57:0/2605576013 shutdown_connections 2024-02-28T15:56:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.915+0000 7fcdfb800700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcddc0692b0 0x7fcddc06b760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.915+0000 7fcdfb800700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf4102f50 0x7fcdf4115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.915+0000 7fcdfb800700 1 --2- 172.21.15.57:0/2605576013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdf41038f0 0x7fcdf41161c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.915+0000 7fcdfb800700 1 -- 172.21.15.57:0/2605576013 >> 172.21.15.57:0/2605576013 conn(0x7fcdf40f8ae0 msgr2=0x7fcdf40fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:33.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.915+0000 7fcdfb800700 1 -- 172.21.15.57:0/2605576013 shutdown_connections 2024-02-28T15:56:33.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:33.915+0000 7fcdfb800700 1 -- 172.21.15.57:0/2605576013 wait complete. 2024-02-28T15:56:34.573 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: Detected new or changed devices on smithi087 2024-02-28T15:56:34.573 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:34.573 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:34.573 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:56:34.573 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: Adjusting osd_memory_target on smithi087 to 5313M 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:34.574 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:34 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2605576013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T15:56:34.634 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T15:54:45.908218+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-02-28T15:56:34.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-28T15:56:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: Detected new or changed devices on smithi087 2024-02-28T15:56:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:56:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: Adjusting osd_memory_target on smithi087 to 5313M 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:56:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:34 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2605576013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T15:56:35.133 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:36.271 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:36 smithi057 ceph-mon[28763]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:36.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:36 smithi087 ceph-mon[37122]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.078+0000 7fe4a0600700 1 -- 172.21.15.57:0/3059441660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4980fdf50 msgr2=0x7fe4980fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.078+0000 7fe4a0600700 1 --2- 172.21.15.57:0/3059441660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4980fdf50 0x7fe4980fe320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe48c004940 tx=0x7fe48c009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.079+0000 7fe4a0600700 1 -- 172.21.15.57:0/3059441660 shutdown_connections 2024-02-28T15:56:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.079+0000 7fe4a0600700 1 --2- 172.21.15.57:0/3059441660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4980fe8f0 0x7fe498106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.079+0000 7fe4a0600700 1 --2- 172.21.15.57:0/3059441660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4980fdf50 0x7fe4980fe320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.079+0000 7fe4a0600700 1 -- 172.21.15.57:0/3059441660 >> 172.21.15.57:0/3059441660 conn(0x7fe4980f79e0 msgr2=0x7fe4980f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.079+0000 7fe4a0600700 1 -- 172.21.15.57:0/3059441660 shutdown_connections 2024-02-28T15:56:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.079+0000 7fe4a0600700 1 -- 172.21.15.57:0/3059441660 wait complete. 2024-02-28T15:56:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.080+0000 7fe4a0600700 1 Processor -- start 2024-02-28T15:56:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.080+0000 7fe4a0600700 1 -- start start 2024-02-28T15:56:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.080+0000 7fe4a0600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4980fdf50 0x7fe4980fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.080+0000 7fe4a0600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4980fe8f0 0x7fe4980fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.080+0000 7fe4a0600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4980fc8c0 con 0x7fe4980fdf50 2024-02-28T15:56:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.080+0000 7fe4a0600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4980fca30 con 0x7fe4980fe8f0 2024-02-28T15:56:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.081+0000 7fe49dc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4980fdf50 0x7fe4980fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.081+0000 7fe49dc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4980fdf50 0x7fe4980fbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37464/0 (socket says 172.21.15.57:37464) 2024-02-28T15:56:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.081+0000 7fe49dc00700 1 -- 172.21.15.57:0/3618840842 learned_addr learned my addr 172.21.15.57:0/3618840842 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:56:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.081+0000 7fe49d200700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4980fe8f0 0x7fe4980fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.081+0000 7fe49dc00700 1 -- 172.21.15.57:0/3618840842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4980fe8f0 msgr2=0x7fe4980fc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.081+0000 7fe49dc00700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4980fe8f0 0x7fe4980fc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.081+0000 7fe49dc00700 1 -- 172.21.15.57:0/3618840842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c005040 con 0x7fe4980fdf50 2024-02-28T15:56:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.081+0000 7fe49dc00700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4980fdf50 0x7fe4980fbd80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009180 tx=0x7fe48c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.082+0000 7fe495600700 1 -- 172.21.15.57:0/3618840842 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48c00e040 con 0x7fe4980fdf50 2024-02-28T15:56:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.082+0000 7fe495600700 1 -- 172.21.15.57:0/3618840842 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe48c00bbf0 con 0x7fe4980fdf50 2024-02-28T15:56:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.082+0000 7fe4a0600700 1 -- 172.21.15.57:0/3618840842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe498119cc0 con 0x7fe4980fdf50 2024-02-28T15:56:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.082+0000 7fe495600700 1 -- 172.21.15.57:0/3618840842 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48c01c630 con 0x7fe4980fdf50 2024-02-28T15:56:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.082+0000 7fe4a0600700 1 -- 172.21.15.57:0/3618840842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49811a120 con 0x7fe4980fdf50 2024-02-28T15:56:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.083+0000 7fe4a0600700 1 -- 172.21.15.57:0/3618840842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe498104540 con 0x7fe4980fdf50 2024-02-28T15:56:37.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.084+0000 7fe495600700 1 -- 172.21.15.57:0/3618840842 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe48c00bd60 con 0x7fe4980fdf50 2024-02-28T15:56:37.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.085+0000 7fe495600700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe4800692b0 0x7fe48006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:37.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.085+0000 7fe495600700 1 -- 172.21.15.57:0/3618840842 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe48c088270 con 0x7fe4980fdf50 2024-02-28T15:56:37.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.085+0000 7fe49d200700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe4800692b0 0x7fe48006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:37.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.086+0000 7fe49d200700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe4800692b0 0x7fe48006b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe484007fd0 tx=0x7fe484009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:37.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.090+0000 7fe495600700 1 -- 172.21.15.57:0/3618840842 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe48c0548e0 con 0x7fe4980fdf50 2024-02-28T15:56:37.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:56:37.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.308+0000 7fe4a0600700 1 -- 172.21.15.57:0/3618840842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4980fb5e0 con 0x7fe4980fdf50 2024-02-28T15:56:37.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.309+0000 7fe495600700 1 -- 172.21.15.57:0/3618840842 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe48c057f00 con 0x7fe4980fdf50 2024-02-28T15:56:37.303 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-02-28T15:56:37.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.312+0000 7fe4a0600700 1 -- 172.21.15.57:0/3618840842 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe4800692b0 msgr2=0x7fe48006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:37.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.312+0000 7fe4a0600700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe4800692b0 0x7fe48006b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe484007fd0 tx=0x7fe484009040 comp rx=0 tx=0).stop 2024-02-28T15:56:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.312+0000 7fe4a0600700 1 -- 172.21.15.57:0/3618840842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4980fdf50 msgr2=0x7fe4980fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.312+0000 7fe4a0600700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4980fdf50 0x7fe4980fbd80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009180 tx=0x7fe48c009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.313+0000 7fe4a0600700 1 -- 172.21.15.57:0/3618840842 shutdown_connections 2024-02-28T15:56:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.313+0000 7fe4a0600700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe4800692b0 0x7fe48006b760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.313+0000 7fe4a0600700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4980fdf50 0x7fe4980fbd80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.313+0000 7fe4a0600700 1 --2- 172.21.15.57:0/3618840842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4980fe8f0 0x7fe4980fc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.313+0000 7fe4a0600700 1 -- 172.21.15.57:0/3618840842 >> 172.21.15.57:0/3618840842 conn(0x7fe4980f79e0 msgr2=0x7fe4981016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.313+0000 7fe4a0600700 1 -- 172.21.15.57:0/3618840842 shutdown_connections 2024-02-28T15:56:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:37.313+0000 7fe4a0600700 1 -- 172.21.15.57:0/3618840842 wait complete. 2024-02-28T15:56:37.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:56:38.153 INFO:tasks.cephadm:Setting up client nodes... 2024-02-28T15:56:38.153 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-28T15:56:38.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:38 smithi057 ceph-mon[28763]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:38.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:38 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3618840842' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T15:56:38.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:38 smithi087 ceph-mon[37122]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:38.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:38 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3618840842' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T15:56:38.650 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:40.518 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:40 smithi057 ceph-mon[28763]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:40.618 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:40 smithi087 ceph-mon[37122]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.885+0000 7fb614200700 1 -- 172.21.15.57:0/2508020317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb60c0ff150 msgr2=0x7fb60c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.885+0000 7fb614200700 1 --2- 172.21.15.57:0/2508020317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb60c0ff150 0x7fb60c0ff560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb600004940 tx=0x7fb600009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.885+0000 7fb614200700 1 -- 172.21.15.57:0/2508020317 shutdown_connections 2024-02-28T15:56:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.885+0000 7fb614200700 1 --2- 172.21.15.57:0/2508020317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb60c100360 0x7fb60c1007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.885+0000 7fb614200700 1 --2- 172.21.15.57:0/2508020317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb60c0ff150 0x7fb60c0ff560 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.885+0000 7fb614200700 1 -- 172.21.15.57:0/2508020317 >> 172.21.15.57:0/2508020317 conn(0x7fb60c0fa920 msgr2=0x7fb60c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.885+0000 7fb614200700 1 -- 172.21.15.57:0/2508020317 shutdown_connections 2024-02-28T15:56:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.885+0000 7fb614200700 1 -- 172.21.15.57:0/2508020317 wait complete. 2024-02-28T15:56:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.886+0000 7fb614200700 1 Processor -- start 2024-02-28T15:56:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.887+0000 7fb614200700 1 -- start start 2024-02-28T15:56:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.887+0000 7fb614200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb60c0ff150 0x7fb60c10fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.887+0000 7fb614200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb60c100360 0x7fb60c1100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.887+0000 7fb614200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c1106d0 con 0x7fb60c0ff150 2024-02-28T15:56:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.887+0000 7fb614200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c110f70 con 0x7fb60c100360 2024-02-28T15:56:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.887+0000 7fb611800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb60c0ff150 0x7fb60c10fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.887+0000 7fb611800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb60c0ff150 0x7fb60c10fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37484/0 (socket says 172.21.15.57:37484) 2024-02-28T15:56:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.887+0000 7fb611800700 1 -- 172.21.15.57:0/257697738 learned_addr learned my addr 172.21.15.57:0/257697738 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:56:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.888+0000 7fb610e00700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb60c100360 0x7fb60c1100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.888+0000 7fb611800700 1 -- 172.21.15.57:0/257697738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb60c100360 msgr2=0x7fb60c1100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.888+0000 7fb611800700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb60c100360 0x7fb60c1100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.888+0000 7fb611800700 1 -- 172.21.15.57:0/257697738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb600005040 con 0x7fb60c0ff150 2024-02-28T15:56:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.888+0000 7fb611800700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb60c0ff150 0x7fb60c10fb90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb600000c00 tx=0x7fb600009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.889+0000 7fb609600700 1 -- 172.21.15.57:0/257697738 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb60000e040 con 0x7fb60c0ff150 2024-02-28T15:56:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.889+0000 7fb609600700 1 -- 172.21.15.57:0/257697738 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb60000bcc0 con 0x7fb60c0ff150 2024-02-28T15:56:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.889+0000 7fb614200700 1 -- 172.21.15.57:0/257697738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c1111f0 con 0x7fb60c0ff150 2024-02-28T15:56:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.889+0000 7fb609600700 1 -- 172.21.15.57:0/257697738 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb60001c630 con 0x7fb60c0ff150 2024-02-28T15:56:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.889+0000 7fb614200700 1 -- 172.21.15.57:0/257697738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c111730 con 0x7fb60c0ff150 2024-02-28T15:56:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.890+0000 7fb614200700 1 -- 172.21.15.57:0/257697738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c04bed0 con 0x7fb60c0ff150 2024-02-28T15:56:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.891+0000 7fb609600700 1 -- 172.21.15.57:0/257697738 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fb600013980 con 0x7fb60c0ff150 2024-02-28T15:56:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.892+0000 7fb609600700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb5f40692a0 0x7fb5f406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:40.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.892+0000 7fb609600700 1 -- 172.21.15.57:0/257697738 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb600088270 con 0x7fb60c0ff150 2024-02-28T15:56:40.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.892+0000 7fb610e00700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb5f40692a0 0x7fb5f406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:40.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.893+0000 7fb610e00700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb5f40692a0 0x7fb5f406b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8004990 tx=0x7fb5f8009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:40.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:40.897+0000 7fb609600700 1 -- 172.21.15.57:0/257697738 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb6000582d0 con 0x7fb60c0ff150 2024-02-28T15:56:41.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.195+0000 7fb614200700 1 -- 172.21.15.57:0/257697738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb60c107c30 con 0x7fb60c0ff150 2024-02-28T15:56:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.201+0000 7fb609600700 1 -- 172.21.15.57:0/257697738 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb600057e60 con 0x7fb60c0ff150 2024-02-28T15:56:41.194 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2024-02-28T15:56:41.195 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC5V99lLHCzCxAA7pshVLDRSrQbEqm37yo5dA== 2024-02-28T15:56:41.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.204+0000 7fb614200700 1 -- 172.21.15.57:0/257697738 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb5f40692a0 msgr2=0x7fb5f406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:41.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.204+0000 7fb614200700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb5f40692a0 0x7fb5f406b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8004990 tx=0x7fb5f8009ee0 comp rx=0 tx=0).stop 2024-02-28T15:56:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.204+0000 7fb614200700 1 -- 172.21.15.57:0/257697738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb60c0ff150 msgr2=0x7fb60c10fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.204+0000 7fb614200700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb60c0ff150 0x7fb60c10fb90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb600000c00 tx=0x7fb600009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.204+0000 7fb614200700 1 -- 172.21.15.57:0/257697738 shutdown_connections 2024-02-28T15:56:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.204+0000 7fb614200700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb5f40692a0 0x7fb5f406b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.204+0000 7fb614200700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb60c0ff150 0x7fb60c10fb90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.204+0000 7fb614200700 1 --2- 172.21.15.57:0/257697738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb60c100360 0x7fb60c1100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.204+0000 7fb614200700 1 -- 172.21.15.57:0/257697738 >> 172.21.15.57:0/257697738 conn(0x7fb60c0fa920 msgr2=0x7fb60c103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.204+0000 7fb614200700 1 -- 172.21.15.57:0/257697738 shutdown_connections 2024-02-28T15:56:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:41.205+0000 7fb614200700 1 -- 172.21.15.57:0/257697738 wait complete. 2024-02-28T15:56:41.586 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:41 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/257697738' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T15:56:41.586 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:41 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/257697738' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T15:56:41.644 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:41 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/257697738' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T15:56:41.644 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:41 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/257697738' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T15:56:41.961 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T15:56:41.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-28T15:56:41.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-28T15:56:42.113 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-28T15:56:42.561 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi087/config 2024-02-28T15:56:42.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:42 smithi057 ceph-mon[28763]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:42.707 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:42 smithi087 ceph-mon[37122]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:44.584 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:44 smithi087 ceph-mon[37122]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:44.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:44 smithi057 ceph-mon[28763]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:44.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.884+0000 7f4508a00700 1 -- 172.21.15.87:0/1977854173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4504103540 msgr2=0x7f4504103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:44.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.884+0000 7f4508a00700 1 --2- 172.21.15.87:0/1977854173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4504103540 0x7f4504103950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f44f4004940 tx=0x7f44f4009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:44.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.884+0000 7f4508a00700 1 -- 172.21.15.87:0/1977854173 shutdown_connections 2024-02-28T15:56:44.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.884+0000 7f4508a00700 1 --2- 172.21.15.87:0/1977854173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4504104750 0x7f4504104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:44.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.884+0000 7f4508a00700 1 --2- 172.21.15.87:0/1977854173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4504103540 0x7f4504103950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:44.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.884+0000 7f4508a00700 1 -- 172.21.15.87:0/1977854173 >> 172.21.15.87:0/1977854173 conn(0x7f45040727d0 msgr2=0x7f4504074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:44.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.884+0000 7f4508a00700 1 -- 172.21.15.87:0/1977854173 shutdown_connections 2024-02-28T15:56:44.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.884+0000 7f4508a00700 1 -- 172.21.15.87:0/1977854173 wait complete. 2024-02-28T15:56:44.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.885+0000 7f4508a00700 1 Processor -- start 2024-02-28T15:56:44.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.885+0000 7f4508a00700 1 -- start start 2024-02-28T15:56:44.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4508a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4504104750 0x7f45041140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:44.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4508a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4504114600 0x7f45041154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:44.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4508a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4504114ac0 con 0x7f4504114600 2024-02-28T15:56:44.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4508a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4504114c00 con 0x7f4504104750 2024-02-28T15:56:44.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4501e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4504104750 0x7f45041140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:44.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4501e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4504104750 0x7f45041140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57148/0 (socket says 172.21.15.87:57148) 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4501e00700 1 -- 172.21.15.87:0/2289177806 learned_addr learned my addr 172.21.15.87:0/2289177806 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4501400700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4504114600 0x7f45041154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4501e00700 1 -- 172.21.15.87:0/2289177806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4504114600 msgr2=0x7f45041154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4501e00700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4504114600 0x7f45041154a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.886+0000 7f4501e00700 1 -- 172.21.15.87:0/2289177806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4005040 con 0x7f4504104750 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.887+0000 7f4501e00700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4504104750 0x7f45041140c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44f4000c00 tx=0x7f44f4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.887+0000 7f44fa000700 1 -- 172.21.15.87:0/2289177806 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f4021070 con 0x7f4504104750 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.887+0000 7f44fa000700 1 -- 172.21.15.87:0/2289177806 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44f401c400 con 0x7f4504104750 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.887+0000 7f44fa000700 1 -- 172.21.15.87:0/2289177806 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f400e070 con 0x7f4504104750 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.887+0000 7f4508a00700 1 -- 172.21.15.87:0/2289177806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4504115aa0 con 0x7f4504104750 2024-02-28T15:56:44.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.887+0000 7f4508a00700 1 -- 172.21.15.87:0/2289177806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4504115f50 con 0x7f4504104750 2024-02-28T15:56:44.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.888+0000 7f4508a00700 1 -- 172.21.15.87:0/2289177806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450404bed0 con 0x7f4504104750 2024-02-28T15:56:44.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.889+0000 7f44fa000700 1 -- 172.21.15.87:0/2289177806 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f44f401ca50 con 0x7f4504104750 2024-02-28T15:56:44.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.890+0000 7f44fa000700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f44e80692b0 0x7f44e806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:44.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.890+0000 7f44fa000700 1 -- 172.21.15.87:0/2289177806 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f44f4087fd0 con 0x7f4504104750 2024-02-28T15:56:44.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.890+0000 7f4501400700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f44e80692b0 0x7f44e806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:44.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.891+0000 7f4501400700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f44e80692b0 0x7f44e806b760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44f0004600 tx=0x7f44f000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:44.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:44.895+0000 7f44fa000700 1 -- 172.21.15.87:0/2289177806 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f44f40b9bd0 con 0x7f4504104750 2024-02-28T15:56:45.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.184+0000 7f4508a00700 1 -- 172.21.15.87:0/2289177806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f450411a710 con 0x7f4504104750 2024-02-28T15:56:45.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.198+0000 7f44fa000700 1 -- 172.21.15.87:0/2289177806 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f44f40580b0 con 0x7f4504104750 2024-02-28T15:56:45.191 INFO:teuthology.orchestra.run.smithi087.stdout:[client.1] 2024-02-28T15:56:45.191 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC9V99lBE4nCxAAU9uyX65JMtzyUJlqvgHwmA== 2024-02-28T15:56:45.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.200+0000 7f4508a00700 1 -- 172.21.15.87:0/2289177806 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f44e80692b0 msgr2=0x7f44e806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:45.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.200+0000 7f4508a00700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f44e80692b0 0x7f44e806b760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44f0004600 tx=0x7f44f000b040 comp rx=0 tx=0).stop 2024-02-28T15:56:45.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.200+0000 7f4508a00700 1 -- 172.21.15.87:0/2289177806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4504104750 msgr2=0x7f45041140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:45.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.200+0000 7f4508a00700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4504104750 0x7f45041140c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44f4000c00 tx=0x7f44f4009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:45.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.201+0000 7f4508a00700 1 -- 172.21.15.87:0/2289177806 shutdown_connections 2024-02-28T15:56:45.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.201+0000 7f4508a00700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f44e80692b0 0x7f44e806b760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:45.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.201+0000 7f4508a00700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4504104750 0x7f45041140c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:45.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.201+0000 7f4508a00700 1 --2- 172.21.15.87:0/2289177806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4504114600 0x7f45041154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:45.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.201+0000 7f4508a00700 1 -- 172.21.15.87:0/2289177806 >> 172.21.15.87:0/2289177806 conn(0x7f45040727d0 msgr2=0x7f4504107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:45.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.201+0000 7f4508a00700 1 -- 172.21.15.87:0/2289177806 shutdown_connections 2024-02-28T15:56:45.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:56:45.201+0000 7f4508a00700 1 -- 172.21.15.87:0/2289177806 wait complete. 2024-02-28T15:56:46.138 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T15:56:46.138 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-28T15:56:46.139 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-28T15:56:46.291 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-28T15:56:46.291 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-28T15:56:46.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph mgr dump --format=json 2024-02-28T15:56:46.387 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:46 smithi057 ceph-mon[28763]: from='client.? 172.21.15.87:0/2289177806' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T15:56:46.388 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:46 smithi057 ceph-mon[28763]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T15:56:46.388 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:46 smithi057 ceph-mon[28763]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T15:56:46.388 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:46 smithi057 ceph-mon[28763]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:46.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:46 smithi087 ceph-mon[37122]: from='client.? 172.21.15.87:0/2289177806' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T15:56:46.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:46 smithi087 ceph-mon[37122]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T15:56:46.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:46 smithi087 ceph-mon[37122]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T15:56:46.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:46 smithi087 ceph-mon[37122]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:46.799 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:48.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:48 smithi057 ceph-mon[28763]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:48.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:48 smithi087 ceph-mon[37122]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:48.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.875+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3332274269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0e00fdfe0 msgr2=0x7fb0e00fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:48.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.875+0000 7fb0e6a00700 1 --2- 172.21.15.57:0/3332274269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0e00fdfe0 0x7fb0e00fe3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0004970 tx=0x7fb0d0009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:48.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.875+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3332274269 shutdown_connections 2024-02-28T15:56:48.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.875+0000 7fb0e6a00700 1 --2- 172.21.15.57:0/3332274269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0e00fe8f0 0x7fb0e0107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:48.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.875+0000 7fb0e6a00700 1 --2- 172.21.15.57:0/3332274269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0e00fdfe0 0x7fb0e00fe3b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:48.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.875+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3332274269 >> 172.21.15.57:0/3332274269 conn(0x7fb0e0071d90 msgr2=0x7fb0e0072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:48.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.875+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3332274269 shutdown_connections 2024-02-28T15:56:48.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.875+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3332274269 wait complete. 2024-02-28T15:56:48.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.876+0000 7fb0e6a00700 1 Processor -- start 2024-02-28T15:56:48.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.877+0000 7fb0e6a00700 1 -- start start 2024-02-28T15:56:48.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.877+0000 7fb0e6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0e00fdfe0 0x7fb0e0115c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:48.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.877+0000 7fb0e6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0e00fe8f0 0x7fb0e0116140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:48.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.877+0000 7fb0e6a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e0116790 con 0x7fb0e00fdfe0 2024-02-28T15:56:48.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.877+0000 7fb0e6a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e010fae0 con 0x7fb0e00fe8f0 2024-02-28T15:56:48.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.877+0000 7fb0dfe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0e00fdfe0 0x7fb0e0115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:48.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.877+0000 7fb0dfe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0e00fdfe0 0x7fb0e0115c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47038/0 (socket says 172.21.15.57:47038) 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.877+0000 7fb0dfe00700 1 -- 172.21.15.57:0/3538070652 learned_addr learned my addr 172.21.15.57:0/3538070652 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.878+0000 7fb0d7e00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0e00fe8f0 0x7fb0e0116140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.878+0000 7fb0dfe00700 1 -- 172.21.15.57:0/3538070652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0e00fe8f0 msgr2=0x7fb0e0116140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.878+0000 7fb0dfe00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0e00fe8f0 0x7fb0e0116140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.878+0000 7fb0dfe00700 1 -- 172.21.15.57:0/3538070652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0005040 con 0x7fb0e00fdfe0 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.878+0000 7fb0dfe00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0e00fdfe0 0x7fb0e0115c00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009150 tx=0x7fb0d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.878+0000 7fb0dcc00700 1 -- 172.21.15.57:0/3538070652 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0d000e040 con 0x7fb0e00fdfe0 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.878+0000 7fb0dcc00700 1 -- 172.21.15.57:0/3538070652 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0d0004290 con 0x7fb0e00fdfe0 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.878+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3538070652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e010fd60 con 0x7fb0e00fdfe0 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.878+0000 7fb0dcc00700 1 -- 172.21.15.57:0/3538070652 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0d001c630 con 0x7fb0e00fdfe0 2024-02-28T15:56:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.879+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3538070652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e01102a0 con 0x7fb0e00fdfe0 2024-02-28T15:56:48.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.880+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3538070652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e0106b20 con 0x7fb0e00fdfe0 2024-02-28T15:56:48.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.881+0000 7fb0dcc00700 1 -- 172.21.15.57:0/3538070652 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fb0d0013980 con 0x7fb0e00fdfe0 2024-02-28T15:56:48.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.882+0000 7fb0dcc00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb0c40692b0 0x7fb0c406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:48.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.882+0000 7fb0dcc00700 1 -- 172.21.15.57:0/3538070652 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb0d0088230 con 0x7fb0e00fdfe0 2024-02-28T15:56:48.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.882+0000 7fb0d7e00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb0c40692b0 0x7fb0c406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:48.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.883+0000 7fb0d7e00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb0c40692b0 0x7fb0c406b760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb0e01114a0 tx=0x7fb0c800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:48.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:48.887+0000 7fb0dcc00700 1 -- 172.21.15.57:0/3538070652 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb0d0054800 con 0x7fb0e00fdfe0 2024-02-28T15:56:49.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.158+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3538070652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb0e00738b0 con 0x7fb0e00fdfe0 2024-02-28T15:56:49.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.164+0000 7fb0dcc00700 1 -- 172.21.15.57:0/3538070652 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167169 (secure 0 0 0) 0x7fb0d0057e20 con 0x7fb0e00fdfe0 2024-02-28T15:56:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:56:49.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3538070652 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb0c40692b0 msgr2=0x7fb0c406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb0c40692b0 0x7fb0c406b760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb0e01114a0 tx=0x7fb0c800b040 comp rx=0 tx=0).stop 2024-02-28T15:56:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3538070652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0e00fdfe0 msgr2=0x7fb0e0115c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0e00fdfe0 0x7fb0e0115c00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009150 tx=0x7fb0d0009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3538070652 shutdown_connections 2024-02-28T15:56:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb0c40692b0 0x7fb0c406b760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0e00fdfe0 0x7fb0e0115c00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 --2- 172.21.15.57:0/3538070652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0e00fe8f0 0x7fb0e0116140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3538070652 >> 172.21.15.57:0/3538070652 conn(0x7fb0e0071d90 msgr2=0x7fb0e00fb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3538070652 shutdown_connections 2024-02-28T15:56:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:49.170+0000 7fb0e6a00700 1 -- 172.21.15.57:0/3538070652 wait complete. 2024-02-28T15:56:49.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:49 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3538070652' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-28T15:56:49.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:49 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3538070652' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-28T15:56:49.979 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"active_gid":14214,"active_name":"smithi057.upqerc","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2828490283},{"type":"v1","addr":"172.21.15.57:6801","nonce":2828490283}]},"active_addr":"172.21.15.57:6801/2828490283","active_change":"2024-02-28T15:51:51.210096+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14236,"name":"smithi087.ewrszc","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.57:8443/","prometheus":"http://172.21.15.57:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":3728594338}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":794302018}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":961475533}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":1819633079}]}]} 2024-02-28T15:56:49.983 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-28T15:56:49.984 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-28T15:56:49.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T15:56:50.481 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:50.636 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:50 smithi057 ceph-mon[28763]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:50.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:50 smithi087 ceph-mon[37122]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:51.658 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:56:51.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:56:52.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.483+0000 7f6bb8400700 1 -- 172.21.15.57:0/189464395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb01038e0 msgr2=0x7f6bb00fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:52.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.483+0000 7f6bb8400700 1 --2- 172.21.15.57:0/189464395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb01038e0 0x7f6bb00fcf50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c004940 tx=0x7f6b9c009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:52.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.484+0000 7f6bb8400700 1 -- 172.21.15.57:0/189464395 shutdown_connections 2024-02-28T15:56:52.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.484+0000 7f6bb8400700 1 --2- 172.21.15.57:0/189464395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb01038e0 0x7f6bb00fcf50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:52.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.484+0000 7f6bb8400700 1 --2- 172.21.15.57:0/189464395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb0102f40 0x7f6bb0103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:52.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.484+0000 7f6bb8400700 1 -- 172.21.15.57:0/189464395 >> 172.21.15.57:0/189464395 conn(0x7f6bb00f8af0 msgr2=0x7f6bb00faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:52.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.484+0000 7f6bb8400700 1 -- 172.21.15.57:0/189464395 shutdown_connections 2024-02-28T15:56:52.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.484+0000 7f6bb8400700 1 -- 172.21.15.57:0/189464395 wait complete. 2024-02-28T15:56:52.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.484+0000 7f6bb8400700 1 Processor -- start 2024-02-28T15:56:52.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.485+0000 7f6bb8400700 1 -- start start 2024-02-28T15:56:52.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.485+0000 7f6bb8400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb0102f40 0x7f6bb0115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.485+0000 7f6bb8400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb01038e0 0x7f6bb01161e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.485+0000 7f6bb8400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb0116830 con 0x7f6bb01038e0 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.485+0000 7f6bb8400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb010fb40 con 0x7f6bb0102f40 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.485+0000 7f6bb5000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb01038e0 0x7f6bb01161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.485+0000 7f6bb5000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb01038e0 0x7f6bb01161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37034/0 (socket says 172.21.15.57:37034) 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.485+0000 7f6bb5000700 1 -- 172.21.15.57:0/871004031 learned_addr learned my addr 172.21.15.57:0/871004031 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.486+0000 7f6bb5a00700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb0102f40 0x7f6bb0115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.486+0000 7f6bb5000700 1 -- 172.21.15.57:0/871004031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb0102f40 msgr2=0x7f6bb0115ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.486+0000 7f6bb5000700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb0102f40 0x7f6bb0115ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.486+0000 7f6bb5000700 1 -- 172.21.15.57:0/871004031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c005040 con 0x7f6bb01038e0 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.486+0000 7f6bb5a00700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb0102f40 0x7f6bb0115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.486+0000 7f6bb5000700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb01038e0 0x7f6bb01161e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0090d0 tx=0x7f6b9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:52.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.486+0000 7f6bad600700 1 -- 172.21.15.57:0/871004031 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9c00e040 con 0x7f6bb01038e0 2024-02-28T15:56:52.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.486+0000 7f6bad600700 1 -- 172.21.15.57:0/871004031 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b9c00bbf0 con 0x7f6bb01038e0 2024-02-28T15:56:52.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.486+0000 7f6bad600700 1 -- 172.21.15.57:0/871004031 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9c01c630 con 0x7f6bb01038e0 2024-02-28T15:56:52.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.486+0000 7f6bb8400700 1 -- 172.21.15.57:0/871004031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb010fdc0 con 0x7f6bb01038e0 2024-02-28T15:56:52.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.487+0000 7f6bb8400700 1 -- 172.21.15.57:0/871004031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb0110300 con 0x7f6bb01038e0 2024-02-28T15:56:52.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.488+0000 7f6bb8400700 1 -- 172.21.15.57:0/871004031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb00fc6f0 con 0x7f6bb01038e0 2024-02-28T15:56:52.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.489+0000 7f6bad600700 1 -- 172.21.15.57:0/871004031 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f6b9c00bd60 con 0x7f6bb01038e0 2024-02-28T15:56:52.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.490+0000 7f6bad600700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6b980692a0 0x7f6b9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:52.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.490+0000 7f6bad600700 1 -- 172.21.15.57:0/871004031 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6b9c088250 con 0x7f6bb01038e0 2024-02-28T15:56:52.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.490+0000 7f6bb5a00700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6b980692a0 0x7f6b9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:52.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.491+0000 7f6bb5a00700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6b980692a0 0x7f6b9806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4004d60 tx=0x7f6ba400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.495+0000 7f6bad600700 1 -- 172.21.15.57:0/871004031 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6b9c0582b0 con 0x7f6bb01038e0 2024-02-28T15:56:52.665 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:52 smithi087 ceph-mon[37122]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:52.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:52 smithi057 ceph-mon[28763]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:52.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.711+0000 7f6bb8400700 1 -- 172.21.15.57:0/871004031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bb010a020 con 0x7f6bb01038e0 2024-02-28T15:56:52.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.713+0000 7f6bad600700 1 -- 172.21.15.57:0/871004031 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11035 (secure 0 0 0) 0x7f6b9c013e60 con 0x7f6bb01038e0 2024-02-28T15:56:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:56:52.707 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","created":"2024-02-28T15:49:03.036724+0000","modified":"2024-02-28T15:56:29.114177+0000","last_up_change":"2024-02-28T15:56:28.099575+0000","last_in_change":"2024-02-28T15:56:03.811536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T15:54:45.908218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7a78e2ba-3bfe-4677-b633-f2095c44065f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6803","nonce":3134303986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6805","nonce":3134303986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3134303986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6807","nonce":3134303986}]},"public_addr":"172.21.15.57:6803/3134303986","cluster_addr":"172.21.15.57:6805/3134303986","heartbeat_back_addr":"172.21.15.57:6809/3134303986","heartbeat_front_addr":"172.21.15.57:6807/3134303986","state":["exists","up"]},{"osd":1,"uuid":"fccab799-0840-4050-9ead-4ad9e7e69fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6811","nonce":37973257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6813","nonce":37973257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6817","nonce":37973257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6815","nonce":37973257}]},"public_addr":"172.21.15.57:6811/37973257","cluster_addr":"172.21.15.57:6813/37973257","heartbeat_back_addr":"172.21.15.57:6817/37973257","heartbeat_front_addr":"172.21.15.57:6815/37973257","state":["exists","up"]},{"osd":2,"uuid":"4b0a7b1d-f096-4698-b27a-6b5aa2239eb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6819","nonce":2276135967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6821","nonce":2276135967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6825","nonce":2276135967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6823","nonce":2276135967}]},"public_addr":"172.21.15.57:6819/2276135967","cluster_addr":"172.21.15.57:6821/2276135967","heartbeat_back_addr":"172.21.15.57:6825/2276135967","heartbeat_front_addr":"172.21.15.57:6823/2276135967","state":["exists","up"]},{"osd":3,"uuid":"1c67654a-1d10-422e-9540-a348cff2d828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6801","nonce":1839102641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6803","nonce":1839102641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6807","nonce":1839102641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6805","nonce":1839102641}]},"public_addr":"172.21.15.87:6801/1839102641","cluster_addr":"172.21.15.87:6803/1839102641","heartbeat_back_addr":"172.21.15.87:6807/1839102641","heartbeat_front_addr":"172.21.15.87:6805/1839102641","state":["exists","up"]},{"osd":4,"uuid":"7f988788-349d-4afd-adca-af474c7bb8ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6809","nonce":3382559885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6811","nonce":3382559885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6815","nonce":3382559885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6813","nonce":3382559885}]},"public_addr":"172.21.15.87:6809/3382559885","cluster_addr":"172.21.15.87:6811/3382559885","heartbeat_back_addr":"172.21.15.87:6815/3382559885","heartbeat_front_addr":"172.21.15.87:6813/3382559885","state":["exists","up"]},{"osd":5,"uuid":"83e02849-bd1f-4fa8-893e-1bfd8b2cfe42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6817","nonce":2535835025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6819","nonce":2535835025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6823","nonce":2535835025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6821","nonce":2535835025}]},"public_addr":"172.21.15.87:6817/2535835025","cluster_addr":"172.21.15.87:6819/2535835025","heartbeat_back_addr":"172.21.15.87:6823/2535835025","heartbeat_front_addr":"172.21.15.87:6821/2535835025","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:53:27.750469+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:03.782911+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:41.785278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:15.986058+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:50.819979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:56:26.433957+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/2044423401":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/429066936":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6800/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6801/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6801/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/509992026":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6800/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/4184139864":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3955176243":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6800/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3171524924":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/1871958144":"2024-02-29T15:49:35.637547+0000","172.21.15.57:6801/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/4078846536":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/2729792809":"2024-02-29T15:50:16.193611+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.715+0000 7f6bb8400700 1 -- 172.21.15.57:0/871004031 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6b980692a0 msgr2=0x7f6b9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.715+0000 7f6bb8400700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6b980692a0 0x7f6b9806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4004d60 tx=0x7f6ba400b040 comp rx=0 tx=0).stop 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.715+0000 7f6bb8400700 1 -- 172.21.15.57:0/871004031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb01038e0 msgr2=0x7f6bb01161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.715+0000 7f6bb8400700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb01038e0 0x7f6bb01161e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0090d0 tx=0x7f6b9c009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.715+0000 7f6bb8400700 1 -- 172.21.15.57:0/871004031 shutdown_connections 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.715+0000 7f6bb8400700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f6b980692a0 0x7f6b9806b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.715+0000 7f6bb8400700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb0102f40 0x7f6bb0115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.715+0000 7f6bb8400700 1 --2- 172.21.15.57:0/871004031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb01038e0 0x7f6bb01161e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.715+0000 7f6bb8400700 1 -- 172.21.15.57:0/871004031 >> 172.21.15.57:0/871004031 conn(0x7f6bb00f8af0 msgr2=0x7f6bb00fa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.716+0000 7f6bb8400700 1 -- 172.21.15.57:0/871004031 shutdown_connections 2024-02-28T15:56:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:52.716+0000 7f6bb8400700 1 -- 172.21.15.57:0/871004031 wait complete. 2024-02-28T15:56:53.474 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-28T15:56:53.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T15:56:53.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:53 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/871004031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T15:56:53.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:53 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/871004031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T15:56:53.994 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:54.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:54 smithi057 ceph-mon[28763]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:54.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:54 smithi087 ceph-mon[37122]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.005+0000 7fd550600700 1 -- 172.21.15.57:0/2720498978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd548102f50 msgr2=0x7fd548103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.005+0000 7fd550600700 1 --2- 172.21.15.57:0/2720498978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd548102f50 0x7fd548103320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd53c004940 tx=0x7fd53c009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.005+0000 7fd550600700 1 -- 172.21.15.57:0/2720498978 shutdown_connections 2024-02-28T15:56:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.005+0000 7fd550600700 1 --2- 172.21.15.57:0/2720498978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5481038f0 0x7fd5480fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.005+0000 7fd550600700 1 --2- 172.21.15.57:0/2720498978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd548102f50 0x7fd548103320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.005+0000 7fd550600700 1 -- 172.21.15.57:0/2720498978 >> 172.21.15.57:0/2720498978 conn(0x7fd5480f8ae0 msgr2=0x7fd5480faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.005+0000 7fd550600700 1 -- 172.21.15.57:0/2720498978 shutdown_connections 2024-02-28T15:56:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.005+0000 7fd550600700 1 -- 172.21.15.57:0/2720498978 wait complete. 2024-02-28T15:56:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.006+0000 7fd550600700 1 Processor -- start 2024-02-28T15:56:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.006+0000 7fd550600700 1 -- start start 2024-02-28T15:56:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.006+0000 7fd550600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd548102f50 0x7fd548115c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.006+0000 7fd550600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5481038f0 0x7fd5481161d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.006+0000 7fd550600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd548116820 con 0x7fd548102f50 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.007+0000 7fd550600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54810fb50 con 0x7fd5481038f0 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.007+0000 7fd54dc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd548102f50 0x7fd548115c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.007+0000 7fd54dc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd548102f50 0x7fd548115c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37048/0 (socket says 172.21.15.57:37048) 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.007+0000 7fd54dc00700 1 -- 172.21.15.57:0/3250670391 learned_addr learned my addr 172.21.15.57:0/3250670391 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.007+0000 7fd54d200700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5481038f0 0x7fd5481161d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.007+0000 7fd54dc00700 1 -- 172.21.15.57:0/3250670391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5481038f0 msgr2=0x7fd5481161d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.007+0000 7fd54dc00700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5481038f0 0x7fd5481161d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.007+0000 7fd54dc00700 1 -- 172.21.15.57:0/3250670391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c005040 con 0x7fd548102f50 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.007+0000 7fd54d200700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5481038f0 0x7fd5481161d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T15:56:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.008+0000 7fd54dc00700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd548102f50 0x7fd548115c90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009150 tx=0x7fd53c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.008+0000 7fd545600700 1 -- 172.21.15.57:0/3250670391 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd53c00e040 con 0x7fd548102f50 2024-02-28T15:56:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.008+0000 7fd545600700 1 -- 172.21.15.57:0/3250670391 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd53c00bbf0 con 0x7fd548102f50 2024-02-28T15:56:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.008+0000 7fd550600700 1 -- 172.21.15.57:0/3250670391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54810fdd0 con 0x7fd548102f50 2024-02-28T15:56:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.008+0000 7fd545600700 1 -- 172.21.15.57:0/3250670391 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd53c01c630 con 0x7fd548102f50 2024-02-28T15:56:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.008+0000 7fd550600700 1 -- 172.21.15.57:0/3250670391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd548110310 con 0x7fd548102f50 2024-02-28T15:56:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.009+0000 7fd550600700 1 -- 172.21.15.57:0/3250670391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5480fc6e0 con 0x7fd548102f50 2024-02-28T15:56:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.010+0000 7fd545600700 1 -- 172.21.15.57:0/3250670391 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fd53c00bd60 con 0x7fd548102f50 2024-02-28T15:56:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.011+0000 7fd545600700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd5300692b0 0x7fd53006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:56:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.011+0000 7fd545600700 1 -- 172.21.15.57:0/3250670391 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd53c0882f0 con 0x7fd548102f50 2024-02-28T15:56:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.011+0000 7fd54d200700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd5300692b0 0x7fd53006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:56:56.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.012+0000 7fd54d200700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd5300692b0 0x7fd53006b760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd534009fd0 tx=0x7fd53400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:56:56.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.016+0000 7fd545600700 1 -- 172.21.15.57:0/3250670391 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd53c058350 con 0x7fd548102f50 2024-02-28T15:56:56.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.230+0000 7fd550600700 1 -- 172.21.15.57:0/3250670391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd548111230 con 0x7fd548102f50 2024-02-28T15:56:56.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.232+0000 7fd545600700 1 -- 172.21.15.57:0/3250670391 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11035 (secure 0 0 0) 0x7fd53c057ee0 con 0x7fd548102f50 2024-02-28T15:56:56.227 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:56:56.227 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","created":"2024-02-28T15:49:03.036724+0000","modified":"2024-02-28T15:56:29.114177+0000","last_up_change":"2024-02-28T15:56:28.099575+0000","last_in_change":"2024-02-28T15:56:03.811536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T15:54:45.908218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7a78e2ba-3bfe-4677-b633-f2095c44065f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6803","nonce":3134303986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6805","nonce":3134303986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3134303986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6807","nonce":3134303986}]},"public_addr":"172.21.15.57:6803/3134303986","cluster_addr":"172.21.15.57:6805/3134303986","heartbeat_back_addr":"172.21.15.57:6809/3134303986","heartbeat_front_addr":"172.21.15.57:6807/3134303986","state":["exists","up"]},{"osd":1,"uuid":"fccab799-0840-4050-9ead-4ad9e7e69fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6811","nonce":37973257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6813","nonce":37973257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6817","nonce":37973257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6815","nonce":37973257}]},"public_addr":"172.21.15.57:6811/37973257","cluster_addr":"172.21.15.57:6813/37973257","heartbeat_back_addr":"172.21.15.57:6817/37973257","heartbeat_front_addr":"172.21.15.57:6815/37973257","state":["exists","up"]},{"osd":2,"uuid":"4b0a7b1d-f096-4698-b27a-6b5aa2239eb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6819","nonce":2276135967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6821","nonce":2276135967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6825","nonce":2276135967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6823","nonce":2276135967}]},"public_addr":"172.21.15.57:6819/2276135967","cluster_addr":"172.21.15.57:6821/2276135967","heartbeat_back_addr":"172.21.15.57:6825/2276135967","heartbeat_front_addr":"172.21.15.57:6823/2276135967","state":["exists","up"]},{"osd":3,"uuid":"1c67654a-1d10-422e-9540-a348cff2d828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6801","nonce":1839102641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6803","nonce":1839102641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6807","nonce":1839102641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6805","nonce":1839102641}]},"public_addr":"172.21.15.87:6801/1839102641","cluster_addr":"172.21.15.87:6803/1839102641","heartbeat_back_addr":"172.21.15.87:6807/1839102641","heartbeat_front_addr":"172.21.15.87:6805/1839102641","state":["exists","up"]},{"osd":4,"uuid":"7f988788-349d-4afd-adca-af474c7bb8ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6809","nonce":3382559885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6811","nonce":3382559885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6815","nonce":3382559885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6813","nonce":3382559885}]},"public_addr":"172.21.15.87:6809/3382559885","cluster_addr":"172.21.15.87:6811/3382559885","heartbeat_back_addr":"172.21.15.87:6815/3382559885","heartbeat_front_addr":"172.21.15.87:6813/3382559885","state":["exists","up"]},{"osd":5,"uuid":"83e02849-bd1f-4fa8-893e-1bfd8b2cfe42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6817","nonce":2535835025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6819","nonce":2535835025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6823","nonce":2535835025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6821","nonce":2535835025}]},"public_addr":"172.21.15.87:6817/2535835025","cluster_addr":"172.21.15.87:6819/2535835025","heartbeat_back_addr":"172.21.15.87:6823/2535835025","heartbeat_front_addr":"172.21.15.87:6821/2535835025","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:53:27.750469+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:03.782911+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:41.785278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:15.986058+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:50.819979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:56:26.433957+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/2044423401":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/429066936":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6800/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6801/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6801/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/509992026":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6800/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/4184139864":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3955176243":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6800/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3171524924":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/1871958144":"2024-02-29T15:49:35.637547+0000","172.21.15.57:6801/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/4078846536":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/2729792809":"2024-02-29T15:50:16.193611+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T15:56:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 -- 172.21.15.57:0/3250670391 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd5300692b0 msgr2=0x7fd53006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd5300692b0 0x7fd53006b760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd534009fd0 tx=0x7fd53400b040 comp rx=0 tx=0).stop 2024-02-28T15:56:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 -- 172.21.15.57:0/3250670391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd548102f50 msgr2=0x7fd548115c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:56:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd548102f50 0x7fd548115c90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009150 tx=0x7fd53c009e30 comp rx=0 tx=0).stop 2024-02-28T15:56:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 -- 172.21.15.57:0/3250670391 shutdown_connections 2024-02-28T15:56:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd5300692b0 0x7fd53006b760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd548102f50 0x7fd548115c90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 --2- 172.21.15.57:0/3250670391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5481038f0 0x7fd5481161d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:56:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 -- 172.21.15.57:0/3250670391 >> 172.21.15.57:0/3250670391 conn(0x7fd5480f8ae0 msgr2=0x7fd5480fa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:56:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 -- 172.21.15.57:0/3250670391 shutdown_connections 2024-02-28T15:56:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:56:56.235+0000 7fd550600700 1 -- 172.21.15.57:0/3250670391 wait complete. 2024-02-28T15:56:56.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:56 smithi057 ceph-mon[28763]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:56.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:56 smithi087 ceph-mon[37122]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:56.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-28T15:56:56.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-28T15:56:56.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-28T15:56:56.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-28T15:56:56.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-28T15:56:56.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-28T15:56:57.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:57 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3250670391' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T15:56:57.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:57 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3250670391' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T15:56:57.560 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:57.577 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:58.349 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:56:58 smithi057 ceph-mon[28763]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:58.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:56:58 smithi087 ceph-mon[37122]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:56:58.663 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:58.668 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:58.673 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:56:59.558 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:00.529 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:00 smithi057 ceph-mon[28763]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:00 smithi087 ceph-mon[37122]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:02.599 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:02 smithi057 ceph-mon[28763]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:02.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:02 smithi087 ceph-mon[37122]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.011+0000 7f146a000700 1 -- 172.21.15.57:0/2295608304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1464105160 msgr2=0x7f1464105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.011+0000 7f146a000700 1 --2- 172.21.15.57:0/2295608304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1464105160 0x7f1464105530 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1454004940 tx=0x7f1454009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.012+0000 7f146a000700 1 -- 172.21.15.57:0/2295608304 shutdown_connections 2024-02-28T15:57:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.012+0000 7f146a000700 1 --2- 172.21.15.57:0/2295608304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1464105b00 0x7f14640ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.012+0000 7f146a000700 1 --2- 172.21.15.57:0/2295608304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1464105160 0x7f1464105530 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.012+0000 7f146a000700 1 -- 172.21.15.57:0/2295608304 >> 172.21.15.57:0/2295608304 conn(0x7f14640fad30 msgr2=0x7f14640fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.012+0000 7f146a000700 1 -- 172.21.15.57:0/2295608304 shutdown_connections 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.012+0000 7f146a000700 1 -- 172.21.15.57:0/2295608304 wait complete. 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.012+0000 7f146a000700 1 Processor -- start 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.013+0000 7f146a000700 1 -- start start 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.013+0000 7f146a000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1464105160 0x7f14640724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.013+0000 7f146a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1464105b00 0x7f14640729e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.013+0000 7f146a000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1464072f20 con 0x7f1464105b00 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.013+0000 7f146a000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1464073060 con 0x7f1464105160 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.013+0000 7f1462a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1464105b00 0x7f14640729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.013+0000 7f1462a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1464105b00 0x7f14640729e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53184/0 (socket says 172.21.15.57:53184) 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.013+0000 7f1462a00700 1 -- 172.21.15.57:0/4006893622 learned_addr learned my addr 172.21.15.57:0/4006893622 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.014+0000 7f1462a00700 1 -- 172.21.15.57:0/4006893622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1464105160 msgr2=0x7f14640724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.014+0000 7f1463400700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1464105160 0x7f14640724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.014+0000 7f1462a00700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1464105160 0x7f14640724a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.014+0000 7f1462a00700 1 -- 172.21.15.57:0/4006893622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1454005040 con 0x7f1464105b00 2024-02-28T15:57:04.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.014+0000 7f1462a00700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1464105b00 0x7f14640729e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1450002a50 tx=0x7f1450004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:04.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.014+0000 7f145b400700 1 -- 172.21.15.57:0/4006893622 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1450007cc0 con 0x7f1464105b00 2024-02-28T15:57:04.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.014+0000 7f145b400700 1 -- 172.21.15.57:0/4006893622 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f145000f040 con 0x7f1464105b00 2024-02-28T15:57:04.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.014+0000 7f145b400700 1 -- 172.21.15.57:0/4006893622 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f145000da40 con 0x7f1464105b00 2024-02-28T15:57:04.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.014+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146411e2c0 con 0x7f1464105b00 2024-02-28T15:57:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.014+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146411e610 con 0x7f1464105b00 2024-02-28T15:57:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.015+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f146405e690 con 0x7f1464105b00 2024-02-28T15:57:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.017+0000 7f145b400700 1 -- 172.21.15.57:0/4006893622 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f14500097c0 con 0x7f1464105b00 2024-02-28T15:57:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.018+0000 7f145b400700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14480692b0 0x7f144806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.018+0000 7f145b400700 1 -- 172.21.15.57:0/4006893622 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1450086ca0 con 0x7f1464105b00 2024-02-28T15:57:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.018+0000 7f1463400700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14480692b0 0x7f144806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.018+0000 7f145b400700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257] conn(0x7f144806ef80 0x7f1448071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.018+0000 7f145b400700 1 -- 172.21.15.57:0/4006893622 --> [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1448071a40 con 0x7f144806ef80 2024-02-28T15:57:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.018+0000 7f145b400700 1 -- 172.21.15.57:0/4006893622 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14500891f0 con 0x7f1464105b00 2024-02-28T15:57:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.018+0000 7f1463e00700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257] conn(0x7f144806ef80 0x7f1448071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.019+0000 7f1463400700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14480692b0 0x7f144806b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f145400b3b0 tx=0x7f1454009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.019+0000 7f1463e00700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257] conn(0x7f144806ef80 0x7f1448071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.020+0000 7f145b400700 1 -- 172.21.15.57:0/4006893622 <== osd.1 v2:172.21.15.57:6810/37973257 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1448071a40 con 0x7f144806ef80 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.043+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 --> [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f146405eb40 con 0x7f144806ef80 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.043+0000 7f145b400700 1 -- 172.21.15.57:0/4006893622 <== osd.1 v2:172.21.15.57:6810/37973257 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f146405eb40 con 0x7f144806ef80 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.043+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257] conn(0x7f144806ef80 msgr2=0x7f1448071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257] conn(0x7f144806ef80 0x7f1448071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14480692b0 msgr2=0x7f144806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14480692b0 0x7f144806b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f145400b3b0 tx=0x7f1454009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1464105b00 msgr2=0x7f14640729e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1464105b00 0x7f14640729e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1450002a50 tx=0x7f1450004600 comp rx=0 tx=0).stop 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 shutdown_connections 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6810/37973257,v1:172.21.15.57:6811/37973257] conn(0x7f144806ef80 0x7f1448071390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14480692b0 0x7f144806b760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1464105160 0x7f14640724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 --2- 172.21.15.57:0/4006893622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1464105b00 0x7f14640729e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 >> 172.21.15.57:0/4006893622 conn(0x7f14640fad30 msgr2=0x7f14640fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 shutdown_connections 2024-02-28T15:57:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:04.044+0000 7f146a000700 1 -- 172.21.15.57:0/4006893622 wait complete. 2024-02-28T15:57:04.622 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:04 smithi057 ceph-mon[28763]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:04.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:04 smithi087 ceph-mon[37122]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.036+0000 7efe1e800700 1 -- 172.21.15.57:0/3748823668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe180702d0 msgr2=0x7efe180706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.036+0000 7efe1e800700 1 --2- 172.21.15.57:0/3748823668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe180702d0 0x7efe180706a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efe08004970 tx=0x7efe08009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.036+0000 7efe1e800700 1 -- 172.21.15.57:0/3748823668 shutdown_connections 2024-02-28T15:57:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.036+0000 7efe1e800700 1 --2- 172.21.15.57:0/3748823668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe18070be0 0x7efe181092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.036+0000 7efe1e800700 1 --2- 172.21.15.57:0/3748823668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe180702d0 0x7efe180706a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.036+0000 7efe1e800700 1 -- 172.21.15.57:0/3748823668 >> 172.21.15.57:0/3748823668 conn(0x7efe180f8ae0 msgr2=0x7efe180faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.037+0000 7efe1e800700 1 -- 172.21.15.57:0/3748823668 shutdown_connections 2024-02-28T15:57:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.037+0000 7efe1e800700 1 -- 172.21.15.57:0/3748823668 wait complete. 2024-02-28T15:57:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.037+0000 7efe1e800700 1 Processor -- start 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.038+0000 7efe1e800700 1 -- start start 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.038+0000 7efe1e800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe180702d0 0x7efe18115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.038+0000 7efe1e800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe18070be0 0x7efe18116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.038+0000 7efe1e800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe181167b0 con 0x7efe18070be0 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.038+0000 7efe1e800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1810fae0 con 0x7efe180702d0 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.038+0000 7efe16a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe18070be0 0x7efe18116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.038+0000 7efe16a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe18070be0 0x7efe18116160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53202/0 (socket says 172.21.15.57:53202) 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.038+0000 7efe16a00700 1 -- 172.21.15.57:0/4199303460 learned_addr learned my addr 172.21.15.57:0/4199303460 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.039+0000 7efe17400700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe180702d0 0x7efe18115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.039+0000 7efe16a00700 1 -- 172.21.15.57:0/4199303460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe180702d0 msgr2=0x7efe18115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.039+0000 7efe16a00700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe180702d0 0x7efe18115c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.039+0000 7efe16a00700 1 -- 172.21.15.57:0/4199303460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08005040 con 0x7efe18070be0 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.039+0000 7efe16a00700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe18070be0 0x7efe18116160 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efe0400c830 tx=0x7efe04004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.039+0000 7efe0f400700 1 -- 172.21.15.57:0/4199303460 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0400a760 con 0x7efe18070be0 2024-02-28T15:57:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.039+0000 7efe0f400700 1 -- 172.21.15.57:0/4199303460 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe0400ad90 con 0x7efe18070be0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.039+0000 7efe0f400700 1 -- 172.21.15.57:0/4199303460 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe040113a0 con 0x7efe18070be0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.039+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1810fdc0 con 0x7efe18070be0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.040+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe18110300 con 0x7efe18070be0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.041+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe18110800 con 0x7efe18070be0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.042+0000 7efe0f400700 1 -- 172.21.15.57:0/4199303460 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7efe04012400 con 0x7efe18070be0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.043+0000 7efe0f400700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efdfc0692b0 0x7efdfc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.043+0000 7efe0f400700 1 -- 172.21.15.57:0/4199303460 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efe04086f90 con 0x7efe18070be0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.043+0000 7efe0f400700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025] conn(0x7efdfc06ef80 0x7efdfc071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.043+0000 7efe0f400700 1 -- 172.21.15.57:0/4199303460 --> [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efdfc071a40 con 0x7efdfc06ef80 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.043+0000 7efe0f400700 1 -- 172.21.15.57:0/4199303460 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe04089550 con 0x7efe18070be0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.043+0000 7efe17400700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efdfc0692b0 0x7efdfc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.044+0000 7efe17e00700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025] conn(0x7efdfc06ef80 0x7efdfc071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.044+0000 7efe17400700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efdfc0692b0 0x7efdfc06b760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe08004ee0 tx=0x7efe08009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:05.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.045+0000 7efe17e00700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025] conn(0x7efdfc06ef80 0x7efdfc071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:05.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.047+0000 7efe0f400700 1 -- 172.21.15.57:0/4199303460 <== osd.5 v2:172.21.15.87:6816/2535835025 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7efdfc071a40 con 0x7efdfc06ef80 2024-02-28T15:57:05.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.064+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 --> [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe1805e690 con 0x7efdfc06ef80 2024-02-28T15:57:05.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.065+0000 7efe0f400700 1 -- 172.21.15.57:0/4199303460 <== osd.5 v2:172.21.15.87:6816/2535835025 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efe1805e690 con 0x7efdfc06ef80 2024-02-28T15:57:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.065+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 >> [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025] conn(0x7efdfc06ef80 msgr2=0x7efdfc071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.065+0000 7efe1e800700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025] conn(0x7efdfc06ef80 0x7efdfc071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.065+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efdfc0692b0 msgr2=0x7efdfc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:05.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.065+0000 7efe1e800700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efdfc0692b0 0x7efdfc06b760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe08004ee0 tx=0x7efe08009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:05.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.065+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe18070be0 msgr2=0x7efe18116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:05.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.065+0000 7efe1e800700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe18070be0 0x7efe18116160 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efe0400c830 tx=0x7efe04004470 comp rx=0 tx=0).stop 2024-02-28T15:57:05.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.066+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 shutdown_connections 2024-02-28T15:57:05.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.066+0000 7efe1e800700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.87:6816/2535835025,v1:172.21.15.87:6817/2535835025] conn(0x7efdfc06ef80 0x7efdfc071390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.066+0000 7efe1e800700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efdfc0692b0 0x7efdfc06b760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.066+0000 7efe1e800700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe180702d0 0x7efe18115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.066+0000 7efe1e800700 1 --2- 172.21.15.57:0/4199303460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe18070be0 0x7efe18116160 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.066+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 >> 172.21.15.57:0/4199303460 conn(0x7efe180f8ae0 msgr2=0x7efe18103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:05.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.066+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 shutdown_connections 2024-02-28T15:57:05.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.066+0000 7efe1e800700 1 -- 172.21.15.57:0/4199303460 wait complete. 2024-02-28T15:57:05.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.347+0000 7f6980800700 1 -- 172.21.15.57:0/3253085242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69780fdf40 msgr2=0x7f69780fe310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.347+0000 7f6980800700 1 --2- 172.21.15.57:0/3253085242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69780fdf40 0x7f69780fe310 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f696c004940 tx=0x7f696c009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.347+0000 7f6980800700 1 -- 172.21.15.57:0/3253085242 shutdown_connections 2024-02-28T15:57:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.347+0000 7f6980800700 1 --2- 172.21.15.57:0/3253085242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69780fe8e0 0x7f6978106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.347+0000 7f6980800700 1 --2- 172.21.15.57:0/3253085242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69780fdf40 0x7f69780fe310 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.347+0000 7f6980800700 1 -- 172.21.15.57:0/3253085242 >> 172.21.15.57:0/3253085242 conn(0x7f69780f79d0 msgr2=0x7f69780f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.347+0000 7f6980800700 1 -- 172.21.15.57:0/3253085242 shutdown_connections 2024-02-28T15:57:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.347+0000 7f6980800700 1 -- 172.21.15.57:0/3253085242 wait complete. 2024-02-28T15:57:05.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.348+0000 7f6980800700 1 Processor -- start 2024-02-28T15:57:05.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.348+0000 7f6980800700 1 -- start start 2024-02-28T15:57:05.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f6980800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69780fdf40 0x7f6978115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:05.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f6980800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69780fe8e0 0x7f6978116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:05.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f6980800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69781167b0 con 0x7f69780fe8e0 2024-02-28T15:57:05.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f6980800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697810fb00 con 0x7f69780fdf40 2024-02-28T15:57:05.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f697d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69780fe8e0 0x7f6978116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:05.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f697d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69780fe8e0 0x7f6978116160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53208/0 (socket says 172.21.15.57:53208) 2024-02-28T15:57:05.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f697d400700 1 -- 172.21.15.57:0/2357204963 learned_addr learned my addr 172.21.15.57:0/2357204963 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:05.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f697de00700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69780fdf40 0x7f6978115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:05.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f697d400700 1 -- 172.21.15.57:0/2357204963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69780fdf40 msgr2=0x7f6978115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:05.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f697d400700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69780fdf40 0x7f6978115c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.349+0000 7f697d400700 1 -- 172.21.15.57:0/2357204963 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c005040 con 0x7f69780fe8e0 2024-02-28T15:57:05.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.350+0000 7f697d400700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69780fe8e0 0x7f6978116160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f696800c8c0 tx=0x7f69680044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:05.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.350+0000 7f6972000700 1 -- 172.21.15.57:0/2357204963 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696800a980 con 0x7f69780fe8e0 2024-02-28T15:57:05.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.350+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697810fde0 con 0x7f69780fe8e0 2024-02-28T15:57:05.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.350+0000 7f6972000700 1 -- 172.21.15.57:0/2357204963 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f696800ce60 con 0x7f69780fe8e0 2024-02-28T15:57:05.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.350+0000 7f6972000700 1 -- 172.21.15.57:0/2357204963 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69680113a0 con 0x7f69780fe8e0 2024-02-28T15:57:05.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.350+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6978110320 con 0x7f69780fe8e0 2024-02-28T15:57:05.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.351+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6978110870 con 0x7f69780fe8e0 2024-02-28T15:57:05.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.352+0000 7f6972000700 1 -- 172.21.15.57:0/2357204963 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f6968012850 con 0x7f69780fe8e0 2024-02-28T15:57:05.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.353+0000 7f6972000700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f69600692b0 0x7f696006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:05.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.353+0000 7f6972000700 1 -- 172.21.15.57:0/2357204963 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6968087a50 con 0x7f69780fe8e0 2024-02-28T15:57:05.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.353+0000 7f697de00700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f69600692b0 0x7f696006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:05.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.354+0000 7f6972000700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986] conn(0x7f696006efd0 0x7f69600713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:05.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.354+0000 7f6972000700 1 -- 172.21.15.57:0/2357204963 --> [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6960071a90 con 0x7f696006efd0 2024-02-28T15:57:05.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.354+0000 7f6972000700 1 -- 172.21.15.57:0/2357204963 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6968087d90 con 0x7f69780fe8e0 2024-02-28T15:57:05.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.354+0000 7f697e800700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986] conn(0x7f696006efd0 0x7f69600713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:05.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.354+0000 7f697de00700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f69600692b0 0x7f696006b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f696c009fd0 tx=0x7f696c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:05.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.355+0000 7f697e800700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986] conn(0x7f696006efd0 0x7f69600713e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:05.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.355+0000 7f6972000700 1 -- 172.21.15.57:0/2357204963 <== osd.0 v2:172.21.15.57:6802/3134303986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6960071a90 con 0x7f696006efd0 2024-02-28T15:57:05.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.372+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 --> [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f697805e610 con 0x7f696006efd0 2024-02-28T15:57:05.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.372+0000 7f6972000700 1 -- 172.21.15.57:0/2357204963 <== osd.0 v2:172.21.15.57:6802/3134303986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f697805e610 con 0x7f696006efd0 2024-02-28T15:57:05.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986] conn(0x7f696006efd0 msgr2=0x7f69600713e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:05.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986] conn(0x7f696006efd0 0x7f69600713e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f69600692b0 msgr2=0x7f696006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f69600692b0 0x7f696006b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f696c009fd0 tx=0x7f696c009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69780fe8e0 msgr2=0x7f6978116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69780fe8e0 0x7f6978116160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f696800c8c0 tx=0x7f69680044c0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 shutdown_connections 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6802/3134303986,v1:172.21.15.57:6803/3134303986] conn(0x7f696006efd0 0x7f69600713e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f69600692b0 0x7f696006b760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69780fdf40 0x7f6978115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 --2- 172.21.15.57:0/2357204963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69780fe8e0 0x7f6978116160 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 >> 172.21.15.57:0/2357204963 conn(0x7f69780f79d0 msgr2=0x7f69780fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.373+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 shutdown_connections 2024-02-28T15:57:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:05.374+0000 7f6980800700 1 -- 172.21.15.57:0/2357204963 wait complete. 2024-02-28T15:57:06.388 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:06 smithi057 ceph-mon[28763]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:06.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:06 smithi087 ceph-mon[37122]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:38654705710 2024-02-28T15:57:06.767 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-28T15:57:07.190 INFO:teuthology.orchestra.run.smithi057.stdout:171798691851 2024-02-28T15:57:07.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-28T15:57:07.366 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:07 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:57:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:07 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:57:08.340 INFO:teuthology.orchestra.run.smithi057.stdout:60129542182 2024-02-28T15:57:08.341 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-28T15:57:08.385 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:08 smithi057 ceph-mon[28763]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:08.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:08 smithi087 ceph-mon[37122]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:08.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.553+0000 7fb981800700 1 -- 172.21.15.57:0/2085242094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb97c071f60 msgr2=0x7fb97c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:08.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.553+0000 7fb981800700 1 --2- 172.21.15.57:0/2085242094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb97c071f60 0x7fb97c070330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb96c004970 tx=0x7fb96c009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:08.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.553+0000 7fb981800700 1 -- 172.21.15.57:0/2085242094 shutdown_connections 2024-02-28T15:57:08.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.553+0000 7fb981800700 1 --2- 172.21.15.57:0/2085242094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c070870 0x7fb97c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.553+0000 7fb981800700 1 --2- 172.21.15.57:0/2085242094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb97c071f60 0x7fb97c070330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.553+0000 7fb981800700 1 -- 172.21.15.57:0/2085242094 >> 172.21.15.57:0/2085242094 conn(0x7fb97c0f8ae0 msgr2=0x7fb97c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.553+0000 7fb981800700 1 -- 172.21.15.57:0/2085242094 shutdown_connections 2024-02-28T15:57:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.553+0000 7fb981800700 1 -- 172.21.15.57:0/2085242094 wait complete. 2024-02-28T15:57:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.554+0000 7fb981800700 1 Processor -- start 2024-02-28T15:57:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.554+0000 7fb981800700 1 -- start start 2024-02-28T15:57:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.554+0000 7fb981800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c070870 0x7fb97c11a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.554+0000 7fb981800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb97c071f60 0x7fb97c11a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.554+0000 7fb981800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c11ac00 con 0x7fb97c071f60 2024-02-28T15:57:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.554+0000 7fb981800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c113f10 con 0x7fb97c070870 2024-02-28T15:57:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.555+0000 7fb97a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb97c071f60 0x7fb97c11a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.555+0000 7fb97a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb97c071f60 0x7fb97c11a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53254/0 (socket says 172.21.15.57:53254) 2024-02-28T15:57:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.555+0000 7fb97a000700 1 -- 172.21.15.57:0/1627543140 learned_addr learned my addr 172.21.15.57:0/1627543140 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.555+0000 7fb97aa00700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c070870 0x7fb97c11a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.555+0000 7fb97a000700 1 -- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c070870 msgr2=0x7fb97c11a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.555+0000 7fb97a000700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c070870 0x7fb97c11a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.555+0000 7fb97a000700 1 -- 172.21.15.57:0/1627543140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c005040 con 0x7fb97c071f60 2024-02-28T15:57:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.555+0000 7fb97aa00700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c070870 0x7fb97c11a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T15:57:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.556+0000 7fb97a000700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb97c071f60 0x7fb97c11a5b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb968002a50 tx=0x7fb9680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.556+0000 7fb972a00700 1 -- 172.21.15.57:0/1627543140 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb968007cc0 con 0x7fb97c071f60 2024-02-28T15:57:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.556+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c1141f0 con 0x7fb97c071f60 2024-02-28T15:57:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.556+0000 7fb972a00700 1 -- 172.21.15.57:0/1627543140 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb96800f040 con 0x7fb97c071f60 2024-02-28T15:57:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.556+0000 7fb972a00700 1 -- 172.21.15.57:0/1627543140 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb968009640 con 0x7fb97c071f60 2024-02-28T15:57:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.556+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c114730 con 0x7fb97c071f60 2024-02-28T15:57:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.557+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb97c114b90 con 0x7fb97c071f60 2024-02-28T15:57:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.558+0000 7fb972a00700 1 -- 172.21.15.57:0/1627543140 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fb9680097a0 con 0x7fb97c071f60 2024-02-28T15:57:08.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.559+0000 7fb972a00700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb9600692b0 0x7fb96006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:08.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.559+0000 7fb972a00700 1 -- 172.21.15.57:0/1627543140 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb968086c80 con 0x7fb97c071f60 2024-02-28T15:57:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.560+0000 7fb972a00700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641] conn(0x7fb96006ef80 0x7fb960071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.560+0000 7fb972a00700 1 -- 172.21.15.57:0/1627543140 --> [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb960071a40 con 0x7fb96006ef80 2024-02-28T15:57:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.560+0000 7fb972a00700 1 -- 172.21.15.57:0/1627543140 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb96808c2e0 con 0x7fb97c071f60 2024-02-28T15:57:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.560+0000 7fb97aa00700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb9600692b0 0x7fb96006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.560+0000 7fb97b400700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641] conn(0x7fb96006ef80 0x7fb960071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.561+0000 7fb97aa00700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb9600692b0 0x7fb96006b760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009fd0 tx=0x7fb96c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.561+0000 7fb97b400700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641] conn(0x7fb96006ef80 0x7fb960071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.563+0000 7fb972a00700 1 -- 172.21.15.57:0/1627543140 <== osd.3 v2:172.21.15.87:6800/1839102641 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb960071a40 con 0x7fb96006ef80 2024-02-28T15:57:08.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.580+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 --> [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb97c05e6d0 con 0x7fb96006ef80 2024-02-28T15:57:08.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.581+0000 7fb972a00700 1 -- 172.21.15.57:0/1627543140 <== osd.3 v2:172.21.15.87:6800/1839102641 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb97c05e6d0 con 0x7fb96006ef80 2024-02-28T15:57:08.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641] conn(0x7fb96006ef80 msgr2=0x7fb960071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:08.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641] conn(0x7fb96006ef80 0x7fb960071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb9600692b0 msgr2=0x7fb96006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:08.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb9600692b0 0x7fb96006b760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009fd0 tx=0x7fb96c009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:08.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb97c071f60 msgr2=0x7fb97c11a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:08.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb97c071f60 0x7fb97c11a5b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb968002a50 tx=0x7fb9680046b0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 shutdown_connections 2024-02-28T15:57:08.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb9600692b0 0x7fb96006b760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c070870 0x7fb97c11a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.87:6800/1839102641,v1:172.21.15.87:6801/1839102641] conn(0x7fb96006ef80 0x7fb960071390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 --2- 172.21.15.57:0/1627543140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb97c071f60 0x7fb97c11a5b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 >> 172.21.15.57:0/1627543140 conn(0x7fb97c0f8ae0 msgr2=0x7fb97c0fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:08.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 shutdown_connections 2024-02-28T15:57:08.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:08.582+0000 7fb981800700 1 -- 172.21.15.57:0/1627543140 wait complete. 2024-02-28T15:57:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.765+0000 7fa380600700 1 -- 172.21.15.57:0/1583714588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378070330 msgr2=0x7fa378070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.765+0000 7fa380600700 1 --2- 172.21.15.57:0/1583714588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378070330 0x7fa378070700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa36c004970 tx=0x7fa36c009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.765+0000 7fa380600700 1 -- 172.21.15.57:0/1583714588 shutdown_connections 2024-02-28T15:57:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.765+0000 7fa380600700 1 --2- 172.21.15.57:0/1583714588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa378070c40 0x7fa378109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.765+0000 7fa380600700 1 --2- 172.21.15.57:0/1583714588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378070330 0x7fa378070700 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.765+0000 7fa380600700 1 -- 172.21.15.57:0/1583714588 >> 172.21.15.57:0/1583714588 conn(0x7fa3780f8ae0 msgr2=0x7fa3780faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.766+0000 7fa380600700 1 -- 172.21.15.57:0/1583714588 shutdown_connections 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.766+0000 7fa380600700 1 -- 172.21.15.57:0/1583714588 wait complete. 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.767+0000 7fa380600700 1 Processor -- start 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.767+0000 7fa380600700 1 -- start start 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.767+0000 7fa380600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378070330 0x7fa378108e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.767+0000 7fa380600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa378070c40 0x7fa3780ffc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.767+0000 7fa380600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3781094f0 con 0x7fa378070330 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.768+0000 7fa380600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa378109660 con 0x7fa378070c40 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.768+0000 7fa37dc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378070330 0x7fa378108e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.768+0000 7fa37dc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378070330 0x7fa378108e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53222/0 (socket says 172.21.15.57:53222) 2024-02-28T15:57:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.768+0000 7fa37dc00700 1 -- 172.21.15.57:0/3091024492 learned_addr learned my addr 172.21.15.57:0/3091024492 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.768+0000 7fa37d200700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa378070c40 0x7fa3780ffc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.768+0000 7fa37dc00700 1 -- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa378070c40 msgr2=0x7fa3780ffc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.768+0000 7fa37dc00700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa378070c40 0x7fa3780ffc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.768+0000 7fa37dc00700 1 -- 172.21.15.57:0/3091024492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c005040 con 0x7fa378070330 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.768+0000 7fa37d200700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa378070c40 0x7fa3780ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.769+0000 7fa37dc00700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378070330 0x7fa378108e60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa36c004f50 tx=0x7fa36c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.769+0000 7fa375600700 1 -- 172.21.15.57:0/3091024492 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36c00e040 con 0x7fa378070330 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.769+0000 7fa375600700 1 -- 172.21.15.57:0/3091024492 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa36c004290 con 0x7fa378070330 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.769+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3781002c0 con 0x7fa378070330 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.769+0000 7fa375600700 1 -- 172.21.15.57:0/3091024492 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36c01c630 con 0x7fa378070330 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.769+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa378100800 con 0x7fa378070330 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.770+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa378100ae0 con 0x7fa378070330 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.771+0000 7fa375600700 1 -- 172.21.15.57:0/3091024492 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fa36c00bc10 con 0x7fa378070330 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.772+0000 7fa375600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fa3600692b0 0x7fa36006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.772+0000 7fa375600700 1 -- 172.21.15.57:0/3091024492 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa36c088150 con 0x7fa378070330 2024-02-28T15:57:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.773+0000 7fa37d200700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fa3600692b0 0x7fa36006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.773+0000 7fa375600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885] conn(0x7fa36006efd0 0x7fa3600713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.773+0000 7fa375600700 1 -- 172.21.15.57:0/3091024492 --> [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa360071a90 con 0x7fa36006efd0 2024-02-28T15:57:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.773+0000 7fa375600700 1 -- 172.21.15.57:0/3091024492 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa36c08a760 con 0x7fa378070330 2024-02-28T15:57:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.773+0000 7fa37d200700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fa3600692b0 0x7fa36006b760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa364009fd0 tx=0x7fa364009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.773+0000 7fa37e600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885] conn(0x7fa36006efd0 0x7fa3600713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.774+0000 7fa37e600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885] conn(0x7fa36006efd0 0x7fa3600713e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.777+0000 7fa375600700 1 -- 172.21.15.57:0/3091024492 <== osd.4 v2:172.21.15.87:6808/3382559885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa360071a90 con 0x7fa36006efd0 2024-02-28T15:57:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.793+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 --> [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa378104ed0 con 0x7fa36006efd0 2024-02-28T15:57:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.794+0000 7fa375600700 1 -- 172.21.15.57:0/3091024492 <== osd.4 v2:172.21.15.87:6808/3382559885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa378104ed0 con 0x7fa36006efd0 2024-02-28T15:57:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.794+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885] conn(0x7fa36006efd0 msgr2=0x7fa3600713e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.794+0000 7fa380600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885] conn(0x7fa36006efd0 0x7fa3600713e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fa3600692b0 msgr2=0x7fa36006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fa3600692b0 0x7fa36006b760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa364009fd0 tx=0x7fa364009ee0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378070330 msgr2=0x7fa378108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378070330 0x7fa378108e60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa36c004f50 tx=0x7fa36c009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 shutdown_connections 2024-02-28T15:57:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:6808/3382559885,v1:172.21.15.87:6809/3382559885] conn(0x7fa36006efd0 0x7fa3600713e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fa3600692b0 0x7fa36006b760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378070330 0x7fa378108e60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 --2- 172.21.15.57:0/3091024492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa378070c40 0x7fa3780ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:08.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 >> 172.21.15.57:0/3091024492 conn(0x7fa3780f8ae0 msgr2=0x7fa37810ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:08.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 shutdown_connections 2024-02-28T15:57:08.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:07.795+0000 7fa380600700 1 -- 172.21.15.57:0/3091024492 wait complete. 2024-02-28T15:57:09.385 INFO:teuthology.orchestra.run.smithi057.stdout:150323855378 2024-02-28T15:57:09.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-28T15:57:10.173 INFO:teuthology.orchestra.run.smithi057.stdout:115964117018 2024-02-28T15:57:10.173 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-28T15:57:10.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:10 smithi057 ceph-mon[28763]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:10.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.553+0000 7f5ad7e00700 1 -- 172.21.15.57:0/460109445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad0070870 msgr2=0x7f5ad0070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:10.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.553+0000 7f5ad7e00700 1 --2- 172.21.15.57:0/460109445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad0070870 0x7f5ad0070ce0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5abc004970 tx=0x7f5abc009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:10.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.553+0000 7f5ad7e00700 1 -- 172.21.15.57:0/460109445 shutdown_connections 2024-02-28T15:57:10.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.553+0000 7f5ad7e00700 1 --2- 172.21.15.57:0/460109445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad0070870 0x7f5ad0070ce0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:10.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.553+0000 7f5ad7e00700 1 --2- 172.21.15.57:0/460109445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad0071f60 0x7f5ad0070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:10.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.553+0000 7f5ad7e00700 1 -- 172.21.15.57:0/460109445 >> 172.21.15.57:0/460109445 conn(0x7f5ad00f8ae0 msgr2=0x7f5ad00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:10.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.553+0000 7f5ad7e00700 1 -- 172.21.15.57:0/460109445 shutdown_connections 2024-02-28T15:57:10.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.553+0000 7f5ad7e00700 1 -- 172.21.15.57:0/460109445 wait complete. 2024-02-28T15:57:10.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.554+0000 7f5ad7e00700 1 Processor -- start 2024-02-28T15:57:10.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.554+0000 7f5ad7e00700 1 -- start start 2024-02-28T15:57:10.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad7e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad0070870 0x7f5ad011a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:10.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad0071f60 0x7f5ad011a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:10.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad7e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad011abc0 con 0x7f5ad0071f60 2024-02-28T15:57:10.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad7e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0113ed0 con 0x7f5ad0070870 2024-02-28T15:57:10.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad4a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad0071f60 0x7f5ad011a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:10.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad4a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad0071f60 0x7f5ad011a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53274/0 (socket says 172.21.15.57:53274) 2024-02-28T15:57:10.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad4a00700 1 -- 172.21.15.57:0/1933961477 learned_addr learned my addr 172.21.15.57:0/1933961477 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:10.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad5400700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad0070870 0x7f5ad011a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:10.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad4a00700 1 -- 172.21.15.57:0/1933961477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad0070870 msgr2=0x7f5ad011a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:10.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad4a00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad0070870 0x7f5ad011a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:10.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.555+0000 7f5ad4a00700 1 -- 172.21.15.57:0/1933961477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc005040 con 0x7f5ad0071f60 2024-02-28T15:57:10.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.556+0000 7f5ad4a00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad0071f60 0x7f5ad011a570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5abc004f50 tx=0x7f5abc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:10.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.556+0000 7f5acd600700 1 -- 172.21.15.57:0/1933961477 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5abc00e040 con 0x7f5ad0071f60 2024-02-28T15:57:10.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.556+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad0114150 con 0x7f5ad0071f60 2024-02-28T15:57:10.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.556+0000 7f5acd600700 1 -- 172.21.15.57:0/1933961477 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5abc00bc10 con 0x7f5ad0071f60 2024-02-28T15:57:10.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.556+0000 7f5acd600700 1 -- 172.21.15.57:0/1933961477 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5abc01c630 con 0x7f5ad0071f60 2024-02-28T15:57:10.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.556+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad0114690 con 0x7f5ad0071f60 2024-02-28T15:57:10.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.557+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ad0114c00 con 0x7f5ad0071f60 2024-02-28T15:57:10.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.559+0000 7f5acd600700 1 -- 172.21.15.57:0/1933961477 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f5abc00bd80 con 0x7f5ad0071f60 2024-02-28T15:57:10.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.560+0000 7f5acd600700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5ab80692b0 0x7f5ab806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:10.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.560+0000 7f5acd600700 1 -- 172.21.15.57:0/1933961477 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5abc088c10 con 0x7f5ad0071f60 2024-02-28T15:57:10.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.560+0000 7f5ad5400700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5ab80692b0 0x7f5ab806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:10.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.560+0000 7f5acd600700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967] conn(0x7f5ab806ef80 0x7f5ab8071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:10.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.560+0000 7f5acd600700 1 -- 172.21.15.57:0/1933961477 --> [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ab8071a40 con 0x7f5ab806ef80 2024-02-28T15:57:10.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.560+0000 7f5acd600700 1 -- 172.21.15.57:0/1933961477 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5abc089010 con 0x7f5ad0071f60 2024-02-28T15:57:10.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.561+0000 7f5ad5e00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967] conn(0x7f5ab806ef80 0x7f5ab8071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:10.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.561+0000 7f5ad5400700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5ab80692b0 0x7f5ab806b760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4007fd0 tx=0x7f5ac4009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:10.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.561+0000 7f5ad5e00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967] conn(0x7f5ab806ef80 0x7f5ab8071390 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:10.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.562+0000 7f5acd600700 1 -- 172.21.15.57:0/1933961477 <== osd.2 v2:172.21.15.57:6818/2276135967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5ab8071a40 con 0x7f5ab806ef80 2024-02-28T15:57:10.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.581+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 --> [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ad005e640 con 0x7f5ab806ef80 2024-02-28T15:57:10.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.581+0000 7f5acd600700 1 -- 172.21.15.57:0/1933961477 <== osd.2 v2:172.21.15.57:6818/2276135967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ad005e640 con 0x7f5ab806ef80 2024-02-28T15:57:10.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.582+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967] conn(0x7f5ab806ef80 msgr2=0x7f5ab8071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:10.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.582+0000 7f5ad7e00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967] conn(0x7f5ab806ef80 0x7f5ab8071390 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:10.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.582+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5ab80692b0 msgr2=0x7f5ab806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:10.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.582+0000 7f5ad7e00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5ab80692b0 0x7f5ab806b760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4007fd0 tx=0x7f5ac4009040 comp rx=0 tx=0).stop 2024-02-28T15:57:10.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.582+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad0071f60 msgr2=0x7f5ad011a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:10.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.582+0000 7f5ad7e00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad0071f60 0x7f5ad011a570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5abc004f50 tx=0x7f5abc009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:10.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.583+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 shutdown_connections 2024-02-28T15:57:10.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.583+0000 7f5ad7e00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6818/2276135967,v1:172.21.15.57:6819/2276135967] conn(0x7f5ab806ef80 0x7f5ab8071390 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:10.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.583+0000 7f5ad7e00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5ab80692b0 0x7f5ab806b760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:10.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.583+0000 7f5ad7e00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad0070870 0x7f5ad011a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:10.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.583+0000 7f5ad7e00700 1 --2- 172.21.15.57:0/1933961477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad0071f60 0x7f5ad011a570 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:10.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.583+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 >> 172.21.15.57:0/1933961477 conn(0x7f5ad00f8ae0 msgr2=0x7f5ad00fa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:10.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.583+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 shutdown_connections 2024-02-28T15:57:10.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:10.583+0000 7f5ad7e00700 1 -- 172.21.15.57:0/1933961477 wait complete. 2024-02-28T15:57:10.582 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:10.617 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:10 smithi087 ceph-mon[37122]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:10.866 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:11.343 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:11.377 INFO:teuthology.orchestra.run.smithi057.stdout:81604378657 2024-02-28T15:57:11.378 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-28T15:57:12.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:12 smithi057 ceph-mon[28763]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:12 smithi087 ceph-mon[37122]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:13.441 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:13.443 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:14.631 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:14 smithi057 ceph-mon[28763]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:14.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:14 smithi087 ceph-mon[37122]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:16.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.164+0000 7ff66c200700 1 -- 172.21.15.57:0/2367671077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff664101e40 msgr2=0x7ff664102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:16.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.164+0000 7ff66c200700 1 --2- 172.21.15.57:0/2367671077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff664101e40 0x7ff664102210 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff658004940 tx=0x7ff658009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:16.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.164+0000 7ff66c200700 1 -- 172.21.15.57:0/2367671077 shutdown_connections 2024-02-28T15:57:16.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.164+0000 7ff66c200700 1 --2- 172.21.15.57:0/2367671077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6641027e0 0x7ff6640fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:16.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.164+0000 7ff66c200700 1 --2- 172.21.15.57:0/2367671077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff664101e40 0x7ff664102210 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:16.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.164+0000 7ff66c200700 1 -- 172.21.15.57:0/2367671077 >> 172.21.15.57:0/2367671077 conn(0x7ff664071d90 msgr2=0x7ff664072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:16.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.165+0000 7ff66c200700 1 -- 172.21.15.57:0/2367671077 shutdown_connections 2024-02-28T15:57:16.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.165+0000 7ff66c200700 1 -- 172.21.15.57:0/2367671077 wait complete. 2024-02-28T15:57:16.160 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:16 smithi057 ceph-mon[28763]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:16.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.166+0000 7ff66c200700 1 Processor -- start 2024-02-28T15:57:16.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.166+0000 7ff66c200700 1 -- start start 2024-02-28T15:57:16.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.166+0000 7ff66c200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff664101e40 0x7ff664113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:16.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.166+0000 7ff66c200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6641027e0 0x7ff664113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:16.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.166+0000 7ff66c200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6641145f0 con 0x7ff664101e40 2024-02-28T15:57:16.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.166+0000 7ff66c200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66410d920 con 0x7ff6641027e0 2024-02-28T15:57:16.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.167+0000 7ff669800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff664101e40 0x7ff664113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:16.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.167+0000 7ff669800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff664101e40 0x7ff664113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44988/0 (socket says 172.21.15.57:44988) 2024-02-28T15:57:16.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.167+0000 7ff669800700 1 -- 172.21.15.57:0/1564336442 learned_addr learned my addr 172.21.15.57:0/1564336442 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:16.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.167+0000 7ff669800700 1 -- 172.21.15.57:0/1564336442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6641027e0 msgr2=0x7ff664113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:16.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.167+0000 7ff669800700 1 --2- 172.21.15.57:0/1564336442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6641027e0 0x7ff664113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:16.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.167+0000 7ff669800700 1 -- 172.21.15.57:0/1564336442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff658005040 con 0x7ff664101e40 2024-02-28T15:57:16.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.167+0000 7ff669800700 1 --2- 172.21.15.57:0/1564336442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff664101e40 0x7ff664113a60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff658009150 tx=0x7ff658009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:16.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.168+0000 7ff661600700 1 -- 172.21.15.57:0/1564336442 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff65800e040 con 0x7ff664101e40 2024-02-28T15:57:16.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.168+0000 7ff66c200700 1 -- 172.21.15.57:0/1564336442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66410dba0 con 0x7ff664101e40 2024-02-28T15:57:16.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.168+0000 7ff661600700 1 -- 172.21.15.57:0/1564336442 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff65800bbf0 con 0x7ff664101e40 2024-02-28T15:57:16.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.168+0000 7ff661600700 1 -- 172.21.15.57:0/1564336442 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff65801c630 con 0x7ff664101e40 2024-02-28T15:57:16.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.168+0000 7ff66c200700 1 -- 172.21.15.57:0/1564336442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66410e0e0 con 0x7ff664101e40 2024-02-28T15:57:16.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.169+0000 7ff66c200700 1 -- 172.21.15.57:0/1564336442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6640738b0 con 0x7ff664101e40 2024-02-28T15:57:16.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.170+0000 7ff661600700 1 -- 172.21.15.57:0/1564336442 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7ff65800bd60 con 0x7ff664101e40 2024-02-28T15:57:16.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.171+0000 7ff661600700 1 --2- 172.21.15.57:0/1564336442 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff64c0692b0 0x7ff64c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:16.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.171+0000 7ff661600700 1 -- 172.21.15.57:0/1564336442 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff658088300 con 0x7ff664101e40 2024-02-28T15:57:16.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.172+0000 7ff668e00700 1 --2- 172.21.15.57:0/1564336442 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff64c0692b0 0x7ff64c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:16.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.172+0000 7ff668e00700 1 --2- 172.21.15.57:0/1564336442 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff64c0692b0 0x7ff64c06b760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff66410f290 tx=0x7ff650009ce0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:16.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.176+0000 7ff661600700 1 -- 172.21.15.57:0/1564336442 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff658058360 con 0x7ff664101e40 2024-02-28T15:57:16.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.395+0000 7ff66c200700 1 -- 172.21.15.57:0/1564336442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff66404bed0 con 0x7ff664101e40 2024-02-28T15:57:16.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.396+0000 7ff661600700 1 -- 172.21.15.57:0/1564336442 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff658057ef0 con 0x7ff664101e40 2024-02-28T15:57:16.390 INFO:teuthology.orchestra.run.smithi057.stdout:38654705712 2024-02-28T15:57:16.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 -- 172.21.15.57:0/1564336442 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff64c0692b0 msgr2=0x7ff64c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:16.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 --2- 172.21.15.57:0/1564336442 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff64c0692b0 0x7ff64c06b760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff66410f290 tx=0x7ff650009ce0 comp rx=0 tx=0).stop 2024-02-28T15:57:16.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 -- 172.21.15.57:0/1564336442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff664101e40 msgr2=0x7ff664113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:16.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 --2- 172.21.15.57:0/1564336442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff664101e40 0x7ff664113a60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff658009150 tx=0x7ff658009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:16.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 -- 172.21.15.57:0/1564336442 shutdown_connections 2024-02-28T15:57:16.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 --2- 172.21.15.57:0/1564336442 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff64c0692b0 0x7ff64c06b760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:16.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 --2- 172.21.15.57:0/1564336442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff664101e40 0x7ff664113a60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:16.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 --2- 172.21.15.57:0/1564336442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6641027e0 0x7ff664113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:16.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 -- 172.21.15.57:0/1564336442 >> 172.21.15.57:0/1564336442 conn(0x7ff664071d90 msgr2=0x7ff6641052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:16.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 -- 172.21.15.57:0/1564336442 shutdown_connections 2024-02-28T15:57:16.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:16.399+0000 7ff66c200700 1 -- 172.21.15.57:0/1564336442 wait complete. 2024-02-28T15:57:16.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:16 smithi087 ceph-mon[37122]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:17.391 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:17 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1564336442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-28T15:57:17.409 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:17.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:17 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1564336442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-28T15:57:17.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.262+0000 7f0732200700 1 -- 172.21.15.57:0/3540487720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f072c071f60 msgr2=0x7f072c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:17.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.262+0000 7f0732200700 1 --2- 172.21.15.57:0/3540487720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f072c071f60 0x7f072c070330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f071c004970 tx=0x7f071c009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:17.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.263+0000 7f0732200700 1 -- 172.21.15.57:0/3540487720 shutdown_connections 2024-02-28T15:57:17.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.263+0000 7f0732200700 1 --2- 172.21.15.57:0/3540487720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f072c070870 0x7f072c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:17.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.263+0000 7f0732200700 1 --2- 172.21.15.57:0/3540487720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f072c071f60 0x7f072c070330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:17.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.263+0000 7f0732200700 1 -- 172.21.15.57:0/3540487720 >> 172.21.15.57:0/3540487720 conn(0x7f072c0f8ae0 msgr2=0x7f072c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:17.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.263+0000 7f0732200700 1 -- 172.21.15.57:0/3540487720 shutdown_connections 2024-02-28T15:57:17.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.263+0000 7f0732200700 1 -- 172.21.15.57:0/3540487720 wait complete. 2024-02-28T15:57:17.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.264+0000 7f0732200700 1 Processor -- start 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.264+0000 7f0732200700 1 -- start start 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.264+0000 7f0732200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f072c070870 0x7f072c11a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.264+0000 7f0732200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f072c071f60 0x7f072c11a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.264+0000 7f0732200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c11abe0 con 0x7f072c070870 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.264+0000 7f0732200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c113ef0 con 0x7f072c071f60 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.264+0000 7f072b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f072c070870 0x7f072c11a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.265+0000 7f072b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f072c070870 0x7f072c11a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45010/0 (socket says 172.21.15.57:45010) 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.265+0000 7f072b400700 1 -- 172.21.15.57:0/1904706210 learned_addr learned my addr 172.21.15.57:0/1904706210 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.265+0000 7f0722a00700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f072c071f60 0x7f072c11a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.265+0000 7f072b400700 1 -- 172.21.15.57:0/1904706210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f072c071f60 msgr2=0x7f072c11a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.265+0000 7f072b400700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f072c071f60 0x7f072c11a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.265+0000 7f072b400700 1 -- 172.21.15.57:0/1904706210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c005040 con 0x7f072c070870 2024-02-28T15:57:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.265+0000 7f072b400700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f072c070870 0x7f072c11a050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f071c004f50 tx=0x7f071c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.265+0000 7f0723e00700 1 -- 172.21.15.57:0/1904706210 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071c00e040 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.266+0000 7f0723e00700 1 -- 172.21.15.57:0/1904706210 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f071c00bc10 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.266+0000 7f0732200700 1 -- 172.21.15.57:0/1904706210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c114170 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.266+0000 7f0723e00700 1 -- 172.21.15.57:0/1904706210 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071c01c630 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.266+0000 7f0732200700 1 -- 172.21.15.57:0/1904706210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c1146b0 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.267+0000 7f0732200700 1 -- 172.21.15.57:0/1904706210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c0fe400 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.268+0000 7f0723e00700 1 -- 172.21.15.57:0/1904706210 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f071c00bd80 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.269+0000 7f0723e00700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f070c0692b0 0x7f070c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.270+0000 7f0723e00700 1 -- 172.21.15.57:0/1904706210 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f071c0882a0 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.270+0000 7f0722a00700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f070c0692b0 0x7f070c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.270+0000 7f0722a00700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f070c0692b0 0x7f070c06b760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f072c1158f0 tx=0x7f071400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.275+0000 7f0723e00700 1 -- 172.21.15.57:0/1904706210 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f071c0583a0 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.492+0000 7f0732200700 1 -- 172.21.15.57:0/1904706210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f072c04bed0 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.493+0000 7f0723e00700 1 -- 172.21.15.57:0/1904706210 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f071c057f30 con 0x7f072c070870 2024-02-28T15:57:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 -- 172.21.15.57:0/1904706210 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f070c0692b0 msgr2=0x7f070c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:17.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f070c0692b0 0x7f070c06b760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f072c1158f0 tx=0x7f071400b040 comp rx=0 tx=0).stop 2024-02-28T15:57:17.544 INFO:teuthology.orchestra.run.smithi057.stdout:171798691853 2024-02-28T15:57:17.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 -- 172.21.15.57:0/1904706210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f072c070870 msgr2=0x7f072c11a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:17.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f072c070870 0x7f072c11a050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f071c004f50 tx=0x7f071c009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 -- 172.21.15.57:0/1904706210 shutdown_connections 2024-02-28T15:57:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f070c0692b0 0x7f070c06b760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f072c070870 0x7f072c11a050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 --2- 172.21.15.57:0/1904706210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f072c071f60 0x7f072c11a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 -- 172.21.15.57:0/1904706210 >> 172.21.15.57:0/1904706210 conn(0x7f072c0f8ae0 msgr2=0x7f072c0fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 -- 172.21.15.57:0/1904706210 shutdown_connections 2024-02-28T15:57:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:17.496+0000 7f0732200700 1 -- 172.21.15.57:0/1904706210 wait complete. 2024-02-28T15:57:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.297+0000 7fcaf1e00700 1 -- 172.21.15.57:0/428143041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec105240 msgr2=0x7fcaec105610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.297+0000 7fcaf1e00700 1 --2- 172.21.15.57:0/428143041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec105240 0x7fcaec105610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcadc004940 tx=0x7fcadc009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.297+0000 7fcaf1e00700 1 -- 172.21.15.57:0/428143041 shutdown_connections 2024-02-28T15:57:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.297+0000 7fcaf1e00700 1 --2- 172.21.15.57:0/428143041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec105be0 0x7fcaec0ff250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.297+0000 7fcaf1e00700 1 --2- 172.21.15.57:0/428143041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec105240 0x7fcaec105610 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.297+0000 7fcaf1e00700 1 -- 172.21.15.57:0/428143041 >> 172.21.15.57:0/428143041 conn(0x7fcaec0fadf0 msgr2=0x7fcaec0fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.297+0000 7fcaf1e00700 1 -- 172.21.15.57:0/428143041 shutdown_connections 2024-02-28T15:57:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.297+0000 7fcaf1e00700 1 -- 172.21.15.57:0/428143041 wait complete. 2024-02-28T15:57:18.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.298+0000 7fcaf1e00700 1 Processor -- start 2024-02-28T15:57:18.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.298+0000 7fcaf1e00700 1 -- start start 2024-02-28T15:57:18.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.298+0000 7fcaf1e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec105240 0x7fcaec115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:18.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.299+0000 7fcaf1e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec105be0 0x7fcaec116230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:18.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.299+0000 7fcaf1e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec116880 con 0x7fcaec105be0 2024-02-28T15:57:18.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.299+0000 7fcaf1e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec10fb90 con 0x7fcaec105240 2024-02-28T15:57:18.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.299+0000 7fcaea000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec105be0 0x7fcaec116230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:18.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.299+0000 7fcaea000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec105be0 0x7fcaec116230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45036/0 (socket says 172.21.15.57:45036) 2024-02-28T15:57:18.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.299+0000 7fcaea000700 1 -- 172.21.15.57:0/1326065005 learned_addr learned my addr 172.21.15.57:0/1326065005 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:18.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.299+0000 7fcaeaa00700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec105240 0x7fcaec115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:18.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.299+0000 7fcaea000700 1 -- 172.21.15.57:0/1326065005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec105240 msgr2=0x7fcaec115cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:18.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.299+0000 7fcaea000700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec105240 0x7fcaec115cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:18.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.299+0000 7fcaea000700 1 -- 172.21.15.57:0/1326065005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc005040 con 0x7fcaec105be0 2024-02-28T15:57:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.300+0000 7fcaea000700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec105be0 0x7fcaec116230 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c890 tx=0x7fcad80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.300+0000 7fcae2a00700 1 -- 172.21.15.57:0/1326065005 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcad800a7d0 con 0x7fcaec105be0 2024-02-28T15:57:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.300+0000 7fcae2a00700 1 -- 172.21.15.57:0/1326065005 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcad800ae00 con 0x7fcaec105be0 2024-02-28T15:57:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.300+0000 7fcaf1e00700 1 -- 172.21.15.57:0/1326065005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec10fe70 con 0x7fcaec105be0 2024-02-28T15:57:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.300+0000 7fcae2a00700 1 -- 172.21.15.57:0/1326065005 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcad80113a0 con 0x7fcaec105be0 2024-02-28T15:57:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.300+0000 7fcaf1e00700 1 -- 172.21.15.57:0/1326065005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec1103b0 con 0x7fcaec105be0 2024-02-28T15:57:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.301+0000 7fcaf1e00700 1 -- 172.21.15.57:0/1326065005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec102550 con 0x7fcaec105be0 2024-02-28T15:57:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.302+0000 7fcae2a00700 1 -- 172.21.15.57:0/1326065005 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fcad8012400 con 0x7fcaec105be0 2024-02-28T15:57:18.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.303+0000 7fcae2a00700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcad00692b0 0x7fcad006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:18.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.303+0000 7fcae2a00700 1 -- 172.21.15.57:0/1326065005 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcad8086f10 con 0x7fcaec105be0 2024-02-28T15:57:18.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.303+0000 7fcaeaa00700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcad00692b0 0x7fcad006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:18.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.304+0000 7fcaeaa00700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcad00692b0 0x7fcad006b760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00b020 tx=0x7fcadc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:18.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.308+0000 7fcae2a00700 1 -- 172.21.15.57:0/1326065005 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcad8056ff0 con 0x7fcaec105be0 2024-02-28T15:57:18.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:18 smithi057 ceph-mon[28763]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:18.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:18 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1904706210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-28T15:57:18.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:18 smithi087 ceph-mon[37122]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:18.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:18 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1904706210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-28T15:57:18.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.524+0000 7fcaf1e00700 1 -- 172.21.15.57:0/1326065005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcaec0fe9f0 con 0x7fcaec105be0 2024-02-28T15:57:18.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.525+0000 7fcae2a00700 1 -- 172.21.15.57:0/1326065005 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcad8056b80 con 0x7fcaec105be0 2024-02-28T15:57:18.519 INFO:teuthology.orchestra.run.smithi057.stdout:60129542185 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.527+0000 7fcaf1e00700 1 -- 172.21.15.57:0/1326065005 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcad00692b0 msgr2=0x7fcad006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.527+0000 7fcaf1e00700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcad00692b0 0x7fcad006b760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00b020 tx=0x7fcadc009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.527+0000 7fcaf1e00700 1 -- 172.21.15.57:0/1326065005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec105be0 msgr2=0x7fcaec116230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.527+0000 7fcaf1e00700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec105be0 0x7fcaec116230 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c890 tx=0x7fcad80044c0 comp rx=0 tx=0).stop 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.527+0000 7fcaf1e00700 1 -- 172.21.15.57:0/1326065005 shutdown_connections 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.527+0000 7fcaf1e00700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcad00692b0 0x7fcad006b760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.527+0000 7fcaf1e00700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec105240 0x7fcaec115cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.527+0000 7fcaf1e00700 1 --2- 172.21.15.57:0/1326065005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec105be0 0x7fcaec116230 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.527+0000 7fcaf1e00700 1 -- 172.21.15.57:0/1326065005 >> 172.21.15.57:0/1326065005 conn(0x7fcaec0fadf0 msgr2=0x7fcaec0fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.528+0000 7fcaf1e00700 1 -- 172.21.15.57:0/1326065005 shutdown_connections 2024-02-28T15:57:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:18.528+0000 7fcaf1e00700 1 -- 172.21.15.57:0/1326065005 wait complete. 2024-02-28T15:57:19.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:19 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1326065005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-28T15:57:19.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:19 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1326065005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-28T15:57:19.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.633+0000 7fcad6800700 1 -- 172.21.15.57:0/1151344449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad0070330 msgr2=0x7fcad0070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.633+0000 7fcad6800700 1 --2- 172.21.15.57:0/1151344449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad0070330 0x7fcad0070700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcac0004970 tx=0x7fcac0009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.633+0000 7fcad6800700 1 -- 172.21.15.57:0/1151344449 shutdown_connections 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.633+0000 7fcad6800700 1 --2- 172.21.15.57:0/1151344449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcad0070c40 0x7fcad0109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.633+0000 7fcad6800700 1 --2- 172.21.15.57:0/1151344449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad0070330 0x7fcad0070700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.633+0000 7fcad6800700 1 -- 172.21.15.57:0/1151344449 >> 172.21.15.57:0/1151344449 conn(0x7fcad00f8ae0 msgr2=0x7fcad00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.633+0000 7fcad6800700 1 -- 172.21.15.57:0/1151344449 shutdown_connections 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.633+0000 7fcad6800700 1 -- 172.21.15.57:0/1151344449 wait complete. 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.634+0000 7fcad6800700 1 Processor -- start 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.634+0000 7fcad6800700 1 -- start start 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.634+0000 7fcad6800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcad0070330 0x7fcad0115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.635+0000 7fcad6800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad0070c40 0x7fcad0116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.635+0000 7fcad6800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad01167b0 con 0x7fcad0070c40 2024-02-28T15:57:19.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.635+0000 7fcad6800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad010fae0 con 0x7fcad0070330 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.635+0000 7fcacea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad0070c40 0x7fcad0116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.635+0000 7fcacea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad0070c40 0x7fcad0116160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45058/0 (socket says 172.21.15.57:45058) 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.635+0000 7fcacea00700 1 -- 172.21.15.57:0/2310464316 learned_addr learned my addr 172.21.15.57:0/2310464316 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.635+0000 7fcacf400700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcad0070330 0x7fcad0115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.635+0000 7fcacea00700 1 -- 172.21.15.57:0/2310464316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcad0070330 msgr2=0x7fcad0115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.635+0000 7fcacea00700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcad0070330 0x7fcad0115c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.635+0000 7fcacea00700 1 -- 172.21.15.57:0/2310464316 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0005040 con 0x7fcad0070c40 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.636+0000 7fcacea00700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad0070c40 0x7fcad0116160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00c830 tx=0x7fcabc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.636+0000 7fcac7400700 1 -- 172.21.15.57:0/2310464316 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcabc00a760 con 0x7fcad0070c40 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.636+0000 7fcac7400700 1 -- 172.21.15.57:0/2310464316 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcabc00ad90 con 0x7fcad0070c40 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.636+0000 7fcac7400700 1 -- 172.21.15.57:0/2310464316 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcabc0113a0 con 0x7fcad0070c40 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.636+0000 7fcad6800700 1 -- 172.21.15.57:0/2310464316 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad010fdc0 con 0x7fcad0070c40 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.636+0000 7fcad6800700 1 -- 172.21.15.57:0/2310464316 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad0110300 con 0x7fcad0070c40 2024-02-28T15:57:19.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.637+0000 7fcad6800700 1 -- 172.21.15.57:0/2310464316 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad0106920 con 0x7fcad0070c40 2024-02-28T15:57:19.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.638+0000 7fcac7400700 1 -- 172.21.15.57:0/2310464316 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fcabc012400 con 0x7fcad0070c40 2024-02-28T15:57:19.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.639+0000 7fcac7400700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcab40692b0 0x7fcab406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:19.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.639+0000 7fcac7400700 1 -- 172.21.15.57:0/2310464316 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcabc086ec0 con 0x7fcad0070c40 2024-02-28T15:57:19.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.639+0000 7fcacf400700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcab40692b0 0x7fcab406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:19.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.640+0000 7fcacf400700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcab40692b0 0x7fcab406b760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009fd0 tx=0x7fcac0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:19.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.643+0000 7fcac7400700 1 -- 172.21.15.57:0/2310464316 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcabc056fa0 con 0x7fcad0070c40 2024-02-28T15:57:19.909 INFO:teuthology.orchestra.run.smithi057.stdout:115964117019 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.858+0000 7fcad6800700 1 -- 172.21.15.57:0/2310464316 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcad0111270 con 0x7fcad0070c40 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.859+0000 7fcac7400700 1 -- 172.21.15.57:0/2310464316 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcad0111270 con 0x7fcad0070c40 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 -- 172.21.15.57:0/2310464316 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcab40692b0 msgr2=0x7fcab406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcab40692b0 0x7fcab406b760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009fd0 tx=0x7fcac0009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 -- 172.21.15.57:0/2310464316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad0070c40 msgr2=0x7fcad0116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad0070c40 0x7fcad0116160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00c830 tx=0x7fcabc004470 comp rx=0 tx=0).stop 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 -- 172.21.15.57:0/2310464316 shutdown_connections 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcab40692b0 0x7fcab406b760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcad0070330 0x7fcad0115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 --2- 172.21.15.57:0/2310464316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcad0070c40 0x7fcad0116160 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 -- 172.21.15.57:0/2310464316 >> 172.21.15.57:0/2310464316 conn(0x7fcad00f8ae0 msgr2=0x7fcad0103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 -- 172.21.15.57:0/2310464316 shutdown_connections 2024-02-28T15:57:19.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:19.862+0000 7fcad6800700 1 -- 172.21.15.57:0/2310464316 wait complete. 2024-02-28T15:57:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:20 smithi057 ceph-mon[28763]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:20 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2310464316' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-28T15:57:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:20 smithi087 ceph-mon[37122]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:20 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2310464316' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-28T15:57:21.129 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542182 got 60129542185 for osd.1 2024-02-28T15:57:21.129 DEBUG:teuthology.parallel:result is None 2024-02-28T15:57:21.379 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:21 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1665819838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-28T15:57:21.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:21 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1665819838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-28T15:57:22.116 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705710 got 38654705712 for osd.0 2024-02-28T15:57:22.116 DEBUG:teuthology.parallel:result is None 2024-02-28T15:57:22.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.914+0000 7f7ad2400700 1 -- 172.21.15.57:0/112202302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7acc105170 msgr2=0x7f7acc105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:22.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.914+0000 7f7ad2400700 1 --2- 172.21.15.57:0/112202302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7acc105170 0x7f7acc105540 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7abc004940 tx=0x7f7abc009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:22.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.915+0000 7f7ad2400700 1 -- 172.21.15.57:0/112202302 shutdown_connections 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.915+0000 7f7ad2400700 1 --2- 172.21.15.57:0/112202302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7acc105b10 0x7f7acc0ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.915+0000 7f7ad2400700 1 --2- 172.21.15.57:0/112202302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7acc105170 0x7f7acc105540 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.915+0000 7f7ad2400700 1 -- 172.21.15.57:0/112202302 >> 172.21.15.57:0/112202302 conn(0x7f7acc0face0 msgr2=0x7f7acc0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.915+0000 7f7ad2400700 1 -- 172.21.15.57:0/112202302 shutdown_connections 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.915+0000 7f7ad2400700 1 -- 172.21.15.57:0/112202302 wait complete. 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.916+0000 7f7ad2400700 1 Processor -- start 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.916+0000 7f7ad2400700 1 -- start start 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.916+0000 7f7ad2400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7acc105170 0x7f7acc115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.916+0000 7f7ad2400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7acc105b10 0x7f7acc1161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.916+0000 7f7ad2400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc1168a0 con 0x7f7acc105b10 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.916+0000 7f7ad2400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc10fb40 con 0x7f7acc105170 2024-02-28T15:57:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.916+0000 7f7acaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7acc105b10 0x7f7acc1161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.916+0000 7f7acaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7acc105b10 0x7f7acc1161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45066/0 (socket says 172.21.15.57:45066) 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.916+0000 7f7acaa00700 1 -- 172.21.15.57:0/1665819838 learned_addr learned my addr 172.21.15.57:0/1665819838 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.917+0000 7f7acb400700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7acc105170 0x7f7acc115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.917+0000 7f7acaa00700 1 -- 172.21.15.57:0/1665819838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7acc105170 msgr2=0x7f7acc115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.917+0000 7f7acaa00700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7acc105170 0x7f7acc115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.917+0000 7f7acaa00700 1 -- 172.21.15.57:0/1665819838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc005040 con 0x7f7acc105b10 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.917+0000 7f7acb400700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7acc105170 0x7f7acc115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.917+0000 7f7acaa00700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7acc105b10 0x7f7acc1161c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800b790 tx=0x7f7ab8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.918+0000 7f7ac3400700 1 -- 172.21.15.57:0/1665819838 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ab800f6f0 con 0x7f7acc105b10 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.918+0000 7f7ac3400700 1 -- 172.21.15.57:0/1665819838 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ab800fd20 con 0x7f7acc105b10 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.918+0000 7f7ac3400700 1 -- 172.21.15.57:0/1665819838 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ab80103a0 con 0x7f7acc105b10 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.918+0000 7f7ad2400700 1 -- 172.21.15.57:0/1665819838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc10fe20 con 0x7f7acc105b10 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.918+0000 7f7ad2400700 1 -- 172.21.15.57:0/1665819838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc110360 con 0x7f7acc105b10 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.919+0000 7f7ad2400700 1 -- 172.21.15.57:0/1665819838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc0fe900 con 0x7f7acc105b10 2024-02-28T15:57:22.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.920+0000 7f7ac3400700 1 -- 172.21.15.57:0/1665819838 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f7ab8011400 con 0x7f7acc105b10 2024-02-28T15:57:22.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.921+0000 7f7ac3400700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f7ab00692b0 0x7f7ab006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:22.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.921+0000 7f7ac3400700 1 -- 172.21.15.57:0/1665819838 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7ab8086c40 con 0x7f7acc105b10 2024-02-28T15:57:22.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.921+0000 7f7acb400700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f7ab00692b0 0x7f7ab006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:22.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.922+0000 7f7acb400700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f7ab00692b0 0x7f7ab006b760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7abc000c00 tx=0x7f7abc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:22.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:20.927+0000 7f7ac3400700 1 -- 172.21.15.57:0/1665819838 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7ab8056d40 con 0x7f7acc105b10 2024-02-28T15:57:22.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.148+0000 7f7ad2400700 1 -- 172.21.15.57:0/1665819838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7acc1111f0 con 0x7f7acc105b10 2024-02-28T15:57:22.158 INFO:teuthology.orchestra.run.smithi057.stdout:150323855380 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.149+0000 7f7ac3400700 1 -- 172.21.15.57:0/1665819838 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ab80568d0 con 0x7f7acc105b10 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.151+0000 7f7ad2400700 1 -- 172.21.15.57:0/1665819838 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f7ab00692b0 msgr2=0x7f7ab006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.151+0000 7f7ad2400700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f7ab00692b0 0x7f7ab006b760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7abc000c00 tx=0x7f7abc009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.151+0000 7f7ad2400700 1 -- 172.21.15.57:0/1665819838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7acc105b10 msgr2=0x7f7acc1161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.151+0000 7f7ad2400700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7acc105b10 0x7f7acc1161c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800b790 tx=0x7f7ab8009220 comp rx=0 tx=0).stop 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.151+0000 7f7ad2400700 1 -- 172.21.15.57:0/1665819838 shutdown_connections 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.151+0000 7f7ad2400700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f7ab00692b0 0x7f7ab006b760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.151+0000 7f7ad2400700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7acc105170 0x7f7acc115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.151+0000 7f7ad2400700 1 --2- 172.21.15.57:0/1665819838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7acc105b10 0x7f7acc1161c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.151+0000 7f7ad2400700 1 -- 172.21.15.57:0/1665819838 >> 172.21.15.57:0/1665819838 conn(0x7f7acc0face0 msgr2=0x7f7acc0fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.152+0000 7f7ad2400700 1 -- 172.21.15.57:0/1665819838 shutdown_connections 2024-02-28T15:57:22.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:21.152+0000 7f7ad2400700 1 -- 172.21.15.57:0/1665819838 wait complete. 2024-02-28T15:57:22.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:57:22.477 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:22 smithi087 ceph-mon[37122]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:22.481 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:57:22.481 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:22 smithi057 ceph-mon[28763]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:22.992 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691851 got 171798691853 for osd.5 2024-02-28T15:57:22.992 DEBUG:teuthology.parallel:result is None 2024-02-28T15:57:23.675 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855378 got 150323855380 for osd.4 2024-02-28T15:57:23.675 DEBUG:teuthology.parallel:result is None 2024-02-28T15:57:23.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.451+0000 7f9f35000700 1 -- 172.21.15.57:0/2647188093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f30070330 msgr2=0x7f9f30070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:23.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.451+0000 7f9f35000700 1 --2- 172.21.15.57:0/2647188093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f30070330 0x7f9f30070700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009d10 tx=0x7f9f20004d10 comp rx=0 tx=0).stop 2024-02-28T15:57:23.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.451+0000 7f9f35000700 1 -- 172.21.15.57:0/2647188093 shutdown_connections 2024-02-28T15:57:23.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.451+0000 7f9f35000700 1 --2- 172.21.15.57:0/2647188093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f30070c40 0x7f9f30109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.451+0000 7f9f35000700 1 --2- 172.21.15.57:0/2647188093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f30070330 0x7f9f30070700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.451+0000 7f9f35000700 1 -- 172.21.15.57:0/2647188093 >> 172.21.15.57:0/2647188093 conn(0x7f9f300f8ae0 msgr2=0x7f9f300faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.451+0000 7f9f35000700 1 -- 172.21.15.57:0/2647188093 shutdown_connections 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.451+0000 7f9f35000700 1 -- 172.21.15.57:0/2647188093 wait complete. 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.452+0000 7f9f35000700 1 Processor -- start 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.452+0000 7f9f35000700 1 -- start start 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.452+0000 7f9f35000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f30070330 0x7f9f30115eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.452+0000 7f9f35000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f30070c40 0x7f9f301163f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.452+0000 7f9f35000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f30116a40 con 0x7f9f30070c40 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.452+0000 7f9f35000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3010fd50 con 0x7f9f30070330 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.453+0000 7f9f2d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f30070c40 0x7f9f301163f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.453+0000 7f9f2d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f30070c40 0x7f9f301163f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56494/0 (socket says 172.21.15.57:56494) 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.453+0000 7f9f2d400700 1 -- 172.21.15.57:0/1262807909 learned_addr learned my addr 172.21.15.57:0/1262807909 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.453+0000 7f9f2de00700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f30070330 0x7f9f30115eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.453+0000 7f9f2d400700 1 -- 172.21.15.57:0/1262807909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f30070330 msgr2=0x7f9f30115eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.453+0000 7f9f2d400700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f30070330 0x7f9f30115eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.453+0000 7f9f2d400700 1 -- 172.21.15.57:0/1262807909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f20009940 con 0x7f9f30070c40 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.453+0000 7f9f2d400700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f30070c40 0x7f9f301163f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c002a50 tx=0x7f9f1c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.454+0000 7f9f26000700 1 -- 172.21.15.57:0/1262807909 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f1c007cc0 con 0x7f9f30070c40 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.454+0000 7f9f26000700 1 -- 172.21.15.57:0/1262807909 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f1c00f040 con 0x7f9f30070c40 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.454+0000 7f9f35000700 1 -- 172.21.15.57:0/1262807909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f30110030 con 0x7f9f30070c40 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.454+0000 7f9f26000700 1 -- 172.21.15.57:0/1262807909 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f1c009640 con 0x7f9f30070c40 2024-02-28T15:57:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.454+0000 7f9f35000700 1 -- 172.21.15.57:0/1262807909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f30110570 con 0x7f9f30070c40 2024-02-28T15:57:23.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.455+0000 7f9f35000700 1 -- 172.21.15.57:0/1262807909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f30106920 con 0x7f9f30070c40 2024-02-28T15:57:23.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.456+0000 7f9f26000700 1 -- 172.21.15.57:0/1262807909 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f9f1c0097a0 con 0x7f9f30070c40 2024-02-28T15:57:23.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.457+0000 7f9f26000700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9f140692b0 0x7f9f1406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:23.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.457+0000 7f9f26000700 1 -- 172.21.15.57:0/1262807909 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9f1c086d20 con 0x7f9f30070c40 2024-02-28T15:57:23.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.457+0000 7f9f2de00700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9f140692b0 0x7f9f1406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:23.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.458+0000 7f9f2de00700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9f140692b0 0x7f9f1406b760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f20015040 tx=0x7f9f20004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:23.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.461+0000 7f9f26000700 1 -- 172.21.15.57:0/1262807909 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9f1c056d00 con 0x7f9f30070c40 2024-02-28T15:57:23.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.684+0000 7f9f35000700 1 -- 172.21.15.57:0/1262807909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9f300fc6e0 con 0x7f9f30070c40 2024-02-28T15:57:23.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.685+0000 7f9f26000700 1 -- 172.21.15.57:0/1262807909 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f1c056890 con 0x7f9f30070c40 2024-02-28T15:57:23.829 INFO:teuthology.orchestra.run.smithi057.stdout:81604378659 2024-02-28T15:57:23.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 -- 172.21.15.57:0/1262807909 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9f140692b0 msgr2=0x7f9f1406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:23.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9f140692b0 0x7f9f1406b760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f20015040 tx=0x7f9f20004d10 comp rx=0 tx=0).stop 2024-02-28T15:57:23.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 -- 172.21.15.57:0/1262807909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f30070c40 msgr2=0x7f9f301163f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:23.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f30070c40 0x7f9f301163f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c002a50 tx=0x7f9f1c0046b0 comp rx=0 tx=0).stop 2024-02-28T15:57:23.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 -- 172.21.15.57:0/1262807909 shutdown_connections 2024-02-28T15:57:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9f140692b0 0x7f9f1406b760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f30070330 0x7f9f30115eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 --2- 172.21.15.57:0/1262807909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f30070c40 0x7f9f301163f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 -- 172.21.15.57:0/1262807909 >> 172.21.15.57:0/1262807909 conn(0x7f9f300f8ae0 msgr2=0x7f9f30103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 -- 172.21.15.57:0/1262807909 shutdown_connections 2024-02-28T15:57:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:23.688+0000 7f9f35000700 1 -- 172.21.15.57:0/1262807909 wait complete. 2024-02-28T15:57:24.496 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:24 smithi057 ceph-mon[28763]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:24.496 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:24 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1262807909' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-28T15:57:24.556 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117018 got 115964117019 for osd.3 2024-02-28T15:57:24.556 DEBUG:teuthology.parallel:result is None 2024-02-28T15:57:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:24 smithi087 ceph-mon[37122]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:24 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1262807909' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-28T15:57:25.001 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378657 got 81604378659 for osd.2 2024-02-28T15:57:25.001 DEBUG:teuthology.parallel:result is None 2024-02-28T15:57:25.001 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-28T15:57:25.001 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph pg dump --format=json 2024-02-28T15:57:25.507 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:26.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:26 smithi057 ceph-mon[28763]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:26.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:26 smithi087 ceph-mon[37122]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.678+0000 7fecb1200700 1 -- 172.21.15.57:0/2506000975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecac1038f0 msgr2=0x7fecac0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.678+0000 7fecb1200700 1 --2- 172.21.15.57:0/2506000975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecac1038f0 0x7fecac0fcf60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fec94004940 tx=0x7fec94009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.678+0000 7fecb1200700 1 -- 172.21.15.57:0/2506000975 shutdown_connections 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.678+0000 7fecb1200700 1 --2- 172.21.15.57:0/2506000975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecac1038f0 0x7fecac0fcf60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.678+0000 7fecb1200700 1 --2- 172.21.15.57:0/2506000975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecac102f50 0x7fecac103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.678+0000 7fecb1200700 1 -- 172.21.15.57:0/2506000975 >> 172.21.15.57:0/2506000975 conn(0x7fecac0f8ae0 msgr2=0x7fecac0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.678+0000 7fecb1200700 1 -- 172.21.15.57:0/2506000975 shutdown_connections 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.678+0000 7fecb1200700 1 -- 172.21.15.57:0/2506000975 wait complete. 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.679+0000 7fecb1200700 1 Processor -- start 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.679+0000 7fecb1200700 1 -- start start 2024-02-28T15:57:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.680+0000 7fecb1200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecac102f50 0x7fecac115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:27.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.680+0000 7fecb1200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecac1038f0 0x7fecac1161e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:27.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.680+0000 7fecb1200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac116830 con 0x7fecac102f50 2024-02-28T15:57:27.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.680+0000 7fecb1200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac10fb40 con 0x7fecac1038f0 2024-02-28T15:57:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.680+0000 7feca9e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecac102f50 0x7fecac115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.680+0000 7feca9e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecac102f50 0x7fecac115ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56510/0 (socket says 172.21.15.57:56510) 2024-02-28T15:57:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.680+0000 7feca9e00700 1 -- 172.21.15.57:0/1245302557 learned_addr learned my addr 172.21.15.57:0/1245302557 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.681+0000 7feca3e00700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecac1038f0 0x7fecac1161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.681+0000 7feca9e00700 1 -- 172.21.15.57:0/1245302557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecac1038f0 msgr2=0x7fecac1161e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.681+0000 7feca9e00700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecac1038f0 0x7fecac1161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.681+0000 7feca9e00700 1 -- 172.21.15.57:0/1245302557 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec94005040 con 0x7fecac102f50 2024-02-28T15:57:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.681+0000 7feca9e00700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecac102f50 0x7fecac115ca0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c830 tx=0x7fec9c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.681+0000 7feca2000700 1 -- 172.21.15.57:0/1245302557 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec9c00a760 con 0x7fecac102f50 2024-02-28T15:57:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.681+0000 7feca2000700 1 -- 172.21.15.57:0/1245302557 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec9c00ad90 con 0x7fecac102f50 2024-02-28T15:57:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.681+0000 7fecb1200700 1 -- 172.21.15.57:0/1245302557 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac10fe20 con 0x7fecac102f50 2024-02-28T15:57:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.681+0000 7feca2000700 1 -- 172.21.15.57:0/1245302557 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec9c0113a0 con 0x7fecac102f50 2024-02-28T15:57:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.681+0000 7fecb1200700 1 -- 172.21.15.57:0/1245302557 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecac110360 con 0x7fecac102f50 2024-02-28T15:57:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.683+0000 7fecb1200700 1 -- 172.21.15.57:0/1245302557 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecac0fc6e0 con 0x7fecac102f50 2024-02-28T15:57:27.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.683+0000 7feca2000700 1 -- 172.21.15.57:0/1245302557 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fec9c012400 con 0x7fecac102f50 2024-02-28T15:57:27.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.684+0000 7feca2000700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fec900692a0 0x7fec9006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:27.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.684+0000 7feca2000700 1 -- 172.21.15.57:0/1245302557 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fec9c086f90 con 0x7fecac102f50 2024-02-28T15:57:27.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.685+0000 7feca3e00700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fec900692a0 0x7fec9006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:27.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.685+0000 7feca3e00700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fec900692a0 0x7fec9006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec94009fd0 tx=0x7fec94009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:27.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.690+0000 7feca2000700 1 -- 172.21.15.57:0/1245302557 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fec9c056ff0 con 0x7fecac102f50 2024-02-28T15:57:27.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.898+0000 7fecb1200700 1 -- 172.21.15.57:0/1245302557 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fecac1112f0 con 0x7fec900692a0 2024-02-28T15:57:27.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.901+0000 7feca2000700 1 -- 172.21.15.57:0/1245302557 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27027 (secure 0 0 0) 0x7fecac1112f0 con 0x7fec900692a0 2024-02-28T15:57:27.895 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.904+0000 7fecb1200700 1 -- 172.21.15.57:0/1245302557 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fec900692a0 msgr2=0x7fec9006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.904+0000 7fecb1200700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fec900692a0 0x7fec9006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec94009fd0 tx=0x7fec94009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.904+0000 7fecb1200700 1 -- 172.21.15.57:0/1245302557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecac102f50 msgr2=0x7fecac115ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.904+0000 7fecb1200700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecac102f50 0x7fecac115ca0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c830 tx=0x7fec9c004470 comp rx=0 tx=0).stop 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.904+0000 7fecb1200700 1 -- 172.21.15.57:0/1245302557 shutdown_connections 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.904+0000 7fecb1200700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fec900692a0 0x7fec9006b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.904+0000 7fecb1200700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecac102f50 0x7fecac115ca0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.904+0000 7fecb1200700 1 --2- 172.21.15.57:0/1245302557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecac1038f0 0x7fecac1161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.904+0000 7fecb1200700 1 -- 172.21.15.57:0/1245302557 >> 172.21.15.57:0/1245302557 conn(0x7fecac0f8ae0 msgr2=0x7fecac0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.905+0000 7fecb1200700 1 -- 172.21.15.57:0/1245302557 shutdown_connections 2024-02-28T15:57:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:27.905+0000 7fecb1200700 1 -- 172.21.15.57:0/1245302557 wait complete. 2024-02-28T15:57:27.899 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-02-28T15:57:28.603 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:28 smithi057 ceph-mon[28763]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:28.681 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-02-28T15:57:27.303994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787652,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683260,"statfs":{"total":575970213888,"available":574139658240,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003122"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-28T15:56:28.109188+0000","last_change":"2024-02-28T15:55:52.373184+0000","last_active":"2024-02-28T15:56:28.109188+0000","last_peered":"2024-02-28T15:56:28.109188+0000","last_clean":"2024-02-28T15:56:28.109188+0000","last_became_active":"2024-02-28T15:55:52.372375+0000","last_became_peered":"2024-02-28T15:55:52.372375+0000","last_unstale":"2024-02-28T15:56:28.109188+0000","last_undegraded":"2024-02-28T15:56:28.109188+0000","last_fullsized":"2024-02-28T15:56:28.109188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-28T15:54:46.035129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-28T15:54:46.035129+0000","last_clean_scrub_stamp":"2024-02-28T15:54:46.035129+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-29T21:56:49.337045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855381,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 15:56:57 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0980000000000001}]},{"osd":1,"last update":"Wed Feb 28 15:56:57 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.89400000000000002}]},{"osd":2,"last update":"Wed Feb 28 15:56:57 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.133},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.2410000000000001}]},{"osd":3,"last update":"Wed Feb 28 15:56:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]}]},{"osd":3,"up_from":27,"seq":115964117021,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 15:57:18 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2549999999999999,"5min":1.353,"15min":1.353},"last":1.071}]},{"osd":1,"last update":"Wed Feb 28 15:57:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.02,"15min":1.024},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Wed Feb 28 15:57:18 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.95899999999999996,"15min":0.93899999999999995},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.087,"15min":1.0880000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3919999999999999,"5min":1.429,"15min":1.429},"last":0.96799999999999997}]},{"osd":4,"last update":"Wed Feb 28 15:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.52},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378660,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 15:56:45 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80700000000000005,"15min":0.80500000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.008},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.90000000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Feb 28 15:56:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.97499999999999998,"15min":0.97999999999999998},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.6200000000000001,"5min":1.865,"15min":1.865},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.04,"15min":1.038},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6859999999999999,"5min":1.839,"15min":1.839},"last":1.095}]},{"osd":3,"last update":"Wed Feb 28 15:57:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.389},{"interface":"front","average":{"1min":1.115,"5min":1.1579999999999999,"15min":1.165},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.431,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.93600000000000005}]},{"osd":4,"last update":"Wed Feb 28 15:56:53 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.5780000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.704}]}]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 28 15:57:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.80900000000000005,"15min":0.78100000000000003},"min":{"1min":0.51100000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.046,"5min":0.88700000000000001,"15min":0.84299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.94299999999999995}]},{"osd":2,"last update":"Wed Feb 28 15:56:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94599999999999995,"15min":0.94799999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.25,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.745},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.026,"15min":1.02},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.0820000000000001}]},{"osd":3,"last update":"Wed Feb 28 15:57:19 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.236,"15min":1.234},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1839999999999999,"15min":1.1819999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.86399999999999999}]},{"osd":4,"last update":"Wed Feb 28 15:56:54 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":1.204},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":6.6609999999999996,"5min":6.6609999999999996,"15min":6.6609999999999996},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 15:57:12 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.82899999999999996,"15min":0.79300000000000004},"min":{"1min":0.56100000000000005,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.1400000000000001,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.86199999999999999,"15min":0.82499999999999996},"min":{"1min":0.50900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.6479999999999999,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.98999999999999999}]},{"osd":2,"last update":"Wed Feb 28 15:56:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.90500000000000003,"15min":0.878},"min":{"1min":0.753,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.071},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.004,"15min":0.98699999999999999},"min":{"1min":0.83599999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.266}]},{"osd":3,"last update":"Wed Feb 28 15:57:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.05,"15min":1.046},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.202,"15min":1.1899999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.214}]},{"osd":4,"last update":"Wed Feb 28 15:56:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.2989999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-28T15:57:28.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph pg dump --format=json 2024-02-28T15:57:28.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:28 smithi087 ceph-mon[37122]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:29.192 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:29.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:29 smithi057 ceph-mon[28763]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T15:57:29.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:29 smithi087 ceph-mon[37122]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T15:57:30.577 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:30 smithi057 ceph-mon[28763]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:30.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:30 smithi087 ceph-mon[37122]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.402+0000 7f9955800700 1 -- 172.21.15.57:0/419093958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99500fdfe0 msgr2=0x7f99500fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.402+0000 7f9955800700 1 --2- 172.21.15.57:0/419093958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99500fdfe0 0x7f99500fe3b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9940004970 tx=0x7f9940009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.403+0000 7f9955800700 1 -- 172.21.15.57:0/419093958 shutdown_connections 2024-02-28T15:57:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.403+0000 7f9955800700 1 --2- 172.21.15.57:0/419093958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99500fe8f0 0x7f9950107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.403+0000 7f9955800700 1 --2- 172.21.15.57:0/419093958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99500fdfe0 0x7f99500fe3b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.403+0000 7f9955800700 1 -- 172.21.15.57:0/419093958 >> 172.21.15.57:0/419093958 conn(0x7f9950071d90 msgr2=0x7f9950072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.403+0000 7f9955800700 1 -- 172.21.15.57:0/419093958 shutdown_connections 2024-02-28T15:57:31.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.404+0000 7f9955800700 1 -- 172.21.15.57:0/419093958 wait complete. 2024-02-28T15:57:31.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.405+0000 7f9955800700 1 Processor -- start 2024-02-28T15:57:31.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.405+0000 7f9955800700 1 -- start start 2024-02-28T15:57:31.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.405+0000 7f9955800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99500fdfe0 0x7f99500fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:31.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.405+0000 7f9955800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99500fe8f0 0x7f99500fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:31.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.405+0000 7f9955800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500fc9e0 con 0x7f99500fe8f0 2024-02-28T15:57:31.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.405+0000 7f9955800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500fcb50 con 0x7f99500fdfe0 2024-02-28T15:57:31.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.406+0000 7f994e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99500fe8f0 0x7f99500fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:31.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.406+0000 7f994e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99500fe8f0 0x7f99500fc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56518/0 (socket says 172.21.15.57:56518) 2024-02-28T15:57:31.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.406+0000 7f994e000700 1 -- 172.21.15.57:0/733822090 learned_addr learned my addr 172.21.15.57:0/733822090 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:31.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.406+0000 7f994ea00700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99500fdfe0 0x7f99500fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:31.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.406+0000 7f994e000700 1 -- 172.21.15.57:0/733822090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99500fdfe0 msgr2=0x7f99500fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:31.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.406+0000 7f994e000700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99500fdfe0 0x7f99500fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:31.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.406+0000 7f994e000700 1 -- 172.21.15.57:0/733822090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940005040 con 0x7f99500fe8f0 2024-02-28T15:57:31.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.407+0000 7f994e000700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99500fe8f0 0x7f99500fc3e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f993c002a50 tx=0x7f993c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:31.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.407+0000 7f9946a00700 1 -- 172.21.15.57:0/733822090 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f993c007cc0 con 0x7f99500fe8f0 2024-02-28T15:57:31.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.407+0000 7f9946a00700 1 -- 172.21.15.57:0/733822090 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f993c00f040 con 0x7f99500fe8f0 2024-02-28T15:57:31.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.407+0000 7f9955800700 1 -- 172.21.15.57:0/733822090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9950119c90 con 0x7f99500fe8f0 2024-02-28T15:57:31.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.407+0000 7f9946a00700 1 -- 172.21.15.57:0/733822090 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f993c00da30 con 0x7f99500fe8f0 2024-02-28T15:57:31.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.407+0000 7f9955800700 1 -- 172.21.15.57:0/733822090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995011a170 con 0x7f99500fe8f0 2024-02-28T15:57:31.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.409+0000 7f9955800700 1 -- 172.21.15.57:0/733822090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99501046c0 con 0x7f99500fe8f0 2024-02-28T15:57:31.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.409+0000 7f9946a00700 1 -- 172.21.15.57:0/733822090 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f993c00db90 con 0x7f99500fe8f0 2024-02-28T15:57:31.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.410+0000 7f9946a00700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f99340692a0 0x7f993406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:31.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.410+0000 7f9946a00700 1 -- 172.21.15.57:0/733822090 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f993c086bc0 con 0x7f99500fe8f0 2024-02-28T15:57:31.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.411+0000 7f994ea00700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f99340692a0 0x7f993406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:31.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.411+0000 7f994ea00700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f99340692a0 0x7f993406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9940000c00 tx=0x7f9940009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:31.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.415+0000 7f9946a00700 1 -- 172.21.15.57:0/733822090 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f993c053190 con 0x7f99500fe8f0 2024-02-28T15:57:31.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.625+0000 7f9955800700 1 -- 172.21.15.57:0/733822090 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99500fd5e0 con 0x7f99340692a0 2024-02-28T15:57:31.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.628+0000 7f9946a00700 1 -- 172.21.15.57:0/733822090 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27025 (secure 0 0 0) 0x7f99500fd5e0 con 0x7f99340692a0 2024-02-28T15:57:31.621 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:57:31.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.630+0000 7f9955800700 1 -- 172.21.15.57:0/733822090 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f99340692a0 msgr2=0x7f993406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:31.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.630+0000 7f9955800700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f99340692a0 0x7f993406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9940000c00 tx=0x7f9940009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:31.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.630+0000 7f9955800700 1 -- 172.21.15.57:0/733822090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99500fe8f0 msgr2=0x7f99500fc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:31.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.630+0000 7f9955800700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99500fe8f0 0x7f99500fc3e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f993c002a50 tx=0x7f993c0046b0 comp rx=0 tx=0).stop 2024-02-28T15:57:31.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.631+0000 7f9955800700 1 -- 172.21.15.57:0/733822090 shutdown_connections 2024-02-28T15:57:31.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.631+0000 7f9955800700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f99340692a0 0x7f993406b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:31.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.631+0000 7f9955800700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99500fdfe0 0x7f99500fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:31.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.631+0000 7f9955800700 1 --2- 172.21.15.57:0/733822090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99500fe8f0 0x7f99500fc3e0 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f993c002a50 tx=0x7f993c0046b0 comp rx=0 tx=0).stop 2024-02-28T15:57:31.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.631+0000 7f9955800700 1 -- 172.21.15.57:0/733822090 >> 172.21.15.57:0/733822090 conn(0x7f9950071d90 msgr2=0x7f9950101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:31.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.631+0000 7f9955800700 1 -- 172.21.15.57:0/733822090 shutdown_connections 2024-02-28T15:57:31.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:31.631+0000 7f9955800700 1 -- 172.21.15.57:0/733822090 wait complete. 2024-02-28T15:57:31.625 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-02-28T15:57:32.385 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-02-28T15:57:31.305024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787652,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683260,"statfs":{"total":575970213888,"available":574139658240,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003286"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-28T15:56:28.109188+0000","last_change":"2024-02-28T15:55:52.373184+0000","last_active":"2024-02-28T15:56:28.109188+0000","last_peered":"2024-02-28T15:56:28.109188+0000","last_clean":"2024-02-28T15:56:28.109188+0000","last_became_active":"2024-02-28T15:55:52.372375+0000","last_became_peered":"2024-02-28T15:55:52.372375+0000","last_unstale":"2024-02-28T15:56:28.109188+0000","last_undegraded":"2024-02-28T15:56:28.109188+0000","last_fullsized":"2024-02-28T15:56:28.109188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-28T15:54:46.035129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-28T15:54:46.035129+0000","last_clean_scrub_stamp":"2024-02-28T15:54:46.035129+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-29T21:56:49.337045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691856,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 15:56:57 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.179}]},{"osd":1,"last update":"Wed Feb 28 15:56:57 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.087}]},{"osd":2,"last update":"Wed Feb 28 15:56:57 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.3859999999999999}]},{"osd":3,"last update":"Wed Feb 28 15:56:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.222}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 15:57:18 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2549999999999999,"5min":1.353,"15min":1.353},"last":1.0840000000000001}]},{"osd":1,"last update":"Wed Feb 28 15:57:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.02,"15min":1.024},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.3080000000000001}]},{"osd":2,"last update":"Wed Feb 28 15:57:18 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.95899999999999996,"15min":0.93899999999999995},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.087,"15min":1.0880000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3919999999999999,"5min":1.429,"15min":1.429},"last":1.2709999999999999}]},{"osd":4,"last update":"Wed Feb 28 15:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]}]},{"osd":2,"up_from":19,"seq":81604378661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 15:56:45 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80700000000000005,"15min":0.80500000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.081},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.90000000000000002,"15min":0.88600000000000001},"min":{"1min":0.627,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.97199999999999998}]},{"osd":1,"last update":"Wed Feb 28 15:56:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.97499999999999998,"15min":0.97999999999999998},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.6200000000000001,"5min":1.865,"15min":1.865},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.05,"5min":1.04,"15min":1.038},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6859999999999999,"5min":1.839,"15min":1.839},"last":1.514}]},{"osd":3,"last update":"Wed Feb 28 15:57:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.226},{"interface":"front","average":{"1min":1.115,"5min":1.1579999999999999,"15min":1.165},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.431,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.3009999999999999}]},{"osd":4,"last update":"Wed Feb 28 15:56:53 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.365}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5900000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 28 15:57:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.80900000000000005,"15min":0.78100000000000003},"min":{"1min":0.51100000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.046,"5min":0.88700000000000001,"15min":0.84299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Feb 28 15:56:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94599999999999995,"15min":0.94799999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.25,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.026,"15min":1.02},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.98399999999999999}]},{"osd":3,"last update":"Wed Feb 28 15:57:19 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.236,"15min":1.234},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1839999999999999,"15min":1.1819999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.873}]},{"osd":4,"last update":"Wed Feb 28 15:56:54 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":6.6609999999999996,"5min":6.6609999999999996,"15min":6.6609999999999996},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 15:57:12 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.82899999999999996,"15min":0.79300000000000004},"min":{"1min":0.56100000000000005,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.1400000000000001,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.86199999999999999,"15min":0.82499999999999996},"min":{"1min":0.50900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.6479999999999999,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.98999999999999999}]},{"osd":2,"last update":"Wed Feb 28 15:56:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.90500000000000003,"15min":0.878},"min":{"1min":0.753,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.071},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.004,"15min":0.98699999999999999},"min":{"1min":0.83599999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.266}]},{"osd":3,"last update":"Wed Feb 28 15:57:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.05,"15min":1.046},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.202,"15min":1.1899999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.214}]},{"osd":4,"last update":"Wed Feb 28 15:56:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.2989999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-28T15:57:32.386 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-28T15:57:32.386 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-28T15:57:32.386 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-28T15:57:32.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph health --format=json 2024-02-28T15:57:32.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:32 smithi057 ceph-mon[28763]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:32.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:32 smithi057 ceph-mon[28763]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T15:57:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:32 smithi087 ceph-mon[37122]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:32 smithi087 ceph-mon[37122]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T15:57:32.854 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:34.666 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:34 smithi057 ceph-mon[28763]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:34.666 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:34 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:57:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:34 smithi087 ceph-mon[37122]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:34 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:57:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.008+0000 7fe40c600700 1 -- 172.21.15.57:0/1149368054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040702d0 msgr2=0x7fe4040706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.008+0000 7fe40c600700 1 --2- 172.21.15.57:0/1149368054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040702d0 0x7fe4040706a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8004970 tx=0x7fe3f8009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.008+0000 7fe40c600700 1 -- 172.21.15.57:0/1149368054 shutdown_connections 2024-02-28T15:57:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.008+0000 7fe40c600700 1 --2- 172.21.15.57:0/1149368054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe404070be0 0x7fe4041092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.008+0000 7fe40c600700 1 --2- 172.21.15.57:0/1149368054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040702d0 0x7fe4040706a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.008+0000 7fe40c600700 1 -- 172.21.15.57:0/1149368054 >> 172.21.15.57:0/1149368054 conn(0x7fe4040f8ae0 msgr2=0x7fe4040faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:35.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.008+0000 7fe40c600700 1 -- 172.21.15.57:0/1149368054 shutdown_connections 2024-02-28T15:57:35.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.008+0000 7fe40c600700 1 -- 172.21.15.57:0/1149368054 wait complete. 2024-02-28T15:57:35.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.009+0000 7fe40c600700 1 Processor -- start 2024-02-28T15:57:35.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.009+0000 7fe40c600700 1 -- start start 2024-02-28T15:57:35.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.010+0000 7fe40c600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040702d0 0x7fe404115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:35.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.010+0000 7fe40c600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe404070be0 0x7fe404116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:35.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.010+0000 7fe40c600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4041167b0 con 0x7fe4040702d0 2024-02-28T15:57:35.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.010+0000 7fe40c600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40410fae0 con 0x7fe404070be0 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.010+0000 7fe409c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040702d0 0x7fe404115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.010+0000 7fe409c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040702d0 0x7fe404115c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58324/0 (socket says 172.21.15.57:58324) 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.010+0000 7fe409c00700 1 -- 172.21.15.57:0/2640795907 learned_addr learned my addr 172.21.15.57:0/2640795907 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.010+0000 7fe409200700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe404070be0 0x7fe404116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.010+0000 7fe409c00700 1 -- 172.21.15.57:0/2640795907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe404070be0 msgr2=0x7fe404116160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.010+0000 7fe409c00700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe404070be0 0x7fe404116160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.011+0000 7fe409c00700 1 -- 172.21.15.57:0/2640795907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8005040 con 0x7fe4040702d0 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.011+0000 7fe409200700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe404070be0 0x7fe404116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.011+0000 7fe409c00700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040702d0 0x7fe404115c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009150 tx=0x7fe3f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.011+0000 7fe401600700 1 -- 172.21.15.57:0/2640795907 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3f800e040 con 0x7fe4040702d0 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.011+0000 7fe401600700 1 -- 172.21.15.57:0/2640795907 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3f8004290 con 0x7fe4040702d0 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.011+0000 7fe401600700 1 -- 172.21.15.57:0/2640795907 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3f801c630 con 0x7fe4040702d0 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.011+0000 7fe40c600700 1 -- 172.21.15.57:0/2640795907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40410fd60 con 0x7fe4040702d0 2024-02-28T15:57:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.011+0000 7fe40c600700 1 -- 172.21.15.57:0/2640795907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe404110250 con 0x7fe4040702d0 2024-02-28T15:57:35.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.013+0000 7fe40c600700 1 -- 172.21.15.57:0/2640795907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe404106980 con 0x7fe4040702d0 2024-02-28T15:57:35.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.013+0000 7fe401600700 1 -- 172.21.15.57:0/2640795907 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe3f8013980 con 0x7fe4040702d0 2024-02-28T15:57:35.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.014+0000 7fe401600700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3ec0692b0 0x7fe3ec06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:35.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.014+0000 7fe401600700 1 -- 172.21.15.57:0/2640795907 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe3f8088250 con 0x7fe4040702d0 2024-02-28T15:57:35.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.015+0000 7fe409200700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3ec0692b0 0x7fe3ec06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:35.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.015+0000 7fe409200700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3ec0692b0 0x7fe3ec06b760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009fd0 tx=0x7fe3f0009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:35.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.019+0000 7fe401600700 1 -- 172.21.15.57:0/2640795907 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe3f80582b0 con 0x7fe4040702d0 2024-02-28T15:57:35.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.282+0000 7fe40c600700 1 -- 172.21.15.57:0/2640795907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe40404bed0 con 0x7fe4040702d0 2024-02-28T15:57:35.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.282+0000 7fe401600700 1 -- 172.21.15.57:0/2640795907 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe3f8057e40 con 0x7fe4040702d0 2024-02-28T15:57:35.275 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:57:35.276 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-28T15:57:35.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 -- 172.21.15.57:0/2640795907 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3ec0692b0 msgr2=0x7fe3ec06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:35.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3ec0692b0 0x7fe3ec06b760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009fd0 tx=0x7fe3f0009ee0 comp rx=0 tx=0).stop 2024-02-28T15:57:35.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 -- 172.21.15.57:0/2640795907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040702d0 msgr2=0x7fe404115c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:35.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040702d0 0x7fe404115c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009150 tx=0x7fe3f8009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:35.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 -- 172.21.15.57:0/2640795907 shutdown_connections 2024-02-28T15:57:35.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe3ec0692b0 0x7fe3ec06b760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:35.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040702d0 0x7fe404115c20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:35.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 --2- 172.21.15.57:0/2640795907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe404070be0 0x7fe404116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:35.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 -- 172.21.15.57:0/2640795907 >> 172.21.15.57:0/2640795907 conn(0x7fe4040f8ae0 msgr2=0x7fe404103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:35.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 -- 172.21.15.57:0/2640795907 shutdown_connections 2024-02-28T15:57:35.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:35.285+0000 7fe40c600700 1 -- 172.21.15.57:0/2640795907 wait complete. 2024-02-28T15:57:36.130 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-28T15:57:36.130 INFO:tasks.cephadm:Setup complete, yielding 2024-02-28T15:57:36.131 INFO:teuthology.run_tasks:Running task print... 2024-02-28T15:57:36.140 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-02-28T15:57:36.140 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T15:57:36.156 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:57:36.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-28T15:57:36.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:57:36.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:57:36.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:57:36.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:36 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2640795907' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-28T15:57:36.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:36 smithi057 ceph-mon[28763]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:36.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:57:36.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:57:36.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:57:36.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:36 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2640795907' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-28T15:57:36.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:36 smithi087 ceph-mon[37122]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:36.667 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:37.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:57:37.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:57:38.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:38 smithi087 ceph-mon[37122]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:38.519 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:38 smithi057 ceph-mon[28763]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:38.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.703+0000 7f96f9200700 1 -- 172.21.15.57:0/3584889279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f4103540 msgr2=0x7f96f4103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:38.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.703+0000 7f96f9200700 1 --2- 172.21.15.57:0/3584889279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f4103540 0x7f96f4103950 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f96e4004940 tx=0x7f96e4009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:38.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.703+0000 7f96f9200700 1 -- 172.21.15.57:0/3584889279 shutdown_connections 2024-02-28T15:57:38.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.703+0000 7f96f9200700 1 --2- 172.21.15.57:0/3584889279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f4104750 0x7f96f4104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:38.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.703+0000 7f96f9200700 1 --2- 172.21.15.57:0/3584889279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f4103540 0x7f96f4103950 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:38.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.703+0000 7f96f9200700 1 -- 172.21.15.57:0/3584889279 >> 172.21.15.57:0/3584889279 conn(0x7f96f40727d0 msgr2=0x7f96f4074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:38.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.703+0000 7f96f9200700 1 -- 172.21.15.57:0/3584889279 shutdown_connections 2024-02-28T15:57:38.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.703+0000 7f96f9200700 1 -- 172.21.15.57:0/3584889279 wait complete. 2024-02-28T15:57:38.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.704+0000 7f96f9200700 1 Processor -- start 2024-02-28T15:57:38.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.704+0000 7f96f9200700 1 -- start start 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.704+0000 7f96f9200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f4103540 0x7f96f4113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.704+0000 7f96f9200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f4104750 0x7f96f41144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.704+0000 7f96f9200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4114aa0 con 0x7f96f4104750 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.705+0000 7f96f9200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4115340 con 0x7f96f4103540 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.705+0000 7f96ebe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f4104750 0x7f96f41144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.705+0000 7f96ebe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f4104750 0x7f96f41144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58352/0 (socket says 172.21.15.57:58352) 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.705+0000 7f96ebe00700 1 -- 172.21.15.57:0/3157368322 learned_addr learned my addr 172.21.15.57:0/3157368322 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.705+0000 7f96f1e00700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f4103540 0x7f96f4113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.705+0000 7f96ebe00700 1 -- 172.21.15.57:0/3157368322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f4103540 msgr2=0x7f96f4113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.705+0000 7f96ebe00700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f4103540 0x7f96f4113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.705+0000 7f96ebe00700 1 -- 172.21.15.57:0/3157368322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e4005040 con 0x7f96f4104750 2024-02-28T15:57:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.706+0000 7f96ebe00700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f4104750 0x7f96f41144a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c8c0 tx=0x7f96dc0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:38.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.706+0000 7f96ea000700 1 -- 172.21.15.57:0/3157368322 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96dc00a980 con 0x7f96f4104750 2024-02-28T15:57:38.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.706+0000 7f96f9200700 1 -- 172.21.15.57:0/3157368322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f4115620 con 0x7f96f4104750 2024-02-28T15:57:38.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.706+0000 7f96ea000700 1 -- 172.21.15.57:0/3157368322 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96dc00ce60 con 0x7f96f4104750 2024-02-28T15:57:38.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.706+0000 7f96ea000700 1 -- 172.21.15.57:0/3157368322 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96dc0115e0 con 0x7f96f4104750 2024-02-28T15:57:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.706+0000 7f96f9200700 1 -- 172.21.15.57:0/3157368322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f4115b60 con 0x7f96f4104750 2024-02-28T15:57:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.707+0000 7f96f9200700 1 -- 172.21.15.57:0/3157368322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f404bed0 con 0x7f96f4104750 2024-02-28T15:57:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.708+0000 7f96ea000700 1 -- 172.21.15.57:0/3157368322 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f96dc012400 con 0x7f96f4104750 2024-02-28T15:57:38.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.710+0000 7f96ea000700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f96d80692b0 0x7f96d806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:38.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.710+0000 7f96ea000700 1 -- 172.21.15.57:0/3157368322 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f96dc086ff0 con 0x7f96f4104750 2024-02-28T15:57:38.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.710+0000 7f96f1e00700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f96d80692b0 0x7f96d806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:38.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.711+0000 7f96f1e00700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f96d80692b0 0x7f96d806b760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96e400b020 tx=0x7f96e4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:38.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.715+0000 7f96ea000700 1 -- 172.21.15.57:0/3157368322 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f96dc057050 con 0x7f96f4104750 2024-02-28T15:57:38.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.925+0000 7f96f9200700 1 -- 172.21.15.57:0/3157368322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f96f410c020 con 0x7f96f4104750 2024-02-28T15:57:38.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.937+0000 7f96ea000700 1 -- 172.21.15.57:0/3157368322 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f96dc0126b0 con 0x7f96f4104750 2024-02-28T15:57:38.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.939+0000 7f96f9200700 1 -- 172.21.15.57:0/3157368322 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f96d80692b0 msgr2=0x7f96d806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:38.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.939+0000 7f96f9200700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f96d80692b0 0x7f96d806b760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96e400b020 tx=0x7f96e4009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.939+0000 7f96f9200700 1 -- 172.21.15.57:0/3157368322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f4104750 msgr2=0x7f96f41144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.939+0000 7f96f9200700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f4104750 0x7f96f41144a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c8c0 tx=0x7f96dc0044c0 comp rx=0 tx=0).stop 2024-02-28T15:57:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.940+0000 7f96f9200700 1 -- 172.21.15.57:0/3157368322 shutdown_connections 2024-02-28T15:57:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.940+0000 7f96f9200700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f96d80692b0 0x7f96d806b760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.940+0000 7f96f9200700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f4103540 0x7f96f4113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.940+0000 7f96f9200700 1 --2- 172.21.15.57:0/3157368322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f4104750 0x7f96f41144a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.940+0000 7f96f9200700 1 -- 172.21.15.57:0/3157368322 >> 172.21.15.57:0/3157368322 conn(0x7f96f40727d0 msgr2=0x7f96f4107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.940+0000 7f96f9200700 1 -- 172.21.15.57:0/3157368322 shutdown_connections 2024-02-28T15:57:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:38.941+0000 7f96f9200700 1 -- 172.21.15.57:0/3157368322 wait complete. 2024-02-28T15:57:39.826 INFO:teuthology.run_tasks:Running task print... 2024-02-28T15:57:39.835 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-28T15:57:39.835 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T15:57:39.851 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:57:39.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph orch status' 2024-02-28T15:57:40.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:39 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3157368322' entity='client.admin' 2024-02-28T15:57:40.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:39 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:57:40.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:39 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:57:40.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:39 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:57:40.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:39 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:57:40.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:39 smithi057 ceph-mon[28763]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:40.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:39 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3157368322' entity='client.admin' 2024-02-28T15:57:40.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:39 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:57:40.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:39 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:57:40.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:39 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:57:40.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:39 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:57:40.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:39 smithi087 ceph-mon[37122]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:40.346 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:42.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.628+0000 7f4581200700 1 -- 172.21.15.57:0/3991601404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c0fcef0 msgr2=0x7f457c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:42.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.628+0000 7f4581200700 1 --2- 172.21.15.57:0/3991601404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c0fcef0 0x7f457c0fd320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f456c004940 tx=0x7f456c009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.628+0000 7f4581200700 1 -- 172.21.15.57:0/3991601404 shutdown_connections 2024-02-28T15:57:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.628+0000 7f4581200700 1 --2- 172.21.15.57:0/3991601404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f457c0fe0e0 0x7f457c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.628+0000 7f4581200700 1 --2- 172.21.15.57:0/3991601404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c0fcef0 0x7f457c0fd320 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.628+0000 7f4581200700 1 -- 172.21.15.57:0/3991601404 >> 172.21.15.57:0/3991601404 conn(0x7f457c0f8620 msgr2=0x7f457c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.628+0000 7f4581200700 1 -- 172.21.15.57:0/3991601404 shutdown_connections 2024-02-28T15:57:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.628+0000 7f4581200700 1 -- 172.21.15.57:0/3991601404 wait complete. 2024-02-28T15:57:42.622 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:42 smithi057 ceph-mon[28763]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.629+0000 7f4581200700 1 Processor -- start 2024-02-28T15:57:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.629+0000 7f4581200700 1 -- start start 2024-02-28T15:57:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.629+0000 7f4581200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c0fcef0 0x7f457c10fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.629+0000 7f4581200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f457c0fe0e0 0x7f457c1100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.629+0000 7f4581200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c1106c0 con 0x7f457c0fcef0 2024-02-28T15:57:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.629+0000 7f4581200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c110f60 con 0x7f457c0fe0e0 2024-02-28T15:57:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.630+0000 7f4579e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c0fcef0 0x7f457c10fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.630+0000 7f4579e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c0fcef0 0x7f457c10fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35252/0 (socket says 172.21.15.57:35252) 2024-02-28T15:57:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.630+0000 7f4579e00700 1 -- 172.21.15.57:0/1978145343 learned_addr learned my addr 172.21.15.57:0/1978145343 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.630+0000 7f4571400700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f457c0fe0e0 0x7f457c1100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.630+0000 7f4579e00700 1 -- 172.21.15.57:0/1978145343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f457c0fe0e0 msgr2=0x7f457c1100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.630+0000 7f4579e00700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f457c0fe0e0 0x7f457c1100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.630+0000 7f4579e00700 1 -- 172.21.15.57:0/1978145343 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c005040 con 0x7f457c0fcef0 2024-02-28T15:57:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.630+0000 7f4579e00700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c0fcef0 0x7f457c10fb80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f456c000c00 tx=0x7f456c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.631+0000 7f4572a00700 1 -- 172.21.15.57:0/1978145343 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f456c00e040 con 0x7f457c0fcef0 2024-02-28T15:57:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.631+0000 7f4572a00700 1 -- 172.21.15.57:0/1978145343 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f456c00bcc0 con 0x7f457c0fcef0 2024-02-28T15:57:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.631+0000 7f4572a00700 1 -- 172.21.15.57:0/1978145343 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f456c013ea0 con 0x7f457c0fcef0 2024-02-28T15:57:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.631+0000 7f4581200700 1 -- 172.21.15.57:0/1978145343 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c1111e0 con 0x7f457c0fcef0 2024-02-28T15:57:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.631+0000 7f4581200700 1 -- 172.21.15.57:0/1978145343 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c111720 con 0x7f457c0fcef0 2024-02-28T15:57:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.632+0000 7f4581200700 1 -- 172.21.15.57:0/1978145343 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457c102210 con 0x7f457c0fcef0 2024-02-28T15:57:42.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.633+0000 7f4572a00700 1 -- 172.21.15.57:0/1978145343 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f456c013420 con 0x7f457c0fcef0 2024-02-28T15:57:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.634+0000 7f4572a00700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f45600692b0 0x7f456006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.634+0000 7f4572a00700 1 -- 172.21.15.57:0/1978145343 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f456c088180 con 0x7f457c0fcef0 2024-02-28T15:57:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.634+0000 7f4571400700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f45600692b0 0x7f456006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.635+0000 7f4571400700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f45600692b0 0x7f456006b760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4564004990 tx=0x7f4564009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:42.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.639+0000 7f4572a00700 1 -- 172.21.15.57:0/1978145343 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f456c0581e0 con 0x7f457c0fcef0 2024-02-28T15:57:42.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:42 smithi087 ceph-mon[37122]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:42.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.867+0000 7f4581200700 1 -- 172.21.15.57:0/1978145343 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f457c111a50 con 0x7f45600692b0 2024-02-28T15:57:42.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.869+0000 7f4572a00700 1 -- 172.21.15.57:0/1978145343 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f457c111a50 con 0x7f45600692b0 2024-02-28T15:57:42.862 INFO:teuthology.orchestra.run.smithi057.stdout:Backend: cephadm 2024-02-28T15:57:42.862 INFO:teuthology.orchestra.run.smithi057.stdout:Available: Yes 2024-02-28T15:57:42.862 INFO:teuthology.orchestra.run.smithi057.stdout:Paused: No 2024-02-28T15:57:42.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 -- 172.21.15.57:0/1978145343 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f45600692b0 msgr2=0x7f456006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:42.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f45600692b0 0x7f456006b760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4564004990 tx=0x7f4564009ee0 comp rx=0 tx=0).stop 2024-02-28T15:57:42.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 -- 172.21.15.57:0/1978145343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c0fcef0 msgr2=0x7f457c10fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:42.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c0fcef0 0x7f457c10fb80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f456c000c00 tx=0x7f456c009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:42.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 -- 172.21.15.57:0/1978145343 shutdown_connections 2024-02-28T15:57:42.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f45600692b0 0x7f456006b760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:42.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c0fcef0 0x7f457c10fb80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:42.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 --2- 172.21.15.57:0/1978145343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f457c0fe0e0 0x7f457c1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:42.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 -- 172.21.15.57:0/1978145343 >> 172.21.15.57:0/1978145343 conn(0x7f457c0f8620 msgr2=0x7f457c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:42.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 -- 172.21.15.57:0/1978145343 shutdown_connections 2024-02-28T15:57:42.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:42.872+0000 7f4581200700 1 -- 172.21.15.57:0/1978145343 wait complete. 2024-02-28T15:57:43.796 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-28T15:57:44.314 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:44.665 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:44 smithi057 ceph-mon[28763]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:57:44.665 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:44 smithi057 ceph-mon[28763]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:44.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:44 smithi087 ceph-mon[37122]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:57:44.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:44 smithi087 ceph-mon[37122]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:46.320 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:46 smithi057 ceph-mon[28763]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:46.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:46 smithi087 ceph-mon[37122]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.612+0000 7f3ed8200700 1 -- 172.21.15.57:0/1974564679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed00fcf30 msgr2=0x7f3ed00fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.612+0000 7f3ed8200700 1 --2- 172.21.15.57:0/1974564679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed00fcf30 0x7f3ed00fd340 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4004940 tx=0x7f3ec4009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.612+0000 7f3ed8200700 1 -- 172.21.15.57:0/1974564679 shutdown_connections 2024-02-28T15:57:46.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.612+0000 7f3ed8200700 1 --2- 172.21.15.57:0/1974564679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ed00fe1e0 0x7f3ed00fe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:46.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.612+0000 7f3ed8200700 1 --2- 172.21.15.57:0/1974564679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed00fcf30 0x7f3ed00fd340 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:46.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.612+0000 7f3ed8200700 1 -- 172.21.15.57:0/1974564679 >> 172.21.15.57:0/1974564679 conn(0x7f3ed00f86b0 msgr2=0x7f3ed00faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:46.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.612+0000 7f3ed8200700 1 -- 172.21.15.57:0/1974564679 shutdown_connections 2024-02-28T15:57:46.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.612+0000 7f3ed8200700 1 -- 172.21.15.57:0/1974564679 wait complete. 2024-02-28T15:57:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.613+0000 7f3ed8200700 1 Processor -- start 2024-02-28T15:57:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.613+0000 7f3ed8200700 1 -- start start 2024-02-28T15:57:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.614+0000 7f3ed8200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed00fcf30 0x7f3ed0113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.614+0000 7f3ed8200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ed00fe1e0 0x7f3ed01143d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.614+0000 7f3ed8200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01149d0 con 0x7f3ed00fcf30 2024-02-28T15:57:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.614+0000 7f3ed8200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0115270 con 0x7f3ed00fe1e0 2024-02-28T15:57:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.614+0000 7f3ed5800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed00fcf30 0x7f3ed0113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.614+0000 7f3ed5800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed00fcf30 0x7f3ed0113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35272/0 (socket says 172.21.15.57:35272) 2024-02-28T15:57:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.614+0000 7f3ed5800700 1 -- 172.21.15.57:0/1916098405 learned_addr learned my addr 172.21.15.57:0/1916098405 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.614+0000 7f3ed4e00700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ed00fe1e0 0x7f3ed01143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.614+0000 7f3ed5800700 1 -- 172.21.15.57:0/1916098405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ed00fe1e0 msgr2=0x7f3ed01143d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.614+0000 7f3ed5800700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ed00fe1e0 0x7f3ed01143d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.615+0000 7f3ed5800700 1 -- 172.21.15.57:0/1916098405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4005040 con 0x7f3ed00fcf30 2024-02-28T15:57:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.615+0000 7f3ed5800700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed00fcf30 0x7f3ed0113e90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4000c00 tx=0x7f3ec4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.615+0000 7f3ecd600700 1 -- 172.21.15.57:0/1916098405 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec4021070 con 0x7f3ed00fcf30 2024-02-28T15:57:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.615+0000 7f3ecd600700 1 -- 172.21.15.57:0/1916098405 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ec401c400 con 0x7f3ed00fcf30 2024-02-28T15:57:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.615+0000 7f3ed8200700 1 -- 172.21.15.57:0/1916098405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed01154f0 con 0x7f3ed00fcf30 2024-02-28T15:57:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.615+0000 7f3ecd600700 1 -- 172.21.15.57:0/1916098405 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec400e070 con 0x7f3ed00fcf30 2024-02-28T15:57:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.615+0000 7f3ed8200700 1 -- 172.21.15.57:0/1916098405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed01159d0 con 0x7f3ed00fcf30 2024-02-28T15:57:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.617+0000 7f3ed8200700 1 -- 172.21.15.57:0/1916098405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed0102280 con 0x7f3ed00fcf30 2024-02-28T15:57:46.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.617+0000 7f3ecd600700 1 -- 172.21.15.57:0/1916098405 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f3ec401ca20 con 0x7f3ed00fcf30 2024-02-28T15:57:46.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.618+0000 7f3ecd600700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3eb80692b0 0x7f3eb806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:46.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.618+0000 7f3ecd600700 1 -- 172.21.15.57:0/1916098405 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3ec40880c0 con 0x7f3ed00fcf30 2024-02-28T15:57:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.619+0000 7f3ed4e00700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3eb80692b0 0x7f3eb806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.619+0000 7f3ed4e00700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3eb80692b0 0x7f3eb806b760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc004600 tx=0x7f3ebc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:46.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.623+0000 7f3ecd600700 1 -- 172.21.15.57:0/1916098405 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3ec40581a0 con 0x7f3ed00fcf30 2024-02-28T15:57:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.845+0000 7f3ed8200700 1 -- 172.21.15.57:0/1916098405 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ed0115d00 con 0x7f3eb80692b0 2024-02-28T15:57:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.854+0000 7f3ecd600700 1 -- 172.21.15.57:0/1916098405 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7f3ed0115d00 con 0x7f3eb80692b0 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (4m) 2m ago 6m 14.1M - 0.25.0 c8568f914cd2 64bbae049744 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (7m) 2m ago 7m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (5m) 78s ago 5m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (4m) 2m ago 6m 74.5M - 9.4.7 954c08fa6188 60cd69b6a8d5 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:9283 running (8m) 2m ago 8m 473M - 17.2.7-535-gc0f02e60 1c37ed371348 2db340312662 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283 running (5m) 78s ago 5m 431M - 17.2.7-535-gc0f02e60 1c37ed371348 b5fa36ca3912 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (8m) 2m ago 8m 41.5M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (5m) 78s ago 5m 30.5M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (7m) 2m ago 7m 7788k - 1.5.0 0da6a335fe13 a721184edf00 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (5m) 78s ago 5m 7411k - 1.5.0 0da6a335fe13 f91fe90e3547 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (4m) 2m ago 4m 38.0M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T15:57:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (3m) 2m ago 3m 38.8M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T15:57:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (3m) 2m ago 3m 37.4M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T15:57:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (2m) 78s ago 2m 38.4M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T15:57:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (2m) 78s ago 2m 35.2M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T15:57:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (85s) 78s ago 85s 10.5M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T15:57:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (4m) 2m ago 6m 34.4M - 2.43.0 a07b618ecd1d 2e0885a51c9e 2024-02-28T15:57:46.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.857+0000 7f3ed8200700 1 -- 172.21.15.57:0/1916098405 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3eb80692b0 msgr2=0x7f3eb806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:46.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.857+0000 7f3ed8200700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3eb80692b0 0x7f3eb806b760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc004600 tx=0x7f3ebc00b040 comp rx=0 tx=0).stop 2024-02-28T15:57:46.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.857+0000 7f3ed8200700 1 -- 172.21.15.57:0/1916098405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed00fcf30 msgr2=0x7f3ed0113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:46.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.857+0000 7f3ed8200700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed00fcf30 0x7f3ed0113e90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4000c00 tx=0x7f3ec4009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:46.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.857+0000 7f3ed8200700 1 -- 172.21.15.57:0/1916098405 shutdown_connections 2024-02-28T15:57:46.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.857+0000 7f3ed8200700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3eb80692b0 0x7f3eb806b760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:46.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.857+0000 7f3ed8200700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed00fcf30 0x7f3ed0113e90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:46.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.857+0000 7f3ed8200700 1 --2- 172.21.15.57:0/1916098405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ed00fe1e0 0x7f3ed01143d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:46.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.857+0000 7f3ed8200700 1 -- 172.21.15.57:0/1916098405 >> 172.21.15.57:0/1916098405 conn(0x7f3ed00f86b0 msgr2=0x7f3ed00ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:46.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.858+0000 7f3ed8200700 1 -- 172.21.15.57:0/1916098405 shutdown_connections 2024-02-28T15:57:46.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:46.858+0000 7f3ed8200700 1 -- 172.21.15.57:0/1916098405 wait complete. 2024-02-28T15:57:47.794 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-28T15:57:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:48.640 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:48 smithi057 ceph-mon[28763]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:57:48.641 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:48 smithi057 ceph-mon[28763]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:48.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:48 smithi087 ceph-mon[37122]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:57:48.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:48 smithi087 ceph-mon[37122]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:50.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.492+0000 7f280c600700 1 -- 172.21.15.57:0/1965042642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2804100380 msgr2=0x7f28041007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:50.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.492+0000 7f280c600700 1 --2- 172.21.15.57:0/1965042642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2804100380 0x7f28041007d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f27f0004940 tx=0x7f27f0009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:50.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.492+0000 7f280c600700 1 -- 172.21.15.57:0/1965042642 shutdown_connections 2024-02-28T15:57:50.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.492+0000 7f280c600700 1 --2- 172.21.15.57:0/1965042642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2804100380 0x7f28041007d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:50.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.492+0000 7f280c600700 1 --2- 172.21.15.57:0/1965042642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28040ff170 0x7f28040ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:50.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.492+0000 7f280c600700 1 -- 172.21.15.57:0/1965042642 >> 172.21.15.57:0/1965042642 conn(0x7f28040fa920 msgr2=0x7f28040fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:50.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.492+0000 7f280c600700 1 -- 172.21.15.57:0/1965042642 shutdown_connections 2024-02-28T15:57:50.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.492+0000 7f280c600700 1 -- 172.21.15.57:0/1965042642 wait complete. 2024-02-28T15:57:50.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.493+0000 7f280c600700 1 Processor -- start 2024-02-28T15:57:50.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.493+0000 7f280c600700 1 -- start start 2024-02-28T15:57:50.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.494+0000 7f280c600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28040ff170 0x7f280410fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:50.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.494+0000 7f280c600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2804100380 0x7f28041100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.494+0000 7f280c600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28041106d0 con 0x7f2804100380 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.494+0000 7f280c600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2804110f70 con 0x7f28040ff170 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.494+0000 7f2809200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2804100380 0x7f28041100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.494+0000 7f2809200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2804100380 0x7f28041100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35288/0 (socket says 172.21.15.57:35288) 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.494+0000 7f2809200700 1 -- 172.21.15.57:0/647057232 learned_addr learned my addr 172.21.15.57:0/647057232 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.495+0000 7f2809c00700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28040ff170 0x7f280410fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.495+0000 7f2809200700 1 -- 172.21.15.57:0/647057232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28040ff170 msgr2=0x7f280410fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.495+0000 7f2809200700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28040ff170 0x7f280410fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.495+0000 7f2809200700 1 -- 172.21.15.57:0/647057232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0005040 con 0x7f2804100380 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.495+0000 7f2809200700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2804100380 0x7f28041100d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f27f000b3b0 tx=0x7f27f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.495+0000 7f2801600700 1 -- 172.21.15.57:0/647057232 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27f000e040 con 0x7f2804100380 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.495+0000 7f2801600700 1 -- 172.21.15.57:0/647057232 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27f000bd90 con 0x7f2804100380 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.495+0000 7f280c600700 1 -- 172.21.15.57:0/647057232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28041111f0 con 0x7f2804100380 2024-02-28T15:57:50.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.495+0000 7f2801600700 1 -- 172.21.15.57:0/647057232 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27f001c630 con 0x7f2804100380 2024-02-28T15:57:50.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.496+0000 7f280c600700 1 -- 172.21.15.57:0/647057232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2804111730 con 0x7f2804100380 2024-02-28T15:57:50.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.497+0000 7f280c600700 1 -- 172.21.15.57:0/647057232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280404bed0 con 0x7f2804100380 2024-02-28T15:57:50.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.498+0000 7f2801600700 1 -- 172.21.15.57:0/647057232 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f27f00139f0 con 0x7f2804100380 2024-02-28T15:57:50.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.498+0000 7f2801600700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f27ec0692b0 0x7f27ec06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:50.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.499+0000 7f2801600700 1 -- 172.21.15.57:0/647057232 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f27f0088390 con 0x7f2804100380 2024-02-28T15:57:50.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.499+0000 7f2809c00700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f27ec0692b0 0x7f27ec06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:50.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.499+0000 7f2809c00700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f27ec0692b0 0x7f27ec06b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009fd0 tx=0x7f27f8009f00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:50.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.503+0000 7f2801600700 1 -- 172.21.15.57:0/647057232 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f27f0058520 con 0x7f2804100380 2024-02-28T15:57:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:50 smithi057 ceph-mon[28763]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:50.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.721+0000 7f280c600700 1 -- 172.21.15.57:0/647057232 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2804111bd0 con 0x7f27ec0692b0 2024-02-28T15:57:50.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:50 smithi087 ceph-mon[37122]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:50.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.726+0000 7f2801600700 1 -- 172.21.15.57:0/647057232 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1161 (secure 0 0 0) 0x7f2804111bd0 con 0x7f27ec0692b0 2024-02-28T15:57:50.720 INFO:teuthology.orchestra.run.smithi057.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-28T15:57:50.720 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager ?:9093,9094 1/1 2m ago 7m count:1 2024-02-28T15:57:50.720 INFO:teuthology.orchestra.run.smithi057.stdout:crash 2/2 2m ago 7m * 2024-02-28T15:57:50.720 INFO:teuthology.orchestra.run.smithi057.stdout:grafana ?:3000 1/1 2m ago 7m count:1 2024-02-28T15:57:50.720 INFO:teuthology.orchestra.run.smithi057.stdout:mgr 2/2 2m ago 7m count:2 2024-02-28T15:57:50.721 INFO:teuthology.orchestra.run.smithi057.stdout:mon 2/2 2m ago 6m smithi057:172.21.15.57=smithi057;smithi087:172.21.15.87=smithi087;count:2 2024-02-28T15:57:50.721 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter ?:9100 2/2 2m ago 7m * 2024-02-28T15:57:50.721 INFO:teuthology.orchestra.run.smithi057.stdout:osd 6 2m ago - 2024-02-28T15:57:50.721 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus ?:9095 1/1 2m ago 7m count:1 2024-02-28T15:57:50.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 -- 172.21.15.57:0/647057232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f27ec0692b0 msgr2=0x7f27ec06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:50.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f27ec0692b0 0x7f27ec06b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009fd0 tx=0x7f27f8009f00 comp rx=0 tx=0).stop 2024-02-28T15:57:50.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 -- 172.21.15.57:0/647057232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2804100380 msgr2=0x7f28041100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:50.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2804100380 0x7f28041100d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f27f000b3b0 tx=0x7f27f0009e30 comp rx=0 tx=0).stop 2024-02-28T15:57:50.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 -- 172.21.15.57:0/647057232 shutdown_connections 2024-02-28T15:57:50.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f27ec0692b0 0x7f27ec06b760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:50.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28040ff170 0x7f280410fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:50.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 --2- 172.21.15.57:0/647057232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2804100380 0x7f28041100d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:50.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 -- 172.21.15.57:0/647057232 >> 172.21.15.57:0/647057232 conn(0x7f28040fa920 msgr2=0x7f28041035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:50.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 -- 172.21.15.57:0/647057232 shutdown_connections 2024-02-28T15:57:50.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:50.729+0000 7f280c600700 1 -- 172.21.15.57:0/647057232 wait complete. 2024-02-28T15:57:51.653 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:51 smithi057 ceph-mon[28763]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:57:51.653 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:57:51.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-28T15:57:51.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:51 smithi087 ceph-mon[37122]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:57:51.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:57:52.149 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:52.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:52 smithi057 ceph-mon[28763]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:52.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:52 smithi087 ceph-mon[37122]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.320+0000 7f97fa200700 1 -- 172.21.15.57:0/3190718192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f40ff150 msgr2=0x7f97f40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.320+0000 7f97fa200700 1 --2- 172.21.15.57:0/3190718192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f40ff150 0x7f97f40ff560 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009ce0 tx=0x7f97e4004d10 comp rx=0 tx=0).stop 2024-02-28T15:57:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.320+0000 7f97fa200700 1 -- 172.21.15.57:0/3190718192 shutdown_connections 2024-02-28T15:57:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.320+0000 7f97fa200700 1 --2- 172.21.15.57:0/3190718192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97f4100360 0x7f97f41007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.320+0000 7f97fa200700 1 --2- 172.21.15.57:0/3190718192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f40ff150 0x7f97f40ff560 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.321+0000 7f97fa200700 1 -- 172.21.15.57:0/3190718192 >> 172.21.15.57:0/3190718192 conn(0x7f97f40fa920 msgr2=0x7f97f40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.321+0000 7f97fa200700 1 -- 172.21.15.57:0/3190718192 shutdown_connections 2024-02-28T15:57:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.321+0000 7f97fa200700 1 -- 172.21.15.57:0/3190718192 wait complete. 2024-02-28T15:57:54.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.321+0000 7f97fa200700 1 Processor -- start 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.322+0000 7f97fa200700 1 -- start start 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.322+0000 7f97fa200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f40ff150 0x7f97f410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.322+0000 7f97fa200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97f4100360 0x7f97f41102e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.322+0000 7f97fa200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f41110d0 con 0x7f97f40ff150 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.322+0000 7f97fa200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4111240 con 0x7f97f4100360 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.322+0000 7f97f3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f40ff150 0x7f97f410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.322+0000 7f97f3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f40ff150 0x7f97f410fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55586/0 (socket says 172.21.15.57:55586) 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.322+0000 7f97f3400700 1 -- 172.21.15.57:0/355696434 learned_addr learned my addr 172.21.15.57:0/355696434 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.323+0000 7f97f2a00700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97f4100360 0x7f97f41102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.323+0000 7f97f3400700 1 -- 172.21.15.57:0/355696434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97f4100360 msgr2=0x7f97f41102e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.323+0000 7f97f3400700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97f4100360 0x7f97f41102e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.323+0000 7f97f3400700 1 -- 172.21.15.57:0/355696434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4009940 con 0x7f97f40ff150 2024-02-28T15:57:54.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.323+0000 7f97f3400700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f40ff150 0x7f97f410fda0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009380 tx=0x7f97e4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:54.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.324+0000 7f97eb400700 1 -- 172.21.15.57:0/355696434 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e400e040 con 0x7f97f40ff150 2024-02-28T15:57:54.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.324+0000 7f97eb400700 1 -- 172.21.15.57:0/355696434 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97e40128e0 con 0x7f97f40ff150 2024-02-28T15:57:54.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.324+0000 7f97eb400700 1 -- 172.21.15.57:0/355696434 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e401c970 con 0x7f97f40ff150 2024-02-28T15:57:54.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.324+0000 7f97fa200700 1 -- 172.21.15.57:0/355696434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f41114c0 con 0x7f97f40ff150 2024-02-28T15:57:54.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.324+0000 7f97fa200700 1 -- 172.21.15.57:0/355696434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f41119b0 con 0x7f97f40ff150 2024-02-28T15:57:54.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.325+0000 7f97fa200700 1 -- 172.21.15.57:0/355696434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f40fe4b0 con 0x7f97f40ff150 2024-02-28T15:57:54.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.326+0000 7f97eb400700 1 -- 172.21.15.57:0/355696434 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f97e4012a50 con 0x7f97f40ff150 2024-02-28T15:57:54.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.327+0000 7f97eb400700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f97d80692b0 0x7f97d806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:54.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.327+0000 7f97eb400700 1 -- 172.21.15.57:0/355696434 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f97e4088c20 con 0x7f97f40ff150 2024-02-28T15:57:54.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.327+0000 7f97f2a00700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f97d80692b0 0x7f97d806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:54.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.328+0000 7f97f2a00700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f97d80692b0 0x7f97d806b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f97f410fb30 tx=0x7f97e0009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.332+0000 7f97eb400700 1 -- 172.21.15.57:0/355696434 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f97e4055170 con 0x7f97f40ff150 2024-02-28T15:57:54.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.552+0000 7f97fa200700 1 -- 172.21.15.57:0/355696434 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f97f4111d30 con 0x7f97d80692b0 2024-02-28T15:57:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.555+0000 7f97eb400700 1 -- 172.21.15.57:0/355696434 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7f97f4111d30 con 0x7f97d80692b0 2024-02-28T15:57:54.549 INFO:teuthology.orchestra.run.smithi057.stdout:HOST ADDR LABELS STATUS 2024-02-28T15:57:54.549 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057 172.21.15.57 2024-02-28T15:57:54.549 INFO:teuthology.orchestra.run.smithi057.stdout:smithi087 172.21.15.87 2024-02-28T15:57:54.549 INFO:teuthology.orchestra.run.smithi057.stdout:2 hosts in cluster 2024-02-28T15:57:54.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.557+0000 7f97fa200700 1 -- 172.21.15.57:0/355696434 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f97d80692b0 msgr2=0x7f97d806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:54.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.558+0000 7f97fa200700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f97d80692b0 0x7f97d806b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f97f410fb30 tx=0x7f97e0009ee0 comp rx=0 tx=0).stop 2024-02-28T15:57:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.558+0000 7f97fa200700 1 -- 172.21.15.57:0/355696434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f40ff150 msgr2=0x7f97f410fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.558+0000 7f97fa200700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f40ff150 0x7f97f410fda0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009380 tx=0x7f97e4004d10 comp rx=0 tx=0).stop 2024-02-28T15:57:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.558+0000 7f97fa200700 1 -- 172.21.15.57:0/355696434 shutdown_connections 2024-02-28T15:57:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.558+0000 7f97fa200700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f97d80692b0 0x7f97d806b760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.558+0000 7f97fa200700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f40ff150 0x7f97f410fda0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.558+0000 7f97fa200700 1 --2- 172.21.15.57:0/355696434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97f4100360 0x7f97f41102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.558+0000 7f97fa200700 1 -- 172.21.15.57:0/355696434 >> 172.21.15.57:0/355696434 conn(0x7f97f40fa920 msgr2=0x7f97f4103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.558+0000 7f97fa200700 1 -- 172.21.15.57:0/355696434 shutdown_connections 2024-02-28T15:57:54.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:54.558+0000 7f97fa200700 1 -- 172.21.15.57:0/355696434 wait complete. 2024-02-28T15:57:54.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:54 smithi057 ceph-mon[28763]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:54.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:54 smithi087 ceph-mon[37122]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:55.301 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-28T15:57:55.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:55 smithi057 ceph-mon[28763]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:57:55.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:55 smithi087 ceph-mon[37122]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:57:55.808 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:56.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:56 smithi057 ceph-mon[28763]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:56.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:56 smithi087 ceph-mon[37122]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:57.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.910+0000 7f0e55c00700 1 -- 172.21.15.57:0/2517169445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e500fbe50 msgr2=0x7f0e500fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:57.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.910+0000 7f0e55c00700 1 --2- 172.21.15.57:0/2517169445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e500fbe50 0x7f0e500fc260 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009ce0 tx=0x7f0e40004d10 comp rx=0 tx=0).stop 2024-02-28T15:57:57.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.910+0000 7f0e55c00700 1 -- 172.21.15.57:0/2517169445 shutdown_connections 2024-02-28T15:57:57.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.910+0000 7f0e55c00700 1 --2- 172.21.15.57:0/2517169445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e500fcfc0 0x7f0e500fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:57.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.910+0000 7f0e55c00700 1 --2- 172.21.15.57:0/2517169445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e500fbe50 0x7f0e500fc260 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:57.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.910+0000 7f0e55c00700 1 -- 172.21.15.57:0/2517169445 >> 172.21.15.57:0/2517169445 conn(0x7f0e500f7510 msgr2=0x7f0e500f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:57.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.910+0000 7f0e55c00700 1 -- 172.21.15.57:0/2517169445 shutdown_connections 2024-02-28T15:57:57.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.910+0000 7f0e55c00700 1 -- 172.21.15.57:0/2517169445 wait complete. 2024-02-28T15:57:57.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.911+0000 7f0e55c00700 1 Processor -- start 2024-02-28T15:57:57.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.911+0000 7f0e55c00700 1 -- start start 2024-02-28T15:57:57.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.912+0000 7f0e55c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e500fbe50 0x7f0e5010fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:57.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.912+0000 7f0e55c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e500fcfc0 0x7f0e501102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:57.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.912+0000 7f0e55c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50111080 con 0x7f0e500fcfc0 2024-02-28T15:57:57.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.912+0000 7f0e55c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e501111f0 con 0x7f0e500fbe50 2024-02-28T15:57:57.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.912+0000 7f0e46000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e500fcfc0 0x7f0e501102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:57.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.912+0000 7f0e46000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e500fcfc0 0x7f0e501102c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55602/0 (socket says 172.21.15.57:55602) 2024-02-28T15:57:57.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.912+0000 7f0e46000700 1 -- 172.21.15.57:0/471331248 learned_addr learned my addr 172.21.15.57:0/471331248 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.912+0000 7f0e4ea00700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e500fbe50 0x7f0e5010fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.913+0000 7f0e46000700 1 -- 172.21.15.57:0/471331248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e500fbe50 msgr2=0x7f0e5010fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.913+0000 7f0e46000700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e500fbe50 0x7f0e5010fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.913+0000 7f0e46000700 1 -- 172.21.15.57:0/471331248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40009940 con 0x7f0e500fcfc0 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.913+0000 7f0e4ea00700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e500fbe50 0x7f0e5010fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.913+0000 7f0e46000700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e500fcfc0 0x7f0e501102c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0e38002a50 tx=0x7f0e380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.913+0000 7f0e47400700 1 -- 172.21.15.57:0/471331248 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e38007cc0 con 0x7f0e500fcfc0 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.913+0000 7f0e47400700 1 -- 172.21.15.57:0/471331248 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e3800f040 con 0x7f0e500fcfc0 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.913+0000 7f0e55c00700 1 -- 172.21.15.57:0/471331248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e50111470 con 0x7f0e500fcfc0 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.913+0000 7f0e47400700 1 -- 172.21.15.57:0/471331248 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3800db70 con 0x7f0e500fcfc0 2024-02-28T15:57:57.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.913+0000 7f0e55c00700 1 -- 172.21.15.57:0/471331248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e501119b0 con 0x7f0e500fcfc0 2024-02-28T15:57:57.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.915+0000 7f0e55c00700 1 -- 172.21.15.57:0/471331248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e50103100 con 0x7f0e500fcfc0 2024-02-28T15:57:57.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.916+0000 7f0e47400700 1 -- 172.21.15.57:0/471331248 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f0e3800dcd0 con 0x7f0e500fcfc0 2024-02-28T15:57:57.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.917+0000 7f0e47400700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f0e340692b0 0x7f0e3406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:57:57.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.917+0000 7f0e47400700 1 -- 172.21.15.57:0/471331248 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0e380866e0 con 0x7f0e500fcfc0 2024-02-28T15:57:57.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.917+0000 7f0e4ea00700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f0e340692b0 0x7f0e3406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:57:57.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.918+0000 7f0e4ea00700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f0e340692b0 0x7f0e3406b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009470 tx=0x7f0e40004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:57:57.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:57.921+0000 7f0e47400700 1 -- 172.21.15.57:0/471331248 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0e38052d30 con 0x7f0e500fcfc0 2024-02-28T15:57:58.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.143+0000 7f0e55c00700 1 -- 172.21.15.57:0/471331248 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e50111cc0 con 0x7f0e340692b0 2024-02-28T15:57:58.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.146+0000 7f0e47400700 1 -- 172.21.15.57:0/471331248 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f0e50111cc0 con 0x7f0e340692b0 2024-02-28T15:57:58.140 INFO:teuthology.orchestra.run.smithi057.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-28T15:57:58.140 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN 3726G No 3m ago Has a FileSystem, LVM detected 2024-02-28T15:57:58.140 INFO:teuthology.orchestra.run.smithi057.stdout:smithi087 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN 372G No 84s ago Has a FileSystem, LVM detected 2024-02-28T15:57:58.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 -- 172.21.15.57:0/471331248 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f0e340692b0 msgr2=0x7f0e3406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:58.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f0e340692b0 0x7f0e3406b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009470 tx=0x7f0e40004d10 comp rx=0 tx=0).stop 2024-02-28T15:57:58.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 -- 172.21.15.57:0/471331248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e500fcfc0 msgr2=0x7f0e501102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:57:58.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e500fcfc0 0x7f0e501102c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0e38002a50 tx=0x7f0e380046b0 comp rx=0 tx=0).stop 2024-02-28T15:57:58.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 -- 172.21.15.57:0/471331248 shutdown_connections 2024-02-28T15:57:58.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f0e340692b0 0x7f0e3406b760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:58.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e500fbe50 0x7f0e5010fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:58.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 --2- 172.21.15.57:0/471331248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e500fcfc0 0x7f0e501102c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:57:58.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 -- 172.21.15.57:0/471331248 >> 172.21.15.57:0/471331248 conn(0x7f0e500f7510 msgr2=0x7f0e50100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:57:58.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 -- 172.21.15.57:0/471331248 shutdown_connections 2024-02-28T15:57:58.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:57:58.149+0000 7f0e55c00700 1 -- 172.21.15.57:0/471331248 wait complete. 2024-02-28T15:57:58.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:58 smithi057 ceph-mon[28763]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:58.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:58 smithi087 ceph-mon[37122]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:57:59.078 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T15:57:59.088 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:57:59.088 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-28T15:57:59.612 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:57:59.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:57:59 smithi057 ceph-mon[28763]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:57:59.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:57:59 smithi087 ceph-mon[37122]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:58:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:00 smithi087 ceph-mon[37122]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:00.793 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:00 smithi057 ceph-mon[28763]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.788+0000 7fb281400700 1 -- 172.21.15.57:0/1867670874 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26c00bcb0 con 0x7fb2840fe160 2024-02-28T15:58:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.789+0000 7fb288a00700 1 -- 172.21.15.57:0/1867670874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840fe160 msgr2=0x7fb2841005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.789+0000 7fb288a00700 1 --2- 172.21.15.57:0/1867670874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840fe160 0x7fb2841005e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb26c004940 tx=0x7fb26c009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.789+0000 7fb288a00700 1 -- 172.21.15.57:0/1867670874 shutdown_connections 2024-02-28T15:58:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.789+0000 7fb288a00700 1 --2- 172.21.15.57:0/1867670874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840fe160 0x7fb2841005e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.789+0000 7fb288a00700 1 --2- 172.21.15.57:0/1867670874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2840fb800 0x7fb2840fdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.789+0000 7fb288a00700 1 -- 172.21.15.57:0/1867670874 >> 172.21.15.57:0/1867670874 conn(0x7fb2840f7490 msgr2=0x7fb2840f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.789+0000 7fb288a00700 1 -- 172.21.15.57:0/1867670874 shutdown_connections 2024-02-28T15:58:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.789+0000 7fb288a00700 1 -- 172.21.15.57:0/1867670874 wait complete. 2024-02-28T15:58:01.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.790+0000 7fb288a00700 1 Processor -- start 2024-02-28T15:58:01.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.790+0000 7fb288a00700 1 -- start start 2024-02-28T15:58:01.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.790+0000 7fb288a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2840fb800 0x7fb284113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:01.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.790+0000 7fb288a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840fe160 0x7fb2841143c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:01.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.790+0000 7fb288a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2841149c0 con 0x7fb2840fe160 2024-02-28T15:58:01.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.790+0000 7fb288a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb284115260 con 0x7fb2840fb800 2024-02-28T15:58:01.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.791+0000 7fb27be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840fe160 0x7fb2841143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.791+0000 7fb27be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840fe160 0x7fb2841143c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55614/0 (socket says 172.21.15.57:55614) 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.791+0000 7fb27be00700 1 -- 172.21.15.57:0/1985509255 learned_addr learned my addr 172.21.15.57:0/1985509255 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.791+0000 7fb281e00700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2840fb800 0x7fb284113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.791+0000 7fb27be00700 1 -- 172.21.15.57:0/1985509255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2840fb800 msgr2=0x7fb284113e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.791+0000 7fb27be00700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2840fb800 0x7fb284113e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.791+0000 7fb27be00700 1 -- 172.21.15.57:0/1985509255 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c005040 con 0x7fb2840fe160 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.791+0000 7fb27be00700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840fe160 0x7fb2841143c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0093b0 tx=0x7fb26c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.792+0000 7fb27a000700 1 -- 172.21.15.57:0/1985509255 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26c00e040 con 0x7fb2840fe160 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.792+0000 7fb27a000700 1 -- 172.21.15.57:0/1985509255 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb26c00bcc0 con 0x7fb2840fe160 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.792+0000 7fb27a000700 1 -- 172.21.15.57:0/1985509255 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26c01c630 con 0x7fb2840fe160 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.792+0000 7fb288a00700 1 -- 172.21.15.57:0/1985509255 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2841154e0 con 0x7fb2840fe160 2024-02-28T15:58:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.792+0000 7fb288a00700 1 -- 172.21.15.57:0/1985509255 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb284115a20 con 0x7fb2840fe160 2024-02-28T15:58:01.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.793+0000 7fb288a00700 1 -- 172.21.15.57:0/1985509255 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28404bed0 con 0x7fb2840fe160 2024-02-28T15:58:01.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.794+0000 7fb27a000700 1 -- 172.21.15.57:0/1985509255 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fb26c0139f0 con 0x7fb2840fe160 2024-02-28T15:58:01.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.795+0000 7fb27a000700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb2640692a0 0x7fb26406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.795+0000 7fb27a000700 1 -- 172.21.15.57:0/1985509255 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb26c088180 con 0x7fb2840fe160 2024-02-28T15:58:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.795+0000 7fb281e00700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb2640692a0 0x7fb26406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:01.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.796+0000 7fb281e00700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb2640692a0 0x7fb26406b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb274004d60 tx=0x7fb27400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:01.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:01.800+0000 7fb27a000700 1 -- 172.21.15.57:0/1985509255 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb26c058320 con 0x7fb2840fe160 2024-02-28T15:58:02.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:02.046+0000 7fb288a00700 1 -- 172.21.15.57:0/1985509255 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb284116050 con 0x7fb2640692a0 2024-02-28T15:58:02.825 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:02 smithi057 ceph-mon[28763]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:02.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:02 smithi087 ceph-mon[37122]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:03.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.714+0000 7fb27a000700 1 -- 172.21.15.57:0/1985509255 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb284116050 con 0x7fb2640692a0 2024-02-28T15:58:03.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.719+0000 7fb288a00700 1 -- 172.21.15.57:0/1985509255 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb2640692a0 msgr2=0x7fb26406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:03.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.719+0000 7fb288a00700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb2640692a0 0x7fb26406b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb274004d60 tx=0x7fb27400b040 comp rx=0 tx=0).stop 2024-02-28T15:58:03.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.719+0000 7fb288a00700 1 -- 172.21.15.57:0/1985509255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840fe160 msgr2=0x7fb2841143c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:03.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.719+0000 7fb288a00700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840fe160 0x7fb2841143c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0093b0 tx=0x7fb26c009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:03.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.719+0000 7fb288a00700 1 -- 172.21.15.57:0/1985509255 shutdown_connections 2024-02-28T15:58:03.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.719+0000 7fb288a00700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb2640692a0 0x7fb26406b750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:03.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.719+0000 7fb288a00700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2840fb800 0x7fb284113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:03.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.719+0000 7fb288a00700 1 --2- 172.21.15.57:0/1985509255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840fe160 0x7fb2841143c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:03.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.719+0000 7fb288a00700 1 -- 172.21.15.57:0/1985509255 >> 172.21.15.57:0/1985509255 conn(0x7fb2840f7490 msgr2=0x7fb2840f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:03.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.720+0000 7fb288a00700 1 -- 172.21.15.57:0/1985509255 shutdown_connections 2024-02-28T15:58:03.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:03.720+0000 7fb288a00700 1 -- 172.21.15.57:0/1985509255 wait complete. 2024-02-28T15:58:03.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:03 smithi057 ceph-mon[28763]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:58:03.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-28T15:58:03.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-28T15:58:03.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:03 smithi057 ceph-mon[28763]: osdmap e42: 6 total, 6 up, 6 in 2024-02-28T15:58:03.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:03 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-28T15:58:03.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:03 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057[28759]: 2024-02-28T15:58:03.683+0000 7fd220200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T15:58:03.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:03 smithi087 ceph-mon[37122]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:58:03.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:03 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-28T15:58:03.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:03 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-28T15:58:03.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:03 smithi087 ceph-mon[37122]: osdmap e42: 6 total, 6 up, 6 in 2024-02-28T15:58:03.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:03 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-28T15:58:04.680 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T15:58:04.869 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: pgmap v216: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:04.869 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-28T15:58:04.869 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-28T15:58:04.869 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: osdmap e43: 6 total, 6 up, 6 in 2024-02-28T15:58:04.869 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-28T15:58:04.869 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T15:58:04.869 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: osdmap e44: 6 total, 6 up, 6 in 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: fsmap cephfs:0 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: Saving service mds.cephfs spec with placement count:4 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.eztwsd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.eztwsd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T15:58:04.870 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:04 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: pgmap v216: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-28T15:58:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-28T15:58:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: osdmap e43: 6 total, 6 up, 6 in 2024-02-28T15:58:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-28T15:58:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T15:58:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-28T15:58:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: osdmap e44: 6 total, 6 up, 6 in 2024-02-28T15:58:04.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-28T15:58:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: fsmap cephfs:0 2024-02-28T15:58:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: Saving service mds.cephfs spec with placement count:4 2024-02-28T15:58:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:58:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:58:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.eztwsd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T15:58:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.eztwsd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T15:58:04.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:04 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:05.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:05 smithi057 ceph-mon[28763]: Deploying daemon mds.cephfs.smithi057.eztwsd on smithi057 2024-02-28T15:58:05.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:05 smithi057 ceph-mon[28763]: osdmap e45: 6 total, 6 up, 6 in 2024-02-28T15:58:05.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:05 smithi087 ceph-mon[37122]: Deploying daemon mds.cephfs.smithi057.eztwsd on smithi057 2024-02-28T15:58:05.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:05 smithi087 ceph-mon[37122]: osdmap e45: 6 total, 6 up, 6 in 2024-02-28T15:58:06.083 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:58:06.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:06 smithi087 ceph-mon[37122]: pgmap v220: 65 pgs: 21 creating+peering, 33 unknown, 11 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:06.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:06 smithi087 ceph-mon[37122]: osdmap e46: 6 total, 6 up, 6 in 2024-02-28T15:58:06.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:06 smithi087 ceph-mon[37122]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-28T15:58:06.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:06 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:06.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:06 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:58:07.113 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:06 smithi057 ceph-mon[28763]: pgmap v220: 65 pgs: 21 creating+peering, 33 unknown, 11 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:07.114 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:06 smithi057 ceph-mon[28763]: osdmap e46: 6 total, 6 up, 6 in 2024-02-28T15:58:07.114 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:06 smithi057 ceph-mon[28763]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-28T15:58:07.114 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:06 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:07.114 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:06 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:58:08.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.583+0000 7fee30800700 1 -- 172.21.15.57:0/4031723522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee28070860 msgr2=0x7fee28070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:08.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.583+0000 7fee30800700 1 --2- 172.21.15.57:0/4031723522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee28070860 0x7fee28070cd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fee18004940 tx=0x7fee18009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:08.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.583+0000 7fee30800700 1 -- 172.21.15.57:0/4031723522 shutdown_connections 2024-02-28T15:58:08.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.583+0000 7fee30800700 1 --2- 172.21.15.57:0/4031723522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee28070860 0x7fee28070cd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:08.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.583+0000 7fee30800700 1 --2- 172.21.15.57:0/4031723522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee28071eb0 0x7fee28070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:08.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.583+0000 7fee30800700 1 -- 172.21.15.57:0/4031723522 >> 172.21.15.57:0/4031723522 conn(0x7fee280f8620 msgr2=0x7fee280faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:08.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.583+0000 7fee30800700 1 -- 172.21.15.57:0/4031723522 shutdown_connections 2024-02-28T15:58:08.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.583+0000 7fee30800700 1 -- 172.21.15.57:0/4031723522 wait complete. 2024-02-28T15:58:08.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.584+0000 7fee30800700 1 Processor -- start 2024-02-28T15:58:08.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.584+0000 7fee30800700 1 -- start start 2024-02-28T15:58:08.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.585+0000 7fee30800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee28070860 0x7fee2810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:08.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.585+0000 7fee30800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee28071eb0 0x7fee28110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.585+0000 7fee30800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee28110680 con 0x7fee28071eb0 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.585+0000 7fee30800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee28110f20 con 0x7fee28070860 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.585+0000 7fee2d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee28071eb0 0x7fee28110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.585+0000 7fee2d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee28071eb0 0x7fee28110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51212/0 (socket says 172.21.15.57:51212) 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.585+0000 7fee2d400700 1 -- 172.21.15.57:0/1760255514 learned_addr learned my addr 172.21.15.57:0/1760255514 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.585+0000 7fee2de00700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee28070860 0x7fee2810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.585+0000 7fee2d400700 1 -- 172.21.15.57:0/1760255514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee28070860 msgr2=0x7fee2810fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.586+0000 7fee2d400700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee28070860 0x7fee2810fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.586+0000 7fee2d400700 1 -- 172.21.15.57:0/1760255514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee18005040 con 0x7fee28071eb0 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.586+0000 7fee2d400700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee28071eb0 0x7fee28110080 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee18009fd0 tx=0x7fee18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.586+0000 7fee22000700 1 -- 172.21.15.57:0/1760255514 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee1800e040 con 0x7fee28071eb0 2024-02-28T15:58:08.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.586+0000 7fee22000700 1 -- 172.21.15.57:0/1760255514 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee1800bcc0 con 0x7fee28071eb0 2024-02-28T15:58:08.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.586+0000 7fee30800700 1 -- 172.21.15.57:0/1760255514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee281111a0 con 0x7fee28071eb0 2024-02-28T15:58:08.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.586+0000 7fee30800700 1 -- 172.21.15.57:0/1760255514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee281116e0 con 0x7fee28071eb0 2024-02-28T15:58:08.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.586+0000 7fee22000700 1 -- 172.21.15.57:0/1760255514 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee1801c630 con 0x7fee28071eb0 2024-02-28T15:58:08.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.587+0000 7fee30800700 1 -- 172.21.15.57:0/1760255514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2804bed0 con 0x7fee28071eb0 2024-02-28T15:58:08.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.589+0000 7fee22000700 1 -- 172.21.15.57:0/1760255514 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fee18013420 con 0x7fee28071eb0 2024-02-28T15:58:08.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.589+0000 7fee22000700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fee100692b0 0x7fee1006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:08.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.590+0000 7fee22000700 1 -- 172.21.15.57:0/1760255514 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fee18088650 con 0x7fee28071eb0 2024-02-28T15:58:08.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.590+0000 7fee2de00700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fee100692b0 0x7fee1006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:08.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.591+0000 7fee2de00700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fee100692b0 0x7fee1006b760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fee1c004f40 tx=0x7fee1c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:08.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.595+0000 7fee22000700 1 -- 172.21.15.57:0/1760255514 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fee18058370 con 0x7fee28071eb0 2024-02-28T15:58:08.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.868+0000 7fee30800700 1 -- 172.21.15.57:0/1760255514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fee28107c00 con 0x7fee28071eb0 2024-02-28T15:58:08.862 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:08 smithi057 ceph-mon[28763]: pgmap v222: 65 pgs: 21 creating+peering, 12 unknown, 32 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:08.862 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:08 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:08.863 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:08 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:08.863 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:08 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:08.863 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:08 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.fzjgef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T15:58:08.863 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:08 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.fzjgef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T15:58:08.863 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:08 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:08.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.869+0000 7fee22000700 1 -- 172.21.15.57:0/1760255514 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1247 (secure 0 0 0) 0x7fee18057f00 con 0x7fee28071eb0 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout:e4 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 4 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T15:58:08.864 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T15:58:08.730771+0000 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 1 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:in 0 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452} 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T15:58:08.865 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T15:58:08.866 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T15:58:08.866 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T15:58:08.866 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T15:58:08.866 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T15:58:08.866 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T15:58:08.866 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 0 2024-02-28T15:58:08.866 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:creating seq 1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:58:08.866 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:58:08.866 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:58:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.873+0000 7fee30800700 1 -- 172.21.15.57:0/1760255514 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fee100692b0 msgr2=0x7fee1006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.873+0000 7fee30800700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fee100692b0 0x7fee1006b760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fee1c004f40 tx=0x7fee1c00b040 comp rx=0 tx=0).stop 2024-02-28T15:58:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.873+0000 7fee30800700 1 -- 172.21.15.57:0/1760255514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee28071eb0 msgr2=0x7fee28110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.873+0000 7fee30800700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee28071eb0 0x7fee28110080 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee18009fd0 tx=0x7fee18009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.873+0000 7fee30800700 1 -- 172.21.15.57:0/1760255514 shutdown_connections 2024-02-28T15:58:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.873+0000 7fee30800700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fee100692b0 0x7fee1006b760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.873+0000 7fee30800700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee28070860 0x7fee2810fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.873+0000 7fee30800700 1 --2- 172.21.15.57:0/1760255514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee28071eb0 0x7fee28110080 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.873+0000 7fee30800700 1 -- 172.21.15.57:0/1760255514 >> 172.21.15.57:0/1760255514 conn(0x7fee280f8620 msgr2=0x7fee28102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:08.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.873+0000 7fee30800700 1 -- 172.21.15.57:0/1760255514 shutdown_connections 2024-02-28T15:58:08.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:08.874+0000 7fee30800700 1 -- 172.21.15.57:0/1760255514 wait complete. 2024-02-28T15:58:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 4 2024-02-28T15:58:09.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:08 smithi087 ceph-mon[37122]: pgmap v222: 65 pgs: 21 creating+peering, 12 unknown, 32 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:09.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:08 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:09.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:08 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:09.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:08 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:09.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:08 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.fzjgef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T15:58:09.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:08 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.fzjgef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T15:58:09.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:08 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:09.679 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T15:58:09.689 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:58:09.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-02-28T15:58:09.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: Deploying daemon mds.cephfs.smithi087.fzjgef on smithi087 2024-02-28T15:58:09.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: mds.? [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] up:boot 2024-02-28T15:58:09.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: daemon mds.cephfs.smithi057.eztwsd assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-28T15:58:09.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T15:58:09.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-28T15:58:09.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: Cluster is now healthy 2024-02-28T15:58:09.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: fsmap cephfs:0 1 up:standby 2024-02-28T15:58:09.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T15:58:09.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:creating} 2024-02-28T15:58:09.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: daemon mds.cephfs.smithi057.eztwsd is now active in filesystem cephfs as rank 0 2024-02-28T15:58:09.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:09 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1760255514' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T15:58:10.210 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:58:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: Deploying daemon mds.cephfs.smithi087.fzjgef on smithi087 2024-02-28T15:58:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: mds.? [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] up:boot 2024-02-28T15:58:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: daemon mds.cephfs.smithi057.eztwsd assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-28T15:58:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T15:58:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-28T15:58:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: Cluster is now healthy 2024-02-28T15:58:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: fsmap cephfs:0 1 up:standby 2024-02-28T15:58:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T15:58:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:creating} 2024-02-28T15:58:10.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: daemon mds.cephfs.smithi057.eztwsd is now active in filesystem cephfs as rank 0 2024-02-28T15:58:10.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:09 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1760255514' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T15:58:10.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:10 smithi057 ceph-mon[28763]: pgmap v223: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:10.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:10 smithi057 ceph-mon[28763]: mds.? [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] up:active 2024-02-28T15:58:10.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:10 smithi057 ceph-mon[28763]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 2024-02-28T15:58:10.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:10 smithi087 ceph-mon[37122]: pgmap v223: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T15:58:10.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:10 smithi087 ceph-mon[37122]: mds.? [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] up:active 2024-02-28T15:58:10.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:10 smithi087 ceph-mon[37122]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 2024-02-28T15:58:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.430+0000 7f38c9200700 1 -- 172.21.15.57:0/3099123636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38c40fda80 msgr2=0x7f38c40ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.430+0000 7f38c9200700 1 --2- 172.21.15.57:0/3099123636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38c40fda80 0x7f38c40ffe60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38b4004940 tx=0x7f38b4009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.430+0000 7f38c9200700 1 -- 172.21.15.57:0/3099123636 shutdown_connections 2024-02-28T15:58:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.430+0000 7f38c9200700 1 --2- 172.21.15.57:0/3099123636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38c41003a0 0x7f38c4102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.430+0000 7f38c9200700 1 --2- 172.21.15.57:0/3099123636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38c40fda80 0x7f38c40ffe60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.430+0000 7f38c9200700 1 -- 172.21.15.57:0/3099123636 >> 172.21.15.57:0/3099123636 conn(0x7f38c40f7520 msgr2=0x7f38c40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.431+0000 7f38c9200700 1 -- 172.21.15.57:0/3099123636 shutdown_connections 2024-02-28T15:58:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.431+0000 7f38c9200700 1 -- 172.21.15.57:0/3099123636 wait complete. 2024-02-28T15:58:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.432+0000 7f38c9200700 1 Processor -- start 2024-02-28T15:58:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.432+0000 7f38c9200700 1 -- start start 2024-02-28T15:58:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.432+0000 7f38c9200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38c40fda80 0x7f38c410fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.432+0000 7f38c9200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38c41003a0 0x7f38c4110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.432+0000 7f38c9200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4110620 con 0x7f38c40fda80 2024-02-28T15:58:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.432+0000 7f38c9200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4110ec0 con 0x7f38c41003a0 2024-02-28T15:58:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.433+0000 7f38c1e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38c40fda80 0x7f38c410fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.433+0000 7f38c1e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38c40fda80 0x7f38c410fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39170/0 (socket says 172.21.15.57:39170) 2024-02-28T15:58:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.433+0000 7f38c1e00700 1 -- 172.21.15.57:0/3081121522 learned_addr learned my addr 172.21.15.57:0/3081121522 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.433+0000 7f38c1400700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38c41003a0 0x7f38c4110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.433+0000 7f38c1e00700 1 -- 172.21.15.57:0/3081121522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38c41003a0 msgr2=0x7f38c4110020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.433+0000 7f38c1e00700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38c41003a0 0x7f38c4110020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.433+0000 7f38c1e00700 1 -- 172.21.15.57:0/3081121522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4005040 con 0x7f38c40fda80 2024-02-28T15:58:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.434+0000 7f38c1e00700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38c40fda80 0x7f38c410fae0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38b40093b0 tx=0x7f38b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.434+0000 7f38ba000700 1 -- 172.21.15.57:0/3081121522 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38b400e040 con 0x7f38c40fda80 2024-02-28T15:58:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.434+0000 7f38ba000700 1 -- 172.21.15.57:0/3081121522 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38b400bcc0 con 0x7f38c40fda80 2024-02-28T15:58:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.434+0000 7f38ba000700 1 -- 172.21.15.57:0/3081121522 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38b401c630 con 0x7f38c40fda80 2024-02-28T15:58:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.434+0000 7f38c9200700 1 -- 172.21.15.57:0/3081121522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c4111140 con 0x7f38c40fda80 2024-02-28T15:58:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.434+0000 7f38c9200700 1 -- 172.21.15.57:0/3081121522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c4111680 con 0x7f38c40fda80 2024-02-28T15:58:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.436+0000 7f38c9200700 1 -- 172.21.15.57:0/3081121522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c404bed0 con 0x7f38c40fda80 2024-02-28T15:58:12.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.437+0000 7f38ba000700 1 -- 172.21.15.57:0/3081121522 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f38b40139f0 con 0x7f38c40fda80 2024-02-28T15:58:12.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.438+0000 7f38ba000700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38a80692a0 0x7f38a806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.438+0000 7f38ba000700 1 -- 172.21.15.57:0/3081121522 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f38b4088580 con 0x7f38c40fda80 2024-02-28T15:58:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.438+0000 7f38c1400700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38a80692a0 0x7f38a806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.439+0000 7f38c1400700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38a80692a0 0x7f38a806b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f38b0007fd0 tx=0x7f38b0009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:12.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.443+0000 7f38ba000700 1 -- 172.21.15.57:0/3081121522 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f38b4058320 con 0x7f38c40fda80 2024-02-28T15:58:12.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.714+0000 7f38c9200700 1 -- 172.21.15.57:0/3081121522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f38c4111b30 con 0x7f38c40fda80 2024-02-28T15:58:12.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.766+0000 7f38ba000700 1 -- 172.21.15.57:0/3081121522 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f38b4057eb0 con 0x7f38c40fda80 2024-02-28T15:58:12.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.769+0000 7f38c9200700 1 -- 172.21.15.57:0/3081121522 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38a80692a0 msgr2=0x7f38a806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:12.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.769+0000 7f38c9200700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38a80692a0 0x7f38a806b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f38b0007fd0 tx=0x7f38b0009040 comp rx=0 tx=0).stop 2024-02-28T15:58:12.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.769+0000 7f38c9200700 1 -- 172.21.15.57:0/3081121522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38c40fda80 msgr2=0x7f38c410fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:12.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.769+0000 7f38c9200700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38c40fda80 0x7f38c410fae0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38b40093b0 tx=0x7f38b4009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:12.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.770+0000 7f38c9200700 1 -- 172.21.15.57:0/3081121522 shutdown_connections 2024-02-28T15:58:12.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.770+0000 7f38c9200700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38a80692a0 0x7f38a806b750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:12.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.770+0000 7f38c9200700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38c40fda80 0x7f38c410fae0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:12.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.770+0000 7f38c9200700 1 --2- 172.21.15.57:0/3081121522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38c41003a0 0x7f38c4110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:12.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.770+0000 7f38c9200700 1 -- 172.21.15.57:0/3081121522 >> 172.21.15.57:0/3081121522 conn(0x7f38c40f7520 msgr2=0x7f38c40fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:12.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.770+0000 7f38c9200700 1 -- 172.21.15.57:0/3081121522 shutdown_connections 2024-02-28T15:58:12.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:12.770+0000 7f38c9200700 1 -- 172.21.15.57:0/3081121522 wait complete. 2024-02-28T15:58:13.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:12 smithi057 ceph-mon[28763]: pgmap v224: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 940 B/s wr, 2 op/s 2024-02-28T15:58:13.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:12 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:13.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:12 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:13.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:12 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:13.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:12 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.qwatmu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T15:58:13.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:12 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.qwatmu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T15:58:13.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:12 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:13.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:12 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3081121522' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-28T15:58:13.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:12 smithi087 ceph-mon[37122]: pgmap v224: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 940 B/s wr, 2 op/s 2024-02-28T15:58:13.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:12 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:13.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:12 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:13.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:12 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:13.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:12 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.qwatmu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T15:58:13.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:12 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.qwatmu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T15:58:13.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:12 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:13.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:12 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3081121522' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-28T15:58:13.815 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T15:58:13.825 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:58:13.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: Deploying daemon mds.cephfs.smithi057.qwatmu on smithi057 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: mds.? [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] up:boot 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3081121522' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: daemon mds.cephfs.smithi087.fzjgef assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 1 up:standby 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:creating} 2024-02-28T15:58:14.044 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:13 smithi057 ceph-mon[28763]: daemon mds.cephfs.smithi087.fzjgef is now active in filesystem cephfs as rank 1 2024-02-28T15:58:14.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: Deploying daemon mds.cephfs.smithi057.qwatmu on smithi057 2024-02-28T15:58:14.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-28T15:58:14.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: mds.? [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] up:boot 2024-02-28T15:58:14.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3081121522' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-28T15:58:14.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: daemon mds.cephfs.smithi087.fzjgef assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-28T15:58:14.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-28T15:58:14.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-28T15:58:14.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 1 up:standby 2024-02-28T15:58:14.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T15:58:14.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:creating} 2024-02-28T15:58:14.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:13 smithi087 ceph-mon[37122]: daemon mds.cephfs.smithi087.fzjgef is now active in filesystem cephfs as rank 1 2024-02-28T15:58:14.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:14 smithi057 ceph-mon[28763]: pgmap v225: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T15:58:14.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:14 smithi057 ceph-mon[28763]: mds.? [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] up:active 2024-02-28T15:58:14.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:14 smithi057 ceph-mon[28763]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2024-02-28T15:58:15.129 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:58:15.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:14 smithi087 ceph-mon[37122]: pgmap v225: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T15:58:15.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:14 smithi087 ceph-mon[37122]: mds.? [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] up:active 2024-02-28T15:58:15.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:14 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2024-02-28T15:58:16.374 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:16 smithi057 ceph-mon[28763]: pgmap v226: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-02-28T15:58:16.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:16 smithi087 ceph-mon[37122]: pgmap v226: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-02-28T15:58:17.585 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:17 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:17.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:17 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:17.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.937+0000 7f5106800700 1 -- 172.21.15.57:0/821069529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51000708c0 msgr2=0x7f5100070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:17.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.937+0000 7f5106800700 1 --2- 172.21.15.57:0/821069529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51000708c0 0x7f5100070d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50e8004940 tx=0x7f50e8009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:17.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.937+0000 7f5106800700 1 -- 172.21.15.57:0/821069529 shutdown_connections 2024-02-28T15:58:17.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.937+0000 7f5106800700 1 --2- 172.21.15.57:0/821069529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51000708c0 0x7f5100070d10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:17.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.937+0000 7f5106800700 1 --2- 172.21.15.57:0/821069529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5100071f10 0x7f5100070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:17.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.937+0000 7f5106800700 1 -- 172.21.15.57:0/821069529 >> 172.21.15.57:0/821069529 conn(0x7f51000f8620 msgr2=0x7f51000faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:17.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.937+0000 7f5106800700 1 -- 172.21.15.57:0/821069529 shutdown_connections 2024-02-28T15:58:17.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.937+0000 7f5106800700 1 -- 172.21.15.57:0/821069529 wait complete. 2024-02-28T15:58:17.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.938+0000 7f5106800700 1 Processor -- start 2024-02-28T15:58:17.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.938+0000 7f5106800700 1 -- start start 2024-02-28T15:58:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f5106800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51000708c0 0x7f51000fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f5106800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5100071f10 0x7f51000fd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f5106800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51000fd8f0 con 0x7f51000708c0 2024-02-28T15:58:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f5106800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51000fe190 con 0x7f5100071f10 2024-02-28T15:58:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f50ff400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51000708c0 0x7f51000fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f50ff400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51000708c0 0x7f51000fcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39210/0 (socket says 172.21.15.57:39210) 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f50ff400700 1 -- 172.21.15.57:0/2585830768 learned_addr learned my addr 172.21.15.57:0/2585830768 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f50f6a00700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5100071f10 0x7f51000fd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f50ff400700 1 -- 172.21.15.57:0/2585830768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5100071f10 msgr2=0x7f51000fd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f50ff400700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5100071f10 0x7f51000fd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.939+0000 7f50ff400700 1 -- 172.21.15.57:0/2585830768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8005040 con 0x7f51000708c0 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.940+0000 7f50ff400700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51000708c0 0x7f51000fcd60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f50f000ec90 tx=0x7f50f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.940+0000 7f50f7e00700 1 -- 172.21.15.57:0/2585830768 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50f0007b30 con 0x7f51000708c0 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.940+0000 7f50f7e00700 1 -- 172.21.15.57:0/2585830768 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50f000f040 con 0x7f51000708c0 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.940+0000 7f5106800700 1 -- 172.21.15.57:0/2585830768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51000fe470 con 0x7f51000708c0 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.940+0000 7f50f7e00700 1 -- 172.21.15.57:0/2585830768 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50f000cc80 con 0x7f51000708c0 2024-02-28T15:58:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.940+0000 7f5106800700 1 -- 172.21.15.57:0/2585830768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51000fe9b0 con 0x7f51000708c0 2024-02-28T15:58:17.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.942+0000 7f5106800700 1 -- 172.21.15.57:0/2585830768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510004bed0 con 0x7f51000708c0 2024-02-28T15:58:17.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.943+0000 7f50f7e00700 1 -- 172.21.15.57:0/2585830768 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f50f0007c90 con 0x7f51000708c0 2024-02-28T15:58:17.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.943+0000 7f50f7e00700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f50e40692b0 0x7f50e406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:17.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.944+0000 7f50f7e00700 1 -- 172.21.15.57:0/2585830768 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f50f00875e0 con 0x7f51000708c0 2024-02-28T15:58:17.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.944+0000 7f50f6a00700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f50e40692b0 0x7f50e406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:17.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.944+0000 7f50f6a00700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f50e40692b0 0x7f50e406b760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f50e80136a0 tx=0x7f50e8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:17.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:17.948+0000 7f50f7e00700 1 -- 172.21.15.57:0/2585830768 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f50f0053890 con 0x7f51000708c0 2024-02-28T15:58:18.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.207+0000 7f5106800700 1 -- 172.21.15.57:0/2585830768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f51000fed90 con 0x7f51000708c0 2024-02-28T15:58:18.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.400+0000 7f50f7e00700 1 -- 172.21.15.57:0/2585830768 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f50f0056eb0 con 0x7f51000708c0 2024-02-28T15:58:18.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.404+0000 7f5106800700 1 -- 172.21.15.57:0/2585830768 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f50e40692b0 msgr2=0x7f50e406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:18.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.404+0000 7f5106800700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f50e40692b0 0x7f50e406b760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f50e80136a0 tx=0x7f50e8009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:18.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.404+0000 7f5106800700 1 -- 172.21.15.57:0/2585830768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51000708c0 msgr2=0x7f51000fcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:18.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.404+0000 7f5106800700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51000708c0 0x7f51000fcd60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f50f000ec90 tx=0x7f50f000b040 comp rx=0 tx=0).stop 2024-02-28T15:58:18.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.404+0000 7f5106800700 1 -- 172.21.15.57:0/2585830768 shutdown_connections 2024-02-28T15:58:18.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.404+0000 7f5106800700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f50e40692b0 0x7f50e406b760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:18.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.404+0000 7f5106800700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51000708c0 0x7f51000fcd60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:18.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.404+0000 7f5106800700 1 --2- 172.21.15.57:0/2585830768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5100071f10 0x7f51000fd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:18.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.404+0000 7f5106800700 1 -- 172.21.15.57:0/2585830768 >> 172.21.15.57:0/2585830768 conn(0x7f51000f8620 msgr2=0x7f5100102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:18.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.405+0000 7f5106800700 1 -- 172.21.15.57:0/2585830768 shutdown_connections 2024-02-28T15:58:18.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:18.405+0000 7f5106800700 1 -- 172.21.15.57:0/2585830768 wait complete. 2024-02-28T15:58:18.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:18 smithi057 ceph-mon[28763]: pgmap v227: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-02-28T15:58:18.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:18.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:18.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:18.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.whebmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T15:58:18.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.whebmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T15:58:18.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:18 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:18.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:18 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2585830768' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-28T15:58:18.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:18 smithi087 ceph-mon[37122]: pgmap v227: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-02-28T15:58:18.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:18.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:18.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:18.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.whebmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T15:58:18.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.whebmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T15:58:18.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:18 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:18.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:18 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2585830768' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-28T15:58:19.291 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T15:58:19.301 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:58:19.301 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-02-28T15:58:19.647 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:19 smithi087 ceph-mon[37122]: Deploying daemon mds.cephfs.smithi087.whebmo on smithi087 2024-02-28T15:58:19.647 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:19 smithi087 ceph-mon[37122]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-28T15:58:19.647 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:19 smithi087 ceph-mon[37122]: Cluster is now healthy 2024-02-28T15:58:19.647 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:19 smithi087 ceph-mon[37122]: mds.? [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] up:boot 2024-02-28T15:58:19.647 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:19 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2585830768' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-28T15:58:19.647 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:19 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 1 up:standby 2024-02-28T15:58:19.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:19 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T15:58:19.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:19 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 1 up:standby-replay 2024-02-28T15:58:19.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:19 smithi057 ceph-mon[28763]: Deploying daemon mds.cephfs.smithi087.whebmo on smithi087 2024-02-28T15:58:19.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:19 smithi057 ceph-mon[28763]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-28T15:58:19.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:19 smithi057 ceph-mon[28763]: Cluster is now healthy 2024-02-28T15:58:19.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:19 smithi057 ceph-mon[28763]: mds.? [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] up:boot 2024-02-28T15:58:19.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:19 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2585830768' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-28T15:58:19.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:19 smithi057 ceph-mon[28763]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 1 up:standby 2024-02-28T15:58:19.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:19 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T15:58:19.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:19 smithi057 ceph-mon[28763]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 1 up:standby-replay 2024-02-28T15:58:19.814 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:58:20.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:20 smithi057 ceph-mon[28763]: pgmap v228: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2024-02-28T15:58:20.683 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:20 smithi087 ceph-mon[37122]: pgmap v228: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2024-02-28T15:58:21.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.937+0000 7f06bb600700 1 -- 172.21.15.57:0/600736737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4103500 msgr2=0x7f06b4103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:21.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.937+0000 7f06bb600700 1 --2- 172.21.15.57:0/600736737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4103500 0x7f06b4103910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009ce0 tx=0x7f06a8004d10 comp rx=0 tx=0).stop 2024-02-28T15:58:21.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.938+0000 7f06bb600700 1 -- 172.21.15.57:0/600736737 shutdown_connections 2024-02-28T15:58:21.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.938+0000 7f06bb600700 1 --2- 172.21.15.57:0/600736737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b4104710 0x7f06b4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:21.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.938+0000 7f06bb600700 1 --2- 172.21.15.57:0/600736737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4103500 0x7f06b4103910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:21.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.938+0000 7f06bb600700 1 -- 172.21.15.57:0/600736737 >> 172.21.15.57:0/600736737 conn(0x7f06b40725c0 msgr2=0x7f06b4074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:21.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.938+0000 7f06bb600700 1 -- 172.21.15.57:0/600736737 shutdown_connections 2024-02-28T15:58:21.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.938+0000 7f06bb600700 1 -- 172.21.15.57:0/600736737 wait complete. 2024-02-28T15:58:21.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.939+0000 7f06bb600700 1 Processor -- start 2024-02-28T15:58:21.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.939+0000 7f06bb600700 1 -- start start 2024-02-28T15:58:21.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.940+0000 7f06bb600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4103500 0x7f06b41140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:21.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.940+0000 7f06bb600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b4104710 0x7f06b41145f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:21.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.940+0000 7f06bb600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b4114bf0 con 0x7f06b4103500 2024-02-28T15:58:21.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.940+0000 7f06bb600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b4115490 con 0x7f06b4104710 2024-02-28T15:58:21.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.940+0000 7f06b8c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4103500 0x7f06b41140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:21.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.940+0000 7f06b8c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4103500 0x7f06b41140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52176/0 (socket says 172.21.15.57:52176) 2024-02-28T15:58:21.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.940+0000 7f06b8c00700 1 -- 172.21.15.57:0/341932485 learned_addr learned my addr 172.21.15.57:0/341932485 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:21.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.940+0000 7f06b3e00700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b4104710 0x7f06b41145f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:21.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.941+0000 7f06b8c00700 1 -- 172.21.15.57:0/341932485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b4104710 msgr2=0x7f06b41145f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:21.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.941+0000 7f06b8c00700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b4104710 0x7f06b41145f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:21.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.941+0000 7f06b8c00700 1 -- 172.21.15.57:0/341932485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8009940 con 0x7f06b4103500 2024-02-28T15:58:21.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.941+0000 7f06b8c00700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4103500 0x7f06b41140b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009380 tx=0x7f06a8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:21.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.941+0000 7f06b0c00700 1 -- 172.21.15.57:0/341932485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a800e040 con 0x7f06b4103500 2024-02-28T15:58:21.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.941+0000 7f06b0c00700 1 -- 172.21.15.57:0/341932485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06a80128e0 con 0x7f06b4103500 2024-02-28T15:58:21.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.941+0000 7f06b0c00700 1 -- 172.21.15.57:0/341932485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a801ca50 con 0x7f06b4103500 2024-02-28T15:58:21.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.941+0000 7f06bb600700 1 -- 172.21.15.57:0/341932485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b4115710 con 0x7f06b4103500 2024-02-28T15:58:21.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.942+0000 7f06bb600700 1 -- 172.21.15.57:0/341932485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b4115c50 con 0x7f06b4103500 2024-02-28T15:58:21.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.943+0000 7f06a6000700 1 -- 172.21.15.57:0/341932485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06900052b0 con 0x7f06b4103500 2024-02-28T15:58:21.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.944+0000 7f06b0c00700 1 -- 172.21.15.57:0/341932485 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f06a8012a50 con 0x7f06b4103500 2024-02-28T15:58:21.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.945+0000 7f06b0c00700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f069c0692b0 0x7f069c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:21.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.945+0000 7f06b0c00700 1 -- 172.21.15.57:0/341932485 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f06a8088e50 con 0x7f06b4103500 2024-02-28T15:58:21.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.945+0000 7f06b3e00700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f069c0692b0 0x7f069c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:21.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.946+0000 7f06b3e00700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f069c0692b0 0x7f069c06b760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06a0007fd0 tx=0x7f06a0009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:21.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:21.950+0000 7f06b0c00700 1 -- 172.21.15.57:0/341932485 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f06a8058c10 con 0x7f06b4103500 2024-02-28T15:58:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.240+0000 7f06a6000700 1 -- 172.21.15.57:0/341932485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f0690005ae0 con 0x7f06b4103500 2024-02-28T15:58:22.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.311+0000 7f06b0c00700 1 -- 172.21.15.57:0/341932485 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v11) v1 ==== 133+0+0 (secure 0 0 0) 0x7f06a80587a0 con 0x7f06b4103500 2024-02-28T15:58:22.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.314+0000 7f06a6000700 1 -- 172.21.15.57:0/341932485 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f069c0692b0 msgr2=0x7f069c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:22.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.314+0000 7f06a6000700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f069c0692b0 0x7f069c06b760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06a0007fd0 tx=0x7f06a0009040 comp rx=0 tx=0).stop 2024-02-28T15:58:22.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.314+0000 7f06a6000700 1 -- 172.21.15.57:0/341932485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4103500 msgr2=0x7f06b41140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:22.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.314+0000 7f06a6000700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4103500 0x7f06b41140b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009380 tx=0x7f06a8004d10 comp rx=0 tx=0).stop 2024-02-28T15:58:22.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.315+0000 7f06a6000700 1 -- 172.21.15.57:0/341932485 shutdown_connections 2024-02-28T15:58:22.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.315+0000 7f06a6000700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f069c0692b0 0x7f069c06b760 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:22.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.315+0000 7f06a6000700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4103500 0x7f06b41140b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:22.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.315+0000 7f06a6000700 1 --2- 172.21.15.57:0/341932485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b4104710 0x7f06b41145f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:22.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.315+0000 7f06a6000700 1 -- 172.21.15.57:0/341932485 >> 172.21.15.57:0/341932485 conn(0x7f06b40725c0 msgr2=0x7f06b4107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:22.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.315+0000 7f06a6000700 1 -- 172.21.15.57:0/341932485 shutdown_connections 2024-02-28T15:58:22.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:22.315+0000 7f06a6000700 1 -- 172.21.15.57:0/341932485 wait complete. 2024-02-28T15:58:22.311 INFO:teuthology.orchestra.run.smithi057.stderr:inline data disabled 2024-02-28T15:58:22.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:58:22.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:22 smithi057 ceph-mon[28763]: pgmap v229: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-02-28T15:58:22.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:22 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:58:22.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:22 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/341932485' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-28T15:58:22.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:58:22.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:22 smithi087 ceph-mon[37122]: pgmap v229: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-02-28T15:58:22.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:22.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:22 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:58:22.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:22 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/341932485' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-28T15:58:23.209 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T15:58:23.219 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:58:23.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T15:58:23.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:23 smithi057 ceph-mon[28763]: mds.? [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] up:boot 2024-02-28T15:58:23.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:23 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/341932485' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-28T15:58:23.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:23 smithi057 ceph-mon[28763]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 1 up:standby-replay 1 up:standby 2024-02-28T15:58:23.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:23 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T15:58:23.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:23 smithi057 ceph-mon[28763]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T15:58:23.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:23 smithi087 ceph-mon[37122]: mds.? [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] up:boot 2024-02-28T15:58:23.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:23 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/341932485' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-28T15:58:23.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:23 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 1 up:standby-replay 1 up:standby 2024-02-28T15:58:23.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:23 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T15:58:23.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:23 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T15:58:24.118 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:58:24.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:24 smithi087 ceph-mon[37122]: pgmap v230: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-02-28T15:58:24.589 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:24 smithi057 ceph-mon[28763]: pgmap v230: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-02-28T15:58:26.412 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:26 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:26.412 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:26 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:26.412 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:26 smithi057 ceph-mon[28763]: pgmap v231: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-02-28T15:58:26.412 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:26 smithi057 ceph-mon[28763]: mds.? [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] up:active 2024-02-28T15:58:26.412 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:26 smithi057 ceph-mon[28763]: mds.? [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] up:active 2024-02-28T15:58:26.412 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:26 smithi057 ceph-mon[28763]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T15:58:26.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:26 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:26.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:26 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:26.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:26 smithi087 ceph-mon[37122]: pgmap v231: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-02-28T15:58:26.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:26 smithi087 ceph-mon[37122]: mds.? [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] up:active 2024-02-28T15:58:26.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:26 smithi087 ceph-mon[37122]: mds.? [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] up:active 2024-02-28T15:58:26.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:26 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T15:58:26.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.712+0000 7f8a9aa00700 1 -- 172.21.15.57:0/1415437988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94103540 msgr2=0x7f8a94103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:26.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.712+0000 7f8a9aa00700 1 --2- 172.21.15.57:0/1415437988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94103540 0x7f8a94103950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8a84004940 tx=0x7f8a84009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:26.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.712+0000 7f8a9aa00700 1 -- 172.21.15.57:0/1415437988 shutdown_connections 2024-02-28T15:58:26.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.712+0000 7f8a9aa00700 1 --2- 172.21.15.57:0/1415437988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a94104750 0x7f8a94104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:26.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.712+0000 7f8a9aa00700 1 --2- 172.21.15.57:0/1415437988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94103540 0x7f8a94103950 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:26.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.712+0000 7f8a9aa00700 1 -- 172.21.15.57:0/1415437988 >> 172.21.15.57:0/1415437988 conn(0x7f8a940727d0 msgr2=0x7f8a94074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:26.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.713+0000 7f8a9aa00700 1 -- 172.21.15.57:0/1415437988 shutdown_connections 2024-02-28T15:58:26.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.713+0000 7f8a9aa00700 1 -- 172.21.15.57:0/1415437988 wait complete. 2024-02-28T15:58:26.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.713+0000 7f8a9aa00700 1 Processor -- start 2024-02-28T15:58:26.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.714+0000 7f8a9aa00700 1 -- start start 2024-02-28T15:58:26.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.714+0000 7f8a9aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a94103540 0x7f8a94113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:26.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.714+0000 7f8a9aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94104750 0x7f8a941144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:26.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.714+0000 7f8a9aa00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94114aa0 con 0x7f8a94104750 2024-02-28T15:58:26.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.714+0000 7f8a9aa00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94115340 con 0x7f8a94103540 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.714+0000 7f8a8be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94104750 0x7f8a941144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.714+0000 7f8a8be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94104750 0x7f8a941144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52192/0 (socket says 172.21.15.57:52192) 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.714+0000 7f8a8be00700 1 -- 172.21.15.57:0/574079847 learned_addr learned my addr 172.21.15.57:0/574079847 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.714+0000 7f8a93e00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a94103540 0x7f8a94113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.715+0000 7f8a8be00700 1 -- 172.21.15.57:0/574079847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a94103540 msgr2=0x7f8a94113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.715+0000 7f8a8be00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a94103540 0x7f8a94113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.715+0000 7f8a8be00700 1 -- 172.21.15.57:0/574079847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84005040 con 0x7f8a94104750 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.715+0000 7f8a93e00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a94103540 0x7f8a94113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.715+0000 7f8a8be00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94104750 0x7f8a941144a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c002a50 tx=0x7f8a7c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.715+0000 7f8a90c00700 1 -- 172.21.15.57:0/574079847 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a7c007cc0 con 0x7f8a94104750 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.715+0000 7f8a90c00700 1 -- 172.21.15.57:0/574079847 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a7c00f040 con 0x7f8a94104750 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.715+0000 7f8a90c00700 1 -- 172.21.15.57:0/574079847 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a7c009640 con 0x7f8a94104750 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.715+0000 7f8a9aa00700 1 -- 172.21.15.57:0/574079847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a94115620 con 0x7f8a94104750 2024-02-28T15:58:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.715+0000 7f8a9aa00700 1 -- 172.21.15.57:0/574079847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a94115b60 con 0x7f8a94104750 2024-02-28T15:58:26.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.716+0000 7f8a9aa00700 1 -- 172.21.15.57:0/574079847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9404bed0 con 0x7f8a94104750 2024-02-28T15:58:26.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.717+0000 7f8a90c00700 1 -- 172.21.15.57:0/574079847 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f8a7c0097a0 con 0x7f8a94104750 2024-02-28T15:58:26.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.718+0000 7f8a90c00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8a780692b0 0x7f8a7806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:26.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.718+0000 7f8a90c00700 1 -- 172.21.15.57:0/574079847 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8a7c086f50 con 0x7f8a94104750 2024-02-28T15:58:26.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.719+0000 7f8a93e00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8a780692b0 0x7f8a7806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:26.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.719+0000 7f8a93e00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8a780692b0 0x7f8a7806b760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400b7a0 tx=0x7f8a84009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:26.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.723+0000 7f8a90c00700 1 -- 172.21.15.57:0/574079847 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8a7c056c70 con 0x7f8a94104750 2024-02-28T15:58:26.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.994+0000 7f8a9aa00700 1 -- 172.21.15.57:0/574079847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8a94115f90 con 0x7f8a94104750 2024-02-28T15:58:26.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.995+0000 7f8a90c00700 1 -- 172.21.15.57:0/574079847 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1825 (secure 0 0 0) 0x7f8a7c056800 con 0x7f8a94104750 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:e14 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 14 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T15:58:26.323114+0000 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T15:58:26.989 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T15:58:26.990 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T15:58:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T15:58:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T15:58:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T15:58:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:58:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:58:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:58:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:58:26.991 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:58:26.991 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:58:26.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.998+0000 7f8a9aa00700 1 -- 172.21.15.57:0/574079847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8a780692b0 msgr2=0x7f8a7806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:26.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.998+0000 7f8a9aa00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8a780692b0 0x7f8a7806b760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400b7a0 tx=0x7f8a84009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:26.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.998+0000 7f8a9aa00700 1 -- 172.21.15.57:0/574079847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94104750 msgr2=0x7f8a941144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:26.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.998+0000 7f8a9aa00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94104750 0x7f8a941144a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c002a50 tx=0x7f8a7c0046b0 comp rx=0 tx=0).stop 2024-02-28T15:58:26.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.998+0000 7f8a9aa00700 1 -- 172.21.15.57:0/574079847 shutdown_connections 2024-02-28T15:58:26.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.998+0000 7f8a9aa00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8a780692b0 0x7f8a7806b760 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:26.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.998+0000 7f8a9aa00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a94103540 0x7f8a94113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:26.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.998+0000 7f8a9aa00700 1 --2- 172.21.15.57:0/574079847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94104750 0x7f8a941144a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:26.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.998+0000 7f8a9aa00700 1 -- 172.21.15.57:0/574079847 >> 172.21.15.57:0/574079847 conn(0x7f8a940727d0 msgr2=0x7f8a94107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:26.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.998+0000 7f8a9aa00700 1 -- 172.21.15.57:0/574079847 shutdown_connections 2024-02-28T15:58:26.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:26.999+0000 7f8a9aa00700 1 -- 172.21.15.57:0/574079847 wait complete. 2024-02-28T15:58:26.993 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-02-28T15:58:27.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:27 smithi057 ceph-mon[28763]: mds.? [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] up:standby-replay 2024-02-28T15:58:27.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:27 smithi057 ceph-mon[28763]: mds.? [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] up:standby-replay 2024-02-28T15:58:27.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:27 smithi057 ceph-mon[28763]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T15:58:27.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:27 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:27.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:27 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/574079847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T15:58:27.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:27 smithi087 ceph-mon[37122]: mds.? [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] up:standby-replay 2024-02-28T15:58:27.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:27 smithi087 ceph-mon[37122]: mds.? [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] up:standby-replay 2024-02-28T15:58:27.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:27 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T15:58:27.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:27 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:27.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:27 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/574079847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T15:58:28.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-28T15:58:28.656 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:28 smithi057 ceph-mon[28763]: pgmap v232: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-28T15:58:28.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:28 smithi087 ceph-mon[37122]: pgmap v232: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-28T15:58:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:58:30.651 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:30 smithi057 ceph-mon[28763]: pgmap v233: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-28T15:58:30.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:30 smithi087 ceph-mon[37122]: pgmap v233: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-28T15:58:31.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.839+0000 7fb57d400700 1 -- 172.21.15.57:0/3196545938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb578071f10 msgr2=0x7fb578070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:31.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.839+0000 7fb57d400700 1 --2- 172.21.15.57:0/3196545938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb578071f10 0x7fb578070380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb568004940 tx=0x7fb568009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:31.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.840+0000 7fb57d400700 1 -- 172.21.15.57:0/3196545938 shutdown_connections 2024-02-28T15:58:31.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.840+0000 7fb57d400700 1 --2- 172.21.15.57:0/3196545938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5780708c0 0x7fb578070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:31.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.840+0000 7fb57d400700 1 --2- 172.21.15.57:0/3196545938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb578071f10 0x7fb578070380 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:31.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.840+0000 7fb57d400700 1 -- 172.21.15.57:0/3196545938 >> 172.21.15.57:0/3196545938 conn(0x7fb5780f8620 msgr2=0x7fb5780faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:31.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.840+0000 7fb57d400700 1 -- 172.21.15.57:0/3196545938 shutdown_connections 2024-02-28T15:58:31.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.840+0000 7fb57d400700 1 -- 172.21.15.57:0/3196545938 wait complete. 2024-02-28T15:58:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.841+0000 7fb57d400700 1 Processor -- start 2024-02-28T15:58:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.841+0000 7fb57d400700 1 -- start start 2024-02-28T15:58:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.842+0000 7fb57d400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5780708c0 0x7fb57810fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.842+0000 7fb57d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb578071f10 0x7fb5781100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.842+0000 7fb57d400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5781106e0 con 0x7fb578071f10 2024-02-28T15:58:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.842+0000 7fb57d400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb578110f80 con 0x7fb5780708c0 2024-02-28T15:58:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.842+0000 7fb575e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb578071f10 0x7fb5781100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.842+0000 7fb575e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb578071f10 0x7fb5781100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52206/0 (socket says 172.21.15.57:52206) 2024-02-28T15:58:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.842+0000 7fb575e00700 1 -- 172.21.15.57:0/2838283582 learned_addr learned my addr 172.21.15.57:0/2838283582 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:31.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.842+0000 7fb576800700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5780708c0 0x7fb57810fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:31.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.842+0000 7fb575e00700 1 -- 172.21.15.57:0/2838283582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5780708c0 msgr2=0x7fb57810fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:31.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.842+0000 7fb575e00700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5780708c0 0x7fb57810fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:31.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.843+0000 7fb575e00700 1 -- 172.21.15.57:0/2838283582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb568005040 con 0x7fb578071f10 2024-02-28T15:58:31.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.843+0000 7fb575e00700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb578071f10 0x7fb5781100e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb564002a50 tx=0x7fb5640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:31.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.843+0000 7fb56ea00700 1 -- 172.21.15.57:0/2838283582 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb564007cc0 con 0x7fb578071f10 2024-02-28T15:58:31.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.843+0000 7fb56ea00700 1 -- 172.21.15.57:0/2838283582 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb56400f040 con 0x7fb578071f10 2024-02-28T15:58:31.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.843+0000 7fb57d400700 1 -- 172.21.15.57:0/2838283582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb578111260 con 0x7fb578071f10 2024-02-28T15:58:31.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.843+0000 7fb57d400700 1 -- 172.21.15.57:0/2838283582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5781117a0 con 0x7fb578071f10 2024-02-28T15:58:31.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.844+0000 7fb56ea00700 1 -- 172.21.15.57:0/2838283582 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb56400da30 con 0x7fb578071f10 2024-02-28T15:58:31.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.845+0000 7fb57d400700 1 -- 172.21.15.57:0/2838283582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5580052e0 con 0x7fb578071f10 2024-02-28T15:58:31.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.846+0000 7fb56ea00700 1 -- 172.21.15.57:0/2838283582 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fb56400dc70 con 0x7fb578071f10 2024-02-28T15:58:31.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.847+0000 7fb56ea00700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb55c0692b0 0x7fb55c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:31.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.847+0000 7fb56ea00700 1 -- 172.21.15.57:0/2838283582 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb564086df0 con 0x7fb578071f10 2024-02-28T15:58:31.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.847+0000 7fb576800700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb55c0692b0 0x7fb55c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:31.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.848+0000 7fb576800700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb55c0692b0 0x7fb55c06b760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb568009fd0 tx=0x7fb568009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:31.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:31.852+0000 7fb56ea00700 1 -- 172.21.15.57:0/2838283582 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb564056bb0 con 0x7fb578071f10 2024-02-28T15:58:32.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.124+0000 7fb57d400700 1 -- 172.21.15.57:0/2838283582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb558005b10 con 0x7fb578071f10 2024-02-28T15:58:32.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.125+0000 7fb56ea00700 1 -- 172.21.15.57:0/2838283582 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4711 (secure 0 0 0) 0x7fb564056740 con 0x7fb578071f10 2024-02-28T15:58:32.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.127+0000 7fb57d400700 1 -- 172.21.15.57:0/2838283582 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb55c0692b0 msgr2=0x7fb55c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:32.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.127+0000 7fb57d400700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb55c0692b0 0x7fb55c06b760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb568009fd0 tx=0x7fb568009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:32.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.127+0000 7fb57d400700 1 -- 172.21.15.57:0/2838283582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb578071f10 msgr2=0x7fb5781100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:32.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.127+0000 7fb57d400700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb578071f10 0x7fb5781100e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb564002a50 tx=0x7fb5640046b0 comp rx=0 tx=0).stop 2024-02-28T15:58:32.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.128+0000 7fb57d400700 1 -- 172.21.15.57:0/2838283582 shutdown_connections 2024-02-28T15:58:32.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.128+0000 7fb57d400700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb55c0692b0 0x7fb55c06b760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:32.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.128+0000 7fb57d400700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5780708c0 0x7fb57810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:32.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.128+0000 7fb57d400700 1 --2- 172.21.15.57:0/2838283582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb578071f10 0x7fb5781100e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:32.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.128+0000 7fb57d400700 1 -- 172.21.15.57:0/2838283582 >> 172.21.15.57:0/2838283582 conn(0x7fb5780f8620 msgr2=0x7fb578102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:32.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.128+0000 7fb57d400700 1 -- 172.21.15.57:0/2838283582 shutdown_connections 2024-02-28T15:58:32.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:32.129+0000 7fb57d400700 1 -- 172.21.15.57:0/2838283582 wait complete. 2024-02-28T15:58:32.124 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-02-28T15:58:32.138 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T15:58:32.489 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:32 smithi057 ceph-mon[28763]: pgmap v234: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-28T15:58:32.489 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:32.489 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:32.489 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:32.489 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:58:32.489 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:32.489 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:32 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:58:32.489 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:32 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2838283582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T15:58:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:32 smithi087 ceph-mon[37122]: pgmap v234: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-28T15:58:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:58:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:32 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:58:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:32 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2838283582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T15:58:32.938 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-28T15:58:34.059 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:58:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:34 smithi057 ceph-mon[28763]: pgmap v235: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-28T15:58:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:34 smithi087 ceph-mon[37122]: pgmap v235: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-28T15:58:36.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:36 smithi087 ceph-mon[37122]: pgmap v236: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 5 op/s 2024-02-28T15:58:36.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:36.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:36.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:36 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:58:36.753 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:36 smithi057 ceph-mon[28763]: pgmap v236: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 5 op/s 2024-02-28T15:58:36.754 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:36.754 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:36.754 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:36 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:58:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.841+0000 7f3d15e00700 1 -- 172.21.15.57:0/1069570945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d100fcef0 msgr2=0x7f3d100fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.841+0000 7f3d15e00700 1 --2- 172.21.15.57:0/1069570945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d100fcef0 0x7f3d100fd320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3d00004940 tx=0x7f3d00009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.841+0000 7f3d15e00700 1 -- 172.21.15.57:0/1069570945 shutdown_connections 2024-02-28T15:58:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.841+0000 7f3d15e00700 1 --2- 172.21.15.57:0/1069570945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d100fe0e0 0x7f3d100fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.841+0000 7f3d15e00700 1 --2- 172.21.15.57:0/1069570945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d100fcef0 0x7f3d100fd320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.841+0000 7f3d15e00700 1 -- 172.21.15.57:0/1069570945 >> 172.21.15.57:0/1069570945 conn(0x7f3d100f8620 msgr2=0x7f3d100faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.841+0000 7f3d15e00700 1 -- 172.21.15.57:0/1069570945 shutdown_connections 2024-02-28T15:58:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.841+0000 7f3d15e00700 1 -- 172.21.15.57:0/1069570945 wait complete. 2024-02-28T15:58:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.842+0000 7f3d15e00700 1 Processor -- start 2024-02-28T15:58:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.842+0000 7f3d15e00700 1 -- start start 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.842+0000 7f3d15e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d100fcef0 0x7f3d1010fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d15e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d100fe0e0 0x7f3d101100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d15e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101106c0 con 0x7f3d100fe0e0 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d15e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10110f60 con 0x7f3d100fcef0 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d0e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d100fe0e0 0x7f3d101100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d0e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d100fe0e0 0x7f3d101100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53530/0 (socket says 172.21.15.57:53530) 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d0e000700 1 -- 172.21.15.57:0/21711571 learned_addr learned my addr 172.21.15.57:0/21711571 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d0ea00700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d100fcef0 0x7f3d1010fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d0e000700 1 -- 172.21.15.57:0/21711571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d100fcef0 msgr2=0x7f3d1010fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d0e000700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d100fcef0 0x7f3d1010fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d0e000700 1 -- 172.21.15.57:0/21711571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00005040 con 0x7f3d100fe0e0 2024-02-28T15:58:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.843+0000 7f3d0ea00700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d100fcef0 0x7f3d1010fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T15:58:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.844+0000 7f3d0e000700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d100fe0e0 0x7f3d101100c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc002a50 tx=0x7f3cfc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.844+0000 7f3d06a00700 1 -- 172.21.15.57:0/21711571 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cfc007cc0 con 0x7f3d100fe0e0 2024-02-28T15:58:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.844+0000 7f3d06a00700 1 -- 172.21.15.57:0/21711571 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cfc00f040 con 0x7f3d100fe0e0 2024-02-28T15:58:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.844+0000 7f3d06a00700 1 -- 172.21.15.57:0/21711571 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cfc009640 con 0x7f3d100fe0e0 2024-02-28T15:58:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.844+0000 7f3d15e00700 1 -- 172.21.15.57:0/21711571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d10111240 con 0x7f3d100fe0e0 2024-02-28T15:58:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.844+0000 7f3d15e00700 1 -- 172.21.15.57:0/21711571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d10111780 con 0x7f3d100fe0e0 2024-02-28T15:58:36.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.846+0000 7f3d15e00700 1 -- 172.21.15.57:0/21711571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d10102210 con 0x7f3d100fe0e0 2024-02-28T15:58:36.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.846+0000 7f3d06a00700 1 -- 172.21.15.57:0/21711571 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f3cfc0097a0 con 0x7f3d100fe0e0 2024-02-28T15:58:36.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.847+0000 7f3d06a00700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3cf40692a0 0x7f3cf406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:36.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.847+0000 7f3d06a00700 1 -- 172.21.15.57:0/21711571 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3cfc086eb0 con 0x7f3d100fe0e0 2024-02-28T15:58:36.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.848+0000 7f3d0ea00700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3cf40692a0 0x7f3cf406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:36.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.849+0000 7f3d0ea00700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3cf40692a0 0x7f3cf406b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000b3b0 tx=0x7f3d00009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:36.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:36.852+0000 7f3d06a00700 1 -- 172.21.15.57:0/21711571 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3cfc056c70 con 0x7f3d100fe0e0 2024-02-28T15:58:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.161+0000 7f3d15e00700 1 -- 172.21.15.57:0/21711571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f3d1004bed0 con 0x7f3d100fe0e0 2024-02-28T15:58:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.161+0000 7f3d06a00700 1 -- 172.21.15.57:0/21711571 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+99 (secure 0 0 0) 0x7f3cfc056800 con 0x7f3d100fe0e0 2024-02-28T15:58:37.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 -- 172.21.15.57:0/21711571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3cf40692a0 msgr2=0x7f3cf406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:37.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3cf40692a0 0x7f3cf406b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000b3b0 tx=0x7f3d00009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:37.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 -- 172.21.15.57:0/21711571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d100fe0e0 msgr2=0x7f3d101100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:37.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d100fe0e0 0x7f3d101100c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc002a50 tx=0x7f3cfc0046b0 comp rx=0 tx=0).stop 2024-02-28T15:58:37.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 -- 172.21.15.57:0/21711571 shutdown_connections 2024-02-28T15:58:37.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3cf40692a0 0x7f3cf406b750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:37.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d100fcef0 0x7f3d1010fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:37.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 --2- 172.21.15.57:0/21711571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d100fe0e0 0x7f3d101100c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:37.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 -- 172.21.15.57:0/21711571 >> 172.21.15.57:0/21711571 conn(0x7f3d100f8620 msgr2=0x7f3d100ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:37.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 -- 172.21.15.57:0/21711571 shutdown_connections 2024-02-28T15:58:37.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:37.164+0000 7f3d15e00700 1 -- 172.21.15.57:0/21711571 wait complete. 2024-02-28T15:58:37.173 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T15:58:37.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:37 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/21711571' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-28T15:58:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:37 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/21711571' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-28T15:58:38.392 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-28T15:58:38.404 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.624+0000 7fd809800640 1 -- 172.21.15.57:0/1161839907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8040fc470 msgr2=0x7fd8040fc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.624+0000 7fd809800640 1 --2- 172.21.15.57:0/1161839907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8040fc470 0x7fd8040fc8e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0048d0 tx=0x7fd7ec009da0 comp rx=0 tx=0).stop 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.624+0000 7fd809800640 1 -- 172.21.15.57:0/1161839907 shutdown_connections 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.624+0000 7fd809800640 1 --2- 172.21.15.57:0/1161839907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8040fc470 0x7fd8040fc8e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.624+0000 7fd809800640 1 --2- 172.21.15.57:0/1161839907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8040fb1a0 0x7fd8040fb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.624+0000 7fd809800640 1 -- 172.21.15.57:0/1161839907 >> 172.21.15.57:0/1161839907 conn(0x7fd8040f6960 msgr2=0x7fd8040f8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.624+0000 7fd809800640 1 -- 172.21.15.57:0/1161839907 shutdown_connections 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.624+0000 7fd809800640 1 -- 172.21.15.57:0/1161839907 wait complete. 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.625+0000 7fd809800640 1 Processor -- start 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.625+0000 7fd809800640 1 -- start start 2024-02-28T15:58:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.625+0000 7fd809800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8040fb1a0 0x7fd80410ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.625+0000 7fd809800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8040fc470 0x7fd80410f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.625+0000 7fd809800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80410f8f0 con 0x7fd8040fb1a0 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.625+0000 7fd809800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd804114300 con 0x7fd8040fc470 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.626+0000 7fd802a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8040fb1a0 0x7fd80410ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.626+0000 7fd802a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8040fb1a0 0x7fd80410ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53546/0 (socket says 172.21.15.57:53546) 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.626+0000 7fd802a00640 1 -- 172.21.15.57:0/1480277518 learned_addr learned my addr 172.21.15.57:0/1480277518 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.626+0000 7fd802a00640 1 -- 172.21.15.57:0/1480277518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8040fc470 msgr2=0x7fd80410f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.626+0000 7fd802a00640 1 --2- 172.21.15.57:0/1480277518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8040fc470 0x7fd80410f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.626+0000 7fd802a00640 1 -- 172.21.15.57:0/1480277518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec005040 con 0x7fd8040fb1a0 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.626+0000 7fd802a00640 1 --2- 172.21.15.57:0/1480277518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8040fb1a0 0x7fd80410ed60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4002a50 tx=0x7fd7f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.627+0000 7fd7faa00640 1 -- 172.21.15.57:0/1480277518 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f4007c30 con 0x7fd8040fb1a0 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.627+0000 7fd7faa00640 1 -- 172.21.15.57:0/1480277518 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7f400f040 con 0x7fd8040fb1a0 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.627+0000 7fd809800640 1 -- 172.21.15.57:0/1480277518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8041144a0 con 0x7fd8040fb1a0 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.627+0000 7fd7faa00640 1 -- 172.21.15.57:0/1480277518 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f400db50 con 0x7fd8040fb1a0 2024-02-28T15:58:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.627+0000 7fd809800640 1 -- 172.21.15.57:0/1480277518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd804114970 con 0x7fd8040fb1a0 2024-02-28T15:58:38.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.628+0000 7fd809800640 1 -- 172.21.15.57:0/1480277518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd804102490 con 0x7fd8040fb1a0 2024-02-28T15:58:38.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.629+0000 7fd7faa00640 1 -- 172.21.15.57:0/1480277518 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fd7f401c400 con 0x7fd8040fb1a0 2024-02-28T15:58:38.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.630+0000 7fd7faa00640 1 --2- 172.21.15.57:0/1480277518 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e8069210 0x7fd7e806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:38.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.630+0000 7fd7faa00640 1 -- 172.21.15.57:0/1480277518 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd7f4086b60 con 0x7fd8040fb1a0 2024-02-28T15:58:38.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.630+0000 7fd7fbe00640 1 --2- 172.21.15.57:0/1480277518 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e8069210 0x7fd7e806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:38.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.631+0000 7fd7fbe00640 1 --2- 172.21.15.57:0/1480277518 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e8069210 0x7fd7e806b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec034040 tx=0x7fd7ec009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:38.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.635+0000 7fd7faa00640 1 -- 172.21.15.57:0/1480277518 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd7f404cbd0 con 0x7fd8040fb1a0 2024-02-28T15:58:38.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:38 smithi057 ceph-mon[28763]: pgmap v237: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-28T15:58:38.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:38 smithi087 ceph-mon[37122]: pgmap v237: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-28T15:58:38.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.834+0000 7fd809800640 1 -- 172.21.15.57:0/1480277518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd804104e10 con 0x7fd8040fb1a0 2024-02-28T15:58:38.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.836+0000 7fd7faa00640 1 -- 172.21.15.57:0/1480277518 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14220 (secure 0 0 0) 0x7fd7f4052d70 con 0x7fd8040fb1a0 2024-02-28T15:58:38.829 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:58:38.829 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":46,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","created":"2024-02-28T15:49:03.036724+0000","modified":"2024-02-28T15:58:05.703087+0000","last_up_change":"2024-02-28T15:56:28.099575+0000","last_in_change":"2024-02-28T15:56:03.811536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T15:54:45.908218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T15:58:02.602649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T15:58:03.211266+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7a78e2ba-3bfe-4677-b633-f2095c44065f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6803","nonce":3134303986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6805","nonce":3134303986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3134303986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3134303986},{"type":"v1","addr":"172.21.15.57:6807","nonce":3134303986}]},"public_addr":"172.21.15.57:6803/3134303986","cluster_addr":"172.21.15.57:6805/3134303986","heartbeat_back_addr":"172.21.15.57:6809/3134303986","heartbeat_front_addr":"172.21.15.57:6807/3134303986","state":["exists","up"]},{"osd":1,"uuid":"fccab799-0840-4050-9ead-4ad9e7e69fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6811","nonce":37973257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6813","nonce":37973257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6817","nonce":37973257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":37973257},{"type":"v1","addr":"172.21.15.57:6815","nonce":37973257}]},"public_addr":"172.21.15.57:6811/37973257","cluster_addr":"172.21.15.57:6813/37973257","heartbeat_back_addr":"172.21.15.57:6817/37973257","heartbeat_front_addr":"172.21.15.57:6815/37973257","state":["exists","up"]},{"osd":2,"uuid":"4b0a7b1d-f096-4698-b27a-6b5aa2239eb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6819","nonce":2276135967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6821","nonce":2276135967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6825","nonce":2276135967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2276135967},{"type":"v1","addr":"172.21.15.57:6823","nonce":2276135967}]},"public_addr":"172.21.15.57:6819/2276135967","cluster_addr":"172.21.15.57:6821/2276135967","heartbeat_back_addr":"172.21.15.57:6825/2276135967","heartbeat_front_addr":"172.21.15.57:6823/2276135967","state":["exists","up"]},{"osd":3,"uuid":"1c67654a-1d10-422e-9540-a348cff2d828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6801","nonce":1839102641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6803","nonce":1839102641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6807","nonce":1839102641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1839102641},{"type":"v1","addr":"172.21.15.87:6805","nonce":1839102641}]},"public_addr":"172.21.15.87:6801/1839102641","cluster_addr":"172.21.15.87:6803/1839102641","heartbeat_back_addr":"172.21.15.87:6807/1839102641","heartbeat_front_addr":"172.21.15.87:6805/1839102641","state":["exists","up"]},{"osd":4,"uuid":"7f988788-349d-4afd-adca-af474c7bb8ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6809","nonce":3382559885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6811","nonce":3382559885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6815","nonce":3382559885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3382559885},{"type":"v1","addr":"172.21.15.87:6813","nonce":3382559885}]},"public_addr":"172.21.15.87:6809/3382559885","cluster_addr":"172.21.15.87:6811/3382559885","heartbeat_back_addr":"172.21.15.87:6815/3382559885","heartbeat_front_addr":"172.21.15.87:6813/3382559885","state":["exists","up"]},{"osd":5,"uuid":"83e02849-bd1f-4fa8-893e-1bfd8b2cfe42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6817","nonce":2535835025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6819","nonce":2535835025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6823","nonce":2535835025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2535835025},{"type":"v1","addr":"172.21.15.87:6821","nonce":2535835025}]},"public_addr":"172.21.15.87:6817/2535835025","cluster_addr":"172.21.15.87:6819/2535835025","heartbeat_back_addr":"172.21.15.87:6823/2535835025","heartbeat_front_addr":"172.21.15.87:6821/2535835025","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:53:27.750469+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:03.782911+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:41.785278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:15.986058+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:50.819979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:56:26.433957+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/2044423401":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/429066936":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6800/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6801/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6801/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/509992026":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6800/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/4184139864":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3955176243":"2024-02-29T15:51:51.209781+0000","172.21.15.57:6800/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3171524924":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/1871958144":"2024-02-29T15:49:35.637547+0000","172.21.15.57:6801/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/4078846536":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/2729792809":"2024-02-29T15:50:16.193611+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T15:58:38.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 -- 172.21.15.57:0/1480277518 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e8069210 msgr2=0x7fd7e806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:38.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 --2- 172.21.15.57:0/1480277518 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e8069210 0x7fd7e806b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec034040 tx=0x7fd7ec009da0 comp rx=0 tx=0).stop 2024-02-28T15:58:38.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 -- 172.21.15.57:0/1480277518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8040fb1a0 msgr2=0x7fd80410ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:38.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 --2- 172.21.15.57:0/1480277518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8040fb1a0 0x7fd80410ed60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4002a50 tx=0x7fd7f4004600 comp rx=0 tx=0).stop 2024-02-28T15:58:38.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 -- 172.21.15.57:0/1480277518 shutdown_connections 2024-02-28T15:58:38.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 --2- 172.21.15.57:0/1480277518 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e8069210 0x7fd7e806b6c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:38.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 --2- 172.21.15.57:0/1480277518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8040fc470 0x7fd80410f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:38.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 --2- 172.21.15.57:0/1480277518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8040fb1a0 0x7fd80410ed60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:38.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 -- 172.21.15.57:0/1480277518 >> 172.21.15.57:0/1480277518 conn(0x7fd8040f6960 msgr2=0x7fd8040ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:38.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 -- 172.21.15.57:0/1480277518 shutdown_connections 2024-02-28T15:58:38.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:38.838+0000 7fd809800640 1 -- 172.21.15.57:0/1480277518 wait complete. 2024-02-28T15:58:38.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T15:54:45.908218+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T15:58:02.602649+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T15:58:03.211266+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-28T15:58:38.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T15:58:39.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.073+0000 7f8d7e200640 1 -- 172.21.15.57:0/2394376289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d780fe320 msgr2=0x7f8d780fe730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:39.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.073+0000 7f8d7e200640 1 --2- 172.21.15.57:0/2394376289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d780fe320 0x7f8d780fe730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0048d0 tx=0x7f8d6c009da0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.073+0000 7f8d7e200640 1 -- 172.21.15.57:0/2394376289 shutdown_connections 2024-02-28T15:58:39.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.073+0000 7f8d7e200640 1 --2- 172.21.15.57:0/2394376289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d780ff550 0x7f8d780ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.073+0000 7f8d7e200640 1 --2- 172.21.15.57:0/2394376289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d780fe320 0x7f8d780fe730 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.073+0000 7f8d7e200640 1 -- 172.21.15.57:0/2394376289 >> 172.21.15.57:0/2394376289 conn(0x7f8d780f9ab0 msgr2=0x7f8d780fbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:39.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.074+0000 7f8d7e200640 1 -- 172.21.15.57:0/2394376289 shutdown_connections 2024-02-28T15:58:39.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.074+0000 7f8d7e200640 1 -- 172.21.15.57:0/2394376289 wait complete. 2024-02-28T15:58:39.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.074+0000 7f8d7e200640 1 Processor -- start 2024-02-28T15:58:39.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.075+0000 7f8d7e200640 1 -- start start 2024-02-28T15:58:39.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.075+0000 7f8d7e200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d780fe320 0x7f8d7810ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:39.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.075+0000 7f8d7e200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d780ff550 0x7f8d7810f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:39.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.075+0000 7f8d7e200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7810f800 con 0x7f8d780ff550 2024-02-28T15:58:39.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.075+0000 7f8d7e200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78114210 con 0x7f8d780fe320 2024-02-28T15:58:39.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.075+0000 7f8d77e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d780ff550 0x7f8d7810f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:39.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.075+0000 7f8d77e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d780ff550 0x7f8d7810f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53558/0 (socket says 172.21.15.57:53558) 2024-02-28T15:58:39.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.075+0000 7f8d77e00640 1 -- 172.21.15.57:0/2183466334 learned_addr learned my addr 172.21.15.57:0/2183466334 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:39.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.076+0000 7f8d7ce00640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d780fe320 0x7f8d7810ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:39.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.076+0000 7f8d77e00640 1 -- 172.21.15.57:0/2183466334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d780fe320 msgr2=0x7f8d7810ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:39.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.076+0000 7f8d77e00640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d780fe320 0x7f8d7810ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.076+0000 7f8d77e00640 1 -- 172.21.15.57:0/2183466334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c005040 con 0x7f8d780ff550 2024-02-28T15:58:39.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.076+0000 7f8d77e00640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d780ff550 0x7f8d7810f180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400b790 tx=0x7f8d640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:39.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.076+0000 7f8d74c00640 1 -- 172.21.15.57:0/2183466334 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6400c700 con 0x7f8d780ff550 2024-02-28T15:58:39.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.076+0000 7f8d7e200640 1 -- 172.21.15.57:0/2183466334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d78114410 con 0x7f8d780ff550 2024-02-28T15:58:39.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.076+0000 7f8d74c00640 1 -- 172.21.15.57:0/2183466334 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d6400cd30 con 0x7f8d780ff550 2024-02-28T15:58:39.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.076+0000 7f8d74c00640 1 -- 172.21.15.57:0/2183466334 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d64013370 con 0x7f8d780ff550 2024-02-28T15:58:39.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.077+0000 7f8d7e200640 1 -- 172.21.15.57:0/2183466334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d78114930 con 0x7f8d780ff550 2024-02-28T15:58:39.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.078+0000 7f8d7e200640 1 -- 172.21.15.57:0/2183466334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d78106ef0 con 0x7f8d780ff550 2024-02-28T15:58:39.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.079+0000 7f8d74c00640 1 -- 172.21.15.57:0/2183466334 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f8d64012070 con 0x7f8d780ff550 2024-02-28T15:58:39.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.079+0000 7f8d74c00640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8d60069210 0x7f8d6006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:39.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.079+0000 7f8d74c00640 1 -- 172.21.15.57:0/2183466334 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8d64086ec0 con 0x7f8d780ff550 2024-02-28T15:58:39.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.080+0000 7f8d7ce00640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8d60069210 0x7f8d6006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:39.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.080+0000 7f8d7ce00640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8d60069210 0x7f8d6006b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d7810fb50 tx=0x7f8d6c009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:39.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.084+0000 7f8d74c00640 1 -- 172.21.15.57:0/2183466334 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8d640530d0 con 0x7f8d780ff550 2024-02-28T15:58:39.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.278+0000 7f8d7e200640 1 -- 172.21.15.57:0/2183466334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d78107080 con 0x7f8d780ff550 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.279+0000 7f8d74c00640 1 -- 172.21.15.57:0/2183466334 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d78107080 con 0x7f8d780ff550 2024-02-28T15:58:39.272 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.281+0000 7f8d7e200640 1 -- 172.21.15.57:0/2183466334 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8d60069210 msgr2=0x7f8d6006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.281+0000 7f8d7e200640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8d60069210 0x7f8d6006b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d7810fb50 tx=0x7f8d6c009da0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.281+0000 7f8d7e200640 1 -- 172.21.15.57:0/2183466334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d780ff550 msgr2=0x7f8d7810f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:39.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.281+0000 7f8d7e200640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d780ff550 0x7f8d7810f180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400b790 tx=0x7f8d640091d0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.281+0000 7f8d7e200640 1 -- 172.21.15.57:0/2183466334 shutdown_connections 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.281+0000 7f8d7e200640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8d60069210 0x7f8d6006b6c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.282+0000 7f8d7e200640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d780ff550 0x7f8d7810f180 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.282+0000 7f8d7e200640 1 --2- 172.21.15.57:0/2183466334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d780fe320 0x7f8d7810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.282+0000 7f8d7e200640 1 -- 172.21.15.57:0/2183466334 >> 172.21.15.57:0/2183466334 conn(0x7f8d780f9ab0 msgr2=0x7f8d78102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.282+0000 7f8d7e200640 1 -- 172.21.15.57:0/2183466334 shutdown_connections 2024-02-28T15:58:39.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.282+0000 7f8d7e200640 1 -- 172.21.15.57:0/2183466334 wait complete. 2024-02-28T15:58:39.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T15:58:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.485+0000 7fc46c400640 1 -- 172.21.15.57:0/3340838434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4640fe490 msgr2=0x7fc4640fe8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.485+0000 7fc46c400640 1 --2- 172.21.15.57:0/3340838434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4640fe490 0x7fc4640fe8a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc4580048d0 tx=0x7fc458009da0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.486+0000 7fc46c400640 1 -- 172.21.15.57:0/3340838434 shutdown_connections 2024-02-28T15:58:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.486+0000 7fc46c400640 1 --2- 172.21.15.57:0/3340838434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4640ff760 0x7fc4640ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.486+0000 7fc46c400640 1 --2- 172.21.15.57:0/3340838434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4640fe490 0x7fc4640fe8a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.486+0000 7fc46c400640 1 -- 172.21.15.57:0/3340838434 >> 172.21.15.57:0/3340838434 conn(0x7fc4640f9c50 msgr2=0x7fc4640fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.486+0000 7fc46c400640 1 -- 172.21.15.57:0/3340838434 shutdown_connections 2024-02-28T15:58:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.486+0000 7fc46c400640 1 -- 172.21.15.57:0/3340838434 wait complete. 2024-02-28T15:58:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.487+0000 7fc46c400640 1 Processor -- start 2024-02-28T15:58:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.487+0000 7fc46c400640 1 -- start start 2024-02-28T15:58:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.487+0000 7fc46c400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4640fe490 0x7fc46410edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.487+0000 7fc46c400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4640ff760 0x7fc46410f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.487+0000 7fc46c400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46410f9d0 con 0x7fc4640ff760 2024-02-28T15:58:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.487+0000 7fc46c400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc464114390 con 0x7fc4640fe490 2024-02-28T15:58:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.487+0000 7fc469000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4640ff760 0x7fc46410f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.487+0000 7fc469000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4640ff760 0x7fc46410f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53574/0 (socket says 172.21.15.57:53574) 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.487+0000 7fc469000640 1 -- 172.21.15.57:0/74910665 learned_addr learned my addr 172.21.15.57:0/74910665 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.488+0000 7fc469a00640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4640fe490 0x7fc46410edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.488+0000 7fc469000640 1 -- 172.21.15.57:0/74910665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4640fe490 msgr2=0x7fc46410edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.488+0000 7fc469000640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4640fe490 0x7fc46410edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.488+0000 7fc469000640 1 -- 172.21.15.57:0/74910665 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458005040 con 0x7fc4640ff760 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.488+0000 7fc469000640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4640ff760 0x7fc46410f2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc45400b790 tx=0x7fc4540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.488+0000 7fc461600640 1 -- 172.21.15.57:0/74910665 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc45400c700 con 0x7fc4640ff760 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.488+0000 7fc461600640 1 -- 172.21.15.57:0/74910665 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc45400cd30 con 0x7fc4640ff760 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.488+0000 7fc46c400640 1 -- 172.21.15.57:0/74910665 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc464114590 con 0x7fc4640ff760 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.488+0000 7fc461600640 1 -- 172.21.15.57:0/74910665 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc454013370 con 0x7fc4640ff760 2024-02-28T15:58:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.489+0000 7fc46c400640 1 -- 172.21.15.57:0/74910665 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc464114ab0 con 0x7fc4640ff760 2024-02-28T15:58:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.490+0000 7fc46c400640 1 -- 172.21.15.57:0/74910665 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc464107060 con 0x7fc4640ff760 2024-02-28T15:58:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.491+0000 7fc461600640 1 -- 172.21.15.57:0/74910665 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fc454012070 con 0x7fc4640ff760 2024-02-28T15:58:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.491+0000 7fc461600640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc44c069220 0x7fc44c06b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.492+0000 7fc461600640 1 -- 172.21.15.57:0/74910665 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc454086bc0 con 0x7fc4640ff760 2024-02-28T15:58:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.492+0000 7fc469a00640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc44c069220 0x7fc44c06b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.493+0000 7fc469a00640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc44c069220 0x7fc44c06b6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc458034040 tx=0x7fc458009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.496+0000 7fc461600640 1 -- 172.21.15.57:0/74910665 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc454052e50 con 0x7fc4640ff760 2024-02-28T15:58:39.639 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:39 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1480277518' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T15:58:39.639 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:39 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2183466334' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T15:58:39.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.687+0000 7fc46c400640 1 -- 172.21.15.57:0/74910665 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fc464114de0 con 0x7fc4640ff760 2024-02-28T15:58:39.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.688+0000 7fc461600640 1 -- 172.21.15.57:0/74910665 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc454056470 con 0x7fc4640ff760 2024-02-28T15:58:39.680 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-02-28T15:58:39.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 -- 172.21.15.57:0/74910665 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc44c069220 msgr2=0x7fc44c06b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc44c069220 0x7fc44c06b6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc458034040 tx=0x7fc458009da0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 -- 172.21.15.57:0/74910665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4640ff760 msgr2=0x7fc46410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4640ff760 0x7fc46410f2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc45400b790 tx=0x7fc4540091d0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 -- 172.21.15.57:0/74910665 shutdown_connections 2024-02-28T15:58:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc44c069220 0x7fc44c06b6d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4640ff760 0x7fc46410f2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 --2- 172.21.15.57:0/74910665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4640fe490 0x7fc46410edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 -- 172.21.15.57:0/74910665 >> 172.21.15.57:0/74910665 conn(0x7fc4640f9c50 msgr2=0x7fc464102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 -- 172.21.15.57:0/74910665 shutdown_connections 2024-02-28T15:58:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.690+0000 7fc46c400640 1 -- 172.21.15.57:0/74910665 wait complete. 2024-02-28T15:58:39.698 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T15:58:39.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:39 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1480277518' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T15:58:39.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:39 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2183466334' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T15:58:39.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.894+0000 7fc131200640 1 -- 172.21.15.57:0/2851773346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0fc280 msgr2=0x7fc12c0fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:39.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.894+0000 7fc131200640 1 --2- 172.21.15.57:0/2851773346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0fc280 0x7fc12c0fc690 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0048d0 tx=0x7fc11c009da0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.894+0000 7fc131200640 1 -- 172.21.15.57:0/2851773346 shutdown_connections 2024-02-28T15:58:39.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.894+0000 7fc131200640 1 --2- 172.21.15.57:0/2851773346 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc12c0fd550 0x7fc12c0fd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.894+0000 7fc131200640 1 --2- 172.21.15.57:0/2851773346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0fc280 0x7fc12c0fc690 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.895+0000 7fc131200640 1 -- 172.21.15.57:0/2851773346 >> 172.21.15.57:0/2851773346 conn(0x7fc12c0f7a60 msgr2=0x7fc12c0f9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:39.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.895+0000 7fc131200640 1 -- 172.21.15.57:0/2851773346 shutdown_connections 2024-02-28T15:58:39.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.895+0000 7fc131200640 1 -- 172.21.15.57:0/2851773346 wait complete. 2024-02-28T15:58:39.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.895+0000 7fc131200640 1 Processor -- start 2024-02-28T15:58:39.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.896+0000 7fc131200640 1 -- start start 2024-02-28T15:58:39.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.896+0000 7fc131200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc12c0fc280 0x7fc12c10ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:39.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.896+0000 7fc131200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0fd550 0x7fc12c10f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:39.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.896+0000 7fc131200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c10f8a0 con 0x7fc12c0fd550 2024-02-28T15:58:39.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.896+0000 7fc131200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c1142f0 con 0x7fc12c0fc280 2024-02-28T15:58:39.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.896+0000 7fc129400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0fd550 0x7fc12c10f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:39.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.896+0000 7fc129400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0fd550 0x7fc12c10f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53600/0 (socket says 172.21.15.57:53600) 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.896+0000 7fc129400640 1 -- 172.21.15.57:0/758198022 learned_addr learned my addr 172.21.15.57:0/758198022 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.896+0000 7fc129e00640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc12c0fc280 0x7fc12c10ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.897+0000 7fc129400640 1 -- 172.21.15.57:0/758198022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc12c0fc280 msgr2=0x7fc12c10ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.897+0000 7fc129400640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc12c0fc280 0x7fc12c10ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.897+0000 7fc129400640 1 -- 172.21.15.57:0/758198022 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c005040 con 0x7fc12c0fd550 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.897+0000 7fc129400640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0fd550 0x7fc12c10f250 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc118002a50 tx=0x7fc118004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.897+0000 7fc122000640 1 -- 172.21.15.57:0/758198022 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc118007c30 con 0x7fc12c0fd550 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.897+0000 7fc122000640 1 -- 172.21.15.57:0/758198022 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc11800f040 con 0x7fc12c0fd550 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.897+0000 7fc122000640 1 -- 172.21.15.57:0/758198022 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc11800db60 con 0x7fc12c0fd550 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.897+0000 7fc131200640 1 -- 172.21.15.57:0/758198022 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c114490 con 0x7fc12c0fd550 2024-02-28T15:58:39.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.897+0000 7fc131200640 1 -- 172.21.15.57:0/758198022 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c114980 con 0x7fc12c0fd550 2024-02-28T15:58:39.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.899+0000 7fc131200640 1 -- 172.21.15.57:0/758198022 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c101560 con 0x7fc12c0fd550 2024-02-28T15:58:39.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.899+0000 7fc122000640 1 -- 172.21.15.57:0/758198022 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fc11800dcc0 con 0x7fc12c0fd550 2024-02-28T15:58:39.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.900+0000 7fc122000640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc110069220 0x7fc11006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:39.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.900+0000 7fc122000640 1 -- 172.21.15.57:0/758198022 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc118086fe0 con 0x7fc12c0fd550 2024-02-28T15:58:39.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.900+0000 7fc129e00640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc110069220 0x7fc11006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:39.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.901+0000 7fc129e00640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc110069220 0x7fc11006b6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc11c034040 tx=0x7fc11c009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:39.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:39.904+0000 7fc122000640 1 -- 172.21.15.57:0/758198022 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc118053310 con 0x7fc12c0fd550 2024-02-28T15:58:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.097+0000 7fc131200640 1 -- 172.21.15.57:0/758198022 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fc12c02a990 con 0x7fc12c0fd550 2024-02-28T15:58:40.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.098+0000 7fc122000640 1 -- 172.21.15.57:0/758198022 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc118056930 con 0x7fc12c0fd550 2024-02-28T15:58:40.091 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 -- 172.21.15.57:0/758198022 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc110069220 msgr2=0x7fc11006b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc110069220 0x7fc11006b6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc11c034040 tx=0x7fc11c009da0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 -- 172.21.15.57:0/758198022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0fd550 msgr2=0x7fc12c10f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0fd550 0x7fc12c10f250 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc118002a50 tx=0x7fc118004600 comp rx=0 tx=0).stop 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 -- 172.21.15.57:0/758198022 shutdown_connections 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fc110069220 0x7fc11006b6d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0fd550 0x7fc12c10f250 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 --2- 172.21.15.57:0/758198022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc12c0fc280 0x7fc12c10ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 -- 172.21.15.57:0/758198022 >> 172.21.15.57:0/758198022 conn(0x7fc12c0f7a60 msgr2=0x7fc12c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 -- 172.21.15.57:0/758198022 shutdown_connections 2024-02-28T15:58:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.101+0000 7fc131200640 1 -- 172.21.15.57:0/758198022 wait complete. 2024-02-28T15:58:40.116 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-28T15:58:40.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.312+0000 7f8b83200640 1 -- 172.21.15.57:0/2876341186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b840fc220 msgr2=0x7f8b840fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:40.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.312+0000 7f8b83200640 1 --2- 172.21.15.57:0/2876341186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b840fc220 0x7f8b840fc690 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8b700048d0 tx=0x7f8b70009da0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.312+0000 7f8b83200640 1 -- 172.21.15.57:0/2876341186 shutdown_connections 2024-02-28T15:58:40.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.312+0000 7f8b83200640 1 --2- 172.21.15.57:0/2876341186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b840fc220 0x7f8b840fc690 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.312+0000 7f8b83200640 1 --2- 172.21.15.57:0/2876341186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b840faff0 0x7f8b840fb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.312+0000 7f8b83200640 1 -- 172.21.15.57:0/2876341186 >> 172.21.15.57:0/2876341186 conn(0x7f8b840f66d0 msgr2=0x7f8b840f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:40.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.313+0000 7f8b83200640 1 -- 172.21.15.57:0/2876341186 shutdown_connections 2024-02-28T15:58:40.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.313+0000 7f8b83200640 1 -- 172.21.15.57:0/2876341186 wait complete. 2024-02-28T15:58:40.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.313+0000 7f8b83200640 1 Processor -- start 2024-02-28T15:58:40.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.314+0000 7f8b83200640 1 -- start start 2024-02-28T15:58:40.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.314+0000 7f8b83200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b840faff0 0x7f8b8410ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:40.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.314+0000 7f8b83200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b840fc220 0x7f8b8410f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:40.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.314+0000 7f8b83200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8410f740 con 0x7f8b840fc220 2024-02-28T15:58:40.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.314+0000 7f8b83200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b84114190 con 0x7f8b840faff0 2024-02-28T15:58:40.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.314+0000 7f8b81400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b840fc220 0x7f8b8410f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:40.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.314+0000 7f8b81400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b840fc220 0x7f8b8410f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53616/0 (socket says 172.21.15.57:53616) 2024-02-28T15:58:40.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.314+0000 7f8b81400640 1 -- 172.21.15.57:0/121852654 learned_addr learned my addr 172.21.15.57:0/121852654 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:40.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.315+0000 7f8b81e00640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b840faff0 0x7f8b8410ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:40.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.315+0000 7f8b81400640 1 -- 172.21.15.57:0/121852654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b840faff0 msgr2=0x7f8b8410ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:40.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.315+0000 7f8b81400640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b840faff0 0x7f8b8410ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.315+0000 7f8b81400640 1 -- 172.21.15.57:0/121852654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70005040 con 0x7f8b840fc220 2024-02-28T15:58:40.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.315+0000 7f8b81400640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b840fc220 0x7f8b8410f0f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8b70007da0 tx=0x7f8b70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:40.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.316+0000 7f8b7a000640 1 -- 172.21.15.57:0/121852654 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b700094c0 con 0x7f8b840fc220 2024-02-28T15:58:40.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.316+0000 7f8b7a000640 1 -- 172.21.15.57:0/121852654 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b70009620 con 0x7f8b840fc220 2024-02-28T15:58:40.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.316+0000 7f8b83200640 1 -- 172.21.15.57:0/121852654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b841142d0 con 0x7f8b840fc220 2024-02-28T15:58:40.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.316+0000 7f8b7a000640 1 -- 172.21.15.57:0/121852654 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b7003b620 con 0x7f8b840fc220 2024-02-28T15:58:40.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.316+0000 7f8b83200640 1 -- 172.21.15.57:0/121852654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b841147c0 con 0x7f8b840fc220 2024-02-28T15:58:40.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.317+0000 7f8b83200640 1 -- 172.21.15.57:0/121852654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b84103b60 con 0x7f8b840fc220 2024-02-28T15:58:40.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.318+0000 7f8b7a000640 1 -- 172.21.15.57:0/121852654 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f8b7002f070 con 0x7f8b840fc220 2024-02-28T15:58:40.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.319+0000 7f8b7a000640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b68069210 0x7f8b6806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:40.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.319+0000 7f8b7a000640 1 -- 172.21.15.57:0/121852654 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8b700a9890 con 0x7f8b840fc220 2024-02-28T15:58:40.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.319+0000 7f8b81e00640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b68069210 0x7f8b6806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:40.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.320+0000 7f8b81e00640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b68069210 0x7f8b6806b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009fd0 tx=0x7f8b74009e50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:40.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.324+0000 7f8b7a000640 1 -- 172.21.15.57:0/121852654 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f8b70075aa0 con 0x7f8b840fc220 2024-02-28T15:58:40.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.560+0000 7f8b83200640 1 -- 172.21.15.57:0/121852654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b84114950 con 0x7f8b840fc220 2024-02-28T15:58:40.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.561+0000 7f8b7a000640 1 -- 172.21.15.57:0/121852654 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f8b700790c0 con 0x7f8b840fc220 2024-02-28T15:58:40.554 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:58:40.554 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T15:58:26.323114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14452,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6827/1436733447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1436733447},{"type":"v1","addr":"172.21.15.57:6827","nonce":1436733447}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14464":{"gid":14464,"name":"cephfs.smithi057.qwatmu","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.57:6829/3864009326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3864009326},{"type":"v1","addr":"172.21.15.57:6829","nonce":3864009326}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi087.fzjgef","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6825/82197361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":82197361},{"type":"v1","addr":"172.21.15.87:6825","nonce":82197361}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24293":{"gid":24293,"name":"cephfs.smithi087.whebmo","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.87:6827/2094154189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2094154189},{"type":"v1","addr":"172.21.15.87:6827","nonce":2094154189}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-28T15:58:40.554 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-02-28T15:58:40.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.563+0000 7f8b83200640 1 -- 172.21.15.57:0/121852654 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b68069210 msgr2=0x7f8b6806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:40.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.563+0000 7f8b83200640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b68069210 0x7f8b6806b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009fd0 tx=0x7f8b74009e50 comp rx=0 tx=0).stop 2024-02-28T15:58:40.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.563+0000 7f8b83200640 1 -- 172.21.15.57:0/121852654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b840fc220 msgr2=0x7f8b8410f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:40.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.563+0000 7f8b83200640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b840fc220 0x7f8b8410f0f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8b70007da0 tx=0x7f8b70009da0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.563+0000 7f8b83200640 1 -- 172.21.15.57:0/121852654 shutdown_connections 2024-02-28T15:58:40.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.563+0000 7f8b83200640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f8b68069210 0x7f8b6806b6c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.563+0000 7f8b83200640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b840fc220 0x7f8b8410f0f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.563+0000 7f8b83200640 1 --2- 172.21.15.57:0/121852654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b840faff0 0x7f8b8410ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:40.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.563+0000 7f8b83200640 1 -- 172.21.15.57:0/121852654 >> 172.21.15.57:0/121852654 conn(0x7f8b840f66d0 msgr2=0x7f8b84064480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:40.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.564+0000 7f8b83200640 1 -- 172.21.15.57:0/121852654 shutdown_connections 2024-02-28T15:58:40.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:40.564+0000 7f8b83200640 1 -- 172.21.15.57:0/121852654 wait complete. 2024-02-28T15:58:40.574 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 2, 'flags': 50} 2024-02-28T15:58:40.575 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-28T15:58:40.603 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-28T15:58:40.603 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-02-28T15:58:40.603 INFO:tasks.ceph_fuse:client.0 config is {} 2024-02-28T15:58:40.603 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-28T15:58:40.603 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:40.604 INFO:tasks.ceph_fuse:client.1 config is {} 2024-02-28T15:58:40.604 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-28T15:58:40.604 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:40.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:40.604 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-02-28T15:58:40.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:40.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2024-02-28T15:58:40.715 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:40 smithi057 ceph-mon[28763]: pgmap v238: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:58:40.715 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:40 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/74910665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T15:58:40.715 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:40 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/758198022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T15:58:40.729 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2024-02-28T15:58:40.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T15:58:40.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:40.733 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-02-28T15:58:40.765 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:40 smithi087 ceph-mon[37122]: pgmap v238: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:58:40.765 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:40 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/74910665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T15:58:40.765 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:40 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/758198022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T15:58:40.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:40.789 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-02-28T15:58:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-02-28T15:58:40.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T15:58:40.930 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-28T15:58:40.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph fs ls 2024-02-28T15:58:41.431 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:58:41.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:41 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/121852654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T15:58:41.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:41 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:41.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:41 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:41.755 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:41 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/121852654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T15:58:41.755 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:41 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:41.755 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:41 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:42.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:42 smithi087 ceph-mon[37122]: pgmap v239: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:58:42.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:42.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:58:42.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:42.791 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:42 smithi057 ceph-mon[28763]: pgmap v239: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:58:42.791 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:58:42.791 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:58:42.792 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:58:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.646+0000 7f747ac00700 1 -- 172.21.15.57:0/539136377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74741095f0 msgr2=0x7f74741099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.646+0000 7f747ac00700 1 --2- 172.21.15.57:0/539136377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74741095f0 0x7f74741099c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7464004940 tx=0x7f7464009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.646+0000 7f747ac00700 1 -- 172.21.15.57:0/539136377 shutdown_connections 2024-02-28T15:58:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.646+0000 7f747ac00700 1 --2- 172.21.15.57:0/539136377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7474103dc0 0x7f7474104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.646+0000 7f747ac00700 1 --2- 172.21.15.57:0/539136377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74741095f0 0x7f74741099c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.646+0000 7f747ac00700 1 -- 172.21.15.57:0/539136377 >> 172.21.15.57:0/539136377 conn(0x7f7474072d50 msgr2=0x7f7474075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.646+0000 7f747ac00700 1 -- 172.21.15.57:0/539136377 shutdown_connections 2024-02-28T15:58:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.646+0000 7f747ac00700 1 -- 172.21.15.57:0/539136377 wait complete. 2024-02-28T15:58:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.647+0000 7f747ac00700 1 Processor -- start 2024-02-28T15:58:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.647+0000 7f747ac00700 1 -- start start 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.647+0000 7f747ac00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7474103dc0 0x7f747411a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.647+0000 7f747ac00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74741095f0 0x7f747411a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.647+0000 7f747ac00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747411ac70 con 0x7f7474103dc0 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.647+0000 7f747ac00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474113f80 con 0x7f74741095f0 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.648+0000 7f7473e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7474103dc0 0x7f747411a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.648+0000 7f7473e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7474103dc0 0x7f747411a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51226/0 (socket says 172.21.15.57:51226) 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.648+0000 7f7473e00700 1 -- 172.21.15.57:0/2827196520 learned_addr learned my addr 172.21.15.57:0/2827196520 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.648+0000 7f746be00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74741095f0 0x7f747411a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.648+0000 7f7473e00700 1 -- 172.21.15.57:0/2827196520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74741095f0 msgr2=0x7f747411a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.648+0000 7f7473e00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74741095f0 0x7f747411a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.648+0000 7f7473e00700 1 -- 172.21.15.57:0/2827196520 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464005040 con 0x7f7474103dc0 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.648+0000 7f7473e00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7474103dc0 0x7f747411a0e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7464009150 tx=0x7f7464009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.649+0000 7f7470c00700 1 -- 172.21.15.57:0/2827196520 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f746400e040 con 0x7f7474103dc0 2024-02-28T15:58:43.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.649+0000 7f747ac00700 1 -- 172.21.15.57:0/2827196520 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7474114200 con 0x7f7474103dc0 2024-02-28T15:58:43.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.649+0000 7f7470c00700 1 -- 172.21.15.57:0/2827196520 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f746400bbf0 con 0x7f7474103dc0 2024-02-28T15:58:43.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.649+0000 7f7470c00700 1 -- 172.21.15.57:0/2827196520 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f746401c630 con 0x7f7474103dc0 2024-02-28T15:58:43.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.649+0000 7f747ac00700 1 -- 172.21.15.57:0/2827196520 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7474114740 con 0x7f7474103dc0 2024-02-28T15:58:43.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.650+0000 7f747ac00700 1 -- 172.21.15.57:0/2827196520 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7474106850 con 0x7f7474103dc0 2024-02-28T15:58:43.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.651+0000 7f7470c00700 1 -- 172.21.15.57:0/2827196520 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f746400bd60 con 0x7f7474103dc0 2024-02-28T15:58:43.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.652+0000 7f7470c00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74580692b0 0x7f745806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:43.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.652+0000 7f7470c00700 1 -- 172.21.15.57:0/2827196520 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f74640885a0 con 0x7f7474103dc0 2024-02-28T15:58:43.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.652+0000 7f746be00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74580692b0 0x7f745806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:43.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.653+0000 7f746be00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74580692b0 0x7f745806b760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7474115980 tx=0x7f745c009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:43.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.657+0000 7f7470c00700 1 -- 172.21.15.57:0/2827196520 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7464058360 con 0x7f7474103dc0 2024-02-28T15:58:43.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.925+0000 7f747ac00700 1 -- 172.21.15.57:0/2827196520 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f747404bed0 con 0x7f7474103dc0 2024-02-28T15:58:43.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.926+0000 7f7470c00700 1 -- 172.21.15.57:0/2827196520 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f7464057ef0 con 0x7f7474103dc0 2024-02-28T15:58:43.919 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-28T15:58:43.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.929+0000 7f747ac00700 1 -- 172.21.15.57:0/2827196520 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74580692b0 msgr2=0x7f745806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:43.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.929+0000 7f747ac00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74580692b0 0x7f745806b760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7474115980 tx=0x7f745c009ee0 comp rx=0 tx=0).stop 2024-02-28T15:58:43.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.929+0000 7f747ac00700 1 -- 172.21.15.57:0/2827196520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7474103dc0 msgr2=0x7f747411a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:43.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.929+0000 7f747ac00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7474103dc0 0x7f747411a0e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7464009150 tx=0x7f7464009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:43.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.929+0000 7f747ac00700 1 -- 172.21.15.57:0/2827196520 shutdown_connections 2024-02-28T15:58:43.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.929+0000 7f747ac00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74580692b0 0x7f745806b760 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:43.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.929+0000 7f747ac00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7474103dc0 0x7f747411a0e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:43.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.929+0000 7f747ac00700 1 --2- 172.21.15.57:0/2827196520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74741095f0 0x7f747411a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:43.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.929+0000 7f747ac00700 1 -- 172.21.15.57:0/2827196520 >> 172.21.15.57:0/2827196520 conn(0x7f7474072d50 msgr2=0x7f7474074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:43.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.930+0000 7f747ac00700 1 -- 172.21.15.57:0/2827196520 shutdown_connections 2024-02-28T15:58:43.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:43.930+0000 7f747ac00700 1 -- 172.21.15.57:0/2827196520 wait complete. 2024-02-28T15:58:44.632 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:44 smithi057 ceph-mon[28763]: pgmap v240: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:58:44.632 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:44 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2827196520' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T15:58:44.723 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-28T15:58:44.723 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-28T15:58:44.723 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2024-02-28T15:58:44.723 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-28T15:58:44.723 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:44.723 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-28T15:58:44.723 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-28T15:58:44.723 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-28T15:58:44.723 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-28T15:58:44.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:44.724 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2024-02-28T15:58:44.783 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-28T15:58:44.784 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-28T15:58:44.784 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2024-02-28T15:58:44.784 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-02-28T15:58:44.784 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2024-02-28T15:58:44.784 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-02-28T15:58:44.784 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T15:58:44.784 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2024-02-28T15:58:44.784 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2024-02-28T15:58:44.784 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T15:58:44.784 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 41913sec preferred_lft 41913sec 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link noprefixroute 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2024-02-28T15:58:44.785 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2024-02-28T15:58:44.786 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-28T15:58:44.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:44.786 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2024-02-28T15:58:44.786 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-02-28T15:58:44.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2024-02-28T15:58:44.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2024-02-28T15:58:44.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2024-02-28T15:58:44.787 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-28T15:58:44.787 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-02-28T15:58:44.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:44 smithi087 ceph-mon[37122]: pgmap v240: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:58:44.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:44 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2827196520' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T15:58:45.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:45.264 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-28T15:58:45.344 INFO:teuthology.orchestra.run.smithi057.stdout:1 2024-02-28T15:58:45.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:45.348 DEBUG:teuthology.orchestra.run.smithi057:> route 2024-02-28T15:58:45.413 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2024-02-28T15:58:45.413 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-28T15:58:45.413 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-28T15:58:45.413 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-28T15:58:45.414 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-28T15:58:45.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:45.414 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2024-02-28T15:58:45.414 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-02-28T15:58:45.414 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-28T15:58:45.414 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-28T15:58:45.414 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-28T15:58:45.415 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-02-28T15:58:46.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:46.149 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-02-28T15:58:46.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:46.210 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2024-02-28T15:58:46.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:46.266 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2024-02-28T15:58:46.266 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-02-28T15:58:46.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T15:58:46.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-28T15:58:46.266 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-02-28T15:58:46.402 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:46 smithi057 ceph-mon[28763]: pgmap v241: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:58:46.416 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-28T15:58:46.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:46.416 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2024-02-28T15:58:46.416 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-02-28T15:58:46.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-28T15:58:46.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-28T15:58:46.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-28T15:58:46.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-28T15:58:46.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-28T15:58:46.417 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-02-28T15:58:46.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:46 smithi087 ceph-mon[37122]: pgmap v241: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:58:46.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:46.712 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2024-02-28T15:58:46.712 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-02-28T15:58:46.712 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2024-02-28T15:58:46.713 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2024-02-28T15:58:46.713 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-02-28T15:58:46.889 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-02-28T15:58:46.889 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T15:58:46.890 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:46.944 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-28T15:58:46.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T15:58:46.944 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:46.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-02-28T15:58:47.087 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T15:58:47.140 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-02-28T15:58:47.141 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/d665e4b74a67f94f133bf4bea228e6a907d5d7461bb39d7d6512d9b76db1dd50/merged 2024-02-28T15:58:47.142 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/77f9e0d22102acec9cc0f521b5c426d0151d14df734ade1c3f7efcdc1a89f1f6/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/0 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/a2c7c0b15dbb4759cba09769507c025cb2125d7a4b2f02183b85e3ad4580ba0f/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/48046a8d9eff69f149c33af0a28595401a0e36834ade80c51429340c5efaec12/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/2bf316c270caec8007a8c050137d5f836de7c71e097ce0e7dd23786684845aba/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/bc39054389cd6e95bd4f3e1f23f591b219cfd0b5f0f119438ab41990c428432a/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/b17baf2dd49e2a85c5a083790cb8eeb1cb59c988c48245a6cd6049a778b7ce03/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/40573bc5b910e9ec0a9270809282aa5516d60dc85c31075d98afa25626f36936/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/4c553258b38ccccd2b45b5f2459665d0cbf9458e191b0d13174bafd79ff2f282/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/759974b74f167c5935cc09f53245e165b65bf21cc3a621fd9d7fcb23cc6ee4ad/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/e7a27c372a76739a743b631ff447af32e8b2209841feafe33ff20de0711cffa2/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/615fbf2c0ef5d2c32cf08c8a68642ce7b0a6e40dd2f688b030db2ef20cd30cad/merged 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T15:58:47.143 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T15:58:47.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:47.145 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-02-28T15:58:47.194 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-28T15:58:47.194 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-28T15:58:47.200 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-02-28T15:58:47.282 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T15:58:47.330 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-02-28T15:58:47.330 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-02-28T15:58:47.330 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-02-28T15:58:47.330 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-02-28T15:58:47.330 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-02-28T15:58:47.330 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-02-28T15:58:47.330 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-02-28T15:58:47.330 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-02-28T15:58:47.330 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T15:58:47.331 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/d665e4b74a67f94f133bf4bea228e6a907d5d7461bb39d7d6512d9b76db1dd50/merged 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/77f9e0d22102acec9cc0f521b5c426d0151d14df734ade1c3f7efcdc1a89f1f6/merged 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/0 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/a2c7c0b15dbb4759cba09769507c025cb2125d7a4b2f02183b85e3ad4580ba0f/merged 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/48046a8d9eff69f149c33af0a28595401a0e36834ade80c51429340c5efaec12/merged 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/2bf316c270caec8007a8c050137d5f836de7c71e097ce0e7dd23786684845aba/merged 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/bc39054389cd6e95bd4f3e1f23f591b219cfd0b5f0f119438ab41990c428432a/merged 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/b17baf2dd49e2a85c5a083790cb8eeb1cb59c988c48245a6cd6049a778b7ce03/merged 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/40573bc5b910e9ec0a9270809282aa5516d60dc85c31075d98afa25626f36936/merged 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/4c553258b38ccccd2b45b5f2459665d0cbf9458e191b0d13174bafd79ff2f282/merged 2024-02-28T15:58:47.332 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/759974b74f167c5935cc09f53245e165b65bf21cc3a621fd9d7fcb23cc6ee4ad/merged 2024-02-28T15:58:47.333 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/e7a27c372a76739a743b631ff447af32e8b2209841feafe33ff20de0711cffa2/merged 2024-02-28T15:58:47.333 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/615fbf2c0ef5d2c32cf08c8a68642ce7b0a6e40dd2f688b030db2ef20cd30cad/merged 2024-02-28T15:58:47.333 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-02-28T15:58:47.333 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T15:58:47.333 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T15:58:47.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:47.334 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-02-28T15:58:47.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:2024-02-28T15:58:47.442+0000 7f84718be300 -1 init, newargv = 0x55b7782ff050 newargc=15 2024-02-28T15:58:47.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[76008]: starting ceph client 2024-02-28T15:58:47.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[76008]: starting fuse 2024-02-28T15:58:48.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-02-28T15:58:48.583 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T15:58:48.642 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-02-28T15:58:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay 2024-02-28T15:58:48.644 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/d665e4b74a67f94f133bf4bea228e6a907d5d7461bb39d7d6512d9b76db1dd50/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/77f9e0d22102acec9cc0f521b5c426d0151d14df734ade1c3f7efcdc1a89f1f6/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/0 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/a2c7c0b15dbb4759cba09769507c025cb2125d7a4b2f02183b85e3ad4580ba0f/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/48046a8d9eff69f149c33af0a28595401a0e36834ade80c51429340c5efaec12/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/2bf316c270caec8007a8c050137d5f836de7c71e097ce0e7dd23786684845aba/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/bc39054389cd6e95bd4f3e1f23f591b219cfd0b5f0f119438ab41990c428432a/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/b17baf2dd49e2a85c5a083790cb8eeb1cb59c988c48245a6cd6049a778b7ce03/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/40573bc5b910e9ec0a9270809282aa5516d60dc85c31075d98afa25626f36936/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/4c553258b38ccccd2b45b5f2459665d0cbf9458e191b0d13174bafd79ff2f282/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/759974b74f167c5935cc09f53245e165b65bf21cc3a621fd9d7fcb23cc6ee4ad/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/e7a27c372a76739a743b631ff447af32e8b2209841feafe33ff20de0711cffa2/merged 2024-02-28T15:58:48.645 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/containers/storage/overlay/615fbf2c0ef5d2c32cf08c8a68642ce7b0a6e40dd2f688b030db2ef20cd30cad/merged 2024-02-28T15:58:48.646 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-02-28T15:58:48.646 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T15:58:48.646 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T15:58:48.646 INFO:teuthology.orchestra.run.smithi057.stdout:/home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:48.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:48.647 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-02-28T15:58:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:48 smithi057 ceph-mon[28763]: pgmap v242: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:58:48.697 INFO:teuthology.orchestra.run.smithi057.stdout:147 2024-02-28T15:58:48.697 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [147] 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> sudo stdin-killer -- python3 -c ' 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> import glob 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> import re 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> import os 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> import subprocess 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> def _find_admin_socket(client_name): 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> files = glob.glob(asok_path) 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> # Given a non-glob path, it better be there 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> if "*" not in asok_path: 2024-02-28T15:58:48.698 DEBUG:teuthology.orchestra.run.smithi057:> assert(len(files) == 1) 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> return files[0] 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> for f in files: 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> contents = proc_f.read() 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> if mountpoint in contents: 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> return f 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> print(_find_admin_socket("client.0")) 2024-02-28T15:58:48.699 DEBUG:teuthology.orchestra.run.smithi057:> ' 2024-02-28T15:58:48.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:48 smithi087 ceph-mon[37122]: pgmap v242: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:58:48.925 INFO:teuthology.orchestra.run.smithi057.stdout:/var/run/ceph/ceph-client.0.76008.asok 2024-02-28T15:58:48.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-28T15:58:48.943 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76008.asok 2024-02-28T15:58:48.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:48.944 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76008.asok status 2024-02-28T15:58:49.181 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": { 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_sha1": "c0f02e608ed955f887728ffa27c686f52f9fd400", 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)", 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "entity_id": "0", 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "hostname": "smithi057", 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "pid": "76008", 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "root": "/" 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_count": 0, 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_pinned_count": 0, 2024-02-28T15:58:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 14516, 2024-02-28T15:58:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "inst": { 2024-02-28T15:58:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "name": { 2024-02-28T15:58:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "client", 2024-02-28T15:58:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "num": 14516 2024-02-28T15:58:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:58:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-02-28T15:58:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-02-28T15:58:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2024-02-28T15:58:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 757520085 2024-02-28T15:58:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T15:58:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:58:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-02-28T15:58:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-02-28T15:58:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2024-02-28T15:58:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 757520085 2024-02-28T15:58:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:58:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "inst_str": "client.14516 192.168.0.1:0/757520085", 2024-02-28T15:58:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "addr_str": "192.168.0.1:0/757520085", 2024-02-28T15:58:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "inode_count": 1, 2024-02-28T15:58:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_epoch": 14, 2024-02-28T15:58:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch": 46, 2024-02-28T15:58:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch_barrier": 0, 2024-02-28T15:58:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklisted": false, 2024-02-28T15:58:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs" 2024-02-28T15:58:49.185 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T15:58:49.197 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- ceph fs ls 2024-02-28T15:58:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:58:50.637 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:50 smithi057 ceph-mon[28763]: pgmap v243: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-28T15:58:50.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:50 smithi087 ceph-mon[37122]: pgmap v243: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-28T15:58:51.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:58:51.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:58:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.043+0000 7fdf4d800700 1 -- 172.21.15.57:0/3852070742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf48070c40 msgr2=0x7fdf48109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.043+0000 7fdf4d800700 1 --2- 172.21.15.57:0/3852070742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf48070c40 0x7fdf48109250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdf30004970 tx=0x7fdf30009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.043+0000 7fdf4d800700 1 -- 172.21.15.57:0/3852070742 shutdown_connections 2024-02-28T15:58:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.043+0000 7fdf4d800700 1 --2- 172.21.15.57:0/3852070742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf48070c40 0x7fdf48109250 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:52.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.043+0000 7fdf4d800700 1 --2- 172.21.15.57:0/3852070742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf48070330 0x7fdf48070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:52.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.043+0000 7fdf4d800700 1 -- 172.21.15.57:0/3852070742 >> 172.21.15.57:0/3852070742 conn(0x7fdf480f8af0 msgr2=0x7fdf480faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:52.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.043+0000 7fdf4d800700 1 -- 172.21.15.57:0/3852070742 shutdown_connections 2024-02-28T15:58:52.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.043+0000 7fdf4d800700 1 -- 172.21.15.57:0/3852070742 wait complete. 2024-02-28T15:58:52.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.044+0000 7fdf4d800700 1 Processor -- start 2024-02-28T15:58:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.044+0000 7fdf4d800700 1 -- start start 2024-02-28T15:58:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.044+0000 7fdf4d800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf48070330 0x7fdf48115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.044+0000 7fdf4d800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf48070c40 0x7fdf48116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.044+0000 7fdf4d800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48116780 con 0x7fdf48070330 2024-02-28T15:58:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.044+0000 7fdf4d800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4810fad0 con 0x7fdf48070c40 2024-02-28T15:58:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.045+0000 7fdf46a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf48070330 0x7fdf48115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.045+0000 7fdf46a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf48070330 0x7fdf48115bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41668/0 (socket says 172.21.15.57:41668) 2024-02-28T15:58:52.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.045+0000 7fdf46a00700 1 -- 172.21.15.57:0/3946502549 learned_addr learned my addr 172.21.15.57:0/3946502549 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:58:52.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.045+0000 7fdf3fe00700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf48070c40 0x7fdf48116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:52.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.045+0000 7fdf46a00700 1 -- 172.21.15.57:0/3946502549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf48070c40 msgr2=0x7fdf48116130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:52.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.045+0000 7fdf46a00700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf48070c40 0x7fdf48116130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:52.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.045+0000 7fdf46a00700 1 -- 172.21.15.57:0/3946502549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf30005040 con 0x7fdf48070330 2024-02-28T15:58:52.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.045+0000 7fdf46a00700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf48070330 0x7fdf48115bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800c8c0 tx=0x7fdf380044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.046+0000 7fdf3ea00700 1 -- 172.21.15.57:0/3946502549 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf3800a760 con 0x7fdf48070330 2024-02-28T15:58:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.046+0000 7fdf4d800700 1 -- 172.21.15.57:0/3946502549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4810fdb0 con 0x7fdf48070330 2024-02-28T15:58:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.046+0000 7fdf3ea00700 1 -- 172.21.15.57:0/3946502549 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf3800ad90 con 0x7fdf48070330 2024-02-28T15:58:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.046+0000 7fdf3ea00700 1 -- 172.21.15.57:0/3946502549 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf380113a0 con 0x7fdf48070330 2024-02-28T15:58:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.046+0000 7fdf4d800700 1 -- 172.21.15.57:0/3946502549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf481102c0 con 0x7fdf48070330 2024-02-28T15:58:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.047+0000 7fdf4d800700 1 -- 172.21.15.57:0/3946502549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf48106910 con 0x7fdf48070330 2024-02-28T15:58:52.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.048+0000 7fdf3ea00700 1 -- 172.21.15.57:0/3946502549 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fdf38012400 con 0x7fdf48070330 2024-02-28T15:58:52.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.049+0000 7fdf3ea00700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fdf2c0692b0 0x7fdf2c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:58:52.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.049+0000 7fdf3ea00700 1 -- 172.21.15.57:0/3946502549 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fdf38087240 con 0x7fdf48070330 2024-02-28T15:58:52.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.049+0000 7fdf3fe00700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fdf2c0692b0 0x7fdf2c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:58:52.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.050+0000 7fdf3fe00700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fdf2c0692b0 0x7fdf2c06b760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdf30004940 tx=0x7fdf30009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:58:52.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.054+0000 7fdf3ea00700 1 -- 172.21.15.57:0/3946502549 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fdf380534d0 con 0x7fdf48070330 2024-02-28T15:58:52.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.312+0000 7fdf4d800700 1 -- 172.21.15.57:0/3946502549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdf4804bed0 con 0x7fdf48070330 2024-02-28T15:58:52.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.313+0000 7fdf3ea00700 1 -- 172.21.15.57:0/3946502549 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7fdf38056af0 con 0x7fdf48070330 2024-02-28T15:58:52.306 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.315+0000 7fdf4d800700 1 -- 172.21.15.57:0/3946502549 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fdf2c0692b0 msgr2=0x7fdf2c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.315+0000 7fdf4d800700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fdf2c0692b0 0x7fdf2c06b760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdf30004940 tx=0x7fdf30009e30 comp rx=0 tx=0).stop 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.315+0000 7fdf4d800700 1 -- 172.21.15.57:0/3946502549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf48070330 msgr2=0x7fdf48115bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.315+0000 7fdf4d800700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf48070330 0x7fdf48115bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800c8c0 tx=0x7fdf380044c0 comp rx=0 tx=0).stop 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.316+0000 7fdf4d800700 1 -- 172.21.15.57:0/3946502549 shutdown_connections 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.316+0000 7fdf4d800700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fdf2c0692b0 0x7fdf2c06b760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.316+0000 7fdf4d800700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf48070330 0x7fdf48115bf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.316+0000 7fdf4d800700 1 --2- 172.21.15.57:0/3946502549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf48070c40 0x7fdf48116130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.316+0000 7fdf4d800700 1 -- 172.21.15.57:0/3946502549 >> 172.21.15.57:0/3946502549 conn(0x7fdf480f8af0 msgr2=0x7fdf48103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.316+0000 7fdf4d800700 1 -- 172.21.15.57:0/3946502549 shutdown_connections 2024-02-28T15:58:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:58:52.316+0000 7fdf4d800700 1 -- 172.21.15.57:0/3946502549 wait complete. 2024-02-28T15:58:52.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:52 smithi057 ceph-mon[28763]: pgmap v244: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-28T15:58:52.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:52 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3946502549' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T15:58:52.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:52 smithi087 ceph-mon[37122]: pgmap v244: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-28T15:58:52.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:52 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3946502549' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T15:58:53.211 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-28T15:58:53.211 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-28T15:58:53.211 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-02-28T15:58:53.211 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-28T15:58:53.211 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:53.211 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-28T15:58:53.211 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-28T15:58:53.211 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-28T15:58:53.211 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-28T15:58:53.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:53.212 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-02-28T15:58:53.270 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-28T15:58:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-28T15:58:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-02-28T15:58:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-02-28T15:58:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-28T15:58:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 41859sec preferred_lft 41859sec 2024-02-28T15:58:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-02-28T15:58:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-02-28T15:58:53.273 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-28T15:58:53.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:53.273 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-02-28T15:58:53.273 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-02-28T15:58:53.273 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-02-28T15:58:53.273 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-02-28T15:58:53.273 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-02-28T15:58:53.273 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-28T15:58:53.273 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-02-28T15:58:53.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:53.714 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-28T15:58:53.795 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-02-28T15:58:53.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:53.799 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-02-28T15:58:53.858 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-02-28T15:58:53.858 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-28T15:58:53.858 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-28T15:58:53.858 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-28T15:58:53.858 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-28T15:58:53.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:53.858 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-02-28T15:58:53.858 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-02-28T15:58:53.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-28T15:58:53.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-28T15:58:53.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-28T15:58:53.859 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-02-28T15:58:54.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:54 smithi087 ceph-mon[37122]: pgmap v245: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-28T15:58:54.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:54.607 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-02-28T15:58:54.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:54.662 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-02-28T15:58:54.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:54 smithi057 ceph-mon[28763]: pgmap v245: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-28T15:58:54.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:54.718 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-02-28T15:58:54.718 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-02-28T15:58:54.718 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T15:58:54.718 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-28T15:58:54.718 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-02-28T15:58:54.858 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-28T15:58:54.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:54.859 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-02-28T15:58:54.859 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-02-28T15:58:54.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-28T15:58:54.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-28T15:58:54.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-28T15:58:54.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-28T15:58:54.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-28T15:58:54.859 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-02-28T15:58:55.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:55.151 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-02-28T15:58:55.151 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-02-28T15:58:55.151 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-02-28T15:58:55.151 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-02-28T15:58:55.151 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-02-28T15:58:55.314 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-02-28T15:58:55.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T15:58:55.315 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:55.364 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-28T15:58:55.364 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T15:58:55.365 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:55.412 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-02-28T15:58:55.501 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T15:58:55.551 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:55.552 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/0 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/b95fff2c1148de6597ed6ed3afa5d92e58c716be9af6ce39aee996028675f26b/merged 2024-02-28T15:58:55.553 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/fd899d2aa17a8b4b14244a38fa3b07dbd79c0c55ad748fd8e971a0ae1670d8fc/merged 2024-02-28T15:58:55.554 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/378ddbe939b8612d251d937eef486afbd0be25898d197c8643d34edb564ad08e/merged 2024-02-28T15:58:55.554 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/8a0097daac6b9e063fbd72d18741eecf03aaaf292496585802557b183479bfa3/merged 2024-02-28T15:58:55.554 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/b0e0b2fbadaf6649aae835b850b9ad1a89bf9fc04bf0eb8cfa88e1bf8f139dc7/merged 2024-02-28T15:58:55.554 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/9691bbe1315fd719f6173fa95d3e7fcd153434a594f7d042392e3cbc77e0bfa1/merged 2024-02-28T15:58:55.554 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/b2b2f1ab9352612b5103b742903b55c60bd99acda5203844327f34add3b53b21/merged 2024-02-28T15:58:55.554 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/cc5edf0933cf51f3ffe93c1f55526747808635b8c7b04e4ff5c749c611f364e7/merged 2024-02-28T15:58:55.554 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/419d618e919b1b38410763b222413628c2d83e08896ad50d3b000878711a8380/merged 2024-02-28T15:58:55.554 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-02-28T15:58:55.554 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T15:58:55.554 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T15:58:55.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:55.555 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-02-28T15:58:55.605 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-28T15:58:55.606 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-02-28T15:58:55.652 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-02-28T15:58:55.728 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T15:58:55.769 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-02-28T15:58:55.769 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-02-28T15:58:55.769 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-02-28T15:58:55.769 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-02-28T15:58:55.769 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-02-28T15:58:55.770 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/0 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/b95fff2c1148de6597ed6ed3afa5d92e58c716be9af6ce39aee996028675f26b/merged 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/fd899d2aa17a8b4b14244a38fa3b07dbd79c0c55ad748fd8e971a0ae1670d8fc/merged 2024-02-28T15:58:55.771 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/378ddbe939b8612d251d937eef486afbd0be25898d197c8643d34edb564ad08e/merged 2024-02-28T15:58:55.772 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/8a0097daac6b9e063fbd72d18741eecf03aaaf292496585802557b183479bfa3/merged 2024-02-28T15:58:55.772 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/b0e0b2fbadaf6649aae835b850b9ad1a89bf9fc04bf0eb8cfa88e1bf8f139dc7/merged 2024-02-28T15:58:55.772 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/9691bbe1315fd719f6173fa95d3e7fcd153434a594f7d042392e3cbc77e0bfa1/merged 2024-02-28T15:58:55.772 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/b2b2f1ab9352612b5103b742903b55c60bd99acda5203844327f34add3b53b21/merged 2024-02-28T15:58:55.772 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/cc5edf0933cf51f3ffe93c1f55526747808635b8c7b04e4ff5c749c611f364e7/merged 2024-02-28T15:58:55.772 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/419d618e919b1b38410763b222413628c2d83e08896ad50d3b000878711a8380/merged 2024-02-28T15:58:55.772 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-02-28T15:58:55.772 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T15:58:55.772 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T15:58:55.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:55.773 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-02-28T15:58:55.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-02-28T15:58:55.868+0000 7f6acf907300 -1 init, newargv = 0x560f6a111060 newargc=15 2024-02-28T15:58:55.861 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[62491]: starting ceph client 2024-02-28T15:58:55.876 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[62491]: starting fuse 2024-02-28T15:58:56.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:56 smithi057 ceph-mon[28763]: pgmap v246: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-28T15:58:56.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:56 smithi087 ceph-mon[37122]: pgmap v246: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-28T15:58:56.960 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-02-28T15:58:57.060 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T15:58:57.110 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-02-28T15:58:57.110 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-02-28T15:58:57.110 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-02-28T15:58:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/0 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/b95fff2c1148de6597ed6ed3afa5d92e58c716be9af6ce39aee996028675f26b/merged 2024-02-28T15:58:57.112 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/fd899d2aa17a8b4b14244a38fa3b07dbd79c0c55ad748fd8e971a0ae1670d8fc/merged 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/378ddbe939b8612d251d937eef486afbd0be25898d197c8643d34edb564ad08e/merged 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/8a0097daac6b9e063fbd72d18741eecf03aaaf292496585802557b183479bfa3/merged 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/b0e0b2fbadaf6649aae835b850b9ad1a89bf9fc04bf0eb8cfa88e1bf8f139dc7/merged 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/9691bbe1315fd719f6173fa95d3e7fcd153434a594f7d042392e3cbc77e0bfa1/merged 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/b2b2f1ab9352612b5103b742903b55c60bd99acda5203844327f34add3b53b21/merged 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/cc5edf0933cf51f3ffe93c1f55526747808635b8c7b04e4ff5c749c611f364e7/merged 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/containers/storage/overlay/419d618e919b1b38410763b222413628c2d83e08896ad50d3b000878711a8380/merged 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T15:58:57.113 INFO:teuthology.orchestra.run.smithi087.stdout:/home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:57.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:57.114 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-02-28T15:58:57.161 INFO:teuthology.orchestra.run.smithi087.stdout:114 2024-02-28T15:58:57.162 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-02-28T15:58:57.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-02-28T15:58:57.162 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-02-28T15:58:57.162 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-02-28T15:58:57.162 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-28T15:58:57.163 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-28T15:58:57.164 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-02-28T15:58:57.164 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-02-28T15:58:57.164 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-02-28T15:58:57.164 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-28T15:58:57.164 DEBUG:teuthology.orchestra.run.smithi087:> 2024-02-28T15:58:57.164 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-02-28T15:58:57.164 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-02-28T15:58:57.335 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.62491.asok 2024-02-28T15:58:57.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-02-28T15:58:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-28T15:58:57.353 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.62491.asok 2024-02-28T15:58:57.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:57.353 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.62491.asok status 2024-02-28T15:58:57.580 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-02-28T15:58:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-02-28T15:58:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "c0f02e608ed955f887728ffa27c686f52f9fd400", 2024-02-28T15:58:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)", 2024-02-28T15:58:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-02-28T15:58:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-02-28T15:58:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-02-28T15:58:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "62491", 2024-02-28T15:58:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-02-28T15:58:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24333, 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 24333 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1820173252 2024-02-28T15:58:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1820173252 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.24333 192.168.0.1:0/1820173252", 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1820173252", 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 14, 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 46, 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-02-28T15:58:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-02-28T15:58:57.583 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-02-28T15:58:57.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:57.595 DEBUG:teuthology.orchestra.run.smithi057:> stat --file-system '--printf=%T 2024-02-28T15:58:57.595 DEBUG:teuthology.orchestra.run.smithi057:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:57.658 INFO:teuthology.orchestra.run.smithi057.stdout:fuseblk 2024-02-28T15:58:57.658 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:57.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:57.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:57.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:57.772 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-02-28T15:58:57.772 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:57.827 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-02-28T15:58:57.827 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:57.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T15:58:57.827 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:58.188 INFO:teuthology.run_tasks:Running task print... 2024-02-28T15:58:58.200 INFO:teuthology.task.print:**** done client 2024-02-28T15:58:58.200 INFO:teuthology.run_tasks:Running task parallel... 2024-02-28T15:58:58.217 INFO:teuthology.task.parallel:starting parallel... 2024-02-28T15:58:58.217 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-28T15:58:58.218 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T15:58:58.218 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:58:58.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-02-28T15:58:58.219 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-28T15:58:58.219 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-28T15:58:58.223 INFO:tasks.workunit:Pulling workunits from ref 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:58:58.223 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-28T15:58:58.223 INFO:tasks.workunit:timeout=3h 2024-02-28T15:58:58.223 INFO:tasks.workunit:cleanup=True 2024-02-28T15:58:58.223 DEBUG:teuthology.orchestra.run.smithi057:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:58.279 INFO:teuthology.orchestra.run.smithi057.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:58.279 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-28T15:58:58.279 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 93h/147d Inode: 1 Links: 2 2024-02-28T15:58:58.279 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T15:58:58.279 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-28T15:58:58.279 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-28T15:58:58.279 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-02-28 15:58:08.743716378 +0000 2024-02-28T15:58:58.279 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-02-28 15:58:57.769538723 +0000 2024-02-28T15:58:58.280 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-02-28T15:58:58.280 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-28T15:58:58.280 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-28T15:58:58.426 DEBUG:teuthology.orchestra.run.smithi087:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:58.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:58:58 smithi087 ceph-mon[37122]: pgmap v247: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 426 B/s wr, 4 op/s 2024-02-28T15:58:58.486 INFO:teuthology.orchestra.run.smithi087.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:58.486 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-28T15:58:58.486 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 72h/114d Inode: 1 Links: 3 2024-02-28T15:58:58.486 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T15:58:58.486 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-28T15:58:58.486 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-28T15:58:58.486 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-02-28 15:58:58.416918463 +0000 2024-02-28T15:58:58.487 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-02-28 15:58:58.416918463 +0000 2024-02-28T15:58:58.487 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-02-28T15:58:58.487 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-28T15:58:58.487 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-28T15:58:58.632 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:58:58.633 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:58:58.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:58:58 smithi057 ceph-mon[28763]: pgmap v247: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 426 B/s wr, 4 op/s 2024-02-28T15:58:58.683 INFO:tasks.workunit.client.0.smithi057.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-28T15:58:58.693 INFO:tasks.workunit.client.1.smithi087.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-28T15:58:58.714 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:59:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:00 smithi057 ceph-mon[28763]: pgmap v248: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-02-28T15:59:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:00 smithi087 ceph-mon[37122]: pgmap v248: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-02-28T15:59:00.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.938+0000 7f1a84600700 1 -- 172.21.15.57:0/2821387898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a7c0fe0e0 msgr2=0x7f1a7c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:00.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.938+0000 7f1a84600700 1 --2- 172.21.15.57:0/2821387898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a7c0fe0e0 0x7f1a7c0fe550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a68004940 tx=0x7f1a68009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:00.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.938+0000 7f1a84600700 1 -- 172.21.15.57:0/2821387898 shutdown_connections 2024-02-28T15:59:00.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.938+0000 7f1a84600700 1 --2- 172.21.15.57:0/2821387898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a7c0fe0e0 0x7f1a7c0fe550 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:00.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.938+0000 7f1a84600700 1 --2- 172.21.15.57:0/2821387898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a7c0fcef0 0x7f1a7c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:00.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.938+0000 7f1a84600700 1 -- 172.21.15.57:0/2821387898 >> 172.21.15.57:0/2821387898 conn(0x7f1a7c0f8620 msgr2=0x7f1a7c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:00.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.938+0000 7f1a84600700 1 -- 172.21.15.57:0/2821387898 shutdown_connections 2024-02-28T15:59:00.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.938+0000 7f1a84600700 1 -- 172.21.15.57:0/2821387898 wait complete. 2024-02-28T15:59:00.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.939+0000 7f1a84600700 1 Processor -- start 2024-02-28T15:59:00.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.940+0000 7f1a84600700 1 -- start start 2024-02-28T15:59:00.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.940+0000 7f1a84600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a7c0fcef0 0x7f1a7c10fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:00.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.940+0000 7f1a84600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a7c0fe0e0 0x7f1a7c1100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:00.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.940+0000 7f1a84600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c1106a0 con 0x7f1a7c0fcef0 2024-02-28T15:59:00.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.940+0000 7f1a84600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c110f40 con 0x7f1a7c0fe0e0 2024-02-28T15:59:00.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.940+0000 7f1a81c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a7c0fcef0 0x7f1a7c10fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:00.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.941+0000 7f1a81c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a7c0fcef0 0x7f1a7c10fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41674/0 (socket says 172.21.15.57:41674) 2024-02-28T15:59:00.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.941+0000 7f1a81c00700 1 -- 172.21.15.57:0/2564625688 learned_addr learned my addr 172.21.15.57:0/2564625688 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.941+0000 7f1a81200700 1 --2- 172.21.15.57:0/2564625688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a7c0fe0e0 0x7f1a7c1100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.941+0000 7f1a81c00700 1 -- 172.21.15.57:0/2564625688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a7c0fe0e0 msgr2=0x7f1a7c1100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.941+0000 7f1a81c00700 1 --2- 172.21.15.57:0/2564625688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a7c0fe0e0 0x7f1a7c1100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.941+0000 7f1a81c00700 1 -- 172.21.15.57:0/2564625688 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a68005040 con 0x7f1a7c0fcef0 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.941+0000 7f1a81200700 1 --2- 172.21.15.57:0/2564625688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a7c0fe0e0 0x7f1a7c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.941+0000 7f1a81c00700 1 --2- 172.21.15.57:0/2564625688 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a7c0fcef0 0x7f1a7c10fb60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1a70002a80 tx=0x7f1a70004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.942+0000 7f1a79600700 1 -- 172.21.15.57:0/2564625688 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a70007cc0 con 0x7f1a7c0fcef0 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.942+0000 7f1a79600700 1 -- 172.21.15.57:0/2564625688 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a7000f040 con 0x7f1a7c0fcef0 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.942+0000 7f1a79600700 1 -- 172.21.15.57:0/2564625688 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7000dad0 con 0x7f1a7c0fcef0 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.942+0000 7f1a84600700 1 -- 172.21.15.57:0/2564625688 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7c111220 con 0x7f1a7c0fcef0 2024-02-28T15:59:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.942+0000 7f1a84600700 1 -- 172.21.15.57:0/2564625688 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7c111710 con 0x7f1a7c0fcef0 2024-02-28T15:59:00.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.943+0000 7f1a84600700 1 -- 172.21.15.57:0/2564625688 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7c102210 con 0x7f1a7c0fcef0 2024-02-28T15:59:00.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.944+0000 7f1a79600700 1 -- 172.21.15.57:0/2564625688 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f1a7000dc30 con 0x7f1a7c0fcef0 2024-02-28T15:59:00.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.945+0000 7f1a79600700 1 --2- 172.21.15.57:0/2564625688 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f1a640692a0 0x7f1a6406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:00.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.945+0000 7f1a79600700 1 -- 172.21.15.57:0/2564625688 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1a70086fe0 con 0x7f1a7c0fcef0 2024-02-28T15:59:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.945+0000 7f1a81200700 1 --2- 172.21.15.57:0/2564625688 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f1a640692a0 0x7f1a6406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.946+0000 7f1a81200700 1 --2- 172.21.15.57:0/2564625688 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f1a640692a0 0x7f1a6406b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000c00 tx=0x7f1a68009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:00.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:00.950+0000 7f1a79600700 1 -- 172.21.15.57:0/2564625688 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1a70056c80 con 0x7f1a7c0fcef0 2024-02-28T15:59:01.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:01.162+0000 7f1a84600700 1 -- 172.21.15.57:0/2564625688 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f1a7c04bed0 con 0x7f1a7c0fcef0 2024-02-28T15:59:01.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:01.163+0000 7f1a79600700 1 -- 172.21.15.57:0/2564625688 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f1a70056810 con 0x7f1a7c0fcef0 2024-02-28T15:59:01.159 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-02-28T15:59:02.069 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T15:59:02.069 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:59:02.069 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-28T15:59:02.625 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:59:02.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:02 smithi057 ceph-mon[28763]: pgmap v249: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-28T15:59:02.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:02 smithi087 ceph-mon[37122]: pgmap v249: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-28T15:59:04.665 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:04 smithi057 ceph-mon[28763]: pgmap v250: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 426 B/s wr, 4 op/s 2024-02-28T15:59:04.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:04 smithi087 ceph-mon[37122]: pgmap v250: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 426 B/s wr, 4 op/s 2024-02-28T15:59:04.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.832+0000 7f46f0600700 1 -- 172.21.15.57:0/3766426487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46e80fbe40 msgr2=0x7f46e80fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:04.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.832+0000 7f46f0600700 1 --2- 172.21.15.57:0/3766426487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46e80fbe40 0x7f46e80fc250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f46dc004940 tx=0x7f46dc009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:04.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.833+0000 7f46f0600700 1 -- 172.21.15.57:0/3766426487 shutdown_connections 2024-02-28T15:59:04.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.833+0000 7f46f0600700 1 --2- 172.21.15.57:0/3766426487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80fcfb0 0x7f46e80fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:04.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.833+0000 7f46f0600700 1 --2- 172.21.15.57:0/3766426487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46e80fbe40 0x7f46e80fc250 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:04.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.833+0000 7f46f0600700 1 -- 172.21.15.57:0/3766426487 >> 172.21.15.57:0/3766426487 conn(0x7f46e80f7500 msgr2=0x7f46e80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:04.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.833+0000 7f46f0600700 1 -- 172.21.15.57:0/3766426487 shutdown_connections 2024-02-28T15:59:04.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.833+0000 7f46f0600700 1 -- 172.21.15.57:0/3766426487 wait complete. 2024-02-28T15:59:04.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.834+0000 7f46f0600700 1 Processor -- start 2024-02-28T15:59:04.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.834+0000 7f46f0600700 1 -- start start 2024-02-28T15:59:04.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.834+0000 7f46f0600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46e80fbe40 0x7f46e810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:04.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.834+0000 7f46f0600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80fcfb0 0x7f46e8110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:04.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.834+0000 7f46f0600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8110710 con 0x7f46e80fbe40 2024-02-28T15:59:04.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.834+0000 7f46f0600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8110f50 con 0x7f46e80fcfb0 2024-02-28T15:59:04.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.834+0000 7f46edc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46e80fbe40 0x7f46e810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:04.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.834+0000 7f46edc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46e80fbe40 0x7f46e810fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41286/0 (socket says 172.21.15.57:41286) 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.834+0000 7f46edc00700 1 -- 172.21.15.57:0/2573561735 learned_addr learned my addr 172.21.15.57:0/2573561735 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.835+0000 7f46ed200700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80fcfb0 0x7f46e8110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.835+0000 7f46edc00700 1 -- 172.21.15.57:0/2573561735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80fcfb0 msgr2=0x7f46e8110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.835+0000 7f46edc00700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80fcfb0 0x7f46e8110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.835+0000 7f46edc00700 1 -- 172.21.15.57:0/2573561735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc005040 con 0x7f46e80fbe40 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.835+0000 7f46edc00700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46e80fbe40 0x7f46e810fb40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00b3b0 tx=0x7f46dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.835+0000 7f46e5600700 1 -- 172.21.15.57:0/2573561735 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46dc00e040 con 0x7f46e80fbe40 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.835+0000 7f46f0600700 1 -- 172.21.15.57:0/2573561735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e81111d0 con 0x7f46e80fbe40 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.836+0000 7f46e5600700 1 -- 172.21.15.57:0/2573561735 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46dc00bd90 con 0x7f46e80fbe40 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.836+0000 7f46e5600700 1 -- 172.21.15.57:0/2573561735 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46dc01c630 con 0x7f46e80fbe40 2024-02-28T15:59:04.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.836+0000 7f46f0600700 1 -- 172.21.15.57:0/2573561735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e8111710 con 0x7f46e80fbe40 2024-02-28T15:59:04.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.837+0000 7f46f0600700 1 -- 172.21.15.57:0/2573561735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e81030f0 con 0x7f46e80fbe40 2024-02-28T15:59:04.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.838+0000 7f46e5600700 1 -- 172.21.15.57:0/2573561735 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f46dc0139f0 con 0x7f46e80fbe40 2024-02-28T15:59:04.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.838+0000 7f46e5600700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f46d00692b0 0x7f46d006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:04.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.839+0000 7f46e5600700 1 -- 172.21.15.57:0/2573561735 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f46dc0886e0 con 0x7f46e80fbe40 2024-02-28T15:59:04.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.839+0000 7f46ed200700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f46d00692b0 0x7f46d006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:04.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.840+0000 7f46ed200700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f46d00692b0 0x7f46d006b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46d4006fd0 tx=0x7f46d4008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:04.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:04.843+0000 7f46e5600700 1 -- 172.21.15.57:0/2573561735 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f46dc058480 con 0x7f46e80fbe40 2024-02-28T15:59:05.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.053+0000 7f46f0600700 1 -- 172.21.15.57:0/2573561735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f46e804bed0 con 0x7f46e80fbe40 2024-02-28T15:59:05.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.054+0000 7f46e5600700 1 -- 172.21.15.57:0/2573561735 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f46dc058010 con 0x7f46e80fbe40 2024-02-28T15:59:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.056+0000 7f46f0600700 1 -- 172.21.15.57:0/2573561735 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f46d00692b0 msgr2=0x7f46d006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.056+0000 7f46f0600700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f46d00692b0 0x7f46d006b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46d4006fd0 tx=0x7f46d4008040 comp rx=0 tx=0).stop 2024-02-28T15:59:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.056+0000 7f46f0600700 1 -- 172.21.15.57:0/2573561735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46e80fbe40 msgr2=0x7f46e810fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.056+0000 7f46f0600700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46e80fbe40 0x7f46e810fb40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00b3b0 tx=0x7f46dc009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.056+0000 7f46f0600700 1 -- 172.21.15.57:0/2573561735 shutdown_connections 2024-02-28T15:59:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.056+0000 7f46f0600700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f46d00692b0 0x7f46d006b760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.056+0000 7f46f0600700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46e80fbe40 0x7f46e810fb40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.056+0000 7f46f0600700 1 --2- 172.21.15.57:0/2573561735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80fcfb0 0x7f46e8110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.056+0000 7f46f0600700 1 -- 172.21.15.57:0/2573561735 >> 172.21.15.57:0/2573561735 conn(0x7f46e80f7500 msgr2=0x7f46e8100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.057+0000 7f46f0600700 1 -- 172.21.15.57:0/2573561735 shutdown_connections 2024-02-28T15:59:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:05.057+0000 7f46f0600700 1 -- 172.21.15.57:0/2573561735 wait complete. 2024-02-28T15:59:05.914 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-28T15:59:06.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:06 smithi057 ceph-mon[28763]: pgmap v251: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-02-28T15:59:06.436 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:59:06.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:06 smithi087 ceph-mon[37122]: pgmap v251: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-02-28T15:59:07.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:07 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:59:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:07 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:59:08.292 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:08 smithi057 ceph-mon[28763]: pgmap v252: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-28T15:59:08.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:08 smithi087 ceph-mon[37122]: pgmap v252: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-28T15:59:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.560+0000 7f4053600700 1 -- 172.21.15.57:0/3958862536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f404c103540 msgr2=0x7f404c103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.560+0000 7f4053600700 1 --2- 172.21.15.57:0/3958862536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f404c103540 0x7f404c103950 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4040004940 tx=0x7f4040009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.560+0000 7f4053600700 1 -- 172.21.15.57:0/3958862536 shutdown_connections 2024-02-28T15:59:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.560+0000 7f4053600700 1 --2- 172.21.15.57:0/3958862536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c104750 0x7f404c104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.560+0000 7f4053600700 1 --2- 172.21.15.57:0/3958862536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f404c103540 0x7f404c103950 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.560+0000 7f4053600700 1 -- 172.21.15.57:0/3958862536 >> 172.21.15.57:0/3958862536 conn(0x7f404c0727d0 msgr2=0x7f404c074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.560+0000 7f4053600700 1 -- 172.21.15.57:0/3958862536 shutdown_connections 2024-02-28T15:59:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.560+0000 7f4053600700 1 -- 172.21.15.57:0/3958862536 wait complete. 2024-02-28T15:59:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.561+0000 7f4053600700 1 Processor -- start 2024-02-28T15:59:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.561+0000 7f4053600700 1 -- start start 2024-02-28T15:59:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.562+0000 7f4053600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c103540 0x7f404c113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.562+0000 7f4053600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f404c104750 0x7f404c1144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.562+0000 7f4053600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c114aa0 con 0x7f404c104750 2024-02-28T15:59:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.562+0000 7f4053600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c115340 con 0x7f404c103540 2024-02-28T15:59:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.562+0000 7f404be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f404c104750 0x7f404c1144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.562+0000 7f404be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f404c104750 0x7f404c1144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41314/0 (socket says 172.21.15.57:41314) 2024-02-28T15:59:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.562+0000 7f404be00700 1 -- 172.21.15.57:0/3143591366 learned_addr learned my addr 172.21.15.57:0/3143591366 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.562+0000 7f4050c00700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c103540 0x7f404c113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.563+0000 7f404be00700 1 -- 172.21.15.57:0/3143591366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c103540 msgr2=0x7f404c113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.563+0000 7f404be00700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c103540 0x7f404c113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.563+0000 7f404be00700 1 -- 172.21.15.57:0/3143591366 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040005040 con 0x7f404c104750 2024-02-28T15:59:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.563+0000 7f404be00700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f404c104750 0x7f404c1144a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4038002a50 tx=0x7f40380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.563+0000 7f4048c00700 1 -- 172.21.15.57:0/3143591366 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4038007cc0 con 0x7f404c104750 2024-02-28T15:59:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.564+0000 7f4053600700 1 -- 172.21.15.57:0/3143591366 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c115620 con 0x7f404c104750 2024-02-28T15:59:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.564+0000 7f4048c00700 1 -- 172.21.15.57:0/3143591366 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f403800f040 con 0x7f404c104750 2024-02-28T15:59:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.564+0000 7f4048c00700 1 -- 172.21.15.57:0/3143591366 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f403800da30 con 0x7f404c104750 2024-02-28T15:59:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.564+0000 7f4053600700 1 -- 172.21.15.57:0/3143591366 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c115b60 con 0x7f404c104750 2024-02-28T15:59:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.565+0000 7f4053600700 1 -- 172.21.15.57:0/3143591366 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c04bed0 con 0x7f404c104750 2024-02-28T15:59:08.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.566+0000 7f4048c00700 1 -- 172.21.15.57:0/3143591366 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f403800db90 con 0x7f404c104750 2024-02-28T15:59:08.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.567+0000 7f4048c00700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f40340692b0 0x7f403406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:08.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.567+0000 7f4048c00700 1 -- 172.21.15.57:0/3143591366 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4038086f00 con 0x7f404c104750 2024-02-28T15:59:08.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.568+0000 7f4050c00700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f40340692b0 0x7f403406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:08.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.568+0000 7f4050c00700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f40340692b0 0x7f403406b760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f404000b840 tx=0x7f4040009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:08.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.572+0000 7f4048c00700 1 -- 172.21.15.57:0/3143591366 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4038056c20 con 0x7f404c104750 2024-02-28T15:59:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.791+0000 7f4053600700 1 -- 172.21.15.57:0/3143591366 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f404c10c020 con 0x7f404c104750 2024-02-28T15:59:08.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.792+0000 7f4048c00700 1 -- 172.21.15.57:0/3143591366 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f40380567b0 con 0x7f404c104750 2024-02-28T15:59:08.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.795+0000 7f4053600700 1 -- 172.21.15.57:0/3143591366 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f40340692b0 msgr2=0x7f403406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:08.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.795+0000 7f4053600700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f40340692b0 0x7f403406b760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f404000b840 tx=0x7f4040009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:08.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.795+0000 7f4053600700 1 -- 172.21.15.57:0/3143591366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f404c104750 msgr2=0x7f404c1144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:08.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.795+0000 7f4053600700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f404c104750 0x7f404c1144a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4038002a50 tx=0x7f40380046b0 comp rx=0 tx=0).stop 2024-02-28T15:59:08.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.795+0000 7f4053600700 1 -- 172.21.15.57:0/3143591366 shutdown_connections 2024-02-28T15:59:08.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.795+0000 7f4053600700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f40340692b0 0x7f403406b760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:08.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.795+0000 7f4053600700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c103540 0x7f404c113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:08.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.795+0000 7f4053600700 1 --2- 172.21.15.57:0/3143591366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f404c104750 0x7f404c1144a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:08.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.795+0000 7f4053600700 1 -- 172.21.15.57:0/3143591366 >> 172.21.15.57:0/3143591366 conn(0x7f404c0727d0 msgr2=0x7f404c107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:08.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.796+0000 7f4053600700 1 -- 172.21.15.57:0/3143591366 shutdown_connections 2024-02-28T15:59:08.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:08.796+0000 7f4053600700 1 -- 172.21.15.57:0/3143591366 wait complete. 2024-02-28T15:59:09.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-28T15:59:10.190 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:59:10.645 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:10 smithi087 ceph-mon[37122]: pgmap v253: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-28T15:59:10.653 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:10 smithi057 ceph-mon[28763]: pgmap v253: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-28T15:59:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.416+0000 7f2d47600700 1 -- 172.21.15.57:0/3039337046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d400708c0 msgr2=0x7f2d40070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.416+0000 7f2d47600700 1 --2- 172.21.15.57:0/3039337046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d400708c0 0x7f2d40070d10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c004940 tx=0x7f2d2c009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.417+0000 7f2d47600700 1 -- 172.21.15.57:0/3039337046 shutdown_connections 2024-02-28T15:59:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.417+0000 7f2d47600700 1 --2- 172.21.15.57:0/3039337046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d400708c0 0x7f2d40070d10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.417+0000 7f2d47600700 1 --2- 172.21.15.57:0/3039337046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d40071f10 0x7f2d40070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.417+0000 7f2d47600700 1 -- 172.21.15.57:0/3039337046 >> 172.21.15.57:0/3039337046 conn(0x7f2d400f8620 msgr2=0x7f2d400faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.417+0000 7f2d47600700 1 -- 172.21.15.57:0/3039337046 shutdown_connections 2024-02-28T15:59:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.417+0000 7f2d47600700 1 -- 172.21.15.57:0/3039337046 wait complete. 2024-02-28T15:59:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.417+0000 7f2d47600700 1 Processor -- start 2024-02-28T15:59:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.418+0000 7f2d47600700 1 -- start start 2024-02-28T15:59:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.418+0000 7f2d47600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d400708c0 0x7f2d4010fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.418+0000 7f2d47600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d40071f10 0x7f2d401100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.418+0000 7f2d47600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401106b0 con 0x7f2d40071f10 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.418+0000 7f2d47600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40110f50 con 0x7f2d400708c0 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.418+0000 7f2d3fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d40071f10 0x7f2d401100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.418+0000 7f2d3fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d40071f10 0x7f2d401100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55636/0 (socket says 172.21.15.57:55636) 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.418+0000 7f2d3fe00700 1 -- 172.21.15.57:0/4036644847 learned_addr learned my addr 172.21.15.57:0/4036644847 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.419+0000 7f2d3fe00700 1 -- 172.21.15.57:0/4036644847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d400708c0 msgr2=0x7f2d4010fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.419+0000 7f2d3fe00700 1 --2- 172.21.15.57:0/4036644847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d400708c0 0x7f2d4010fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.419+0000 7f2d3fe00700 1 -- 172.21.15.57:0/4036644847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c005040 con 0x7f2d40071f10 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.419+0000 7f2d3fe00700 1 --2- 172.21.15.57:0/4036644847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d40071f10 0x7f2d401100b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009fd0 tx=0x7f2d2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.419+0000 7f2d3cc00700 1 -- 172.21.15.57:0/4036644847 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d2c00e040 con 0x7f2d40071f10 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.419+0000 7f2d3cc00700 1 -- 172.21.15.57:0/4036644847 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d2c004290 con 0x7f2d40071f10 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.419+0000 7f2d47600700 1 -- 172.21.15.57:0/4036644847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d401111d0 con 0x7f2d40071f10 2024-02-28T15:59:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.419+0000 7f2d3cc00700 1 -- 172.21.15.57:0/4036644847 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d2c01c630 con 0x7f2d40071f10 2024-02-28T15:59:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.419+0000 7f2d47600700 1 -- 172.21.15.57:0/4036644847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d40111710 con 0x7f2d40071f10 2024-02-28T15:59:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.421+0000 7f2d47600700 1 -- 172.21.15.57:0/4036644847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4004bed0 con 0x7f2d40071f10 2024-02-28T15:59:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.422+0000 7f2d3cc00700 1 -- 172.21.15.57:0/4036644847 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f2d2c00bc60 con 0x7f2d40071f10 2024-02-28T15:59:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.423+0000 7f2d3cc00700 1 --2- 172.21.15.57:0/4036644847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f2d280692b0 0x7f2d2806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.423+0000 7f2d3cc00700 1 -- 172.21.15.57:0/4036644847 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2d2c0886c0 con 0x7f2d40071f10 2024-02-28T15:59:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.423+0000 7f2d44c00700 1 --2- 172.21.15.57:0/4036644847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f2d280692b0 0x7f2d2806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.424+0000 7f2d44c00700 1 --2- 172.21.15.57:0/4036644847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f2d280692b0 0x7f2d2806b760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d34004b70 tx=0x7f2d34007cc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.428+0000 7f2d3cc00700 1 -- 172.21.15.57:0/4036644847 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2d2c058360 con 0x7f2d40071f10 2024-02-28T15:59:12.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:12 smithi087 ceph-mon[37122]: pgmap v254: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 938 B/s wr, 4 op/s 2024-02-28T15:59:12.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.639+0000 7f2d47600700 1 -- 172.21.15.57:0/4036644847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f2d40107c10 con 0x7f2d40071f10 2024-02-28T15:59:12.633 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:12 smithi057 ceph-mon[28763]: pgmap v254: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 938 B/s wr, 4 op/s 2024-02-28T15:59:12.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.640+0000 7f2d3cc00700 1 -- 172.21.15.57:0/4036644847 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f2d2c057ef0 con 0x7f2d40071f10 2024-02-28T15:59:12.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 -- 172.21.15.57:0/4036644847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f2d280692b0 msgr2=0x7f2d2806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:12.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 --2- 172.21.15.57:0/4036644847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f2d280692b0 0x7f2d2806b760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d34004b70 tx=0x7f2d34007cc0 comp rx=0 tx=0).stop 2024-02-28T15:59:12.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 -- 172.21.15.57:0/4036644847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d40071f10 msgr2=0x7f2d401100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:12.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 --2- 172.21.15.57:0/4036644847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d40071f10 0x7f2d401100b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009fd0 tx=0x7f2d2c009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:12.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 -- 172.21.15.57:0/4036644847 shutdown_connections 2024-02-28T15:59:12.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 --2- 172.21.15.57:0/4036644847 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f2d280692b0 0x7f2d2806b760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:12.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 --2- 172.21.15.57:0/4036644847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d400708c0 0x7f2d4010fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:12.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 --2- 172.21.15.57:0/4036644847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d40071f10 0x7f2d401100b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:12.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 -- 172.21.15.57:0/4036644847 >> 172.21.15.57:0/4036644847 conn(0x7f2d400f8620 msgr2=0x7f2d40102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:12.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 -- 172.21.15.57:0/4036644847 shutdown_connections 2024-02-28T15:59:12.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:12.644+0000 7f2d47600700 1 -- 172.21.15.57:0/4036644847 wait complete. 2024-02-28T15:59:13.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-28T15:59:14.018 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:59:14.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:14 smithi057 ceph-mon[28763]: pgmap v255: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-28T15:59:14.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:14 smithi087 ceph-mon[37122]: pgmap v255: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-28T15:59:16.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.169+0000 7fd016e00700 1 -- 172.21.15.57:0/4077164293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0100663e0 msgr2=0x7fd0100ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:16.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.169+0000 7fd016e00700 1 --2- 172.21.15.57:0/4077164293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0100663e0 0x7fd0100ffaf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd000004940 tx=0x7fd000009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:16.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.169+0000 7fd016e00700 1 -- 172.21.15.57:0/4077164293 shutdown_connections 2024-02-28T15:59:16.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.169+0000 7fd016e00700 1 --2- 172.21.15.57:0/4077164293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0101000c0 0x7fd010102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:16.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.169+0000 7fd016e00700 1 --2- 172.21.15.57:0/4077164293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0100663e0 0x7fd0100ffaf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:16.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.169+0000 7fd016e00700 1 -- 172.21.15.57:0/4077164293 >> 172.21.15.57:0/4077164293 conn(0x7fd0100f74e0 msgr2=0x7fd0100f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:16.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.169+0000 7fd016e00700 1 -- 172.21.15.57:0/4077164293 shutdown_connections 2024-02-28T15:59:16.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.169+0000 7fd016e00700 1 -- 172.21.15.57:0/4077164293 wait complete. 2024-02-28T15:59:16.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.170+0000 7fd016e00700 1 Processor -- start 2024-02-28T15:59:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.171+0000 7fd016e00700 1 -- start start 2024-02-28T15:59:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.171+0000 7fd016e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0100663e0 0x7fd01010fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.171+0000 7fd016e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0101000c0 0x7fd010110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.171+0000 7fd016e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd010110660 con 0x7fd0100663e0 2024-02-28T15:59:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.171+0000 7fd016e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd010110f00 con 0x7fd0101000c0 2024-02-28T15:59:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.172+0000 7fd00fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0100663e0 0x7fd01010fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.172+0000 7fd00fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0100663e0 0x7fd01010fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55662/0 (socket says 172.21.15.57:55662) 2024-02-28T15:59:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.172+0000 7fd00fe00700 1 -- 172.21.15.57:0/4287903072 learned_addr learned my addr 172.21.15.57:0/4287903072 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.172+0000 7fd00f400700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0101000c0 0x7fd010110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.172+0000 7fd00fe00700 1 -- 172.21.15.57:0/4287903072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0101000c0 msgr2=0x7fd010110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:16.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.172+0000 7fd00fe00700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0101000c0 0x7fd010110060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:16.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.172+0000 7fd00fe00700 1 -- 172.21.15.57:0/4287903072 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd000005040 con 0x7fd0100663e0 2024-02-28T15:59:16.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.173+0000 7fd00fe00700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0100663e0 0x7fd01010fb20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd000009fd0 tx=0x7fd000009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:16.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.173+0000 7fd007e00700 1 -- 172.21.15.57:0/4287903072 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00000e040 con 0x7fd0100663e0 2024-02-28T15:59:16.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.173+0000 7fd007e00700 1 -- 172.21.15.57:0/4287903072 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd00000bcc0 con 0x7fd0100663e0 2024-02-28T15:59:16.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.173+0000 7fd007e00700 1 -- 172.21.15.57:0/4287903072 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00001c630 con 0x7fd0100663e0 2024-02-28T15:59:16.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.173+0000 7fd016e00700 1 -- 172.21.15.57:0/4287903072 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd010111180 con 0x7fd0100663e0 2024-02-28T15:59:16.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.173+0000 7fd016e00700 1 -- 172.21.15.57:0/4287903072 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0101116c0 con 0x7fd0100663e0 2024-02-28T15:59:16.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.174+0000 7fd016e00700 1 -- 172.21.15.57:0/4287903072 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01004bed0 con 0x7fd0100663e0 2024-02-28T15:59:16.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.175+0000 7fd007e00700 1 -- 172.21.15.57:0/4287903072 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fd000013980 con 0x7fd0100663e0 2024-02-28T15:59:16.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.176+0000 7fd007e00700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcff40692b0 0x7fcff406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:16.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.176+0000 7fd007e00700 1 -- 172.21.15.57:0/4287903072 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd000088620 con 0x7fd0100663e0 2024-02-28T15:59:16.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.177+0000 7fd00f400700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcff40692b0 0x7fcff406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:16.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.177+0000 7fd00f400700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcff40692b0 0x7fcff406b760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd010066120 tx=0x7fcffc009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:16.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.181+0000 7fd007e00700 1 -- 172.21.15.57:0/4287903072 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd0000583c0 con 0x7fd0100663e0 2024-02-28T15:59:16.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.412+0000 7fd016e00700 1 -- 172.21.15.57:0/4287903072 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}) v1 -- 0x7fd010111d80 con 0x7fcff40692b0 2024-02-28T15:59:16.406 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:16 smithi057 ceph-mon[28763]: pgmap v256: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-02-28T15:59:16.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.425+0000 7fd007e00700 1 -- 172.21.15.57:0/4287903072 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fd010111d80 con 0x7fcff40692b0 2024-02-28T15:59:16.419 INFO:teuthology.orchestra.run.smithi057.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:59:16.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.428+0000 7fd016e00700 1 -- 172.21.15.57:0/4287903072 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcff40692b0 msgr2=0x7fcff406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:16.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.428+0000 7fd016e00700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcff40692b0 0x7fcff406b760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd010066120 tx=0x7fcffc009ee0 comp rx=0 tx=0).stop 2024-02-28T15:59:16.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.428+0000 7fd016e00700 1 -- 172.21.15.57:0/4287903072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0100663e0 msgr2=0x7fd01010fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:16.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.428+0000 7fd016e00700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0100663e0 0x7fd01010fb20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd000009fd0 tx=0x7fd000009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:16.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.428+0000 7fd016e00700 1 -- 172.21.15.57:0/4287903072 shutdown_connections 2024-02-28T15:59:16.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.428+0000 7fd016e00700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fcff40692b0 0x7fcff406b760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:16.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.428+0000 7fd016e00700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0100663e0 0x7fd01010fb20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:16.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.428+0000 7fd016e00700 1 --2- 172.21.15.57:0/4287903072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0101000c0 0x7fd010110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:16.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.428+0000 7fd016e00700 1 -- 172.21.15.57:0/4287903072 >> 172.21.15.57:0/4287903072 conn(0x7fd0100f74e0 msgr2=0x7fd0100fb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:16.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.429+0000 7fd016e00700 1 -- 172.21.15.57:0/4287903072 shutdown_connections 2024-02-28T15:59:16.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:16.429+0000 7fd016e00700 1 -- 172.21.15.57:0/4287903072 wait complete. 2024-02-28T15:59:16.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:16 smithi087 ceph-mon[37122]: pgmap v256: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-02-28T15:59:17.214 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T15:59:17.214 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T15:59:17.215 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-28T15:59:17.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:17 smithi057 ceph-mon[28763]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:17.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:17 smithi057 ceph-mon[28763]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:59:17.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:17 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:59:17.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:17 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:59:17.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:17 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:59:17.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:17 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:59:17.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:17 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:59:17.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:17 smithi057 ceph-mon[28763]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:59:17.698 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T15:59:17.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:17 smithi087 ceph-mon[37122]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:17.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:17 smithi087 ceph-mon[37122]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:59:17.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:17 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:59:17.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:17 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:59:17.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:17 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T15:59:17.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:17 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T15:59:17.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:17 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:59:17.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:17 smithi087 ceph-mon[37122]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:59:18.749 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:18 smithi057 ceph-mon[28763]: pgmap v257: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-28T15:59:18.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:18 smithi087 ceph-mon[37122]: pgmap v257: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-28T15:59:19.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.965+0000 7fd800000700 1 -- 172.21.15.57:0/1214265588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7f80663c0 msgr2=0x7fd7f80ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:19.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.965+0000 7fd800000700 1 --2- 172.21.15.57:0/1214265588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7f80663c0 0x7fd7f80ffb10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec004940 tx=0x7fd7ec009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:19.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.966+0000 7fd800000700 1 -- 172.21.15.57:0/1214265588 shutdown_connections 2024-02-28T15:59:19.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.966+0000 7fd800000700 1 --2- 172.21.15.57:0/1214265588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f81000e0 0x7fd7f8102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:19.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.966+0000 7fd800000700 1 --2- 172.21.15.57:0/1214265588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7f80663c0 0x7fd7f80ffb10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:19.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.966+0000 7fd800000700 1 -- 172.21.15.57:0/1214265588 >> 172.21.15.57:0/1214265588 conn(0x7fd7f80f74e0 msgr2=0x7fd7f80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:19.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.966+0000 7fd800000700 1 -- 172.21.15.57:0/1214265588 shutdown_connections 2024-02-28T15:59:19.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.966+0000 7fd800000700 1 -- 172.21.15.57:0/1214265588 wait complete. 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.967+0000 7fd800000700 1 Processor -- start 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.967+0000 7fd800000700 1 -- start start 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.967+0000 7fd800000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f80663c0 0x7fd7f810fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.967+0000 7fd800000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7f81000e0 0x7fd7f8110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.967+0000 7fd800000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8110690 con 0x7fd7f81000e0 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.967+0000 7fd800000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8110f30 con 0x7fd7f80663c0 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.968+0000 7fd7fcc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7f81000e0 0x7fd7f8110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.968+0000 7fd7fcc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7f81000e0 0x7fd7f8110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55684/0 (socket says 172.21.15.57:55684) 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.968+0000 7fd7fcc00700 1 -- 172.21.15.57:0/156884133 learned_addr learned my addr 172.21.15.57:0/156884133 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.968+0000 7fd7fd600700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f80663c0 0x7fd7f810fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.968+0000 7fd7fcc00700 1 -- 172.21.15.57:0/156884133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f80663c0 msgr2=0x7fd7f810fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.968+0000 7fd7fcc00700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f80663c0 0x7fd7f810fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:19.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.968+0000 7fd7fcc00700 1 -- 172.21.15.57:0/156884133 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec005040 con 0x7fd7f81000e0 2024-02-28T15:59:19.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.969+0000 7fd7fcc00700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7f81000e0 0x7fd7f8110090 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4002a50 tx=0x7fd7e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:19.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.969+0000 7fd7f5600700 1 -- 172.21.15.57:0/156884133 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7e4007cc0 con 0x7fd7f81000e0 2024-02-28T15:59:19.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.969+0000 7fd7f5600700 1 -- 172.21.15.57:0/156884133 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7e400f040 con 0x7fd7f81000e0 2024-02-28T15:59:19.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.969+0000 7fd7f5600700 1 -- 172.21.15.57:0/156884133 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7e400d970 con 0x7fd7f81000e0 2024-02-28T15:59:19.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.969+0000 7fd800000700 1 -- 172.21.15.57:0/156884133 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f8111210 con 0x7fd7f81000e0 2024-02-28T15:59:19.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.969+0000 7fd800000700 1 -- 172.21.15.57:0/156884133 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f8111700 con 0x7fd7f81000e0 2024-02-28T15:59:19.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.970+0000 7fd800000700 1 -- 172.21.15.57:0/156884133 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f804bed0 con 0x7fd7f81000e0 2024-02-28T15:59:19.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.971+0000 7fd7f5600700 1 -- 172.21.15.57:0/156884133 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fd7e4009730 con 0x7fd7f81000e0 2024-02-28T15:59:19.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.973+0000 7fd7f5600700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e00692b0 0x7fd7e006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:19.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.973+0000 7fd7f5600700 1 -- 172.21.15.57:0/156884133 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd7e4087060 con 0x7fd7f81000e0 2024-02-28T15:59:19.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.973+0000 7fd7fd600700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e00692b0 0x7fd7e006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:19.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.974+0000 7fd7fd600700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e00692b0 0x7fd7e006b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00b020 tx=0x7fd7ec009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:19.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:19.977+0000 7fd7f5600700 1 -- 172.21.15.57:0/156884133 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd7e4056a70 con 0x7fd7f81000e0 2024-02-28T15:59:20.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.228+0000 7fd800000700 1 -- 172.21.15.57:0/156884133 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7f8111c30 con 0x7fd7e00692b0 2024-02-28T15:59:20.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.230+0000 7fd7f5600700 1 -- 172.21.15.57:0/156884133 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fd7f8111c30 con 0x7fd7e00692b0 2024-02-28T15:59:20.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.232+0000 7fd800000700 1 -- 172.21.15.57:0/156884133 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e00692b0 msgr2=0x7fd7e006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.232+0000 7fd800000700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e00692b0 0x7fd7e006b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00b020 tx=0x7fd7ec009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.232+0000 7fd800000700 1 -- 172.21.15.57:0/156884133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7f81000e0 msgr2=0x7fd7f8110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.232+0000 7fd800000700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7f81000e0 0x7fd7f8110090 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4002a50 tx=0x7fd7e4004600 comp rx=0 tx=0).stop 2024-02-28T15:59:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.232+0000 7fd800000700 1 -- 172.21.15.57:0/156884133 shutdown_connections 2024-02-28T15:59:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.232+0000 7fd800000700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd7e00692b0 0x7fd7e006b760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.232+0000 7fd800000700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f80663c0 0x7fd7f810fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.232+0000 7fd800000700 1 --2- 172.21.15.57:0/156884133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7f81000e0 0x7fd7f8110090 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.232+0000 7fd800000700 1 -- 172.21.15.57:0/156884133 >> 172.21.15.57:0/156884133 conn(0x7fd7f80f74e0 msgr2=0x7fd7f80fb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.233+0000 7fd800000700 1 -- 172.21.15.57:0/156884133 shutdown_connections 2024-02-28T15:59:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.233+0000 7fd800000700 1 -- 172.21.15.57:0/156884133 wait complete. 2024-02-28T15:59:20.244 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T15:59:20.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.396+0000 7fe61b400700 1 -- 172.21.15.57:0/301032513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6140fe0e0 msgr2=0x7fe6140fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:20.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.396+0000 7fe61b400700 1 --2- 172.21.15.57:0/301032513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6140fe0e0 0x7fe6140fe550 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe600004940 tx=0x7fe600009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:20.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.396+0000 7fe61b400700 1 -- 172.21.15.57:0/301032513 shutdown_connections 2024-02-28T15:59:20.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.396+0000 7fe61b400700 1 --2- 172.21.15.57:0/301032513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6140fe0e0 0x7fe6140fe550 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.396+0000 7fe61b400700 1 --2- 172.21.15.57:0/301032513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fcef0 0x7fe6140fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.396+0000 7fe61b400700 1 -- 172.21.15.57:0/301032513 >> 172.21.15.57:0/301032513 conn(0x7fe6140f8620 msgr2=0x7fe6140faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:20.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.396+0000 7fe61b400700 1 -- 172.21.15.57:0/301032513 shutdown_connections 2024-02-28T15:59:20.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.396+0000 7fe61b400700 1 -- 172.21.15.57:0/301032513 wait complete. 2024-02-28T15:59:20.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.397+0000 7fe61b400700 1 Processor -- start 2024-02-28T15:59:20.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.397+0000 7fe61b400700 1 -- start start 2024-02-28T15:59:20.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.398+0000 7fe61b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6140fcef0 0x7fe614113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:20.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.398+0000 7fe61b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fe0e0 0x7fe6141144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:20.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.398+0000 7fe61b400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614114ab0 con 0x7fe6140fcef0 2024-02-28T15:59:20.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.398+0000 7fe61b400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614115350 con 0x7fe6140fe0e0 2024-02-28T15:59:20.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.398+0000 7fe618a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6140fcef0 0x7fe614113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:20.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.398+0000 7fe618a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6140fcef0 0x7fe614113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55716/0 (socket says 172.21.15.57:55716) 2024-02-28T15:59:20.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.398+0000 7fe618a00700 1 -- 172.21.15.57:0/269830232 learned_addr learned my addr 172.21.15.57:0/269830232 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:20.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.399+0000 7fe60be00700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fe0e0 0x7fe6141144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:20.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.399+0000 7fe618a00700 1 -- 172.21.15.57:0/269830232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fe0e0 msgr2=0x7fe6141144b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:20.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.399+0000 7fe618a00700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fe0e0 0x7fe6141144b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.399+0000 7fe618a00700 1 -- 172.21.15.57:0/269830232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600005040 con 0x7fe6140fcef0 2024-02-28T15:59:20.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.399+0000 7fe618a00700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6140fcef0 0x7fe614113f70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8002a80 tx=0x7fe5f8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:20.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.399+0000 7fe611600700 1 -- 172.21.15.57:0/269830232 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f8007cc0 con 0x7fe6140fcef0 2024-02-28T15:59:20.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.399+0000 7fe611600700 1 -- 172.21.15.57:0/269830232 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5f800f040 con 0x7fe6140fcef0 2024-02-28T15:59:20.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.399+0000 7fe611600700 1 -- 172.21.15.57:0/269830232 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f800dad0 con 0x7fe6140fcef0 2024-02-28T15:59:20.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.399+0000 7fe61b400700 1 -- 172.21.15.57:0/269830232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe614115630 con 0x7fe6140fcef0 2024-02-28T15:59:20.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.400+0000 7fe61b400700 1 -- 172.21.15.57:0/269830232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe614115b70 con 0x7fe6140fcef0 2024-02-28T15:59:20.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.401+0000 7fe61b400700 1 -- 172.21.15.57:0/269830232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe614102210 con 0x7fe6140fcef0 2024-02-28T15:59:20.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.402+0000 7fe611600700 1 -- 172.21.15.57:0/269830232 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe5f800dc30 con 0x7fe6140fcef0 2024-02-28T15:59:20.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.403+0000 7fe611600700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5f00692b0 0x7fe5f006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:20.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.403+0000 7fe611600700 1 -- 172.21.15.57:0/269830232 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe5f8086e70 con 0x7fe6140fcef0 2024-02-28T15:59:20.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.403+0000 7fe60be00700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5f00692b0 0x7fe5f006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:20.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.404+0000 7fe60be00700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5f00692b0 0x7fe5f006b760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe60000b020 tx=0x7fe600009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:20.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.408+0000 7fe611600700 1 -- 172.21.15.57:0/269830232 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe5f8056c30 con 0x7fe6140fcef0 2024-02-28T15:59:20.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.670+0000 7fe61b400700 1 -- 172.21.15.57:0/269830232 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe614115f50 con 0x7fe5f00692b0 2024-02-28T15:59:20.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.672+0000 7fe611600700 1 -- 172.21.15.57:0/269830232 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fe614115f50 con 0x7fe5f00692b0 2024-02-28T15:59:20.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.675+0000 7fe61b400700 1 -- 172.21.15.57:0/269830232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5f00692b0 msgr2=0x7fe5f006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:20.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.675+0000 7fe61b400700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5f00692b0 0x7fe5f006b760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe60000b020 tx=0x7fe600009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:20.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.675+0000 7fe61b400700 1 -- 172.21.15.57:0/269830232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6140fcef0 msgr2=0x7fe614113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:20.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.675+0000 7fe61b400700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6140fcef0 0x7fe614113f70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8002a80 tx=0x7fe5f8004600 comp rx=0 tx=0).stop 2024-02-28T15:59:20.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.675+0000 7fe61b400700 1 -- 172.21.15.57:0/269830232 shutdown_connections 2024-02-28T15:59:20.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.676+0000 7fe61b400700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5f00692b0 0x7fe5f006b760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.676+0000 7fe61b400700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6140fcef0 0x7fe614113f70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.676+0000 7fe61b400700 1 --2- 172.21.15.57:0/269830232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fe0e0 0x7fe6141144b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.676+0000 7fe61b400700 1 -- 172.21.15.57:0/269830232 >> 172.21.15.57:0/269830232 conn(0x7fe6140f8620 msgr2=0x7fe6140ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:20.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.676+0000 7fe61b400700 1 -- 172.21.15.57:0/269830232 shutdown_connections 2024-02-28T15:59:20.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.676+0000 7fe61b400700 1 -- 172.21.15.57:0/269830232 wait complete. 2024-02-28T15:59:20.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.839+0000 7ff14c400700 1 -- 172.21.15.57:0/2705517746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1440fe0e0 msgr2=0x7ff1440fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:20.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.839+0000 7ff14c400700 1 --2- 172.21.15.57:0/2705517746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1440fe0e0 0x7ff1440fe550 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff130004940 tx=0x7ff130009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:20.834 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:20 smithi057 ceph-mon[28763]: pgmap v258: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-28T15:59:20.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.840+0000 7ff14c400700 1 -- 172.21.15.57:0/2705517746 shutdown_connections 2024-02-28T15:59:20.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.840+0000 7ff14c400700 1 --2- 172.21.15.57:0/2705517746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1440fe0e0 0x7ff1440fe550 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.840+0000 7ff14c400700 1 --2- 172.21.15.57:0/2705517746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1440fcef0 0x7ff1440fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.840+0000 7ff14c400700 1 -- 172.21.15.57:0/2705517746 >> 172.21.15.57:0/2705517746 conn(0x7ff1440f8620 msgr2=0x7ff1440faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:20.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.842+0000 7ff14c400700 1 -- 172.21.15.57:0/2705517746 shutdown_connections 2024-02-28T15:59:20.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.842+0000 7ff14c400700 1 -- 172.21.15.57:0/2705517746 wait complete. 2024-02-28T15:59:20.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.843+0000 7ff14c400700 1 Processor -- start 2024-02-28T15:59:20.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.843+0000 7ff14c400700 1 -- start start 2024-02-28T15:59:20.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.843+0000 7ff14c400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1440fcef0 0x7ff144071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:20.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.843+0000 7ff14c400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1440fe0e0 0x7ff1440702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:20.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.843+0000 7ff14c400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff144111650 con 0x7ff1440fe0e0 2024-02-28T15:59:20.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.843+0000 7ff14c400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1441117c0 con 0x7ff1440fcef0 2024-02-28T15:59:20.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.843+0000 7ff149000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1440fe0e0 0x7ff1440702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:20.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.844+0000 7ff149000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1440fe0e0 0x7ff1440702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55744/0 (socket says 172.21.15.57:55744) 2024-02-28T15:59:20.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.844+0000 7ff149000700 1 -- 172.21.15.57:0/3515598529 learned_addr learned my addr 172.21.15.57:0/3515598529 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:20.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.844+0000 7ff149a00700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1440fcef0 0x7ff144071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:20.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.844+0000 7ff149000700 1 -- 172.21.15.57:0/3515598529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1440fcef0 msgr2=0x7ff144071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:20.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.844+0000 7ff149000700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1440fcef0 0x7ff144071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:20.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.844+0000 7ff149000700 1 -- 172.21.15.57:0/3515598529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130005040 con 0x7ff1440fe0e0 2024-02-28T15:59:20.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.844+0000 7ff149000700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1440fe0e0 0x7ff1440702e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff1300093b0 tx=0x7ff130009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:20.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.845+0000 7ff141600700 1 -- 172.21.15.57:0/3515598529 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13000e040 con 0x7ff1440fe0e0 2024-02-28T15:59:20.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.845+0000 7ff141600700 1 -- 172.21.15.57:0/3515598529 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff13000bcc0 con 0x7ff1440fe0e0 2024-02-28T15:59:20.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.845+0000 7ff141600700 1 -- 172.21.15.57:0/3515598529 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13001c630 con 0x7ff1440fe0e0 2024-02-28T15:59:20.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.845+0000 7ff14c400700 1 -- 172.21.15.57:0/3515598529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1440708e0 con 0x7ff1440fe0e0 2024-02-28T15:59:20.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.845+0000 7ff14c400700 1 -- 172.21.15.57:0/3515598529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff144070e20 con 0x7ff1440fe0e0 2024-02-28T15:59:20.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.847+0000 7ff14c400700 1 -- 172.21.15.57:0/3515598529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14404bed0 con 0x7ff1440fe0e0 2024-02-28T15:59:20.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.848+0000 7ff141600700 1 -- 172.21.15.57:0/3515598529 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7ff1300139f0 con 0x7ff1440fe0e0 2024-02-28T15:59:20.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.849+0000 7ff141600700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff12c0692a0 0x7ff12c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:20.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.849+0000 7ff141600700 1 -- 172.21.15.57:0/3515598529 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff1300884e0 con 0x7ff1440fe0e0 2024-02-28T15:59:20.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.849+0000 7ff149a00700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff12c0692a0 0x7ff12c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:20.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.850+0000 7ff149a00700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff12c0692a0 0x7ff12c06b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff138009fd0 tx=0x7ff138009f00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:20.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:20.853+0000 7ff141600700 1 -- 172.21.15.57:0/3515598529 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff130058340 con 0x7ff1440fe0e0 2024-02-28T15:59:20.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:20 smithi087 ceph-mon[37122]: pgmap v258: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-28T15:59:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.087+0000 7ff14c400700 1 -- 172.21.15.57:0/3515598529 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff144102ac0 con 0x7ff12c0692a0 2024-02-28T15:59:21.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.103+0000 7ff141600700 1 -- 172.21.15.57:0/3515598529 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7ff144102ac0 con 0x7ff12c0692a0 2024-02-28T15:59:21.097 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T15:59:21.097 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (6m) 40s ago 8m 13.5M - 0.25.0 c8568f914cd2 64bbae049744 2024-02-28T15:59:21.097 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (8m) 40s ago 8m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T15:59:21.097 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (7m) 45s ago 7m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T15:59:21.097 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (6m) 40s ago 8m 75.1M - 9.4.7 954c08fa6188 60cd69b6a8d5 2024-02-28T15:59:21.097 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (73s) 40s ago 72s 13.3M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T15:59:21.097 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (64s) 40s ago 63s 12.0M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (69s) 45s ago 68s 12.9M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (60s) 45s ago 59s 11.7M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:9283 running (10m) 40s ago 10m 481M - 17.2.7-535-gc0f02e60 1c37ed371348 2db340312662 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283 running (7m) 45s ago 7m 432M - 17.2.7-535-gc0f02e60 1c37ed371348 b5fa36ca3912 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (10m) 40s ago 10m 41.4M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (6m) 45s ago 6m 33.3M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (8m) 40s ago 8m 8024k - 1.5.0 0da6a335fe13 a721184edf00 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (7m) 45s ago 7m 7998k - 1.5.0 0da6a335fe13 f91fe90e3547 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (5m) 40s ago 5m 45.2M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (5m) 40s ago 5m 45.5M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (4m) 40s ago 4m 43.8M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (4m) 45s ago 4m 43.2M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (3m) 45s ago 3m 42.3M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T15:59:21.098 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (3m) 45s ago 2m 40.8M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T15:59:21.099 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (6m) 40s ago 7m 45.0M - 2.43.0 a07b618ecd1d 2e0885a51c9e 2024-02-28T15:59:21.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.107+0000 7ff14c400700 1 -- 172.21.15.57:0/3515598529 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff12c0692a0 msgr2=0x7ff12c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:21.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.107+0000 7ff14c400700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff12c0692a0 0x7ff12c06b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff138009fd0 tx=0x7ff138009f00 comp rx=0 tx=0).stop 2024-02-28T15:59:21.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.107+0000 7ff14c400700 1 -- 172.21.15.57:0/3515598529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1440fe0e0 msgr2=0x7ff1440702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:21.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.107+0000 7ff14c400700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1440fe0e0 0x7ff1440702e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff1300093b0 tx=0x7ff130009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:21.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.107+0000 7ff14c400700 1 -- 172.21.15.57:0/3515598529 shutdown_connections 2024-02-28T15:59:21.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.107+0000 7ff14c400700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7ff12c0692a0 0x7ff12c06b750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.107+0000 7ff14c400700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1440fcef0 0x7ff144071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.107+0000 7ff14c400700 1 --2- 172.21.15.57:0/3515598529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1440fe0e0 0x7ff1440702e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.107+0000 7ff14c400700 1 -- 172.21.15.57:0/3515598529 >> 172.21.15.57:0/3515598529 conn(0x7ff1440f8620 msgr2=0x7ff1441013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:21.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.108+0000 7ff14c400700 1 -- 172.21.15.57:0/3515598529 shutdown_connections 2024-02-28T15:59:21.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.108+0000 7ff14c400700 1 -- 172.21.15.57:0/3515598529 wait complete. 2024-02-28T15:59:21.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.266+0000 7fb202a00700 1 -- 172.21.15.57:0/769081479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc104580 msgr2=0x7fb1fc1049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:21.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.266+0000 7fb202a00700 1 --2- 172.21.15.57:0/769081479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc104580 0x7fb1fc1049d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8004940 tx=0x7fb1e8009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:21.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.266+0000 7fb202a00700 1 -- 172.21.15.57:0/769081479 shutdown_connections 2024-02-28T15:59:21.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.266+0000 7fb202a00700 1 --2- 172.21.15.57:0/769081479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc104580 0x7fb1fc1049d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.266+0000 7fb202a00700 1 --2- 172.21.15.57:0/769081479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1fc103370 0x7fb1fc103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.266+0000 7fb202a00700 1 -- 172.21.15.57:0/769081479 >> 172.21.15.57:0/769081479 conn(0x7fb1fc0727d0 msgr2=0x7fb1fc074c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:21.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.266+0000 7fb202a00700 1 -- 172.21.15.57:0/769081479 shutdown_connections 2024-02-28T15:59:21.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.266+0000 7fb202a00700 1 -- 172.21.15.57:0/769081479 wait complete. 2024-02-28T15:59:21.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.267+0000 7fb202a00700 1 Processor -- start 2024-02-28T15:59:21.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.267+0000 7fb202a00700 1 -- start start 2024-02-28T15:59:21.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.268+0000 7fb202a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1fc103370 0x7fb1fc113d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:21.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.268+0000 7fb202a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc104580 0x7fb1fc114290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:21.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.268+0000 7fb202a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc114890 con 0x7fb1fc104580 2024-02-28T15:59:21.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.268+0000 7fb202a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc115020 con 0x7fb1fc103370 2024-02-28T15:59:21.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.268+0000 7fb200c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc104580 0x7fb1fc114290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:21.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.268+0000 7fb200c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc104580 0x7fb1fc114290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55758/0 (socket says 172.21.15.57:55758) 2024-02-28T15:59:21.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.268+0000 7fb200c00700 1 -- 172.21.15.57:0/3964600053 learned_addr learned my addr 172.21.15.57:0/3964600053 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:21.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.268+0000 7fb201600700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1fc103370 0x7fb1fc113d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:21.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.269+0000 7fb200c00700 1 -- 172.21.15.57:0/3964600053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1fc103370 msgr2=0x7fb1fc113d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:21.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.269+0000 7fb200c00700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1fc103370 0x7fb1fc113d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.269+0000 7fb200c00700 1 -- 172.21.15.57:0/3964600053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e8005040 con 0x7fb1fc104580 2024-02-28T15:59:21.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.269+0000 7fb200c00700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc104580 0x7fb1fc114290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8000c00 tx=0x7fb1e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:21.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.269+0000 7fb1f9600700 1 -- 172.21.15.57:0/3964600053 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e8021070 con 0x7fb1fc104580 2024-02-28T15:59:21.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.270+0000 7fb1f9600700 1 -- 172.21.15.57:0/3964600053 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1e801c400 con 0x7fb1fc104580 2024-02-28T15:59:21.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.270+0000 7fb202a00700 1 -- 172.21.15.57:0/3964600053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc1152a0 con 0x7fb1fc104580 2024-02-28T15:59:21.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.270+0000 7fb1f9600700 1 -- 172.21.15.57:0/3964600053 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e800e070 con 0x7fb1fc104580 2024-02-28T15:59:21.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.270+0000 7fb202a00700 1 -- 172.21.15.57:0/3964600053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc115780 con 0x7fb1fc104580 2024-02-28T15:59:21.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.271+0000 7fb202a00700 1 -- 172.21.15.57:0/3964600053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc04bed0 con 0x7fb1fc104580 2024-02-28T15:59:21.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.272+0000 7fb1f9600700 1 -- 172.21.15.57:0/3964600053 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fb1e801ca20 con 0x7fb1fc104580 2024-02-28T15:59:21.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.273+0000 7fb1f9600700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb1e40692b0 0x7fb1e406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:21.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.273+0000 7fb1f9600700 1 -- 172.21.15.57:0/3964600053 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb1e8088540 con 0x7fb1fc104580 2024-02-28T15:59:21.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.273+0000 7fb201600700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb1e40692b0 0x7fb1e406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:21.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.274+0000 7fb201600700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb1e40692b0 0x7fb1e406b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0004600 tx=0x7fb1f000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:21.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.278+0000 7fb1f9600700 1 -- 172.21.15.57:0/3964600053 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb1e8058260 con 0x7fb1fc104580 2024-02-28T15:59:21.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.609+0000 7fb202a00700 1 -- 172.21.15.57:0/3964600053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb1fc115cb0 con 0x7fb1fc104580 2024-02-28T15:59:21.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.610+0000 7fb1f9600700 1 -- 172.21.15.57:0/3964600053 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fb1e8057df0 con 0x7fb1fc104580 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:59:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T15:59:21.606 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T15:59:21.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:59:21.606 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T15:59:21.606 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 14 2024-02-28T15:59:21.606 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T15:59:21.606 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T15:59:21.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.613+0000 7fb202a00700 1 -- 172.21.15.57:0/3964600053 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb1e40692b0 msgr2=0x7fb1e406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:21.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.613+0000 7fb202a00700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb1e40692b0 0x7fb1e406b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0004600 tx=0x7fb1f000b040 comp rx=0 tx=0).stop 2024-02-28T15:59:21.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.613+0000 7fb202a00700 1 -- 172.21.15.57:0/3964600053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc104580 msgr2=0x7fb1fc114290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:21.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.613+0000 7fb202a00700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc104580 0x7fb1fc114290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8000c00 tx=0x7fb1e8009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.614+0000 7fb202a00700 1 -- 172.21.15.57:0/3964600053 shutdown_connections 2024-02-28T15:59:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.614+0000 7fb202a00700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fb1e40692b0 0x7fb1e406b760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.614+0000 7fb202a00700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1fc103370 0x7fb1fc113d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.614+0000 7fb202a00700 1 --2- 172.21.15.57:0/3964600053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc104580 0x7fb1fc114290 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.614+0000 7fb202a00700 1 -- 172.21.15.57:0/3964600053 >> 172.21.15.57:0/3964600053 conn(0x7fb1fc0727d0 msgr2=0x7fb1fc1077b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.614+0000 7fb202a00700 1 -- 172.21.15.57:0/3964600053 shutdown_connections 2024-02-28T15:59:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.614+0000 7fb202a00700 1 -- 172.21.15.57:0/3964600053 wait complete. 2024-02-28T15:59:21.774 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:21 smithi057 ceph-mon[28763]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:21.774 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:21 smithi057 ceph-mon[28763]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:21.774 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:59:21.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.780+0000 7f74dc000700 1 -- 172.21.15.57:0/708346199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d4102430 msgr2=0x7f74d4104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:21.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.780+0000 7f74dc000700 1 --2- 172.21.15.57:0/708346199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d4102430 0x7f74d4104810 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f74c0004940 tx=0x7f74c0009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:21.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.780+0000 7f74dc000700 1 -- 172.21.15.57:0/708346199 shutdown_connections 2024-02-28T15:59:21.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.780+0000 7f74dc000700 1 --2- 172.21.15.57:0/708346199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d4102430 0x7f74d4104810 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.780+0000 7f74dc000700 1 --2- 172.21.15.57:0/708346199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74d40663e0 0x7f74d4101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.780+0000 7f74dc000700 1 -- 172.21.15.57:0/708346199 >> 172.21.15.57:0/708346199 conn(0x7f74d40f74e0 msgr2=0x7f74d40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:21.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.780+0000 7f74dc000700 1 -- 172.21.15.57:0/708346199 shutdown_connections 2024-02-28T15:59:21.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.781+0000 7f74dc000700 1 -- 172.21.15.57:0/708346199 wait complete. 2024-02-28T15:59:21.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.781+0000 7f74dc000700 1 Processor -- start 2024-02-28T15:59:21.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.782+0000 7f74dc000700 1 -- start start 2024-02-28T15:59:21.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.782+0000 7f74dc000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d40663e0 0x7f74d410fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:21.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.782+0000 7f74dc000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74d4102430 0x7f74d41100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:21.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.782+0000 7f74dc000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d4110750 con 0x7f74d40663e0 2024-02-28T15:59:21.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.782+0000 7f74dc000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d4110f90 con 0x7f74d4102430 2024-02-28T15:59:21.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.783+0000 7f74d9600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d40663e0 0x7f74d410fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:21.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.783+0000 7f74d9600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d40663e0 0x7f74d410fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55778/0 (socket says 172.21.15.57:55778) 2024-02-28T15:59:21.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.783+0000 7f74d9600700 1 -- 172.21.15.57:0/783764753 learned_addr learned my addr 172.21.15.57:0/783764753 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:21.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.783+0000 7f74d8c00700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74d4102430 0x7f74d41100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:21.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.783+0000 7f74d9600700 1 -- 172.21.15.57:0/783764753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74d4102430 msgr2=0x7f74d41100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:21.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.783+0000 7f74d9600700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74d4102430 0x7f74d41100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:21.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.783+0000 7f74d9600700 1 -- 172.21.15.57:0/783764753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c0005040 con 0x7f74d40663e0 2024-02-28T15:59:21.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.784+0000 7f74d9600700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d40663e0 0x7f74d410fb80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f74c800b790 tx=0x7f74c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:21.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.784+0000 7f74d1600700 1 -- 172.21.15.57:0/783764753 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c800f770 con 0x7f74d40663e0 2024-02-28T15:59:21.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.784+0000 7f74d1600700 1 -- 172.21.15.57:0/783764753 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74c800fda0 con 0x7f74d40663e0 2024-02-28T15:59:21.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.784+0000 7f74dc000700 1 -- 172.21.15.57:0/783764753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d4111270 con 0x7f74d40663e0 2024-02-28T15:59:21.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.784+0000 7f74d1600700 1 -- 172.21.15.57:0/783764753 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c800d310 con 0x7f74d40663e0 2024-02-28T15:59:21.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.785+0000 7f74dc000700 1 -- 172.21.15.57:0/783764753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d41117b0 con 0x7f74d40663e0 2024-02-28T15:59:21.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.786+0000 7f74dc000700 1 -- 172.21.15.57:0/783764753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d404bed0 con 0x7f74d40663e0 2024-02-28T15:59:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.787+0000 7f74d1600700 1 -- 172.21.15.57:0/783764753 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f74c8010420 con 0x7f74d40663e0 2024-02-28T15:59:21.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.789+0000 7f74d1600700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74bc069360 0x7f74bc06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:21.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.789+0000 7f74d1600700 1 -- 172.21.15.57:0/783764753 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f74c8087130 con 0x7f74d40663e0 2024-02-28T15:59:21.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.789+0000 7f74d8c00700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74bc069360 0x7f74bc06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:21.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.790+0000 7f74d8c00700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74bc069360 0x7f74bc06b810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f74c000b020 tx=0x7f74c0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:21.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:21.793+0000 7f74d1600700 1 -- 172.21.15.57:0/783764753 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f74c8056ed0 con 0x7f74d40663e0 2024-02-28T15:59:21.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:21 smithi087 ceph-mon[37122]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:21.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:21 smithi087 ceph-mon[37122]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:21.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:21 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:59:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.080+0000 7f74dc000700 1 -- 172.21.15.57:0/783764753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f74d4111cd0 con 0x7f74d40663e0 2024-02-28T15:59:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.081+0000 7f74d1600700 1 -- 172.21.15.57:0/783764753 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1825 (secure 0 0 0) 0x7f74c8056a60 con 0x7f74d40663e0 2024-02-28T15:59:22.075 INFO:teuthology.orchestra.run.smithi057.stdout:e14 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 14 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T15:58:26.323114+0000 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T15:59:22.076 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T15:59:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T15:59:22.078 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T15:59:22.078 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T15:59:22.078 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:59:22.078 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:59:22.078 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:59:22.078 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:59:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:59:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:59:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.084+0000 7f74dc000700 1 -- 172.21.15.57:0/783764753 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74bc069360 msgr2=0x7f74bc06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.084+0000 7f74dc000700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74bc069360 0x7f74bc06b810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f74c000b020 tx=0x7f74c0009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.084+0000 7f74dc000700 1 -- 172.21.15.57:0/783764753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d40663e0 msgr2=0x7f74d410fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.084+0000 7f74dc000700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d40663e0 0x7f74d410fb80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f74c800b790 tx=0x7f74c8009250 comp rx=0 tx=0).stop 2024-02-28T15:59:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.085+0000 7f74dc000700 1 -- 172.21.15.57:0/783764753 shutdown_connections 2024-02-28T15:59:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.085+0000 7f74dc000700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f74bc069360 0x7f74bc06b810 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.085+0000 7f74dc000700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74d40663e0 0x7f74d410fb80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.085+0000 7f74dc000700 1 --2- 172.21.15.57:0/783764753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74d4102430 0x7f74d41100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.085+0000 7f74dc000700 1 -- 172.21.15.57:0/783764753 >> 172.21.15.57:0/783764753 conn(0x7f74d40f74e0 msgr2=0x7f74d40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.085+0000 7f74dc000700 1 -- 172.21.15.57:0/783764753 shutdown_connections 2024-02-28T15:59:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.085+0000 7f74dc000700 1 -- 172.21.15.57:0/783764753 wait complete. 2024-02-28T15:59:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-02-28T15:59:22.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.246+0000 7f14cfe00700 1 -- 172.21.15.57:0/1338495332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d0071eb0 msgr2=0x7f14d0070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:22.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.246+0000 7f14cfe00700 1 --2- 172.21.15.57:0/1338495332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d0071eb0 0x7f14d0070320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f14c0004940 tx=0x7f14c0009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:22.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.246+0000 7f14cfe00700 1 -- 172.21.15.57:0/1338495332 shutdown_connections 2024-02-28T15:59:22.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.246+0000 7f14cfe00700 1 --2- 172.21.15.57:0/1338495332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d0070860 0x7f14d0070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.246+0000 7f14cfe00700 1 --2- 172.21.15.57:0/1338495332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d0071eb0 0x7f14d0070320 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.246+0000 7f14cfe00700 1 -- 172.21.15.57:0/1338495332 >> 172.21.15.57:0/1338495332 conn(0x7f14d00f8410 msgr2=0x7f14d00fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:22.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.248+0000 7f14cfe00700 1 -- 172.21.15.57:0/1338495332 shutdown_connections 2024-02-28T15:59:22.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.248+0000 7f14cfe00700 1 -- 172.21.15.57:0/1338495332 wait complete. 2024-02-28T15:59:22.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.248+0000 7f14cfe00700 1 Processor -- start 2024-02-28T15:59:22.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.249+0000 7f14cfe00700 1 -- start start 2024-02-28T15:59:22.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.249+0000 7f14cfe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d0070860 0x7f14d010f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.249+0000 7f14cfe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d0071eb0 0x7f14d010fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.249+0000 7f14cfe00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d0110470 con 0x7f14d0071eb0 2024-02-28T15:59:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.249+0000 7f14cfe00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d0110d10 con 0x7f14d0070860 2024-02-28T15:59:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.249+0000 7f14ce000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d0071eb0 0x7f14d010fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.249+0000 7f14ce000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d0071eb0 0x7f14d010fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57044/0 (socket says 172.21.15.57:57044) 2024-02-28T15:59:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.249+0000 7f14ce000700 1 -- 172.21.15.57:0/2273704236 learned_addr learned my addr 172.21.15.57:0/2273704236 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.249+0000 7f14cea00700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d0070860 0x7f14d010f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.250+0000 7f14ce000700 1 -- 172.21.15.57:0/2273704236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d0070860 msgr2=0x7f14d010f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.250+0000 7f14ce000700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d0070860 0x7f14d010f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.250+0000 7f14ce000700 1 -- 172.21.15.57:0/2273704236 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0005040 con 0x7f14d0071eb0 2024-02-28T15:59:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.250+0000 7f14ce000700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d0071eb0 0x7f14d010fe70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f14bc002a50 tx=0x7f14bc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.251+0000 7f14c6a00700 1 -- 172.21.15.57:0/2273704236 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14bc007cc0 con 0x7f14d0071eb0 2024-02-28T15:59:22.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.251+0000 7f14c6a00700 1 -- 172.21.15.57:0/2273704236 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14bc00f040 con 0x7f14d0071eb0 2024-02-28T15:59:22.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.251+0000 7f14cfe00700 1 -- 172.21.15.57:0/2273704236 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d0110ff0 con 0x7f14d0071eb0 2024-02-28T15:59:22.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.251+0000 7f14c6a00700 1 -- 172.21.15.57:0/2273704236 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14bc00da30 con 0x7f14d0071eb0 2024-02-28T15:59:22.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.251+0000 7f14cfe00700 1 -- 172.21.15.57:0/2273704236 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d0111530 con 0x7f14d0071eb0 2024-02-28T15:59:22.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.253+0000 7f14cfe00700 1 -- 172.21.15.57:0/2273704236 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d004bed0 con 0x7f14d0071eb0 2024-02-28T15:59:22.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.253+0000 7f14c6a00700 1 -- 172.21.15.57:0/2273704236 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f14bc00db90 con 0x7f14d0071eb0 2024-02-28T15:59:22.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.254+0000 7f14c6a00700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14b40692b0 0x7f14b406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:22.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.254+0000 7f14c6a00700 1 -- 172.21.15.57:0/2273704236 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f14bc086f40 con 0x7f14d0071eb0 2024-02-28T15:59:22.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.255+0000 7f14cea00700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14b40692b0 0x7f14b406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:22.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.255+0000 7f14cea00700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14b40692b0 0x7f14b406b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f14c00043d0 tx=0x7f14c0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:22.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.260+0000 7f14c6a00700 1 -- 172.21.15.57:0/2273704236 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f14bc056c80 con 0x7f14d0071eb0 2024-02-28T15:59:22.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.508+0000 7f14cfe00700 1 -- 172.21.15.57:0/2273704236 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14d0104380 con 0x7f14b40692b0 2024-02-28T15:59:22.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.510+0000 7f14c6a00700 1 -- 172.21.15.57:0/2273704236 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f14d0104380 con 0x7f14b40692b0 2024-02-28T15:59:22.504 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T15:59:22.505 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", 2024-02-28T15:59:22.505 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T15:59:22.505 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T15:59:22.505 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [], 2024-02-28T15:59:22.505 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "", 2024-02-28T15:59:22.505 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 image", 2024-02-28T15:59:22.505 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T15:59:22.505 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T15:59:22.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.514+0000 7f14cfe00700 1 -- 172.21.15.57:0/2273704236 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14b40692b0 msgr2=0x7f14b406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.514+0000 7f14cfe00700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14b40692b0 0x7f14b406b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f14c00043d0 tx=0x7f14c0009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.514+0000 7f14cfe00700 1 -- 172.21.15.57:0/2273704236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d0071eb0 msgr2=0x7f14d010fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.514+0000 7f14cfe00700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d0071eb0 0x7f14d010fe70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f14bc002a50 tx=0x7f14bc0046b0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.515+0000 7f14cfe00700 1 -- 172.21.15.57:0/2273704236 shutdown_connections 2024-02-28T15:59:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.515+0000 7f14cfe00700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f14b40692b0 0x7f14b406b760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.515+0000 7f14cfe00700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d0070860 0x7f14d010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.515+0000 7f14cfe00700 1 --2- 172.21.15.57:0/2273704236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d0071eb0 0x7f14d010fe70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.515+0000 7f14cfe00700 1 -- 172.21.15.57:0/2273704236 >> 172.21.15.57:0/2273704236 conn(0x7f14d00f8410 msgr2=0x7f14d0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.515+0000 7f14cfe00700 1 -- 172.21.15.57:0/2273704236 shutdown_connections 2024-02-28T15:59:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.515+0000 7f14cfe00700 1 -- 172.21.15.57:0/2273704236 wait complete. 2024-02-28T15:59:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.681+0000 7fe604a00700 1 -- 172.21.15.57:0/1095652229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6000fe0e0 msgr2=0x7fe6000fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.681+0000 7fe604a00700 1 --2- 172.21.15.57:0/1095652229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6000fe0e0 0x7fe6000fe550 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8004940 tx=0x7fe5e8009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.682+0000 7fe604a00700 1 -- 172.21.15.57:0/1095652229 shutdown_connections 2024-02-28T15:59:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.682+0000 7fe604a00700 1 --2- 172.21.15.57:0/1095652229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6000fe0e0 0x7fe6000fe550 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.682+0000 7fe604a00700 1 --2- 172.21.15.57:0/1095652229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6000fcef0 0x7fe6000fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.682+0000 7fe604a00700 1 -- 172.21.15.57:0/1095652229 >> 172.21.15.57:0/1095652229 conn(0x7fe6000f8620 msgr2=0x7fe6000faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.682+0000 7fe604a00700 1 -- 172.21.15.57:0/1095652229 shutdown_connections 2024-02-28T15:59:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.682+0000 7fe604a00700 1 -- 172.21.15.57:0/1095652229 wait complete. 2024-02-28T15:59:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.683+0000 7fe604a00700 1 Processor -- start 2024-02-28T15:59:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.683+0000 7fe604a00700 1 -- start start 2024-02-28T15:59:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.683+0000 7fe604a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6000fcef0 0x7fe60010fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.683+0000 7fe604a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6000fe0e0 0x7fe6001100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.683+0000 7fe604a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600110750 con 0x7fe6000fcef0 2024-02-28T15:59:22.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.683+0000 7fe604a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600110f90 con 0x7fe6000fe0e0 2024-02-28T15:59:22.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.684+0000 7fe5fde00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6000fcef0 0x7fe60010fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:22.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.684+0000 7fe5fde00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6000fcef0 0x7fe60010fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57052/0 (socket says 172.21.15.57:57052) 2024-02-28T15:59:22.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.684+0000 7fe5fde00700 1 -- 172.21.15.57:0/2090831736 learned_addr learned my addr 172.21.15.57:0/2090831736 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.684+0000 7fe5f5400700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6000fe0e0 0x7fe6001100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.684+0000 7fe5fde00700 1 -- 172.21.15.57:0/2090831736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6000fe0e0 msgr2=0x7fe6001100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.684+0000 7fe5fde00700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6000fe0e0 0x7fe6001100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.684+0000 7fe5fde00700 1 -- 172.21.15.57:0/2090831736 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e8005040 con 0x7fe6000fcef0 2024-02-28T15:59:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.685+0000 7fe5fde00700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6000fcef0 0x7fe60010fb80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000b790 tx=0x7fe5f0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.685+0000 7fe5f6a00700 1 -- 172.21.15.57:0/2090831736 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f000f6f0 con 0x7fe6000fcef0 2024-02-28T15:59:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.685+0000 7fe5f6a00700 1 -- 172.21.15.57:0/2090831736 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5f000fd20 con 0x7fe6000fcef0 2024-02-28T15:59:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.685+0000 7fe604a00700 1 -- 172.21.15.57:0/2090831736 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe600111270 con 0x7fe6000fcef0 2024-02-28T15:59:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.685+0000 7fe5f6a00700 1 -- 172.21.15.57:0/2090831736 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f00103a0 con 0x7fe6000fcef0 2024-02-28T15:59:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.685+0000 7fe604a00700 1 -- 172.21.15.57:0/2090831736 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6001117b0 con 0x7fe6000fcef0 2024-02-28T15:59:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.686+0000 7fe604a00700 1 -- 172.21.15.57:0/2090831736 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe600102210 con 0x7fe6000fcef0 2024-02-28T15:59:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.688+0000 7fe5f6a00700 1 -- 172.21.15.57:0/2090831736 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe5f0011400 con 0x7fe6000fcef0 2024-02-28T15:59:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.688+0000 7fe5f6a00700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5e40692b0 0x7fe5e406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.689+0000 7fe5f6a00700 1 -- 172.21.15.57:0/2090831736 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe5f0086f50 con 0x7fe6000fcef0 2024-02-28T15:59:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.689+0000 7fe5f5400700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5e40692b0 0x7fe5e406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.690+0000 7fe5f5400700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5e40692b0 0x7fe5e406b760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800b020 tx=0x7fe5e8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:22.693+0000 7fe5f6a00700 1 -- 172.21.15.57:0/2090831736 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe5f0056d10 con 0x7fe6000fcef0 2024-02-28T15:59:22.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:22 smithi057 ceph-mon[28763]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:22.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:22 smithi057 ceph-mon[28763]: pgmap v259: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-28T15:59:22.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:22 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3964600053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T15:59:22.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:22 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/783764753' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T15:59:22.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:22 smithi087 ceph-mon[37122]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:22.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:22 smithi087 ceph-mon[37122]: pgmap v259: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-28T15:59:22.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:22 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3964600053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T15:59:22.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:22 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/783764753' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T15:59:23.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.009+0000 7fe604a00700 1 -- 172.21.15.57:0/2090831736 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe60004bed0 con 0x7fe6000fcef0 2024-02-28T15:59:23.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.009+0000 7fe5f6a00700 1 -- 172.21.15.57:0/2090831736 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe5f00568a0 con 0x7fe6000fcef0 2024-02-28T15:59:23.003 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 -- 172.21.15.57:0/2090831736 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5e40692b0 msgr2=0x7fe5e406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5e40692b0 0x7fe5e406b760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800b020 tx=0x7fe5e8009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 -- 172.21.15.57:0/2090831736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6000fcef0 msgr2=0x7fe60010fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6000fcef0 0x7fe60010fb80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000b790 tx=0x7fe5f0009220 comp rx=0 tx=0).stop 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 -- 172.21.15.57:0/2090831736 shutdown_connections 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5e40692b0 0x7fe5e406b760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6000fcef0 0x7fe60010fb80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 --2- 172.21.15.57:0/2090831736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6000fe0e0 0x7fe6001100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 -- 172.21.15.57:0/2090831736 >> 172.21.15.57:0/2090831736 conn(0x7fe6000f8620 msgr2=0x7fe6000ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 -- 172.21.15.57:0/2090831736 shutdown_connections 2024-02-28T15:59:23.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:23.012+0000 7fe604a00700 1 -- 172.21.15.57:0/2090831736 wait complete. 2024-02-28T15:59:23.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:23 smithi057 ceph-mon[28763]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:23 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2090831736' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T15:59:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:23 smithi087 ceph-mon[37122]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:23 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2090831736' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T15:59:24.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:24 smithi057 ceph-mon[28763]: pgmap v260: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-28T15:59:24.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:24 smithi087 ceph-mon[37122]: pgmap v260: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-28T15:59:26.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:26 smithi057 ceph-mon[28763]: pgmap v261: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 4 op/s 2024-02-28T15:59:26.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:26 smithi087 ceph-mon[37122]: pgmap v261: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 4 op/s 2024-02-28T15:59:28.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:28 smithi057 ceph-mon[28763]: pgmap v262: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:28.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:28 smithi087 ceph-mon[37122]: pgmap v262: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:30.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:30 smithi057 ceph-mon[28763]: pgmap v263: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:30.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:30 smithi087 ceph-mon[37122]: pgmap v263: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:32.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:32 smithi057 ceph-mon[28763]: pgmap v264: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:32.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:32 smithi087 ceph-mon[37122]: pgmap v264: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:34 smithi087 ceph-mon[37122]: pgmap v265: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:34.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:34 smithi057 ceph-mon[28763]: pgmap v265: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:36.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:36 smithi057 ceph-mon[28763]: pgmap v266: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:36.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:36 smithi087 ceph-mon[37122]: pgmap v266: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:37.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:59:37.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:59:38.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:38 smithi087 ceph-mon[37122]: pgmap v267: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:38.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:38 smithi057 ceph-mon[28763]: pgmap v267: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:40.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:40 smithi057 ceph-mon[28763]: pgmap v268: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:40.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:40 smithi087 ceph-mon[37122]: pgmap v268: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:42.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:42 smithi087 ceph-mon[37122]: pgmap v269: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:42.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:42 smithi057 ceph-mon[28763]: pgmap v269: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:44.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:44 smithi057 ceph-mon[28763]: pgmap v270: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:44.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:44 smithi087 ceph-mon[37122]: pgmap v270: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:46.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:46 smithi057 ceph-mon[28763]: pgmap v271: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:46.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:46 smithi087 ceph-mon[37122]: pgmap v271: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:48.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:48 smithi057 ceph-mon[28763]: pgmap v272: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:48 smithi087 ceph-mon[37122]: pgmap v272: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:50.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:50 smithi057 ceph-mon[28763]: pgmap v273: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:50.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:50 smithi087 ceph-mon[37122]: pgmap v273: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:59:51.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T15:59:52.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:52 smithi057 ceph-mon[28763]: pgmap v274: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:52.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:52 smithi087 ceph-mon[37122]: pgmap v274: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:53.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.222+0000 7f5f28000700 1 -- 172.21.15.57:0/2442059767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f200708c0 msgr2=0x7f5f20070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:53.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.222+0000 7f5f28000700 1 --2- 172.21.15.57:0/2442059767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f200708c0 0x7f5f20070d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c004940 tx=0x7f5f0c009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:53.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.222+0000 7f5f28000700 1 -- 172.21.15.57:0/2442059767 shutdown_connections 2024-02-28T15:59:53.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.222+0000 7f5f28000700 1 --2- 172.21.15.57:0/2442059767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f200708c0 0x7f5f20070d10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:53.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.222+0000 7f5f28000700 1 --2- 172.21.15.57:0/2442059767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20071f10 0x7f5f20070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:53.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.222+0000 7f5f28000700 1 -- 172.21.15.57:0/2442059767 >> 172.21.15.57:0/2442059767 conn(0x7f5f200f8620 msgr2=0x7f5f200faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:53.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.222+0000 7f5f28000700 1 -- 172.21.15.57:0/2442059767 shutdown_connections 2024-02-28T15:59:53.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.222+0000 7f5f28000700 1 -- 172.21.15.57:0/2442059767 wait complete. 2024-02-28T15:59:53.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.223+0000 7f5f28000700 1 Processor -- start 2024-02-28T15:59:53.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.223+0000 7f5f28000700 1 -- start start 2024-02-28T15:59:53.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.223+0000 7f5f28000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f200708c0 0x7f5f20113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:53.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.224+0000 7f5f28000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20071f10 0x7f5f201144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:53.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.224+0000 7f5f28000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20114b40 con 0x7f5f20071f10 2024-02-28T15:59:53.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.224+0000 7f5f28000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20115380 con 0x7f5f200708c0 2024-02-28T15:59:53.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.224+0000 7f5f25600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f200708c0 0x7f5f20113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:53.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.224+0000 7f5f25600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f200708c0 0x7f5f20113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:46858/0 (socket says 172.21.15.57:46858) 2024-02-28T15:59:53.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.224+0000 7f5f25600700 1 -- 172.21.15.57:0/1041719114 learned_addr learned my addr 172.21.15.57:0/1041719114 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:53.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.225+0000 7f5f25600700 1 -- 172.21.15.57:0/1041719114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20071f10 msgr2=0x7f5f201144b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:53.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.225+0000 7f5f25600700 1 --2- 172.21.15.57:0/1041719114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20071f10 0x7f5f201144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:53.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.225+0000 7f5f25600700 1 -- 172.21.15.57:0/1041719114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c005040 con 0x7f5f200708c0 2024-02-28T15:59:53.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.225+0000 7f5f25600700 1 --2- 172.21.15.57:0/1041719114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f200708c0 0x7f5f20113f70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400b790 tx=0x7f5f14009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:53.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.225+0000 7f5f1d600700 1 -- 172.21.15.57:0/1041719114 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f1400f770 con 0x7f5f200708c0 2024-02-28T15:59:53.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.225+0000 7f5f1d600700 1 -- 172.21.15.57:0/1041719114 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f1400fda0 con 0x7f5f200708c0 2024-02-28T15:59:53.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.225+0000 7f5f28000700 1 -- 172.21.15.57:0/1041719114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f20115660 con 0x7f5f200708c0 2024-02-28T15:59:53.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.226+0000 7f5f28000700 1 -- 172.21.15.57:0/1041719114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f20115ba0 con 0x7f5f200708c0 2024-02-28T15:59:53.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.226+0000 7f5f1d600700 1 -- 172.21.15.57:0/1041719114 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f1400d310 con 0x7f5f200708c0 2024-02-28T15:59:53.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.229+0000 7f5f28000700 1 -- 172.21.15.57:0/1041719114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f000052e0 con 0x7f5f200708c0 2024-02-28T15:59:53.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.229+0000 7f5f1d600700 1 -- 172.21.15.57:0/1041719114 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f5f1400d5b0 con 0x7f5f200708c0 2024-02-28T15:59:53.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.231+0000 7f5f1d600700 1 --2- 172.21.15.57:0/1041719114 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5f080692b0 0x7f5f0806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:53.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.231+0000 7f5f1d600700 1 -- 172.21.15.57:0/1041719114 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5f14087120 con 0x7f5f200708c0 2024-02-28T15:59:53.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.231+0000 7f5f24c00700 1 --2- 172.21.15.57:0/1041719114 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5f080692b0 0x7f5f0806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:53.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.232+0000 7f5f24c00700 1 --2- 172.21.15.57:0/1041719114 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5f080692b0 0x7f5f0806b760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c004f90 tx=0x7f5f0c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:53.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.240+0000 7f5f1d600700 1 -- 172.21.15.57:0/1041719114 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5f14057f60 con 0x7f5f200708c0 2024-02-28T15:59:53.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.599+0000 7f5f28000700 1 -- 172.21.15.57:0/1041719114 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f00000bf0 con 0x7f5f080692b0 2024-02-28T15:59:53.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.601+0000 7f5f1d600700 1 -- 172.21.15.57:0/1041719114 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f5f00000bf0 con 0x7f5f080692b0 2024-02-28T15:59:53.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.604+0000 7f5f28000700 1 -- 172.21.15.57:0/1041719114 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5f080692b0 msgr2=0x7f5f0806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:53.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.604+0000 7f5f28000700 1 --2- 172.21.15.57:0/1041719114 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5f080692b0 0x7f5f0806b760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c004f90 tx=0x7f5f0c009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:53.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.604+0000 7f5f28000700 1 -- 172.21.15.57:0/1041719114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f200708c0 msgr2=0x7f5f20113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:53.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.604+0000 7f5f28000700 1 --2- 172.21.15.57:0/1041719114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f200708c0 0x7f5f20113f70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400b790 tx=0x7f5f14009250 comp rx=0 tx=0).stop 2024-02-28T15:59:53.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.605+0000 7f5f28000700 1 -- 172.21.15.57:0/1041719114 shutdown_connections 2024-02-28T15:59:53.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.605+0000 7f5f28000700 1 --2- 172.21.15.57:0/1041719114 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f5f080692b0 0x7f5f0806b760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:53.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.605+0000 7f5f28000700 1 --2- 172.21.15.57:0/1041719114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f200708c0 0x7f5f20113f70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:53.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.605+0000 7f5f28000700 1 --2- 172.21.15.57:0/1041719114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20071f10 0x7f5f201144b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:53.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.605+0000 7f5f28000700 1 -- 172.21.15.57:0/1041719114 >> 172.21.15.57:0/1041719114 conn(0x7f5f200f8620 msgr2=0x7f5f200fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:53.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.605+0000 7f5f28000700 1 -- 172.21.15.57:0/1041719114 shutdown_connections 2024-02-28T15:59:53.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.605+0000 7f5f28000700 1 -- 172.21.15.57:0/1041719114 wait complete. 2024-02-28T15:59:53.614 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T15:59:53.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.809+0000 7f381be00700 1 -- 172.21.15.57:0/143535137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c0fcd50 msgr2=0x7f381c0fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:53.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.809+0000 7f381be00700 1 --2- 172.21.15.57:0/143535137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c0fcd50 0x7f381c0fd160 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f380c004880 tx=0x7f380c009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:53.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.809+0000 7f381be00700 1 -- 172.21.15.57:0/143535137 shutdown_connections 2024-02-28T15:59:53.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.809+0000 7f381be00700 1 --2- 172.21.15.57:0/143535137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f381c0fdf60 0x7f381c0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:53.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.809+0000 7f381be00700 1 --2- 172.21.15.57:0/143535137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c0fcd50 0x7f381c0fd160 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:53.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.809+0000 7f381be00700 1 -- 172.21.15.57:0/143535137 >> 172.21.15.57:0/143535137 conn(0x7f381c0f8430 msgr2=0x7f381c0fa840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.809+0000 7f381be00700 1 -- 172.21.15.57:0/143535137 shutdown_connections 2024-02-28T15:59:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.810+0000 7f381be00700 1 -- 172.21.15.57:0/143535137 wait complete. 2024-02-28T15:59:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.811+0000 7f381be00700 1 Processor -- start 2024-02-28T15:59:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.811+0000 7f381be00700 1 -- start start 2024-02-28T15:59:53.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.811+0000 7f381be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c0fcd50 0x7f381c10d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:53.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.811+0000 7f381be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f381c0fdf60 0x7f381c10dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:53.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.811+0000 7f381be00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c10e270 con 0x7f381c0fcd50 2024-02-28T15:59:53.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.811+0000 7f381be00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c10eb10 con 0x7f381c0fdf60 2024-02-28T15:59:53.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.812+0000 7f381a000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f381c0fdf60 0x7f381c10dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:53.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.812+0000 7f381aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c0fcd50 0x7f381c10d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:53.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.812+0000 7f381a000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f381c0fdf60 0x7f381c10dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:46876/0 (socket says 172.21.15.57:46876) 2024-02-28T15:59:53.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.812+0000 7f381a000700 1 -- 172.21.15.57:0/1896528751 learned_addr learned my addr 172.21.15.57:0/1896528751 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:53.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.812+0000 7f381a000700 1 -- 172.21.15.57:0/1896528751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c0fcd50 msgr2=0x7f381c10d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:53.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.812+0000 7f381a000700 1 --2- 172.21.15.57:0/1896528751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c0fcd50 0x7f381c10d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:53.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.812+0000 7f381a000700 1 -- 172.21.15.57:0/1896528751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3808005040 con 0x7f381c0fdf60 2024-02-28T15:59:53.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.813+0000 7f381a000700 1 --2- 172.21.15.57:0/1896528751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f381c0fdf60 0x7f381c10dc70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f38080096b0 tx=0x7f3808009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.813+0000 7f3812a00700 1 -- 172.21.15.57:0/1896528751 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3808017070 con 0x7f381c0fdf60 2024-02-28T15:59:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.813+0000 7f3812a00700 1 -- 172.21.15.57:0/1896528751 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f380800f040 con 0x7f381c0fdf60 2024-02-28T15:59:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.813+0000 7f3812a00700 1 -- 172.21.15.57:0/1896528751 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3808013be0 con 0x7f381c0fdf60 2024-02-28T15:59:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.814+0000 7f381be00700 1 -- 172.21.15.57:0/1896528751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c005040 con 0x7f381c0fdf60 2024-02-28T15:59:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.814+0000 7f381be00700 1 -- 172.21.15.57:0/1896528751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c10f140 con 0x7f381c0fdf60 2024-02-28T15:59:53.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.815+0000 7f381be00700 1 -- 172.21.15.57:0/1896528751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c04bed0 con 0x7f381c0fdf60 2024-02-28T15:59:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.816+0000 7f3812a00700 1 -- 172.21.15.57:0/1896528751 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f3808013400 con 0x7f381c0fdf60 2024-02-28T15:59:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.817+0000 7f3812a00700 1 --2- 172.21.15.57:0/1896528751 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38000692b0 0x7f380006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.817+0000 7f3812a00700 1 -- 172.21.15.57:0/1896528751 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3808086c40 con 0x7f381c0fdf60 2024-02-28T15:59:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.818+0000 7f381aa00700 1 --2- 172.21.15.57:0/1896528751 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38000692b0 0x7f380006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:53.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.819+0000 7f381aa00700 1 --2- 172.21.15.57:0/1896528751 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38000692b0 0x7f380006b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f380c000c00 tx=0x7f380c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:53.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:53.824+0000 7f3812a00700 1 -- 172.21.15.57:0/1896528751 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f38080569e0 con 0x7f381c0fdf60 2024-02-28T15:59:54.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.224+0000 7f381be00700 1 -- 172.21.15.57:0/1896528751 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f381c10f6e0 con 0x7f38000692b0 2024-02-28T15:59:54.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.225+0000 7f3812a00700 1 -- 172.21.15.57:0/1896528751 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f381c10f6e0 con 0x7f38000692b0 2024-02-28T15:59:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 -- 172.21.15.57:0/1896528751 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38000692b0 msgr2=0x7f380006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 --2- 172.21.15.57:0/1896528751 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38000692b0 0x7f380006b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f380c000c00 tx=0x7f380c009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 -- 172.21.15.57:0/1896528751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f381c0fdf60 msgr2=0x7f381c10dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 --2- 172.21.15.57:0/1896528751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f381c0fdf60 0x7f381c10dc70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f38080096b0 tx=0x7f3808009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 -- 172.21.15.57:0/1896528751 shutdown_connections 2024-02-28T15:59:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 --2- 172.21.15.57:0/1896528751 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f38000692b0 0x7f380006b760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 --2- 172.21.15.57:0/1896528751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c0fcd50 0x7f381c10d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 --2- 172.21.15.57:0/1896528751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f381c0fdf60 0x7f381c10dc70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 -- 172.21.15.57:0/1896528751 >> 172.21.15.57:0/1896528751 conn(0x7f381c0f8430 msgr2=0x7f381c101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 -- 172.21.15.57:0/1896528751 shutdown_connections 2024-02-28T15:59:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.228+0000 7f381be00700 1 -- 172.21.15.57:0/1896528751 wait complete. 2024-02-28T15:59:54.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.402+0000 7fd8c6800700 1 -- 172.21.15.57:0/511375323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8c00fda80 msgr2=0x7fd8c00ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:54.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.402+0000 7fd8c6800700 1 --2- 172.21.15.57:0/511375323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8c00fda80 0x7fd8c00ffe60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0004940 tx=0x7fd8b0009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:54.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.402+0000 7fd8c6800700 1 -- 172.21.15.57:0/511375323 shutdown_connections 2024-02-28T15:59:54.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.402+0000 7fd8c6800700 1 --2- 172.21.15.57:0/511375323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8c01003a0 0x7fd8c0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.402+0000 7fd8c6800700 1 --2- 172.21.15.57:0/511375323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8c00fda80 0x7fd8c00ffe60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.402+0000 7fd8c6800700 1 -- 172.21.15.57:0/511375323 >> 172.21.15.57:0/511375323 conn(0x7fd8c00f74e0 msgr2=0x7fd8c00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:54.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.402+0000 7fd8c6800700 1 -- 172.21.15.57:0/511375323 shutdown_connections 2024-02-28T15:59:54.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.403+0000 7fd8c6800700 1 -- 172.21.15.57:0/511375323 wait complete. 2024-02-28T15:59:54.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.404+0000 7fd8c6800700 1 Processor -- start 2024-02-28T15:59:54.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.404+0000 7fd8c6800700 1 -- start start 2024-02-28T15:59:54.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.404+0000 7fd8c6800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8c00fda80 0x7fd8c0113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:54.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.404+0000 7fd8c6800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8c01003a0 0x7fd8c01143f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:54.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.404+0000 7fd8c6800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c01149f0 con 0x7fd8c00fda80 2024-02-28T15:59:54.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.404+0000 7fd8c6800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0115290 con 0x7fd8c01003a0 2024-02-28T15:59:54.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.405+0000 7fd8bf400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8c00fda80 0x7fd8c0113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:54.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.405+0000 7fd8bea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8c01003a0 0x7fd8c01143f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:54.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.405+0000 7fd8bf400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8c00fda80 0x7fd8c0113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40610/0 (socket says 172.21.15.57:40610) 2024-02-28T15:59:54.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.405+0000 7fd8bf400700 1 -- 172.21.15.57:0/2500470381 learned_addr learned my addr 172.21.15.57:0/2500470381 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:54.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.405+0000 7fd8bf400700 1 -- 172.21.15.57:0/2500470381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8c01003a0 msgr2=0x7fd8c01143f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:54.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.405+0000 7fd8bf400700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8c01003a0 0x7fd8c01143f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.405+0000 7fd8bf400700 1 -- 172.21.15.57:0/2500470381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0005040 con 0x7fd8c00fda80 2024-02-28T15:59:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.406+0000 7fd8bea00700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8c01003a0 0x7fd8c01143f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T15:59:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.406+0000 7fd8bf400700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8c00fda80 0x7fd8c0113eb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009fd0 tx=0x7fd8b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.406+0000 7fd8b7400700 1 -- 172.21.15.57:0/2500470381 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8b0021070 con 0x7fd8c00fda80 2024-02-28T15:59:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.406+0000 7fd8b7400700 1 -- 172.21.15.57:0/2500470381 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8b001c400 con 0x7fd8c00fda80 2024-02-28T15:59:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.406+0000 7fd8c6800700 1 -- 172.21.15.57:0/2500470381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c0115510 con 0x7fd8c00fda80 2024-02-28T15:59:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.407+0000 7fd8b7400700 1 -- 172.21.15.57:0/2500470381 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8b0021070 con 0x7fd8c00fda80 2024-02-28T15:59:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.407+0000 7fd8c6800700 1 -- 172.21.15.57:0/2500470381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c01159f0 con 0x7fd8c00fda80 2024-02-28T15:59:54.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.408+0000 7fd8c6800700 1 -- 172.21.15.57:0/2500470381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c004bed0 con 0x7fd8c00fda80 2024-02-28T15:59:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.409+0000 7fd8b7400700 1 -- 172.21.15.57:0/2500470381 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fd8b001ca50 con 0x7fd8c00fda80 2024-02-28T15:59:54.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.411+0000 7fd8b7400700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd8a4069310 0x7fd8a406b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:54.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.411+0000 7fd8b7400700 1 -- 172.21.15.57:0/2500470381 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd8b0087dc0 con 0x7fd8c00fda80 2024-02-28T15:59:54.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.411+0000 7fd8bea00700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd8a4069310 0x7fd8a406b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:54.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.412+0000 7fd8bea00700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd8a4069310 0x7fd8a406b7c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac004600 tx=0x7fd8ac00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:54.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.416+0000 7fd8b7400700 1 -- 172.21.15.57:0/2500470381 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd8b0057b80 con 0x7fd8c00fda80 2024-02-28T15:59:54.629 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:54 smithi057 ceph-mon[28763]: pgmap v275: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:54.630 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:54 smithi057 ceph-mon[28763]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:54.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:54 smithi087 ceph-mon[37122]: pgmap v275: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:54.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:54 smithi087 ceph-mon[37122]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:54.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.741+0000 7fd8c6800700 1 -- 172.21.15.57:0/2500470381 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8c0116120 con 0x7fd8a4069310 2024-02-28T15:59:54.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.760+0000 7fd8b7400700 1 -- 172.21.15.57:0/2500470381 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd8ac00f040 con 0x7fd8a4069310 2024-02-28T15:59:54.753 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T15:59:54.753 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (7m) 74s ago 8m 13.5M - 0.25.0 c8568f914cd2 64bbae049744 2024-02-28T15:59:54.753 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (9m) 74s ago 9m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T15:59:54.753 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (7m) 79s ago 7m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T15:59:54.753 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (6m) 74s ago 8m 75.1M - 9.4.7 954c08fa6188 60cd69b6a8d5 2024-02-28T15:59:54.753 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (107s) 74s ago 106s 13.3M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T15:59:54.753 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (97s) 74s ago 97s 12.0M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (103s) 79s ago 102s 12.9M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (93s) 79s ago 93s 11.7M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:9283 running (10m) 74s ago 10m 481M - 17.2.7-535-gc0f02e60 1c37ed371348 2db340312662 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283 running (7m) 79s ago 7m 432M - 17.2.7-535-gc0f02e60 1c37ed371348 b5fa36ca3912 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (10m) 74s ago 10m 41.4M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (7m) 79s ago 7m 33.3M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (9m) 74s ago 9m 8024k - 1.5.0 0da6a335fe13 a721184edf00 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (7m) 79s ago 7m 7998k - 1.5.0 0da6a335fe13 f91fe90e3547 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (6m) 74s ago 6m 45.2M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (5m) 74s ago 5m 45.5M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (5m) 74s ago 5m 43.8M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (4m) 79s ago 4m 43.2M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T15:59:54.754 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (4m) 79s ago 4m 42.3M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T15:59:54.755 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (3m) 79s ago 3m 40.8M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T15:59:54.755 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (6m) 74s ago 8m 45.0M - 2.43.0 a07b618ecd1d 2e0885a51c9e 2024-02-28T15:59:54.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.763+0000 7fd8c6800700 1 -- 172.21.15.57:0/2500470381 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd8a4069310 msgr2=0x7fd8a406b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:54.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.763+0000 7fd8c6800700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd8a4069310 0x7fd8a406b7c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac004600 tx=0x7fd8ac00b040 comp rx=0 tx=0).stop 2024-02-28T15:59:54.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.763+0000 7fd8c6800700 1 -- 172.21.15.57:0/2500470381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8c00fda80 msgr2=0x7fd8c0113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:54.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.763+0000 7fd8c6800700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8c00fda80 0x7fd8c0113eb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009fd0 tx=0x7fd8b0009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:54.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.763+0000 7fd8c6800700 1 -- 172.21.15.57:0/2500470381 shutdown_connections 2024-02-28T15:59:54.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.763+0000 7fd8c6800700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd8a4069310 0x7fd8a406b7c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.763+0000 7fd8c6800700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8c00fda80 0x7fd8c0113eb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.763+0000 7fd8c6800700 1 --2- 172.21.15.57:0/2500470381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8c01003a0 0x7fd8c01143f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.763+0000 7fd8c6800700 1 -- 172.21.15.57:0/2500470381 >> 172.21.15.57:0/2500470381 conn(0x7fd8c00f74e0 msgr2=0x7fd8c00fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:54.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.764+0000 7fd8c6800700 1 -- 172.21.15.57:0/2500470381 shutdown_connections 2024-02-28T15:59:54.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.764+0000 7fd8c6800700 1 -- 172.21.15.57:0/2500470381 wait complete. 2024-02-28T15:59:54.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.950+0000 7f03c1800700 1 -- 172.21.15.57:0/2672817529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03bc100360 msgr2=0x7f03bc1007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:54.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.950+0000 7f03c1800700 1 --2- 172.21.15.57:0/2672817529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03bc100360 0x7f03bc1007b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f03a8004940 tx=0x7f03a8009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:54.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.950+0000 7f03c1800700 1 -- 172.21.15.57:0/2672817529 shutdown_connections 2024-02-28T15:59:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.950+0000 7f03c1800700 1 --2- 172.21.15.57:0/2672817529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03bc100360 0x7f03bc1007b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.950+0000 7f03c1800700 1 --2- 172.21.15.57:0/2672817529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03bc0ff150 0x7f03bc0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.950+0000 7f03c1800700 1 -- 172.21.15.57:0/2672817529 >> 172.21.15.57:0/2672817529 conn(0x7f03bc0fa920 msgr2=0x7f03bc0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.951+0000 7f03c1800700 1 -- 172.21.15.57:0/2672817529 shutdown_connections 2024-02-28T15:59:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.951+0000 7f03c1800700 1 -- 172.21.15.57:0/2672817529 wait complete. 2024-02-28T15:59:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.951+0000 7f03c1800700 1 Processor -- start 2024-02-28T15:59:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.952+0000 7f03c1800700 1 -- start start 2024-02-28T15:59:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.952+0000 7f03c1800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03bc0ff150 0x7f03bc10fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.952+0000 7f03c1800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03bc100360 0x7f03bc110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.952+0000 7f03c1800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc110640 con 0x7f03bc0ff150 2024-02-28T15:59:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.952+0000 7f03c1800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc110ee0 con 0x7f03bc100360 2024-02-28T15:59:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.953+0000 7f03baa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03bc0ff150 0x7f03bc10fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.953+0000 7f03baa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03bc0ff150 0x7f03bc10fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40634/0 (socket says 172.21.15.57:40634) 2024-02-28T15:59:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.953+0000 7f03baa00700 1 -- 172.21.15.57:0/3079166811 learned_addr learned my addr 172.21.15.57:0/3079166811 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.953+0000 7f03ba000700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03bc100360 0x7f03bc110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.953+0000 7f03baa00700 1 -- 172.21.15.57:0/3079166811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03bc100360 msgr2=0x7f03bc110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.953+0000 7f03baa00700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03bc100360 0x7f03bc110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.953+0000 7f03baa00700 1 -- 172.21.15.57:0/3079166811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a8005040 con 0x7f03bc0ff150 2024-02-28T15:59:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.953+0000 7f03baa00700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03bc0ff150 0x7f03bc10fb00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00eb70 tx=0x7f03ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.954+0000 7f03b2a00700 1 -- 172.21.15.57:0/3079166811 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03ac007cc0 con 0x7f03bc0ff150 2024-02-28T15:59:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.954+0000 7f03b2a00700 1 -- 172.21.15.57:0/3079166811 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03ac00f040 con 0x7f03bc0ff150 2024-02-28T15:59:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.954+0000 7f03c1800700 1 -- 172.21.15.57:0/3079166811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03bc111160 con 0x7f03bc0ff150 2024-02-28T15:59:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.954+0000 7f03c1800700 1 -- 172.21.15.57:0/3079166811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03bc1116a0 con 0x7f03bc0ff150 2024-02-28T15:59:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.955+0000 7f03b2a00700 1 -- 172.21.15.57:0/3079166811 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03ac00cb20 con 0x7f03bc0ff150 2024-02-28T15:59:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.956+0000 7f03c1800700 1 -- 172.21.15.57:0/3079166811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03bc04bed0 con 0x7f03bc0ff150 2024-02-28T15:59:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.957+0000 7f03b2a00700 1 -- 172.21.15.57:0/3079166811 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f03ac00cd40 con 0x7f03bc0ff150 2024-02-28T15:59:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.958+0000 7f03b2a00700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f03a00692b0 0x7f03a006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.958+0000 7f03b2a00700 1 -- 172.21.15.57:0/3079166811 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f03ac086bd0 con 0x7f03bc0ff150 2024-02-28T15:59:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.958+0000 7f03ba000700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f03a00692b0 0x7f03a006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.959+0000 7f03ba000700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f03a00692b0 0x7f03a006b760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03a80136a0 tx=0x7f03a8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:54.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:54.964+0000 7f03b2a00700 1 -- 172.21.15.57:0/3079166811 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f03ac04dbd0 con 0x7f03bc0ff150 2024-02-28T15:59:55.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.344+0000 7f03c1800700 1 -- 172.21.15.57:0/3079166811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f03bc1112f0 con 0x7f03bc0ff150 2024-02-28T15:59:55.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.345+0000 7f03b2a00700 1 -- 172.21.15.57:0/3079166811 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f03bc1112f0 con 0x7f03bc0ff150 2024-02-28T15:59:55.337 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T15:59:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 14 2024-02-28T15:59:55.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T15:59:55.339 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T15:59:55.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.348+0000 7f03c1800700 1 -- 172.21.15.57:0/3079166811 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f03a00692b0 msgr2=0x7f03a006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:55.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.348+0000 7f03c1800700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f03a00692b0 0x7f03a006b760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03a80136a0 tx=0x7f03a8009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:55.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.348+0000 7f03c1800700 1 -- 172.21.15.57:0/3079166811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03bc0ff150 msgr2=0x7f03bc10fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:55.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.348+0000 7f03c1800700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03bc0ff150 0x7f03bc10fb00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00eb70 tx=0x7f03ac00b040 comp rx=0 tx=0).stop 2024-02-28T15:59:55.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.349+0000 7f03c1800700 1 -- 172.21.15.57:0/3079166811 shutdown_connections 2024-02-28T15:59:55.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.349+0000 7f03c1800700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f03a00692b0 0x7f03a006b760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:55.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.349+0000 7f03c1800700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03bc0ff150 0x7f03bc10fb00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:55.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.349+0000 7f03c1800700 1 --2- 172.21.15.57:0/3079166811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03bc100360 0x7f03bc110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:55.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.349+0000 7f03c1800700 1 -- 172.21.15.57:0/3079166811 >> 172.21.15.57:0/3079166811 conn(0x7f03bc0fa920 msgr2=0x7f03bc103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:55.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.349+0000 7f03c1800700 1 -- 172.21.15.57:0/3079166811 shutdown_connections 2024-02-28T15:59:55.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.349+0000 7f03c1800700 1 -- 172.21.15.57:0/3079166811 wait complete. 2024-02-28T15:59:55.507 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:55 smithi057 ceph-mon[28763]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:55.507 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:55 smithi057 ceph-mon[28763]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:55.507 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:55 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3079166811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T15:59:55.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.513+0000 7fd50f200700 1 -- 172.21.15.57:0/196689803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5081001a0 msgr2=0x7fd508102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:55.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.513+0000 7fd50f200700 1 --2- 172.21.15.57:0/196689803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5081001a0 0x7fd508102580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8004940 tx=0x7fd4f8009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:55.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.514+0000 7fd50f200700 1 -- 172.21.15.57:0/196689803 shutdown_connections 2024-02-28T15:59:55.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.514+0000 7fd50f200700 1 --2- 172.21.15.57:0/196689803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5081001a0 0x7fd508102580 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:55.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.514+0000 7fd50f200700 1 --2- 172.21.15.57:0/196689803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5080fd880 0x7fd5080ffc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:55.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.514+0000 7fd50f200700 1 -- 172.21.15.57:0/196689803 >> 172.21.15.57:0/196689803 conn(0x7fd5080f72c0 msgr2=0x7fd5080f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:55.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.514+0000 7fd50f200700 1 -- 172.21.15.57:0/196689803 shutdown_connections 2024-02-28T15:59:55.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.514+0000 7fd50f200700 1 -- 172.21.15.57:0/196689803 wait complete. 2024-02-28T15:59:55.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.515+0000 7fd50f200700 1 Processor -- start 2024-02-28T15:59:55.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.515+0000 7fd50f200700 1 -- start start 2024-02-28T15:59:55.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.515+0000 7fd50f200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5080fd880 0x7fd5080fd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:55.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.515+0000 7fd50f200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5081001a0 0x7fd5080fb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:55.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.515+0000 7fd50f200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080fbd90 con 0x7fd5080fd880 2024-02-28T15:59:55.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.515+0000 7fd50f200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080fbf00 con 0x7fd5081001a0 2024-02-28T15:59:55.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.516+0000 7fd50d400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5081001a0 0x7fd5080fb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:55.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.516+0000 7fd50d400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5081001a0 0x7fd5080fb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:46928/0 (socket says 172.21.15.57:46928) 2024-02-28T15:59:55.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.516+0000 7fd50d400700 1 -- 172.21.15.57:0/360443779 learned_addr learned my addr 172.21.15.57:0/360443779 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:55.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.516+0000 7fd50de00700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5080fd880 0x7fd5080fd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:55.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.516+0000 7fd50d400700 1 -- 172.21.15.57:0/360443779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5080fd880 msgr2=0x7fd5080fd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:55.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.516+0000 7fd50d400700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5080fd880 0x7fd5080fd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:55.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.516+0000 7fd50d400700 1 -- 172.21.15.57:0/360443779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f8005040 con 0x7fd5081001a0 2024-02-28T15:59:55.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.517+0000 7fd50d400700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5081001a0 0x7fd5080fb790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009fd0 tx=0x7fd4f8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:55.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.517+0000 7fd502000700 1 -- 172.21.15.57:0/360443779 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4f8021070 con 0x7fd5081001a0 2024-02-28T15:59:55.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.517+0000 7fd502000700 1 -- 172.21.15.57:0/360443779 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4f801c400 con 0x7fd5081001a0 2024-02-28T15:59:55.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.517+0000 7fd502000700 1 -- 172.21.15.57:0/360443779 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4f800e070 con 0x7fd5081001a0 2024-02-28T15:59:55.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.518+0000 7fd50f200700 1 -- 172.21.15.57:0/360443779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5080fc180 con 0x7fd5081001a0 2024-02-28T15:59:55.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.518+0000 7fd50f200700 1 -- 172.21.15.57:0/360443779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd508115670 con 0x7fd5081001a0 2024-02-28T15:59:55.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.520+0000 7fd50f200700 1 -- 172.21.15.57:0/360443779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd508107850 con 0x7fd5081001a0 2024-02-28T15:59:55.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.520+0000 7fd502000700 1 -- 172.21.15.57:0/360443779 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fd4f801ca90 con 0x7fd5081001a0 2024-02-28T15:59:55.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.522+0000 7fd502000700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd4f00692b0 0x7fd4f006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:55.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.522+0000 7fd502000700 1 -- 172.21.15.57:0/360443779 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd4f8087e10 con 0x7fd5081001a0 2024-02-28T15:59:55.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.522+0000 7fd50de00700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd4f00692b0 0x7fd4f006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:55.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.523+0000 7fd50de00700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd4f00692b0 0x7fd4f006b760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc004600 tx=0x7fd4fc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:55.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.530+0000 7fd502000700 1 -- 172.21.15.57:0/360443779 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd4f8057c60 con 0x7fd5081001a0 2024-02-28T15:59:55.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:55 smithi087 ceph-mon[37122]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:55.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:55 smithi087 ceph-mon[37122]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:55.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:55 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3079166811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T15:59:55.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.873+0000 7fd50f200700 1 -- 172.21.15.57:0/360443779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd50804bed0 con 0x7fd5081001a0 2024-02-28T15:59:55.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.873+0000 7fd502000700 1 -- 172.21.15.57:0/360443779 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1825 (secure 0 0 0) 0x7fd4f80577f0 con 0x7fd5081001a0 2024-02-28T15:59:55.866 INFO:teuthology.orchestra.run.smithi057.stdout:e14 2024-02-28T15:59:55.866 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T15:59:55.866 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 14 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T15:58:26.323114+0000 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T15:59:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T15:59:55.868 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:59:55.869 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:59:55.869 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:59:55.869 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T15:59:55.869 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:59:55.869 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T15:59:55.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 -- 172.21.15.57:0/360443779 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd4f00692b0 msgr2=0x7fd4f006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:55.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd4f00692b0 0x7fd4f006b760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc004600 tx=0x7fd4fc00b040 comp rx=0 tx=0).stop 2024-02-28T15:59:55.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 -- 172.21.15.57:0/360443779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5081001a0 msgr2=0x7fd5080fb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:55.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5081001a0 0x7fd5080fb790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009fd0 tx=0x7fd4f8009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:55.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 -- 172.21.15.57:0/360443779 shutdown_connections 2024-02-28T15:59:55.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fd4f00692b0 0x7fd4f006b760 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:55.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5080fd880 0x7fd5080fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:55.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 --2- 172.21.15.57:0/360443779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5081001a0 0x7fd5080fb790 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:55.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 -- 172.21.15.57:0/360443779 >> 172.21.15.57:0/360443779 conn(0x7fd5080f72c0 msgr2=0x7fd5080f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:55.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 -- 172.21.15.57:0/360443779 shutdown_connections 2024-02-28T15:59:55.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:55.877+0000 7fd50f200700 1 -- 172.21.15.57:0/360443779 wait complete. 2024-02-28T15:59:55.871 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-02-28T15:59:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.042+0000 7f2103000700 1 -- 172.21.15.57:0/591285570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20fc1000e0 msgr2=0x7f20fc102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.042+0000 7f2103000700 1 --2- 172.21.15.57:0/591285570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20fc1000e0 0x7f20fc102520 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20e8004940 tx=0x7f20e8009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.043+0000 7f2103000700 1 -- 172.21.15.57:0/591285570 shutdown_connections 2024-02-28T15:59:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.043+0000 7f2103000700 1 --2- 172.21.15.57:0/591285570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20fc1000e0 0x7f20fc102520 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.043+0000 7f2103000700 1 --2- 172.21.15.57:0/591285570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20fc0663c0 0x7f20fc0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.043+0000 7f2103000700 1 -- 172.21.15.57:0/591285570 >> 172.21.15.57:0/591285570 conn(0x7f20fc0f74e0 msgr2=0x7f20fc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.043+0000 7f2103000700 1 -- 172.21.15.57:0/591285570 shutdown_connections 2024-02-28T15:59:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.043+0000 7f2103000700 1 -- 172.21.15.57:0/591285570 wait complete. 2024-02-28T15:59:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.044+0000 7f2103000700 1 Processor -- start 2024-02-28T15:59:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.044+0000 7f2103000700 1 -- start start 2024-02-28T15:59:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.044+0000 7f2103000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20fc0663c0 0x7f20fc10fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.044+0000 7f2103000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20fc1000e0 0x7f20fc110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.044+0000 7f2103000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc110670 con 0x7f20fc0663c0 2024-02-28T15:59:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.044+0000 7f2103000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc110f10 con 0x7f20fc1000e0 2024-02-28T15:59:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.045+0000 7f20fbe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20fc0663c0 0x7f20fc10fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.045+0000 7f20fbe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20fc0663c0 0x7f20fc10fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40654/0 (socket says 172.21.15.57:40654) 2024-02-28T15:59:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.045+0000 7f20fbe00700 1 -- 172.21.15.57:0/926737928 learned_addr learned my addr 172.21.15.57:0/926737928 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.045+0000 7f20fb400700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20fc1000e0 0x7f20fc110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.046+0000 7f20fb400700 1 -- 172.21.15.57:0/926737928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20fc0663c0 msgr2=0x7f20fc10fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.046+0000 7f20fb400700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20fc0663c0 0x7f20fc10fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.046+0000 7f20fb400700 1 -- 172.21.15.57:0/926737928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8005040 con 0x7f20fc1000e0 2024-02-28T15:59:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.046+0000 7f20fbe00700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20fc0663c0 0x7f20fc10fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T15:59:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.046+0000 7f20fb400700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20fc1000e0 0x7f20fc110070 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f20e8000c00 tx=0x7f20e8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.047+0000 7f20f3e00700 1 -- 172.21.15.57:0/926737928 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20e800e070 con 0x7f20fc1000e0 2024-02-28T15:59:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.047+0000 7f2103000700 1 -- 172.21.15.57:0/926737928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc111190 con 0x7f20fc1000e0 2024-02-28T15:59:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.047+0000 7f20f3e00700 1 -- 172.21.15.57:0/926737928 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20e801c400 con 0x7f20fc1000e0 2024-02-28T15:59:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.047+0000 7f20f3e00700 1 -- 172.21.15.57:0/926737928 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20e800b650 con 0x7f20fc1000e0 2024-02-28T15:59:56.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.047+0000 7f2103000700 1 -- 172.21.15.57:0/926737928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc111670 con 0x7f20fc1000e0 2024-02-28T15:59:56.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.048+0000 7f2103000700 1 -- 172.21.15.57:0/926737928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc04bed0 con 0x7f20fc1000e0 2024-02-28T15:59:56.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.050+0000 7f20f3e00700 1 -- 172.21.15.57:0/926737928 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f20e801c9e0 con 0x7f20fc1000e0 2024-02-28T15:59:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.051+0000 7f20f3e00700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f20e00692b0 0x7f20e006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.051+0000 7f20f3e00700 1 -- 172.21.15.57:0/926737928 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f20e8088820 con 0x7f20fc1000e0 2024-02-28T15:59:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.051+0000 7f20fbe00700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f20e00692b0 0x7f20e006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.052+0000 7f20fbe00700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f20e00692b0 0x7f20e006b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0041d0 tx=0x7f20ec00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.059+0000 7f20f3e00700 1 -- 172.21.15.57:0/926737928 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f20e8058540 con 0x7f20fc1000e0 2024-02-28T15:59:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.446+0000 7f2103000700 1 -- 172.21.15.57:0/926737928 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f20fc111b10 con 0x7f20e00692b0 2024-02-28T15:59:56.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.448+0000 7f20f3e00700 1 -- 172.21.15.57:0/926737928 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f20fc111b10 con 0x7f20e00692b0 2024-02-28T15:59:56.441 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T15:59:56.441 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T15:59:56.441 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T15:59:56.441 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T15:59:56.442 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [], 2024-02-28T15:59:56.442 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "0/21 daemons upgraded", 2024-02-28T15:59:56.442 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T15:59:56.442 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T15:59:56.442 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T15:59:56.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 -- 172.21.15.57:0/926737928 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f20e00692b0 msgr2=0x7f20e006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:56.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f20e00692b0 0x7f20e006b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0041d0 tx=0x7f20ec00b040 comp rx=0 tx=0).stop 2024-02-28T15:59:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 -- 172.21.15.57:0/926737928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20fc1000e0 msgr2=0x7f20fc110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20fc1000e0 0x7f20fc110070 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f20e8000c00 tx=0x7f20e8009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 -- 172.21.15.57:0/926737928 shutdown_connections 2024-02-28T15:59:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f20e00692b0 0x7f20e006b760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20fc0663c0 0x7f20fc10fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 --2- 172.21.15.57:0/926737928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20fc1000e0 0x7f20fc110070 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 -- 172.21.15.57:0/926737928 >> 172.21.15.57:0/926737928 conn(0x7f20fc0f74e0 msgr2=0x7f20fc0fb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 -- 172.21.15.57:0/926737928 shutdown_connections 2024-02-28T15:59:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.451+0000 7f2103000700 1 -- 172.21.15.57:0/926737928 wait complete. 2024-02-28T15:59:56.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.592+0000 7f16fdc00700 1 -- 172.21.15.57:0/3894166443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f80708c0 msgr2=0x7f16f8070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:56.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.592+0000 7f16fdc00700 1 --2- 172.21.15.57:0/3894166443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f80708c0 0x7f16f8070d10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f16e4004940 tx=0x7f16e4009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:56.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.592+0000 7f16fdc00700 1 -- 172.21.15.57:0/3894166443 shutdown_connections 2024-02-28T15:59:56.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.593+0000 7f16fdc00700 1 --2- 172.21.15.57:0/3894166443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f80708c0 0x7f16f8070d10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:56.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.593+0000 7f16fdc00700 1 --2- 172.21.15.57:0/3894166443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16f8071f10 0x7f16f8070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.593+0000 7f16fdc00700 1 -- 172.21.15.57:0/3894166443 >> 172.21.15.57:0/3894166443 conn(0x7f16f80f8620 msgr2=0x7f16f80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.593+0000 7f16fdc00700 1 -- 172.21.15.57:0/3894166443 shutdown_connections 2024-02-28T15:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.593+0000 7f16fdc00700 1 -- 172.21.15.57:0/3894166443 wait complete. 2024-02-28T15:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.594+0000 7f16fdc00700 1 Processor -- start 2024-02-28T15:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.594+0000 7f16fdc00700 1 -- start start 2024-02-28T15:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.594+0000 7f16fdc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16f80708c0 0x7f16f8113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.594+0000 7f16fdc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8071f10 0x7f16f81143e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.594+0000 7f16fdc00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f81149e0 con 0x7f16f8071f10 2024-02-28T15:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.594+0000 7f16fdc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8115280 con 0x7f16f80708c0 2024-02-28T15:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.595+0000 7f16f6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16f80708c0 0x7f16f8113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.595+0000 7f16f6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16f80708c0 0x7f16f8113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:46968/0 (socket says 172.21.15.57:46968) 2024-02-28T15:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.595+0000 7f16f6a00700 1 -- 172.21.15.57:0/3009789002 learned_addr learned my addr 172.21.15.57:0/3009789002 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T15:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.595+0000 7f16f6000700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8071f10 0x7f16f81143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.595+0000 7f16f6000700 1 -- 172.21.15.57:0/3009789002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16f80708c0 msgr2=0x7f16f8113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.595+0000 7f16f6000700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16f80708c0 0x7f16f8113ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.595+0000 7f16f6000700 1 -- 172.21.15.57:0/3009789002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4005040 con 0x7f16f8071f10 2024-02-28T15:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.596+0000 7f16f6000700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8071f10 0x7f16f81143e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f16e4000c00 tx=0x7f16e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.596+0000 7f16eea00700 1 -- 172.21.15.57:0/3009789002 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e4021070 con 0x7f16f8071f10 2024-02-28T15:59:56.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.596+0000 7f16eea00700 1 -- 172.21.15.57:0/3009789002 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16e401c400 con 0x7f16f8071f10 2024-02-28T15:59:56.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.596+0000 7f16eea00700 1 -- 172.21.15.57:0/3009789002 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e400e070 con 0x7f16f8071f10 2024-02-28T15:59:56.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.597+0000 7f16fdc00700 1 -- 172.21.15.57:0/3009789002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f8115500 con 0x7f16f8071f10 2024-02-28T15:59:56.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.597+0000 7f16fdc00700 1 -- 172.21.15.57:0/3009789002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f81159f0 con 0x7f16f8071f10 2024-02-28T15:59:56.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.598+0000 7f16fdc00700 1 -- 172.21.15.57:0/3009789002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f804bed0 con 0x7f16f8071f10 2024-02-28T15:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.600+0000 7f16eea00700 1 -- 172.21.15.57:0/3009789002 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f16e401ca00 con 0x7f16f8071f10 2024-02-28T15:59:56.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.601+0000 7f16eea00700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f16dc0692b0 0x7f16dc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T15:59:56.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.601+0000 7f16eea00700 1 -- 172.21.15.57:0/3009789002 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f16e4088400 con 0x7f16f8071f10 2024-02-28T15:59:56.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.602+0000 7f16f6a00700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f16dc0692b0 0x7f16dc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T15:59:56.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.603+0000 7f16f6a00700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f16dc0692b0 0x7f16dc06b760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16e8008fd0 tx=0x7f16e800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T15:59:56.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:56.610+0000 7f16eea00700 1 -- 172.21.15.57:0/3009789002 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f16e4058120 con 0x7f16f8071f10 2024-02-28T15:59:56.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:56 smithi087 ceph-mon[37122]: pgmap v276: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:56.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:56 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/360443779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T15:59:56.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:56 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:59:56.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:56 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:59:56.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:56 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:59:56.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:56 smithi057 ceph-mon[28763]: pgmap v276: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T15:59:56.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:56 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/360443779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T15:59:56.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:56 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:59:56.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:56 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T15:59:56.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:56 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T15:59:57.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.175+0000 7f16fdc00700 1 -- 172.21.15.57:0/3009789002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f16f810c010 con 0x7f16f8071f10 2024-02-28T15:59:57.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.176+0000 7f16eea00700 1 -- 172.21.15.57:0/3009789002 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f16e4057cb0 con 0x7f16f8071f10 2024-02-28T15:59:57.169 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T15:59:57.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.179+0000 7f16fdc00700 1 -- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f16dc0692b0 msgr2=0x7f16dc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.179+0000 7f16fdc00700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f16dc0692b0 0x7f16dc06b760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16e8008fd0 tx=0x7f16e800b040 comp rx=0 tx=0).stop 2024-02-28T15:59:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.179+0000 7f16fdc00700 1 -- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8071f10 msgr2=0x7f16f81143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T15:59:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.179+0000 7f16fdc00700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8071f10 0x7f16f81143e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f16e4000c00 tx=0x7f16e4009e30 comp rx=0 tx=0).stop 2024-02-28T15:59:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.179+0000 7f16fdc00700 1 -- 172.21.15.57:0/3009789002 shutdown_connections 2024-02-28T15:59:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.179+0000 7f16fdc00700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f16dc0692b0 0x7f16dc06b760 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.179+0000 7f16fdc00700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16f80708c0 0x7f16f8113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.179+0000 7f16fdc00700 1 --2- 172.21.15.57:0/3009789002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8071f10 0x7f16f81143e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T15:59:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.179+0000 7f16fdc00700 1 -- 172.21.15.57:0/3009789002 >> 172.21.15.57:0/3009789002 conn(0x7f16f80f8620 msgr2=0x7f16f80fa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T15:59:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.179+0000 7f16fdc00700 1 -- 172.21.15.57:0/3009789002 shutdown_connections 2024-02-28T15:59:57.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T15:59:57.180+0000 7f16fdc00700 1 -- 172.21.15.57:0/3009789002 wait complete. 2024-02-28T15:59:57.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:57 smithi087 ceph-mon[37122]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (unknown) 2024-02-28T15:59:57.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:57 smithi087 ceph-mon[37122]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T15:59:57.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:57 smithi087 ceph-mon[37122]: Upgrade: Need to upgrade myself (mgr.smithi057.upqerc) 2024-02-28T15:59:57.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:57 smithi087 ceph-mon[37122]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:57.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:57 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3009789002' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T15:59:57.900 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:57 smithi057 ceph-mon[28763]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (unknown) 2024-02-28T15:59:57.900 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:57 smithi057 ceph-mon[28763]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T15:59:57.900 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:57 smithi057 ceph-mon[28763]: Upgrade: Need to upgrade myself (mgr.smithi057.upqerc) 2024-02-28T15:59:57.900 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:57 smithi057 ceph-mon[28763]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T15:59:57.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:57 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3009789002' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T15:59:58.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:58 smithi087 ceph-mon[37122]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc on smithi087 2024-02-28T15:59:58.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 15:59:58 smithi087 ceph-mon[37122]: pgmap v277: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T15:59:58.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:58 smithi057 ceph-mon[28763]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc on smithi087 2024-02-28T15:59:58.822 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 15:59:58 smithi057 ceph-mon[28763]: pgmap v277: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:00 smithi087 ceph-mon[37122]: pgmap v278: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:00 smithi087 ceph-mon[37122]: overall HEALTH_OK 2024-02-28T16:00:00.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:00 smithi057 ceph-mon[28763]: pgmap v278: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:00.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:00 smithi057 ceph-mon[28763]: overall HEALTH_OK 2024-02-28T16:00:02.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:02 smithi057 ceph-mon[28763]: pgmap v279: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:02.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:02 smithi087 ceph-mon[37122]: pgmap v279: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:04.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:04 smithi057 ceph-mon[28763]: pgmap v280: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:04.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:04 smithi087 ceph-mon[37122]: pgmap v280: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:06.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:06 smithi087 ceph-mon[37122]: pgmap v281: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:06.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:06 smithi057 ceph-mon[28763]: pgmap v281: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:07.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:07 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:00:07.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:07 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:00:08.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:08 smithi087 ceph-mon[37122]: pgmap v282: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:08.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:08 smithi057 ceph-mon[28763]: pgmap v282: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:10.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:10 smithi057 ceph-mon[28763]: pgmap v283: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:10.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:10 smithi087 ceph-mon[37122]: pgmap v283: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:12.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:12 smithi057 ceph-mon[28763]: pgmap v284: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:12.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:12 smithi087 ceph-mon[37122]: pgmap v284: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:14.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:14 smithi087 ceph-mon[37122]: pgmap v285: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:14.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:14 smithi057 ceph-mon[28763]: pgmap v285: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:16.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:16 smithi087 ceph-mon[37122]: pgmap v286: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:16.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:16 smithi057 ceph-mon[28763]: pgmap v286: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:18.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:18 smithi057 ceph-mon[28763]: pgmap v287: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:18.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:18 smithi087 ceph-mon[37122]: pgmap v287: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:20.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:20 smithi057 ceph-mon[28763]: pgmap v288: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:20.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:20 smithi087 ceph-mon[37122]: pgmap v288: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:21.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:21 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:00:21.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:21 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:00:22.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:22 smithi087 ceph-mon[37122]: pgmap v289: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:22.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:22 smithi057 ceph-mon[28763]: pgmap v289: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:24 smithi087 ceph-mon[37122]: pgmap v290: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:24.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:24 smithi057 ceph-mon[28763]: pgmap v290: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:25.875 INFO:tasks.workunit.client.1.smithi087.stderr:Updating files: 55% (6811/12271) Updating files: 56% (6872/12271) Updating files: 57% (6995/12271) Updating files: 58% (7118/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 86% (10631/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-02-28T16:00:26.124 INFO:tasks.workunit.client.0.smithi057.stderr:Updating files: 61% (7546/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-02-28T16:00:26.288 INFO:tasks.workunit.client.0.smithi057.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-02-28T16:00:26.288 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-02-28T16:00:26.288 INFO:tasks.workunit.client.0.smithi057.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-28T16:00:26.288 INFO:tasks.workunit.client.0.smithi057.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr:state without impacting any branches by switching back to a branch. 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr: git switch -c 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr:Or undo this operation with: 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr: git switch - 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-02-28T16:00:26.289 INFO:tasks.workunit.client.0.smithi057.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-02-28T16:00:26.292 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-28T16:00:26.418 INFO:tasks.workunit.client.1.smithi087.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-02-28T16:00:26.418 INFO:tasks.workunit.client.1.smithi087.stderr: 2024-02-28T16:00:26.418 INFO:tasks.workunit.client.1.smithi087.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-28T16:00:26.418 INFO:tasks.workunit.client.1.smithi087.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-28T16:00:26.418 INFO:tasks.workunit.client.1.smithi087.stderr:state without impacting any branches by switching back to a branch. 2024-02-28T16:00:26.418 INFO:tasks.workunit.client.1.smithi087.stderr: 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr: 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr: git switch -c 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr: 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr:Or undo this operation with: 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr: 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr: git switch - 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr: 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-28T16:00:26.419 INFO:tasks.workunit.client.1.smithi087.stderr: 2024-02-28T16:00:26.420 INFO:tasks.workunit.client.1.smithi087.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-02-28T16:00:26.421 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-28T16:00:26.450 INFO:tasks.workunit.client.0.smithi057.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-28T16:00:26.459 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-28T16:00:26.460 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-28T16:00:26.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:26 smithi087 ceph-mon[37122]: pgmap v291: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:26.524 INFO:tasks.workunit.client.1.smithi087.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-28T16:00:26.532 INFO:tasks.workunit.client.1.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-28T16:00:26.532 INFO:tasks.workunit.client.1.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-28T16:00:26.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:26 smithi057 ceph-mon[28763]: pgmap v291: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:00:27.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.371+0000 7f51aa400700 1 -- 172.21.15.57:0/2038357017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51a4100110 msgr2=0x7f51a4102530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:27.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.371+0000 7f51aa400700 1 --2- 172.21.15.57:0/2038357017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51a4100110 0x7f51a4102530 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5190004940 tx=0x7f5190009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:27.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.371+0000 7f51aa400700 1 -- 172.21.15.57:0/2038357017 shutdown_connections 2024-02-28T16:00:27.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.371+0000 7f51aa400700 1 --2- 172.21.15.57:0/2038357017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51a4100110 0x7f51a4102530 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:27.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.371+0000 7f51aa400700 1 --2- 172.21.15.57:0/2038357017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4066c30 0x7f51a40ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:27.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.371+0000 7f51aa400700 1 -- 172.21.15.57:0/2038357017 >> 172.21.15.57:0/2038357017 conn(0x7f51a40f7510 msgr2=0x7f51a40f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:27.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.371+0000 7f51aa400700 1 -- 172.21.15.57:0/2038357017 shutdown_connections 2024-02-28T16:00:27.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.371+0000 7f51aa400700 1 -- 172.21.15.57:0/2038357017 wait complete. 2024-02-28T16:00:27.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.372+0000 7f51aa400700 1 Processor -- start 2024-02-28T16:00:27.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.372+0000 7f51aa400700 1 -- start start 2024-02-28T16:00:27.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.373+0000 7f51aa400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51a4066c30 0x7f51a410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:27.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.373+0000 7f51aa400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4100110 0x7f51a41100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:27.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.373+0000 7f51aa400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a41106b0 con 0x7f51a4066c30 2024-02-28T16:00:27.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.373+0000 7f51aa400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4110f50 con 0x7f51a4100110 2024-02-28T16:00:27.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.373+0000 7f51a3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51a4066c30 0x7f51a410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:27.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.373+0000 7f51a3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51a4066c30 0x7f51a410fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38288/0 (socket says 172.21.15.57:38288) 2024-02-28T16:00:27.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.373+0000 7f51a3400700 1 -- 172.21.15.57:0/145129478 learned_addr learned my addr 172.21.15.57:0/145129478 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:00:27.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.373+0000 7f51a2a00700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4100110 0x7f51a41100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:27.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.374+0000 7f51a3400700 1 -- 172.21.15.57:0/145129478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4100110 msgr2=0x7f51a41100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:27.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.374+0000 7f51a3400700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4100110 0x7f51a41100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:27.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.374+0000 7f51a3400700 1 -- 172.21.15.57:0/145129478 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5190005040 con 0x7f51a4066c30 2024-02-28T16:00:27.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.374+0000 7f51a3400700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51a4066c30 0x7f51a410fb70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5194002a50 tx=0x7f51940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:27.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.374+0000 7f519b400700 1 -- 172.21.15.57:0/145129478 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5194007cc0 con 0x7f51a4066c30 2024-02-28T16:00:27.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.374+0000 7f519b400700 1 -- 172.21.15.57:0/145129478 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f519400f040 con 0x7f51a4066c30 2024-02-28T16:00:27.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.374+0000 7f51aa400700 1 -- 172.21.15.57:0/145129478 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a4111230 con 0x7f51a4066c30 2024-02-28T16:00:27.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.374+0000 7f519b400700 1 -- 172.21.15.57:0/145129478 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5194009640 con 0x7f51a4066c30 2024-02-28T16:00:27.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.375+0000 7f51aa400700 1 -- 172.21.15.57:0/145129478 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a4111770 con 0x7f51a4066c30 2024-02-28T16:00:27.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.376+0000 7f51aa400700 1 -- 172.21.15.57:0/145129478 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a404bed0 con 0x7f51a4066c30 2024-02-28T16:00:27.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.378+0000 7f519b400700 1 -- 172.21.15.57:0/145129478 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f51940097c0 con 0x7f51a4066c30 2024-02-28T16:00:27.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.379+0000 7f519b400700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f51880692b0 0x7f518806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:27.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.379+0000 7f519b400700 1 -- 172.21.15.57:0/145129478 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f51940875b0 con 0x7f51a4066c30 2024-02-28T16:00:27.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.379+0000 7f51a2a00700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f51880692b0 0x7f518806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:27.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.380+0000 7f51a2a00700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f51880692b0 0x7f518806b760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f519000b020 tx=0x7f5190009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:27.376 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-28T16:00:27.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.383+0000 7f519b400700 1 -- 172.21.15.57:0/145129478 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5194057370 con 0x7f51a4066c30 2024-02-28T16:00:27.498 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-28T16:00:27.586 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-28T16:00:27.592 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-28T16:00:27.592 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-28T16:00:27.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.618+0000 7f51aa400700 1 -- 172.21.15.57:0/145129478 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51a40fc030 con 0x7f51880692b0 2024-02-28T16:00:27.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.620+0000 7f519b400700 1 -- 172.21.15.57:0/145129478 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f51a40fc030 con 0x7f51880692b0 2024-02-28T16:00:27.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 -- 172.21.15.57:0/145129478 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f51880692b0 msgr2=0x7f518806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:27.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f51880692b0 0x7f518806b760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f519000b020 tx=0x7f5190009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:27.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 -- 172.21.15.57:0/145129478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51a4066c30 msgr2=0x7f51a410fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:27.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51a4066c30 0x7f51a410fb70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5194002a50 tx=0x7f51940046b0 comp rx=0 tx=0).stop 2024-02-28T16:00:27.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 -- 172.21.15.57:0/145129478 shutdown_connections 2024-02-28T16:00:27.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f51880692b0 0x7f518806b760 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:27.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51a4066c30 0x7f51a410fb70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:27.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 --2- 172.21.15.57:0/145129478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4100110 0x7f51a41100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:27.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 -- 172.21.15.57:0/145129478 >> 172.21.15.57:0/145129478 conn(0x7f51a40f7510 msgr2=0x7f51a40fb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:27.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 -- 172.21.15.57:0/145129478 shutdown_connections 2024-02-28T16:00:27.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.623+0000 7f51aa400700 1 -- 172.21.15.57:0/145129478 wait complete. 2024-02-28T16:00:27.633 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:00:27.671 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-28T16:00:27.679 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T16:00:27.679 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-28T16:00:27.727 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-28T16:00:27.730 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-28T16:00:27.730 DEBUG:teuthology.orchestra.run.smithi057:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-28T16:00:27.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.781+0000 7f3f26400700 1 -- 172.21.15.57:0/1089613553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f200fe0e0 msgr2=0x7f3f200fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:27.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.781+0000 7f3f26400700 1 --2- 172.21.15.57:0/1089613553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f200fe0e0 0x7f3f200fe550 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c004940 tx=0x7f3f0c009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:27.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.781+0000 7f3f26400700 1 -- 172.21.15.57:0/1089613553 shutdown_connections 2024-02-28T16:00:27.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.781+0000 7f3f26400700 1 --2- 172.21.15.57:0/1089613553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f200fe0e0 0x7f3f200fe550 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:27.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.781+0000 7f3f26400700 1 --2- 172.21.15.57:0/1089613553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f200fcef0 0x7f3f200fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:27.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.781+0000 7f3f26400700 1 -- 172.21.15.57:0/1089613553 >> 172.21.15.57:0/1089613553 conn(0x7f3f200f8620 msgr2=0x7f3f200faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:27.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.781+0000 7f3f26400700 1 -- 172.21.15.57:0/1089613553 shutdown_connections 2024-02-28T16:00:27.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.781+0000 7f3f26400700 1 -- 172.21.15.57:0/1089613553 wait complete. 2024-02-28T16:00:27.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.782+0000 7f3f26400700 1 Processor -- start 2024-02-28T16:00:27.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.782+0000 7f3f26400700 1 -- start start 2024-02-28T16:00:27.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.783+0000 7f3f26400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f200fcef0 0x7f3f2010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:27.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.783+0000 7f3f26400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f200fe0e0 0x7f3f201100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:27.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.783+0000 7f3f26400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f201106a0 con 0x7f3f200fe0e0 2024-02-28T16:00:27.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.783+0000 7f3f26400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f20110f40 con 0x7f3f200fcef0 2024-02-28T16:00:27.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.783+0000 7f3f1ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f200fe0e0 0x7f3f201100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:27.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.783+0000 7f3f1ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f200fe0e0 0x7f3f201100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38300/0 (socket says 172.21.15.57:38300) 2024-02-28T16:00:27.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.783+0000 7f3f1ea00700 1 -- 172.21.15.57:0/3897322150 learned_addr learned my addr 172.21.15.57:0/3897322150 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:00:27.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.784+0000 7f3f1f400700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f200fcef0 0x7f3f2010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:27.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.784+0000 7f3f1ea00700 1 -- 172.21.15.57:0/3897322150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f200fcef0 msgr2=0x7f3f2010fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:27.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.784+0000 7f3f1ea00700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f200fcef0 0x7f3f2010fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:27.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.784+0000 7f3f1ea00700 1 -- 172.21.15.57:0/3897322150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c005040 con 0x7f3f200fe0e0 2024-02-28T16:00:27.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.784+0000 7f3f1ea00700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f200fe0e0 0x7f3f201100a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00b3b0 tx=0x7f3f0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:27.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.785+0000 7f3f17400700 1 -- 172.21.15.57:0/3897322150 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f0c00e040 con 0x7f3f200fe0e0 2024-02-28T16:00:27.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.785+0000 7f3f17400700 1 -- 172.21.15.57:0/3897322150 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f0c00bd90 con 0x7f3f200fe0e0 2024-02-28T16:00:27.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.785+0000 7f3f17400700 1 -- 172.21.15.57:0/3897322150 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f0c01c630 con 0x7f3f200fe0e0 2024-02-28T16:00:27.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.785+0000 7f3f26400700 1 -- 172.21.15.57:0/3897322150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f201111c0 con 0x7f3f200fe0e0 2024-02-28T16:00:27.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.785+0000 7f3f26400700 1 -- 172.21.15.57:0/3897322150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f20111700 con 0x7f3f200fe0e0 2024-02-28T16:00:27.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.786+0000 7f3f26400700 1 -- 172.21.15.57:0/3897322150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f20102210 con 0x7f3f200fe0e0 2024-02-28T16:00:27.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.787+0000 7f3f17400700 1 -- 172.21.15.57:0/3897322150 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f3f0c0139f0 con 0x7f3f200fe0e0 2024-02-28T16:00:27.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.788+0000 7f3f17400700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3f040692b0 0x7f3f0406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:27.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.788+0000 7f3f17400700 1 -- 172.21.15.57:0/3897322150 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3f0c0886d0 con 0x7f3f200fe0e0 2024-02-28T16:00:27.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.788+0000 7f3f1f400700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3f040692b0 0x7f3f0406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:27.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.789+0000 7f3f1f400700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3f040692b0 0x7f3f0406b760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f200fcc30 tx=0x7f3f10009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:27.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:27.794+0000 7f3f17400700 1 -- 172.21.15.57:0/3897322150 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3f0c058520 con 0x7f3f200fe0e0 2024-02-28T16:00:27.835 INFO:tasks.workunit.client.0.smithi057.stderr:+ mkdir -p fsstress 2024-02-28T16:00:27.840 INFO:tasks.workunit.client.0.smithi057.stderr:+ pushd fsstress 2024-02-28T16:00:27.843 INFO:tasks.workunit.client.0.smithi057.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:00:27.843 INFO:tasks.workunit.client.0.smithi057.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-28T16:00:28.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.021+0000 7f3f26400700 1 -- 172.21.15.57:0/3897322150 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f20111b40 con 0x7f3f040692b0 2024-02-28T16:00:28.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.023+0000 7f3f17400700 1 -- 172.21.15.57:0/3897322150 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f3f20111b40 con 0x7f3f040692b0 2024-02-28T16:00:28.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 -- 172.21.15.57:0/3897322150 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3f040692b0 msgr2=0x7f3f0406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:28.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3f040692b0 0x7f3f0406b760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f200fcc30 tx=0x7f3f10009040 comp rx=0 tx=0).stop 2024-02-28T16:00:28.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 -- 172.21.15.57:0/3897322150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f200fe0e0 msgr2=0x7f3f201100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:28.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f200fe0e0 0x7f3f201100a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00b3b0 tx=0x7f3f0c009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 -- 172.21.15.57:0/3897322150 shutdown_connections 2024-02-28T16:00:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3f040692b0 0x7f3f0406b760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f200fcef0 0x7f3f2010fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 --2- 172.21.15.57:0/3897322150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f200fe0e0 0x7f3f201100a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 -- 172.21.15.57:0/3897322150 >> 172.21.15.57:0/3897322150 conn(0x7f3f200f8620 msgr2=0x7f3f200ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:28.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 -- 172.21.15.57:0/3897322150 shutdown_connections 2024-02-28T16:00:28.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.026+0000 7f3f26400700 1 -- 172.21.15.57:0/3897322150 wait complete. 2024-02-28T16:00:28.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.177+0000 7f3e96a00700 1 -- 172.21.15.57:0/1054782866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e900663e0 msgr2=0x7f3e900ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:28.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.177+0000 7f3e96a00700 1 --2- 172.21.15.57:0/1054782866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e900663e0 0x7f3e900ffaf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3e80004940 tx=0x7f3e80009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:28.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.177+0000 7f3e96a00700 1 -- 172.21.15.57:0/1054782866 shutdown_connections 2024-02-28T16:00:28.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.177+0000 7f3e96a00700 1 --2- 172.21.15.57:0/1054782866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e901000c0 0x7f3e90102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.177+0000 7f3e96a00700 1 --2- 172.21.15.57:0/1054782866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e900663e0 0x7f3e900ffaf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.177+0000 7f3e96a00700 1 -- 172.21.15.57:0/1054782866 >> 172.21.15.57:0/1054782866 conn(0x7f3e900f74e0 msgr2=0x7f3e900f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:28.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.177+0000 7f3e96a00700 1 -- 172.21.15.57:0/1054782866 shutdown_connections 2024-02-28T16:00:28.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.177+0000 7f3e96a00700 1 -- 172.21.15.57:0/1054782866 wait complete. 2024-02-28T16:00:28.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.178+0000 7f3e96a00700 1 Processor -- start 2024-02-28T16:00:28.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.178+0000 7f3e96a00700 1 -- start start 2024-02-28T16:00:28.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.179+0000 7f3e96a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e900663e0 0x7f3e9010d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:28.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.179+0000 7f3e96a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e901000c0 0x7f3e9010def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:28.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.179+0000 7f3e96a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9010e4f0 con 0x7f3e901000c0 2024-02-28T16:00:28.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.179+0000 7f3e96a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9010ed90 con 0x7f3e900663e0 2024-02-28T16:00:28.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.179+0000 7f3e8f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e901000c0 0x7f3e9010def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:28.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.179+0000 7f3e8f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e901000c0 0x7f3e9010def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38304/0 (socket says 172.21.15.57:38304) 2024-02-28T16:00:28.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.179+0000 7f3e8f400700 1 -- 172.21.15.57:0/3193010488 learned_addr learned my addr 172.21.15.57:0/3193010488 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:00:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.179+0000 7f3e8fe00700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e900663e0 0x7f3e9010d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.180+0000 7f3e8f400700 1 -- 172.21.15.57:0/3193010488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e900663e0 msgr2=0x7f3e9010d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.180+0000 7f3e8f400700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e900663e0 0x7f3e9010d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.180+0000 7f3e8f400700 1 -- 172.21.15.57:0/3193010488 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80005040 con 0x7f3e901000c0 2024-02-28T16:00:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.180+0000 7f3e8f400700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e901000c0 0x7f3e9010def0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00c800 tx=0x7f3e7c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.180+0000 7f3e87e00700 1 -- 172.21.15.57:0/3193010488 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e7c00a760 con 0x7f3e901000c0 2024-02-28T16:00:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.180+0000 7f3e87e00700 1 -- 172.21.15.57:0/3193010488 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e7c00ad90 con 0x7f3e901000c0 2024-02-28T16:00:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.180+0000 7f3e87e00700 1 -- 172.21.15.57:0/3193010488 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e7c0113a0 con 0x7f3e901000c0 2024-02-28T16:00:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.180+0000 7f3e96a00700 1 -- 172.21.15.57:0/3193010488 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9010f070 con 0x7f3e901000c0 2024-02-28T16:00:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.180+0000 7f3e96a00700 1 -- 172.21.15.57:0/3193010488 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9010f560 con 0x7f3e901000c0 2024-02-28T16:00:28.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.182+0000 7f3e96a00700 1 -- 172.21.15.57:0/3193010488 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e90107a70 con 0x7f3e901000c0 2024-02-28T16:00:28.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.184+0000 7f3e87e00700 1 -- 172.21.15.57:0/3193010488 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f3e7c012400 con 0x7f3e901000c0 2024-02-28T16:00:28.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.184+0000 7f3e87e00700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3e740692b0 0x7f3e7406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:28.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.185+0000 7f3e87e00700 1 -- 172.21.15.57:0/3193010488 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3e7c087210 con 0x7f3e901000c0 2024-02-28T16:00:28.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.185+0000 7f3e8fe00700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3e740692b0 0x7f3e7406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:28.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.186+0000 7f3e8fe00700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3e740692b0 0x7f3e7406b760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000b020 tx=0x7f3e80009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.190+0000 7f3e87e00700 1 -- 172.21.15.57:0/3193010488 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3e7c056fd0 con 0x7f3e901000c0 2024-02-28T16:00:28.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.402+0000 7f3e96a00700 1 -- 172.21.15.57:0/3193010488 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e9010f8a0 con 0x7f3e740692b0 2024-02-28T16:00:28.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.414+0000 7f3e87e00700 1 -- 172.21.15.57:0/3193010488 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f3e9010f8a0 con 0x7f3e740692b0 2024-02-28T16:00:28.408 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:00:28.408 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (7m) 107s ago 9m 13.5M - 0.25.0 c8568f914cd2 64bbae049744 2024-02-28T16:00:28.408 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (9m) 107s ago 9m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T16:00:28.408 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (8m) 112s ago 8m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T16:00:28.408 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (7m) 107s ago 9m 75.1M - 9.4.7 954c08fa6188 60cd69b6a8d5 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (2m) 107s ago 2m 13.3M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (2m) 107s ago 2m 12.0M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (2m) 112s ago 2m 12.9M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (2m) 112s ago 2m 11.7M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:9283 running (11m) 107s ago 11m 481M - 17.2.7-535-gc0f02e60 1c37ed371348 2db340312662 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283 running (8m) 112s ago 8m 432M - 17.2.7-535-gc0f02e60 1c37ed371348 b5fa36ca3912 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (11m) 107s ago 11m 41.4M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (8m) 112s ago 8m 33.3M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (9m) 107s ago 9m 8024k - 1.5.0 0da6a335fe13 a721184edf00 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (8m) 112s ago 8m 7998k - 1.5.0 0da6a335fe13 f91fe90e3547 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (7m) 107s ago 7m 45.2M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (6m) 107s ago 6m 45.5M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (5m) 107s ago 5m 43.8M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:00:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (5m) 112s ago 5m 43.2M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:00:28.410 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (4m) 112s ago 4m 42.3M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:00:28.410 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (4m) 112s ago 4m 40.8M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:00:28.410 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (7m) 107s ago 8m 45.0M - 2.43.0 a07b618ecd1d 2e0885a51c9e 2024-02-28T16:00:28.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 -- 172.21.15.57:0/3193010488 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3e740692b0 msgr2=0x7f3e7406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:28.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3e740692b0 0x7f3e7406b760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000b020 tx=0x7f3e80009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:28.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 -- 172.21.15.57:0/3193010488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e901000c0 msgr2=0x7f3e9010def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:28.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e901000c0 0x7f3e9010def0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00c800 tx=0x7f3e7c004470 comp rx=0 tx=0).stop 2024-02-28T16:00:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 -- 172.21.15.57:0/3193010488 shutdown_connections 2024-02-28T16:00:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f3e740692b0 0x7f3e7406b760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e900663e0 0x7f3e9010d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 --2- 172.21.15.57:0/3193010488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e901000c0 0x7f3e9010def0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 -- 172.21.15.57:0/3193010488 >> 172.21.15.57:0/3193010488 conn(0x7f3e900f74e0 msgr2=0x7f3e900f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 -- 172.21.15.57:0/3193010488 shutdown_connections 2024-02-28T16:00:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.417+0000 7f3e96a00700 1 -- 172.21.15.57:0/3193010488 wait complete. 2024-02-28T16:00:28.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.574+0000 7f9dfaa00700 1 -- 172.21.15.57:0/2328020843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40fcd90 msgr2=0x7f9df40fd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:28.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.574+0000 7f9dfaa00700 1 --2- 172.21.15.57:0/2328020843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40fcd90 0x7f9df40fd1a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9de8004940 tx=0x7f9de8009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:28.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.574+0000 7f9dfaa00700 1 -- 172.21.15.57:0/2328020843 shutdown_connections 2024-02-28T16:00:28.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.574+0000 7f9dfaa00700 1 --2- 172.21.15.57:0/2328020843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40fdfa0 0x7f9df40fe3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.574+0000 7f9dfaa00700 1 --2- 172.21.15.57:0/2328020843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40fcd90 0x7f9df40fd1a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.574+0000 7f9dfaa00700 1 -- 172.21.15.57:0/2328020843 >> 172.21.15.57:0/2328020843 conn(0x7f9df40f8470 msgr2=0x7f9df40fa880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:28.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.574+0000 7f9dfaa00700 1 -- 172.21.15.57:0/2328020843 shutdown_connections 2024-02-28T16:00:28.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.575+0000 7f9dfaa00700 1 -- 172.21.15.57:0/2328020843 wait complete. 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.575+0000 7f9dfaa00700 1 Processor -- start 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.576+0000 7f9dfaa00700 1 -- start start 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.576+0000 7f9dfaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40fcd90 0x7f9df410f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.576+0000 7f9dfaa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40fdfa0 0x7f9df410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.576+0000 7f9dfaa00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df4110420 con 0x7f9df40fcd90 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.576+0000 7f9dfaa00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df4110cc0 con 0x7f9df40fdfa0 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.576+0000 7f9df9600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40fcd90 0x7f9df410f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.576+0000 7f9df9600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40fcd90 0x7f9df410f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38322/0 (socket says 172.21.15.57:38322) 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.576+0000 7f9df9600700 1 -- 172.21.15.57:0/3523069808 learned_addr learned my addr 172.21.15.57:0/3523069808 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.576+0000 7f9df8c00700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40fdfa0 0x7f9df410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.577+0000 7f9df9600700 1 -- 172.21.15.57:0/3523069808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40fdfa0 msgr2=0x7f9df410fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:28.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.577+0000 7f9df9600700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40fdfa0 0x7f9df410fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.577+0000 7f9df9600700 1 -- 172.21.15.57:0/3523069808 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de8005040 con 0x7f9df40fcd90 2024-02-28T16:00:28.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.577+0000 7f9df9600700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40fcd90 0x7f9df410f8e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009fd0 tx=0x7f9de8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:28.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.577+0000 7f9df1600700 1 -- 172.21.15.57:0/3523069808 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9de8021070 con 0x7f9df40fcd90 2024-02-28T16:00:28.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.577+0000 7f9df1600700 1 -- 172.21.15.57:0/3523069808 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9de801c400 con 0x7f9df40fcd90 2024-02-28T16:00:28.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.577+0000 7f9dfaa00700 1 -- 172.21.15.57:0/3523069808 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df4110f40 con 0x7f9df40fcd90 2024-02-28T16:00:28.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.577+0000 7f9df1600700 1 -- 172.21.15.57:0/3523069808 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9de800e070 con 0x7f9df40fcd90 2024-02-28T16:00:28.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.578+0000 7f9dfaa00700 1 -- 172.21.15.57:0/3523069808 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df4111420 con 0x7f9df40fcd90 2024-02-28T16:00:28.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.579+0000 7f9dfaa00700 1 -- 172.21.15.57:0/3523069808 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df4102040 con 0x7f9df40fcd90 2024-02-28T16:00:28.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.580+0000 7f9df1600700 1 -- 172.21.15.57:0/3523069808 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f9de801ca50 con 0x7f9df40fcd90 2024-02-28T16:00:28.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.581+0000 7f9df1600700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9ddc0692b0 0x7f9ddc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:28.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.581+0000 7f9df1600700 1 -- 172.21.15.57:0/3523069808 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9de8088330 con 0x7f9df40fcd90 2024-02-28T16:00:28.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.581+0000 7f9df8c00700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9ddc0692b0 0x7f9ddc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:28.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.582+0000 7f9df8c00700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9ddc0692b0 0x7f9ddc06b760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9de0004600 tx=0x7f9de000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:28.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.587+0000 7f9df1600700 1 -- 172.21.15.57:0/3523069808 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9de8058190 con 0x7f9df40fcd90 2024-02-28T16:00:28.672 INFO:tasks.workunit.client.1.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-28T16:00:28.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:28 smithi057 ceph-mon[28763]: pgmap v292: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:28.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:28 smithi057 ceph-mon[28763]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:00:28.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:28 smithi087 ceph-mon[37122]: pgmap v292: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:00:28.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:28 smithi087 ceph-mon[37122]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:00:28.884 INFO:tasks.workunit.client.1.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-28T16:00:28.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.952+0000 7f9dfaa00700 1 -- 172.21.15.57:0/3523069808 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9df4111750 con 0x7f9df40fcd90 2024-02-28T16:00:28.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.953+0000 7f9df1600700 1 -- 172.21.15.57:0/3523069808 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f9de8057d20 con 0x7f9df40fcd90 2024-02-28T16:00:28.947 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:00:28.947 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:00:28.947 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:00:28.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:00:28.947 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:00:28.947 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:00:28.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:00:28.947 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:00:28.947 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:00:28.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:00:28.948 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:00:28.948 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:00:28.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:00:28.948 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:00:28.948 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 14 2024-02-28T16:00:28.948 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:00:28.948 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:00:28.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.956+0000 7f9dfaa00700 1 -- 172.21.15.57:0/3523069808 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9ddc0692b0 msgr2=0x7f9ddc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:28.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.956+0000 7f9dfaa00700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9ddc0692b0 0x7f9ddc06b760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9de0004600 tx=0x7f9de000b040 comp rx=0 tx=0).stop 2024-02-28T16:00:28.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.956+0000 7f9dfaa00700 1 -- 172.21.15.57:0/3523069808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40fcd90 msgr2=0x7f9df410f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:28.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.956+0000 7f9dfaa00700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40fcd90 0x7f9df410f8e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009fd0 tx=0x7f9de8009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:28.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.956+0000 7f9dfaa00700 1 -- 172.21.15.57:0/3523069808 shutdown_connections 2024-02-28T16:00:28.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.956+0000 7f9dfaa00700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f9ddc0692b0 0x7f9ddc06b760 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.956+0000 7f9dfaa00700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40fcd90 0x7f9df410f8e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.956+0000 7f9dfaa00700 1 --2- 172.21.15.57:0/3523069808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40fdfa0 0x7f9df410fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:28.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.956+0000 7f9dfaa00700 1 -- 172.21.15.57:0/3523069808 >> 172.21.15.57:0/3523069808 conn(0x7f9df40f8470 msgr2=0x7f9df40ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:28.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.957+0000 7f9dfaa00700 1 -- 172.21.15.57:0/3523069808 shutdown_connections 2024-02-28T16:00:28.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:28.957+0000 7f9dfaa00700 1 -- 172.21.15.57:0/3523069808 wait complete. 2024-02-28T16:00:28.965 INFO:tasks.workunit.client.1.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-28T16:00:28.970 INFO:tasks.workunit.client.1.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-28T16:00:28.970 INFO:tasks.workunit.client.1.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-28T16:00:29.051 INFO:tasks.workunit.client.1.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-28T16:00:29.060 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-02-28T16:00:29.061 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-28T16:00:29.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.111+0000 7efd90e00700 1 -- 172.21.15.57:0/3944117169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd8c073af0 msgr2=0x7efd8c073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:29.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.111+0000 7efd90e00700 1 --2- 172.21.15.57:0/3944117169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd8c073af0 0x7efd8c073f60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efd78004940 tx=0x7efd78009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.113+0000 7efd90e00700 1 -- 172.21.15.57:0/3944117169 shutdown_connections 2024-02-28T16:00:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.113+0000 7efd90e00700 1 --2- 172.21.15.57:0/3944117169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd8c073af0 0x7efd8c073f60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.113+0000 7efd90e00700 1 --2- 172.21.15.57:0/3944117169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8c072890 0x7efd8c072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.113+0000 7efd90e00700 1 -- 172.21.15.57:0/3944117169 >> 172.21.15.57:0/3944117169 conn(0x7efd8c0fa920 msgr2=0x7efd8c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.113+0000 7efd90e00700 1 -- 172.21.15.57:0/3944117169 shutdown_connections 2024-02-28T16:00:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.113+0000 7efd90e00700 1 -- 172.21.15.57:0/3944117169 wait complete. 2024-02-28T16:00:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.114+0000 7efd90e00700 1 Processor -- start 2024-02-28T16:00:29.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.114+0000 7efd90e00700 1 -- start start 2024-02-28T16:00:29.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.115+0000 7efd90e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd8c072890 0x7efd8c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:29.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.115+0000 7efd90e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8c073af0 0x7efd8c06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:29.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.115+0000 7efd90e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c06fc10 con 0x7efd8c072890 2024-02-28T16:00:29.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.115+0000 7efd90e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c11dc00 con 0x7efd8c073af0 2024-02-28T16:00:29.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.115+0000 7efd89e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd8c072890 0x7efd8c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:29.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.115+0000 7efd89e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd8c072890 0x7efd8c06f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38336/0 (socket says 172.21.15.57:38336) 2024-02-28T16:00:29.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.115+0000 7efd89e00700 1 -- 172.21.15.57:0/2651682816 learned_addr learned my addr 172.21.15.57:0/2651682816 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:00:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.116+0000 7efd89400700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8c073af0 0x7efd8c06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.116+0000 7efd89e00700 1 -- 172.21.15.57:0/2651682816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8c073af0 msgr2=0x7efd8c06f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.116+0000 7efd89e00700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8c073af0 0x7efd8c06f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.116+0000 7efd89e00700 1 -- 172.21.15.57:0/2651682816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78005040 con 0x7efd8c072890 2024-02-28T16:00:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.117+0000 7efd89e00700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd8c072890 0x7efd8c06f0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efd7c002a50 tx=0x7efd7c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.117+0000 7efd82000700 1 -- 172.21.15.57:0/2651682816 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7c007cc0 con 0x7efd8c072890 2024-02-28T16:00:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.117+0000 7efd82000700 1 -- 172.21.15.57:0/2651682816 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd7c00f040 con 0x7efd8c072890 2024-02-28T16:00:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.117+0000 7efd82000700 1 -- 172.21.15.57:0/2651682816 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7c009640 con 0x7efd8c072890 2024-02-28T16:00:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.117+0000 7efd90e00700 1 -- 172.21.15.57:0/2651682816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c11dee0 con 0x7efd8c072890 2024-02-28T16:00:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.117+0000 7efd90e00700 1 -- 172.21.15.57:0/2651682816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c11e3d0 con 0x7efd8c072890 2024-02-28T16:00:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.119+0000 7efd90e00700 1 -- 172.21.15.57:0/2651682816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8c04bed0 con 0x7efd8c072890 2024-02-28T16:00:29.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.120+0000 7efd82000700 1 -- 172.21.15.57:0/2651682816 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7efd7c0097a0 con 0x7efd8c072890 2024-02-28T16:00:29.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.122+0000 7efd82000700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efd700692a0 0x7efd7006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:29.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.122+0000 7efd82000700 1 -- 172.21.15.57:0/2651682816 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7efd7c086fc0 con 0x7efd8c072890 2024-02-28T16:00:29.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.123+0000 7efd89400700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efd700692a0 0x7efd7006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:29.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.124+0000 7efd89400700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efd700692a0 0x7efd7006b750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd78004f90 tx=0x7efd78009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:29.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.130+0000 7efd82000700 1 -- 172.21.15.57:0/2651682816 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7efd7c056d00 con 0x7efd8c072890 2024-02-28T16:00:29.155 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-28T16:00:29.156 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-28T16:00:29.156 DEBUG:teuthology.orchestra.run.smithi087:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-28T16:00:29.241 INFO:tasks.workunit.client.0.smithi057.stderr:+ tar xzf ltp-full.tgz 2024-02-28T16:00:29.293 INFO:tasks.workunit.client.1.smithi087.stderr:+ mkdir -p fsstress 2024-02-28T16:00:29.299 INFO:tasks.workunit.client.1.smithi087.stderr:+ pushd fsstress 2024-02-28T16:00:29.302 INFO:tasks.workunit.client.1.smithi087.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:00:29.302 INFO:tasks.workunit.client.1.smithi087.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-28T16:00:29.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.466+0000 7efd90e00700 1 -- 172.21.15.57:0/2651682816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efd8c11e790 con 0x7efd8c072890 2024-02-28T16:00:29.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.466+0000 7efd82000700 1 -- 172.21.15.57:0/2651682816 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1825 (secure 0 0 0) 0x7efd7c056890 con 0x7efd8c072890 2024-02-28T16:00:29.460 INFO:teuthology.orchestra.run.smithi057.stdout:e14 2024-02-28T16:00:29.460 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:00:29.460 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 14 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T15:58:26.323114+0000 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:00:29.461 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:00:29.462 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:00:29.463 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:00:29.463 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:00:29.463 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:00:29.463 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:00:29.463 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:00:29.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 -- 172.21.15.57:0/2651682816 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efd700692a0 msgr2=0x7efd7006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:29.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efd700692a0 0x7efd7006b750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd78004f90 tx=0x7efd78009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:29.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 -- 172.21.15.57:0/2651682816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd8c072890 msgr2=0x7efd8c06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:29.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd8c072890 0x7efd8c06f0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efd7c002a50 tx=0x7efd7c0046b0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 -- 172.21.15.57:0/2651682816 shutdown_connections 2024-02-28T16:00:29.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7efd700692a0 0x7efd7006b750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd8c072890 0x7efd8c06f0d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 --2- 172.21.15.57:0/2651682816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8c073af0 0x7efd8c06f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 -- 172.21.15.57:0/2651682816 >> 172.21.15.57:0/2651682816 conn(0x7efd8c0fa920 msgr2=0x7efd8c109460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:29.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 -- 172.21.15.57:0/2651682816 shutdown_connections 2024-02-28T16:00:29.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.470+0000 7efd90e00700 1 -- 172.21.15.57:0/2651682816 wait complete. 2024-02-28T16:00:29.465 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-02-28T16:00:29.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.654+0000 7f4e23a00700 1 -- 172.21.15.57:0/3475014196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c102430 msgr2=0x7f4e1c104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.654+0000 7f4e23a00700 1 --2- 172.21.15.57:0/3475014196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c102430 0x7f4e1c104810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4e08004940 tx=0x7f4e08009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.654+0000 7f4e23a00700 1 -- 172.21.15.57:0/3475014196 shutdown_connections 2024-02-28T16:00:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.654+0000 7f4e23a00700 1 --2- 172.21.15.57:0/3475014196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c102430 0x7f4e1c104810 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.654+0000 7f4e23a00700 1 --2- 172.21.15.57:0/3475014196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1c0663e0 0x7f4e1c101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.654+0000 7f4e23a00700 1 -- 172.21.15.57:0/3475014196 >> 172.21.15.57:0/3475014196 conn(0x7f4e1c0f74e0 msgr2=0x7f4e1c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.655+0000 7f4e23a00700 1 -- 172.21.15.57:0/3475014196 shutdown_connections 2024-02-28T16:00:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.655+0000 7f4e23a00700 1 -- 172.21.15.57:0/3475014196 wait complete. 2024-02-28T16:00:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.655+0000 7f4e23a00700 1 Processor -- start 2024-02-28T16:00:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.656+0000 7f4e23a00700 1 -- start start 2024-02-28T16:00:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.656+0000 7f4e23a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c0663e0 0x7f4e1c10faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.656+0000 7f4e23a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1c102430 0x7f4e1c110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.656+0000 7f4e23a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c110630 con 0x7f4e1c0663e0 2024-02-28T16:00:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.656+0000 7f4e23a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c110ed0 con 0x7f4e1c102430 2024-02-28T16:00:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.656+0000 7f4e21000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c0663e0 0x7f4e1c10faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.656+0000 7f4e21000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c0663e0 0x7f4e1c10faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38360/0 (socket says 172.21.15.57:38360) 2024-02-28T16:00:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.656+0000 7f4e21000700 1 -- 172.21.15.57:0/1481084483 learned_addr learned my addr 172.21.15.57:0/1481084483 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:00:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.657+0000 7f4e1be00700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1c102430 0x7f4e1c110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.657+0000 7f4e21000700 1 -- 172.21.15.57:0/1481084483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1c102430 msgr2=0x7f4e1c110030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.657+0000 7f4e21000700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1c102430 0x7f4e1c110030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.657+0000 7f4e21000700 1 -- 172.21.15.57:0/1481084483 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08005040 con 0x7f4e1c0663e0 2024-02-28T16:00:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.657+0000 7f4e1be00700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1c102430 0x7f4e1c110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:00:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.657+0000 7f4e21000700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c0663e0 0x7f4e1c10faf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000eb40 tx=0x7f4e1000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.658+0000 7f4e18c00700 1 -- 172.21.15.57:0/1481084483 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e10007cc0 con 0x7f4e1c0663e0 2024-02-28T16:00:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.658+0000 7f4e18c00700 1 -- 172.21.15.57:0/1481084483 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e1000f040 con 0x7f4e1c0663e0 2024-02-28T16:00:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.658+0000 7f4e18c00700 1 -- 172.21.15.57:0/1481084483 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e10009620 con 0x7f4e1c0663e0 2024-02-28T16:00:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.658+0000 7f4e23a00700 1 -- 172.21.15.57:0/1481084483 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c111150 con 0x7f4e1c0663e0 2024-02-28T16:00:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.658+0000 7f4e23a00700 1 -- 172.21.15.57:0/1481084483 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c111690 con 0x7f4e1c0663e0 2024-02-28T16:00:29.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.660+0000 7f4e23a00700 1 -- 172.21.15.57:0/1481084483 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c109c50 con 0x7f4e1c0663e0 2024-02-28T16:00:29.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.661+0000 7f4e18c00700 1 -- 172.21.15.57:0/1481084483 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7f4e10009780 con 0x7f4e1c0663e0 2024-02-28T16:00:29.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.663+0000 7f4e18c00700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f4e04069360 0x7f4e0406b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.663+0000 7f4e18c00700 1 -- 172.21.15.57:0/1481084483 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4e10086d80 con 0x7f4e1c0663e0 2024-02-28T16:00:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.663+0000 7f4e1be00700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f4e04069360 0x7f4e0406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:29.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.664+0000 7f4e1be00700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f4e04069360 0x7f4e0406b810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800b0d0 tx=0x7f4e08009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.670+0000 7f4e18c00700 1 -- 172.21.15.57:0/1481084483 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4e1004dbd0 con 0x7f4e1c0663e0 2024-02-28T16:00:29.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:29 smithi057 ceph-mon[28763]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:00:29.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:29 smithi057 ceph-mon[28763]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:00:29.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:29 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3523069808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:00:29.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:29 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:29.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:29 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:00:29.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:29 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:00:29.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:29 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:00:29.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:29 smithi087 ceph-mon[37122]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:00:29.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:29 smithi087 ceph-mon[37122]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:00:29.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:29 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3523069808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:00:29.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:29 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:29.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:29 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:00:29.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:29 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:00:29.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:29 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:00:29.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.988+0000 7f4e23a00700 1 -- 172.21.15.57:0/1481084483 --> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e1c02b310 con 0x7f4e04069360 2024-02-28T16:00:29.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.990+0000 7f4e18c00700 1 -- 172.21.15.57:0/1481084483 <== mgr.14214 v2:172.21.15.57:6800/2828490283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f4e1c02b310 con 0x7f4e04069360 2024-02-28T16:00:29.983 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:00:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:00:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:00:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:00:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [], 2024-02-28T16:00:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "0/21 daemons upgraded", 2024-02-28T16:00:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T16:00:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:00:29.984 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:00:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 -- 172.21.15.57:0/1481084483 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f4e04069360 msgr2=0x7f4e0406b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f4e04069360 0x7f4e0406b810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800b0d0 tx=0x7f4e08009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 -- 172.21.15.57:0/1481084483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c0663e0 msgr2=0x7f4e1c10faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c0663e0 0x7f4e1c10faf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000eb40 tx=0x7f4e1000b040 comp rx=0 tx=0).stop 2024-02-28T16:00:29.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 -- 172.21.15.57:0/1481084483 shutdown_connections 2024-02-28T16:00:29.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f4e04069360 0x7f4e0406b810 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c0663e0 0x7f4e1c10faf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 --2- 172.21.15.57:0/1481084483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1c102430 0x7f4e1c110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:29.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 -- 172.21.15.57:0/1481084483 >> 172.21.15.57:0/1481084483 conn(0x7f4e1c0f74e0 msgr2=0x7f4e1c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 -- 172.21.15.57:0/1481084483 shutdown_connections 2024-02-28T16:00:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:29.993+0000 7f4e23a00700 1 -- 172.21.15.57:0/1481084483 wait complete. 2024-02-28T16:00:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.165+0000 7fe5d8400700 1 -- 172.21.15.57:0/3082317038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d0073af0 msgr2=0x7fe5d0073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.165+0000 7fe5d8400700 1 --2- 172.21.15.57:0/3082317038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d0073af0 0x7fe5d0073f60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc004880 tx=0x7fe5bc009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.166+0000 7fe5d8400700 1 -- 172.21.15.57:0/3082317038 shutdown_connections 2024-02-28T16:00:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.166+0000 7fe5d8400700 1 --2- 172.21.15.57:0/3082317038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d0073af0 0x7fe5d0073f60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.166+0000 7fe5d8400700 1 --2- 172.21.15.57:0/3082317038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d0072890 0x7fe5d0072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.166+0000 7fe5d8400700 1 -- 172.21.15.57:0/3082317038 >> 172.21.15.57:0/3082317038 conn(0x7fe5d00fa920 msgr2=0x7fe5d00fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.166+0000 7fe5d8400700 1 -- 172.21.15.57:0/3082317038 shutdown_connections 2024-02-28T16:00:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.166+0000 7fe5d8400700 1 -- 172.21.15.57:0/3082317038 wait complete. 2024-02-28T16:00:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.167+0000 7fe5d8400700 1 Processor -- start 2024-02-28T16:00:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.168+0000 7fe5d8400700 1 -- start start 2024-02-28T16:00:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.168+0000 7fe5d8400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d0072890 0x7fe5d0113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.168+0000 7fe5d8400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d0073af0 0x7fe5d01143b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.168+0000 7fe5d8400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d01149b0 con 0x7fe5d0072890 2024-02-28T16:00:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.168+0000 7fe5d8400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0115250 con 0x7fe5d0073af0 2024-02-28T16:00:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.168+0000 7fe5d5000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d0073af0 0x7fe5d01143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.168+0000 7fe5d5000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d0073af0 0x7fe5d01143b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:42804/0 (socket says 172.21.15.57:42804) 2024-02-28T16:00:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.168+0000 7fe5d5000700 1 -- 172.21.15.57:0/678590282 learned_addr learned my addr 172.21.15.57:0/678590282 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:00:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.168+0000 7fe5d5a00700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d0072890 0x7fe5d0113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:30.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.169+0000 7fe5d5000700 1 -- 172.21.15.57:0/678590282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d0072890 msgr2=0x7fe5d0113e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.169+0000 7fe5d5000700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d0072890 0x7fe5d0113e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.169+0000 7fe5d5000700 1 -- 172.21.15.57:0/678590282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc005040 con 0x7fe5d0073af0 2024-02-28T16:00:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.169+0000 7fe5d5000700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d0073af0 0x7fe5d01143b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc008f80 tx=0x7fe5bc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.170+0000 7fe5cd600700 1 -- 172.21.15.57:0/678590282 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5bc00e030 con 0x7fe5d0073af0 2024-02-28T16:00:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.170+0000 7fe5cd600700 1 -- 172.21.15.57:0/678590282 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5bc013b70 con 0x7fe5d0073af0 2024-02-28T16:00:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.170+0000 7fe5cd600700 1 -- 172.21.15.57:0/678590282 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5bc0123c0 con 0x7fe5d0073af0 2024-02-28T16:00:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.170+0000 7fe5d8400700 1 -- 172.21.15.57:0/678590282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d01154d0 con 0x7fe5d0073af0 2024-02-28T16:00:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.170+0000 7fe5d8400700 1 -- 172.21.15.57:0/678590282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d0115a10 con 0x7fe5d0073af0 2024-02-28T16:00:30.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.171+0000 7fe5d8400700 1 -- 172.21.15.57:0/678590282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d004bed0 con 0x7fe5d0073af0 2024-02-28T16:00:30.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.173+0000 7fe5cd600700 1 -- 172.21.15.57:0/678590282 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 86621+0+0 (secure 0 0 0) 0x7fe5bc013ce0 con 0x7fe5d0073af0 2024-02-28T16:00:30.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.174+0000 7fe5cd600700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5b80692b0 0x7fe5b806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:00:30.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.174+0000 7fe5cd600700 1 -- 172.21.15.57:0/678590282 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe5bc088c60 con 0x7fe5d0073af0 2024-02-28T16:00:30.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.174+0000 7fe5d5a00700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5b80692b0 0x7fe5b806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:00:30.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.176+0000 7fe5d5a00700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5b80692b0 0x7fe5b806b760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40046c0 tx=0x7fe5c400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:00:30.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.180+0000 7fe5cd600700 1 -- 172.21.15.57:0/678590282 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe5bc058a00 con 0x7fe5d0073af0 2024-02-28T16:00:30.262 INFO:tasks.workunit.client.1.smithi087.stderr:+ tar xzf ltp-full.tgz 2024-02-28T16:00:30.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.611+0000 7fe5d8400700 1 -- 172.21.15.57:0/678590282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe5d004bed0 con 0x7fe5d0073af0 2024-02-28T16:00:30.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.612+0000 7fe5cd600700 1 -- 172.21.15.57:0/678590282 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe5bc058590 con 0x7fe5d0073af0 2024-02-28T16:00:30.605 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:00:30.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.615+0000 7fe5d8400700 1 -- 172.21.15.57:0/678590282 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5b80692b0 msgr2=0x7fe5b806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:30.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.615+0000 7fe5d8400700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5b80692b0 0x7fe5b806b760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40046c0 tx=0x7fe5c400b040 comp rx=0 tx=0).stop 2024-02-28T16:00:30.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.615+0000 7fe5d8400700 1 -- 172.21.15.57:0/678590282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d0073af0 msgr2=0x7fe5d01143b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:00:30.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.615+0000 7fe5d8400700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d0073af0 0x7fe5d01143b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc008f80 tx=0x7fe5bc009e30 comp rx=0 tx=0).stop 2024-02-28T16:00:30.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.616+0000 7fe5d8400700 1 -- 172.21.15.57:0/678590282 shutdown_connections 2024-02-28T16:00:30.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.616+0000 7fe5d8400700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7fe5b80692b0 0x7fe5b806b760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:30.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.616+0000 7fe5d8400700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d0072890 0x7fe5d0113e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:30.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.616+0000 7fe5d8400700 1 --2- 172.21.15.57:0/678590282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d0073af0 0x7fe5d01143b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:00:30.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.616+0000 7fe5d8400700 1 -- 172.21.15.57:0/678590282 >> 172.21.15.57:0/678590282 conn(0x7fe5d00fa920 msgr2=0x7fe5d01093f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:00:30.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.616+0000 7fe5d8400700 1 -- 172.21.15.57:0/678590282 shutdown_connections 2024-02-28T16:00:30.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:00:30.616+0000 7fe5d8400700 1 -- 172.21.15.57:0/678590282 wait complete. 2024-02-28T16:00:30.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:30 smithi057 ceph-mon[28763]: Upgrade: Updating mgr.smithi087.ewrszc 2024-02-28T16:00:30.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:30 smithi057 ceph-mon[28763]: Deploying daemon mgr.smithi087.ewrszc on smithi087 2024-02-28T16:00:30.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:30 smithi057 ceph-mon[28763]: pgmap v293: 65 pgs: 65 active+clean; 598 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 853 B/s wr, 4 op/s 2024-02-28T16:00:30.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:30 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2651682816' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:00:30.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:30 smithi087 ceph-mon[37122]: Upgrade: Updating mgr.smithi087.ewrszc 2024-02-28T16:00:30.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:30 smithi087 ceph-mon[37122]: Deploying daemon mgr.smithi087.ewrszc on smithi087 2024-02-28T16:00:30.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:30 smithi087 ceph-mon[37122]: pgmap v293: 65 pgs: 65 active+clean; 598 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 853 B/s wr, 4 op/s 2024-02-28T16:00:30.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:30 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2651682816' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:00:31.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:31 smithi057 ceph-mon[28763]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:00:31.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:31 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/678590282' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:00:31.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:31 smithi087 ceph-mon[37122]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:00:31.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:31 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/678590282' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:00:32.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:32 smithi087 ceph-mon[37122]: pgmap v294: 65 pgs: 65 active+clean; 4.8 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 366 KiB/s wr, 7 op/s 2024-02-28T16:00:32.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:32 smithi057 ceph-mon[28763]: pgmap v294: 65 pgs: 65 active+clean; 4.8 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 366 KiB/s wr, 7 op/s 2024-02-28T16:00:34.562 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:34 smithi087 ceph-mon[37122]: pgmap v295: 65 pgs: 65 active+clean; 12 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 989 KiB/s wr, 22 op/s 2024-02-28T16:00:34.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:34 smithi057 ceph-mon[28763]: pgmap v295: 65 pgs: 65 active+clean; 12 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 989 KiB/s wr, 22 op/s 2024-02-28T16:00:35.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:35 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:35.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:35 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:35.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:35 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:00:35.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:35 smithi087 ceph-mon[37122]: pgmap v296: 65 pgs: 65 active+clean; 27 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-02-28T16:00:35.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:35 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:35.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:35 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:36.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:35 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:36.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:35 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:36.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:35 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:00:36.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:35 smithi057 ceph-mon[28763]: pgmap v296: 65 pgs: 65 active+clean; 27 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-02-28T16:00:36.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:35 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:36.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:35 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:37.433 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:37 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:00:37.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:37 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:00:38.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:38 smithi087 ceph-mon[37122]: pgmap v297: 65 pgs: 65 active+clean; 28 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 2.4 MiB/s wr, 120 op/s 2024-02-28T16:00:38.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:38 smithi057 ceph-mon[28763]: pgmap v297: 65 pgs: 65 active+clean; 28 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 2.4 MiB/s wr, 120 op/s 2024-02-28T16:00:40.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:40 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:00:40.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:40 smithi087 ceph-mon[37122]: pgmap v298: 65 pgs: 65 active+clean; 32 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s rd, 2.7 MiB/s wr, 174 op/s 2024-02-28T16:00:40.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:40 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:40.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:40 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:40.480 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:40 smithi057 ceph-mon[28763]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:00:40.480 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:40 smithi057 ceph-mon[28763]: pgmap v298: 65 pgs: 65 active+clean; 32 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s rd, 2.7 MiB/s wr, 174 op/s 2024-02-28T16:00:40.480 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:40 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:40.480 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:40 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:42.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:42 smithi057 ceph-mon[28763]: pgmap v299: 65 pgs: 65 active+clean; 33 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 2.8 MiB/s wr, 200 op/s 2024-02-28T16:00:42.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:42.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:42 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:42.826 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:42 smithi087 ceph-mon[37122]: pgmap v299: 65 pgs: 65 active+clean; 33 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 2.8 MiB/s wr, 200 op/s 2024-02-28T16:00:42.827 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:42.827 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:42 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:00:44.792 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:44 smithi087 ceph-mon[37122]: pgmap v300: 65 pgs: 65 active+clean; 38 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 689 KiB/s rd, 2.9 MiB/s wr, 228 op/s 2024-02-28T16:00:44.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:44 smithi057 ceph-mon[28763]: pgmap v300: 65 pgs: 65 active+clean; 38 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 689 KiB/s rd, 2.9 MiB/s wr, 228 op/s 2024-02-28T16:00:46.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:46 smithi087 ceph-mon[37122]: pgmap v301: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 288 op/s 2024-02-28T16:00:46.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:46 smithi057 ceph-mon[28763]: pgmap v301: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 288 op/s 2024-02-28T16:00:47.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:47 smithi087 ceph-mon[37122]: Standby manager daemon smithi087.ewrszc restarted 2024-02-28T16:00:47.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:47 smithi087 ceph-mon[37122]: Standby manager daemon smithi087.ewrszc started 2024-02-28T16:00:47.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:47 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/crt"}]: dispatch 2024-02-28T16:00:47.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:47 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:00:47.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:47 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/key"}]: dispatch 2024-02-28T16:00:47.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:47 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:00:47.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:47 smithi057 ceph-mon[28763]: Standby manager daemon smithi087.ewrszc restarted 2024-02-28T16:00:47.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:47 smithi057 ceph-mon[28763]: Standby manager daemon smithi087.ewrszc started 2024-02-28T16:00:47.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:47 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/crt"}]: dispatch 2024-02-28T16:00:47.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:47 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:00:47.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:47 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/key"}]: dispatch 2024-02-28T16:00:47.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:47 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:00:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:48 smithi057 ceph-mon[28763]: mgrmap e20: smithi057.upqerc(active, since 8m), standbys: smithi087.ewrszc 2024-02-28T16:00:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:48 smithi057 ceph-mon[28763]: pgmap v302: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2024-02-28T16:00:48.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:48 smithi087 ceph-mon[37122]: mgrmap e20: smithi057.upqerc(active, since 8m), standbys: smithi087.ewrszc 2024-02-28T16:00:48.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:48 smithi087 ceph-mon[37122]: pgmap v302: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2024-02-28T16:00:50.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:50 smithi057 ceph-mon[28763]: pgmap v303: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 294 op/s 2024-02-28T16:00:50.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:50 smithi087 ceph-mon[37122]: pgmap v303: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 294 op/s 2024-02-28T16:00:51.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:51 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:00:51.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:51 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:00:52.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:52 smithi087 ceph-mon[37122]: pgmap v304: 65 pgs: 65 active+clean; 59 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 271 op/s 2024-02-28T16:00:52.856 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:52 smithi057 ceph-mon[28763]: pgmap v304: 65 pgs: 65 active+clean; 59 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 271 op/s 2024-02-28T16:00:54.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:54 smithi087 ceph-mon[37122]: pgmap v305: 65 pgs: 65 active+clean; 62 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 269 op/s 2024-02-28T16:00:54.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:54 smithi057 ceph-mon[28763]: pgmap v305: 65 pgs: 65 active+clean; 62 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 269 op/s 2024-02-28T16:00:56.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:56 smithi087 ceph-mon[37122]: pgmap v306: 65 pgs: 65 active+clean; 72 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 308 op/s 2024-02-28T16:00:56.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:56 smithi057 ceph-mon[28763]: pgmap v306: 65 pgs: 65 active+clean; 72 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 308 op/s 2024-02-28T16:00:58.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:00:58 smithi057 ceph-mon[28763]: pgmap v307: 65 pgs: 65 active+clean; 77 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 273 op/s 2024-02-28T16:00:58.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:00:58 smithi087 ceph-mon[37122]: pgmap v307: 65 pgs: 65 active+clean; 77 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 273 op/s 2024-02-28T16:01:00.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:00 smithi057 ceph-mon[28763]: pgmap v308: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 287 op/s 2024-02-28T16:01:00.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:00 smithi087 ceph-mon[37122]: pgmap v308: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 287 op/s 2024-02-28T16:01:00.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.842+0000 7f798e600700 1 -- 172.21.15.57:0/3715729176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79880fcef0 msgr2=0x7f79880fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:00.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.842+0000 7f798e600700 1 --2- 172.21.15.57:0/3715729176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79880fcef0 0x7f79880fd320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7978004940 tx=0x7f7978009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:00.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.842+0000 7f798e600700 1 -- 172.21.15.57:0/3715729176 shutdown_connections 2024-02-28T16:01:00.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.842+0000 7f798e600700 1 --2- 172.21.15.57:0/3715729176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79880fe0e0 0x7f79880fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:00.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.842+0000 7f798e600700 1 --2- 172.21.15.57:0/3715729176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79880fcef0 0x7f79880fd320 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:00.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.842+0000 7f798e600700 1 -- 172.21.15.57:0/3715729176 >> 172.21.15.57:0/3715729176 conn(0x7f79880f8620 msgr2=0x7f79880faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:00.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.842+0000 7f798e600700 1 -- 172.21.15.57:0/3715729176 shutdown_connections 2024-02-28T16:01:00.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.843+0000 7f798e600700 1 -- 172.21.15.57:0/3715729176 wait complete. 2024-02-28T16:01:00.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.844+0000 7f798e600700 1 Processor -- start 2024-02-28T16:01:00.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.844+0000 7f798e600700 1 -- start start 2024-02-28T16:01:00.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.845+0000 7f798e600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79880fcef0 0x7f798810b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:00.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.845+0000 7f798e600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79880fe0e0 0x7f798810bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:00.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.845+0000 7f798e600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798810c360 con 0x7f79880fcef0 2024-02-28T16:01:00.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.845+0000 7f798e600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798810cc00 con 0x7f79880fe0e0 2024-02-28T16:01:00.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.845+0000 7f7986a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79880fe0e0 0x7f798810bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:00.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.845+0000 7f7986a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79880fe0e0 0x7f798810bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:46294/0 (socket says 172.21.15.57:46294) 2024-02-28T16:01:00.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.845+0000 7f7986a00700 1 -- 172.21.15.57:0/4196503805 learned_addr learned my addr 172.21.15.57:0/4196503805 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:00.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.846+0000 7f7987400700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79880fcef0 0x7f798810b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:00.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.846+0000 7f7986a00700 1 -- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79880fcef0 msgr2=0x7f798810b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:00.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.846+0000 7f7986a00700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79880fcef0 0x7f798810b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:00.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.846+0000 7f7986a00700 1 -- 172.21.15.57:0/4196503805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978005040 con 0x7f79880fe0e0 2024-02-28T16:01:00.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.846+0000 7f7987400700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79880fcef0 0x7f798810b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:01:00.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.846+0000 7f7986a00700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79880fe0e0 0x7f798810bd10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7974002a50 tx=0x7f79740046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:00.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.847+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7974007cc0 con 0x7f79880fe0e0 2024-02-28T16:01:00.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.847+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f797400f040 con 0x7f79880fe0e0 2024-02-28T16:01:00.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.847+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7974009540 con 0x7f79880fe0e0 2024-02-28T16:01:00.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.848+0000 7f798e600700 1 -- 172.21.15.57:0/4196503805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798810cee0 con 0x7f79880fe0e0 2024-02-28T16:01:00.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.848+0000 7f798e600700 1 -- 172.21.15.57:0/4196503805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798810d3d0 con 0x7f79880fe0e0 2024-02-28T16:01:00.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.850+0000 7f798e600700 1 -- 172.21.15.57:0/4196503805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798804bed0 con 0x7f79880fe0e0 2024-02-28T16:01:00.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.851+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 20) v1 ==== 88910+0+0 (secure 0 0 0) 0x7f79740096a0 con 0x7f79880fe0e0 2024-02-28T16:01:00.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.852+0000 7f797f400700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f796c06b220 0x7f796c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:00.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.852+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7974089290 con 0x7f79880fe0e0 2024-02-28T16:01:00.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.853+0000 7f7987400700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f796c06b220 0x7f796c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:00.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.854+0000 7f7987400700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f796c06b220 0x7f796c06d6d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7978000c00 tx=0x7f7978009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:00.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.860+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f79740554a0 con 0x7f79880fe0e0 2024-02-28T16:01:00.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.972+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 21) v1 ==== 45451+0+0 (secure 0 0 0) 0x7f7974055870 con 0x7f79880fe0e0 2024-02-28T16:01:00.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.972+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f796c06b220 msgr2=0x7f796c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:00.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:00.972+0000 7f797f400700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f796c06b220 0x7f796c06d6d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7978000c00 tx=0x7f7978009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:01.942 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:01:01.942 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:01:01.942 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:01:01.942 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:01:01.942 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:01:01.942 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:01:01.942 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr fail", "who": "smithi057.upqerc"}]: dispatch 2024-02-28T16:01:01.942 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: osdmap e47: 6 total, 6 up, 6 in 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "mgr fail", "who": "smithi057.upqerc"}]': finished 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: mgrmap e21: smithi087.ewrszc(active, starting, since 0.0131803s) 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mgr metadata", "who": "smithi087.ewrszc", "id": "smithi087.ewrszc"}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:01:01.943 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: Manager daemon smithi087.ewrszc is now available 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.ewrszc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.ewrszc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.ewrszc/trash_purge_schedule"}]: dispatch 2024-02-28T16:01:01.944 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.ewrszc/trash_purge_schedule"}]: dispatch 2024-02-28T16:01:01.945 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:01 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr fail", "who": "smithi057.upqerc"}]: dispatch 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:01:01.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: osdmap e47: 6 total, 6 up, 6 in 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.14214 172.21.15.57:0/500322086' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "mgr fail", "who": "smithi057.upqerc"}]': finished 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: mgrmap e21: smithi087.ewrszc(active, starting, since 0.0131803s) 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mgr metadata", "who": "smithi087.ewrszc", "id": "smithi087.ewrszc"}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:01:01.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:01:01.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: Manager daemon smithi087.ewrszc is now available 2024-02-28T16:01:01.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:01.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:01:01.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:01:01.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:01:01.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.ewrszc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:01:01.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.ewrszc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:01:01.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.ewrszc/trash_purge_schedule"}]: dispatch 2024-02-28T16:01:01.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.ewrszc/trash_purge_schedule"}]: dispatch 2024-02-28T16:01:01.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:01 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:01.977+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 <== mon.1 v2:172.21.15.87:3300/0 8 ==== mgrmap(e 22) v1 ==== 45578+0+0 (secure 0 0 0) 0x7f7974045850 con 0x7f79880fe0e0 2024-02-28T16:01:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:01.977+0000 7f797f400700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f796c005d10 0x7f796c034370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:01.977+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f796c032260 con 0x7f796c005d10 2024-02-28T16:01:01.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:01.989+0000 7f7987400700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f796c005d10 0x7f796c034370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:01.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:01.994+0000 7f7987400700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f796c005d10 0x7f796c034370 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7978000c00 tx=0x7f7978009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:01.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:01.998+0000 7f797f400700 1 -- 172.21.15.57:0/4196503805 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f796c032260 con 0x7f796c005d10 2024-02-28T16:01:01.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.003+0000 7f798e600700 1 -- 172.21.15.57:0/4196503805 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f796c005d10 msgr2=0x7f796c034370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:01.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.003+0000 7f798e600700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f796c005d10 0x7f796c034370 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7978000c00 tx=0x7f7978009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:01.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.003+0000 7f798e600700 1 -- 172.21.15.57:0/4196503805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79880fe0e0 msgr2=0x7f798810bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:01.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.003+0000 7f798e600700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79880fe0e0 0x7f798810bd10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7974002a50 tx=0x7f79740046b0 comp rx=0 tx=0).stop 2024-02-28T16:01:01.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.003+0000 7f798e600700 1 -- 172.21.15.57:0/4196503805 shutdown_connections 2024-02-28T16:01:01.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.003+0000 7f798e600700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f796c005d10 0x7f796c034370 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:01.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.003+0000 7f798e600700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:6800/2828490283,v1:172.21.15.57:6801/2828490283] conn(0x7f796c06b220 0x7f796c06d6d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:01.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.003+0000 7f798e600700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79880fcef0 0x7f798810b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:01.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.003+0000 7f798e600700 1 --2- 172.21.15.57:0/4196503805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79880fe0e0 0x7f798810bd10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:01.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.003+0000 7f798e600700 1 -- 172.21.15.57:0/4196503805 >> 172.21.15.57:0/4196503805 conn(0x7f79880f8620 msgr2=0x7f79880ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:01.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.004+0000 7f798e600700 1 -- 172.21.15.57:0/4196503805 shutdown_connections 2024-02-28T16:01:01.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.006+0000 7f798e600700 1 -- 172.21.15.57:0/4196503805 wait complete. 2024-02-28T16:01:02.023 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:01:02.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.206+0000 7fe2b1800700 1 -- 172.21.15.57:0/590789422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2ac0708c0 msgr2=0x7fe2ac070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.206+0000 7fe2b1800700 1 --2- 172.21.15.57:0/590789422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2ac0708c0 0x7fe2ac070d10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe294004940 tx=0x7fe294009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.206+0000 7fe2b1800700 1 -- 172.21.15.57:0/590789422 shutdown_connections 2024-02-28T16:01:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.206+0000 7fe2b1800700 1 --2- 172.21.15.57:0/590789422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2ac0708c0 0x7fe2ac070d10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.206+0000 7fe2b1800700 1 --2- 172.21.15.57:0/590789422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2ac071f10 0x7fe2ac070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.206+0000 7fe2b1800700 1 -- 172.21.15.57:0/590789422 >> 172.21.15.57:0/590789422 conn(0x7fe2ac0f8620 msgr2=0x7fe2ac0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.207+0000 7fe2b1800700 1 -- 172.21.15.57:0/590789422 shutdown_connections 2024-02-28T16:01:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.207+0000 7fe2b1800700 1 -- 172.21.15.57:0/590789422 wait complete. 2024-02-28T16:01:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.208+0000 7fe2b1800700 1 Processor -- start 2024-02-28T16:01:02.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.208+0000 7fe2b1800700 1 -- start start 2024-02-28T16:01:02.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.209+0000 7fe2b1800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2ac0708c0 0x7fe2ac10fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:02.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.209+0000 7fe2b1800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2ac071f10 0x7fe2ac1100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:02.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.209+0000 7fe2b1800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac1106b0 con 0x7fe2ac0708c0 2024-02-28T16:01:02.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.209+0000 7fe2b1800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac110f50 con 0x7fe2ac071f10 2024-02-28T16:01:02.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.210+0000 7fe2aaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2ac0708c0 0x7fe2ac10fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:02.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.210+0000 7fe2aaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2ac0708c0 0x7fe2ac10fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46416/0 (socket says 172.21.15.57:46416) 2024-02-28T16:01:02.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.210+0000 7fe2aaa00700 1 -- 172.21.15.57:0/4254708299 learned_addr learned my addr 172.21.15.57:0/4254708299 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:02.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.211+0000 7fe2aaa00700 1 -- 172.21.15.57:0/4254708299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2ac071f10 msgr2=0x7fe2ac1100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:02.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.211+0000 7fe2aaa00700 1 --2- 172.21.15.57:0/4254708299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2ac071f10 0x7fe2ac1100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:02.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.211+0000 7fe2aaa00700 1 -- 172.21.15.57:0/4254708299 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe294005040 con 0x7fe2ac0708c0 2024-02-28T16:01:02.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.212+0000 7fe2aaa00700 1 --2- 172.21.15.57:0/4254708299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2ac0708c0 0x7fe2ac10fb70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400c8c0 tx=0x7fe2a40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:02.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.212+0000 7fe2a2a00700 1 -- 172.21.15.57:0/4254708299 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2a400a980 con 0x7fe2ac0708c0 2024-02-28T16:01:02.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.213+0000 7fe2a2a00700 1 -- 172.21.15.57:0/4254708299 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe2a400ce60 con 0x7fe2ac0708c0 2024-02-28T16:01:02.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.213+0000 7fe2a2a00700 1 -- 172.21.15.57:0/4254708299 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2a40113a0 con 0x7fe2ac0708c0 2024-02-28T16:01:02.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.213+0000 7fe2b1800700 1 -- 172.21.15.57:0/4254708299 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ac1111d0 con 0x7fe2ac0708c0 2024-02-28T16:01:02.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.213+0000 7fe2b1800700 1 -- 172.21.15.57:0/4254708299 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac111710 con 0x7fe2ac0708c0 2024-02-28T16:01:02.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.216+0000 7fe2b1800700 1 -- 172.21.15.57:0/4254708299 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac04bed0 con 0x7fe2ac0708c0 2024-02-28T16:01:02.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.218+0000 7fe2a2a00700 1 -- 172.21.15.57:0/4254708299 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 22) v1 ==== 45578+0+0 (secure 0 0 0) 0x7fe2a4012850 con 0x7fe2ac0708c0 2024-02-28T16:01:02.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.219+0000 7fe2a2a00700 1 --2- 172.21.15.57:0/4254708299 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe2900386a0 0x7fe29003ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:02.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.219+0000 7fe2a2a00700 1 -- 172.21.15.57:0/4254708299 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe2a404bf40 con 0x7fe2ac0708c0 2024-02-28T16:01:02.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.220+0000 7fe2aa000700 1 --2- 172.21.15.57:0/4254708299 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe2900386a0 0x7fe29003ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:02.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.221+0000 7fe2aa000700 1 --2- 172.21.15.57:0/4254708299 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe2900386a0 0x7fe29003ab50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe294004f90 tx=0x7fe294009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:02.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.225+0000 7fe2a2a00700 1 -- 172.21.15.57:0/4254708299 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe2a4012400 con 0x7fe2ac0708c0 2024-02-28T16:01:02.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.568+0000 7fe2b1800700 1 -- 172.21.15.57:0/4254708299 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2ac1044f0 con 0x7fe2900386a0 2024-02-28T16:01:02.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.571+0000 7fe2a2a00700 1 -- 172.21.15.57:0/4254708299 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fe2ac1044f0 con 0x7fe2900386a0 2024-02-28T16:01:02.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.574+0000 7fe2b1800700 1 -- 172.21.15.57:0/4254708299 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe2900386a0 msgr2=0x7fe29003ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:02.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.574+0000 7fe2b1800700 1 --2- 172.21.15.57:0/4254708299 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe2900386a0 0x7fe29003ab50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe294004f90 tx=0x7fe294009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:02.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.574+0000 7fe2b1800700 1 -- 172.21.15.57:0/4254708299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2ac0708c0 msgr2=0x7fe2ac10fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:02.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.574+0000 7fe2b1800700 1 --2- 172.21.15.57:0/4254708299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2ac0708c0 0x7fe2ac10fb70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400c8c0 tx=0x7fe2a40044c0 comp rx=0 tx=0).stop 2024-02-28T16:01:02.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.574+0000 7fe2b1800700 1 -- 172.21.15.57:0/4254708299 shutdown_connections 2024-02-28T16:01:02.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.574+0000 7fe2b1800700 1 --2- 172.21.15.57:0/4254708299 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe2900386a0 0x7fe29003ab50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:02.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.574+0000 7fe2b1800700 1 --2- 172.21.15.57:0/4254708299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2ac0708c0 0x7fe2ac10fb70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:02.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.574+0000 7fe2b1800700 1 --2- 172.21.15.57:0/4254708299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2ac071f10 0x7fe2ac1100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:02.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.574+0000 7fe2b1800700 1 -- 172.21.15.57:0/4254708299 >> 172.21.15.57:0/4254708299 conn(0x7fe2ac0f8620 msgr2=0x7fe2ac102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:02.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.575+0000 7fe2b1800700 1 -- 172.21.15.57:0/4254708299 shutdown_connections 2024-02-28T16:01:02.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.575+0000 7fe2b1800700 1 -- 172.21.15.57:0/4254708299 wait complete. 2024-02-28T16:01:02.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.758+0000 7f29a1600700 1 -- 172.21.15.57:0/3246415829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f299c0fcef0 msgr2=0x7f299c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:02.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.758+0000 7f29a1600700 1 --2- 172.21.15.57:0/3246415829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f299c0fcef0 0x7f299c0fd320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f298c004940 tx=0x7f298c009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:02.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.758+0000 7f29a1600700 1 -- 172.21.15.57:0/3246415829 shutdown_connections 2024-02-28T16:01:02.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.758+0000 7f29a1600700 1 --2- 172.21.15.57:0/3246415829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f299c0fe0e0 0x7f299c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:02.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.758+0000 7f29a1600700 1 --2- 172.21.15.57:0/3246415829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f299c0fcef0 0x7f299c0fd320 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:02.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.758+0000 7f29a1600700 1 -- 172.21.15.57:0/3246415829 >> 172.21.15.57:0/3246415829 conn(0x7f299c0f8620 msgr2=0x7f299c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:02.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.758+0000 7f29a1600700 1 -- 172.21.15.57:0/3246415829 shutdown_connections 2024-02-28T16:01:02.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.759+0000 7f29a1600700 1 -- 172.21.15.57:0/3246415829 wait complete. 2024-02-28T16:01:02.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.759+0000 7f29a1600700 1 Processor -- start 2024-02-28T16:01:02.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.760+0000 7f29a1600700 1 -- start start 2024-02-28T16:01:02.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.760+0000 7f29a1600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f299c0fcef0 0x7f299c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:02.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.760+0000 7f29a1600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f299c0fe0e0 0x7f299c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:02.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.760+0000 7f29a1600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0708e0 con 0x7f299c0fe0e0 2024-02-28T16:01:02.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.760+0000 7f29a1600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c070a50 con 0x7f299c0fcef0 2024-02-28T16:01:02.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.761+0000 7f299a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f299c0fe0e0 0x7f299c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:02.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.761+0000 7f299a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f299c0fe0e0 0x7f299c0702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46430/0 (socket says 172.21.15.57:46430) 2024-02-28T16:01:02.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.761+0000 7f299a000700 1 -- 172.21.15.57:0/4247929874 learned_addr learned my addr 172.21.15.57:0/4247929874 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:02.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.761+0000 7f299aa00700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f299c0fcef0 0x7f299c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:02.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.761+0000 7f299a000700 1 -- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f299c0fcef0 msgr2=0x7f299c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:02.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.761+0000 7f299a000700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f299c0fcef0 0x7f299c071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:02.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.761+0000 7f299a000700 1 -- 172.21.15.57:0/4247929874 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c005040 con 0x7f299c0fe0e0 2024-02-28T16:01:02.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.761+0000 7f299aa00700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f299c0fcef0 0x7f299c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:01:02.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.762+0000 7f299a000700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f299c0fe0e0 0x7f299c0702e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f298800c830 tx=0x7f2988004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:02.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.763+0000 7f2992a00700 1 -- 172.21.15.57:0/4247929874 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29880106f0 con 0x7f299c0fe0e0 2024-02-28T16:01:02.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.763+0000 7f2992a00700 1 -- 172.21.15.57:0/4247929874 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2988010d20 con 0x7f299c0fe0e0 2024-02-28T16:01:02.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.763+0000 7f2992a00700 1 -- 172.21.15.57:0/4247929874 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29880113a0 con 0x7f299c0fe0e0 2024-02-28T16:01:02.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.763+0000 7f29a1600700 1 -- 172.21.15.57:0/4247929874 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c070d30 con 0x7f299c0fe0e0 2024-02-28T16:01:02.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.763+0000 7f29a1600700 1 -- 172.21.15.57:0/4247929874 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c1159a0 con 0x7f299c0fe0e0 2024-02-28T16:01:02.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.764+0000 7f29a1600700 1 -- 172.21.15.57:0/4247929874 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c04bed0 con 0x7f299c0fe0e0 2024-02-28T16:01:02.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.765+0000 7f2992a00700 1 -- 172.21.15.57:0/4247929874 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 22) v1 ==== 45578+0+0 (secure 0 0 0) 0x7f2988012400 con 0x7f299c0fe0e0 2024-02-28T16:01:02.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.765+0000 7f2992a00700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f29800386e0 0x7f298003ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:02.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.765+0000 7f2992a00700 1 -- 172.21.15.57:0/4247929874 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f298804be10 con 0x7f299c0fe0e0 2024-02-28T16:01:02.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.767+0000 7f299aa00700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f29800386e0 0x7f298003ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:02.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.768+0000 7f299aa00700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f29800386e0 0x7f298003ab90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f299c071bf0 tx=0x7f298c009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:02.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.772+0000 7f2992a00700 1 -- 172.21.15.57:0/4247929874 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f298800a8e0 con 0x7f299c0fe0e0 2024-02-28T16:01:02.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:02 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:02.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:02 smithi057 ceph-mon[28763]: mgrmap e22: smithi087.ewrszc(active, since 1.0132s) 2024-02-28T16:01:02.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:02 smithi057 ceph-mon[28763]: [28/Feb/2024:16:01:02] ENGINE Bus STARTING 2024-02-28T16:01:02.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:02 smithi057 ceph-mon[28763]: Deploying cephadm binary to smithi087 2024-02-28T16:01:02.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:02 smithi057 ceph-mon[28763]: Deploying cephadm binary to smithi057 2024-02-28T16:01:02.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:02 smithi057 ceph-mon[28763]: [28/Feb/2024:16:01:02] ENGINE Serving on http://172.21.15.87:8765 2024-02-28T16:01:02.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:02 smithi057 ceph-mon[28763]: [28/Feb/2024:16:01:02] ENGINE Serving on https://172.21.15.87:7150 2024-02-28T16:01:02.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:02 smithi057 ceph-mon[28763]: [28/Feb/2024:16:01:02] ENGINE Bus STARTED 2024-02-28T16:01:02.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:02 smithi057 ceph-mon[28763]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:02.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:02 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:02.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:02 smithi087 ceph-mon[37122]: mgrmap e22: smithi087.ewrszc(active, since 1.0132s) 2024-02-28T16:01:02.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:02 smithi087 ceph-mon[37122]: [28/Feb/2024:16:01:02] ENGINE Bus STARTING 2024-02-28T16:01:02.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:02 smithi087 ceph-mon[37122]: Deploying cephadm binary to smithi087 2024-02-28T16:01:02.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:02 smithi087 ceph-mon[37122]: Deploying cephadm binary to smithi057 2024-02-28T16:01:02.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:02 smithi087 ceph-mon[37122]: [28/Feb/2024:16:01:02] ENGINE Serving on http://172.21.15.87:8765 2024-02-28T16:01:02.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:02 smithi087 ceph-mon[37122]: [28/Feb/2024:16:01:02] ENGINE Serving on https://172.21.15.87:7150 2024-02-28T16:01:02.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:02 smithi087 ceph-mon[37122]: [28/Feb/2024:16:01:02] ENGINE Bus STARTED 2024-02-28T16:01:02.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:02 smithi087 ceph-mon[37122]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:02.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:02.985+0000 7f2992a00700 1 -- 172.21.15.57:0/4247929874 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 23) v1 ==== 45872+0+0 (secure 0 0 0) 0x7f29880115f0 con 0x7f299c0fe0e0 2024-02-28T16:01:03.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.163+0000 7f29a1600700 1 -- 172.21.15.57:0/4247929874 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f299c102ac0 con 0x7f29800386e0 2024-02-28T16:01:03.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.190+0000 7f2992a00700 1 -- 172.21.15.57:0/4247929874 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f299c102ac0 con 0x7f29800386e0 2024-02-28T16:01:03.182 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:01:03.182 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (8m) 2m ago 10m 13.5M - 0.25.0 c8568f914cd2 64bbae049744 2024-02-28T16:01:03.182 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (10m) 2m ago 10m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T16:01:03.182 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (8m) 23s ago 8m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T16:01:03.182 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (7m) 2m ago 9m 75.1M - 9.4.7 954c08fa6188 60cd69b6a8d5 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (2m) 2m ago 2m 13.3M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (2m) 2m ago 2m 12.0M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (2m) 23s ago 2m 17.0M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (2m) 23s ago 2m 17.3M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:9283 running (11m) 2m ago 11m 481M - 17.2.7-535-gc0f02e60 1c37ed371348 2db340312662 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283 running (29s) 23s ago 8m 52.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 83ce464fbb4f 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (11m) 2m ago 12m 41.4M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (8m) 23s ago 8m 34.4M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (10m) 2m ago 10m 8024k - 1.5.0 0da6a335fe13 a721184edf00 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (8m) 23s ago 8m 7902k - 1.5.0 0da6a335fe13 f91fe90e3547 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (7m) 2m ago 7m 45.2M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (7m) 2m ago 7m 45.5M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (6m) 2m ago 6m 43.8M 4290M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (5m) 23s ago 5m 56.5M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:01:03.183 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (5m) 23s ago 5m 58.3M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:01:03.184 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (4m) 23s ago 4m 54.7M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:01:03.184 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (7m) 2m ago 9m 45.0M - 2.43.0 a07b618ecd1d 2e0885a51c9e 2024-02-28T16:01:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.194+0000 7f29a1600700 1 -- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f29800386e0 msgr2=0x7f298003ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.194+0000 7f29a1600700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f29800386e0 0x7f298003ab90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f299c071bf0 tx=0x7f298c009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.194+0000 7f29a1600700 1 -- 172.21.15.57:0/4247929874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f299c0fe0e0 msgr2=0x7f299c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.194+0000 7f29a1600700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f299c0fe0e0 0x7f299c0702e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f298800c830 tx=0x7f2988004470 comp rx=0 tx=0).stop 2024-02-28T16:01:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.194+0000 7f29a1600700 1 -- 172.21.15.57:0/4247929874 shutdown_connections 2024-02-28T16:01:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.194+0000 7f29a1600700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f29800386e0 0x7f298003ab90 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f299c071bf0 tx=0x7f298c009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.194+0000 7f29a1600700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f299c0fcef0 0x7f299c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:03.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.194+0000 7f29a1600700 1 --2- 172.21.15.57:0/4247929874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f299c0fe0e0 0x7f299c0702e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:03.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.194+0000 7f29a1600700 1 -- 172.21.15.57:0/4247929874 >> 172.21.15.57:0/4247929874 conn(0x7f299c0f8620 msgr2=0x7f299c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:03.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.197+0000 7f29a1600700 1 -- 172.21.15.57:0/4247929874 shutdown_connections 2024-02-28T16:01:03.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.197+0000 7f29a1600700 1 -- 172.21.15.57:0/4247929874 wait complete. 2024-02-28T16:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.382+0000 7fb7bdc00700 1 -- 172.21.15.57:0/570287798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b81003a0 msgr2=0x7fb7b8102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.382+0000 7fb7bdc00700 1 --2- 172.21.15.57:0/570287798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b81003a0 0x7fb7b8102780 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4004940 tx=0x7fb7a4009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.382+0000 7fb7bdc00700 1 -- 172.21.15.57:0/570287798 shutdown_connections 2024-02-28T16:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.382+0000 7fb7bdc00700 1 --2- 172.21.15.57:0/570287798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b81003a0 0x7fb7b8102780 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.382+0000 7fb7bdc00700 1 --2- 172.21.15.57:0/570287798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b80fda80 0x7fb7b80ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.382+0000 7fb7bdc00700 1 -- 172.21.15.57:0/570287798 >> 172.21.15.57:0/570287798 conn(0x7fb7b80f74e0 msgr2=0x7fb7b80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.383+0000 7fb7bdc00700 1 -- 172.21.15.57:0/570287798 shutdown_connections 2024-02-28T16:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.383+0000 7fb7bdc00700 1 -- 172.21.15.57:0/570287798 wait complete. 2024-02-28T16:01:03.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.384+0000 7fb7bdc00700 1 Processor -- start 2024-02-28T16:01:03.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.385+0000 7fb7bdc00700 1 -- start start 2024-02-28T16:01:03.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.386+0000 7fb7bdc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b80fda80 0x7fb7b8113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.386+0000 7fb7bdc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81003a0 0x7fb7b81143f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.386+0000 7fb7bdc00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b81149f0 con 0x7fb7b80fda80 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.386+0000 7fb7bdc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b8115290 con 0x7fb7b81003a0 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.386+0000 7fb7b6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b80fda80 0x7fb7b8113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.386+0000 7fb7b6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b80fda80 0x7fb7b8113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46436/0 (socket says 172.21.15.57:46436) 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.386+0000 7fb7b6a00700 1 -- 172.21.15.57:0/182257077 learned_addr learned my addr 172.21.15.57:0/182257077 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.386+0000 7fb7b6000700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81003a0 0x7fb7b81143f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.387+0000 7fb7b6000700 1 -- 172.21.15.57:0/182257077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b80fda80 msgr2=0x7fb7b8113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.387+0000 7fb7b6000700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b80fda80 0x7fb7b8113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.387+0000 7fb7b6000700 1 -- 172.21.15.57:0/182257077 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a4005040 con 0x7fb7b81003a0 2024-02-28T16:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.387+0000 7fb7b6000700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81003a0 0x7fb7b81143f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4000c00 tx=0x7fb7a4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:03.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.387+0000 7fb7aea00700 1 -- 172.21.15.57:0/182257077 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7a400e070 con 0x7fb7b81003a0 2024-02-28T16:01:03.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.388+0000 7fb7aea00700 1 -- 172.21.15.57:0/182257077 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7a401c400 con 0x7fb7b81003a0 2024-02-28T16:01:03.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.388+0000 7fb7aea00700 1 -- 172.21.15.57:0/182257077 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7a400b650 con 0x7fb7b81003a0 2024-02-28T16:01:03.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.388+0000 7fb7bdc00700 1 -- 172.21.15.57:0/182257077 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b8115510 con 0x7fb7b81003a0 2024-02-28T16:01:03.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.388+0000 7fb7bdc00700 1 -- 172.21.15.57:0/182257077 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b81159a0 con 0x7fb7b81003a0 2024-02-28T16:01:03.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.390+0000 7fb7bdc00700 1 -- 172.21.15.57:0/182257077 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b804bed0 con 0x7fb7b81003a0 2024-02-28T16:01:03.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.390+0000 7fb7aea00700 1 -- 172.21.15.57:0/182257077 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 23) v1 ==== 45872+0+0 (secure 0 0 0) 0x7fb7a401c9e0 con 0x7fb7b81003a0 2024-02-28T16:01:03.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.391+0000 7fb7aea00700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fb79c0389d0 0x7fb79c03ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:03.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.391+0000 7fb7aea00700 1 -- 172.21.15.57:0/182257077 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fb7a4011730 con 0x7fb7b81003a0 2024-02-28T16:01:03.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.392+0000 7fb7b6a00700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fb79c0389d0 0x7fb79c03ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:03.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.392+0000 7fb7b6a00700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fb79c0389d0 0x7fb79c03ae80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8008fd0 tx=0x7fb7a800b040 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:03.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.400+0000 7fb7aea00700 1 -- 172.21.15.57:0/182257077 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb7a4026600 con 0x7fb7b81003a0 2024-02-28T16:01:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.945+0000 7fb7bdc00700 1 -- 172.21.15.57:0/182257077 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb7b8107d00 con 0x7fb7b81003a0 2024-02-28T16:01:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.945+0000 7fb7aea00700 1 -- 172.21.15.57:0/182257077 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fb7a40267a0 con 0x7fb7b81003a0 2024-02-28T16:01:03.938 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:01:03.938 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:01:03.938 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:01:03.939 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:01:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.948+0000 7fb7bdc00700 1 -- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fb79c0389d0 msgr2=0x7fb79c03ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.948+0000 7fb7bdc00700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fb79c0389d0 0x7fb79c03ae80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8008fd0 tx=0x7fb7a800b040 comp rx=0 tx=0).stop 2024-02-28T16:01:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.948+0000 7fb7bdc00700 1 -- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81003a0 msgr2=0x7fb7b81143f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.948+0000 7fb7bdc00700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81003a0 0x7fb7b81143f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4000c00 tx=0x7fb7a4009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.949+0000 7fb7bdc00700 1 -- 172.21.15.57:0/182257077 shutdown_connections 2024-02-28T16:01:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.949+0000 7fb7bdc00700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fb79c0389d0 0x7fb79c03ae80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.949+0000 7fb7bdc00700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b80fda80 0x7fb7b8113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.949+0000 7fb7bdc00700 1 --2- 172.21.15.57:0/182257077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81003a0 0x7fb7b81143f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:03.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.949+0000 7fb7bdc00700 1 -- 172.21.15.57:0/182257077 >> 172.21.15.57:0/182257077 conn(0x7fb7b80f74e0 msgr2=0x7fb7b80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:03.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.949+0000 7fb7bdc00700 1 -- 172.21.15.57:0/182257077 shutdown_connections 2024-02-28T16:01:03.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:03.949+0000 7fb7bdc00700 1 -- 172.21.15.57:0/182257077 wait complete. 2024-02-28T16:01:04.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.129+0000 7fd65aa00700 1 -- 172.21.15.57:0/2794659520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd654071eb0 msgr2=0x7fd654070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:04.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.129+0000 7fd65aa00700 1 --2- 172.21.15.57:0/2794659520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd654071eb0 0x7fd654070320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd644004880 tx=0x7fd644009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:04.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.130+0000 7fd65aa00700 1 -- 172.21.15.57:0/2794659520 shutdown_connections 2024-02-28T16:01:04.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.130+0000 7fd65aa00700 1 --2- 172.21.15.57:0/2794659520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd654070860 0x7fd654070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:04.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.130+0000 7fd65aa00700 1 --2- 172.21.15.57:0/2794659520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd654071eb0 0x7fd654070320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:04.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.130+0000 7fd65aa00700 1 -- 172.21.15.57:0/2794659520 >> 172.21.15.57:0/2794659520 conn(0x7fd6540f8620 msgr2=0x7fd6540faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:04.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.130+0000 7fd65aa00700 1 -- 172.21.15.57:0/2794659520 shutdown_connections 2024-02-28T16:01:04.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.130+0000 7fd65aa00700 1 -- 172.21.15.57:0/2794659520 wait complete. 2024-02-28T16:01:04.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.131+0000 7fd65aa00700 1 Processor -- start 2024-02-28T16:01:04.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.132+0000 7fd65aa00700 1 -- start start 2024-02-28T16:01:04.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.132+0000 7fd65aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd654070860 0x7fd65410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:04.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.132+0000 7fd65aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd654071eb0 0x7fd654110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:04.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.132+0000 7fd65aa00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654110740 con 0x7fd654071eb0 2024-02-28T16:01:04.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.132+0000 7fd65aa00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654110fe0 con 0x7fd654070860 2024-02-28T16:01:04.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.133+0000 7fd653e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd654070860 0x7fd65410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:04.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.133+0000 7fd653400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd654071eb0 0x7fd654110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:04.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.133+0000 7fd653400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd654071eb0 0x7fd654110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46458/0 (socket says 172.21.15.57:46458) 2024-02-28T16:01:04.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.133+0000 7fd653400700 1 -- 172.21.15.57:0/1601549611 learned_addr learned my addr 172.21.15.57:0/1601549611 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:04.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.134+0000 7fd653e00700 1 -- 172.21.15.57:0/1601549611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd654071eb0 msgr2=0x7fd654110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:04.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.134+0000 7fd653e00700 1 --2- 172.21.15.57:0/1601549611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd654071eb0 0x7fd654110140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:04.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.134+0000 7fd653e00700 1 -- 172.21.15.57:0/1601549611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd644005040 con 0x7fd654070860 2024-02-28T16:01:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.134+0000 7fd653e00700 1 --2- 172.21.15.57:0/1601549611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd654070860 0x7fd65410fc00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd644000c00 tx=0x7fd644009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.135+0000 7fd64be00700 1 -- 172.21.15.57:0/1601549611 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd64400e070 con 0x7fd654070860 2024-02-28T16:01:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.135+0000 7fd64be00700 1 -- 172.21.15.57:0/1601549611 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd644013e90 con 0x7fd654070860 2024-02-28T16:01:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.135+0000 7fd64be00700 1 -- 172.21.15.57:0/1601549611 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6440123c0 con 0x7fd654070860 2024-02-28T16:01:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.135+0000 7fd65aa00700 1 -- 172.21.15.57:0/1601549611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd654111260 con 0x7fd654070860 2024-02-28T16:01:04.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.135+0000 7fd65aa00700 1 -- 172.21.15.57:0/1601549611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd654111740 con 0x7fd654070860 2024-02-28T16:01:04.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.137+0000 7fd64be00700 1 -- 172.21.15.57:0/1601549611 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 23) v1 ==== 45872+0+0 (secure 0 0 0) 0x7fd644012520 con 0x7fd654070860 2024-02-28T16:01:04.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.137+0000 7fd64be00700 1 --2- 172.21.15.57:0/1601549611 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fd6380389e0 0x7fd63803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:04.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.138+0000 7fd64be00700 1 -- 172.21.15.57:0/1601549611 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd644014040 con 0x7fd654070860 2024-02-28T16:01:04.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.139+0000 7fd653400700 1 --2- 172.21.15.57:0/1601549611 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fd6380389e0 0x7fd63803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:04.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.140+0000 7fd653400700 1 --2- 172.21.15.57:0/1601549611 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fd6380389e0 0x7fd63803ae90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6400041d0 tx=0x7fd64000b040 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:04.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.140+0000 7fd65aa00700 1 -- 172.21.15.57:0/1601549611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65404bed0 con 0x7fd654070860 2024-02-28T16:01:04.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.148+0000 7fd64be00700 1 -- 172.21.15.57:0/1601549611 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd644026b80 con 0x7fd654070860 2024-02-28T16:01:04.282 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:03 smithi057 ceph-mon[28763]: mgrmap e23: smithi087.ewrszc(active, since 2s) 2024-02-28T16:01:04.282 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:03 smithi057 ceph-mon[28763]: pgmap v4: 65 pgs: 65 active+clean; 102 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:01:04.282 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:03 smithi057 ceph-mon[28763]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:04.282 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:03 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/182257077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:01:04.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:03 smithi087 ceph-mon[37122]: mgrmap e23: smithi087.ewrszc(active, since 2s) 2024-02-28T16:01:04.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:03 smithi087 ceph-mon[37122]: pgmap v4: 65 pgs: 65 active+clean; 102 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:01:04.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:03 smithi087 ceph-mon[37122]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:04.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:03 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/182257077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:01:04.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.512+0000 7fd65aa00700 1 -- 172.21.15.57:0/1601549611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd654111df0 con 0x7fd654070860 2024-02-28T16:01:04.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.513+0000 7fd64be00700 1 -- 172.21.15.57:0/1601549611 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1842 (secure 0 0 0) 0x7fd644026b80 con 0x7fd654070860 2024-02-28T16:01:04.506 INFO:teuthology.orchestra.run.smithi057.stdout:e15 2024-02-28T16:01:04.506 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:01:04.506 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:01:04.506 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:01:04.507 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:01:04.507 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:01:04.507 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:01:04.507 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 15 2024-02-28T16:01:04.507 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:01:04.507 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:01:04.508 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:00:39.195831+0000 2024-02-28T16:01:04.508 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:01:04.508 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:01:04.508 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:01:04.508 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:01:04.508 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:01:04.509 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:01:04.509 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:01:04.509 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:01:04.509 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:01:04.509 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:01:04.509 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:01:04.510 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:01:04.510 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:01:04.510 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:01:04.510 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:01:04.510 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:01:04.510 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:01:04.511 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:01:04.511 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:01:04.511 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:01:04.511 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:01:04.511 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:01:04.511 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:01:04.512 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:01:04.512 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:01:04.512 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:01:04.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.516+0000 7fd65aa00700 1 -- 172.21.15.57:0/1601549611 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fd6380389e0 msgr2=0x7fd63803ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:04.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.516+0000 7fd65aa00700 1 --2- 172.21.15.57:0/1601549611 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fd6380389e0 0x7fd63803ae90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6400041d0 tx=0x7fd64000b040 comp rx=0 tx=0).stop 2024-02-28T16:01:04.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.516+0000 7fd65aa00700 1 -- 172.21.15.57:0/1601549611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd654070860 msgr2=0x7fd65410fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:04.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.516+0000 7fd65aa00700 1 --2- 172.21.15.57:0/1601549611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd654070860 0x7fd65410fc00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd644000c00 tx=0x7fd644009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:04.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.517+0000 7fd65aa00700 1 -- 172.21.15.57:0/1601549611 shutdown_connections 2024-02-28T16:01:04.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.517+0000 7fd65aa00700 1 --2- 172.21.15.57:0/1601549611 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fd6380389e0 0x7fd63803ae90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:04.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.517+0000 7fd65aa00700 1 --2- 172.21.15.57:0/1601549611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd654070860 0x7fd65410fc00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:04.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.517+0000 7fd65aa00700 1 --2- 172.21.15.57:0/1601549611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd654071eb0 0x7fd654110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:04.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.517+0000 7fd65aa00700 1 -- 172.21.15.57:0/1601549611 >> 172.21.15.57:0/1601549611 conn(0x7fd6540f8620 msgr2=0x7fd654102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:04.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.517+0000 7fd65aa00700 1 -- 172.21.15.57:0/1601549611 shutdown_connections 2024-02-28T16:01:04.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.517+0000 7fd65aa00700 1 -- 172.21.15.57:0/1601549611 wait complete. 2024-02-28T16:01:04.515 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 15 2024-02-28T16:01:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.711+0000 7fc6fde00700 1 -- 172.21.15.57:0/2222121045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f81003a0 msgr2=0x7fc6f8102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.711+0000 7fc6fde00700 1 --2- 172.21.15.57:0/2222121045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f81003a0 0x7fc6f8102780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4004940 tx=0x7fc6e4009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.711+0000 7fc6fde00700 1 -- 172.21.15.57:0/2222121045 shutdown_connections 2024-02-28T16:01:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.711+0000 7fc6fde00700 1 --2- 172.21.15.57:0/2222121045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f81003a0 0x7fc6f8102780 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.711+0000 7fc6fde00700 1 --2- 172.21.15.57:0/2222121045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6f80fda80 0x7fc6f80ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.711+0000 7fc6fde00700 1 -- 172.21.15.57:0/2222121045 >> 172.21.15.57:0/2222121045 conn(0x7fc6f80f74e0 msgr2=0x7fc6f80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.712+0000 7fc6fde00700 1 -- 172.21.15.57:0/2222121045 shutdown_connections 2024-02-28T16:01:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.712+0000 7fc6fde00700 1 -- 172.21.15.57:0/2222121045 wait complete. 2024-02-28T16:01:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.713+0000 7fc6fde00700 1 Processor -- start 2024-02-28T16:01:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.713+0000 7fc6fde00700 1 -- start start 2024-02-28T16:01:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.714+0000 7fc6fde00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f80fda80 0x7fc6f810faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.714+0000 7fc6fde00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6f81003a0 0x7fc6f8110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.714+0000 7fc6fde00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8110630 con 0x7fc6f80fda80 2024-02-28T16:01:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.714+0000 7fc6fde00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8110ed0 con 0x7fc6f81003a0 2024-02-28T16:01:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.714+0000 7fc6f6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f80fda80 0x7fc6f810faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.715+0000 7fc6f6000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6f81003a0 0x7fc6f8110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.715+0000 7fc6f6000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6f81003a0 0x7fc6f8110030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:38368/0 (socket says 172.21.15.57:38368) 2024-02-28T16:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.715+0000 7fc6f6000700 1 -- 172.21.15.57:0/1925805282 learned_addr learned my addr 172.21.15.57:0/1925805282 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.715+0000 7fc6f6000700 1 -- 172.21.15.57:0/1925805282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f80fda80 msgr2=0x7fc6f810faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.715+0000 7fc6f6000700 1 --2- 172.21.15.57:0/1925805282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f80fda80 0x7fc6f810faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.715+0000 7fc6f6000700 1 -- 172.21.15.57:0/1925805282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e8005040 con 0x7fc6f81003a0 2024-02-28T16:01:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.716+0000 7fc6f6000700 1 --2- 172.21.15.57:0/1925805282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6f81003a0 0x7fc6f8110030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009fd0 tx=0x7fc6e4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.716+0000 7fc6eea00700 1 -- 172.21.15.57:0/1925805282 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e400e070 con 0x7fc6f81003a0 2024-02-28T16:01:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.716+0000 7fc6fde00700 1 -- 172.21.15.57:0/1925805282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e4005040 con 0x7fc6f81003a0 2024-02-28T16:01:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.716+0000 7fc6fde00700 1 -- 172.21.15.57:0/1925805282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f81114a0 con 0x7fc6f81003a0 2024-02-28T16:01:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.716+0000 7fc6eea00700 1 -- 172.21.15.57:0/1925805282 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6e4009430 con 0x7fc6f81003a0 2024-02-28T16:01:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.717+0000 7fc6eea00700 1 -- 172.21.15.57:0/1925805282 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e401cd60 con 0x7fc6f81003a0 2024-02-28T16:01:04.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.718+0000 7fc6fde00700 1 -- 172.21.15.57:0/1925805282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d80052e0 con 0x7fc6f81003a0 2024-02-28T16:01:04.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.719+0000 7fc6eea00700 1 -- 172.21.15.57:0/1925805282 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 23) v1 ==== 45872+0+0 (secure 0 0 0) 0x7fc6e401c400 con 0x7fc6f81003a0 2024-02-28T16:01:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.720+0000 7fc6eea00700 1 --2- 172.21.15.57:0/1925805282 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc6dc038ae0 0x7fc6dc03af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.720+0000 7fc6eea00700 1 -- 172.21.15.57:0/1925805282 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fc6e404dac0 con 0x7fc6f81003a0 2024-02-28T16:01:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.720+0000 7fc6f6a00700 1 --2- 172.21.15.57:0/1925805282 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc6dc038ae0 0x7fc6dc03af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:04.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.721+0000 7fc6f6a00700 1 --2- 172.21.15.57:0/1925805282 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc6dc038ae0 0x7fc6dc03af90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009fd0 tx=0x7fc6e800b040 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:04.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.727+0000 7fc6eea00700 1 -- 172.21.15.57:0/1925805282 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc6e404fe60 con 0x7fc6f81003a0 2024-02-28T16:01:04.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:04.997+0000 7fc6eea00700 1 -- 172.21.15.57:0/1925805282 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 24) v1 ==== 45928+0+0 (secure 0 0 0) 0x7fc6e4018d10 con 0x7fc6f81003a0 2024-02-28T16:01:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.096+0000 7fc6fde00700 1 -- 172.21.15.57:0/1925805282 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6d8000bf0 con 0x7fc6dc038ae0 2024-02-28T16:01:05.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.110+0000 7fc6eea00700 1 -- 172.21.15.57:0/1925805282 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc6d8000bf0 con 0x7fc6dc038ae0 2024-02-28T16:01:05.103 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:01:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:01:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:01:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:01:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [], 2024-02-28T16:01:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "1/21 daemons upgraded", 2024-02-28T16:01:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "", 2024-02-28T16:01:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:01:05.104 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:01:05.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.113+0000 7fc6fde00700 1 -- 172.21.15.57:0/1925805282 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc6dc038ae0 msgr2=0x7fc6dc03af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:05.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.113+0000 7fc6fde00700 1 --2- 172.21.15.57:0/1925805282 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc6dc038ae0 0x7fc6dc03af90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009fd0 tx=0x7fc6e800b040 comp rx=0 tx=0).stop 2024-02-28T16:01:05.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.113+0000 7fc6fde00700 1 -- 172.21.15.57:0/1925805282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6f81003a0 msgr2=0x7fc6f8110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:05.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.113+0000 7fc6fde00700 1 --2- 172.21.15.57:0/1925805282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6f81003a0 0x7fc6f8110030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009fd0 tx=0x7fc6e4009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:05.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.114+0000 7fc6fde00700 1 -- 172.21.15.57:0/1925805282 shutdown_connections 2024-02-28T16:01:05.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.114+0000 7fc6fde00700 1 --2- 172.21.15.57:0/1925805282 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc6dc038ae0 0x7fc6dc03af90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:05.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.114+0000 7fc6fde00700 1 --2- 172.21.15.57:0/1925805282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f80fda80 0x7fc6f810faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:05.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.114+0000 7fc6fde00700 1 --2- 172.21.15.57:0/1925805282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6f81003a0 0x7fc6f8110030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:05.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.114+0000 7fc6fde00700 1 -- 172.21.15.57:0/1925805282 >> 172.21.15.57:0/1925805282 conn(0x7fc6f80f74e0 msgr2=0x7fc6f80fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:05.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.114+0000 7fc6fde00700 1 -- 172.21.15.57:0/1925805282 shutdown_connections 2024-02-28T16:01:05.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.114+0000 7fc6fde00700 1 -- 172.21.15.57:0/1925805282 wait complete. 2024-02-28T16:01:05.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:04 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1601549611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:01:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.302+0000 7f1750200700 1 -- 172.21.15.57:0/2392572120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17480fda80 msgr2=0x7f17480ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.302+0000 7f1750200700 1 --2- 172.21.15.57:0/2392572120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17480fda80 0x7f17480ffe60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f173c004940 tx=0x7f173c009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.302+0000 7f1750200700 1 -- 172.21.15.57:0/2392572120 shutdown_connections 2024-02-28T16:01:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.302+0000 7f1750200700 1 --2- 172.21.15.57:0/2392572120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17481003a0 0x7f1748102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.302+0000 7f1750200700 1 --2- 172.21.15.57:0/2392572120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17480fda80 0x7f17480ffe60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.302+0000 7f1750200700 1 -- 172.21.15.57:0/2392572120 >> 172.21.15.57:0/2392572120 conn(0x7f17480f74e0 msgr2=0x7f17480f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.303+0000 7f1750200700 1 -- 172.21.15.57:0/2392572120 shutdown_connections 2024-02-28T16:01:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.303+0000 7f1750200700 1 -- 172.21.15.57:0/2392572120 wait complete. 2024-02-28T16:01:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.304+0000 7f1750200700 1 Processor -- start 2024-02-28T16:01:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.304+0000 7f1750200700 1 -- start start 2024-02-28T16:01:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.305+0000 7f1750200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17480fda80 0x7f174810faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.305+0000 7f1750200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17481003a0 0x7f174810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.305+0000 7f1750200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17481105e0 con 0x7f17480fda80 2024-02-28T16:01:05.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.305+0000 7f1750200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748110e80 con 0x7f17481003a0 2024-02-28T16:01:05.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.305+0000 7f174d800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17480fda80 0x7f174810faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:05.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.305+0000 7f174d800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17480fda80 0x7f174810faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46504/0 (socket says 172.21.15.57:46504) 2024-02-28T16:01:05.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.305+0000 7f174d800700 1 -- 172.21.15.57:0/635215270 learned_addr learned my addr 172.21.15.57:0/635215270 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:05.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.305+0000 7f174ce00700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17481003a0 0x7f174810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:05.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.306+0000 7f174d800700 1 -- 172.21.15.57:0/635215270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17481003a0 msgr2=0x7f174810ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:05.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.306+0000 7f174d800700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17481003a0 0x7f174810ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:05.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.306+0000 7f174d800700 1 -- 172.21.15.57:0/635215270 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734005040 con 0x7f17480fda80 2024-02-28T16:01:05.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.306+0000 7f174d800700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17480fda80 0x7f174810faa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f173c009fd0 tx=0x7f173c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:05.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.307+0000 7f1745600700 1 -- 172.21.15.57:0/635215270 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173c021070 con 0x7f17480fda80 2024-02-28T16:01:05.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.307+0000 7f1745600700 1 -- 172.21.15.57:0/635215270 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f173c01c400 con 0x7f17480fda80 2024-02-28T16:01:05.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.307+0000 7f1750200700 1 -- 172.21.15.57:0/635215270 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c005040 con 0x7f17480fda80 2024-02-28T16:01:05.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.307+0000 7f1745600700 1 -- 172.21.15.57:0/635215270 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173c00e070 con 0x7f17480fda80 2024-02-28T16:01:05.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.307+0000 7f1750200700 1 -- 172.21.15.57:0/635215270 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1748111450 con 0x7f17480fda80 2024-02-28T16:01:05.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.308+0000 7f1750200700 1 -- 172.21.15.57:0/635215270 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1748109c50 con 0x7f17480fda80 2024-02-28T16:01:05.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.309+0000 7f1745600700 1 -- 172.21.15.57:0/635215270 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 24) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f173c01c570 con 0x7f17480fda80 2024-02-28T16:01:05.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.310+0000 7f1745600700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f1730038a70 0x7f173003af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.310+0000 7f1745600700 1 -- 172.21.15.57:0/635215270 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f173c04d8c0 con 0x7f17480fda80 2024-02-28T16:01:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.310+0000 7f174ce00700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f1730038a70 0x7f173003af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.311+0000 7f174ce00700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f1730038a70 0x7f173003af20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1734009fd0 tx=0x7f1734009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:05.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.319+0000 7f1745600700 1 -- 172.21.15.57:0/635215270 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f173c024720 con 0x7f17480fda80 2024-02-28T16:01:05.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:04 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1601549611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:01:05.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.826+0000 7f1750200700 1 -- 172.21.15.57:0/635215270 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1748107c10 con 0x7f17480fda80 2024-02-28T16:01:05.819 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:01:05.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.827+0000 7f1745600700 1 -- 172.21.15.57:0/635215270 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f173c025370 con 0x7f17480fda80 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.830+0000 7f1750200700 1 -- 172.21.15.57:0/635215270 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f1730038a70 msgr2=0x7f173003af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.830+0000 7f1750200700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f1730038a70 0x7f173003af20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1734009fd0 tx=0x7f1734009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.830+0000 7f1750200700 1 -- 172.21.15.57:0/635215270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17480fda80 msgr2=0x7f174810faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.830+0000 7f1750200700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17480fda80 0x7f174810faa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f173c009fd0 tx=0x7f173c009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.830+0000 7f1750200700 1 -- 172.21.15.57:0/635215270 shutdown_connections 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.830+0000 7f1750200700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f1730038a70 0x7f173003af20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.830+0000 7f1750200700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17480fda80 0x7f174810faa0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.830+0000 7f1750200700 1 --2- 172.21.15.57:0/635215270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17481003a0 0x7f174810ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.830+0000 7f1750200700 1 -- 172.21.15.57:0/635215270 >> 172.21.15.57:0/635215270 conn(0x7f17480f74e0 msgr2=0x7f17480f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.831+0000 7f1750200700 1 -- 172.21.15.57:0/635215270 shutdown_connections 2024-02-28T16:01:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:05.831+0000 7f1750200700 1 -- 172.21.15.57:0/635215270 wait complete. 2024-02-28T16:01:06.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:05 smithi057 ceph-mon[28763]: mgrmap e24: smithi087.ewrszc(active, since 4s) 2024-02-28T16:01:06.181 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:05 smithi057 ceph-mon[28763]: pgmap v5: 65 pgs: 65 active+clean; 102 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:01:06.181 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:05 smithi057 ceph-mon[28763]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:06.181 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:05 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/635215270' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:01:06.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:05 smithi087 ceph-mon[37122]: mgrmap e24: smithi087.ewrszc(active, since 4s) 2024-02-28T16:01:06.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:05 smithi087 ceph-mon[37122]: pgmap v5: 65 pgs: 65 active+clean; 102 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:01:06.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:05 smithi087 ceph-mon[37122]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:06.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:06 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/635215270' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:01:08.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:08 smithi057 ceph-mon[28763]: pgmap v6: 65 pgs: 65 active+clean; 109 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 269 op/s 2024-02-28T16:01:08.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:08 smithi087 ceph-mon[37122]: pgmap v6: 65 pgs: 65 active+clean; 109 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 269 op/s 2024-02-28T16:01:10.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:10 smithi057 ceph-mon[28763]: pgmap v7: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 833 KiB/s rd, 1.4 MiB/s wr, 295 op/s 2024-02-28T16:01:10.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:10 smithi087 ceph-mon[37122]: pgmap v7: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 833 KiB/s rd, 1.4 MiB/s wr, 295 op/s 2024-02-28T16:01:12.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:12 smithi087 ceph-mon[37122]: pgmap v8: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 647 KiB/s rd, 1.1 MiB/s wr, 229 op/s 2024-02-28T16:01:12.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:12 smithi057 ceph-mon[28763]: pgmap v8: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 647 KiB/s rd, 1.1 MiB/s wr, 229 op/s 2024-02-28T16:01:13.399 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:13 smithi057 ceph-mon[28763]: Standby manager daemon smithi057.upqerc started 2024-02-28T16:01:13.399 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:13 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.57:0/12428823' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi057.upqerc/crt"}]: dispatch 2024-02-28T16:01:13.399 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:13 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.57:0/12428823' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:01:13.399 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:13 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.57:0/12428823' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi057.upqerc/key"}]: dispatch 2024-02-28T16:01:13.399 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:13 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.57:0/12428823' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:01:13.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:13 smithi087 ceph-mon[37122]: Standby manager daemon smithi057.upqerc started 2024-02-28T16:01:13.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:13 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.57:0/12428823' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi057.upqerc/crt"}]: dispatch 2024-02-28T16:01:13.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:13 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.57:0/12428823' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:01:13.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:13 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.57:0/12428823' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi057.upqerc/key"}]: dispatch 2024-02-28T16:01:13.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:13 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.57:0/12428823' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:01:14.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:14 smithi057 ceph-mon[28763]: pgmap v9: 65 pgs: 65 active+clean; 122 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 354 op/s 2024-02-28T16:01:14.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:14 smithi057 ceph-mon[28763]: mgrmap e25: smithi087.ewrszc(active, since 12s), standbys: smithi057.upqerc 2024-02-28T16:01:14.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:14 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T16:01:14.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:14 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:14.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:14 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:14 smithi087 ceph-mon[37122]: pgmap v9: 65 pgs: 65 active+clean; 122 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 354 op/s 2024-02-28T16:01:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:14 smithi087 ceph-mon[37122]: mgrmap e25: smithi087.ewrszc(active, since 12s), standbys: smithi057.upqerc 2024-02-28T16:01:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:14 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T16:01:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:14 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:14.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:14 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:16.486 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:16 smithi057 ceph-mon[28763]: pgmap v10: 65 pgs: 65 active+clean; 122 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 324 op/s 2024-02-28T16:01:16.486 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:16 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:01:16.486 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:16 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:16.487 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:16 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:16.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:16 smithi087 ceph-mon[37122]: pgmap v10: 65 pgs: 65 active+clean; 122 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 324 op/s 2024-02-28T16:01:16.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:16 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:01:16.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:16 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:16.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:16 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:18.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:18 smithi087 ceph-mon[37122]: pgmap v11: 65 pgs: 65 active+clean; 129 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 413 op/s 2024-02-28T16:01:18.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:18 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:18.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:18 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:18.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:18 smithi057 ceph-mon[28763]: pgmap v11: 65 pgs: 65 active+clean; 129 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 413 op/s 2024-02-28T16:01:18.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:18 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:18.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:18 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:20.384 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:20 smithi087 ceph-mon[37122]: pgmap v12: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 355 op/s 2024-02-28T16:01:20.384 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:20 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:20.384 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:20 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:20.384 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:20 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.384 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:20 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.384 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:20 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.385 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:20 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.385 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:20 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.385 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:20 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.385 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:20 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:20.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:20 smithi057 ceph-mon[28763]: pgmap v12: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 355 op/s 2024-02-28T16:01:20.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:20 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:20.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:20 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:20.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:20 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:20 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:20 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:20 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:20 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:20 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:20.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:20 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:21.579 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:21 smithi087 ceph-mon[37122]: Adjusting osd_memory_target on smithi057 to 1559M 2024-02-28T16:01:21.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:21 smithi057 ceph-mon[28763]: Adjusting osd_memory_target on smithi057 to 1559M 2024-02-28T16:01:22.252 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:22 smithi087 ceph-mon[37122]: pgmap v13: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 295 op/s 2024-02-28T16:01:22.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:22 smithi057 ceph-mon[28763]: pgmap v13: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 295 op/s 2024-02-28T16:01:23.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:23.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: Adjusting osd_memory_target on smithi087 to 2582M 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: Updating smithi057:/etc/ceph/ceph.conf 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: Updating smithi087:/etc/ceph/ceph.conf 2024-02-28T16:01:23.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: pgmap v14: 65 pgs: 65 active+clean; 156 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 433 op/s 2024-02-28T16:01:23.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:01:23.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:23 smithi057 ceph-mon[28763]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:01:23.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:23.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:23.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: Adjusting osd_memory_target on smithi087 to 2582M 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: Updating smithi057:/etc/ceph/ceph.conf 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: Updating smithi087:/etc/ceph/ceph.conf 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: pgmap v14: 65 pgs: 65 active+clean; 156 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 433 op/s 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:01:23.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:23 smithi087 ceph-mon[37122]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:01:24.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:24 smithi057 ceph-mon[28763]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:01:24.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:24 smithi087 ceph-mon[37122]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:01:26.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:01:26.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:01:26.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: pgmap v15: 65 pgs: 65 active+clean; 156 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 280 op/s 2024-02-28T16:01:26.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:01:26.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:01:26.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:01:26.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: pgmap v15: 65 pgs: 65 active+clean; 156 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 280 op/s 2024-02-28T16:01:26.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:01:26.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:26.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:27.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:27 smithi057 ceph-mon[28763]: Reconfiguring node-exporter.smithi057 (dependencies changed)... 2024-02-28T16:01:27.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:27 smithi057 ceph-mon[28763]: Reconfiguring daemon node-exporter.smithi057 on smithi057 2024-02-28T16:01:27.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:27 smithi087 ceph-mon[37122]: Reconfiguring node-exporter.smithi057 (dependencies changed)... 2024-02-28T16:01:27.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:27 smithi087 ceph-mon[37122]: Reconfiguring daemon node-exporter.smithi057 on smithi057 2024-02-28T16:01:28.891 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:28 smithi057 ceph-mon[28763]: pgmap v16: 65 pgs: 65 active+clean; 163 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 371 op/s 2024-02-28T16:01:28.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:28 smithi087 ceph-mon[37122]: pgmap v16: 65 pgs: 65 active+clean; 163 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 371 op/s 2024-02-28T16:01:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:30 smithi057 ceph-mon[28763]: pgmap v17: 65 pgs: 65 active+clean; 167 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 316 op/s 2024-02-28T16:01:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:30 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:30 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:30.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:30 smithi087 ceph-mon[37122]: pgmap v17: 65 pgs: 65 active+clean; 167 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 316 op/s 2024-02-28T16:01:30.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:30 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:30.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:30 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:31 smithi057 ceph-mon[28763]: Reconfiguring alertmanager.smithi057 (dependencies changed)... 2024-02-28T16:01:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:31 smithi057 ceph-mon[28763]: Reconfiguring daemon alertmanager.smithi057 on smithi057 2024-02-28T16:01:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:31 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:01:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:31 smithi087 ceph-mon[37122]: Reconfiguring alertmanager.smithi057 (dependencies changed)... 2024-02-28T16:01:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:31 smithi087 ceph-mon[37122]: Reconfiguring daemon alertmanager.smithi057 on smithi057 2024-02-28T16:01:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:31 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:01:32.866 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:32 smithi057 ceph-mon[28763]: pgmap v18: 65 pgs: 65 active+clean; 167 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2024-02-28T16:01:32.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:32 smithi087 ceph-mon[37122]: pgmap v18: 65 pgs: 65 active+clean; 167 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2024-02-28T16:01:34.897 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:34 smithi057 ceph-mon[28763]: pgmap v19: 65 pgs: 65 active+clean; 182 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 385 op/s 2024-02-28T16:01:34.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:34 smithi087 ceph-mon[37122]: pgmap v19: 65 pgs: 65 active+clean; 182 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 385 op/s 2024-02-28T16:01:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.024+0000 7fc237c00700 1 -- 172.21.15.57:0/31692711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2300708c0 msgr2=0x7fc230070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.024+0000 7fc237c00700 1 --2- 172.21.15.57:0/31692711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2300708c0 0x7fc230070d10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc21c004940 tx=0x7fc21c009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.024+0000 7fc237c00700 1 -- 172.21.15.57:0/31692711 shutdown_connections 2024-02-28T16:01:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.024+0000 7fc237c00700 1 --2- 172.21.15.57:0/31692711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2300708c0 0x7fc230070d10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.024+0000 7fc237c00700 1 --2- 172.21.15.57:0/31692711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc230071f10 0x7fc230070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.024+0000 7fc237c00700 1 -- 172.21.15.57:0/31692711 >> 172.21.15.57:0/31692711 conn(0x7fc2300f8620 msgr2=0x7fc2300faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.024+0000 7fc237c00700 1 -- 172.21.15.57:0/31692711 shutdown_connections 2024-02-28T16:01:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.024+0000 7fc237c00700 1 -- 172.21.15.57:0/31692711 wait complete. 2024-02-28T16:01:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.025+0000 7fc237c00700 1 Processor -- start 2024-02-28T16:01:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.025+0000 7fc237c00700 1 -- start start 2024-02-28T16:01:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.026+0000 7fc237c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2300708c0 0x7fc230113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.026+0000 7fc237c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc230071f10 0x7fc2301144f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.026+0000 7fc237c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc230114af0 con 0x7fc2300708c0 2024-02-28T16:01:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.026+0000 7fc237c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc230115390 con 0x7fc230071f10 2024-02-28T16:01:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.026+0000 7fc235200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2300708c0 0x7fc230113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.026+0000 7fc235200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2300708c0 0x7fc230113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59640/0 (socket says 172.21.15.57:59640) 2024-02-28T16:01:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.026+0000 7fc235200700 1 -- 172.21.15.57:0/705153028 learned_addr learned my addr 172.21.15.57:0/705153028 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.026+0000 7fc22fe00700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc230071f10 0x7fc2301144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.027+0000 7fc235200700 1 -- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc230071f10 msgr2=0x7fc2301144f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:36.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.027+0000 7fc235200700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc230071f10 0x7fc2301144f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.027+0000 7fc235200700 1 -- 172.21.15.57:0/705153028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c005040 con 0x7fc2300708c0 2024-02-28T16:01:36.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.027+0000 7fc22fe00700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc230071f10 0x7fc2301144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:01:36.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.028+0000 7fc235200700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2300708c0 0x7fc230113fb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc224002a50 tx=0x7fc2240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:36.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.028+0000 7fc22cc00700 1 -- 172.21.15.57:0/705153028 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc224007cc0 con 0x7fc2300708c0 2024-02-28T16:01:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.028+0000 7fc237c00700 1 -- 172.21.15.57:0/705153028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc230115670 con 0x7fc2300708c0 2024-02-28T16:01:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.028+0000 7fc237c00700 1 -- 172.21.15.57:0/705153028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc230115bb0 con 0x7fc2300708c0 2024-02-28T16:01:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.028+0000 7fc22cc00700 1 -- 172.21.15.57:0/705153028 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc22400f040 con 0x7fc2300708c0 2024-02-28T16:01:36.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.029+0000 7fc22cc00700 1 -- 172.21.15.57:0/705153028 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc224009640 con 0x7fc2300708c0 2024-02-28T16:01:36.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.031+0000 7fc237c00700 1 -- 172.21.15.57:0/705153028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2100052e0 con 0x7fc2300708c0 2024-02-28T16:01:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.032+0000 7fc22cc00700 1 -- 172.21.15.57:0/705153028 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7fc2240097c0 con 0x7fc2300708c0 2024-02-28T16:01:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.033+0000 7fc22cc00700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc21806b2e0 0x7fc21806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.033+0000 7fc22cc00700 1 -- 172.21.15.57:0/705153028 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fc224089c40 con 0x7fc2300708c0 2024-02-28T16:01:36.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.034+0000 7fc22fe00700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc21806b2e0 0x7fc21806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:36.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.035+0000 7fc22fe00700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc21806b2e0 0x7fc21806d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc21c004f90 tx=0x7fc21c009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:36.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.040+0000 7fc22cc00700 1 -- 172.21.15.57:0/705153028 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc2240576b0 con 0x7fc2300708c0 2024-02-28T16:01:36.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.398+0000 7fc237c00700 1 -- 172.21.15.57:0/705153028 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc210000bf0 con 0x7fc21806b2e0 2024-02-28T16:01:36.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.402+0000 7fc22cc00700 1 -- 172.21.15.57:0/705153028 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc210000bf0 con 0x7fc21806b2e0 2024-02-28T16:01:36.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.406+0000 7fc237c00700 1 -- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc21806b2e0 msgr2=0x7fc21806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:36.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.406+0000 7fc237c00700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc21806b2e0 0x7fc21806d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc21c004f90 tx=0x7fc21c009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:36.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.406+0000 7fc237c00700 1 -- 172.21.15.57:0/705153028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2300708c0 msgr2=0x7fc230113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:36.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.406+0000 7fc237c00700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2300708c0 0x7fc230113fb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc224002a50 tx=0x7fc2240046b0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.407+0000 7fc237c00700 1 -- 172.21.15.57:0/705153028 shutdown_connections 2024-02-28T16:01:36.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.407+0000 7fc237c00700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fc21806b2e0 0x7fc21806d790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.407+0000 7fc237c00700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2300708c0 0x7fc230113fb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.407+0000 7fc237c00700 1 --2- 172.21.15.57:0/705153028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc230071f10 0x7fc2301144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.407+0000 7fc237c00700 1 -- 172.21.15.57:0/705153028 >> 172.21.15.57:0/705153028 conn(0x7fc2300f8620 msgr2=0x7fc2300fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:36.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.407+0000 7fc237c00700 1 -- 172.21.15.57:0/705153028 shutdown_connections 2024-02-28T16:01:36.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.407+0000 7fc237c00700 1 -- 172.21.15.57:0/705153028 wait complete. 2024-02-28T16:01:36.421 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:01:36.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.606+0000 7fbd40200700 1 -- 172.21.15.57:0/982590867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd38100360 msgr2=0x7fbd381007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:36.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.606+0000 7fbd40200700 1 --2- 172.21.15.57:0/982590867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd38100360 0x7fbd381007b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbd24004940 tx=0x7fbd24009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:36.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.607+0000 7fbd40200700 1 -- 172.21.15.57:0/982590867 shutdown_connections 2024-02-28T16:01:36.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.607+0000 7fbd40200700 1 --2- 172.21.15.57:0/982590867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd38100360 0x7fbd381007b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.607+0000 7fbd40200700 1 --2- 172.21.15.57:0/982590867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd380ff150 0x7fbd380ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.607+0000 7fbd40200700 1 -- 172.21.15.57:0/982590867 >> 172.21.15.57:0/982590867 conn(0x7fbd380fa920 msgr2=0x7fbd380fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.607+0000 7fbd40200700 1 -- 172.21.15.57:0/982590867 shutdown_connections 2024-02-28T16:01:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.608+0000 7fbd40200700 1 -- 172.21.15.57:0/982590867 wait complete. 2024-02-28T16:01:36.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.609+0000 7fbd40200700 1 Processor -- start 2024-02-28T16:01:36.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.609+0000 7fbd40200700 1 -- start start 2024-02-28T16:01:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.609+0000 7fbd40200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd380ff150 0x7fbd3810fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.609+0000 7fbd40200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd38100360 0x7fbd38110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.609+0000 7fbd40200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd38110640 con 0x7fbd380ff150 2024-02-28T16:01:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.609+0000 7fbd40200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd38110ee0 con 0x7fbd38100360 2024-02-28T16:01:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.610+0000 7fbd3d800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd380ff150 0x7fbd3810fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.610+0000 7fbd3d800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd380ff150 0x7fbd3810fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59658/0 (socket says 172.21.15.57:59658) 2024-02-28T16:01:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.610+0000 7fbd3d800700 1 -- 172.21.15.57:0/1862738993 learned_addr learned my addr 172.21.15.57:0/1862738993 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:36.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.610+0000 7fbd3ce00700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd38100360 0x7fbd38110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:36.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.610+0000 7fbd3d800700 1 -- 172.21.15.57:0/1862738993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd38100360 msgr2=0x7fbd38110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:36.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.610+0000 7fbd3d800700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd38100360 0x7fbd38110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.610+0000 7fbd3d800700 1 -- 172.21.15.57:0/1862738993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd24005040 con 0x7fbd380ff150 2024-02-28T16:01:36.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.611+0000 7fbd3d800700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd380ff150 0x7fbd3810fb00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00eb70 tx=0x7fbd2c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:36.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.611+0000 7fbd35600700 1 -- 172.21.15.57:0/1862738993 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd2c007cc0 con 0x7fbd380ff150 2024-02-28T16:01:36.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.611+0000 7fbd40200700 1 -- 172.21.15.57:0/1862738993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd38111160 con 0x7fbd380ff150 2024-02-28T16:01:36.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.611+0000 7fbd35600700 1 -- 172.21.15.57:0/1862738993 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd2c00f040 con 0x7fbd380ff150 2024-02-28T16:01:36.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.611+0000 7fbd35600700 1 -- 172.21.15.57:0/1862738993 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd2c00ca10 con 0x7fbd380ff150 2024-02-28T16:01:36.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.612+0000 7fbd40200700 1 -- 172.21.15.57:0/1862738993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd381116a0 con 0x7fbd380ff150 2024-02-28T16:01:36.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.613+0000 7fbd40200700 1 -- 172.21.15.57:0/1862738993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3804bed0 con 0x7fbd380ff150 2024-02-28T16:01:36.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.614+0000 7fbd35600700 1 -- 172.21.15.57:0/1862738993 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7fbd2c00cb70 con 0x7fbd380ff150 2024-02-28T16:01:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.615+0000 7fbd35600700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fbd2006b2e0 0x7fbd2006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.616+0000 7fbd35600700 1 -- 172.21.15.57:0/1862738993 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fbd2c089810 con 0x7fbd380ff150 2024-02-28T16:01:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.617+0000 7fbd3ce00700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fbd2006b2e0 0x7fbd2006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:36.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.618+0000 7fbd3ce00700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fbd2006b2e0 0x7fbd2006d790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbd240136a0 tx=0x7fbd24009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:36.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.621+0000 7fbd35600700 1 -- 172.21.15.57:0/1862738993 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fbd2c0573b0 con 0x7fbd380ff150 2024-02-28T16:01:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:36 smithi057 ceph-mon[28763]: pgmap v20: 65 pgs: 65 active+clean; 182 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 248 op/s 2024-02-28T16:01:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:36 smithi057 ceph-mon[28763]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:36.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.963+0000 7fbd40200700 1 -- 172.21.15.57:0/1862738993 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd38111b40 con 0x7fbd2006b2e0 2024-02-28T16:01:36.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.965+0000 7fbd35600700 1 -- 172.21.15.57:0/1862738993 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fbd38111b40 con 0x7fbd2006b2e0 2024-02-28T16:01:36.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 -- 172.21.15.57:0/1862738993 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fbd2006b2e0 msgr2=0x7fbd2006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:36.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fbd2006b2e0 0x7fbd2006d790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbd240136a0 tx=0x7fbd24009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:36.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 -- 172.21.15.57:0/1862738993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd380ff150 msgr2=0x7fbd3810fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:36.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd380ff150 0x7fbd3810fb00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00eb70 tx=0x7fbd2c00b040 comp rx=0 tx=0).stop 2024-02-28T16:01:36.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 -- 172.21.15.57:0/1862738993 shutdown_connections 2024-02-28T16:01:36.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fbd2006b2e0 0x7fbd2006d790 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd380ff150 0x7fbd3810fb00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 --2- 172.21.15.57:0/1862738993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd38100360 0x7fbd38110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:36.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 -- 172.21.15.57:0/1862738993 >> 172.21.15.57:0/1862738993 conn(0x7fbd380fa920 msgr2=0x7fbd38103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:36.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 -- 172.21.15.57:0/1862738993 shutdown_connections 2024-02-28T16:01:36.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:36.968+0000 7fbd40200700 1 -- 172.21.15.57:0/1862738993 wait complete. 2024-02-28T16:01:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:36 smithi087 ceph-mon[37122]: pgmap v20: 65 pgs: 65 active+clean; 182 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 248 op/s 2024-02-28T16:01:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:36 smithi087 ceph-mon[37122]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:37.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.157+0000 7f31c0000700 1 -- 172.21.15.57:0/4135013938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b8070860 msgr2=0x7f31b8070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:37.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.157+0000 7f31c0000700 1 --2- 172.21.15.57:0/4135013938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b8070860 0x7f31b8070cd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f31a4004940 tx=0x7f31a4009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:37.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.157+0000 7f31c0000700 1 -- 172.21.15.57:0/4135013938 shutdown_connections 2024-02-28T16:01:37.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.157+0000 7f31c0000700 1 --2- 172.21.15.57:0/4135013938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b8070860 0x7f31b8070cd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:37.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.157+0000 7f31c0000700 1 --2- 172.21.15.57:0/4135013938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b8071eb0 0x7f31b8070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:37.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.157+0000 7f31c0000700 1 -- 172.21.15.57:0/4135013938 >> 172.21.15.57:0/4135013938 conn(0x7f31b80f8620 msgr2=0x7f31b80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:37.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.157+0000 7f31c0000700 1 -- 172.21.15.57:0/4135013938 shutdown_connections 2024-02-28T16:01:37.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.157+0000 7f31c0000700 1 -- 172.21.15.57:0/4135013938 wait complete. 2024-02-28T16:01:37.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.158+0000 7f31c0000700 1 Processor -- start 2024-02-28T16:01:37.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.159+0000 7f31c0000700 1 -- start start 2024-02-28T16:01:37.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.160+0000 7f31c0000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b8070860 0x7f31b806ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:37.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.160+0000 7f31c0000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b8071eb0 0x7f31b806f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:37.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.160+0000 7f31c0000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b806fa60 con 0x7f31b8071eb0 2024-02-28T16:01:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.160+0000 7f31bd600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b8070860 0x7f31b806ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.160+0000 7f31bcc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b8071eb0 0x7f31b806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.160+0000 7f31bcc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b8071eb0 0x7f31b806f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59678/0 (socket says 172.21.15.57:59678) 2024-02-28T16:01:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.161+0000 7f31bcc00700 1 -- 172.21.15.57:0/3370182068 learned_addr learned my addr 172.21.15.57:0/3370182068 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.161+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b81196d0 con 0x7f31b8070860 2024-02-28T16:01:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.161+0000 7f31bcc00700 1 -- 172.21.15.57:0/3370182068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b8070860 msgr2=0x7f31b806ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.161+0000 7f31bcc00700 1 --2- 172.21.15.57:0/3370182068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b8070860 0x7f31b806ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.161+0000 7f31bcc00700 1 -- 172.21.15.57:0/3370182068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a4005040 con 0x7f31b8071eb0 2024-02-28T16:01:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.162+0000 7f31bcc00700 1 --2- 172.21.15.57:0/3370182068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b8071eb0 0x7f31b806f460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009fd0 tx=0x7f31a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.162+0000 7f31b5600700 1 -- 172.21.15.57:0/3370182068 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31a400e070 con 0x7f31b8071eb0 2024-02-28T16:01:37.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.162+0000 7f31b5600700 1 -- 172.21.15.57:0/3370182068 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31a4009430 con 0x7f31b8071eb0 2024-02-28T16:01:37.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.162+0000 7f31b5600700 1 -- 172.21.15.57:0/3370182068 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31a401ce50 con 0x7f31b8071eb0 2024-02-28T16:01:37.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.162+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b8119950 con 0x7f31b8071eb0 2024-02-28T16:01:37.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.162+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b8119de0 con 0x7f31b8071eb0 2024-02-28T16:01:37.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.164+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b804bed0 con 0x7f31b8071eb0 2024-02-28T16:01:37.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.165+0000 7f31b5600700 1 -- 172.21.15.57:0/3370182068 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7f31a401c690 con 0x7f31b8071eb0 2024-02-28T16:01:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.167+0000 7f31b5600700 1 --2- 172.21.15.57:0/3370182068 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f31a006b330 0x7f31a006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.168+0000 7f31b5600700 1 -- 172.21.15.57:0/3370182068 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f31a408b4b0 con 0x7f31b8071eb0 2024-02-28T16:01:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.168+0000 7f31bd600700 1 --2- 172.21.15.57:0/3370182068 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f31a006b330 0x7f31a006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:37.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.169+0000 7f31bd600700 1 --2- 172.21.15.57:0/3370182068 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f31a006b330 0x7f31a006d7e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009b80 tx=0x7f31ac00b040 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:37.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.172+0000 7f31b5600700 1 -- 172.21.15.57:0/3370182068 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f31a4058fa0 con 0x7f31b8071eb0 2024-02-28T16:01:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.580+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f31b811a2c0 con 0x7f31a006b330 2024-02-28T16:01:37.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.615+0000 7f31b5600700 1 -- 172.21.15.57:0/3370182068 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f31b811a2c0 con 0x7f31a006b330 2024-02-28T16:01:37.609 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:01:37.609 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (8m) 19s ago 10m 13.7M - 0.25.0 c8568f914cd2 64bbae049744 2024-02-28T16:01:37.609 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (11m) 19s ago 11m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T16:01:37.609 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (9m) 23s ago 9m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T16:01:37.609 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (8m) 19s ago 10m 74.6M - 9.4.7 954c08fa6188 60cd69b6a8d5 2024-02-28T16:01:37.609 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (3m) 19s ago 3m 75.1M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:01:37.609 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (3m) 19s ago 3m 44.2M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:01:37.609 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (3m) 23s ago 3m 104M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (3m) 23s ago 3m 50.2M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:9283 running (12m) 19s ago 12m 339M - 17.2.7-535-gc0f02e60 1c37ed371348 2db340312662 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283 running (63s) 23s ago 9m 490M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 83ce464fbb4f 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (12m) 19s ago 12m 47.2M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (9m) 23s ago 9m 36.8M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 starting - - - - 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (9m) 23s ago 9m 8132k - 1.5.0 0da6a335fe13 f91fe90e3547 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (8m) 19s ago 8m 91.3M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (7m) 19s ago 7m 97.9M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (7m) 19s ago 7m 83.3M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (6m) 23s ago 6m 99.7M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (5m) 23s ago 5m 94.7M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (5m) 23s ago 5m 89.1M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:01:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (8m) 19s ago 9m 53.5M - 2.43.0 a07b618ecd1d 2e0885a51c9e 2024-02-28T16:01:37.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.619+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f31a006b330 msgr2=0x7f31a006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.619+0000 7f31c0000700 1 --2- 172.21.15.57:0/3370182068 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f31a006b330 0x7f31a006d7e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009b80 tx=0x7f31ac00b040 comp rx=0 tx=0).stop 2024-02-28T16:01:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.619+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b8071eb0 msgr2=0x7f31b806f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.619+0000 7f31c0000700 1 --2- 172.21.15.57:0/3370182068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b8071eb0 0x7f31b806f460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009fd0 tx=0x7f31a4009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.620+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 shutdown_connections 2024-02-28T16:01:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.620+0000 7f31c0000700 1 --2- 172.21.15.57:0/3370182068 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f31a006b330 0x7f31a006d7e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.620+0000 7f31c0000700 1 --2- 172.21.15.57:0/3370182068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b8070860 0x7f31b806ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:37.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.620+0000 7f31c0000700 1 --2- 172.21.15.57:0/3370182068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b8071eb0 0x7f31b806f460 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:37.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.620+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 >> 172.21.15.57:0/3370182068 conn(0x7f31b80f8620 msgr2=0x7f31b8102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:37.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.620+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 shutdown_connections 2024-02-28T16:01:37.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.620+0000 7f31c0000700 1 -- 172.21.15.57:0/3370182068 wait complete. 2024-02-28T16:01:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.848+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3103774084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0cc06ea50 msgr2=0x7fe0cc06ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.848+0000 7fe0d0c00700 1 --2- 172.21.15.57:0/3103774084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0cc06ea50 0x7fe0cc06ee60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4004940 tx=0x7fe0b4009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.848+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3103774084 shutdown_connections 2024-02-28T16:01:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.848+0000 7fe0d0c00700 1 --2- 172.21.15.57:0/3103774084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0cc06f430 0x7fe0cc108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:37.843 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:37 smithi057 ceph-mon[28763]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:37.843 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:37 smithi057 ceph-mon[28763]: pgmap v21: 65 pgs: 65 active+clean; 198 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 346 op/s 2024-02-28T16:01:37.843 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:37 smithi057 ceph-mon[28763]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.849+0000 7fe0d0c00700 1 --2- 172.21.15.57:0/3103774084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0cc06ea50 0x7fe0cc06ee60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.849+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3103774084 >> 172.21.15.57:0/3103774084 conn(0x7fe0cc069e70 msgr2=0x7fe0cc06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.849+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3103774084 shutdown_connections 2024-02-28T16:01:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.849+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3103774084 wait complete. 2024-02-28T16:01:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.850+0000 7fe0d0c00700 1 Processor -- start 2024-02-28T16:01:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.850+0000 7fe0d0c00700 1 -- start start 2024-02-28T16:01:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.851+0000 7fe0d0c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0cc06ea50 0x7fe0cc115770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.851+0000 7fe0d0c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0cc113bf0 0x7fe0cc114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.851+0000 7fe0d0c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc1145f0 con 0x7fe0cc113bf0 2024-02-28T16:01:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.851+0000 7fe0d0c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc114730 con 0x7fe0cc06ea50 2024-02-28T16:01:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.852+0000 7fe0c9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0cc113bf0 0x7fe0cc114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.852+0000 7fe0c9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0cc113bf0 0x7fe0cc114060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59710/0 (socket says 172.21.15.57:59710) 2024-02-28T16:01:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.852+0000 7fe0c9400700 1 -- 172.21.15.57:0/3161475766 learned_addr learned my addr 172.21.15.57:0/3161475766 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.852+0000 7fe0c9e00700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0cc06ea50 0x7fe0cc115770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.853+0000 7fe0c9400700 1 -- 172.21.15.57:0/3161475766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0cc06ea50 msgr2=0x7fe0cc115770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.853+0000 7fe0c9400700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0cc06ea50 0x7fe0cc115770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.853+0000 7fe0c9400700 1 -- 172.21.15.57:0/3161475766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc005040 con 0x7fe0cc113bf0 2024-02-28T16:01:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.854+0000 7fe0c9400700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0cc113bf0 0x7fe0cc114060 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00a770 tx=0x7fe0bc00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.854+0000 7fe0c2000700 1 -- 172.21.15.57:0/3161475766 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0bc00ab30 con 0x7fe0cc113bf0 2024-02-28T16:01:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.854+0000 7fe0c2000700 1 -- 172.21.15.57:0/3161475766 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0bc010040 con 0x7fe0cc113bf0 2024-02-28T16:01:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.854+0000 7fe0c2000700 1 -- 172.21.15.57:0/3161475766 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0bc014ba0 con 0x7fe0cc113bf0 2024-02-28T16:01:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.855+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3161475766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b4005040 con 0x7fe0cc113bf0 2024-02-28T16:01:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.855+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3161475766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc11e330 con 0x7fe0cc113bf0 2024-02-28T16:01:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.857+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3161475766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc10e0a0 con 0x7fe0cc113bf0 2024-02-28T16:01:37.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.858+0000 7fe0c2000700 1 -- 172.21.15.57:0/3161475766 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7fe0bc0143f0 con 0x7fe0cc113bf0 2024-02-28T16:01:37.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.861+0000 7fe0c2000700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe0b006b3a0 0x7fe0b006d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:37.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.861+0000 7fe0c2000700 1 -- 172.21.15.57:0/3161475766 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe0bc089350 con 0x7fe0cc113bf0 2024-02-28T16:01:37.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.862+0000 7fe0c9e00700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe0b006b3a0 0x7fe0b006d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:37.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.864+0000 7fe0c9e00700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe0b006b3a0 0x7fe0b006d850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400b0d0 tx=0x7fe0b4009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:37.868+0000 7fe0c2000700 1 -- 172.21.15.57:0/3161475766 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe0bc056f70 con 0x7fe0cc113bf0 2024-02-28T16:01:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:37 smithi087 ceph-mon[37122]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:37.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:37 smithi087 ceph-mon[37122]: pgmap v21: 65 pgs: 65 active+clean; 198 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 346 op/s 2024-02-28T16:01:37.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:37 smithi087 ceph-mon[37122]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:38.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.382+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3161475766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe0cc06f4d0 con 0x7fe0cc113bf0 2024-02-28T16:01:38.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.383+0000 7fe0c2000700 1 -- 172.21.15.57:0/3161475766 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fe0bc056b00 con 0x7fe0cc113bf0 2024-02-28T16:01:38.377 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:01:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:01:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:01:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:01:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:01:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:01:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 13, 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:01:38.378 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:01:38.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.387+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3161475766 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe0b006b3a0 msgr2=0x7fe0b006d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:38.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.387+0000 7fe0d0c00700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe0b006b3a0 0x7fe0b006d850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400b0d0 tx=0x7fe0b4009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:38.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.387+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3161475766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0cc113bf0 msgr2=0x7fe0cc114060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:38.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.387+0000 7fe0d0c00700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0cc113bf0 0x7fe0cc114060 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00a770 tx=0x7fe0bc00af40 comp rx=0 tx=0).stop 2024-02-28T16:01:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.387+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3161475766 shutdown_connections 2024-02-28T16:01:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.387+0000 7fe0d0c00700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe0b006b3a0 0x7fe0b006d850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.387+0000 7fe0d0c00700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0cc06ea50 0x7fe0cc115770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.387+0000 7fe0d0c00700 1 --2- 172.21.15.57:0/3161475766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0cc113bf0 0x7fe0cc114060 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.387+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3161475766 >> 172.21.15.57:0/3161475766 conn(0x7fe0cc069e70 msgr2=0x7fe0cc107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.387+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3161475766 shutdown_connections 2024-02-28T16:01:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.388+0000 7fe0d0c00700 1 -- 172.21.15.57:0/3161475766 wait complete. 2024-02-28T16:01:38.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.565+0000 7fe36d600700 1 -- 172.21.15.57:0/2177329141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe368070860 msgr2=0x7fe368070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:38.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.565+0000 7fe36d600700 1 --2- 172.21.15.57:0/2177329141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe368070860 0x7fe368070cd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe350009ce0 tx=0x7fe350004d10 comp rx=0 tx=0).stop 2024-02-28T16:01:38.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.565+0000 7fe36d600700 1 -- 172.21.15.57:0/2177329141 shutdown_connections 2024-02-28T16:01:38.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.565+0000 7fe36d600700 1 --2- 172.21.15.57:0/2177329141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe368070860 0x7fe368070cd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:38.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.565+0000 7fe36d600700 1 --2- 172.21.15.57:0/2177329141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe368071eb0 0x7fe368070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:38.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.565+0000 7fe36d600700 1 -- 172.21.15.57:0/2177329141 >> 172.21.15.57:0/2177329141 conn(0x7fe3680f8620 msgr2=0x7fe3680faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:38.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.565+0000 7fe36d600700 1 -- 172.21.15.57:0/2177329141 shutdown_connections 2024-02-28T16:01:38.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.565+0000 7fe36d600700 1 -- 172.21.15.57:0/2177329141 wait complete. 2024-02-28T16:01:38.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.566+0000 7fe36d600700 1 Processor -- start 2024-02-28T16:01:38.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.566+0000 7fe36d600700 1 -- start start 2024-02-28T16:01:38.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.566+0000 7fe36d600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe368070860 0x7fe3680fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:38.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.566+0000 7fe36d600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe368071eb0 0x7fe3680fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:38.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.566+0000 7fe36d600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680fd950 con 0x7fe368070860 2024-02-28T16:01:38.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.566+0000 7fe36d600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680fe1f0 con 0x7fe368071eb0 2024-02-28T16:01:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.567+0000 7fe366a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe368070860 0x7fe3680fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.567+0000 7fe366a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe368070860 0x7fe3680fcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59722/0 (socket says 172.21.15.57:59722) 2024-02-28T16:01:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.567+0000 7fe366a00700 1 -- 172.21.15.57:0/3909929233 learned_addr learned my addr 172.21.15.57:0/3909929233 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.567+0000 7fe366000700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe368071eb0 0x7fe3680fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.567+0000 7fe366a00700 1 -- 172.21.15.57:0/3909929233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe368071eb0 msgr2=0x7fe3680fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.567+0000 7fe366a00700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe368071eb0 0x7fe3680fd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.567+0000 7fe366a00700 1 -- 172.21.15.57:0/3909929233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe350009940 con 0x7fe368070860 2024-02-28T16:01:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.568+0000 7fe366a00700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe368070860 0x7fe3680fcdc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe36000eb40 tx=0x7fe36000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.569+0000 7fe35ea00700 1 -- 172.21.15.57:0/3909929233 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe360007cc0 con 0x7fe368070860 2024-02-28T16:01:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.569+0000 7fe35ea00700 1 -- 172.21.15.57:0/3909929233 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe36000f040 con 0x7fe368070860 2024-02-28T16:01:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.569+0000 7fe36d600700 1 -- 172.21.15.57:0/3909929233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3680fe470 con 0x7fe368070860 2024-02-28T16:01:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.569+0000 7fe35ea00700 1 -- 172.21.15.57:0/3909929233 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe360009620 con 0x7fe368070860 2024-02-28T16:01:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.569+0000 7fe36d600700 1 -- 172.21.15.57:0/3909929233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3680fe9b0 con 0x7fe368070860 2024-02-28T16:01:38.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.570+0000 7fe36d600700 1 -- 172.21.15.57:0/3909929233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36804bed0 con 0x7fe368070860 2024-02-28T16:01:38.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.572+0000 7fe35ea00700 1 -- 172.21.15.57:0/3909929233 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7fe360009780 con 0x7fe368070860 2024-02-28T16:01:38.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.573+0000 7fe35ea00700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe34c06b2e0 0x7fe34c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:38.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.573+0000 7fe35ea00700 1 -- 172.21.15.57:0/3909929233 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe360089a30 con 0x7fe368070860 2024-02-28T16:01:38.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.574+0000 7fe366000700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe34c06b2e0 0x7fe34c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:38.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.575+0000 7fe366000700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe34c06b2e0 0x7fe34c06d790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe35000b460 tx=0x7fe350004d10 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:38.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.580+0000 7fe35ea00700 1 -- 172.21.15.57:0/3909929233 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe36004f620 con 0x7fe368070860 2024-02-28T16:01:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:38 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3161475766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:01:38.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.949+0000 7fe36d600700 1 -- 172.21.15.57:0/3909929233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe3680fee00 con 0x7fe368070860 2024-02-28T16:01:38.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.950+0000 7fe35ea00700 1 -- 172.21.15.57:0/3909929233 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1842 (secure 0 0 0) 0x7fe360053ac0 con 0x7fe368070860 2024-02-28T16:01:38.943 INFO:teuthology.orchestra.run.smithi057.stdout:e15 2024-02-28T16:01:38.943 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:01:38.943 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:01:38.943 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:01:38.943 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:01:38.943 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:01:38.943 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 15 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:00:39.195831+0000 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:01:38.944 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:01:38.945 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:01:38.946 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:01:38.946 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:01:38.946 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:01:38.946 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.952+0000 7fe36d600700 1 -- 172.21.15.57:0/3909929233 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe34c06b2e0 msgr2=0x7fe34c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.952+0000 7fe36d600700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe34c06b2e0 0x7fe34c06d790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe35000b460 tx=0x7fe350004d10 comp rx=0 tx=0).stop 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.952+0000 7fe36d600700 1 -- 172.21.15.57:0/3909929233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe368070860 msgr2=0x7fe3680fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.952+0000 7fe36d600700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe368070860 0x7fe3680fcdc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe36000eb40 tx=0x7fe36000b040 comp rx=0 tx=0).stop 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.953+0000 7fe36d600700 1 -- 172.21.15.57:0/3909929233 shutdown_connections 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.953+0000 7fe36d600700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fe34c06b2e0 0x7fe34c06d790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.953+0000 7fe36d600700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe368070860 0x7fe3680fcdc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.953+0000 7fe36d600700 1 --2- 172.21.15.57:0/3909929233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe368071eb0 0x7fe3680fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.953+0000 7fe36d600700 1 -- 172.21.15.57:0/3909929233 >> 172.21.15.57:0/3909929233 conn(0x7fe3680f8620 msgr2=0x7fe368102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.953+0000 7fe36d600700 1 -- 172.21.15.57:0/3909929233 shutdown_connections 2024-02-28T16:01:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:38.953+0000 7fe36d600700 1 -- 172.21.15.57:0/3909929233 wait complete. 2024-02-28T16:01:38.948 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 15 2024-02-28T16:01:38.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:38 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3161475766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:01:39.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.150+0000 7ff952800700 1 -- 172.21.15.57:0/4073120168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff94c0fda80 msgr2=0x7ff94c0ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:39.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.150+0000 7ff952800700 1 --2- 172.21.15.57:0/4073120168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff94c0fda80 0x7ff94c0ffe60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff93c004940 tx=0x7ff93c009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:39.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.150+0000 7ff952800700 1 -- 172.21.15.57:0/4073120168 shutdown_connections 2024-02-28T16:01:39.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.150+0000 7ff952800700 1 --2- 172.21.15.57:0/4073120168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff94c1003a0 0x7ff94c102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:39.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.150+0000 7ff952800700 1 --2- 172.21.15.57:0/4073120168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff94c0fda80 0x7ff94c0ffe60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:39.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.150+0000 7ff952800700 1 -- 172.21.15.57:0/4073120168 >> 172.21.15.57:0/4073120168 conn(0x7ff94c0f74e0 msgr2=0x7ff94c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:39.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.151+0000 7ff952800700 1 -- 172.21.15.57:0/4073120168 shutdown_connections 2024-02-28T16:01:39.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.151+0000 7ff952800700 1 -- 172.21.15.57:0/4073120168 wait complete. 2024-02-28T16:01:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.152+0000 7ff952800700 1 Processor -- start 2024-02-28T16:01:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.152+0000 7ff952800700 1 -- start start 2024-02-28T16:01:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.152+0000 7ff952800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff94c0fda80 0x7ff94c113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.152+0000 7ff952800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff94c1003a0 0x7ff94c114450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.152+0000 7ff952800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c114a50 con 0x7ff94c1003a0 2024-02-28T16:01:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.152+0000 7ff952800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c1152f0 con 0x7ff94c0fda80 2024-02-28T16:01:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.153+0000 7ff94aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff94c1003a0 0x7ff94c114450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.153+0000 7ff94b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff94c0fda80 0x7ff94c113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.153+0000 7ff94aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff94c1003a0 0x7ff94c114450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59746/0 (socket says 172.21.15.57:59746) 2024-02-28T16:01:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.153+0000 7ff94aa00700 1 -- 172.21.15.57:0/2772428636 learned_addr learned my addr 172.21.15.57:0/2772428636 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:39.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.153+0000 7ff94b400700 1 -- 172.21.15.57:0/2772428636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff94c1003a0 msgr2=0x7ff94c114450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:39.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.153+0000 7ff94b400700 1 --2- 172.21.15.57:0/2772428636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff94c1003a0 0x7ff94c114450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:39.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.153+0000 7ff94b400700 1 -- 172.21.15.57:0/2772428636 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c005040 con 0x7ff94c0fda80 2024-02-28T16:01:39.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.154+0000 7ff94b400700 1 --2- 172.21.15.57:0/2772428636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff94c0fda80 0x7ff94c113f10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009fd0 tx=0x7ff93c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:39.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.154+0000 7ff943400700 1 -- 172.21.15.57:0/2772428636 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93c00e040 con 0x7ff94c0fda80 2024-02-28T16:01:39.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.154+0000 7ff943400700 1 -- 172.21.15.57:0/2772428636 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff93c00bcc0 con 0x7ff94c0fda80 2024-02-28T16:01:39.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.154+0000 7ff943400700 1 -- 172.21.15.57:0/2772428636 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93c013660 con 0x7ff94c0fda80 2024-02-28T16:01:39.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.156+0000 7ff952800700 1 -- 172.21.15.57:0/2772428636 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c115570 con 0x7ff94c0fda80 2024-02-28T16:01:39.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.156+0000 7ff952800700 1 -- 172.21.15.57:0/2772428636 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c115ab0 con 0x7ff94c0fda80 2024-02-28T16:01:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.158+0000 7ff952800700 1 -- 172.21.15.57:0/2772428636 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c105870 con 0x7ff94c0fda80 2024-02-28T16:01:39.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.160+0000 7ff943400700 1 -- 172.21.15.57:0/2772428636 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7ff93c01ca70 con 0x7ff94c0fda80 2024-02-28T16:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.161+0000 7ff943400700 1 --2- 172.21.15.57:0/2772428636 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7ff93006b2e0 0x7ff93006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.162+0000 7ff943400700 1 -- 172.21.15.57:0/2772428636 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7ff93c08a760 con 0x7ff94c0fda80 2024-02-28T16:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.162+0000 7ff94aa00700 1 --2- 172.21.15.57:0/2772428636 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7ff93006b2e0 0x7ff93006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:39.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.164+0000 7ff94aa00700 1 --2- 172.21.15.57:0/2772428636 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7ff93006b2e0 0x7ff93006d790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff938009fd0 tx=0x7ff938007ab0 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:39.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.169+0000 7ff943400700 1 -- 172.21.15.57:0/2772428636 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ff93c0582d0 con 0x7ff94c0fda80 2024-02-28T16:01:39.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.511+0000 7ff952800700 1 -- 172.21.15.57:0/2772428636 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff94c115de0 con 0x7ff93006b2e0 2024-02-28T16:01:39.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.514+0000 7ff943400700 1 -- 172.21.15.57:0/2772428636 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7ff94c115de0 con 0x7ff93006b2e0 2024-02-28T16:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [], 2024-02-28T16:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "1/21 daemons upgraded", 2024-02-28T16:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "", 2024-02-28T16:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:01:39.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.518+0000 7ff952800700 1 -- 172.21.15.57:0/2772428636 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7ff93006b2e0 msgr2=0x7ff93006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:39.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.518+0000 7ff952800700 1 --2- 172.21.15.57:0/2772428636 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7ff93006b2e0 0x7ff93006d790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff938009fd0 tx=0x7ff938007ab0 comp rx=0 tx=0).stop 2024-02-28T16:01:39.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.518+0000 7ff952800700 1 -- 172.21.15.57:0/2772428636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff94c0fda80 msgr2=0x7ff94c113f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.518+0000 7ff952800700 1 --2- 172.21.15.57:0/2772428636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff94c0fda80 0x7ff94c113f10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009fd0 tx=0x7ff93c009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.518+0000 7ff952800700 1 -- 172.21.15.57:0/2772428636 shutdown_connections 2024-02-28T16:01:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.518+0000 7ff952800700 1 --2- 172.21.15.57:0/2772428636 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7ff93006b2e0 0x7ff93006d790 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.518+0000 7ff952800700 1 --2- 172.21.15.57:0/2772428636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff94c0fda80 0x7ff94c113f10 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009fd0 tx=0x7ff93c009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.518+0000 7ff952800700 1 --2- 172.21.15.57:0/2772428636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff94c1003a0 0x7ff94c114450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.518+0000 7ff952800700 1 -- 172.21.15.57:0/2772428636 >> 172.21.15.57:0/2772428636 conn(0x7ff94c0f74e0 msgr2=0x7ff94c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.519+0000 7ff952800700 1 -- 172.21.15.57:0/2772428636 shutdown_connections 2024-02-28T16:01:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.519+0000 7ff952800700 1 -- 172.21.15.57:0/2772428636 wait complete. 2024-02-28T16:01:39.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.710+0000 7f299c800700 1 -- 172.21.15.57:0/1429339682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2994104760 msgr2=0x7f2994104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:39.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.710+0000 7f299c800700 1 --2- 172.21.15.57:0/1429339682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2994104760 0x7f2994104bb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2984004880 tx=0x7f2984009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:39.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.710+0000 7f299c800700 1 -- 172.21.15.57:0/1429339682 shutdown_connections 2024-02-28T16:01:39.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.710+0000 7f299c800700 1 --2- 172.21.15.57:0/1429339682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2994104760 0x7f2994104bb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:39.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.711+0000 7f299c800700 1 --2- 172.21.15.57:0/1429339682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29941035a0 0x7f29941039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:39.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.711+0000 7f299c800700 1 -- 172.21.15.57:0/1429339682 >> 172.21.15.57:0/1429339682 conn(0x7f29940668f0 msgr2=0x7f2994066d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:39.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.711+0000 7f299c800700 1 -- 172.21.15.57:0/1429339682 shutdown_connections 2024-02-28T16:01:39.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.712+0000 7f299c800700 1 -- 172.21.15.57:0/1429339682 wait complete. 2024-02-28T16:01:39.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.714+0000 7f299c800700 1 Processor -- start 2024-02-28T16:01:39.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.714+0000 7f299c800700 1 -- start start 2024-02-28T16:01:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.715+0000 7f299c800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29941035a0 0x7f299406f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.715+0000 7f299c800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2994104760 0x7f299406f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.715+0000 7f299c800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299406fc00 con 0x7f29941035a0 2024-02-28T16:01:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.715+0000 7f299c800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299411db70 con 0x7f2994104760 2024-02-28T16:01:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.715+0000 7f2999e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29941035a0 0x7f299406f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.715+0000 7f2999400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2994104760 0x7f299406f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.715+0000 7f2999400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2994104760 0x7f299406f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:54200/0 (socket says 172.21.15.57:54200) 2024-02-28T16:01:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.715+0000 7f2999400700 1 -- 172.21.15.57:0/2090269961 learned_addr learned my addr 172.21.15.57:0/2090269961 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:01:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.715+0000 7f2999e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29941035a0 0x7f299406f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59772/0 (socket says 172.21.15.57:59772) 2024-02-28T16:01:39.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.716+0000 7f2999400700 1 -- 172.21.15.57:0/2090269961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29941035a0 msgr2=0x7f299406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:39.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.716+0000 7f2999400700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29941035a0 0x7f299406f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:39.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.716+0000 7f2999400700 1 -- 172.21.15.57:0/2090269961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2984005040 con 0x7f2994104760 2024-02-28T16:01:39.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.716+0000 7f2999e00700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29941035a0 0x7f299406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:01:39.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.717+0000 7f2999400700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2994104760 0x7f299406f5b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2984008f80 tx=0x7f2984009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.718+0000 7f298e000700 1 -- 172.21.15.57:0/2090269961 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f298400e030 con 0x7f2994104760 2024-02-28T16:01:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.718+0000 7f299c800700 1 -- 172.21.15.57:0/2090269961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299411dd60 con 0x7f2994104760 2024-02-28T16:01:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.718+0000 7f298e000700 1 -- 172.21.15.57:0/2090269961 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2984013b70 con 0x7f2994104760 2024-02-28T16:01:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.718+0000 7f298e000700 1 -- 172.21.15.57:0/2090269961 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29840123c0 con 0x7f2994104760 2024-02-28T16:01:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.719+0000 7f299c800700 1 -- 172.21.15.57:0/2090269961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299411e2a0 con 0x7f2994104760 2024-02-28T16:01:39.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.720+0000 7f299c800700 1 -- 172.21.15.57:0/2090269961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299404bed0 con 0x7f2994104760 2024-02-28T16:01:39.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.722+0000 7f298e000700 1 -- 172.21.15.57:0/2090269961 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7f298401c400 con 0x7f2994104760 2024-02-28T16:01:39.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.723+0000 7f298e000700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f297c06b2e0 0x7f297c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:01:39.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.723+0000 7f298e000700 1 -- 172.21.15.57:0/2090269961 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f298408b770 con 0x7f2994104760 2024-02-28T16:01:39.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.723+0000 7f2999e00700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f297c06b2e0 0x7f297c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:01:39.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.724+0000 7f2999e00700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f297c06b2e0 0x7f297c06d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f299406ee00 tx=0x7f298800b040 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:01:39.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:39.730+0000 7f298e000700 1 -- 172.21.15.57:0/2090269961 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2984055910 con 0x7f2994104760 2024-02-28T16:01:39.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:39 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3909929233' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:01:39.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:39 smithi057 ceph-mon[28763]: pgmap v22: 65 pgs: 65 active+clean; 198 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 255 op/s 2024-02-28T16:01:39.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:39 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:39.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:39 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:39.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:39 smithi057 ceph-mon[28763]: Reconfiguring grafana.smithi057 (dependencies changed)... 2024-02-28T16:01:39.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:39 smithi057 ceph-mon[28763]: Reconfiguring daemon grafana.smithi057 on smithi057 2024-02-28T16:01:39.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:39 smithi057 ceph-mon[28763]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:39.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:39 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3909929233' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:01:39.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:39 smithi087 ceph-mon[37122]: pgmap v22: 65 pgs: 65 active+clean; 198 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 255 op/s 2024-02-28T16:01:39.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:39 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:39.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:39 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:01:39.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:39 smithi087 ceph-mon[37122]: Reconfiguring grafana.smithi057 (dependencies changed)... 2024-02-28T16:01:39.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:39 smithi087 ceph-mon[37122]: Reconfiguring daemon grafana.smithi057 on smithi057 2024-02-28T16:01:39.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:39 smithi087 ceph-mon[37122]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:01:40.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.181+0000 7f299c800700 1 -- 172.21.15.57:0/2090269961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f299410c030 con 0x7f2994104760 2024-02-28T16:01:40.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.182+0000 7f298e000700 1 -- 172.21.15.57:0/2090269961 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2984058fd0 con 0x7f2994104760 2024-02-28T16:01:40.175 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:01:40.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 -- 172.21.15.57:0/2090269961 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f297c06b2e0 msgr2=0x7f297c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:40.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f297c06b2e0 0x7f297c06d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f299406ee00 tx=0x7f298800b040 comp rx=0 tx=0).stop 2024-02-28T16:01:40.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 -- 172.21.15.57:0/2090269961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2994104760 msgr2=0x7f299406f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:01:40.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2994104760 0x7f299406f5b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2984008f80 tx=0x7f2984009e30 comp rx=0 tx=0).stop 2024-02-28T16:01:40.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 -- 172.21.15.57:0/2090269961 shutdown_connections 2024-02-28T16:01:40.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f297c06b2e0 0x7f297c06d790 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:40.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29941035a0 0x7f299406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:40.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 --2- 172.21.15.57:0/2090269961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2994104760 0x7f299406f5b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:01:40.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 -- 172.21.15.57:0/2090269961 >> 172.21.15.57:0/2090269961 conn(0x7f29940668f0 msgr2=0x7f2994107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:01:40.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 -- 172.21.15.57:0/2090269961 shutdown_connections 2024-02-28T16:01:40.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:01:40.186+0000 7f299c800700 1 -- 172.21.15.57:0/2090269961 wait complete. 2024-02-28T16:01:40.374 INFO:tasks.workunit.client.1.smithi087.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-28T16:01:40.400 INFO:tasks.workunit.client.1.smithi087.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:01:40.400 INFO:tasks.workunit.client.1.smithi087.stderr:+ make 2024-02-28T16:01:40.776 INFO:tasks.workunit.client.1.smithi087.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-28T16:01:40.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:40 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2090269961' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:01:40.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:40 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2090269961' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:01:41.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:41 smithi057 ceph-mon[28763]: pgmap v23: 65 pgs: 65 active+clean; 198 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 221 op/s 2024-02-28T16:01:41.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:41 smithi087 ceph-mon[37122]: pgmap v23: 65 pgs: 65 active+clean; 198 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 221 op/s 2024-02-28T16:01:42.130 INFO:tasks.workunit.client.1.smithi087.stderr:++ readlink -f fsstress 2024-02-28T16:01:42.136 INFO:tasks.workunit.client.1.smithi087.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-28T16:01:42.136 INFO:tasks.workunit.client.1.smithi087.stderr:+ popd 2024-02-28T16:01:42.141 INFO:tasks.workunit.client.1.smithi087.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:01:42.142 INFO:tasks.workunit.client.1.smithi087.stderr:+ popd 2024-02-28T16:01:42.145 INFO:tasks.workunit.client.1.smithi087.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:01:42.146 INFO:tasks.workunit.client.1.smithi087.stderr:++ mktemp -d -p . 2024-02-28T16:01:42.155 INFO:tasks.workunit.client.1.smithi087.stderr:+ T=./tmp.Q1MBZpkjM6 2024-02-28T16:01:42.155 INFO:tasks.workunit.client.1.smithi087.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Q1MBZpkjM6 -l 1 -n 1000 -p 10 -v 2024-02-28T16:01:42.164 INFO:tasks.workunit.client.1.smithi087.stdout:seed = 1709047010 2024-02-28T16:01:42.173 INFO:tasks.workunit.client.1.smithi087.stdout:8/0: truncate - no filename 2024-02-28T16:01:42.173 INFO:tasks.workunit.client.1.smithi087.stdout:8/1: dread - no filename 2024-02-28T16:01:42.173 INFO:tasks.workunit.client.1.smithi087.stdout:8/2: write - no filename 2024-02-28T16:01:42.173 INFO:tasks.workunit.client.1.smithi087.stdout:8/3: fsync - no filename 2024-02-28T16:01:42.174 INFO:tasks.workunit.client.1.smithi087.stdout:0/0: creat f0 x:0 0 0 2024-02-28T16:01:42.176 INFO:tasks.workunit.client.1.smithi087.stdout:1/0: read - no filename 2024-02-28T16:01:42.176 INFO:tasks.workunit.client.1.smithi087.stdout:1/1: readlink - no filename 2024-02-28T16:01:42.176 INFO:tasks.workunit.client.1.smithi087.stdout:1/2: dread - no filename 2024-02-28T16:01:42.176 INFO:tasks.workunit.client.1.smithi087.stdout:1/3: link - no file 2024-02-28T16:01:42.176 INFO:tasks.workunit.client.1.smithi087.stdout:1/4: write - no filename 2024-02-28T16:01:42.177 INFO:tasks.workunit.client.1.smithi087.stdout:0/1: unlink f0 0 2024-02-28T16:01:42.178 INFO:tasks.workunit.client.1.smithi087.stdout:8/4: mknod c0 0 2024-02-28T16:01:42.178 INFO:tasks.workunit.client.1.smithi087.stdout:8/5: fsync - no filename 2024-02-28T16:01:42.180 INFO:tasks.workunit.client.1.smithi087.stdout:2/0: link - no file 2024-02-28T16:01:42.180 INFO:tasks.workunit.client.1.smithi087.stdout:2/1: dread - no filename 2024-02-28T16:01:42.181 INFO:tasks.workunit.client.1.smithi087.stdout:2/2: dread - no filename 2024-02-28T16:01:42.181 INFO:tasks.workunit.client.1.smithi087.stdout:2/3: chown . 13784 1 2024-02-28T16:01:42.189 INFO:tasks.workunit.client.1.smithi087.stdout:0/2: symlink l1 0 2024-02-28T16:01:42.191 INFO:tasks.workunit.client.1.smithi087.stdout:8/6: unlink c0 0 2024-02-28T16:01:42.191 INFO:tasks.workunit.client.1.smithi087.stdout:8/7: dread - no filename 2024-02-28T16:01:42.191 INFO:tasks.workunit.client.1.smithi087.stdout:8/8: dread - no filename 2024-02-28T16:01:42.191 INFO:tasks.workunit.client.1.smithi087.stdout:8/9: write - no filename 2024-02-28T16:01:42.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/10: dread - no filename 2024-02-28T16:01:42.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/11: read - no filename 2024-02-28T16:01:42.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/12: dwrite - no filename 2024-02-28T16:01:42.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/13: dwrite - no filename 2024-02-28T16:01:42.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/14: write - no filename 2024-02-28T16:01:42.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/15: write - no filename 2024-02-28T16:01:42.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/16: dwrite - no filename 2024-02-28T16:01:42.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/17: write - no filename 2024-02-28T16:01:42.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/18: truncate - no filename 2024-02-28T16:01:42.195 INFO:tasks.workunit.client.1.smithi087.stdout:1/5: mkdir d0 0 2024-02-28T16:01:42.195 INFO:tasks.workunit.client.1.smithi087.stdout:1/6: dwrite - no filename 2024-02-28T16:01:42.195 INFO:tasks.workunit.client.1.smithi087.stdout:1/7: dwrite - no filename 2024-02-28T16:01:42.195 INFO:tasks.workunit.client.1.smithi087.stdout:1/8: dwrite - no filename 2024-02-28T16:01:42.195 INFO:tasks.workunit.client.1.smithi087.stdout:1/9: dwrite - no filename 2024-02-28T16:01:42.195 INFO:tasks.workunit.client.1.smithi087.stdout:0/3: mknod c2 0 2024-02-28T16:01:42.197 INFO:tasks.workunit.client.1.smithi087.stdout:8/19: creat f1 x:0 0 0 2024-02-28T16:01:42.197 INFO:tasks.workunit.client.1.smithi087.stdout:2/4: mknod c0 0 2024-02-28T16:01:42.200 INFO:tasks.workunit.client.1.smithi087.stdout:0/4: creat f3 x:0 0 0 2024-02-28T16:01:42.200 INFO:tasks.workunit.client.1.smithi087.stdout:4/0: dwrite - no filename 2024-02-28T16:01:42.201 INFO:tasks.workunit.client.1.smithi087.stdout:8/20: unlink f1 0 2024-02-28T16:01:42.201 INFO:tasks.workunit.client.1.smithi087.stdout:8/21: write - no filename 2024-02-28T16:01:42.202 INFO:tasks.workunit.client.1.smithi087.stdout:8/22: rename - no filename 2024-02-28T16:01:42.202 INFO:tasks.workunit.client.1.smithi087.stdout:8/23: readlink - no filename 2024-02-28T16:01:42.202 INFO:tasks.workunit.client.1.smithi087.stdout:8/24: chown . 106272504 1 2024-02-28T16:01:42.202 INFO:tasks.workunit.client.1.smithi087.stdout:8/25: fsync - no filename 2024-02-28T16:01:42.202 INFO:tasks.workunit.client.1.smithi087.stdout:3/0: mknod c0 0 2024-02-28T16:01:42.202 INFO:tasks.workunit.client.1.smithi087.stdout:3/1: dread - no filename 2024-02-28T16:01:42.202 INFO:tasks.workunit.client.1.smithi087.stdout:3/2: dread - no filename 2024-02-28T16:01:42.203 INFO:tasks.workunit.client.1.smithi087.stdout:3/3: chown c0 0 1 2024-02-28T16:01:42.204 INFO:tasks.workunit.client.1.smithi087.stdout:1/10: mknod d0/c1 0 2024-02-28T16:01:42.204 INFO:tasks.workunit.client.1.smithi087.stdout:1/11: dread - no filename 2024-02-28T16:01:42.206 INFO:tasks.workunit.client.1.smithi087.stdout:0/5: mkdir d4 0 2024-02-28T16:01:42.207 INFO:tasks.workunit.client.1.smithi087.stdout:0/6: chown l1 1 1 2024-02-28T16:01:42.210 INFO:tasks.workunit.client.1.smithi087.stdout:0/7: write f3 [182706,102190] 0 2024-02-28T16:01:42.210 INFO:tasks.workunit.client.1.smithi087.stdout:8/26: mkdir d2 0 2024-02-28T16:01:42.211 INFO:tasks.workunit.client.1.smithi087.stdout:3/4: unlink c0 0 2024-02-28T16:01:42.222 INFO:tasks.workunit.client.1.smithi087.stdout:2/5: link c0 c1 0 2024-02-28T16:01:42.227 INFO:tasks.workunit.client.1.smithi087.stdout:4/1: getdents . 0 2024-02-28T16:01:42.227 INFO:tasks.workunit.client.1.smithi087.stdout:4/2: write - no filename 2024-02-28T16:01:42.227 INFO:tasks.workunit.client.1.smithi087.stdout:4/3: write - no filename 2024-02-28T16:01:42.228 INFO:tasks.workunit.client.1.smithi087.stdout:3/5: creat f1 x:0 0 0 2024-02-28T16:01:42.231 INFO:tasks.workunit.client.1.smithi087.stdout:3/6: chown f1 1 1 2024-02-28T16:01:42.231 INFO:tasks.workunit.client.1.smithi087.stdout:5/0: getdents . 0 2024-02-28T16:01:42.232 INFO:tasks.workunit.client.1.smithi087.stdout:0/8: mknod d4/c5 0 2024-02-28T16:01:42.234 INFO:tasks.workunit.client.1.smithi087.stdout:8/27: creat d2/f3 x:0 0 0 2024-02-28T16:01:42.234 INFO:tasks.workunit.client.1.smithi087.stdout:2/6: mkdir d2 0 2024-02-28T16:01:42.240 INFO:tasks.workunit.client.1.smithi087.stdout:9/0: write - no filename 2024-02-28T16:01:42.240 INFO:tasks.workunit.client.1.smithi087.stdout:9/1: dread - no filename 2024-02-28T16:01:42.241 INFO:tasks.workunit.client.1.smithi087.stdout:3/7: mknod c2 0 2024-02-28T16:01:42.245 INFO:tasks.workunit.client.1.smithi087.stdout:0/9: mkdir d4/d6 0 2024-02-28T16:01:42.249 INFO:tasks.workunit.client.1.smithi087.stdout:4/4: mknod c0 0 2024-02-28T16:01:42.251 INFO:tasks.workunit.client.1.smithi087.stdout:4/5: chown c0 164412621 1 2024-02-28T16:01:42.251 INFO:tasks.workunit.client.1.smithi087.stdout:4/6: fdatasync - no filename 2024-02-28T16:01:42.253 INFO:tasks.workunit.client.1.smithi087.stdout:5/1: mknod c0 0 2024-02-28T16:01:42.253 INFO:tasks.workunit.client.1.smithi087.stdout:5/2: write - no filename 2024-02-28T16:01:42.256 INFO:tasks.workunit.client.1.smithi087.stdout:3/8: mknod c3 0 2024-02-28T16:01:42.257 INFO:tasks.workunit.client.1.smithi087.stdout:7/0: creat f0 x:0 0 0 2024-02-28T16:01:42.260 INFO:tasks.workunit.client.1.smithi087.stdout:2/7: creat d2/f3 x:0 0 0 2024-02-28T16:01:42.261 INFO:tasks.workunit.client.1.smithi087.stdout:9/2: creat f0 x:0 0 0 2024-02-28T16:01:42.262 INFO:tasks.workunit.client.1.smithi087.stdout:9/3: dread - f0 zero size 2024-02-28T16:01:42.263 INFO:tasks.workunit.client.1.smithi087.stdout:2/8: truncate d2/f3 189126 0 2024-02-28T16:01:42.263 INFO:tasks.workunit.client.1.smithi087.stdout:4/7: creat f1 x:0 0 0 2024-02-28T16:01:42.265 INFO:tasks.workunit.client.1.smithi087.stdout:5/3: symlink l1 0 2024-02-28T16:01:42.265 INFO:tasks.workunit.client.1.smithi087.stdout:5/4: dread - no filename 2024-02-28T16:01:42.265 INFO:tasks.workunit.client.1.smithi087.stdout:2/9: write d2/f3 [1034435,89009] 0 2024-02-28T16:01:42.266 INFO:tasks.workunit.client.1.smithi087.stdout:4/8: write f1 [615325,60100] 0 2024-02-28T16:01:42.266 INFO:tasks.workunit.client.1.smithi087.stdout:2/10: readlink - no filename 2024-02-28T16:01:42.268 INFO:tasks.workunit.client.1.smithi087.stdout:3/9: rename c3 to c4 0 2024-02-28T16:01:42.269 INFO:tasks.workunit.client.1.smithi087.stdout:7/1: mknod c1 0 2024-02-28T16:01:42.272 INFO:tasks.workunit.client.1.smithi087.stdout:7/2: stat c1 0 2024-02-28T16:01:42.272 INFO:tasks.workunit.client.1.smithi087.stdout:4/9: truncate f1 1179077 0 2024-02-28T16:01:42.274 INFO:tasks.workunit.client.1.smithi087.stdout:2/11: read d2/f3 [681922,51466] 0 2024-02-28T16:01:42.275 INFO:tasks.workunit.client.1.smithi087.stdout:4/10: mkdir d2 0 2024-02-28T16:01:42.276 INFO:tasks.workunit.client.1.smithi087.stdout:4/11: chown f1 3444438 1 2024-02-28T16:01:42.277 INFO:tasks.workunit.client.1.smithi087.stdout:7/3: rename f0 to f2 0 2024-02-28T16:01:42.278 INFO:tasks.workunit.client.1.smithi087.stdout:7/4: truncate f2 945612 0 2024-02-28T16:01:42.279 INFO:tasks.workunit.client.1.smithi087.stdout:2/12: creat d2/f4 x:0 0 0 2024-02-28T16:01:42.282 INFO:tasks.workunit.client.1.smithi087.stdout:4/12: mknod d2/c3 0 2024-02-28T16:01:42.284 INFO:tasks.workunit.client.1.smithi087.stdout:7/5: write f2 [1841724,19072] 0 2024-02-28T16:01:42.287 INFO:tasks.workunit.client.1.smithi087.stdout:2/13: mknod d2/c5 0 2024-02-28T16:01:42.289 INFO:tasks.workunit.client.1.smithi087.stdout:7/6: creat f3 x:0 0 0 2024-02-28T16:01:42.290 INFO:tasks.workunit.client.1.smithi087.stdout:2/14: rename d2/f4 to d2/f6 0 2024-02-28T16:01:42.296 INFO:tasks.workunit.client.1.smithi087.stdout:7/7: unlink c1 0 2024-02-28T16:01:42.296 INFO:tasks.workunit.client.1.smithi087.stdout:2/15: mkdir d2/d7 0 2024-02-28T16:01:42.298 INFO:tasks.workunit.client.1.smithi087.stdout:7/8: write f3 [497134,14831] 0 2024-02-28T16:01:42.300 INFO:tasks.workunit.client.1.smithi087.stdout:2/16: dread - d2/f6 zero size 2024-02-28T16:01:42.304 INFO:tasks.workunit.client.1.smithi087.stdout:2/17: creat d2/f8 x:0 0 0 2024-02-28T16:01:42.311 INFO:tasks.workunit.client.1.smithi087.stdout:4/13: dwrite f1 [0,4194304] 0 2024-02-28T16:01:42.312 INFO:tasks.workunit.client.1.smithi087.stdout:4/14: chown c0 72883546 1 2024-02-28T16:01:42.322 INFO:tasks.workunit.client.1.smithi087.stdout:4/15: rename f1 to d2/f4 0 2024-02-28T16:01:42.325 INFO:tasks.workunit.client.1.smithi087.stdout:4/16: symlink d2/l5 0 2024-02-28T16:01:42.354 INFO:tasks.workunit.client.1.smithi087.stdout:4/17: dwrite d2/f4 [0,4194304] 0 2024-02-28T16:01:42.373 INFO:tasks.workunit.client.1.smithi087.stdout:4/18: dread d2/f4 [0,4194304] 0 2024-02-28T16:01:42.377 INFO:tasks.workunit.client.1.smithi087.stdout:4/19: rename d2/l5 to d2/l6 0 2024-02-28T16:01:42.380 INFO:tasks.workunit.client.1.smithi087.stdout:4/20: symlink d2/l7 0 2024-02-28T16:01:42.384 INFO:tasks.workunit.client.1.smithi087.stdout:4/21: creat d2/f8 x:0 0 0 2024-02-28T16:01:42.402 INFO:tasks.workunit.client.1.smithi087.stdout:1/12: getdents d0 0 2024-02-28T16:01:42.403 INFO:tasks.workunit.client.1.smithi087.stdout:1/13: chown d0/c1 0 1 2024-02-28T16:01:42.403 INFO:tasks.workunit.client.1.smithi087.stdout:1/14: fsync - no filename 2024-02-28T16:01:42.407 INFO:tasks.workunit.client.1.smithi087.stdout:1/15: creat d0/f2 x:0 0 0 2024-02-28T16:01:42.407 INFO:tasks.workunit.client.1.smithi087.stdout:8/28: getdents d2 0 2024-02-28T16:01:42.408 INFO:tasks.workunit.client.1.smithi087.stdout:4/22: dwrite d2/f8 [0,4194304] 0 2024-02-28T16:01:42.409 INFO:tasks.workunit.client.1.smithi087.stdout:1/16: chown d0/f2 2773 1 2024-02-28T16:01:42.410 INFO:tasks.workunit.client.1.smithi087.stdout:0/10: getdents d4 0 2024-02-28T16:01:42.411 INFO:tasks.workunit.client.1.smithi087.stdout:0/11: chown c2 96 1 2024-02-28T16:01:42.412 INFO:tasks.workunit.client.1.smithi087.stdout:4/23: mkdir d2/d9 0 2024-02-28T16:01:42.413 INFO:tasks.workunit.client.1.smithi087.stdout:1/17: creat d0/f3 x:0 0 0 2024-02-28T16:01:42.413 INFO:tasks.workunit.client.1.smithi087.stdout:1/18: readlink - no filename 2024-02-28T16:01:42.415 INFO:tasks.workunit.client.1.smithi087.stdout:4/24: mkdir d2/d9/da 0 2024-02-28T16:01:42.416 INFO:tasks.workunit.client.1.smithi087.stdout:9/4: fsync f0 0 2024-02-28T16:01:42.416 INFO:tasks.workunit.client.1.smithi087.stdout:1/19: truncate d0/f3 268974 0 2024-02-28T16:01:42.418 INFO:tasks.workunit.client.1.smithi087.stdout:9/5: truncate f0 291869 0 2024-02-28T16:01:42.420 INFO:tasks.workunit.client.1.smithi087.stdout:9/6: write f0 [246495,76084] 0 2024-02-28T16:01:42.423 INFO:tasks.workunit.client.1.smithi087.stdout:3/10: chown c4 1907 1 2024-02-28T16:01:42.424 INFO:tasks.workunit.client.1.smithi087.stdout:0/12: link d4/c5 d4/d6/c7 0 2024-02-28T16:01:42.429 INFO:tasks.workunit.client.1.smithi087.stdout:0/13: write f3 [149227,9519] 0 2024-02-28T16:01:42.432 INFO:tasks.workunit.client.1.smithi087.stdout:3/11: mknod c5 0 2024-02-28T16:01:42.432 INFO:tasks.workunit.client.1.smithi087.stdout:3/12: rmdir - no directory 2024-02-28T16:01:42.435 INFO:tasks.workunit.client.1.smithi087.stdout:4/25: link c0 d2/d9/cb 0 2024-02-28T16:01:42.437 INFO:tasks.workunit.client.1.smithi087.stdout:0/14: write f3 [964665,69168] 0 2024-02-28T16:01:42.442 INFO:tasks.workunit.client.1.smithi087.stdout:2/18: rename d2/f6 to d2/f9 0 2024-02-28T16:01:42.448 INFO:tasks.workunit.client.1.smithi087.stdout:0/15: creat d4/f8 x:0 0 0 2024-02-28T16:01:42.452 INFO:tasks.workunit.client.1.smithi087.stdout:3/13: link c5 c6 0 2024-02-28T16:01:42.455 INFO:tasks.workunit.client.1.smithi087.stdout:8/29: dwrite d2/f3 [0,4194304] 0 2024-02-28T16:01:42.463 INFO:tasks.workunit.client.1.smithi087.stdout:4/26: chown d2/l6 7565824 1 2024-02-28T16:01:42.466 INFO:tasks.workunit.client.1.smithi087.stdout:8/30: write d2/f3 [1047128,86569] 0 2024-02-28T16:01:42.472 INFO:tasks.workunit.client.1.smithi087.stdout:1/20: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:01:42.472 INFO:tasks.workunit.client.1.smithi087.stdout:8/31: stat d2/f3 0 2024-02-28T16:01:42.475 INFO:tasks.workunit.client.1.smithi087.stdout:1/21: fdatasync d0/f3 0 2024-02-28T16:01:42.475 INFO:tasks.workunit.client.1.smithi087.stdout:9/7: dwrite f0 [0,4194304] 0 2024-02-28T16:01:42.475 INFO:tasks.workunit.client.1.smithi087.stdout:8/32: rename d2 to d2/d4 22 2024-02-28T16:01:42.477 INFO:tasks.workunit.client.1.smithi087.stdout:8/33: chown d2/f3 1527803614 1 2024-02-28T16:01:42.477 INFO:tasks.workunit.client.1.smithi087.stdout:9/8: chown f0 51807219 1 2024-02-28T16:01:42.477 INFO:tasks.workunit.client.1.smithi087.stdout:9/9: rmdir - no directory 2024-02-28T16:01:42.477 INFO:tasks.workunit.client.1.smithi087.stdout:2/19: truncate d2/f3 1445905 0 2024-02-28T16:01:42.479 INFO:tasks.workunit.client.1.smithi087.stdout:9/10: chown f0 714167 1 2024-02-28T16:01:42.479 INFO:tasks.workunit.client.1.smithi087.stdout:3/14: creat f7 x:0 0 0 2024-02-28T16:01:42.482 INFO:tasks.workunit.client.1.smithi087.stdout:2/20: truncate d2/f9 498427 0 2024-02-28T16:01:42.482 INFO:tasks.workunit.client.1.smithi087.stdout:9/11: chown f0 1 1 2024-02-28T16:01:42.487 INFO:tasks.workunit.client.1.smithi087.stdout:0/16: link d4/c5 d4/c9 0 2024-02-28T16:01:42.487 INFO:tasks.workunit.client.1.smithi087.stdout:3/15: creat f8 x:0 0 0 2024-02-28T16:01:42.498 INFO:tasks.workunit.client.1.smithi087.stdout:0/17: mknod d4/ca 0 2024-02-28T16:01:42.505 INFO:tasks.workunit.client.1.smithi087.stdout:2/21: dread d2/f9 [0,4194304] 0 2024-02-28T16:01:42.505 INFO:tasks.workunit.client.1.smithi087.stdout:3/16: rename c2 to c9 0 2024-02-28T16:01:42.505 INFO:tasks.workunit.client.1.smithi087.stdout:4/27: link d2/d9/cb d2/d9/cc 0 2024-02-28T16:01:42.505 INFO:tasks.workunit.client.1.smithi087.stdout:3/17: truncate f7 84051 0 2024-02-28T16:01:42.512 INFO:tasks.workunit.client.1.smithi087.stdout:8/34: dwrite d2/f3 [0,4194304] 0 2024-02-28T16:01:42.513 INFO:tasks.workunit.client.1.smithi087.stdout:3/18: unlink f8 0 2024-02-28T16:01:42.516 INFO:tasks.workunit.client.1.smithi087.stdout:9/12: dwrite f0 [0,4194304] 0 2024-02-28T16:01:42.517 INFO:tasks.workunit.client.1.smithi087.stdout:0/18: dread f3 [0,4194304] 0 2024-02-28T16:01:42.519 INFO:tasks.workunit.client.1.smithi087.stdout:2/22: symlink d2/d7/la 0 2024-02-28T16:01:42.519 INFO:tasks.workunit.client.1.smithi087.stdout:4/28: truncate d2/f4 3273747 0 2024-02-28T16:01:42.519 INFO:tasks.workunit.client.1.smithi087.stdout:1/22: fsync d0/f2 0 2024-02-28T16:01:42.519 INFO:tasks.workunit.client.1.smithi087.stdout:2/23: chown d2 724293 1 2024-02-28T16:01:42.520 INFO:tasks.workunit.client.1.smithi087.stdout:3/19: creat fa x:0 0 0 2024-02-28T16:01:42.521 INFO:tasks.workunit.client.1.smithi087.stdout:1/23: stat d0 0 2024-02-28T16:01:42.524 INFO:tasks.workunit.client.1.smithi087.stdout:0/19: dread f3 [0,4194304] 0 2024-02-28T16:01:42.525 INFO:tasks.workunit.client.1.smithi087.stdout:1/24: write d0/f2 [2126293,32864] 0 2024-02-28T16:01:42.526 INFO:tasks.workunit.client.1.smithi087.stdout:2/24: creat d2/fb x:0 0 0 2024-02-28T16:01:42.526 INFO:tasks.workunit.client.1.smithi087.stdout:1/25: rename d0 to d0/d4 22 2024-02-28T16:01:42.527 INFO:tasks.workunit.client.1.smithi087.stdout:4/29: symlink d2/ld 0 2024-02-28T16:01:42.531 INFO:tasks.workunit.client.1.smithi087.stdout:3/20: rename f7 to fb 0 2024-02-28T16:01:42.531 INFO:tasks.workunit.client.1.smithi087.stdout:0/20: mknod d4/cb 0 2024-02-28T16:01:42.534 INFO:tasks.workunit.client.1.smithi087.stdout:1/26: rmdir d0 39 2024-02-28T16:01:42.537 INFO:tasks.workunit.client.1.smithi087.stdout:4/30: mkdir d2/d9/de 0 2024-02-28T16:01:42.538 INFO:tasks.workunit.client.1.smithi087.stdout:3/21: mknod cc 0 2024-02-28T16:01:42.538 INFO:tasks.workunit.client.1.smithi087.stdout:3/22: stat fa 0 2024-02-28T16:01:42.542 INFO:tasks.workunit.client.1.smithi087.stdout:4/31: write d2/f8 [4589751,12331] 0 2024-02-28T16:01:42.542 INFO:tasks.workunit.client.1.smithi087.stdout:0/21: mkdir d4/d6/dc 0 2024-02-28T16:01:42.542 INFO:tasks.workunit.client.1.smithi087.stdout:3/23: dread - fa zero size 2024-02-28T16:01:42.545 INFO:tasks.workunit.client.1.smithi087.stdout:1/27: creat d0/f5 x:0 0 0 2024-02-28T16:01:42.545 INFO:tasks.workunit.client.1.smithi087.stdout:3/24: write fa [903479,88827] 0 2024-02-28T16:01:42.545 INFO:tasks.workunit.client.1.smithi087.stdout:4/32: mkdir d2/df 0 2024-02-28T16:01:42.546 INFO:tasks.workunit.client.1.smithi087.stdout:0/22: rmdir d4/d6 39 2024-02-28T16:01:42.547 INFO:tasks.workunit.client.1.smithi087.stdout:1/28: dread - d0/f5 zero size 2024-02-28T16:01:42.547 INFO:tasks.workunit.client.1.smithi087.stdout:3/25: chown cc 872141 1 2024-02-28T16:01:42.550 INFO:tasks.workunit.client.1.smithi087.stdout:0/23: write f3 [1080400,38942] 0 2024-02-28T16:01:42.552 INFO:tasks.workunit.client.1.smithi087.stdout:0/24: dread - d4/f8 zero size 2024-02-28T16:01:42.552 INFO:tasks.workunit.client.1.smithi087.stdout:3/26: creat fd x:0 0 0 2024-02-28T16:01:42.553 INFO:tasks.workunit.client.1.smithi087.stdout:1/29: mknod d0/c6 0 2024-02-28T16:01:42.556 INFO:tasks.workunit.client.1.smithi087.stdout:3/27: dread fb [0,4194304] 0 2024-02-28T16:01:42.557 INFO:tasks.workunit.client.1.smithi087.stdout:1/30: mkdir d0/d7 0 2024-02-28T16:01:42.559 INFO:tasks.workunit.client.1.smithi087.stdout:0/25: mkdir d4/dd 0 2024-02-28T16:01:42.560 INFO:tasks.workunit.client.1.smithi087.stdout:1/31: write d0/f2 [2858423,45351] 0 2024-02-28T16:01:42.563 INFO:tasks.workunit.client.1.smithi087.stdout:3/28: unlink fd 0 2024-02-28T16:01:42.564 INFO:tasks.workunit.client.1.smithi087.stdout:4/33: dread d2/f8 [0,4194304] 0 2024-02-28T16:01:42.569 INFO:tasks.workunit.client.1.smithi087.stdout:0/26: dread f3 [0,4194304] 0 2024-02-28T16:01:42.570 INFO:tasks.workunit.client.1.smithi087.stdout:1/32: mknod d0/c8 0 2024-02-28T16:01:42.571 INFO:tasks.workunit.client.1.smithi087.stdout:1/33: fdatasync d0/f5 0 2024-02-28T16:01:42.582 INFO:tasks.workunit.client.1.smithi087.stdout:9/13: truncate f0 4111995 0 2024-02-28T16:01:42.582 INFO:tasks.workunit.client.1.smithi087.stdout:4/34: fdatasync d2/f4 0 2024-02-28T16:01:42.585 INFO:tasks.workunit.client.1.smithi087.stdout:4/35: stat d2/c3 0 2024-02-28T16:01:42.586 INFO:tasks.workunit.client.1.smithi087.stdout:0/27: mknod d4/d6/dc/ce 0 2024-02-28T16:01:42.587 INFO:tasks.workunit.client.1.smithi087.stdout:3/29: dwrite fa [0,4194304] 0 2024-02-28T16:01:42.593 INFO:tasks.workunit.client.1.smithi087.stdout:0/28: truncate d4/f8 720108 0 2024-02-28T16:01:42.594 INFO:tasks.workunit.client.1.smithi087.stdout:1/34: rmdir d0/d7 0 2024-02-28T16:01:42.595 INFO:tasks.workunit.client.1.smithi087.stdout:4/36: fsync d2/f8 0 2024-02-28T16:01:42.596 INFO:tasks.workunit.client.1.smithi087.stdout:2/25: write d2/f3 [34147,46403] 0 2024-02-28T16:01:42.598 INFO:tasks.workunit.client.1.smithi087.stdout:0/29: mknod d4/d6/cf 0 2024-02-28T16:01:42.606 INFO:tasks.workunit.client.1.smithi087.stdout:1/35: mknod d0/c9 0 2024-02-28T16:01:42.606 INFO:tasks.workunit.client.1.smithi087.stdout:2/26: write d2/f3 [704237,25139] 0 2024-02-28T16:01:42.606 INFO:tasks.workunit.client.1.smithi087.stdout:0/30: write d4/f8 [510495,45412] 0 2024-02-28T16:01:42.607 INFO:tasks.workunit.client.1.smithi087.stdout:4/37: unlink d2/d9/cc 0 2024-02-28T16:01:42.607 INFO:tasks.workunit.client.1.smithi087.stdout:2/27: dread - d2/fb zero size 2024-02-28T16:01:42.610 INFO:tasks.workunit.client.1.smithi087.stdout:1/36: dread d0/f3 [0,4194304] 0 2024-02-28T16:01:42.613 INFO:tasks.workunit.client.1.smithi087.stdout:0/31: chown d4/c5 6574 1 2024-02-28T16:01:42.620 INFO:tasks.workunit.client.1.smithi087.stdout:3/30: dwrite fa [0,4194304] 0 2024-02-28T16:01:42.629 INFO:tasks.workunit.client.1.smithi087.stdout:3/31: dread fb [0,4194304] 0 2024-02-28T16:01:42.630 INFO:tasks.workunit.client.1.smithi087.stdout:3/32: fdatasync f1 0 2024-02-28T16:01:42.630 INFO:tasks.workunit.client.1.smithi087.stdout:4/38: unlink d2/d9/cb 0 2024-02-28T16:01:42.632 INFO:tasks.workunit.client.1.smithi087.stdout:4/39: fsync d2/f8 0 2024-02-28T16:01:42.633 INFO:tasks.workunit.client.1.smithi087.stdout:0/32: rename d4/d6/dc/ce to d4/d6/dc/c10 0 2024-02-28T16:01:42.635 INFO:tasks.workunit.client.1.smithi087.stdout:9/14: write f0 [564018,113976] 0 2024-02-28T16:01:42.639 INFO:tasks.workunit.client.1.smithi087.stdout:4/40: mkdir d2/d9/d10 0 2024-02-28T16:01:42.640 INFO:tasks.workunit.client.1.smithi087.stdout:3/33: unlink c5 0 2024-02-28T16:01:42.640 INFO:tasks.workunit.client.1.smithi087.stdout:3/34: readlink - no filename 2024-02-28T16:01:42.640 INFO:tasks.workunit.client.1.smithi087.stdout:3/35: readlink - no filename 2024-02-28T16:01:42.644 INFO:tasks.workunit.client.1.smithi087.stdout:2/28: getdents d2/d7 0 2024-02-28T16:01:42.645 INFO:tasks.workunit.client.1.smithi087.stdout:3/36: write fa [4016636,80563] 0 2024-02-28T16:01:42.645 INFO:tasks.workunit.client.1.smithi087.stdout:9/15: write f0 [3685900,45296] 0 2024-02-28T16:01:42.650 INFO:tasks.workunit.client.1.smithi087.stdout:2/29: truncate d2/f8 553176 0 2024-02-28T16:01:42.654 INFO:tasks.workunit.client.1.smithi087.stdout:3/37: symlink le 0 2024-02-28T16:01:42.659 INFO:tasks.workunit.client.1.smithi087.stdout:4/41: mkdir d2/d9/d10/d11 0 2024-02-28T16:01:42.659 INFO:tasks.workunit.client.1.smithi087.stdout:2/30: dread d2/f9 [0,4194304] 0 2024-02-28T16:01:42.660 INFO:tasks.workunit.client.1.smithi087.stdout:3/38: creat ff x:0 0 0 2024-02-28T16:01:42.661 INFO:tasks.workunit.client.1.smithi087.stdout:1/37: dwrite d0/f3 [0,4194304] 0 2024-02-28T16:01:42.667 INFO:tasks.workunit.client.1.smithi087.stdout:2/31: dread - d2/fb zero size 2024-02-28T16:01:42.669 INFO:tasks.workunit.client.1.smithi087.stdout:0/33: dwrite d4/f8 [0,4194304] 0 2024-02-28T16:01:42.669 INFO:tasks.workunit.client.1.smithi087.stdout:4/42: symlink d2/l12 0 2024-02-28T16:01:42.674 INFO:tasks.workunit.client.1.smithi087.stdout:4/43: fsync d2/f8 0 2024-02-28T16:01:42.674 INFO:tasks.workunit.client.1.smithi087.stdout:1/38: chown d0/f3 75 1 2024-02-28T16:01:42.677 INFO:tasks.workunit.client.1.smithi087.stdout:0/34: stat d4/d6 0 2024-02-28T16:01:42.682 INFO:tasks.workunit.client.1.smithi087.stdout:0/35: write d4/f8 [2554873,22160] 0 2024-02-28T16:01:42.690 INFO:tasks.workunit.client.1.smithi087.stdout:4/44: dread d2/f8 [4194304,4194304] 0 2024-02-28T16:01:42.691 INFO:tasks.workunit.client.1.smithi087.stdout:9/16: dwrite f0 [0,4194304] 0 2024-02-28T16:01:42.691 INFO:tasks.workunit.client.1.smithi087.stdout:0/36: rename f3 to d4/d6/dc/f11 0 2024-02-28T16:01:42.701 INFO:tasks.workunit.client.1.smithi087.stdout:0/37: unlink d4/c5 0 2024-02-28T16:01:42.705 INFO:tasks.workunit.client.1.smithi087.stdout:4/45: fsync d2/f4 0 2024-02-28T16:01:42.707 INFO:tasks.workunit.client.1.smithi087.stdout:9/17: rename f0 to f1 0 2024-02-28T16:01:42.720 INFO:tasks.workunit.client.1.smithi087.stdout:4/46: stat d2/ld 0 2024-02-28T16:01:42.723 INFO:tasks.workunit.client.1.smithi087.stdout:2/32: dwrite d2/f3 [0,4194304] 0 2024-02-28T16:01:42.724 INFO:tasks.workunit.client.1.smithi087.stdout:0/38: creat d4/d6/f12 x:0 0 0 2024-02-28T16:01:42.727 INFO:tasks.workunit.client.1.smithi087.stdout:2/33: chown d2/c5 791 1 2024-02-28T16:01:42.728 INFO:tasks.workunit.client.1.smithi087.stdout:3/39: dwrite fb [0,4194304] 0 2024-02-28T16:01:42.733 INFO:tasks.workunit.client.1.smithi087.stdout:9/18: fsync f1 0 2024-02-28T16:01:42.737 INFO:tasks.workunit.client.1.smithi087.stdout:1/39: dwrite d0/f3 [4194304,4194304] 0 2024-02-28T16:01:42.750 INFO:tasks.workunit.client.1.smithi087.stdout:2/34: creat d2/fc x:0 0 0 2024-02-28T16:01:42.753 INFO:tasks.workunit.client.1.smithi087.stdout:1/40: creat d0/fa x:0 0 0 2024-02-28T16:01:42.756 INFO:tasks.workunit.client.1.smithi087.stdout:3/40: rename fb to f10 0 2024-02-28T16:01:42.761 INFO:tasks.workunit.client.1.smithi087.stdout:2/35: creat d2/d7/fd x:0 0 0 2024-02-28T16:01:42.761 INFO:tasks.workunit.client.1.smithi087.stdout:9/19: dread f1 [0,4194304] 0 2024-02-28T16:01:42.762 INFO:tasks.workunit.client.1.smithi087.stdout:4/47: dwrite d2/f8 [0,4194304] 0 2024-02-28T16:01:42.762 INFO:tasks.workunit.client.1.smithi087.stdout:9/20: fsync f1 0 2024-02-28T16:01:42.763 INFO:tasks.workunit.client.1.smithi087.stdout:9/21: write f1 [392500,45981] 0 2024-02-28T16:01:42.764 INFO:tasks.workunit.client.1.smithi087.stdout:1/41: creat d0/fb x:0 0 0 2024-02-28T16:01:42.768 INFO:tasks.workunit.client.1.smithi087.stdout:3/41: read - ff zero size 2024-02-28T16:01:42.768 INFO:tasks.workunit.client.1.smithi087.stdout:2/36: symlink d2/d7/le 0 2024-02-28T16:01:42.771 INFO:tasks.workunit.client.1.smithi087.stdout:2/37: stat d2/d7 0 2024-02-28T16:01:42.775 INFO:tasks.workunit.client.1.smithi087.stdout:1/42: symlink d0/lc 0 2024-02-28T16:01:42.779 INFO:tasks.workunit.client.1.smithi087.stdout:4/48: creat d2/df/f13 x:0 0 0 2024-02-28T16:01:42.782 INFO:tasks.workunit.client.1.smithi087.stdout:3/42: mkdir d11 0 2024-02-28T16:01:42.784 INFO:tasks.workunit.client.1.smithi087.stdout:4/49: mknod d2/d9/da/c14 0 2024-02-28T16:01:42.786 INFO:tasks.workunit.client.1.smithi087.stdout:3/43: fsync fa 0 2024-02-28T16:01:42.791 INFO:tasks.workunit.client.1.smithi087.stdout:3/44: symlink d11/l12 0 2024-02-28T16:01:42.793 INFO:tasks.workunit.client.1.smithi087.stdout:9/22: truncate f1 1837011 0 2024-02-28T16:01:42.795 INFO:tasks.workunit.client.1.smithi087.stdout:0/39: truncate d4/d6/dc/f11 153189 0 2024-02-28T16:01:42.804 INFO:tasks.workunit.client.1.smithi087.stdout:9/23: fsync f1 0 2024-02-28T16:01:42.804 INFO:tasks.workunit.client.1.smithi087.stdout:0/40: write d4/d6/f12 [503719,47989] 0 2024-02-28T16:01:42.807 INFO:tasks.workunit.client.1.smithi087.stdout:9/24: creat f2 x:0 0 0 2024-02-28T16:01:42.810 INFO:tasks.workunit.client.1.smithi087.stdout:1/43: dwrite d0/f2 [4194304,4194304] 0 2024-02-28T16:01:42.813 INFO:tasks.workunit.client.1.smithi087.stdout:1/44: write d0/f5 [927144,6492] 0 2024-02-28T16:01:42.814 INFO:tasks.workunit.client.1.smithi087.stdout:9/25: rename f2 to f3 0 2024-02-28T16:01:42.819 INFO:tasks.workunit.client.1.smithi087.stdout:4/50: dwrite d2/f8 [4194304,4194304] 0 2024-02-28T16:01:42.821 INFO:tasks.workunit.client.1.smithi087.stdout:1/45: truncate d0/fa 676794 0 2024-02-28T16:01:42.822 INFO:tasks.workunit.client.1.smithi087.stdout:9/26: rename f1 to f4 0 2024-02-28T16:01:42.824 INFO:tasks.workunit.client.1.smithi087.stdout:9/27: chown f3 265132881 1 2024-02-28T16:01:42.829 INFO:tasks.workunit.client.1.smithi087.stdout:3/45: dwrite f10 [0,4194304] 0 2024-02-28T16:01:42.837 INFO:tasks.workunit.client.1.smithi087.stdout:3/46: truncate f1 324504 0 2024-02-28T16:01:42.843 INFO:tasks.workunit.client.1.smithi087.stdout:3/47: write fa [1956285,32822] 0 2024-02-28T16:01:42.850 INFO:tasks.workunit.client.1.smithi087.stdout:1/46: dwrite d0/f3 [4194304,4194304] 0 2024-02-28T16:01:42.854 INFO:tasks.workunit.client.1.smithi087.stdout:9/28: getdents . 0 2024-02-28T16:01:42.859 INFO:tasks.workunit.client.1.smithi087.stdout:3/48: read f1 [267472,126672] 0 2024-02-28T16:01:42.860 INFO:tasks.workunit.client.1.smithi087.stdout:4/51: dwrite d2/f8 [4194304,4194304] 0 2024-02-28T16:01:42.862 INFO:tasks.workunit.client.1.smithi087.stdout:3/49: dread - ff zero size 2024-02-28T16:01:42.864 INFO:tasks.workunit.client.1.smithi087.stdout:0/41: dwrite d4/d6/dc/f11 [0,4194304] 0 2024-02-28T16:01:42.865 INFO:tasks.workunit.client.1.smithi087.stdout:9/29: unlink f3 0 2024-02-28T16:01:42.868 INFO:tasks.workunit.client.1.smithi087.stdout:0/42: chown c2 27 1 2024-02-28T16:01:42.873 INFO:tasks.workunit.client.1.smithi087.stdout:4/52: symlink d2/d9/d10/l15 0 2024-02-28T16:01:42.873 INFO:tasks.workunit.client.1.smithi087.stdout:9/30: symlink l5 0 2024-02-28T16:01:42.884 INFO:tasks.workunit.client.1.smithi087.stdout:4/53: write d2/f8 [4759273,24820] 0 2024-02-28T16:01:42.886 INFO:tasks.workunit.client.1.smithi087.stdout:1/47: dwrite d0/fb [0,4194304] 0 2024-02-28T16:01:42.890 INFO:tasks.workunit.client.1.smithi087.stdout:0/43: creat d4/dd/f13 x:0 0 0 2024-02-28T16:01:42.892 INFO:tasks.workunit.client.1.smithi087.stdout:4/54: mknod d2/c16 0 2024-02-28T16:01:42.894 INFO:tasks.workunit.client.1.smithi087.stdout:3/50: dwrite f10 [0,4194304] 0 2024-02-28T16:01:42.899 INFO:tasks.workunit.client.1.smithi087.stdout:0/44: fdatasync d4/f8 0 2024-02-28T16:01:42.905 INFO:tasks.workunit.client.1.smithi087.stdout:3/51: creat d11/f13 x:0 0 0 2024-02-28T16:01:42.906 INFO:tasks.workunit.client.1.smithi087.stdout:0/45: creat d4/d6/f14 x:0 0 0 2024-02-28T16:01:42.908 INFO:tasks.workunit.client.1.smithi087.stdout:4/55: mknod d2/d9/d10/d11/c17 0 2024-02-28T16:01:42.912 INFO:tasks.workunit.client.1.smithi087.stdout:3/52: symlink d11/l14 0 2024-02-28T16:01:42.912 INFO:tasks.workunit.client.1.smithi087.stdout:4/56: stat d2/c16 0 2024-02-28T16:01:42.913 INFO:tasks.workunit.client.1.smithi087.stdout:9/31: dwrite f4 [0,4194304] 0 2024-02-28T16:01:42.920 INFO:tasks.workunit.client.1.smithi087.stdout:1/48: dread d0/f2 [4194304,4194304] 0 2024-02-28T16:01:42.923 INFO:tasks.workunit.client.1.smithi087.stdout:0/46: symlink d4/l15 0 2024-02-28T16:01:42.923 INFO:tasks.workunit.client.1.smithi087.stdout:4/57: unlink d2/d9/d10/l15 0 2024-02-28T16:01:42.924 INFO:tasks.workunit.client.1.smithi087.stdout:3/53: creat d11/f15 x:0 0 0 2024-02-28T16:01:42.926 INFO:tasks.workunit.client.1.smithi087.stdout:3/54: write f10 [3761123,27983] 0 2024-02-28T16:01:42.926 INFO:tasks.workunit.client.1.smithi087.stdout:4/58: creat d2/df/f18 x:0 0 0 2024-02-28T16:01:42.949 INFO:tasks.workunit.client.1.smithi087.stdout:3/55: creat d11/f16 x:0 0 0 2024-02-28T16:01:42.953 INFO:tasks.workunit.client.1.smithi087.stdout:3/56: read - d11/f15 zero size 2024-02-28T16:01:42.959 INFO:tasks.workunit.client.1.smithi087.stdout:1/49: truncate d0/fb 430430 0 2024-02-28T16:01:42.965 INFO:tasks.workunit.client.1.smithi087.stdout:1/50: truncate d0/fa 1292231 0 2024-02-28T16:01:42.965 INFO:tasks.workunit.client.1.smithi087.stdout:0/47: dwrite d4/dd/f13 [0,4194304] 0 2024-02-28T16:01:42.969 INFO:tasks.workunit.client.1.smithi087.stdout:9/32: dwrite f4 [0,4194304] 0 2024-02-28T16:01:42.982 INFO:tasks.workunit.client.1.smithi087.stdout:0/48: dread d4/d6/dc/f11 [0,4194304] 0 2024-02-28T16:01:42.984 INFO:tasks.workunit.client.1.smithi087.stdout:9/33: dread f4 [0,4194304] 0 2024-02-28T16:01:43.040 INFO:tasks.workunit.client.1.smithi087.stdout:3/57: creat d11/f17 x:0 0 0 2024-02-28T16:01:43.045 INFO:tasks.workunit.client.1.smithi087.stdout:9/34: creat f6 x:0 0 0 2024-02-28T16:01:43.047 INFO:tasks.workunit.client.1.smithi087.stdout:3/58: creat d11/f18 x:0 0 0 2024-02-28T16:01:43.052 INFO:tasks.workunit.client.1.smithi087.stdout:9/35: mkdir d7 0 2024-02-28T16:01:43.052 INFO:tasks.workunit.client.1.smithi087.stdout:0/49: mkdir d4/d16 0 2024-02-28T16:01:43.054 INFO:tasks.workunit.client.1.smithi087.stdout:3/59: creat d11/f19 x:0 0 0 2024-02-28T16:01:43.055 INFO:tasks.workunit.client.1.smithi087.stdout:1/51: getdents d0 0 2024-02-28T16:01:43.056 INFO:tasks.workunit.client.1.smithi087.stdout:3/60: dread - d11/f16 zero size 2024-02-28T16:01:43.061 INFO:tasks.workunit.client.1.smithi087.stdout:1/52: write d0/f3 [7523941,24444] 0 2024-02-28T16:01:43.062 INFO:tasks.workunit.client.1.smithi087.stdout:3/61: unlink f1 0 2024-02-28T16:01:43.062 INFO:tasks.workunit.client.1.smithi087.stdout:1/53: readlink d0/lc 0 2024-02-28T16:01:43.076 INFO:tasks.workunit.client.1.smithi087.stdout:0/50: dwrite d4/d6/f12 [0,4194304] 0 2024-02-28T16:01:43.083 INFO:tasks.workunit.client.1.smithi087.stdout:9/36: dwrite f4 [0,4194304] 0 2024-02-28T16:01:43.083 INFO:tasks.workunit.client.1.smithi087.stdout:0/51: creat d4/d16/f17 x:0 0 0 2024-02-28T16:01:43.087 INFO:tasks.workunit.client.1.smithi087.stdout:0/52: chown d4 2 1 2024-02-28T16:01:43.095 INFO:tasks.workunit.client.1.smithi087.stdout:1/54: dwrite d0/fa [0,4194304] 0 2024-02-28T16:01:43.103 INFO:tasks.workunit.client.1.smithi087.stdout:9/37: rename f6 to d7/f8 0 2024-02-28T16:01:43.104 INFO:tasks.workunit.client.1.smithi087.stdout:1/55: creat d0/fd x:0 0 0 2024-02-28T16:01:43.106 INFO:tasks.workunit.client.1.smithi087.stdout:9/38: read - d7/f8 zero size 2024-02-28T16:01:43.109 INFO:tasks.workunit.client.1.smithi087.stdout:9/39: chown d7 556654 1 2024-02-28T16:01:43.130 INFO:tasks.workunit.client.1.smithi087.stdout:1/56: dwrite d0/f5 [0,4194304] 0 2024-02-28T16:01:43.134 INFO:tasks.workunit.client.1.smithi087.stdout:1/57: fsync d0/f2 0 2024-02-28T16:01:43.137 INFO:tasks.workunit.client.1.smithi087.stdout:1/58: mknod d0/ce 0 2024-02-28T16:01:43.139 INFO:tasks.workunit.client.1.smithi087.stdout:1/59: read d0/fb [215486,12386] 0 2024-02-28T16:01:43.140 INFO:tasks.workunit.client.1.smithi087.stdout:1/60: readlink d0/lc 0 2024-02-28T16:01:43.145 INFO:tasks.workunit.client.1.smithi087.stdout:4/59: write d2/f4 [3453757,58600] 0 2024-02-28T16:01:43.151 INFO:tasks.workunit.client.1.smithi087.stdout:3/62: getdents d11 0 2024-02-28T16:01:43.152 INFO:tasks.workunit.client.1.smithi087.stdout:3/63: dread - d11/f17 zero size 2024-02-28T16:01:43.155 INFO:tasks.workunit.client.1.smithi087.stdout:0/53: rename d4/d16 to d4/d6/d18 0 2024-02-28T16:01:43.158 INFO:tasks.workunit.client.1.smithi087.stdout:3/64: rename d11/l14 to d11/l1a 0 2024-02-28T16:01:43.158 INFO:tasks.workunit.client.1.smithi087.stdout:9/40: rename d7 to d7/d9 22 2024-02-28T16:01:43.159 INFO:tasks.workunit.client.1.smithi087.stdout:9/41: stat d7/f8 0 2024-02-28T16:01:43.160 INFO:tasks.workunit.client.1.smithi087.stdout:9/42: chown f4 1704307 1 2024-02-28T16:01:43.162 INFO:tasks.workunit.client.1.smithi087.stdout:3/65: creat d11/f1b x:0 0 0 2024-02-28T16:01:43.163 INFO:tasks.workunit.client.1.smithi087.stdout:9/43: creat d7/fa x:0 0 0 2024-02-28T16:01:43.167 INFO:tasks.workunit.client.1.smithi087.stdout:4/60: dwrite d2/f4 [0,4194304] 0 2024-02-28T16:01:43.169 INFO:tasks.workunit.client.1.smithi087.stdout:3/66: truncate d11/f17 592655 0 2024-02-28T16:01:43.171 INFO:tasks.workunit.client.1.smithi087.stdout:0/54: link d4/d6/c7 d4/dd/c19 0 2024-02-28T16:01:43.174 INFO:tasks.workunit.client.1.smithi087.stdout:0/55: chown d4/d6/dc/f11 21387 1 2024-02-28T16:01:43.177 INFO:tasks.workunit.client.1.smithi087.stdout:4/61: creat d2/d9/de/f19 x:0 0 0 2024-02-28T16:01:43.177 INFO:tasks.workunit.client.1.smithi087.stdout:0/56: symlink d4/d6/l1a 0 2024-02-28T16:01:43.179 INFO:tasks.workunit.client.1.smithi087.stdout:4/62: fsync d2/f8 0 2024-02-28T16:01:43.185 INFO:tasks.workunit.client.1.smithi087.stdout:9/44: dwrite f4 [0,4194304] 0 2024-02-28T16:01:43.190 INFO:tasks.workunit.client.1.smithi087.stdout:9/45: dread - d7/f8 zero size 2024-02-28T16:01:43.197 INFO:tasks.workunit.client.1.smithi087.stdout:0/57: rename d4/d6/dc/f11 to d4/dd/f1b 0 2024-02-28T16:01:43.198 INFO:tasks.workunit.client.1.smithi087.stdout:3/67: rmdir d11 39 2024-02-28T16:01:43.207 INFO:tasks.workunit.client.1.smithi087.stdout:0/58: mkdir d4/d1c 0 2024-02-28T16:01:43.213 INFO:tasks.workunit.client.1.smithi087.stdout:4/63: truncate d2/f8 5985305 0 2024-02-28T16:01:43.217 INFO:tasks.workunit.client.1.smithi087.stdout:4/64: mkdir d2/d9/da/d1a 0 2024-02-28T16:01:43.222 INFO:tasks.workunit.client.1.smithi087.stdout:3/68: dwrite d11/f15 [0,4194304] 0 2024-02-28T16:01:43.224 INFO:tasks.workunit.client.1.smithi087.stdout:4/65: symlink d2/d9/de/l1b 0 2024-02-28T16:01:43.232 INFO:tasks.workunit.client.1.smithi087.stdout:0/59: dwrite d4/f8 [0,4194304] 0 2024-02-28T16:01:43.242 INFO:tasks.workunit.client.1.smithi087.stdout:0/60: truncate d4/d6/d18/f17 1033946 0 2024-02-28T16:01:43.249 INFO:tasks.workunit.client.1.smithi087.stdout:0/61: write d4/dd/f13 [1237898,124027] 0 2024-02-28T16:01:43.254 INFO:tasks.workunit.client.1.smithi087.stdout:3/69: dwrite d11/f18 [0,4194304] 0 2024-02-28T16:01:43.257 INFO:tasks.workunit.client.1.smithi087.stdout:4/66: dwrite d2/df/f13 [0,4194304] 0 2024-02-28T16:01:43.262 INFO:tasks.workunit.client.1.smithi087.stdout:3/70: mknod d11/c1c 0 2024-02-28T16:01:43.265 INFO:tasks.workunit.client.1.smithi087.stdout:3/71: dread - d11/f19 zero size 2024-02-28T16:01:43.265 INFO:tasks.workunit.client.1.smithi087.stdout:3/72: chown d11/f13 12043448 1 2024-02-28T16:01:43.267 INFO:tasks.workunit.client.1.smithi087.stdout:3/73: readlink d11/l12 0 2024-02-28T16:01:43.267 INFO:tasks.workunit.client.1.smithi087.stdout:4/67: link d2/l7 d2/l1c 0 2024-02-28T16:01:43.270 INFO:tasks.workunit.client.1.smithi087.stdout:4/68: creat d2/d9/d10/f1d x:0 0 0 2024-02-28T16:01:43.273 INFO:tasks.workunit.client.1.smithi087.stdout:4/69: symlink d2/d9/d10/l1e 0 2024-02-28T16:01:43.275 INFO:tasks.workunit.client.1.smithi087.stdout:4/70: truncate d2/d9/d10/f1d 204062 0 2024-02-28T16:01:43.279 INFO:tasks.workunit.client.1.smithi087.stdout:0/62: write d4/d6/f12 [4818099,52955] 0 2024-02-28T16:01:43.282 INFO:tasks.workunit.client.1.smithi087.stdout:0/63: creat d4/d6/d18/f1d x:0 0 0 2024-02-28T16:01:43.285 INFO:tasks.workunit.client.1.smithi087.stdout:0/64: symlink d4/d1c/l1e 0 2024-02-28T16:01:43.297 INFO:tasks.workunit.client.1.smithi087.stdout:4/71: write d2/f8 [1702362,129256] 0 2024-02-28T16:01:43.297 INFO:tasks.workunit.client.1.smithi087.stdout:0/65: write d4/dd/f1b [576199,28616] 0 2024-02-28T16:01:43.301 INFO:tasks.workunit.client.1.smithi087.stdout:0/66: mkdir d4/d6/d18/d1f 0 2024-02-28T16:01:43.304 INFO:tasks.workunit.client.1.smithi087.stdout:0/67: getdents d4/dd 0 2024-02-28T16:01:43.310 INFO:tasks.workunit.client.1.smithi087.stdout:4/72: fdatasync d2/f8 0 2024-02-28T16:01:43.312 INFO:tasks.workunit.client.1.smithi087.stdout:4/73: write d2/f4 [1309143,11970] 0 2024-02-28T16:01:43.315 INFO:tasks.workunit.client.1.smithi087.stdout:0/68: rename d4/d6/d18 to d4/dd/d20 0 2024-02-28T16:01:43.320 INFO:tasks.workunit.client.1.smithi087.stdout:0/69: mkdir d4/dd/d21 0 2024-02-28T16:01:43.323 INFO:tasks.workunit.client.1.smithi087.stdout:0/70: creat d4/d6/f22 x:0 0 0 2024-02-28T16:01:43.326 INFO:tasks.workunit.client.1.smithi087.stdout:4/74: dread d2/f8 [0,4194304] 0 2024-02-28T16:01:43.327 INFO:tasks.workunit.client.1.smithi087.stdout:4/75: chown d2/d9/de 0 1 2024-02-28T16:01:43.328 INFO:tasks.workunit.client.1.smithi087.stdout:0/71: rename d4/dd/c19 to d4/d6/dc/c23 0 2024-02-28T16:01:43.333 INFO:tasks.workunit.client.1.smithi087.stdout:4/76: rmdir d2/d9/d10 39 2024-02-28T16:01:43.337 INFO:tasks.workunit.client.1.smithi087.stdout:0/72: dread d4/dd/d20/f17 [0,4194304] 0 2024-02-28T16:01:43.342 INFO:tasks.workunit.client.1.smithi087.stdout:4/77: link d2/d9/da/c14 d2/d9/de/c1f 0 2024-02-28T16:01:43.345 INFO:tasks.workunit.client.1.smithi087.stdout:0/73: link d4/ca d4/d6/c24 0 2024-02-28T16:01:43.347 INFO:tasks.workunit.client.1.smithi087.stdout:4/78: dread d2/d9/d10/f1d [0,4194304] 0 2024-02-28T16:01:43.348 INFO:tasks.workunit.client.1.smithi087.stdout:0/74: mknod d4/d6/c25 0 2024-02-28T16:01:43.349 INFO:tasks.workunit.client.1.smithi087.stdout:0/75: fsync d4/d6/f22 0 2024-02-28T16:01:43.375 INFO:tasks.workunit.client.1.smithi087.stdout:0/76: dwrite d4/d6/f14 [0,4194304] 0 2024-02-28T16:01:43.376 INFO:tasks.workunit.client.1.smithi087.stdout:4/79: dwrite d2/df/f18 [0,4194304] 0 2024-02-28T16:01:43.376 INFO:tasks.workunit.client.1.smithi087.stdout:0/77: readlink d4/l15 0 2024-02-28T16:01:43.399 INFO:tasks.workunit.client.1.smithi087.stdout:4/80: truncate d2/d9/d10/f1d 524403 0 2024-02-28T16:01:43.399 INFO:tasks.workunit.client.1.smithi087.stdout:0/78: truncate d4/d6/f14 2161260 0 2024-02-28T16:01:43.401 INFO:tasks.workunit.client.1.smithi087.stdout:4/81: creat d2/f20 x:0 0 0 2024-02-28T16:01:43.402 INFO:tasks.workunit.client.1.smithi087.stdout:0/79: rmdir d4/dd/d20 39 2024-02-28T16:01:43.402 INFO:tasks.workunit.client.1.smithi087.stdout:0/80: readlink l1 0 2024-02-28T16:01:43.407 INFO:tasks.workunit.client.1.smithi087.stdout:4/82: rename d2/df/f18 to d2/d9/f21 0 2024-02-28T16:01:43.409 INFO:tasks.workunit.client.1.smithi087.stdout:0/81: unlink d4/d6/dc/c23 0 2024-02-28T16:01:43.410 INFO:tasks.workunit.client.1.smithi087.stdout:4/83: mkdir d2/d9/d10/d22 0 2024-02-28T16:01:43.415 INFO:tasks.workunit.client.1.smithi087.stdout:4/84: link d2/d9/de/f19 d2/d9/d10/d22/f23 0 2024-02-28T16:01:43.419 INFO:tasks.workunit.client.1.smithi087.stdout:0/82: rmdir d4/d6 39 2024-02-28T16:01:43.421 INFO:tasks.workunit.client.1.smithi087.stdout:0/83: write d4/f8 [4167122,6069] 0 2024-02-28T16:01:43.421 INFO:tasks.workunit.client.1.smithi087.stdout:4/85: creat d2/d9/f24 x:0 0 0 2024-02-28T16:01:43.424 INFO:tasks.workunit.client.1.smithi087.stdout:0/84: readlink d4/d6/l1a 0 2024-02-28T16:01:43.425 INFO:tasks.workunit.client.1.smithi087.stdout:4/86: symlink d2/d9/da/d1a/l25 0 2024-02-28T16:01:43.425 INFO:tasks.workunit.client.1.smithi087.stdout:4/87: readlink d2/l12 0 2024-02-28T16:01:43.426 INFO:tasks.workunit.client.1.smithi087.stdout:0/85: unlink d4/l15 0 2024-02-28T16:01:43.427 INFO:tasks.workunit.client.1.smithi087.stdout:4/88: chown d2/df/f13 179676 1 2024-02-28T16:01:43.430 INFO:tasks.workunit.client.1.smithi087.stdout:4/89: mkdir d2/d9/da/d1a/d26 0 2024-02-28T16:01:43.433 INFO:tasks.workunit.client.1.smithi087.stdout:4/90: creat d2/d9/d10/d22/f27 x:0 0 0 2024-02-28T16:01:43.437 INFO:tasks.workunit.client.1.smithi087.stdout:4/91: truncate d2/f8 104415 0 2024-02-28T16:01:43.437 INFO:tasks.workunit.client.1.smithi087.stdout:0/86: dread d4/dd/f13 [0,4194304] 0 2024-02-28T16:01:43.440 INFO:tasks.workunit.client.1.smithi087.stdout:0/87: write d4/dd/d20/f1d [372591,65309] 0 2024-02-28T16:01:43.445 INFO:tasks.workunit.client.1.smithi087.stdout:0/88: mkdir d4/dd/d26 0 2024-02-28T16:01:43.447 INFO:tasks.workunit.client.1.smithi087.stdout:0/89: rmdir d4/dd 39 2024-02-28T16:01:43.451 INFO:tasks.workunit.client.1.smithi087.stdout:4/92: dread d2/df/f13 [0,4194304] 0 2024-02-28T16:01:43.452 INFO:tasks.workunit.client.1.smithi087.stdout:4/93: chown d2/f20 37866393 1 2024-02-28T16:01:43.453 INFO:tasks.workunit.client.1.smithi087.stdout:4/94: readlink d2/l1c 0 2024-02-28T16:01:43.454 INFO:tasks.workunit.client.1.smithi087.stdout:4/95: stat d2/d9/de 0 2024-02-28T16:01:43.464 INFO:tasks.workunit.client.1.smithi087.stdout:4/96: dread d2/f4 [0,4194304] 0 2024-02-28T16:01:43.465 INFO:tasks.workunit.client.1.smithi087.stdout:0/90: dwrite d4/dd/d20/f17 [0,4194304] 0 2024-02-28T16:01:43.469 INFO:tasks.workunit.client.1.smithi087.stdout:4/97: symlink d2/d9/da/d1a/d26/l28 0 2024-02-28T16:01:43.471 INFO:tasks.workunit.client.1.smithi087.stdout:4/98: stat d2/d9/de/f19 0 2024-02-28T16:01:43.472 INFO:tasks.workunit.client.1.smithi087.stdout:4/99: read d2/f4 [321535,65210] 0 2024-02-28T16:01:43.476 INFO:tasks.workunit.client.1.smithi087.stdout:4/100: link d2/f4 d2/d9/da/d1a/d26/f29 0 2024-02-28T16:01:43.490 INFO:tasks.workunit.client.1.smithi087.stdout:4/101: dwrite d2/f20 [0,4194304] 0 2024-02-28T16:01:43.532 INFO:tasks.workunit.client.1.smithi087.stdout:4/102: truncate d2/d9/f21 3910585 0 2024-02-28T16:01:43.538 INFO:tasks.workunit.client.1.smithi087.stdout:4/103: getdents d2/d9/da 0 2024-02-28T16:01:43.540 INFO:tasks.workunit.client.1.smithi087.stdout:4/104: write d2/d9/d10/d22/f27 [912412,8862] 0 2024-02-28T16:01:43.543 INFO:tasks.workunit.client.1.smithi087.stdout:4/105: stat d2/d9/f21 0 2024-02-28T16:01:43.546 INFO:tasks.workunit.client.1.smithi087.stdout:4/106: mknod d2/d9/da/d1a/c2a 0 2024-02-28T16:01:43.550 INFO:tasks.workunit.client.1.smithi087.stdout:4/107: symlink d2/d9/da/d1a/l2b 0 2024-02-28T16:01:43.551 INFO:tasks.workunit.client.1.smithi087.stdout:4/108: chown d2/l6 2342475 1 2024-02-28T16:01:43.559 INFO:tasks.workunit.client.1.smithi087.stdout:4/109: rename d2/d9/d10/d22/f23 to d2/d9/f2c 0 2024-02-28T16:01:43.567 INFO:tasks.workunit.client.1.smithi087.stdout:4/110: link d2/d9/de/f19 d2/d9/da/f2d 0 2024-02-28T16:01:43.586 INFO:tasks.workunit.client.1.smithi087.stdout:4/111: dwrite d2/d9/d10/d22/f27 [0,4194304] 0 2024-02-28T16:01:43.589 INFO:tasks.workunit.client.1.smithi087.stdout:4/112: mkdir d2/df/d2e 0 2024-02-28T16:01:43.591 INFO:tasks.workunit.client.1.smithi087.stdout:4/113: creat d2/f2f x:0 0 0 2024-02-28T16:01:44.361 INFO:tasks.workunit.client.0.smithi057.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-28T16:01:44.375 INFO:tasks.workunit.client.0.smithi057.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:01:44.375 INFO:tasks.workunit.client.0.smithi057.stderr:+ make 2024-02-28T16:01:44.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:44 smithi057 ceph-mon[28763]: pgmap v24: 65 pgs: 65 active+clean; 218 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 342 op/s 2024-02-28T16:01:44.456 INFO:tasks.workunit.client.0.smithi057.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-28T16:01:44.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:44 smithi087 ceph-mon[37122]: pgmap v24: 65 pgs: 65 active+clean; 218 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 342 op/s 2024-02-28T16:01:44.574 INFO:tasks.workunit.client.1.smithi087.stdout:5/5: sync 2024-02-28T16:01:44.574 INFO:tasks.workunit.client.1.smithi087.stdout:6/0: sync 2024-02-28T16:01:44.575 INFO:tasks.workunit.client.1.smithi087.stdout:5/6: stat c0 0 2024-02-28T16:01:44.575 INFO:tasks.workunit.client.1.smithi087.stdout:5/7: truncate - no filename 2024-02-28T16:01:44.576 INFO:tasks.workunit.client.1.smithi087.stdout:5/8: readlink l1 0 2024-02-28T16:01:44.578 INFO:tasks.workunit.client.1.smithi087.stdout:6/1: mknod c0 0 2024-02-28T16:01:44.578 INFO:tasks.workunit.client.1.smithi087.stdout:6/2: fdatasync - no filename 2024-02-28T16:01:44.579 INFO:tasks.workunit.client.1.smithi087.stdout:6/3: fsync - no filename 2024-02-28T16:01:44.583 INFO:tasks.workunit.client.1.smithi087.stdout:6/4: symlink l1 0 2024-02-28T16:01:44.584 INFO:tasks.workunit.client.1.smithi087.stdout:6/5: readlink l1 0 2024-02-28T16:01:44.586 INFO:tasks.workunit.client.1.smithi087.stdout:6/6: chown l1 102819815 1 2024-02-28T16:01:44.586 INFO:tasks.workunit.client.1.smithi087.stdout:6/7: dwrite - no filename 2024-02-28T16:01:44.587 INFO:tasks.workunit.client.1.smithi087.stdout:6/8: dwrite - no filename 2024-02-28T16:01:44.587 INFO:tasks.workunit.client.1.smithi087.stdout:6/9: write - no filename 2024-02-28T16:01:44.588 INFO:tasks.workunit.client.1.smithi087.stdout:5/9: link l1 l2 0 2024-02-28T16:01:44.592 INFO:tasks.workunit.client.1.smithi087.stdout:6/10: creat f2 x:0 0 0 2024-02-28T16:01:44.594 INFO:tasks.workunit.client.1.smithi087.stdout:5/10: mkdir d3 0 2024-02-28T16:01:44.594 INFO:tasks.workunit.client.1.smithi087.stdout:5/11: dwrite - no filename 2024-02-28T16:01:44.596 INFO:tasks.workunit.client.1.smithi087.stdout:6/11: symlink l3 0 2024-02-28T16:01:44.599 INFO:tasks.workunit.client.1.smithi087.stdout:5/12: getdents d3 0 2024-02-28T16:01:44.600 INFO:tasks.workunit.client.1.smithi087.stdout:5/13: dwrite - no filename 2024-02-28T16:01:44.600 INFO:tasks.workunit.client.1.smithi087.stdout:5/14: dwrite - no filename 2024-02-28T16:01:44.607 INFO:tasks.workunit.client.1.smithi087.stdout:5/15: creat d3/f4 x:0 0 0 2024-02-28T16:01:44.611 INFO:tasks.workunit.client.1.smithi087.stdout:5/16: write d3/f4 [263718,48030] 0 2024-02-28T16:01:44.614 INFO:tasks.workunit.client.1.smithi087.stdout:5/17: chown d3 4 1 2024-02-28T16:01:44.617 INFO:tasks.workunit.client.1.smithi087.stdout:5/18: readlink l2 0 2024-02-28T16:01:44.622 INFO:tasks.workunit.client.1.smithi087.stdout:5/19: read d3/f4 [98317,53582] 0 2024-02-28T16:01:44.709 INFO:tasks.workunit.client.1.smithi087.stdout:6/12: getdents . 0 2024-02-28T16:01:44.710 INFO:tasks.workunit.client.1.smithi087.stdout:5/20: rmdir d3 39 2024-02-28T16:01:44.713 INFO:tasks.workunit.client.1.smithi087.stdout:5/21: chown c0 5 1 2024-02-28T16:01:44.714 INFO:tasks.workunit.client.1.smithi087.stdout:6/13: mkdir d4 0 2024-02-28T16:01:44.715 INFO:tasks.workunit.client.1.smithi087.stdout:7/9: sync 2024-02-28T16:01:44.715 INFO:tasks.workunit.client.1.smithi087.stdout:8/35: sync 2024-02-28T16:01:44.719 INFO:tasks.workunit.client.1.smithi087.stdout:6/14: write f2 [640629,103169] 0 2024-02-28T16:01:44.720 INFO:tasks.workunit.client.1.smithi087.stdout:8/36: truncate d2/f3 4858547 0 2024-02-28T16:01:44.721 INFO:tasks.workunit.client.1.smithi087.stdout:5/22: unlink l2 0 2024-02-28T16:01:44.722 INFO:tasks.workunit.client.1.smithi087.stdout:8/37: fsync d2/f3 0 2024-02-28T16:01:44.725 INFO:tasks.workunit.client.1.smithi087.stdout:6/15: rename l3 to d4/l5 0 2024-02-28T16:01:44.728 INFO:tasks.workunit.client.1.smithi087.stdout:7/10: link f3 f4 0 2024-02-28T16:01:44.728 INFO:tasks.workunit.client.1.smithi087.stdout:7/11: readlink - no filename 2024-02-28T16:01:44.731 INFO:tasks.workunit.client.1.smithi087.stdout:8/38: creat d2/f5 x:0 0 0 2024-02-28T16:01:44.734 INFO:tasks.workunit.client.1.smithi087.stdout:5/23: mknod d3/c5 0 2024-02-28T16:01:44.735 INFO:tasks.workunit.client.1.smithi087.stdout:5/24: stat c0 0 2024-02-28T16:01:44.741 INFO:tasks.workunit.client.1.smithi087.stdout:5/25: mkdir d3/d6 0 2024-02-28T16:01:44.744 INFO:tasks.workunit.client.1.smithi087.stdout:8/39: link d2/f5 d2/f6 0 2024-02-28T16:01:44.747 INFO:tasks.workunit.client.1.smithi087.stdout:5/26: fsync d3/f4 0 2024-02-28T16:01:44.751 INFO:tasks.workunit.client.1.smithi087.stdout:6/16: rename d4/l5 to d4/l6 0 2024-02-28T16:01:44.752 INFO:tasks.workunit.client.1.smithi087.stdout:7/12: fsync f4 0 2024-02-28T16:01:44.753 INFO:tasks.workunit.client.1.smithi087.stdout:6/17: write f2 [303193,31715] 0 2024-02-28T16:01:44.757 INFO:tasks.workunit.client.1.smithi087.stdout:5/27: dread d3/f4 [0,4194304] 0 2024-02-28T16:01:44.757 INFO:tasks.workunit.client.1.smithi087.stdout:7/13: mknod c5 0 2024-02-28T16:01:44.757 INFO:tasks.workunit.client.1.smithi087.stdout:6/18: fdatasync f2 0 2024-02-28T16:01:44.759 INFO:tasks.workunit.client.1.smithi087.stdout:5/28: chown d3/d6 455933 1 2024-02-28T16:01:44.760 INFO:tasks.workunit.client.1.smithi087.stdout:7/14: read f2 [117682,125891] 0 2024-02-28T16:01:44.760 INFO:tasks.workunit.client.1.smithi087.stdout:5/29: chown d3/f4 3641 1 2024-02-28T16:01:44.762 INFO:tasks.workunit.client.1.smithi087.stdout:5/30: read d3/f4 [157278,1009] 0 2024-02-28T16:01:44.766 INFO:tasks.workunit.client.1.smithi087.stdout:7/15: write f3 [527192,32734] 0 2024-02-28T16:01:44.768 INFO:tasks.workunit.client.1.smithi087.stdout:5/31: unlink d3/f4 0 2024-02-28T16:01:44.772 INFO:tasks.workunit.client.1.smithi087.stdout:7/16: rename f2 to f6 0 2024-02-28T16:01:44.773 INFO:tasks.workunit.client.1.smithi087.stdout:6/19: getdents d4 0 2024-02-28T16:01:44.776 INFO:tasks.workunit.client.1.smithi087.stdout:5/32: mknod d3/d6/c7 0 2024-02-28T16:01:44.777 INFO:tasks.workunit.client.1.smithi087.stdout:6/20: symlink d4/l7 0 2024-02-28T16:01:44.778 INFO:tasks.workunit.client.1.smithi087.stdout:6/21: chown f2 803 1 2024-02-28T16:01:44.779 INFO:tasks.workunit.client.1.smithi087.stdout:7/17: dread f4 [0,4194304] 0 2024-02-28T16:01:44.780 INFO:tasks.workunit.client.1.smithi087.stdout:5/33: creat d3/d6/f8 x:0 0 0 2024-02-28T16:01:44.781 INFO:tasks.workunit.client.1.smithi087.stdout:5/34: stat d3/d6/c7 0 2024-02-28T16:01:44.782 INFO:tasks.workunit.client.1.smithi087.stdout:5/35: fdatasync d3/d6/f8 0 2024-02-28T16:01:44.783 INFO:tasks.workunit.client.1.smithi087.stdout:6/22: creat d4/f8 x:0 0 0 2024-02-28T16:01:44.785 INFO:tasks.workunit.client.1.smithi087.stdout:6/23: creat d4/f9 x:0 0 0 2024-02-28T16:01:44.790 INFO:tasks.workunit.client.1.smithi087.stdout:7/18: rename f6 to f7 0 2024-02-28T16:01:44.813 INFO:tasks.workunit.client.1.smithi087.stdout:5/36: dwrite d3/d6/f8 [0,4194304] 0 2024-02-28T16:01:44.823 INFO:tasks.workunit.client.1.smithi087.stdout:6/24: dwrite f2 [0,4194304] 0 2024-02-28T16:01:44.824 INFO:tasks.workunit.client.1.smithi087.stdout:5/37: getdents d3/d6 0 2024-02-28T16:01:44.827 INFO:tasks.workunit.client.1.smithi087.stdout:7/19: dwrite f7 [0,4194304] 0 2024-02-28T16:01:44.827 INFO:tasks.workunit.client.1.smithi087.stdout:6/25: write d4/f8 [584884,3537] 0 2024-02-28T16:01:44.829 INFO:tasks.workunit.client.1.smithi087.stdout:5/38: mkdir d3/d9 0 2024-02-28T16:01:44.830 INFO:tasks.workunit.client.1.smithi087.stdout:7/20: truncate f7 4756183 0 2024-02-28T16:01:44.832 INFO:tasks.workunit.client.1.smithi087.stdout:6/26: rename f2 to d4/fa 0 2024-02-28T16:01:44.833 INFO:tasks.workunit.client.1.smithi087.stdout:5/39: write d3/d6/f8 [121197,84045] 0 2024-02-28T16:01:44.849 INFO:tasks.workunit.client.1.smithi087.stdout:2/38: sync 2024-02-28T16:01:44.849 INFO:tasks.workunit.client.1.smithi087.stdout:1/61: sync 2024-02-28T16:01:44.849 INFO:tasks.workunit.client.1.smithi087.stdout:0/91: sync 2024-02-28T16:01:44.849 INFO:tasks.workunit.client.1.smithi087.stdout:3/74: sync 2024-02-28T16:01:44.850 INFO:tasks.workunit.client.1.smithi087.stdout:9/46: sync 2024-02-28T16:01:44.850 INFO:tasks.workunit.client.1.smithi087.stdout:4/114: sync 2024-02-28T16:01:44.852 INFO:tasks.workunit.client.1.smithi087.stdout:9/47: dread - d7/f8 zero size 2024-02-28T16:01:44.853 INFO:tasks.workunit.client.1.smithi087.stdout:3/75: chown d11/l12 110 1 2024-02-28T16:01:44.854 INFO:tasks.workunit.client.1.smithi087.stdout:1/62: creat d0/ff x:0 0 0 2024-02-28T16:01:44.858 INFO:tasks.workunit.client.1.smithi087.stdout:0/92: stat d4/d6/dc/c10 0 2024-02-28T16:01:44.859 INFO:tasks.workunit.client.1.smithi087.stdout:2/39: mkdir d2/d7/df 0 2024-02-28T16:01:44.862 INFO:tasks.workunit.client.1.smithi087.stdout:6/27: rmdir d4 39 2024-02-28T16:01:44.863 INFO:tasks.workunit.client.1.smithi087.stdout:3/76: write ff [718707,90247] 0 2024-02-28T16:01:44.863 INFO:tasks.workunit.client.1.smithi087.stdout:0/93: chown d4/d6/dc 516252 1 2024-02-28T16:01:44.866 INFO:tasks.workunit.client.1.smithi087.stdout:5/40: truncate d3/d6/f8 1814722 0 2024-02-28T16:01:44.870 INFO:tasks.workunit.client.1.smithi087.stdout:7/21: dwrite f3 [0,4194304] 0 2024-02-28T16:01:44.876 INFO:tasks.workunit.client.1.smithi087.stdout:5/41: chown l1 0 1 2024-02-28T16:01:44.876 INFO:tasks.workunit.client.1.smithi087.stdout:3/77: creat d11/f1d x:0 0 0 2024-02-28T16:01:44.876 INFO:tasks.workunit.client.1.smithi087.stdout:0/94: write d4/d6/f12 [2367256,52963] 0 2024-02-28T16:01:44.880 INFO:tasks.workunit.client.1.smithi087.stdout:1/63: truncate d0/fa 3028121 0 2024-02-28T16:01:44.882 INFO:tasks.workunit.client.1.smithi087.stdout:7/22: chown f4 1406711 1 2024-02-28T16:01:44.888 INFO:tasks.workunit.client.1.smithi087.stdout:5/42: chown d3/d6/c7 7674270 1 2024-02-28T16:01:44.890 INFO:tasks.workunit.client.1.smithi087.stdout:7/23: chown f3 1 1 2024-02-28T16:01:44.890 INFO:tasks.workunit.client.1.smithi087.stdout:1/64: mknod d0/c10 0 2024-02-28T16:01:44.891 INFO:tasks.workunit.client.1.smithi087.stdout:6/28: dread d4/f8 [0,4194304] 0 2024-02-28T16:01:44.891 INFO:tasks.workunit.client.1.smithi087.stdout:0/95: mkdir d4/dd/d20/d27 0 2024-02-28T16:01:44.895 INFO:tasks.workunit.client.1.smithi087.stdout:3/78: link d11/f13 d11/f1e 0 2024-02-28T16:01:44.898 INFO:tasks.workunit.client.1.smithi087.stdout:6/29: chown l1 253 1 2024-02-28T16:01:44.899 INFO:tasks.workunit.client.1.smithi087.stdout:4/115: dwrite d2/f2f [0,4194304] 0 2024-02-28T16:01:44.899 INFO:tasks.workunit.client.1.smithi087.stdout:7/24: write f3 [2782997,116751] 0 2024-02-28T16:01:44.899 INFO:tasks.workunit.client.1.smithi087.stdout:1/65: dread - d0/fd zero size 2024-02-28T16:01:44.901 INFO:tasks.workunit.client.1.smithi087.stdout:0/96: chown d4/ca 1305550 1 2024-02-28T16:01:44.907 INFO:tasks.workunit.client.1.smithi087.stdout:3/79: mkdir d11/d1f 0 2024-02-28T16:01:44.911 INFO:tasks.workunit.client.1.smithi087.stdout:6/30: unlink d4/f8 0 2024-02-28T16:01:44.912 INFO:tasks.workunit.client.1.smithi087.stdout:9/48: dwrite d7/f8 [0,4194304] 0 2024-02-28T16:01:44.915 INFO:tasks.workunit.client.1.smithi087.stdout:6/31: readlink l1 0 2024-02-28T16:01:44.915 INFO:tasks.workunit.client.1.smithi087.stdout:2/40: dwrite d2/f9 [0,4194304] 0 2024-02-28T16:01:44.916 INFO:tasks.workunit.client.1.smithi087.stdout:1/66: creat d0/f11 x:0 0 0 2024-02-28T16:01:44.921 INFO:tasks.workunit.client.1.smithi087.stdout:8/40: sync 2024-02-28T16:01:44.921 INFO:tasks.workunit.client.1.smithi087.stdout:9/49: symlink d7/lb 0 2024-02-28T16:01:44.923 INFO:tasks.workunit.client.1.smithi087.stdout:9/50: readlink l5 0 2024-02-28T16:01:44.928 INFO:tasks.workunit.client.1.smithi087.stdout:1/67: write d0/f3 [6922490,80532] 0 2024-02-28T16:01:44.931 INFO:tasks.workunit.client.1.smithi087.stdout:5/43: getdents d3 0 2024-02-28T16:01:44.932 INFO:tasks.workunit.client.1.smithi087.stdout:8/41: dread d2/f3 [4194304,4194304] 0 2024-02-28T16:01:44.933 INFO:tasks.workunit.client.1.smithi087.stdout:9/51: mkdir d7/dc 0 2024-02-28T16:01:44.935 INFO:tasks.workunit.client.1.smithi087.stdout:1/68: chown d0/f2 1 1 2024-02-28T16:01:44.937 INFO:tasks.workunit.client.1.smithi087.stdout:5/44: rename d3/d6 to d3/d6/da 22 2024-02-28T16:01:44.939 INFO:tasks.workunit.client.1.smithi087.stdout:3/80: rmdir d11/d1f 0 2024-02-28T16:01:44.939 INFO:tasks.workunit.client.1.smithi087.stdout:2/41: creat d2/d7/df/f10 x:0 0 0 2024-02-28T16:01:44.941 INFO:tasks.workunit.client.1.smithi087.stdout:1/69: creat d0/f12 x:0 0 0 2024-02-28T16:01:44.941 INFO:tasks.workunit.client.1.smithi087.stdout:4/116: getdents d2/df 0 2024-02-28T16:01:44.942 INFO:tasks.workunit.client.1.smithi087.stdout:5/45: chown d3/d6/c7 6427 1 2024-02-28T16:01:44.943 INFO:tasks.workunit.client.1.smithi087.stdout:5/46: readlink l1 0 2024-02-28T16:01:44.946 INFO:tasks.workunit.client.1.smithi087.stdout:7/25: dread f3 [0,4194304] 0 2024-02-28T16:01:44.946 INFO:tasks.workunit.client.1.smithi087.stdout:2/42: unlink d2/f8 0 2024-02-28T16:01:44.946 INFO:tasks.workunit.client.1.smithi087.stdout:3/81: chown d11/f1b 59021482 1 2024-02-28T16:01:44.948 INFO:tasks.workunit.client.1.smithi087.stdout:0/97: dread d4/dd/f1b [0,4194304] 0 2024-02-28T16:01:44.948 INFO:tasks.workunit.client.1.smithi087.stdout:2/43: chown d2/d7 14 1 2024-02-28T16:01:44.949 INFO:tasks.workunit.client.1.smithi087.stdout:3/82: readlink d11/l12 0 2024-02-28T16:01:44.950 INFO:tasks.workunit.client.1.smithi087.stdout:1/70: mkdir d0/d13 0 2024-02-28T16:01:44.952 INFO:tasks.workunit.client.1.smithi087.stdout:4/117: symlink d2/d9/d10/d22/l30 0 2024-02-28T16:01:44.955 INFO:tasks.workunit.client.1.smithi087.stdout:6/32: dread d4/fa [0,4194304] 0 2024-02-28T16:01:44.956 INFO:tasks.workunit.client.1.smithi087.stdout:0/98: mknod d4/d6/c28 0 2024-02-28T16:01:44.959 INFO:tasks.workunit.client.1.smithi087.stdout:6/33: chown d4/l7 812 1 2024-02-28T16:01:44.960 INFO:tasks.workunit.client.1.smithi087.stdout:5/47: dread d3/d6/f8 [0,4194304] 0 2024-02-28T16:01:44.962 INFO:tasks.workunit.client.1.smithi087.stdout:3/83: rename d11/l1a to d11/l20 0 2024-02-28T16:01:44.965 INFO:tasks.workunit.client.1.smithi087.stdout:3/84: write d11/f15 [119085,71528] 0 2024-02-28T16:01:44.985 INFO:tasks.workunit.client.1.smithi087.stdout:9/52: getdents d7 0 2024-02-28T16:01:44.987 INFO:tasks.workunit.client.1.smithi087.stdout:3/85: symlink d11/l21 0 2024-02-28T16:01:44.991 INFO:tasks.workunit.client.1.smithi087.stdout:7/26: dread f3 [0,4194304] 0 2024-02-28T16:01:44.994 INFO:tasks.workunit.client.1.smithi087.stdout:2/44: truncate d2/f9 1845983 0 2024-02-28T16:01:45.010 INFO:tasks.workunit.client.1.smithi087.stdout:0/99: dwrite d4/f8 [0,4194304] 0 2024-02-28T16:01:45.011 INFO:tasks.workunit.client.1.smithi087.stdout:8/42: dwrite d2/f5 [0,4194304] 0 2024-02-28T16:01:45.018 INFO:tasks.workunit.client.1.smithi087.stdout:5/48: dwrite d3/d6/f8 [0,4194304] 0 2024-02-28T16:01:45.018 INFO:tasks.workunit.client.1.smithi087.stdout:8/43: write d2/f5 [3459647,121649] 0 2024-02-28T16:01:45.022 INFO:tasks.workunit.client.1.smithi087.stdout:1/71: dwrite d0/fa [0,4194304] 0 2024-02-28T16:01:45.034 INFO:tasks.workunit.client.1.smithi087.stdout:8/44: dread d2/f3 [0,4194304] 0 2024-02-28T16:01:45.126 INFO:tasks.workunit.client.1.smithi087.stdout:4/118: truncate d2/d9/da/d1a/d26/f29 88732 0 2024-02-28T16:01:45.129 INFO:tasks.workunit.client.1.smithi087.stdout:2/45: creat d2/d7/f11 x:0 0 0 2024-02-28T16:01:45.129 INFO:tasks.workunit.client.1.smithi087.stdout:0/100: rmdir d4/dd 39 2024-02-28T16:01:45.132 INFO:tasks.workunit.client.1.smithi087.stdout:5/49: creat d3/d6/fb x:0 0 0 2024-02-28T16:01:45.134 INFO:tasks.workunit.client.1.smithi087.stdout:1/72: unlink d0/f11 0 2024-02-28T16:01:45.134 INFO:tasks.workunit.client.1.smithi087.stdout:6/34: link d4/l6 d4/lb 0 2024-02-28T16:01:45.137 INFO:tasks.workunit.client.1.smithi087.stdout:3/86: rename le to d11/l22 0 2024-02-28T16:01:45.139 INFO:tasks.workunit.client.1.smithi087.stdout:3/87: chown d11/l21 1105 1 2024-02-28T16:01:45.139 INFO:tasks.workunit.client.1.smithi087.stdout:4/119: dread - d2/d9/da/f2d zero size 2024-02-28T16:01:45.147 INFO:tasks.workunit.client.1.smithi087.stdout:6/35: mkdir d4/dc 0 2024-02-28T16:01:45.148 INFO:tasks.workunit.client.1.smithi087.stdout:6/36: fsync d4/f9 0 2024-02-28T16:01:45.149 INFO:tasks.workunit.client.1.smithi087.stdout:3/88: mknod d11/c23 0 2024-02-28T16:01:45.149 INFO:tasks.workunit.client.1.smithi087.stdout:6/37: readlink l1 0 2024-02-28T16:01:45.151 INFO:tasks.workunit.client.1.smithi087.stdout:3/89: readlink d11/l12 0 2024-02-28T16:01:45.152 INFO:tasks.workunit.client.1.smithi087.stdout:6/38: dread - d4/f9 zero size 2024-02-28T16:01:45.156 INFO:tasks.workunit.client.1.smithi087.stdout:3/90: creat d11/f24 x:0 0 0 2024-02-28T16:01:45.157 INFO:tasks.workunit.client.1.smithi087.stdout:5/50: link c0 d3/d6/cc 0 2024-02-28T16:01:45.158 INFO:tasks.workunit.client.1.smithi087.stdout:8/45: getdents d2 0 2024-02-28T16:01:45.161 INFO:tasks.workunit.client.1.smithi087.stdout:4/120: dwrite d2/f2f [0,4194304] 0 2024-02-28T16:01:45.164 INFO:tasks.workunit.client.1.smithi087.stdout:0/101: creat d4/dd/f29 x:0 0 0 2024-02-28T16:01:45.171 INFO:tasks.workunit.client.1.smithi087.stdout:3/91: symlink d11/l25 0 2024-02-28T16:01:45.171 INFO:tasks.workunit.client.1.smithi087.stdout:3/92: readlink d11/l12 0 2024-02-28T16:01:45.171 INFO:tasks.workunit.client.1.smithi087.stdout:6/39: rename d4/lb to d4/ld 0 2024-02-28T16:01:45.174 INFO:tasks.workunit.client.1.smithi087.stdout:0/102: chown d4/c9 28356601 1 2024-02-28T16:01:45.174 INFO:tasks.workunit.client.1.smithi087.stdout:3/93: write d11/f1b [720723,17925] 0 2024-02-28T16:01:45.177 INFO:tasks.workunit.client.1.smithi087.stdout:4/121: rename d2/c16 to d2/d9/da/d1a/d26/c31 0 2024-02-28T16:01:45.177 INFO:tasks.workunit.client.1.smithi087.stdout:5/51: creat d3/d9/fd x:0 0 0 2024-02-28T16:01:45.181 INFO:tasks.workunit.client.1.smithi087.stdout:3/94: creat d11/f26 x:0 0 0 2024-02-28T16:01:45.184 INFO:tasks.workunit.client.1.smithi087.stdout:5/52: chown d3/d6/fb 4168 1 2024-02-28T16:01:45.184 INFO:tasks.workunit.client.1.smithi087.stdout:0/103: getdents d4/dd/d20/d1f 0 2024-02-28T16:01:45.185 INFO:tasks.workunit.client.1.smithi087.stdout:8/46: dwrite d2/f6 [0,4194304] 0 2024-02-28T16:01:45.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/47: write d2/f5 [1189849,62669] 0 2024-02-28T16:01:45.192 INFO:tasks.workunit.client.1.smithi087.stdout:5/53: chown d3/d6/fb 3342721 1 2024-02-28T16:01:45.196 INFO:tasks.workunit.client.1.smithi087.stdout:0/104: write d4/d6/f14 [2162270,13483] 0 2024-02-28T16:01:45.198 INFO:tasks.workunit.client.1.smithi087.stdout:8/48: symlink d2/l7 0 2024-02-28T16:01:45.200 INFO:tasks.workunit.client.1.smithi087.stdout:5/54: symlink d3/d6/le 0 2024-02-28T16:01:45.204 INFO:tasks.workunit.client.1.smithi087.stdout:0/105: dread - d4/dd/f29 zero size 2024-02-28T16:01:45.205 INFO:tasks.workunit.client.1.smithi087.stdout:6/40: dwrite d4/fa [0,4194304] 0 2024-02-28T16:01:45.205 INFO:tasks.workunit.client.1.smithi087.stdout:8/49: creat d2/f8 x:0 0 0 2024-02-28T16:01:45.207 INFO:tasks.workunit.client.1.smithi087.stdout:6/41: stat l1 0 2024-02-28T16:01:45.209 INFO:tasks.workunit.client.1.smithi087.stdout:5/55: creat d3/d6/ff x:0 0 0 2024-02-28T16:01:45.211 INFO:tasks.workunit.client.1.smithi087.stdout:8/50: mkdir d2/d9 0 2024-02-28T16:01:45.214 INFO:tasks.workunit.client.1.smithi087.stdout:0/106: creat d4/d6/f2a x:0 0 0 2024-02-28T16:01:45.214 INFO:tasks.workunit.client.1.smithi087.stdout:3/95: dwrite d11/f17 [0,4194304] 0 2024-02-28T16:01:45.217 INFO:tasks.workunit.client.1.smithi087.stdout:0/107: chown d4/ca 3 1 2024-02-28T16:01:45.221 INFO:tasks.workunit.client.1.smithi087.stdout:8/51: creat d2/fa x:0 0 0 2024-02-28T16:01:45.222 INFO:tasks.workunit.client.1.smithi087.stdout:6/42: unlink c0 0 2024-02-28T16:01:45.225 INFO:tasks.workunit.client.1.smithi087.stdout:8/52: chown d2/f8 5628028 1 2024-02-28T16:01:45.228 INFO:tasks.workunit.client.1.smithi087.stdout:0/108: creat d4/dd/d26/f2b x:0 0 0 2024-02-28T16:01:45.228 INFO:tasks.workunit.client.1.smithi087.stdout:8/53: chown d2/f8 11764 1 2024-02-28T16:01:45.231 INFO:tasks.workunit.client.1.smithi087.stdout:6/43: mkdir d4/dc/de 0 2024-02-28T16:01:45.233 INFO:tasks.workunit.client.1.smithi087.stdout:8/54: write d2/f8 [526180,128551] 0 2024-02-28T16:01:45.239 INFO:tasks.workunit.client.1.smithi087.stdout:0/109: rename d4/ca to d4/dd/d20/d1f/c2c 0 2024-02-28T16:01:45.245 INFO:tasks.workunit.client.1.smithi087.stdout:0/110: truncate d4/dd/f1b 4987566 0 2024-02-28T16:01:45.245 INFO:tasks.workunit.client.1.smithi087.stdout:8/55: creat d2/d9/fb x:0 0 0 2024-02-28T16:01:45.248 INFO:tasks.workunit.client.1.smithi087.stdout:5/56: dwrite d3/d6/fb [0,4194304] 0 2024-02-28T16:01:45.249 INFO:tasks.workunit.client.1.smithi087.stdout:8/56: dread - d2/d9/fb zero size 2024-02-28T16:01:45.252 INFO:tasks.workunit.client.1.smithi087.stdout:0/111: chown d4/dd/f13 1894923 1 2024-02-28T16:01:45.252 INFO:tasks.workunit.client.1.smithi087.stdout:5/57: write d3/d6/f8 [1309314,60880] 0 2024-02-28T16:01:45.258 INFO:tasks.workunit.client.1.smithi087.stdout:6/44: dwrite d4/fa [0,4194304] 0 2024-02-28T16:01:45.262 INFO:tasks.workunit.client.1.smithi087.stdout:5/58: creat d3/d6/f10 x:0 0 0 2024-02-28T16:01:45.262 INFO:tasks.workunit.client.1.smithi087.stdout:6/45: write d4/fa [4452039,5110] 0 2024-02-28T16:01:45.264 INFO:tasks.workunit.client.1.smithi087.stdout:0/112: creat d4/dd/f2d x:0 0 0 2024-02-28T16:01:45.267 INFO:tasks.workunit.client.1.smithi087.stdout:5/59: mknod d3/c11 0 2024-02-28T16:01:45.269 INFO:tasks.workunit.client.1.smithi087.stdout:5/60: write d3/d6/f8 [2999153,39962] 0 2024-02-28T16:01:45.270 INFO:tasks.workunit.client.1.smithi087.stdout:6/46: creat d4/dc/de/ff x:0 0 0 2024-02-28T16:01:45.271 INFO:tasks.workunit.client.1.smithi087.stdout:0/113: mkdir d4/dd/d20/d1f/d2e 0 2024-02-28T16:01:45.276 INFO:tasks.workunit.client.1.smithi087.stdout:5/61: unlink l1 0 2024-02-28T16:01:45.277 INFO:tasks.workunit.client.1.smithi087.stdout:6/47: mkdir d4/dc/d10 0 2024-02-28T16:01:45.278 INFO:tasks.workunit.client.1.smithi087.stdout:6/48: stat d4/dc 0 2024-02-28T16:01:45.280 INFO:tasks.workunit.client.1.smithi087.stdout:6/49: truncate d4/f9 864779 0 2024-02-28T16:01:45.285 INFO:tasks.workunit.client.1.smithi087.stdout:6/50: getdents d4/dc/d10 0 2024-02-28T16:01:45.287 INFO:tasks.workunit.client.0.smithi057.stderr:++ readlink -f fsstress 2024-02-28T16:01:45.288 INFO:tasks.workunit.client.1.smithi087.stdout:0/114: dread d4/d6/f12 [0,4194304] 0 2024-02-28T16:01:45.290 INFO:tasks.workunit.client.1.smithi087.stdout:6/51: mknod d4/dc/c11 0 2024-02-28T16:01:45.290 INFO:tasks.workunit.client.1.smithi087.stdout:0/115: fsync d4/d6/f12 0 2024-02-28T16:01:45.291 INFO:tasks.workunit.client.1.smithi087.stdout:6/52: chown d4/dc/d10 7739268 1 2024-02-28T16:01:45.291 INFO:tasks.workunit.client.0.smithi057.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-28T16:01:45.291 INFO:tasks.workunit.client.0.smithi057.stderr:+ popd 2024-02-28T16:01:45.292 INFO:tasks.workunit.client.1.smithi087.stdout:0/116: fdatasync d4/dd/d26/f2b 0 2024-02-28T16:01:45.294 INFO:tasks.workunit.client.1.smithi087.stdout:0/117: write d4/d6/f12 [5780725,89421] 0 2024-02-28T16:01:45.294 INFO:tasks.workunit.client.0.smithi057.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:01:45.294 INFO:tasks.workunit.client.0.smithi057.stderr:+ popd 2024-02-28T16:01:45.295 INFO:tasks.workunit.client.0.smithi057.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:01:45.296 INFO:tasks.workunit.client.0.smithi057.stderr:++ mktemp -d -p . 2024-02-28T16:01:45.297 INFO:tasks.workunit.client.1.smithi087.stdout:0/118: mknod d4/dd/d21/c2f 0 2024-02-28T16:01:45.300 INFO:tasks.workunit.client.0.smithi057.stderr:+ T=./tmp.GX0gvmrELa 2024-02-28T16:01:45.300 INFO:tasks.workunit.client.0.smithi057.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.GX0gvmrELa -l 1 -n 1000 -p 10 -v 2024-02-28T16:01:45.301 INFO:tasks.workunit.client.1.smithi087.stdout:0/119: symlink d4/dd/l30 0 2024-02-28T16:01:45.306 INFO:tasks.workunit.client.0.smithi057.stdout:seed = 1708886175 2024-02-28T16:01:45.313 INFO:tasks.workunit.client.1.smithi087.stdout:6/53: dwrite d4/f9 [0,4194304] 0 2024-02-28T16:01:45.313 INFO:tasks.workunit.client.0.smithi057.stdout:0/0: rename - no filename 2024-02-28T16:01:45.316 INFO:tasks.workunit.client.0.smithi057.stdout:1/0: rename - no filename 2024-02-28T16:01:45.316 INFO:tasks.workunit.client.0.smithi057.stdout:1/1: dread - no filename 2024-02-28T16:01:45.317 INFO:tasks.workunit.client.1.smithi087.stdout:6/54: chown d4/l6 5 1 2024-02-28T16:01:45.320 INFO:tasks.workunit.client.0.smithi057.stdout:0/1: creat f0 x:0 0 0 2024-02-28T16:01:45.321 INFO:tasks.workunit.client.0.smithi057.stdout:1/2: creat f0 x:0 0 0 2024-02-28T16:01:45.321 INFO:tasks.workunit.client.1.smithi087.stdout:6/55: write d4/fa [4711899,49018] 0 2024-02-28T16:01:45.323 INFO:tasks.workunit.client.0.smithi057.stdout:1/3: mkdir d1 0 2024-02-28T16:01:45.323 INFO:tasks.workunit.client.0.smithi057.stdout:0/2: read - f0 zero size 2024-02-28T16:01:45.323 INFO:tasks.workunit.client.1.smithi087.stdout:0/120: dwrite d4/dd/f1b [0,4194304] 0 2024-02-28T16:01:45.324 INFO:tasks.workunit.client.0.smithi057.stdout:2/0: mknod c0 0 2024-02-28T16:01:45.324 INFO:tasks.workunit.client.0.smithi057.stdout:1/4: chown d1 0 1 2024-02-28T16:01:45.325 INFO:tasks.workunit.client.1.smithi087.stdout:0/121: chown d4/dd/f13 412612 1 2024-02-28T16:01:45.327 INFO:tasks.workunit.client.1.smithi087.stdout:6/56: mkdir d4/d12 0 2024-02-28T16:01:45.328 INFO:tasks.workunit.client.0.smithi057.stdout:1/5: stat d1 0 2024-02-28T16:01:45.329 INFO:tasks.workunit.client.1.smithi087.stdout:0/122: write d4/d6/f14 [1071774,102279] 0 2024-02-28T16:01:45.330 INFO:tasks.workunit.client.0.smithi057.stdout:1/6: dread - f0 zero size 2024-02-28T16:01:45.331 INFO:tasks.workunit.client.0.smithi057.stdout:0/3: mknod c1 0 2024-02-28T16:01:45.331 INFO:tasks.workunit.client.0.smithi057.stdout:2/1: chown c0 430202 1 2024-02-28T16:01:45.331 INFO:tasks.workunit.client.0.smithi057.stdout:2/2: dread - no filename 2024-02-28T16:01:45.332 INFO:tasks.workunit.client.0.smithi057.stdout:1/7: rename d1 to d1/d2 22 2024-02-28T16:01:45.332 INFO:tasks.workunit.client.0.smithi057.stdout:4/0: write - no filename 2024-02-28T16:01:45.333 INFO:tasks.workunit.client.1.smithi087.stdout:0/123: rmdir d4/dd/d20 39 2024-02-28T16:01:45.333 INFO:tasks.workunit.client.0.smithi057.stdout:0/4: dread - f0 zero size 2024-02-28T16:01:45.336 INFO:tasks.workunit.client.0.smithi057.stdout:1/8: chown f0 20884150 1 2024-02-28T16:01:45.338 INFO:tasks.workunit.client.0.smithi057.stdout:3/0: symlink l0 0 2024-02-28T16:01:45.338 INFO:tasks.workunit.client.0.smithi057.stdout:1/9: stat d1 0 2024-02-28T16:01:45.339 INFO:tasks.workunit.client.1.smithi087.stdout:0/124: mkdir d4/dd/d20/d1f/d2e/d31 0 2024-02-28T16:01:45.340 INFO:tasks.workunit.client.0.smithi057.stdout:2/3: rename c0 to c1 0 2024-02-28T16:01:45.340 INFO:tasks.workunit.client.1.smithi087.stdout:0/125: readlink d4/d6/l1a 0 2024-02-28T16:01:45.341 INFO:tasks.workunit.client.0.smithi057.stdout:3/1: chown l0 422 1 2024-02-28T16:01:45.341 INFO:tasks.workunit.client.0.smithi057.stdout:3/2: write - no filename 2024-02-28T16:01:45.342 INFO:tasks.workunit.client.1.smithi087.stdout:6/57: dread d4/f9 [0,4194304] 0 2024-02-28T16:01:45.343 INFO:tasks.workunit.client.0.smithi057.stdout:0/5: symlink l2 0 2024-02-28T16:01:45.344 INFO:tasks.workunit.client.0.smithi057.stdout:0/6: dread - f0 zero size 2024-02-28T16:01:45.345 INFO:tasks.workunit.client.1.smithi087.stdout:6/58: write d4/fa [2243567,57265] 0 2024-02-28T16:01:45.348 INFO:tasks.workunit.client.0.smithi057.stdout:2/4: creat f2 x:0 0 0 2024-02-28T16:01:45.348 INFO:tasks.workunit.client.1.smithi087.stdout:2/46: fsync d2/d7/f11 0 2024-02-28T16:01:45.348 INFO:tasks.workunit.client.1.smithi087.stdout:9/53: truncate d7/f8 1563525 0 2024-02-28T16:01:45.348 INFO:tasks.workunit.client.0.smithi057.stdout:4/1: symlink l0 0 2024-02-28T16:01:45.350 INFO:tasks.workunit.client.0.smithi057.stdout:3/3: rename l0 to l1 0 2024-02-28T16:01:45.350 INFO:tasks.workunit.client.1.smithi087.stdout:1/73: getdents d0 0 2024-02-28T16:01:45.350 INFO:tasks.workunit.client.0.smithi057.stdout:2/5: write f2 [243773,81791] 0 2024-02-28T16:01:45.350 INFO:tasks.workunit.client.1.smithi087.stdout:7/27: truncate f3 2402830 0 2024-02-28T16:01:45.350 INFO:tasks.workunit.client.1.smithi087.stdout:7/28: rmdir - no directory 2024-02-28T16:01:45.351 INFO:tasks.workunit.client.0.smithi057.stdout:5/0: creat f0 x:0 0 0 2024-02-28T16:01:45.351 INFO:tasks.workunit.client.1.smithi087.stdout:6/59: mkdir d4/dc/de/d13 0 2024-02-28T16:01:45.354 INFO:tasks.workunit.client.1.smithi087.stdout:9/54: mkdir d7/dd 0 2024-02-28T16:01:45.357 INFO:tasks.workunit.client.1.smithi087.stdout:2/47: creat d2/d7/f12 x:0 0 0 2024-02-28T16:01:45.357 INFO:tasks.workunit.client.1.smithi087.stdout:2/48: stat d2/fb 0 2024-02-28T16:01:45.358 INFO:tasks.workunit.client.1.smithi087.stdout:2/49: readlink d2/d7/la 0 2024-02-28T16:01:45.361 INFO:tasks.workunit.client.0.smithi057.stdout:0/7: symlink l3 0 2024-02-28T16:01:45.363 INFO:tasks.workunit.client.1.smithi087.stdout:1/74: dread d0/f5 [0,4194304] 0 2024-02-28T16:01:45.365 INFO:tasks.workunit.client.0.smithi057.stdout:2/6: mknod c3 0 2024-02-28T16:01:45.365 INFO:tasks.workunit.client.1.smithi087.stdout:1/75: chown d0/f12 101 1 2024-02-28T16:01:45.368 INFO:tasks.workunit.client.1.smithi087.stdout:9/55: creat d7/dd/fe x:0 0 0 2024-02-28T16:01:45.368 INFO:tasks.workunit.client.0.smithi057.stdout:6/0: creat f0 x:0 0 0 2024-02-28T16:01:45.369 INFO:tasks.workunit.client.1.smithi087.stdout:9/56: dread - d7/fa zero size 2024-02-28T16:01:45.369 INFO:tasks.workunit.client.1.smithi087.stdout:1/76: mkdir d0/d14 0 2024-02-28T16:01:45.371 INFO:tasks.workunit.client.0.smithi057.stdout:8/0: truncate - no filename 2024-02-28T16:01:45.375 INFO:tasks.workunit.client.0.smithi057.stdout:7/0: symlink l0 0 2024-02-28T16:01:45.375 INFO:tasks.workunit.client.0.smithi057.stdout:7/1: dread - no filename 2024-02-28T16:01:45.375 INFO:tasks.workunit.client.0.smithi057.stdout:7/2: write - no filename 2024-02-28T16:01:45.377 INFO:tasks.workunit.client.1.smithi087.stdout:3/96: getdents d11 0 2024-02-28T16:01:45.378 INFO:tasks.workunit.client.0.smithi057.stdout:2/7: dread f2 [0,4194304] 0 2024-02-28T16:01:45.379 INFO:tasks.workunit.client.0.smithi057.stdout:6/1: truncate f0 445455 0 2024-02-28T16:01:45.380 INFO:tasks.workunit.client.1.smithi087.stdout:3/97: dread - d11/f26 zero size 2024-02-28T16:01:45.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/0: rmdir - no directory 2024-02-28T16:01:45.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/1: readlink - no filename 2024-02-28T16:01:45.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/2: rmdir - no directory 2024-02-28T16:01:45.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/3: dread - no filename 2024-02-28T16:01:45.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/4: rmdir - no directory 2024-02-28T16:01:45.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/5: fdatasync - no filename 2024-02-28T16:01:45.382 INFO:tasks.workunit.client.0.smithi057.stdout:7/3: chown l0 61387 1 2024-02-28T16:01:45.384 INFO:tasks.workunit.client.1.smithi087.stdout:3/98: dread - d11/f26 zero size 2024-02-28T16:01:45.387 INFO:tasks.workunit.client.0.smithi057.stdout:7/4: stat l0 0 2024-02-28T16:01:45.388 INFO:tasks.workunit.client.0.smithi057.stdout:2/8: truncate f2 720241 0 2024-02-28T16:01:45.392 INFO:tasks.workunit.client.0.smithi057.stdout:7/5: mknod c1 0 2024-02-28T16:01:45.392 INFO:tasks.workunit.client.0.smithi057.stdout:7/6: dread - no filename 2024-02-28T16:01:45.393 INFO:tasks.workunit.client.0.smithi057.stdout:9/6: creat f0 x:0 0 0 2024-02-28T16:01:45.396 INFO:tasks.workunit.client.0.smithi057.stdout:7/7: readlink l0 0 2024-02-28T16:01:45.396 INFO:tasks.workunit.client.0.smithi057.stdout:7/8: write - no filename 2024-02-28T16:01:45.398 INFO:tasks.workunit.client.0.smithi057.stdout:1/10: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.400 INFO:tasks.workunit.client.0.smithi057.stdout:5/1: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.400 INFO:tasks.workunit.client.1.smithi087.stdout:0/126: fsync d4/dd/f2d 0 2024-02-28T16:01:45.401 INFO:tasks.workunit.client.0.smithi057.stdout:9/7: mknod c1 0 2024-02-28T16:01:45.402 INFO:tasks.workunit.client.1.smithi087.stdout:2/50: dwrite d2/f9 [0,4194304] 0 2024-02-28T16:01:45.403 INFO:tasks.workunit.client.1.smithi087.stdout:8/57: getdents d2/d9 0 2024-02-28T16:01:45.403 INFO:tasks.workunit.client.1.smithi087.stdout:1/77: dwrite d0/fa [0,4194304] 0 2024-02-28T16:01:45.403 INFO:tasks.workunit.client.1.smithi087.stdout:5/62: getdents d3/d6 0 2024-02-28T16:01:45.405 INFO:tasks.workunit.client.0.smithi057.stdout:7/9: rename c1 to c2 0 2024-02-28T16:01:45.407 INFO:tasks.workunit.client.0.smithi057.stdout:9/8: mkdir d2 0 2024-02-28T16:01:45.408 INFO:tasks.workunit.client.1.smithi087.stdout:4/122: dwrite d2/d9/d10/f1d [0,4194304] 0 2024-02-28T16:01:45.409 INFO:tasks.workunit.client.0.smithi057.stdout:7/10: mknod c3 0 2024-02-28T16:01:45.409 INFO:tasks.workunit.client.0.smithi057.stdout:7/11: dread - no filename 2024-02-28T16:01:45.410 INFO:tasks.workunit.client.0.smithi057.stdout:9/9: chown c1 251770794 1 2024-02-28T16:01:45.415 INFO:tasks.workunit.client.0.smithi057.stdout:7/12: creat f4 x:0 0 0 2024-02-28T16:01:45.416 INFO:tasks.workunit.client.1.smithi087.stdout:0/127: mkdir d4/dd/d21/d32 0 2024-02-28T16:01:45.419 INFO:tasks.workunit.client.1.smithi087.stdout:5/63: rename d3/d6/ff to d3/f12 0 2024-02-28T16:01:45.421 INFO:tasks.workunit.client.1.smithi087.stdout:0/128: fdatasync d4/d6/f2a 0 2024-02-28T16:01:45.422 INFO:tasks.workunit.client.1.smithi087.stdout:4/123: creat d2/f32 x:0 0 0 2024-02-28T16:01:45.424 INFO:tasks.workunit.client.0.smithi057.stdout:7/13: mknod c5 0 2024-02-28T16:01:45.425 INFO:tasks.workunit.client.0.smithi057.stdout:9/10: mknod d2/c3 0 2024-02-28T16:01:45.428 INFO:tasks.workunit.client.1.smithi087.stdout:2/51: rename d2/d7/df/f10 to d2/d7/df/f13 0 2024-02-28T16:01:45.429 INFO:tasks.workunit.client.0.smithi057.stdout:9/11: truncate f0 786729 0 2024-02-28T16:01:45.434 INFO:tasks.workunit.client.1.smithi087.stdout:5/64: creat d3/f13 x:0 0 0 2024-02-28T16:01:45.436 INFO:tasks.workunit.client.1.smithi087.stdout:0/129: fsync d4/dd/f1b 0 2024-02-28T16:01:45.437 INFO:tasks.workunit.client.0.smithi057.stdout:9/12: chown d2/c3 167442 1 2024-02-28T16:01:45.439 INFO:tasks.workunit.client.0.smithi057.stdout:5/2: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.440 INFO:tasks.workunit.client.0.smithi057.stdout:9/13: symlink d2/l4 0 2024-02-28T16:01:45.443 INFO:tasks.workunit.client.0.smithi057.stdout:5/3: write f0 [3018111,107273] 0 2024-02-28T16:01:45.445 INFO:tasks.workunit.client.0.smithi057.stdout:5/4: chown f0 2605 1 2024-02-28T16:01:45.461 INFO:tasks.workunit.client.1.smithi087.stdout:0/130: creat d4/dd/d20/d1f/f33 x:0 0 0 2024-02-28T16:01:45.464 INFO:tasks.workunit.client.1.smithi087.stdout:5/65: mknod d3/c14 0 2024-02-28T16:01:45.466 INFO:tasks.workunit.client.0.smithi057.stdout:9/14: mkdir d2/d5 0 2024-02-28T16:01:45.467 INFO:tasks.workunit.client.0.smithi057.stdout:5/5: rename f0 to f1 0 2024-02-28T16:01:45.467 INFO:tasks.workunit.client.1.smithi087.stdout:8/58: dwrite d2/fa [0,4194304] 0 2024-02-28T16:01:45.469 INFO:tasks.workunit.client.0.smithi057.stdout:5/6: read f1 [2824877,13671] 0 2024-02-28T16:01:45.486 INFO:tasks.workunit.client.1.smithi087.stdout:6/60: dwrite d4/f9 [4194304,4194304] 0 2024-02-28T16:01:45.487 INFO:tasks.workunit.client.1.smithi087.stdout:1/78: dwrite d0/fa [0,4194304] 0 2024-02-28T16:01:45.488 INFO:tasks.workunit.client.1.smithi087.stdout:7/29: dread f3 [0,4194304] 0 2024-02-28T16:01:45.504 INFO:tasks.workunit.client.1.smithi087.stdout:9/57: link d7/f8 d7/dc/ff 0 2024-02-28T16:01:45.505 INFO:tasks.workunit.client.1.smithi087.stdout:1/79: dread - d0/f12 zero size 2024-02-28T16:01:45.506 INFO:tasks.workunit.client.1.smithi087.stdout:7/30: stat c5 0 2024-02-28T16:01:45.506 INFO:tasks.workunit.client.1.smithi087.stdout:7/31: rmdir - no directory 2024-02-28T16:01:45.506 INFO:tasks.workunit.client.1.smithi087.stdout:8/59: symlink d2/lc 0 2024-02-28T16:01:45.506 INFO:tasks.workunit.client.0.smithi057.stdout:0/8: fsync f0 0 2024-02-28T16:01:45.507 INFO:tasks.workunit.client.1.smithi087.stdout:0/131: mkdir d4/dd/d20/d1f/d34 0 2024-02-28T16:01:45.507 INFO:tasks.workunit.client.1.smithi087.stdout:2/52: dwrite d2/d7/f11 [0,4194304] 0 2024-02-28T16:01:45.508 INFO:tasks.workunit.client.0.smithi057.stdout:0/9: write f0 [718321,57429] 0 2024-02-28T16:01:45.512 INFO:tasks.workunit.client.0.smithi057.stdout:1/11: fdatasync f0 0 2024-02-28T16:01:45.512 INFO:tasks.workunit.client.1.smithi087.stdout:1/80: stat d0/lc 0 2024-02-28T16:01:45.514 INFO:tasks.workunit.client.1.smithi087.stdout:8/60: write d2/fa [4834477,35462] 0 2024-02-28T16:01:45.517 INFO:tasks.workunit.client.1.smithi087.stdout:2/53: readlink d2/d7/la 0 2024-02-28T16:01:45.522 INFO:tasks.workunit.client.1.smithi087.stdout:1/81: fdatasync d0/f5 0 2024-02-28T16:01:45.522 INFO:tasks.workunit.client.1.smithi087.stdout:2/54: fsync d2/fc 0 2024-02-28T16:01:45.524 INFO:tasks.workunit.client.1.smithi087.stdout:8/61: mkdir d2/d9/dd 0 2024-02-28T16:01:45.527 INFO:tasks.workunit.client.1.smithi087.stdout:5/66: dwrite d3/d9/fd [0,4194304] 0 2024-02-28T16:01:45.529 INFO:tasks.workunit.client.1.smithi087.stdout:0/132: creat d4/dd/d20/d1f/d34/f35 x:0 0 0 2024-02-28T16:01:45.532 INFO:tasks.workunit.client.0.smithi057.stdout:3/4: stat l1 0 2024-02-28T16:01:45.533 INFO:tasks.workunit.client.1.smithi087.stdout:6/61: dwrite d4/fa [0,4194304] 0 2024-02-28T16:01:45.535 INFO:tasks.workunit.client.0.smithi057.stdout:3/5: stat l1 0 2024-02-28T16:01:45.536 INFO:tasks.workunit.client.1.smithi087.stdout:8/62: mknod d2/ce 0 2024-02-28T16:01:45.542 INFO:tasks.workunit.client.1.smithi087.stdout:7/32: truncate f3 816283 0 2024-02-28T16:01:45.542 INFO:tasks.workunit.client.1.smithi087.stdout:9/58: dread f4 [0,4194304] 0 2024-02-28T16:01:45.542 INFO:tasks.workunit.client.1.smithi087.stdout:1/82: getdents d0/d14 0 2024-02-28T16:01:45.543 INFO:tasks.workunit.client.0.smithi057.stdout:0/10: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.544 INFO:tasks.workunit.client.1.smithi087.stdout:0/133: symlink d4/dd/d26/l36 0 2024-02-28T16:01:45.545 INFO:tasks.workunit.client.1.smithi087.stdout:5/67: write d3/f12 [265556,42881] 0 2024-02-28T16:01:45.545 INFO:tasks.workunit.client.1.smithi087.stdout:7/33: stat c5 0 2024-02-28T16:01:45.545 INFO:tasks.workunit.client.1.smithi087.stdout:7/34: readlink - no filename 2024-02-28T16:01:45.546 INFO:tasks.workunit.client.0.smithi057.stdout:1/12: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.549 INFO:tasks.workunit.client.0.smithi057.stdout:1/13: chown d1 176834 1 2024-02-28T16:01:45.549 INFO:tasks.workunit.client.1.smithi087.stdout:7/35: rename c5 to c8 0 2024-02-28T16:01:45.551 INFO:tasks.workunit.client.1.smithi087.stdout:1/83: dread d0/fb [0,4194304] 0 2024-02-28T16:01:45.560 INFO:tasks.workunit.client.1.smithi087.stdout:1/84: rmdir d0 39 2024-02-28T16:01:45.560 INFO:tasks.workunit.client.1.smithi087.stdout:5/68: creat d3/d9/f15 x:0 0 0 2024-02-28T16:01:45.560 INFO:tasks.workunit.client.1.smithi087.stdout:2/55: dread d2/f9 [0,4194304] 0 2024-02-28T16:01:45.563 INFO:tasks.workunit.client.1.smithi087.stdout:2/56: readlink d2/d7/le 0 2024-02-28T16:01:45.565 INFO:tasks.workunit.client.1.smithi087.stdout:0/134: truncate d4/dd/d20/d1f/f33 927232 0 2024-02-28T16:01:45.566 INFO:tasks.workunit.client.1.smithi087.stdout:5/69: write d3/f13 [189834,97206] 0 2024-02-28T16:01:45.568 INFO:tasks.workunit.client.0.smithi057.stdout:7/14: fsync f4 0 2024-02-28T16:01:45.574 INFO:tasks.workunit.client.0.smithi057.stdout:0/11: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.574 INFO:tasks.workunit.client.1.smithi087.stdout:2/57: chown d2/d7/le 31746290 1 2024-02-28T16:01:45.575 INFO:tasks.workunit.client.0.smithi057.stdout:0/12: write f0 [3536001,113716] 0 2024-02-28T16:01:45.576 INFO:tasks.workunit.client.1.smithi087.stdout:6/62: dwrite d4/dc/de/ff [0,4194304] 0 2024-02-28T16:01:45.576 INFO:tasks.workunit.client.1.smithi087.stdout:1/85: write d0/fb [92844,14663] 0 2024-02-28T16:01:45.576 INFO:tasks.workunit.client.1.smithi087.stdout:0/135: mkdir d4/dd/d37 0 2024-02-28T16:01:45.581 INFO:tasks.workunit.client.1.smithi087.stdout:9/59: dwrite f4 [0,4194304] 0 2024-02-28T16:01:45.582 INFO:tasks.workunit.client.1.smithi087.stdout:5/70: mknod d3/d9/c16 0 2024-02-28T16:01:45.584 INFO:tasks.workunit.client.1.smithi087.stdout:1/86: write d0/f3 [3395198,39596] 0 2024-02-28T16:01:45.585 INFO:tasks.workunit.client.1.smithi087.stdout:2/58: write d2/d7/f11 [3734131,53193] 0 2024-02-28T16:01:45.585 INFO:tasks.workunit.client.1.smithi087.stdout:8/63: dwrite d2/fa [0,4194304] 0 2024-02-28T16:01:45.587 INFO:tasks.workunit.client.1.smithi087.stdout:0/136: mknod d4/d6/c38 0 2024-02-28T16:01:45.587 INFO:tasks.workunit.client.1.smithi087.stdout:7/36: read f4 [581934,53853] 0 2024-02-28T16:01:45.589 INFO:tasks.workunit.client.1.smithi087.stdout:6/63: mknod d4/c14 0 2024-02-28T16:01:45.590 INFO:tasks.workunit.client.1.smithi087.stdout:6/64: fsync d4/fa 0 2024-02-28T16:01:45.593 INFO:tasks.workunit.client.1.smithi087.stdout:7/37: write f7 [1216143,3885] 0 2024-02-28T16:01:45.593 INFO:tasks.workunit.client.1.smithi087.stdout:6/65: rename d4 to d4/d12/d15 22 2024-02-28T16:01:45.593 INFO:tasks.workunit.client.1.smithi087.stdout:8/64: write d2/fa [2809896,806] 0 2024-02-28T16:01:45.596 INFO:tasks.workunit.client.1.smithi087.stdout:8/65: chown d2/ce 903825 1 2024-02-28T16:01:45.597 INFO:tasks.workunit.client.1.smithi087.stdout:5/71: fdatasync d3/f13 0 2024-02-28T16:01:45.597 INFO:tasks.workunit.client.1.smithi087.stdout:2/59: mknod d2/d7/c14 0 2024-02-28T16:01:45.605 INFO:tasks.workunit.client.0.smithi057.stdout:0/13: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.608 INFO:tasks.workunit.client.1.smithi087.stdout:9/60: mkdir d7/dc/d10 0 2024-02-28T16:01:45.611 INFO:tasks.workunit.client.1.smithi087.stdout:7/38: mknod c9 0 2024-02-28T16:01:45.612 INFO:tasks.workunit.client.1.smithi087.stdout:2/60: creat d2/d7/f15 x:0 0 0 2024-02-28T16:01:45.614 INFO:tasks.workunit.client.1.smithi087.stdout:8/66: rename d2/fa to d2/d9/dd/ff 0 2024-02-28T16:01:45.618 INFO:tasks.workunit.client.1.smithi087.stdout:2/61: stat d2/d7/df 0 2024-02-28T16:01:45.620 INFO:tasks.workunit.client.1.smithi087.stdout:1/87: dread d0/f3 [4194304,4194304] 0 2024-02-28T16:01:45.625 INFO:tasks.workunit.client.1.smithi087.stdout:6/66: fdatasync d4/dc/de/ff 0 2024-02-28T16:01:45.625 INFO:tasks.workunit.client.1.smithi087.stdout:2/62: dread - d2/fc zero size 2024-02-28T16:01:45.627 INFO:tasks.workunit.client.1.smithi087.stdout:7/39: write f4 [1036762,46935] 0 2024-02-28T16:01:45.627 INFO:tasks.workunit.client.1.smithi087.stdout:6/67: chown d4/dc/de 8 1 2024-02-28T16:01:45.635 INFO:tasks.workunit.client.0.smithi057.stdout:0/14: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.638 INFO:tasks.workunit.client.1.smithi087.stdout:0/137: dwrite d4/dd/f2d [0,4194304] 0 2024-02-28T16:01:45.642 INFO:tasks.workunit.client.1.smithi087.stdout:6/68: truncate d4/fa 1945247 0 2024-02-28T16:01:45.644 INFO:tasks.workunit.client.1.smithi087.stdout:1/88: rmdir d0/d13 0 2024-02-28T16:01:45.645 INFO:tasks.workunit.client.1.smithi087.stdout:8/67: dread d2/f8 [0,4194304] 0 2024-02-28T16:01:45.645 INFO:tasks.workunit.client.1.smithi087.stdout:5/72: dwrite d3/d9/f15 [0,4194304] 0 2024-02-28T16:01:45.646 INFO:tasks.workunit.client.1.smithi087.stdout:7/40: write f3 [1973706,48871] 0 2024-02-28T16:01:45.652 INFO:tasks.workunit.client.1.smithi087.stdout:7/41: write f7 [2773999,43872] 0 2024-02-28T16:01:45.653 INFO:tasks.workunit.client.1.smithi087.stdout:7/42: rmdir - no directory 2024-02-28T16:01:45.656 INFO:tasks.workunit.client.1.smithi087.stdout:8/68: mkdir d2/d9/d10 0 2024-02-28T16:01:45.656 INFO:tasks.workunit.client.1.smithi087.stdout:1/89: write d0/f3 [942655,120188] 0 2024-02-28T16:01:45.659 INFO:tasks.workunit.client.1.smithi087.stdout:5/73: symlink d3/d9/l17 0 2024-02-28T16:01:45.663 INFO:tasks.workunit.client.0.smithi057.stdout:0/15: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.665 INFO:tasks.workunit.client.1.smithi087.stdout:1/90: symlink d0/l15 0 2024-02-28T16:01:45.666 INFO:tasks.workunit.client.0.smithi057.stdout:0/16: read f0 [4088335,90792] 0 2024-02-28T16:01:45.674 INFO:tasks.workunit.client.1.smithi087.stdout:1/91: rename d0/f3 to d0/f16 0 2024-02-28T16:01:45.685 INFO:tasks.workunit.client.1.smithi087.stdout:9/61: dwrite d7/f8 [0,4194304] 0 2024-02-28T16:01:45.697 INFO:tasks.workunit.client.1.smithi087.stdout:0/138: dwrite d4/d6/f14 [0,4194304] 0 2024-02-28T16:01:45.702 INFO:tasks.workunit.client.1.smithi087.stdout:9/62: rmdir d7/dc 39 2024-02-28T16:01:45.702 INFO:tasks.workunit.client.1.smithi087.stdout:7/43: dwrite f4 [0,4194304] 0 2024-02-28T16:01:45.705 INFO:tasks.workunit.client.1.smithi087.stdout:9/63: fsync f4 0 2024-02-28T16:01:45.708 INFO:tasks.workunit.client.1.smithi087.stdout:6/69: dread d4/fa [0,4194304] 0 2024-02-28T16:01:45.711 INFO:tasks.workunit.client.0.smithi057.stdout:0/17: unlink l2 0 2024-02-28T16:01:45.711 INFO:tasks.workunit.client.1.smithi087.stdout:8/69: dwrite d2/d9/dd/ff [0,4194304] 0 2024-02-28T16:01:45.712 INFO:tasks.workunit.client.0.smithi057.stdout:1/14: mkdir d1/d3 0 2024-02-28T16:01:45.712 INFO:tasks.workunit.client.0.smithi057.stdout:1/15: readlink - no filename 2024-02-28T16:01:45.715 INFO:tasks.workunit.client.1.smithi087.stdout:7/44: stat c9 0 2024-02-28T16:01:45.719 INFO:tasks.workunit.client.0.smithi057.stdout:1/16: symlink d1/d3/l4 0 2024-02-28T16:01:45.721 INFO:tasks.workunit.client.1.smithi087.stdout:5/74: dwrite d3/d6/fb [0,4194304] 0 2024-02-28T16:01:45.722 INFO:tasks.workunit.client.1.smithi087.stdout:7/45: write f7 [3956686,42719] 0 2024-02-28T16:01:45.722 INFO:tasks.workunit.client.1.smithi087.stdout:6/70: creat d4/d12/f16 x:0 0 0 2024-02-28T16:01:45.723 INFO:tasks.workunit.client.1.smithi087.stdout:8/70: write d2/d9/dd/ff [1294756,21137] 0 2024-02-28T16:01:45.726 INFO:tasks.workunit.client.0.smithi057.stdout:1/17: symlink d1/l5 0 2024-02-28T16:01:45.731 INFO:tasks.workunit.client.1.smithi087.stdout:6/71: creat d4/dc/f17 x:0 0 0 2024-02-28T16:01:45.732 INFO:tasks.workunit.client.1.smithi087.stdout:1/92: dwrite d0/fd [0,4194304] 0 2024-02-28T16:01:45.733 INFO:tasks.workunit.client.0.smithi057.stdout:1/18: mknod d1/c6 0 2024-02-28T16:01:45.737 INFO:tasks.workunit.client.1.smithi087.stdout:8/71: symlink d2/d9/dd/l11 0 2024-02-28T16:01:45.738 INFO:tasks.workunit.client.1.smithi087.stdout:5/75: symlink d3/d9/l18 0 2024-02-28T16:01:45.738 INFO:tasks.workunit.client.0.smithi057.stdout:0/18: dread f0 [0,4194304] 0 2024-02-28T16:01:45.739 INFO:tasks.workunit.client.0.smithi057.stdout:1/19: creat d1/f7 x:0 0 0 2024-02-28T16:01:45.742 INFO:tasks.workunit.client.1.smithi087.stdout:8/72: read - d2/d9/fb zero size 2024-02-28T16:01:45.743 INFO:tasks.workunit.client.1.smithi087.stdout:6/72: mknod d4/dc/de/d13/c18 0 2024-02-28T16:01:45.745 INFO:tasks.workunit.client.1.smithi087.stdout:0/139: truncate d4/d6/f12 5504576 0 2024-02-28T16:01:45.749 INFO:tasks.workunit.client.0.smithi057.stdout:9/15: getdents d2 0 2024-02-28T16:01:45.749 INFO:tasks.workunit.client.0.smithi057.stdout:0/19: creat f4 x:0 0 0 2024-02-28T16:01:45.750 INFO:tasks.workunit.client.1.smithi087.stdout:6/73: rmdir d4/dc/de/d13 39 2024-02-28T16:01:45.751 INFO:tasks.workunit.client.0.smithi057.stdout:0/20: read f0 [3567684,115920] 0 2024-02-28T16:01:45.753 INFO:tasks.workunit.client.0.smithi057.stdout:9/16: chown d2/d5 0 1 2024-02-28T16:01:45.753 INFO:tasks.workunit.client.0.smithi057.stdout:5/7: getdents . 0 2024-02-28T16:01:45.755 INFO:tasks.workunit.client.0.smithi057.stdout:1/20: link d1/f7 d1/f8 0 2024-02-28T16:01:45.755 INFO:tasks.workunit.client.1.smithi087.stdout:9/64: truncate d7/dc/ff 2651100 0 2024-02-28T16:01:45.756 INFO:tasks.workunit.client.0.smithi057.stdout:0/21: truncate f0 4803410 0 2024-02-28T16:01:45.757 INFO:tasks.workunit.client.0.smithi057.stdout:1/21: dread - d1/f8 zero size 2024-02-28T16:01:45.758 INFO:tasks.workunit.client.0.smithi057.stdout:9/17: mkdir d2/d6 0 2024-02-28T16:01:45.759 INFO:tasks.workunit.client.1.smithi087.stdout:7/46: dread f7 [0,4194304] 0 2024-02-28T16:01:45.759 INFO:tasks.workunit.client.1.smithi087.stdout:8/73: rename d2/d9/dd/ff to d2/d9/d10/f12 0 2024-02-28T16:01:45.759 INFO:tasks.workunit.client.0.smithi057.stdout:0/22: write f4 [218860,109814] 0 2024-02-28T16:01:45.763 INFO:tasks.workunit.client.1.smithi087.stdout:6/74: creat d4/dc/d10/f19 x:0 0 0 2024-02-28T16:01:45.764 INFO:tasks.workunit.client.0.smithi057.stdout:0/23: chown f0 0 1 2024-02-28T16:01:45.765 INFO:tasks.workunit.client.1.smithi087.stdout:9/65: truncate f4 3983479 0 2024-02-28T16:01:45.768 INFO:tasks.workunit.client.1.smithi087.stdout:8/74: dread d2/f8 [0,4194304] 0 2024-02-28T16:01:45.772 INFO:tasks.workunit.client.1.smithi087.stdout:1/93: dwrite d0/fb [0,4194304] 0 2024-02-28T16:01:45.773 INFO:tasks.workunit.client.1.smithi087.stdout:8/75: chown d2/f6 440535 1 2024-02-28T16:01:45.775 INFO:tasks.workunit.client.0.smithi057.stdout:0/24: symlink l5 0 2024-02-28T16:01:45.775 INFO:tasks.workunit.client.0.smithi057.stdout:1/22: write d1/f8 [513179,69071] 0 2024-02-28T16:01:45.776 INFO:tasks.workunit.client.0.smithi057.stdout:5/8: dread f1 [0,4194304] 0 2024-02-28T16:01:45.777 INFO:tasks.workunit.client.1.smithi087.stdout:5/76: dwrite d3/d9/fd [0,4194304] 0 2024-02-28T16:01:45.779 INFO:tasks.workunit.client.1.smithi087.stdout:0/140: dread d4/f8 [0,4194304] 0 2024-02-28T16:01:45.782 INFO:tasks.workunit.client.1.smithi087.stdout:0/141: readlink d4/dd/l30 0 2024-02-28T16:01:45.783 INFO:tasks.workunit.client.1.smithi087.stdout:7/47: dread f3 [0,4194304] 0 2024-02-28T16:01:45.784 INFO:tasks.workunit.client.0.smithi057.stdout:9/18: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.785 INFO:tasks.workunit.client.1.smithi087.stdout:8/76: rename d2/lc to d2/d9/dd/l13 0 2024-02-28T16:01:45.787 INFO:tasks.workunit.client.0.smithi057.stdout:5/9: mkdir d2 0 2024-02-28T16:01:45.790 INFO:tasks.workunit.client.1.smithi087.stdout:1/94: creat d0/d14/f17 x:0 0 0 2024-02-28T16:01:45.791 INFO:tasks.workunit.client.1.smithi087.stdout:8/77: dread d2/f8 [0,4194304] 0 2024-02-28T16:01:45.794 INFO:tasks.workunit.client.1.smithi087.stdout:8/78: rename d2/d9/dd to d2/d9/dd/d14 22 2024-02-28T16:01:45.795 INFO:tasks.workunit.client.1.smithi087.stdout:0/142: unlink d4/dd/d20/f17 0 2024-02-28T16:01:45.795 INFO:tasks.workunit.client.1.smithi087.stdout:9/66: getdents d7/dc 0 2024-02-28T16:01:45.796 INFO:tasks.workunit.client.1.smithi087.stdout:6/75: link d4/c14 d4/dc/de/d13/c1a 0 2024-02-28T16:01:45.797 INFO:tasks.workunit.client.1.smithi087.stdout:7/48: write f4 [2262219,110221] 0 2024-02-28T16:01:45.799 INFO:tasks.workunit.client.1.smithi087.stdout:1/95: creat d0/d14/f18 x:0 0 0 2024-02-28T16:01:45.799 INFO:tasks.workunit.client.0.smithi057.stdout:5/10: write f1 [2055861,104434] 0 2024-02-28T16:01:45.799 INFO:tasks.workunit.client.0.smithi057.stdout:9/19: symlink d2/d5/l7 0 2024-02-28T16:01:45.799 INFO:tasks.workunit.client.1.smithi087.stdout:5/77: dread d3/d9/fd [0,4194304] 0 2024-02-28T16:01:45.801 INFO:tasks.workunit.client.1.smithi087.stdout:1/96: write d0/fb [2312857,21623] 0 2024-02-28T16:01:45.802 INFO:tasks.workunit.client.0.smithi057.stdout:1/23: dread f0 [0,4194304] 0 2024-02-28T16:01:45.806 INFO:tasks.workunit.client.1.smithi087.stdout:7/49: fsync f7 0 2024-02-28T16:01:45.807 INFO:tasks.workunit.client.1.smithi087.stdout:5/78: truncate d3/d6/f10 1042576 0 2024-02-28T16:01:45.807 INFO:tasks.workunit.client.1.smithi087.stdout:7/50: truncate f4 4856917 0 2024-02-28T16:01:45.811 INFO:tasks.workunit.client.1.smithi087.stdout:0/143: rmdir d4/dd/d20/d27 0 2024-02-28T16:01:45.812 INFO:tasks.workunit.client.0.smithi057.stdout:1/24: write f0 [3464445,126212] 0 2024-02-28T16:01:45.813 INFO:tasks.workunit.client.0.smithi057.stdout:5/11: creat d2/f3 x:0 0 0 2024-02-28T16:01:45.813 INFO:tasks.workunit.client.1.smithi087.stdout:6/76: truncate d4/dc/de/ff 365421 0 2024-02-28T16:01:45.816 INFO:tasks.workunit.client.1.smithi087.stdout:8/79: link d2/d9/dd/l11 d2/d9/dd/l15 0 2024-02-28T16:01:45.816 INFO:tasks.workunit.client.1.smithi087.stdout:6/77: write d4/dc/d10/f19 [207897,83602] 0 2024-02-28T16:01:45.817 INFO:tasks.workunit.client.1.smithi087.stdout:0/144: mkdir d4/dd/d37/d39 0 2024-02-28T16:01:45.830 INFO:tasks.workunit.client.0.smithi057.stdout:5/12: rename f1 to d2/f4 0 2024-02-28T16:01:45.830 INFO:tasks.workunit.client.0.smithi057.stdout:9/20: dwrite f0 [0,4194304] 0 2024-02-28T16:01:45.834 INFO:tasks.workunit.client.0.smithi057.stdout:9/21: creat d2/d5/f8 x:0 0 0 2024-02-28T16:01:45.841 INFO:tasks.workunit.client.0.smithi057.stdout:9/22: dread - d2/d5/f8 zero size 2024-02-28T16:01:45.845 INFO:tasks.workunit.client.0.smithi057.stdout:9/23: mkdir d2/d5/d9 0 2024-02-28T16:01:45.860 INFO:tasks.workunit.client.1.smithi087.stdout:0/145: write d4/d6/f2a [30873,36971] 0 2024-02-28T16:01:45.863 INFO:tasks.workunit.client.1.smithi087.stdout:8/80: write d2/d9/d10/f12 [1800842,124419] 0 2024-02-28T16:01:45.863 INFO:tasks.workunit.client.1.smithi087.stdout:7/51: getdents . 0 2024-02-28T16:01:45.865 INFO:tasks.workunit.client.0.smithi057.stdout:9/24: dwrite d2/d5/f8 [0,4194304] 0 2024-02-28T16:01:45.866 INFO:tasks.workunit.client.1.smithi087.stdout:7/52: chown c9 1 1 2024-02-28T16:01:45.867 INFO:tasks.workunit.client.1.smithi087.stdout:6/78: rename d4/c14 to d4/dc/c1b 0 2024-02-28T16:01:45.868 INFO:tasks.workunit.client.1.smithi087.stdout:0/146: dread - d4/dd/d20/d1f/d34/f35 zero size 2024-02-28T16:01:45.868 INFO:tasks.workunit.client.0.smithi057.stdout:9/25: fdatasync f0 0 2024-02-28T16:01:45.870 INFO:tasks.workunit.client.1.smithi087.stdout:5/79: dwrite d3/d6/fb [0,4194304] 0 2024-02-28T16:01:45.870 INFO:tasks.workunit.client.1.smithi087.stdout:7/53: link f4 fa 0 2024-02-28T16:01:45.872 INFO:tasks.workunit.client.1.smithi087.stdout:8/81: rename d2/f3 to d2/d9/f16 0 2024-02-28T16:01:45.875 INFO:tasks.workunit.client.0.smithi057.stdout:9/26: mknod d2/d6/ca 0 2024-02-28T16:01:45.876 INFO:tasks.workunit.client.1.smithi087.stdout:9/67: dwrite f4 [0,4194304] 0 2024-02-28T16:01:45.876 INFO:tasks.workunit.client.1.smithi087.stdout:5/80: write d3/d6/fb [3249308,101252] 0 2024-02-28T16:01:45.878 INFO:tasks.workunit.client.1.smithi087.stdout:6/79: mkdir d4/dc/de/d13/d1c 0 2024-02-28T16:01:45.878 INFO:tasks.workunit.client.1.smithi087.stdout:8/82: write d2/d9/fb [382484,54186] 0 2024-02-28T16:01:45.887 INFO:tasks.workunit.client.0.smithi057.stdout:9/27: creat d2/d5/d9/fb x:0 0 0 2024-02-28T16:01:45.889 INFO:tasks.workunit.client.0.smithi057.stdout:9/28: stat d2/c3 0 2024-02-28T16:01:45.890 INFO:tasks.workunit.client.1.smithi087.stdout:0/147: dread d4/d6/f14 [0,4194304] 0 2024-02-28T16:01:45.895 INFO:tasks.workunit.client.0.smithi057.stdout:9/29: readlink d2/d5/l7 0 2024-02-28T16:01:45.896 INFO:tasks.workunit.client.1.smithi087.stdout:6/80: creat d4/dc/de/f1d x:0 0 0 2024-02-28T16:01:45.899 INFO:tasks.workunit.client.1.smithi087.stdout:0/148: mkdir d4/dd/d37/d39/d3a 0 2024-02-28T16:01:45.900 INFO:tasks.workunit.client.0.smithi057.stdout:1/25: getdents d1/d3 0 2024-02-28T16:01:45.900 INFO:tasks.workunit.client.0.smithi057.stdout:1/26: chown d1 28 1 2024-02-28T16:01:45.900 INFO:tasks.workunit.client.0.smithi057.stdout:9/30: rename c1 to d2/cc 0 2024-02-28T16:01:45.903 INFO:tasks.workunit.client.0.smithi057.stdout:0/25: truncate f0 2262143 0 2024-02-28T16:01:45.903 INFO:tasks.workunit.client.0.smithi057.stdout:1/27: symlink d1/d3/l9 0 2024-02-28T16:01:45.903 INFO:tasks.workunit.client.1.smithi087.stdout:5/81: truncate d3/d9/f15 802262 0 2024-02-28T16:01:45.904 INFO:tasks.workunit.client.1.smithi087.stdout:5/82: stat d3/d9/fd 0 2024-02-28T16:01:45.905 INFO:tasks.workunit.client.0.smithi057.stdout:9/31: rmdir d2/d6 39 2024-02-28T16:01:45.905 INFO:tasks.workunit.client.1.smithi087.stdout:7/54: dwrite fa [0,4194304] 0 2024-02-28T16:01:45.907 INFO:tasks.workunit.client.1.smithi087.stdout:0/149: symlink d4/dd/d20/d1f/d2e/d31/l3b 0 2024-02-28T16:01:45.907 INFO:tasks.workunit.client.1.smithi087.stdout:8/83: truncate d2/f6 1996613 0 2024-02-28T16:01:45.908 INFO:tasks.workunit.client.0.smithi057.stdout:1/28: write d1/f8 [787215,109108] 0 2024-02-28T16:01:45.909 INFO:tasks.workunit.client.0.smithi057.stdout:0/26: dread f4 [0,4194304] 0 2024-02-28T16:01:45.911 INFO:tasks.workunit.client.1.smithi087.stdout:7/55: rename c9 to cb 0 2024-02-28T16:01:45.911 INFO:tasks.workunit.client.1.smithi087.stdout:0/150: write d4/dd/f29 [16597,6799] 0 2024-02-28T16:01:45.911 INFO:tasks.workunit.client.0.smithi057.stdout:0/27: readlink l5 0 2024-02-28T16:01:45.911 INFO:tasks.workunit.client.0.smithi057.stdout:5/13: getdents d2 0 2024-02-28T16:01:45.912 INFO:tasks.workunit.client.1.smithi087.stdout:8/84: chown d2/d9/d10/f12 11794384 1 2024-02-28T16:01:45.912 INFO:tasks.workunit.client.0.smithi057.stdout:0/28: write f4 [506014,55688] 0 2024-02-28T16:01:45.913 INFO:tasks.workunit.client.1.smithi087.stdout:6/81: write d4/fa [689526,12745] 0 2024-02-28T16:01:45.916 INFO:tasks.workunit.client.0.smithi057.stdout:9/32: symlink d2/d5/d9/ld 0 2024-02-28T16:01:45.916 INFO:tasks.workunit.client.0.smithi057.stdout:0/29: rmdir - no directory 2024-02-28T16:01:45.916 INFO:tasks.workunit.client.1.smithi087.stdout:7/56: unlink f3 0 2024-02-28T16:01:45.916 INFO:tasks.workunit.client.1.smithi087.stdout:5/83: getdents d3 0 2024-02-28T16:01:45.917 INFO:tasks.workunit.client.1.smithi087.stdout:9/68: dwrite d7/dc/ff [0,4194304] 0 2024-02-28T16:01:45.917 INFO:tasks.workunit.client.1.smithi087.stdout:6/82: dread - d4/d12/f16 zero size 2024-02-28T16:01:45.918 INFO:tasks.workunit.client.1.smithi087.stdout:0/151: write d4/dd/d26/f2b [157589,26192] 0 2024-02-28T16:01:45.918 INFO:tasks.workunit.client.0.smithi057.stdout:5/14: symlink d2/l5 0 2024-02-28T16:01:45.925 INFO:tasks.workunit.client.1.smithi087.stdout:5/84: write d3/f13 [558735,118941] 0 2024-02-28T16:01:45.925 INFO:tasks.workunit.client.1.smithi087.stdout:6/83: dread - d4/dc/f17 zero size 2024-02-28T16:01:45.928 INFO:tasks.workunit.client.1.smithi087.stdout:6/84: chown d4/dc/c11 961157 1 2024-02-28T16:01:45.928 INFO:tasks.workunit.client.0.smithi057.stdout:5/15: symlink d2/l6 0 2024-02-28T16:01:45.930 INFO:tasks.workunit.client.0.smithi057.stdout:9/33: mkdir d2/d6/de 0 2024-02-28T16:01:45.931 INFO:tasks.workunit.client.1.smithi087.stdout:6/85: fdatasync d4/fa 0 2024-02-28T16:01:45.932 INFO:tasks.workunit.client.0.smithi057.stdout:5/16: readlink d2/l6 0 2024-02-28T16:01:45.935 INFO:tasks.workunit.client.1.smithi087.stdout:5/85: getdents d3 0 2024-02-28T16:01:45.935 INFO:tasks.workunit.client.1.smithi087.stdout:6/86: fdatasync d4/fa 0 2024-02-28T16:01:45.936 INFO:tasks.workunit.client.0.smithi057.stdout:9/34: read d2/d5/f8 [2473613,273] 0 2024-02-28T16:01:45.942 INFO:tasks.workunit.client.0.smithi057.stdout:5/17: symlink d2/l7 0 2024-02-28T16:01:45.946 INFO:tasks.workunit.client.1.smithi087.stdout:7/57: dread fa [0,4194304] 0 2024-02-28T16:01:45.947 INFO:tasks.workunit.client.1.smithi087.stdout:9/69: dwrite d7/dc/ff [0,4194304] 0 2024-02-28T16:01:45.951 INFO:tasks.workunit.client.0.smithi057.stdout:9/35: creat d2/d6/ff x:0 0 0 2024-02-28T16:01:45.951 INFO:tasks.workunit.client.0.smithi057.stdout:1/29: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:01:45.952 INFO:tasks.workunit.client.1.smithi087.stdout:3/99: sync 2024-02-28T16:01:45.952 INFO:tasks.workunit.client.1.smithi087.stdout:8/85: dwrite d2/f8 [0,4194304] 0 2024-02-28T16:01:45.952 INFO:tasks.workunit.client.1.smithi087.stdout:6/87: creat d4/dc/de/d13/d1c/f1e x:0 0 0 2024-02-28T16:01:45.956 INFO:tasks.workunit.client.1.smithi087.stdout:5/86: dread d3/f13 [0,4194304] 0 2024-02-28T16:01:45.961 INFO:tasks.workunit.client.1.smithi087.stdout:6/88: creat d4/dc/f1f x:0 0 0 2024-02-28T16:01:45.962 INFO:tasks.workunit.client.0.smithi057.stdout:0/30: dwrite f4 [0,4194304] 0 2024-02-28T16:01:45.963 INFO:tasks.workunit.client.0.smithi057.stdout:9/36: write d2/d5/d9/fb [408300,57247] 0 2024-02-28T16:01:45.964 INFO:tasks.workunit.client.1.smithi087.stdout:8/86: creat d2/d9/f17 x:0 0 0 2024-02-28T16:01:45.965 INFO:tasks.workunit.client.1.smithi087.stdout:8/87: chown d2/d9 15055 1 2024-02-28T16:01:45.966 INFO:tasks.workunit.client.1.smithi087.stdout:5/87: unlink d3/d6/fb 0 2024-02-28T16:01:45.968 INFO:tasks.workunit.client.1.smithi087.stdout:6/89: creat d4/f20 x:0 0 0 2024-02-28T16:01:45.968 INFO:tasks.workunit.client.0.smithi057.stdout:0/31: write f4 [2250443,115888] 0 2024-02-28T16:01:45.972 INFO:tasks.workunit.client.1.smithi087.stdout:8/88: mkdir d2/d18 0 2024-02-28T16:01:45.974 INFO:tasks.workunit.client.1.smithi087.stdout:5/88: creat d3/d6/f19 x:0 0 0 2024-02-28T16:01:45.980 INFO:tasks.workunit.client.1.smithi087.stdout:9/70: dwrite f4 [0,4194304] 0 2024-02-28T16:01:45.981 INFO:tasks.workunit.client.0.smithi057.stdout:5/18: dread d2/f4 [0,4194304] 0 2024-02-28T16:01:45.983 INFO:tasks.workunit.client.1.smithi087.stdout:9/71: fdatasync d7/fa 0 2024-02-28T16:01:45.985 INFO:tasks.workunit.client.0.smithi057.stdout:1/30: dread d1/f8 [0,4194304] 0 2024-02-28T16:01:45.986 INFO:tasks.workunit.client.0.smithi057.stdout:5/19: rmdir d2 39 2024-02-28T16:01:45.993 INFO:tasks.workunit.client.0.smithi057.stdout:1/31: mknod d1/d3/ca 0 2024-02-28T16:01:45.994 INFO:tasks.workunit.client.1.smithi087.stdout:9/72: fsync d7/dd/fe 0 2024-02-28T16:01:45.995 INFO:tasks.workunit.client.1.smithi087.stdout:6/90: truncate d4/dc/de/ff 1347364 0 2024-02-28T16:01:45.995 INFO:tasks.workunit.client.0.smithi057.stdout:9/37: dread d2/d5/f8 [0,4194304] 0 2024-02-28T16:01:45.995 INFO:tasks.workunit.client.0.smithi057.stdout:5/20: unlink d2/l7 0 2024-02-28T16:01:45.996 INFO:tasks.workunit.client.1.smithi087.stdout:3/100: write d11/f13 [221495,80828] 0 2024-02-28T16:01:45.996 INFO:tasks.workunit.client.0.smithi057.stdout:1/32: chown f0 36827 1 2024-02-28T16:01:45.997 INFO:tasks.workunit.client.1.smithi087.stdout:5/89: write d3/d9/fd [1103047,2963] 0 2024-02-28T16:01:45.999 INFO:tasks.workunit.client.1.smithi087.stdout:3/101: dread - d11/f16 zero size 2024-02-28T16:01:45.999 INFO:tasks.workunit.client.1.smithi087.stdout:6/91: chown d4/dc/de/d13/c18 142097107 1 2024-02-28T16:01:46.000 INFO:tasks.workunit.client.0.smithi057.stdout:5/21: mkdir d2/d8 0 2024-02-28T16:01:46.000 INFO:tasks.workunit.client.0.smithi057.stdout:5/22: chown d2 74394 1 2024-02-28T16:01:46.002 INFO:tasks.workunit.client.0.smithi057.stdout:1/33: write d1/f7 [283920,4342] 0 2024-02-28T16:01:46.002 INFO:tasks.workunit.client.0.smithi057.stdout:9/38: creat d2/d6/f10 x:0 0 0 2024-02-28T16:01:46.004 INFO:tasks.workunit.client.0.smithi057.stdout:5/23: truncate d2/f3 82050 0 2024-02-28T16:01:46.005 INFO:tasks.workunit.client.1.smithi087.stdout:8/89: dwrite d2/d9/d10/f12 [0,4194304] 0 2024-02-28T16:01:46.011 INFO:tasks.workunit.client.0.smithi057.stdout:0/32: dread f0 [0,4194304] 0 2024-02-28T16:01:46.012 INFO:tasks.workunit.client.0.smithi057.stdout:5/24: write d2/f4 [3770821,114528] 0 2024-02-28T16:01:46.016 INFO:tasks.workunit.client.0.smithi057.stdout:0/33: mkdir d6 0 2024-02-28T16:01:46.021 INFO:tasks.workunit.client.0.smithi057.stdout:5/25: rename d2/f4 to d2/d8/f9 0 2024-02-28T16:01:46.022 INFO:tasks.workunit.client.0.smithi057.stdout:0/34: unlink l3 0 2024-02-28T16:01:46.025 INFO:tasks.workunit.client.0.smithi057.stdout:5/26: write d2/f3 [963722,37289] 0 2024-02-28T16:01:46.026 INFO:tasks.workunit.client.0.smithi057.stdout:0/35: symlink d6/l7 0 2024-02-28T16:01:46.030 INFO:tasks.workunit.client.0.smithi057.stdout:0/36: creat d6/f8 x:0 0 0 2024-02-28T16:01:46.032 INFO:tasks.workunit.client.0.smithi057.stdout:0/37: truncate d6/f8 965569 0 2024-02-28T16:01:46.035 INFO:tasks.workunit.client.0.smithi057.stdout:1/34: dwrite d1/f8 [0,4194304] 0 2024-02-28T16:01:46.035 INFO:tasks.workunit.client.0.smithi057.stdout:0/38: symlink d6/l9 0 2024-02-28T16:01:46.040 INFO:tasks.workunit.client.0.smithi057.stdout:0/39: creat d6/fa x:0 0 0 2024-02-28T16:01:46.042 INFO:tasks.workunit.client.0.smithi057.stdout:0/40: truncate f0 431182 0 2024-02-28T16:01:46.048 INFO:tasks.workunit.client.0.smithi057.stdout:0/41: link l5 d6/lb 0 2024-02-28T16:01:46.052 INFO:tasks.workunit.client.0.smithi057.stdout:0/42: write f4 [5009717,59824] 0 2024-02-28T16:01:46.054 INFO:tasks.workunit.client.0.smithi057.stdout:1/35: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:01:46.057 INFO:tasks.workunit.client.0.smithi057.stdout:5/27: dwrite d2/d8/f9 [0,4194304] 0 2024-02-28T16:01:46.059 INFO:tasks.workunit.client.0.smithi057.stdout:1/36: read d1/f8 [2521434,3482] 0 2024-02-28T16:01:46.059 INFO:tasks.workunit.client.1.smithi087.stdout:7/58: write fa [3287240,50346] 0 2024-02-28T16:01:46.059 INFO:tasks.workunit.client.1.smithi087.stdout:5/90: creat d3/d6/f1a x:0 0 0 2024-02-28T16:01:46.060 INFO:tasks.workunit.client.1.smithi087.stdout:3/102: symlink d11/l27 0 2024-02-28T16:01:46.061 INFO:tasks.workunit.client.0.smithi057.stdout:5/28: rename d2/d8 to d2/d8/da 22 2024-02-28T16:01:46.061 INFO:tasks.workunit.client.0.smithi057.stdout:1/37: chown d1/d3/l4 0 1 2024-02-28T16:01:46.062 INFO:tasks.workunit.client.1.smithi087.stdout:3/103: dread - d11/f26 zero size 2024-02-28T16:01:46.063 INFO:tasks.workunit.client.1.smithi087.stdout:8/90: creat d2/d9/f19 x:0 0 0 2024-02-28T16:01:46.064 INFO:tasks.workunit.client.0.smithi057.stdout:5/29: truncate d2/f3 1499707 0 2024-02-28T16:01:46.066 INFO:tasks.workunit.client.0.smithi057.stdout:5/30: chown d2/d8/f9 5625 1 2024-02-28T16:01:46.069 INFO:tasks.workunit.client.0.smithi057.stdout:5/31: write d2/d8/f9 [140365,76197] 0 2024-02-28T16:01:46.070 INFO:tasks.workunit.client.1.smithi087.stdout:5/91: mkdir d3/d9/d1b 0 2024-02-28T16:01:46.070 INFO:tasks.workunit.client.1.smithi087.stdout:8/91: fsync d2/d9/f16 0 2024-02-28T16:01:46.072 INFO:tasks.workunit.client.1.smithi087.stdout:7/59: creat fc x:0 0 0 2024-02-28T16:01:46.072 INFO:tasks.workunit.client.0.smithi057.stdout:5/32: write d2/f3 [282052,96860] 0 2024-02-28T16:01:46.073 INFO:tasks.workunit.client.1.smithi087.stdout:2/63: sync 2024-02-28T16:01:46.073 INFO:tasks.workunit.client.1.smithi087.stdout:4/124: sync 2024-02-28T16:01:46.073 INFO:tasks.workunit.client.0.smithi057.stdout:0/43: dread f4 [0,4194304] 0 2024-02-28T16:01:46.074 INFO:tasks.workunit.client.1.smithi087.stdout:5/92: unlink d3/d9/c16 0 2024-02-28T16:01:46.074 INFO:tasks.workunit.client.0.smithi057.stdout:0/44: chown d6 3549671 1 2024-02-28T16:01:46.075 INFO:tasks.workunit.client.0.smithi057.stdout:5/33: write d2/f3 [1674964,34163] 0 2024-02-28T16:01:46.075 INFO:tasks.workunit.client.0.smithi057.stdout:0/45: readlink d6/l9 0 2024-02-28T16:01:46.076 INFO:tasks.workunit.client.1.smithi087.stdout:2/64: fdatasync d2/d7/f15 0 2024-02-28T16:01:46.077 INFO:tasks.workunit.client.1.smithi087.stdout:7/60: stat c8 0 2024-02-28T16:01:46.077 INFO:tasks.workunit.client.1.smithi087.stdout:4/125: creat d2/d9/de/f33 x:0 0 0 2024-02-28T16:01:46.081 INFO:tasks.workunit.client.0.smithi057.stdout:0/46: mknod d6/cc 0 2024-02-28T16:01:46.081 INFO:tasks.workunit.client.0.smithi057.stdout:5/34: creat d2/d8/fb x:0 0 0 2024-02-28T16:01:46.081 INFO:tasks.workunit.client.1.smithi087.stdout:7/61: write fc [22406,75952] 0 2024-02-28T16:01:46.082 INFO:tasks.workunit.client.1.smithi087.stdout:4/126: truncate d2/f20 4562109 0 2024-02-28T16:01:46.084 INFO:tasks.workunit.client.0.smithi057.stdout:0/47: write d6/f8 [503149,117944] 0 2024-02-28T16:01:46.085 INFO:tasks.workunit.client.0.smithi057.stdout:5/35: truncate d2/f3 2610250 0 2024-02-28T16:01:46.085 INFO:tasks.workunit.client.1.smithi087.stdout:5/93: read d3/f12 [164543,113006] 0 2024-02-28T16:01:46.085 INFO:tasks.workunit.client.0.smithi057.stdout:0/48: stat d6/fa 0 2024-02-28T16:01:46.086 INFO:tasks.workunit.client.0.smithi057.stdout:1/38: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:01:46.087 INFO:tasks.workunit.client.0.smithi057.stdout:1/39: write d1/f7 [943638,78158] 0 2024-02-28T16:01:46.088 INFO:tasks.workunit.client.0.smithi057.stdout:5/36: creat d2/d8/fc x:0 0 0 2024-02-28T16:01:46.089 INFO:tasks.workunit.client.1.smithi087.stdout:7/62: chown f7 20 1 2024-02-28T16:01:46.089 INFO:tasks.workunit.client.1.smithi087.stdout:4/127: symlink d2/d9/d10/l34 0 2024-02-28T16:01:46.089 INFO:tasks.workunit.client.0.smithi057.stdout:5/37: chown d2/l6 163795194 1 2024-02-28T16:01:46.090 INFO:tasks.workunit.client.0.smithi057.stdout:1/40: creat d1/d3/fb x:0 0 0 2024-02-28T16:01:46.091 INFO:tasks.workunit.client.1.smithi087.stdout:3/104: dwrite d11/f1e [0,4194304] 0 2024-02-28T16:01:46.091 INFO:tasks.workunit.client.0.smithi057.stdout:5/38: chown d2/d8/fc 8597 1 2024-02-28T16:01:46.091 INFO:tasks.workunit.client.1.smithi087.stdout:6/92: truncate d4/dc/de/ff 1891730 0 2024-02-28T16:01:46.094 INFO:tasks.workunit.client.1.smithi087.stdout:6/93: dread - d4/f20 zero size 2024-02-28T16:01:46.098 INFO:tasks.workunit.client.1.smithi087.stdout:6/94: fsync d4/dc/d10/f19 0 2024-02-28T16:01:46.100 INFO:tasks.workunit.client.1.smithi087.stdout:8/92: dwrite d2/d9/f16 [4194304,4194304] 0 2024-02-28T16:01:46.103 INFO:tasks.workunit.client.1.smithi087.stdout:6/95: dread - d4/dc/de/f1d zero size 2024-02-28T16:01:46.103 INFO:tasks.workunit.client.1.smithi087.stdout:8/93: stat d2/d9/fb 0 2024-02-28T16:01:46.104 INFO:tasks.workunit.client.1.smithi087.stdout:3/105: creat d11/f28 x:0 0 0 2024-02-28T16:01:46.111 INFO:tasks.workunit.client.1.smithi087.stdout:8/94: write d2/d9/f17 [789282,16130] 0 2024-02-28T16:01:46.114 INFO:tasks.workunit.client.1.smithi087.stdout:3/106: creat d11/f29 x:0 0 0 2024-02-28T16:01:46.118 INFO:tasks.workunit.client.1.smithi087.stdout:8/95: mkdir d2/d9/d1a 0 2024-02-28T16:01:46.118 INFO:tasks.workunit.client.1.smithi087.stdout:2/65: dwrite d2/d7/df/f13 [0,4194304] 0 2024-02-28T16:01:46.125 INFO:tasks.workunit.client.1.smithi087.stdout:7/63: dwrite f4 [0,4194304] 0 2024-02-28T16:01:46.126 INFO:tasks.workunit.client.1.smithi087.stdout:3/107: creat d11/f2a x:0 0 0 2024-02-28T16:01:46.129 INFO:tasks.workunit.client.1.smithi087.stdout:7/64: stat f4 0 2024-02-28T16:01:46.136 INFO:tasks.workunit.client.1.smithi087.stdout:2/66: write d2/f9 [2680253,119132] 0 2024-02-28T16:01:46.148 INFO:tasks.workunit.client.1.smithi087.stdout:6/96: dwrite d4/f20 [0,4194304] 0 2024-02-28T16:01:46.151 INFO:tasks.workunit.client.1.smithi087.stdout:9/73: truncate d7/f8 316828 0 2024-02-28T16:01:46.154 INFO:tasks.workunit.client.1.smithi087.stdout:5/94: dwrite d3/f12 [0,4194304] 0 2024-02-28T16:01:46.155 INFO:tasks.workunit.client.1.smithi087.stdout:4/128: dwrite d2/df/f13 [0,4194304] 0 2024-02-28T16:01:46.157 INFO:tasks.workunit.client.1.smithi087.stdout:1/97: sync 2024-02-28T16:01:46.157 INFO:tasks.workunit.client.1.smithi087.stdout:0/152: sync 2024-02-28T16:01:46.160 INFO:tasks.workunit.client.1.smithi087.stdout:1/98: dread - d0/f12 zero size 2024-02-28T16:01:46.161 INFO:tasks.workunit.client.1.smithi087.stdout:2/67: mknod d2/d7/df/c16 0 2024-02-28T16:01:46.164 INFO:tasks.workunit.client.1.smithi087.stdout:1/99: chown d0/c6 563931405 1 2024-02-28T16:01:46.170 INFO:tasks.workunit.client.1.smithi087.stdout:6/97: creat d4/d12/f21 x:0 0 0 2024-02-28T16:01:46.175 INFO:tasks.workunit.client.1.smithi087.stdout:7/65: dwrite fc [0,4194304] 0 2024-02-28T16:01:46.176 INFO:tasks.workunit.client.1.smithi087.stdout:3/108: dread d11/f13 [0,4194304] 0 2024-02-28T16:01:46.176 INFO:tasks.workunit.client.1.smithi087.stdout:4/129: creat d2/d9/da/d1a/d26/f35 x:0 0 0 2024-02-28T16:01:46.178 INFO:tasks.workunit.client.1.smithi087.stdout:2/68: mkdir d2/d7/d17 0 2024-02-28T16:01:46.178 INFO:tasks.workunit.client.1.smithi087.stdout:8/96: dwrite d2/d9/d10/f12 [0,4194304] 0 2024-02-28T16:01:46.179 INFO:tasks.workunit.client.1.smithi087.stdout:5/95: write d3/d6/f8 [2321333,2277] 0 2024-02-28T16:01:46.179 INFO:tasks.workunit.client.1.smithi087.stdout:2/69: dread - d2/d7/f12 zero size 2024-02-28T16:01:46.180 INFO:tasks.workunit.client.0.smithi057.stdout:5/39: symlink d2/d8/ld 0 2024-02-28T16:01:46.184 INFO:tasks.workunit.client.1.smithi087.stdout:1/100: symlink d0/d14/l19 0 2024-02-28T16:01:46.186 INFO:tasks.workunit.client.1.smithi087.stdout:7/66: mknod cd 0 2024-02-28T16:01:46.187 INFO:tasks.workunit.client.0.smithi057.stdout:0/49: dread d6/f8 [0,4194304] 0 2024-02-28T16:01:46.188 INFO:tasks.workunit.client.1.smithi087.stdout:4/130: write d2/d9/f24 [958043,15771] 0 2024-02-28T16:01:46.189 INFO:tasks.workunit.client.1.smithi087.stdout:6/98: read d4/fa [1654605,118817] 0 2024-02-28T16:01:46.189 INFO:tasks.workunit.client.1.smithi087.stdout:2/70: readlink d2/d7/le 0 2024-02-28T16:01:46.190 INFO:tasks.workunit.client.0.smithi057.stdout:5/40: mknod d2/d8/ce 0 2024-02-28T16:01:46.191 INFO:tasks.workunit.client.1.smithi087.stdout:1/101: mkdir d0/d1a 0 2024-02-28T16:01:46.192 INFO:tasks.workunit.client.1.smithi087.stdout:2/71: write d2/fb [63807,128919] 0 2024-02-28T16:01:46.193 INFO:tasks.workunit.client.1.smithi087.stdout:8/97: read d2/d9/f17 [648306,109164] 0 2024-02-28T16:01:46.198 INFO:tasks.workunit.client.0.smithi057.stdout:1/41: dwrite d1/f8 [0,4194304] 0 2024-02-28T16:01:46.198 INFO:tasks.workunit.client.0.smithi057.stdout:5/41: symlink d2/d8/lf 0 2024-02-28T16:01:46.201 INFO:tasks.workunit.client.0.smithi057.stdout:5/42: chown d2/d8/lf 0 1 2024-02-28T16:01:46.203 INFO:tasks.workunit.client.0.smithi057.stdout:1/42: read - d1/d3/fb zero size 2024-02-28T16:01:46.206 INFO:tasks.workunit.client.0.smithi057.stdout:5/43: read d2/f3 [1230030,48899] 0 2024-02-28T16:01:46.208 INFO:tasks.workunit.client.1.smithi087.stdout:6/99: mknod d4/c22 0 2024-02-28T16:01:46.210 INFO:tasks.workunit.client.1.smithi087.stdout:0/153: dread d4/dd/f2d [0,4194304] 0 2024-02-28T16:01:46.211 INFO:tasks.workunit.client.0.smithi057.stdout:1/43: mkdir d1/d3/dc 0 2024-02-28T16:01:46.214 INFO:tasks.workunit.client.1.smithi087.stdout:1/102: write d0/f2 [3554944,102426] 0 2024-02-28T16:01:46.214 INFO:tasks.workunit.client.0.smithi057.stdout:0/50: dread f4 [0,4194304] 0 2024-02-28T16:01:46.221 INFO:tasks.workunit.client.1.smithi087.stdout:2/72: creat d2/d7/f18 x:0 0 0 2024-02-28T16:01:46.221 INFO:tasks.workunit.client.1.smithi087.stdout:8/98: mkdir d2/d1b 0 2024-02-28T16:01:46.221 INFO:tasks.workunit.client.0.smithi057.stdout:5/44: rename d2/f3 to d2/f10 0 2024-02-28T16:01:46.222 INFO:tasks.workunit.client.1.smithi087.stdout:6/100: creat d4/f23 x:0 0 0 2024-02-28T16:01:46.224 INFO:tasks.workunit.client.1.smithi087.stdout:1/103: mkdir d0/d1b 0 2024-02-28T16:01:46.230 INFO:tasks.workunit.client.1.smithi087.stdout:0/154: unlink d4/d6/cf 0 2024-02-28T16:01:46.230 INFO:tasks.workunit.client.1.smithi087.stdout:6/101: fdatasync d4/dc/de/f1d 0 2024-02-28T16:01:46.232 INFO:tasks.workunit.client.1.smithi087.stdout:2/73: chown d2/d7/df/c16 73777 1 2024-02-28T16:01:46.233 INFO:tasks.workunit.client.1.smithi087.stdout:1/104: symlink d0/d14/l1c 0 2024-02-28T16:01:46.236 INFO:tasks.workunit.client.1.smithi087.stdout:5/96: dwrite d3/d9/fd [0,4194304] 0 2024-02-28T16:01:46.236 INFO:tasks.workunit.client.0.smithi057.stdout:1/44: dread f0 [0,4194304] 0 2024-02-28T16:01:46.237 INFO:tasks.workunit.client.1.smithi087.stdout:4/131: link d2/f4 d2/d9/da/f36 0 2024-02-28T16:01:46.240 INFO:tasks.workunit.client.0.smithi057.stdout:1/45: symlink d1/ld 0 2024-02-28T16:01:46.242 INFO:tasks.workunit.client.1.smithi087.stdout:8/99: getdents d2/d9/d1a 0 2024-02-28T16:01:46.244 INFO:tasks.workunit.client.1.smithi087.stdout:7/67: dwrite fc [0,4194304] 0 2024-02-28T16:01:46.244 INFO:tasks.workunit.client.1.smithi087.stdout:1/105: chown d0/d14/f18 19008 1 2024-02-28T16:01:46.248 INFO:tasks.workunit.client.0.smithi057.stdout:1/46: chown d1/f7 13991898 1 2024-02-28T16:01:46.249 INFO:tasks.workunit.client.0.smithi057.stdout:1/47: chown d1/d3 528403738 1 2024-02-28T16:01:46.250 INFO:tasks.workunit.client.1.smithi087.stdout:0/155: rename d4/dd/d26/l36 to d4/d6/dc/l3c 0 2024-02-28T16:01:46.255 INFO:tasks.workunit.client.1.smithi087.stdout:1/106: readlink d0/l15 0 2024-02-28T16:01:46.256 INFO:tasks.workunit.client.1.smithi087.stdout:4/132: mknod d2/d9/de/c37 0 2024-02-28T16:01:46.262 INFO:tasks.workunit.client.0.smithi057.stdout:1/48: getdents d1/d3/dc 0 2024-02-28T16:01:46.267 INFO:tasks.workunit.client.1.smithi087.stdout:4/133: fsync d2/df/f13 0 2024-02-28T16:01:46.268 INFO:tasks.workunit.client.0.smithi057.stdout:1/49: rename f0 to d1/fe 0 2024-02-28T16:01:46.271 INFO:tasks.workunit.client.1.smithi087.stdout:1/107: dread - d0/d14/f17 zero size 2024-02-28T16:01:46.272 INFO:tasks.workunit.client.1.smithi087.stdout:6/102: creat d4/dc/de/f24 x:0 0 0 2024-02-28T16:01:46.275 INFO:tasks.workunit.client.1.smithi087.stdout:6/103: readlink l1 0 2024-02-28T16:01:46.275 INFO:tasks.workunit.client.1.smithi087.stdout:9/74: dwrite d7/f8 [0,4194304] 0 2024-02-28T16:01:46.276 INFO:tasks.workunit.client.0.smithi057.stdout:5/45: truncate d2/f10 1217669 0 2024-02-28T16:01:46.277 INFO:tasks.workunit.client.1.smithi087.stdout:0/156: creat d4/dd/d37/f3d x:0 0 0 2024-02-28T16:01:46.278 INFO:tasks.workunit.client.0.smithi057.stdout:5/46: write d2/d8/fb [93411,36612] 0 2024-02-28T16:01:46.281 INFO:tasks.workunit.client.1.smithi087.stdout:7/68: mknod ce 0 2024-02-28T16:01:46.281 INFO:tasks.workunit.client.1.smithi087.stdout:2/74: dwrite d2/d7/f15 [0,4194304] 0 2024-02-28T16:01:46.282 INFO:tasks.workunit.client.0.smithi057.stdout:1/50: link d1/f8 d1/d3/dc/ff 0 2024-02-28T16:01:46.282 INFO:tasks.workunit.client.1.smithi087.stdout:1/108: chown d0/ff 29217 1 2024-02-28T16:01:46.283 INFO:tasks.workunit.client.1.smithi087.stdout:5/97: rename d3/d6/f10 to d3/f1c 0 2024-02-28T16:01:46.283 INFO:tasks.workunit.client.0.smithi057.stdout:1/51: stat d1/d3/dc 0 2024-02-28T16:01:46.289 INFO:tasks.workunit.client.1.smithi087.stdout:1/109: dread - d0/ff zero size 2024-02-28T16:01:46.290 INFO:tasks.workunit.client.1.smithi087.stdout:0/157: mkdir d4/d6/d3e 0 2024-02-28T16:01:46.292 INFO:tasks.workunit.client.0.smithi057.stdout:5/47: link d2/d8/lf d2/d8/l11 0 2024-02-28T16:01:46.298 INFO:tasks.workunit.client.1.smithi087.stdout:8/100: dwrite d2/f8 [4194304,4194304] 0 2024-02-28T16:01:46.298 INFO:tasks.workunit.client.1.smithi087.stdout:2/75: creat d2/d7/f19 x:0 0 0 2024-02-28T16:01:46.298 INFO:tasks.workunit.client.1.smithi087.stdout:0/158: truncate d4/d6/f2a 1030197 0 2024-02-28T16:01:46.299 INFO:tasks.workunit.client.0.smithi057.stdout:5/48: mkdir d2/d12 0 2024-02-28T16:01:46.300 INFO:tasks.workunit.client.1.smithi087.stdout:2/76: fsync d2/d7/f18 0 2024-02-28T16:01:46.302 INFO:tasks.workunit.client.1.smithi087.stdout:1/110: mkdir d0/d1d 0 2024-02-28T16:01:46.306 INFO:tasks.workunit.client.0.smithi057.stdout:0/51: dwrite f0 [0,4194304] 0 2024-02-28T16:01:46.306 INFO:tasks.workunit.client.1.smithi087.stdout:4/134: link d2/d9/d10/d22/l30 d2/df/d2e/l38 0 2024-02-28T16:01:46.307 INFO:tasks.workunit.client.1.smithi087.stdout:9/75: getdents d7/dd 0 2024-02-28T16:01:46.310 INFO:tasks.workunit.client.1.smithi087.stdout:9/76: dread - d7/fa zero size 2024-02-28T16:01:46.311 INFO:tasks.workunit.client.1.smithi087.stdout:8/101: readlink d2/d9/dd/l13 0 2024-02-28T16:01:46.312 INFO:tasks.workunit.client.0.smithi057.stdout:0/52: creat d6/fd x:0 0 0 2024-02-28T16:01:46.317 INFO:tasks.workunit.client.1.smithi087.stdout:1/111: write d0/f16 [735835,50387] 0 2024-02-28T16:01:46.318 INFO:tasks.workunit.client.0.smithi057.stdout:0/53: symlink d6/le 0 2024-02-28T16:01:46.319 INFO:tasks.workunit.client.1.smithi087.stdout:0/159: symlink d4/dd/d37/d39/d3a/l3f 0 2024-02-28T16:01:46.319 INFO:tasks.workunit.client.1.smithi087.stdout:8/102: fsync d2/d9/f16 0 2024-02-28T16:01:46.319 INFO:tasks.workunit.client.1.smithi087.stdout:6/104: dread d4/dc/de/ff [0,4194304] 0 2024-02-28T16:01:46.320 INFO:tasks.workunit.client.1.smithi087.stdout:5/98: write d3/f12 [4691587,13588] 0 2024-02-28T16:01:46.322 INFO:tasks.workunit.client.0.smithi057.stdout:1/52: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:01:46.323 INFO:tasks.workunit.client.1.smithi087.stdout:9/77: creat d7/dc/f11 x:0 0 0 2024-02-28T16:01:46.326 INFO:tasks.workunit.client.1.smithi087.stdout:1/112: write d0/f2 [3993525,47108] 0 2024-02-28T16:01:46.327 INFO:tasks.workunit.client.1.smithi087.stdout:7/69: dwrite fa [0,4194304] 0 2024-02-28T16:01:46.330 INFO:tasks.workunit.client.1.smithi087.stdout:5/99: fdatasync d3/f13 0 2024-02-28T16:01:46.331 INFO:tasks.workunit.client.1.smithi087.stdout:1/113: chown d0/f2 4 1 2024-02-28T16:01:46.331 INFO:tasks.workunit.client.0.smithi057.stdout:1/53: write d1/fe [598796,130850] 0 2024-02-28T16:01:46.331 INFO:tasks.workunit.client.1.smithi087.stdout:8/103: write d2/d9/f19 [738218,77618] 0 2024-02-28T16:01:46.333 INFO:tasks.workunit.client.1.smithi087.stdout:0/160: fsync d4/dd/d20/d1f/d34/f35 0 2024-02-28T16:01:46.335 INFO:tasks.workunit.client.1.smithi087.stdout:8/104: stat d2/d9 0 2024-02-28T16:01:46.336 INFO:tasks.workunit.client.0.smithi057.stdout:0/54: fdatasync f0 0 2024-02-28T16:01:46.338 INFO:tasks.workunit.client.0.smithi057.stdout:5/49: truncate d2/d8/f9 491619 0 2024-02-28T16:01:46.340 INFO:tasks.workunit.client.0.smithi057.stdout:0/55: truncate d6/fd 823979 0 2024-02-28T16:01:46.341 INFO:tasks.workunit.client.1.smithi087.stdout:6/105: fdatasync d4/dc/de/ff 0 2024-02-28T16:01:46.342 INFO:tasks.workunit.client.1.smithi087.stdout:5/100: write d3/d6/f19 [410744,7172] 0 2024-02-28T16:01:46.343 INFO:tasks.workunit.client.0.smithi057.stdout:1/54: creat d1/d3/dc/f10 x:0 0 0 2024-02-28T16:01:46.344 INFO:tasks.workunit.client.1.smithi087.stdout:9/78: creat d7/f12 x:0 0 0 2024-02-28T16:01:46.345 INFO:tasks.workunit.client.1.smithi087.stdout:2/77: dwrite d2/d7/f19 [0,4194304] 0 2024-02-28T16:01:46.347 INFO:tasks.workunit.client.1.smithi087.stdout:8/105: symlink d2/l1c 0 2024-02-28T16:01:46.349 INFO:tasks.workunit.client.0.smithi057.stdout:0/56: rename d6/cc to d6/cf 0 2024-02-28T16:01:46.349 INFO:tasks.workunit.client.1.smithi087.stdout:7/70: mknod cf 0 2024-02-28T16:01:46.349 INFO:tasks.workunit.client.1.smithi087.stdout:7/71: rmdir - no directory 2024-02-28T16:01:46.353 INFO:tasks.workunit.client.1.smithi087.stdout:6/106: write d4/dc/f1f [1044583,127754] 0 2024-02-28T16:01:46.353 INFO:tasks.workunit.client.1.smithi087.stdout:9/79: write d7/f8 [4233810,31760] 0 2024-02-28T16:01:46.355 INFO:tasks.workunit.client.0.smithi057.stdout:0/57: creat d6/f10 x:0 0 0 2024-02-28T16:01:46.357 INFO:tasks.workunit.client.0.smithi057.stdout:1/55: fsync d1/d3/dc/ff 0 2024-02-28T16:01:46.358 INFO:tasks.workunit.client.1.smithi087.stdout:1/114: symlink d0/d1a/l1e 0 2024-02-28T16:01:46.361 INFO:tasks.workunit.client.0.smithi057.stdout:0/58: chown d6/fd 56 1 2024-02-28T16:01:46.363 INFO:tasks.workunit.client.1.smithi087.stdout:2/78: symlink d2/d7/l1a 0 2024-02-28T16:01:46.365 INFO:tasks.workunit.client.0.smithi057.stdout:1/56: creat d1/d3/f11 x:0 0 0 2024-02-28T16:01:46.365 INFO:tasks.workunit.client.1.smithi087.stdout:1/115: stat d0/l15 0 2024-02-28T16:01:46.365 INFO:tasks.workunit.client.1.smithi087.stdout:5/101: dread d3/d6/f19 [0,4194304] 0 2024-02-28T16:01:46.366 INFO:tasks.workunit.client.1.smithi087.stdout:4/135: dwrite d2/d9/de/f19 [0,4194304] 0 2024-02-28T16:01:46.366 INFO:tasks.workunit.client.1.smithi087.stdout:9/80: stat d7/dc/ff 0 2024-02-28T16:01:46.368 INFO:tasks.workunit.client.0.smithi057.stdout:5/50: dread d2/f10 [0,4194304] 0 2024-02-28T16:01:46.369 INFO:tasks.workunit.client.1.smithi087.stdout:5/102: dread - d3/d6/f1a zero size 2024-02-28T16:01:46.370 INFO:tasks.workunit.client.1.smithi087.stdout:2/79: mknod d2/d7/c1b 0 2024-02-28T16:01:46.370 INFO:tasks.workunit.client.0.smithi057.stdout:1/57: creat d1/d3/dc/f12 x:0 0 0 2024-02-28T16:01:46.371 INFO:tasks.workunit.client.1.smithi087.stdout:9/81: write d7/f8 [1079106,77004] 0 2024-02-28T16:01:46.372 INFO:tasks.workunit.client.1.smithi087.stdout:6/107: link l1 d4/l25 0 2024-02-28T16:01:46.373 INFO:tasks.workunit.client.1.smithi087.stdout:9/82: stat d7 0 2024-02-28T16:01:46.376 INFO:tasks.workunit.client.1.smithi087.stdout:7/72: creat f10 x:0 0 0 2024-02-28T16:01:46.376 INFO:tasks.workunit.client.0.smithi057.stdout:0/59: getdents d6 0 2024-02-28T16:01:46.377 INFO:tasks.workunit.client.1.smithi087.stdout:1/116: mkdir d0/d1b/d1f 0 2024-02-28T16:01:46.377 INFO:tasks.workunit.client.1.smithi087.stdout:3/109: sync 2024-02-28T16:01:46.379 INFO:tasks.workunit.client.0.smithi057.stdout:1/58: symlink d1/l13 0 2024-02-28T16:01:46.379 INFO:tasks.workunit.client.0.smithi057.stdout:0/60: symlink d6/l11 0 2024-02-28T16:01:46.379 INFO:tasks.workunit.client.1.smithi087.stdout:2/80: unlink c1 0 2024-02-28T16:01:46.379 INFO:tasks.workunit.client.1.smithi087.stdout:3/110: chown d11/f18 824 1 2024-02-28T16:01:46.382 INFO:tasks.workunit.client.0.smithi057.stdout:0/61: mkdir d6/d12 0 2024-02-28T16:01:46.384 INFO:tasks.workunit.client.1.smithi087.stdout:2/81: write d2/d7/f12 [246047,14542] 0 2024-02-28T16:01:46.385 INFO:tasks.workunit.client.1.smithi087.stdout:6/108: creat d4/f26 x:0 0 0 2024-02-28T16:01:46.386 INFO:tasks.workunit.client.1.smithi087.stdout:9/83: creat d7/dc/f13 x:0 0 0 2024-02-28T16:01:46.390 INFO:tasks.workunit.client.1.smithi087.stdout:5/103: rmdir d3/d9/d1b 0 2024-02-28T16:01:46.390 INFO:tasks.workunit.client.1.smithi087.stdout:3/111: fdatasync d11/f13 0 2024-02-28T16:01:46.394 INFO:tasks.workunit.client.1.smithi087.stdout:8/106: dwrite d2/d9/fb [0,4194304] 0 2024-02-28T16:01:46.394 INFO:tasks.workunit.client.1.smithi087.stdout:2/82: dread - d2/d7/f18 zero size 2024-02-28T16:01:46.394 INFO:tasks.workunit.client.1.smithi087.stdout:6/109: write d4/dc/de/f1d [333123,68426] 0 2024-02-28T16:01:46.395 INFO:tasks.workunit.client.0.smithi057.stdout:5/51: dwrite d2/f10 [0,4194304] 0 2024-02-28T16:01:46.396 INFO:tasks.workunit.client.0.smithi057.stdout:1/59: dread d1/f8 [0,4194304] 0 2024-02-28T16:01:46.397 INFO:tasks.workunit.client.1.smithi087.stdout:3/112: creat d11/f2b x:0 0 0 2024-02-28T16:01:46.397 INFO:tasks.workunit.client.0.smithi057.stdout:0/62: dread f0 [0,4194304] 0 2024-02-28T16:01:46.398 INFO:tasks.workunit.client.0.smithi057.stdout:5/52: creat d2/f13 x:0 0 0 2024-02-28T16:01:46.401 INFO:tasks.workunit.client.1.smithi087.stdout:7/73: creat f11 x:0 0 0 2024-02-28T16:01:46.403 INFO:tasks.workunit.client.1.smithi087.stdout:5/104: creat d3/d6/f1d x:0 0 0 2024-02-28T16:01:46.404 INFO:tasks.workunit.client.0.smithi057.stdout:5/53: rename d2/d8/ce to d2/c14 0 2024-02-28T16:01:46.406 INFO:tasks.workunit.client.0.smithi057.stdout:0/63: link d6/l11 d6/d12/l13 0 2024-02-28T16:01:46.409 INFO:tasks.workunit.client.0.smithi057.stdout:5/54: readlink d2/d8/lf 0 2024-02-28T16:01:46.410 INFO:tasks.workunit.client.1.smithi087.stdout:0/161: dwrite d4/d6/f12 [0,4194304] 0 2024-02-28T16:01:46.410 INFO:tasks.workunit.client.1.smithi087.stdout:3/113: rename d11/f16 to d11/f2c 0 2024-02-28T16:01:46.411 INFO:tasks.workunit.client.0.smithi057.stdout:0/64: symlink d6/l14 0 2024-02-28T16:01:46.411 INFO:tasks.workunit.client.0.smithi057.stdout:0/65: readlink d6/le 0 2024-02-28T16:01:46.412 INFO:tasks.workunit.client.1.smithi087.stdout:4/136: write d2/d9/f21 [3389503,78606] 0 2024-02-28T16:01:46.414 INFO:tasks.workunit.client.1.smithi087.stdout:8/107: mknod d2/d18/c1d 0 2024-02-28T16:01:46.415 INFO:tasks.workunit.client.1.smithi087.stdout:1/117: dwrite d0/fa [0,4194304] 0 2024-02-28T16:01:46.418 INFO:tasks.workunit.client.1.smithi087.stdout:3/114: readlink d11/l25 0 2024-02-28T16:01:46.418 INFO:tasks.workunit.client.1.smithi087.stdout:2/83: link d2/f9 d2/d7/df/f1c 0 2024-02-28T16:01:46.421 INFO:tasks.workunit.client.0.smithi057.stdout:1/60: dread d1/f7 [0,4194304] 0 2024-02-28T16:01:46.422 INFO:tasks.workunit.client.1.smithi087.stdout:5/105: link d3/d9/fd d3/d9/f1e 0 2024-02-28T16:01:46.424 INFO:tasks.workunit.client.1.smithi087.stdout:0/162: chown d4/d6/c25 12 1 2024-02-28T16:01:46.426 INFO:tasks.workunit.client.0.smithi057.stdout:1/61: chown d1/l5 16 1 2024-02-28T16:01:46.427 INFO:tasks.workunit.client.1.smithi087.stdout:7/74: rename fa to f12 0 2024-02-28T16:01:46.427 INFO:tasks.workunit.client.1.smithi087.stdout:1/118: truncate d0/d14/f18 193727 0 2024-02-28T16:01:46.429 INFO:tasks.workunit.client.1.smithi087.stdout:8/108: write d2/f8 [1465614,70388] 0 2024-02-28T16:01:46.429 INFO:tasks.workunit.client.1.smithi087.stdout:2/84: mknod d2/d7/c1d 0 2024-02-28T16:01:46.432 INFO:tasks.workunit.client.1.smithi087.stdout:4/137: dread d2/d9/da/f36 [0,4194304] 0 2024-02-28T16:01:46.432 INFO:tasks.workunit.client.1.smithi087.stdout:9/84: dwrite d7/dc/ff [0,4194304] 0 2024-02-28T16:01:46.433 INFO:tasks.workunit.client.1.smithi087.stdout:7/75: write f12 [3506436,19096] 0 2024-02-28T16:01:46.433 INFO:tasks.workunit.client.0.smithi057.stdout:1/62: mknod d1/d3/dc/c14 0 2024-02-28T16:01:46.433 INFO:tasks.workunit.client.1.smithi087.stdout:7/76: rmdir - no directory 2024-02-28T16:01:46.435 INFO:tasks.workunit.client.0.smithi057.stdout:1/63: chown d1/ld 60276 1 2024-02-28T16:01:46.437 INFO:tasks.workunit.client.0.smithi057.stdout:0/66: dwrite d6/fa [0,4194304] 0 2024-02-28T16:01:46.439 INFO:tasks.workunit.client.0.smithi057.stdout:1/64: chown d1/fe 230097 1 2024-02-28T16:01:46.439 INFO:tasks.workunit.client.0.smithi057.stdout:0/67: fdatasync d6/fd 0 2024-02-28T16:01:46.445 INFO:tasks.workunit.client.0.smithi057.stdout:1/65: mkdir d1/d3/dc/d15 0 2024-02-28T16:01:46.450 INFO:tasks.workunit.client.0.smithi057.stdout:1/66: chown d1/d3/dc/f12 4463 1 2024-02-28T16:01:46.456 INFO:tasks.workunit.client.1.smithi087.stdout:6/110: truncate d4/f9 1541950 0 2024-02-28T16:01:46.457 INFO:tasks.workunit.client.1.smithi087.stdout:2/85: creat d2/d7/df/f1e x:0 0 0 2024-02-28T16:01:46.457 INFO:tasks.workunit.client.0.smithi057.stdout:1/67: link d1/d3/f11 d1/d3/dc/d15/f16 0 2024-02-28T16:01:46.459 INFO:tasks.workunit.client.0.smithi057.stdout:1/68: dread - d1/d3/dc/d15/f16 zero size 2024-02-28T16:01:46.461 INFO:tasks.workunit.client.1.smithi087.stdout:4/138: getdents d2/d9/de 0 2024-02-28T16:01:46.462 INFO:tasks.workunit.client.1.smithi087.stdout:0/163: dread d4/d6/f14 [0,4194304] 0 2024-02-28T16:01:46.468 INFO:tasks.workunit.client.1.smithi087.stdout:1/119: dread d0/fd [0,4194304] 0 2024-02-28T16:01:46.470 INFO:tasks.workunit.client.1.smithi087.stdout:3/115: dwrite d11/f29 [0,4194304] 0 2024-02-28T16:01:46.471 INFO:tasks.workunit.client.1.smithi087.stdout:2/86: unlink d2/d7/l1a 0 2024-02-28T16:01:46.472 INFO:tasks.workunit.client.1.smithi087.stdout:1/120: readlink d0/l15 0 2024-02-28T16:01:46.476 INFO:tasks.workunit.client.1.smithi087.stdout:3/116: readlink d11/l12 0 2024-02-28T16:01:46.483 INFO:tasks.workunit.client.1.smithi087.stdout:8/109: write d2/f5 [2431507,70835] 0 2024-02-28T16:01:46.483 INFO:tasks.workunit.client.1.smithi087.stdout:1/121: chown d0/d1a/l1e 362 1 2024-02-28T16:01:46.485 INFO:tasks.workunit.client.1.smithi087.stdout:2/87: write d2/d7/f12 [1159281,57970] 0 2024-02-28T16:01:46.488 INFO:tasks.workunit.client.1.smithi087.stdout:5/106: dwrite d3/f1c [0,4194304] 0 2024-02-28T16:01:46.490 INFO:tasks.workunit.client.1.smithi087.stdout:6/111: unlink d4/ld 0 2024-02-28T16:01:46.491 INFO:tasks.workunit.client.1.smithi087.stdout:6/112: chown d4/dc/de 53 1 2024-02-28T16:01:46.493 INFO:tasks.workunit.client.1.smithi087.stdout:9/85: dwrite d7/f12 [0,4194304] 0 2024-02-28T16:01:46.494 INFO:tasks.workunit.client.0.smithi057.stdout:1/69: truncate d1/d3/f11 78164 0 2024-02-28T16:01:46.497 INFO:tasks.workunit.client.0.smithi057.stdout:5/55: dwrite d2/d8/f9 [0,4194304] 0 2024-02-28T16:01:46.498 INFO:tasks.workunit.client.1.smithi087.stdout:7/77: dwrite f4 [0,4194304] 0 2024-02-28T16:01:46.501 INFO:tasks.workunit.client.1.smithi087.stdout:8/110: mknod d2/d9/dd/c1e 0 2024-02-28T16:01:46.502 INFO:tasks.workunit.client.1.smithi087.stdout:3/117: creat d11/f2d x:0 0 0 2024-02-28T16:01:46.502 INFO:tasks.workunit.client.1.smithi087.stdout:6/113: write d4/d12/f21 [330200,3306] 0 2024-02-28T16:01:46.502 INFO:tasks.workunit.client.0.smithi057.stdout:1/70: stat d1/l5 0 2024-02-28T16:01:46.503 INFO:tasks.workunit.client.1.smithi087.stdout:1/122: creat d0/d14/f20 x:0 0 0 2024-02-28T16:01:46.505 INFO:tasks.workunit.client.1.smithi087.stdout:7/78: write f11 [697917,63433] 0 2024-02-28T16:01:46.505 INFO:tasks.workunit.client.1.smithi087.stdout:9/86: dread - d7/dc/f13 zero size 2024-02-28T16:01:46.505 INFO:tasks.workunit.client.1.smithi087.stdout:5/107: creat d3/f1f x:0 0 0 2024-02-28T16:01:46.508 INFO:tasks.workunit.client.0.smithi057.stdout:1/71: chown d1/f7 7 1 2024-02-28T16:01:46.508 INFO:tasks.workunit.client.0.smithi057.stdout:5/56: write d2/f10 [5199763,81065] 0 2024-02-28T16:01:46.512 INFO:tasks.workunit.client.1.smithi087.stdout:2/88: mknod d2/d7/df/c1f 0 2024-02-28T16:01:46.514 INFO:tasks.workunit.client.1.smithi087.stdout:3/118: creat d11/f2e x:0 0 0 2024-02-28T16:01:46.515 INFO:tasks.workunit.client.1.smithi087.stdout:0/164: dread d4/d6/f14 [0,4194304] 0 2024-02-28T16:01:46.517 INFO:tasks.workunit.client.0.smithi057.stdout:1/72: fdatasync d1/d3/fb 0 2024-02-28T16:01:46.518 INFO:tasks.workunit.client.1.smithi087.stdout:3/119: readlink d11/l25 0 2024-02-28T16:01:46.518 INFO:tasks.workunit.client.1.smithi087.stdout:1/123: chown d0/d14/l19 298510606 1 2024-02-28T16:01:46.518 INFO:tasks.workunit.client.1.smithi087.stdout:4/139: dread d2/df/f13 [0,4194304] 0 2024-02-28T16:01:46.519 INFO:tasks.workunit.client.1.smithi087.stdout:6/114: creat d4/dc/de/d13/d1c/f27 x:0 0 0 2024-02-28T16:01:46.522 INFO:tasks.workunit.client.0.smithi057.stdout:0/68: dwrite d6/f8 [0,4194304] 0 2024-02-28T16:01:46.524 INFO:tasks.workunit.client.1.smithi087.stdout:1/124: write d0/d14/f20 [71875,25846] 0 2024-02-28T16:01:46.524 INFO:tasks.workunit.client.1.smithi087.stdout:9/87: fdatasync d7/f12 0 2024-02-28T16:01:46.524 INFO:tasks.workunit.client.1.smithi087.stdout:6/115: chown d4/dc/c11 23840574 1 2024-02-28T16:01:46.527 INFO:tasks.workunit.client.1.smithi087.stdout:5/108: unlink c0 0 2024-02-28T16:01:46.536 INFO:tasks.workunit.client.1.smithi087.stdout:0/165: mknod d4/dd/d20/c40 0 2024-02-28T16:01:46.537 INFO:tasks.workunit.client.1.smithi087.stdout:8/111: rmdir d2/d1b 0 2024-02-28T16:01:46.539 INFO:tasks.workunit.client.1.smithi087.stdout:5/109: creat d3/d6/f20 x:0 0 0 2024-02-28T16:01:46.540 INFO:tasks.workunit.client.1.smithi087.stdout:8/112: chown d2/f8 2144904454 1 2024-02-28T16:01:46.540 INFO:tasks.workunit.client.1.smithi087.stdout:2/89: dread d2/d7/df/f1c [0,4194304] 0 2024-02-28T16:01:46.546 INFO:tasks.workunit.client.1.smithi087.stdout:4/140: fdatasync d2/f8 0 2024-02-28T16:01:46.546 INFO:tasks.workunit.client.1.smithi087.stdout:1/125: mknod d0/d1d/c21 0 2024-02-28T16:01:46.546 INFO:tasks.workunit.client.1.smithi087.stdout:0/166: dread d4/dd/d20/f1d [0,4194304] 0 2024-02-28T16:01:46.548 INFO:tasks.workunit.client.1.smithi087.stdout:4/141: fsync d2/d9/d10/f1d 0 2024-02-28T16:01:46.551 INFO:tasks.workunit.client.1.smithi087.stdout:5/110: fsync d3/f1f 0 2024-02-28T16:01:46.553 INFO:tasks.workunit.client.0.smithi057.stdout:5/57: mkdir d2/d15 0 2024-02-28T16:01:46.553 INFO:tasks.workunit.client.1.smithi087.stdout:8/113: symlink d2/d9/d10/l1f 0 2024-02-28T16:01:46.555 INFO:tasks.workunit.client.0.smithi057.stdout:5/58: write d2/f10 [5860693,46723] 0 2024-02-28T16:01:46.559 INFO:tasks.workunit.client.0.smithi057.stdout:0/69: unlink f4 0 2024-02-28T16:01:46.559 INFO:tasks.workunit.client.1.smithi087.stdout:2/90: unlink d2/c5 0 2024-02-28T16:01:46.559 INFO:tasks.workunit.client.1.smithi087.stdout:6/116: rmdir d4/dc/de/d13/d1c 39 2024-02-28T16:01:46.560 INFO:tasks.workunit.client.0.smithi057.stdout:5/59: creat d2/d8/f16 x:0 0 0 2024-02-28T16:01:46.561 INFO:tasks.workunit.client.0.smithi057.stdout:5/60: stat d2/l6 0 2024-02-28T16:01:46.561 INFO:tasks.workunit.client.0.smithi057.stdout:0/70: mknod d6/c15 0 2024-02-28T16:01:46.562 INFO:tasks.workunit.client.1.smithi087.stdout:1/126: creat d0/d1b/f22 x:0 0 0 2024-02-28T16:01:46.565 INFO:tasks.workunit.client.1.smithi087.stdout:0/167: write d4/dd/f13 [3570686,120938] 0 2024-02-28T16:01:46.566 INFO:tasks.workunit.client.0.smithi057.stdout:5/61: creat d2/d15/f17 x:0 0 0 2024-02-28T16:01:46.567 INFO:tasks.workunit.client.0.smithi057.stdout:0/71: link d6/f10 d6/f16 0 2024-02-28T16:01:46.568 INFO:tasks.workunit.client.1.smithi087.stdout:4/142: write d2/f8 [1101795,15536] 0 2024-02-28T16:01:46.568 INFO:tasks.workunit.client.0.smithi057.stdout:5/62: dread - d2/f13 zero size 2024-02-28T16:01:46.569 INFO:tasks.workunit.client.1.smithi087.stdout:8/114: mknod d2/d9/d10/c20 0 2024-02-28T16:01:46.569 INFO:tasks.workunit.client.1.smithi087.stdout:5/111: dread d3/d9/f1e [0,4194304] 0 2024-02-28T16:01:46.572 INFO:tasks.workunit.client.1.smithi087.stdout:2/91: symlink d2/d7/l20 0 2024-02-28T16:01:46.574 INFO:tasks.workunit.client.1.smithi087.stdout:9/88: getdents d7 0 2024-02-28T16:01:46.576 INFO:tasks.workunit.client.0.smithi057.stdout:1/73: fsync d1/d3/dc/d15/f16 0 2024-02-28T16:01:46.576 INFO:tasks.workunit.client.1.smithi087.stdout:9/89: stat d7/dc/f13 0 2024-02-28T16:01:46.580 INFO:tasks.workunit.client.1.smithi087.stdout:5/112: creat d3/f21 x:0 0 0 2024-02-28T16:01:46.580 INFO:tasks.workunit.client.1.smithi087.stdout:6/117: truncate d4/dc/de/d13/d1c/f1e 530720 0 2024-02-28T16:01:46.581 INFO:tasks.workunit.client.1.smithi087.stdout:4/143: creat d2/df/f39 x:0 0 0 2024-02-28T16:01:46.583 INFO:tasks.workunit.client.1.smithi087.stdout:2/92: rename d2/f9 to d2/f21 0 2024-02-28T16:01:46.583 INFO:tasks.workunit.client.0.smithi057.stdout:1/74: creat d1/d3/dc/d15/f17 x:0 0 0 2024-02-28T16:01:46.584 INFO:tasks.workunit.client.1.smithi087.stdout:6/118: rmdir d4 39 2024-02-28T16:01:46.585 INFO:tasks.workunit.client.1.smithi087.stdout:5/113: creat d3/f22 x:0 0 0 2024-02-28T16:01:46.586 INFO:tasks.workunit.client.0.smithi057.stdout:1/75: chown d1/d3/l4 1 1 2024-02-28T16:01:46.588 INFO:tasks.workunit.client.0.smithi057.stdout:1/76: chown d1/d3/dc/ff 25999524 1 2024-02-28T16:01:46.588 INFO:tasks.workunit.client.1.smithi087.stdout:9/90: link f4 d7/f14 0 2024-02-28T16:01:46.591 INFO:tasks.workunit.client.1.smithi087.stdout:5/114: read d3/f13 [418717,2385] 0 2024-02-28T16:01:46.592 INFO:tasks.workunit.client.1.smithi087.stdout:4/144: creat d2/d9/da/d1a/d26/f3a x:0 0 0 2024-02-28T16:01:46.594 INFO:tasks.workunit.client.1.smithi087.stdout:1/127: dwrite d0/fb [0,4194304] 0 2024-02-28T16:01:46.595 INFO:tasks.workunit.client.0.smithi057.stdout:1/77: rename d1/d3/dc/c14 to d1/d3/dc/c18 0 2024-02-28T16:01:46.596 INFO:tasks.workunit.client.0.smithi057.stdout:1/78: creat d1/f19 x:0 0 0 2024-02-28T16:01:46.600 INFO:tasks.workunit.client.1.smithi087.stdout:2/93: truncate d2/d7/f11 4075200 0 2024-02-28T16:01:46.601 INFO:tasks.workunit.client.1.smithi087.stdout:1/128: truncate d0/fb 4243603 0 2024-02-28T16:01:46.603 INFO:tasks.workunit.client.1.smithi087.stdout:4/145: creat d2/f3b x:0 0 0 2024-02-28T16:01:46.606 INFO:tasks.workunit.client.1.smithi087.stdout:8/115: dwrite d2/f6 [0,4194304] 0 2024-02-28T16:01:46.607 INFO:tasks.workunit.client.1.smithi087.stdout:1/129: write d0/f5 [3495740,8201] 0 2024-02-28T16:01:46.607 INFO:tasks.workunit.client.1.smithi087.stdout:9/91: stat d7/lb 0 2024-02-28T16:01:46.607 INFO:tasks.workunit.client.0.smithi057.stdout:1/79: link d1/d3/l4 d1/d3/dc/l1a 0 2024-02-28T16:01:46.608 INFO:tasks.workunit.client.1.smithi087.stdout:4/146: dread - d2/df/f39 zero size 2024-02-28T16:01:46.609 INFO:tasks.workunit.client.1.smithi087.stdout:1/130: stat d0/c1 0 2024-02-28T16:01:46.610 INFO:tasks.workunit.client.0.smithi057.stdout:1/80: mknod d1/c1b 0 2024-02-28T16:01:46.611 INFO:tasks.workunit.client.1.smithi087.stdout:2/94: creat d2/d7/df/f22 x:0 0 0 2024-02-28T16:01:46.611 INFO:tasks.workunit.client.1.smithi087.stdout:5/115: creat d3/d6/f23 x:0 0 0 2024-02-28T16:01:46.617 INFO:tasks.workunit.client.1.smithi087.stdout:2/95: write d2/d7/fd [400454,1727] 0 2024-02-28T16:01:46.621 INFO:tasks.workunit.client.1.smithi087.stdout:8/116: creat d2/d9/dd/f21 x:0 0 0 2024-02-28T16:01:46.621 INFO:tasks.workunit.client.1.smithi087.stdout:0/168: dwrite d4/dd/f2d [4194304,4194304] 0 2024-02-28T16:01:46.622 INFO:tasks.workunit.client.1.smithi087.stdout:2/96: fdatasync d2/d7/df/f1e 0 2024-02-28T16:01:46.624 INFO:tasks.workunit.client.0.smithi057.stdout:5/63: rmdir d2/d15 39 2024-02-28T16:01:46.627 INFO:tasks.workunit.client.0.smithi057.stdout:0/72: fsync d6/f16 0 2024-02-28T16:01:46.631 INFO:tasks.workunit.client.0.smithi057.stdout:0/73: chown d6/l7 1170 1 2024-02-28T16:01:46.632 INFO:tasks.workunit.client.0.smithi057.stdout:5/64: write d2/d8/f16 [593620,125302] 0 2024-02-28T16:01:46.632 INFO:tasks.workunit.client.1.smithi087.stdout:8/117: readlink d2/d9/dd/l11 0 2024-02-28T16:01:46.637 INFO:tasks.workunit.client.1.smithi087.stdout:6/119: dwrite d4/f9 [0,4194304] 0 2024-02-28T16:01:46.638 INFO:tasks.workunit.client.0.smithi057.stdout:0/74: unlink d6/f10 0 2024-02-28T16:01:46.640 INFO:tasks.workunit.client.0.smithi057.stdout:5/65: chown d2/d8/ld 25290 1 2024-02-28T16:01:46.644 INFO:tasks.workunit.client.1.smithi087.stdout:6/120: chown d4/f20 24874 1 2024-02-28T16:01:46.644 INFO:tasks.workunit.client.1.smithi087.stdout:1/131: dread d0/fd [0,4194304] 0 2024-02-28T16:01:46.646 INFO:tasks.workunit.client.1.smithi087.stdout:9/92: dwrite d7/dc/ff [0,4194304] 0 2024-02-28T16:01:46.648 INFO:tasks.workunit.client.1.smithi087.stdout:1/132: read - d0/d14/f17 zero size 2024-02-28T16:01:46.649 INFO:tasks.workunit.client.1.smithi087.stdout:0/169: dread d4/d6/f12 [0,4194304] 0 2024-02-28T16:01:46.649 INFO:tasks.workunit.client.1.smithi087.stdout:5/116: rename d3/d6/c7 to d3/d6/c24 0 2024-02-28T16:01:46.650 INFO:tasks.workunit.client.0.smithi057.stdout:1/81: dwrite d1/fe [4194304,4194304] 0 2024-02-28T16:01:46.650 INFO:tasks.workunit.client.0.smithi057.stdout:0/75: mkdir d6/d12/d17 0 2024-02-28T16:01:46.650 INFO:tasks.workunit.client.0.smithi057.stdout:1/82: stat d1/d3/dc/f12 0 2024-02-28T16:01:46.651 INFO:tasks.workunit.client.1.smithi087.stdout:1/133: read - d0/ff zero size 2024-02-28T16:01:46.654 INFO:tasks.workunit.client.0.smithi057.stdout:0/76: write d6/fa [4333477,108880] 0 2024-02-28T16:01:46.654 INFO:tasks.workunit.client.0.smithi057.stdout:5/66: mknod d2/c18 0 2024-02-28T16:01:46.656 INFO:tasks.workunit.client.1.smithi087.stdout:4/147: truncate d2/f20 2818558 0 2024-02-28T16:01:46.658 INFO:tasks.workunit.client.0.smithi057.stdout:5/67: chown d2/d12 611097 1 2024-02-28T16:01:46.658 INFO:tasks.workunit.client.0.smithi057.stdout:5/68: chown d2/f13 811234337 1 2024-02-28T16:01:46.659 INFO:tasks.workunit.client.0.smithi057.stdout:0/77: chown c1 154 1 2024-02-28T16:01:46.659 INFO:tasks.workunit.client.1.smithi087.stdout:2/97: write d2/d7/df/f1c [1076744,21408] 0 2024-02-28T16:01:46.660 INFO:tasks.workunit.client.1.smithi087.stdout:5/117: read d3/d9/f15 [185832,77461] 0 2024-02-28T16:01:46.660 INFO:tasks.workunit.client.1.smithi087.stdout:6/121: write d4/f9 [5237819,71792] 0 2024-02-28T16:01:46.666 INFO:tasks.workunit.client.1.smithi087.stdout:4/148: mknod d2/d9/da/c3c 0 2024-02-28T16:01:46.667 INFO:tasks.workunit.client.1.smithi087.stdout:2/98: write d2/d7/df/f13 [3801208,30973] 0 2024-02-28T16:01:46.667 INFO:tasks.workunit.client.1.smithi087.stdout:8/118: dread d2/f5 [0,4194304] 0 2024-02-28T16:01:46.668 INFO:tasks.workunit.client.0.smithi057.stdout:0/78: rename d6/cf to d6/d12/c18 0 2024-02-28T16:01:46.673 INFO:tasks.workunit.client.0.smithi057.stdout:5/69: mkdir d2/d19 0 2024-02-28T16:01:46.673 INFO:tasks.workunit.client.1.smithi087.stdout:6/122: truncate d4/dc/de/f24 434477 0 2024-02-28T16:01:46.673 INFO:tasks.workunit.client.1.smithi087.stdout:4/149: read d2/df/f13 [4164469,70563] 0 2024-02-28T16:01:46.676 INFO:tasks.workunit.client.1.smithi087.stdout:8/119: chown d2/d9/d10/f12 6920460 1 2024-02-28T16:01:46.677 INFO:tasks.workunit.client.1.smithi087.stdout:5/118: truncate d3/d9/f15 1130451 0 2024-02-28T16:01:46.677 INFO:tasks.workunit.client.0.smithi057.stdout:1/83: dread d1/f8 [0,4194304] 0 2024-02-28T16:01:46.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:46 smithi057 ceph-mon[28763]: pgmap v25: 65 pgs: 65 active+clean; 218 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 951 KiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-02-28T16:01:46.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:46 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:01:46.679 INFO:tasks.workunit.client.0.smithi057.stdout:0/79: creat d6/f19 x:0 0 0 2024-02-28T16:01:46.681 INFO:tasks.workunit.client.1.smithi087.stdout:9/93: dwrite d7/f8 [0,4194304] 0 2024-02-28T16:01:46.683 INFO:tasks.workunit.client.1.smithi087.stdout:9/94: readlink l5 0 2024-02-28T16:01:46.684 INFO:tasks.workunit.client.1.smithi087.stdout:8/120: creat d2/d18/f22 x:0 0 0 2024-02-28T16:01:46.688 INFO:tasks.workunit.client.1.smithi087.stdout:6/123: creat d4/dc/de/d13/d1c/f28 x:0 0 0 2024-02-28T16:01:46.692 INFO:tasks.workunit.client.1.smithi087.stdout:9/95: mkdir d7/dd/d15 0 2024-02-28T16:01:46.693 INFO:tasks.workunit.client.0.smithi057.stdout:5/70: dwrite d2/d8/f9 [0,4194304] 0 2024-02-28T16:01:46.695 INFO:tasks.workunit.client.1.smithi087.stdout:0/170: dwrite d4/d6/f14 [0,4194304] 0 2024-02-28T16:01:46.695 INFO:tasks.workunit.client.1.smithi087.stdout:8/121: chown d2/d9/d10/f12 15 1 2024-02-28T16:01:46.698 INFO:tasks.workunit.client.1.smithi087.stdout:6/124: write d4/f20 [34314,113718] 0 2024-02-28T16:01:46.698 INFO:tasks.workunit.client.0.smithi057.stdout:0/80: dread f0 [0,4194304] 0 2024-02-28T16:01:46.702 INFO:tasks.workunit.client.0.smithi057.stdout:5/71: mknod d2/d8/c1a 0 2024-02-28T16:01:46.703 INFO:tasks.workunit.client.1.smithi087.stdout:6/125: readlink d4/l7 0 2024-02-28T16:01:46.703 INFO:tasks.workunit.client.0.smithi057.stdout:5/72: write d2/d8/f16 [52698,44857] 0 2024-02-28T16:01:46.703 INFO:tasks.workunit.client.1.smithi087.stdout:1/134: dwrite d0/f12 [0,4194304] 0 2024-02-28T16:01:46.711 INFO:tasks.workunit.client.1.smithi087.stdout:6/126: truncate d4/dc/de/d13/d1c/f27 840365 0 2024-02-28T16:01:46.712 INFO:tasks.workunit.client.1.smithi087.stdout:0/171: mknod d4/d6/c41 0 2024-02-28T16:01:46.715 INFO:tasks.workunit.client.1.smithi087.stdout:1/135: mknod d0/d14/c23 0 2024-02-28T16:01:46.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:46 smithi087 ceph-mon[37122]: pgmap v25: 65 pgs: 65 active+clean; 218 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 951 KiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-02-28T16:01:46.719 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:46 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:01:46.719 INFO:tasks.workunit.client.1.smithi087.stdout:2/99: dwrite d2/f21 [0,4194304] 0 2024-02-28T16:01:46.719 INFO:tasks.workunit.client.1.smithi087.stdout:4/150: dread d2/d9/de/f19 [0,4194304] 0 2024-02-28T16:01:46.720 INFO:tasks.workunit.client.1.smithi087.stdout:9/96: creat d7/dc/d10/f16 x:0 0 0 2024-02-28T16:01:46.721 INFO:tasks.workunit.client.1.smithi087.stdout:0/172: stat d4/dd/d21/c2f 0 2024-02-28T16:01:46.725 INFO:tasks.workunit.client.1.smithi087.stdout:4/151: fsync d2/d9/da/d1a/d26/f3a 0 2024-02-28T16:01:46.729 INFO:tasks.workunit.client.1.smithi087.stdout:8/122: dwrite d2/d9/d10/f12 [4194304,4194304] 0 2024-02-28T16:01:46.729 INFO:tasks.workunit.client.1.smithi087.stdout:6/127: unlink d4/dc/de/d13/d1c/f27 0 2024-02-28T16:01:46.733 INFO:tasks.workunit.client.1.smithi087.stdout:2/100: dread d2/d7/fd [0,4194304] 0 2024-02-28T16:01:46.733 INFO:tasks.workunit.client.1.smithi087.stdout:6/128: dread - d4/d12/f16 zero size 2024-02-28T16:01:46.736 INFO:tasks.workunit.client.1.smithi087.stdout:1/136: mkdir d0/d1d/d24 0 2024-02-28T16:01:46.740 INFO:tasks.workunit.client.1.smithi087.stdout:4/152: creat d2/d9/da/d1a/d26/f3d x:0 0 0 2024-02-28T16:01:46.745 INFO:tasks.workunit.client.1.smithi087.stdout:2/101: symlink d2/d7/l23 0 2024-02-28T16:01:46.746 INFO:tasks.workunit.client.1.smithi087.stdout:1/137: creat d0/d14/f25 x:0 0 0 2024-02-28T16:01:46.747 INFO:tasks.workunit.client.1.smithi087.stdout:4/153: symlink d2/l3e 0 2024-02-28T16:01:46.747 INFO:tasks.workunit.client.1.smithi087.stdout:6/129: chown d4/l25 255182 1 2024-02-28T16:01:46.754 INFO:tasks.workunit.client.1.smithi087.stdout:6/130: symlink d4/dc/l29 0 2024-02-28T16:01:46.756 INFO:tasks.workunit.client.1.smithi087.stdout:1/138: symlink d0/l26 0 2024-02-28T16:01:46.756 INFO:tasks.workunit.client.1.smithi087.stdout:9/97: dwrite d7/dc/f13 [0,4194304] 0 2024-02-28T16:01:46.759 INFO:tasks.workunit.client.1.smithi087.stdout:2/102: rmdir d2/d7/df 39 2024-02-28T16:01:46.762 INFO:tasks.workunit.client.1.smithi087.stdout:0/173: dwrite d4/dd/d26/f2b [0,4194304] 0 2024-02-28T16:01:46.762 INFO:tasks.workunit.client.1.smithi087.stdout:9/98: dread - d7/dc/d10/f16 zero size 2024-02-28T16:01:46.767 INFO:tasks.workunit.client.1.smithi087.stdout:0/174: write d4/dd/f13 [4532981,8426] 0 2024-02-28T16:01:46.770 INFO:tasks.workunit.client.1.smithi087.stdout:1/139: mknod d0/d1b/d1f/c27 0 2024-02-28T16:01:46.771 INFO:tasks.workunit.client.1.smithi087.stdout:1/140: dread - d0/ff zero size 2024-02-28T16:01:46.777 INFO:tasks.workunit.client.1.smithi087.stdout:8/123: truncate d2/f6 1493591 0 2024-02-28T16:01:46.777 INFO:tasks.workunit.client.1.smithi087.stdout:0/175: write d4/f8 [2603448,31986] 0 2024-02-28T16:01:46.778 INFO:tasks.workunit.client.1.smithi087.stdout:6/131: link d4/f26 d4/dc/de/d13/f2a 0 2024-02-28T16:01:46.782 INFO:tasks.workunit.client.1.smithi087.stdout:1/141: fsync d0/fd 0 2024-02-28T16:01:46.784 INFO:tasks.workunit.client.1.smithi087.stdout:4/154: unlink d2/f20 0 2024-02-28T16:01:46.789 INFO:tasks.workunit.client.1.smithi087.stdout:1/142: write d0/fb [4990480,14778] 0 2024-02-28T16:01:46.791 INFO:tasks.workunit.client.1.smithi087.stdout:1/143: readlink d0/lc 0 2024-02-28T16:01:46.791 INFO:tasks.workunit.client.1.smithi087.stdout:2/103: dwrite d2/d7/f12 [0,4194304] 0 2024-02-28T16:01:46.795 INFO:tasks.workunit.client.1.smithi087.stdout:0/176: dread d4/dd/f1b [4194304,4194304] 0 2024-02-28T16:01:46.795 INFO:tasks.workunit.client.1.smithi087.stdout:9/99: dwrite d7/dc/f11 [0,4194304] 0 2024-02-28T16:01:46.796 INFO:tasks.workunit.client.1.smithi087.stdout:4/155: rmdir d2/d9/d10/d11 39 2024-02-28T16:01:46.800 INFO:tasks.workunit.client.1.smithi087.stdout:9/100: dread - d7/dc/d10/f16 zero size 2024-02-28T16:01:46.801 INFO:tasks.workunit.client.1.smithi087.stdout:1/144: mkdir d0/d1a/d28 0 2024-02-28T16:01:46.807 INFO:tasks.workunit.client.1.smithi087.stdout:8/124: dread d2/d9/f16 [0,4194304] 0 2024-02-28T16:01:46.808 INFO:tasks.workunit.client.1.smithi087.stdout:3/120: sync 2024-02-28T16:01:46.808 INFO:tasks.workunit.client.1.smithi087.stdout:7/79: sync 2024-02-28T16:01:46.808 INFO:tasks.workunit.client.1.smithi087.stdout:4/156: creat d2/d9/da/f3f x:0 0 0 2024-02-28T16:01:46.811 INFO:tasks.workunit.client.1.smithi087.stdout:2/104: creat d2/d7/d17/f24 x:0 0 0 2024-02-28T16:01:46.811 INFO:tasks.workunit.client.1.smithi087.stdout:6/132: dwrite d4/dc/de/d13/d1c/f28 [0,4194304] 0 2024-02-28T16:01:46.814 INFO:tasks.workunit.client.1.smithi087.stdout:0/177: creat d4/d6/d3e/f42 x:0 0 0 2024-02-28T16:01:46.815 INFO:tasks.workunit.client.1.smithi087.stdout:8/125: write d2/d9/f16 [5339303,116995] 0 2024-02-28T16:01:46.816 INFO:tasks.workunit.client.1.smithi087.stdout:3/121: creat d11/f2f x:0 0 0 2024-02-28T16:01:46.817 INFO:tasks.workunit.client.1.smithi087.stdout:8/126: dread - d2/d18/f22 zero size 2024-02-28T16:01:46.820 INFO:tasks.workunit.client.1.smithi087.stdout:1/145: creat d0/d1a/d28/f29 x:0 0 0 2024-02-28T16:01:46.821 INFO:tasks.workunit.client.1.smithi087.stdout:2/105: fsync d2/d7/df/f1e 0 2024-02-28T16:01:46.821 INFO:tasks.workunit.client.1.smithi087.stdout:6/133: creat d4/dc/d10/f2b x:0 0 0 2024-02-28T16:01:46.827 INFO:tasks.workunit.client.1.smithi087.stdout:3/122: creat d11/f30 x:0 0 0 2024-02-28T16:01:46.829 INFO:tasks.workunit.client.1.smithi087.stdout:8/127: creat d2/d9/f23 x:0 0 0 2024-02-28T16:01:46.831 INFO:tasks.workunit.client.1.smithi087.stdout:7/80: creat f13 x:0 0 0 2024-02-28T16:01:46.831 INFO:tasks.workunit.client.1.smithi087.stdout:4/157: rename d2/l12 to d2/d9/l40 0 2024-02-28T16:01:46.832 INFO:tasks.workunit.client.1.smithi087.stdout:0/178: symlink d4/dd/d21/d32/l43 0 2024-02-28T16:01:46.833 INFO:tasks.workunit.client.1.smithi087.stdout:2/106: symlink d2/d7/d17/l25 0 2024-02-28T16:01:46.835 INFO:tasks.workunit.client.1.smithi087.stdout:7/81: dread - f10 zero size 2024-02-28T16:01:46.835 INFO:tasks.workunit.client.1.smithi087.stdout:3/123: chown d11/l20 12788 1 2024-02-28T16:01:46.836 INFO:tasks.workunit.client.1.smithi087.stdout:0/179: chown d4/dd/d20 45967 1 2024-02-28T16:01:46.837 INFO:tasks.workunit.client.1.smithi087.stdout:9/101: dwrite d7/fa [0,4194304] 0 2024-02-28T16:01:46.841 INFO:tasks.workunit.client.1.smithi087.stdout:1/146: mknod d0/d1d/d24/c2a 0 2024-02-28T16:01:46.842 INFO:tasks.workunit.client.1.smithi087.stdout:8/128: mkdir d2/d9/d10/d24 0 2024-02-28T16:01:46.847 INFO:tasks.workunit.client.1.smithi087.stdout:0/180: creat d4/dd/d20/f44 x:0 0 0 2024-02-28T16:01:46.849 INFO:tasks.workunit.client.1.smithi087.stdout:3/124: creat d11/f31 x:0 0 0 2024-02-28T16:01:46.851 INFO:tasks.workunit.client.1.smithi087.stdout:2/107: write d2/d7/fd [1418049,102262] 0 2024-02-28T16:01:46.852 INFO:tasks.workunit.client.1.smithi087.stdout:8/129: rename d2/d9/dd to d2/d18/d25 0 2024-02-28T16:01:46.854 INFO:tasks.workunit.client.1.smithi087.stdout:7/82: mkdir d14 0 2024-02-28T16:01:46.858 INFO:tasks.workunit.client.1.smithi087.stdout:6/134: link d4/l25 d4/dc/de/l2c 0 2024-02-28T16:01:46.859 INFO:tasks.workunit.client.1.smithi087.stdout:0/181: mkdir d4/d6/dc/d45 0 2024-02-28T16:01:46.860 INFO:tasks.workunit.client.1.smithi087.stdout:3/125: rename d11/f2c to d11/f32 0 2024-02-28T16:01:46.862 INFO:tasks.workunit.client.1.smithi087.stdout:5/119: sync 2024-02-28T16:01:46.864 INFO:tasks.workunit.client.1.smithi087.stdout:9/102: link d7/dd/fe d7/dd/d15/f17 0 2024-02-28T16:01:46.865 INFO:tasks.workunit.client.1.smithi087.stdout:7/83: mkdir d14/d15 0 2024-02-28T16:01:46.867 INFO:tasks.workunit.client.1.smithi087.stdout:4/158: dwrite d2/f3b [0,4194304] 0 2024-02-28T16:01:46.867 INFO:tasks.workunit.client.1.smithi087.stdout:5/120: rmdir d3/d9 39 2024-02-28T16:01:46.867 INFO:tasks.workunit.client.1.smithi087.stdout:3/126: chown c6 131264 1 2024-02-28T16:01:46.869 INFO:tasks.workunit.client.1.smithi087.stdout:7/84: write fc [4575537,14572] 0 2024-02-28T16:01:46.871 INFO:tasks.workunit.client.1.smithi087.stdout:0/182: creat d4/dd/d37/d39/d3a/f46 x:0 0 0 2024-02-28T16:01:46.871 INFO:tasks.workunit.client.1.smithi087.stdout:1/147: dread d0/f16 [4194304,4194304] 0 2024-02-28T16:01:46.871 INFO:tasks.workunit.client.1.smithi087.stdout:4/159: chown d2/l6 62 1 2024-02-28T16:01:46.871 INFO:tasks.workunit.client.1.smithi087.stdout:6/135: creat d4/dc/de/d13/f2d x:0 0 0 2024-02-28T16:01:46.872 INFO:tasks.workunit.client.1.smithi087.stdout:7/85: write f7 [3566726,105542] 0 2024-02-28T16:01:46.878 INFO:tasks.workunit.client.1.smithi087.stdout:8/130: truncate d2/f6 172112 0 2024-02-28T16:01:46.879 INFO:tasks.workunit.client.1.smithi087.stdout:9/103: creat d7/dc/f18 x:0 0 0 2024-02-28T16:01:46.881 INFO:tasks.workunit.client.1.smithi087.stdout:3/127: mkdir d11/d33 0 2024-02-28T16:01:46.881 INFO:tasks.workunit.client.1.smithi087.stdout:0/183: write d4/dd/f2d [3096660,107448] 0 2024-02-28T16:01:46.882 INFO:tasks.workunit.client.1.smithi087.stdout:2/108: getdents d2/d7 0 2024-02-28T16:01:46.883 INFO:tasks.workunit.client.1.smithi087.stdout:8/131: dread - d2/d18/f22 zero size 2024-02-28T16:01:46.886 INFO:tasks.workunit.client.1.smithi087.stdout:4/160: symlink d2/l41 0 2024-02-28T16:01:46.886 INFO:tasks.workunit.client.1.smithi087.stdout:6/136: creat d4/dc/d10/f2e x:0 0 0 2024-02-28T16:01:46.889 INFO:tasks.workunit.client.1.smithi087.stdout:6/137: chown d4/dc/de/d13/f2d 2 1 2024-02-28T16:01:46.890 INFO:tasks.workunit.client.1.smithi087.stdout:7/86: rename f11 to d14/d15/f16 0 2024-02-28T16:01:46.892 INFO:tasks.workunit.client.1.smithi087.stdout:1/148: dwrite d0/f12 [0,4194304] 0 2024-02-28T16:01:46.893 INFO:tasks.workunit.client.1.smithi087.stdout:5/121: chown d3/d6/f1d 35401 1 2024-02-28T16:01:46.895 INFO:tasks.workunit.client.1.smithi087.stdout:2/109: symlink d2/d7/d17/l26 0 2024-02-28T16:01:46.900 INFO:tasks.workunit.client.1.smithi087.stdout:4/161: symlink d2/df/l42 0 2024-02-28T16:01:46.901 INFO:tasks.workunit.client.1.smithi087.stdout:0/184: creat d4/dd/d20/d1f/f47 x:0 0 0 2024-02-28T16:01:46.902 INFO:tasks.workunit.client.1.smithi087.stdout:0/185: chown d4/d6 62 1 2024-02-28T16:01:46.903 INFO:tasks.workunit.client.1.smithi087.stdout:0/186: chown d4/d6/d3e 74242 1 2024-02-28T16:01:46.906 INFO:tasks.workunit.client.1.smithi087.stdout:7/87: mknod d14/c17 0 2024-02-28T16:01:46.906 INFO:tasks.workunit.client.1.smithi087.stdout:1/149: symlink d0/d1d/l2b 0 2024-02-28T16:01:46.911 INFO:tasks.workunit.client.1.smithi087.stdout:5/122: stat d3/d9/fd 0 2024-02-28T16:01:46.911 INFO:tasks.workunit.client.1.smithi087.stdout:2/110: mknod d2/d7/d17/c27 0 2024-02-28T16:01:46.913 INFO:tasks.workunit.client.1.smithi087.stdout:3/128: symlink d11/d33/l34 0 2024-02-28T16:01:46.914 INFO:tasks.workunit.client.1.smithi087.stdout:6/138: rename l1 to d4/dc/de/d13/d1c/l2f 0 2024-02-28T16:01:46.915 INFO:tasks.workunit.client.1.smithi087.stdout:3/129: stat d11/f2a 0 2024-02-28T16:01:46.917 INFO:tasks.workunit.client.1.smithi087.stdout:4/162: dread d2/d9/de/f19 [0,4194304] 0 2024-02-28T16:01:46.917 INFO:tasks.workunit.client.1.smithi087.stdout:2/111: unlink d2/d7/d17/l25 0 2024-02-28T16:01:46.917 INFO:tasks.workunit.client.1.smithi087.stdout:3/130: write d11/f24 [101854,50122] 0 2024-02-28T16:01:46.919 INFO:tasks.workunit.client.1.smithi087.stdout:5/123: mkdir d3/d9/d25 0 2024-02-28T16:01:46.920 INFO:tasks.workunit.client.1.smithi087.stdout:2/112: fdatasync d2/d7/df/f1c 0 2024-02-28T16:01:46.921 INFO:tasks.workunit.client.1.smithi087.stdout:9/104: truncate d7/dc/ff 1494642 0 2024-02-28T16:01:46.924 INFO:tasks.workunit.client.1.smithi087.stdout:5/124: fsync d3/d9/fd 0 2024-02-28T16:01:46.925 INFO:tasks.workunit.client.1.smithi087.stdout:1/150: dread d0/fa [0,4194304] 0 2024-02-28T16:01:46.925 INFO:tasks.workunit.client.1.smithi087.stdout:2/113: mkdir d2/d7/df/d28 0 2024-02-28T16:01:46.927 INFO:tasks.workunit.client.1.smithi087.stdout:4/163: creat d2/df/d2e/f43 x:0 0 0 2024-02-28T16:01:46.929 INFO:tasks.workunit.client.1.smithi087.stdout:9/105: fdatasync d7/f12 0 2024-02-28T16:01:46.929 INFO:tasks.workunit.client.1.smithi087.stdout:7/88: dwrite f13 [0,4194304] 0 2024-02-28T16:01:46.932 INFO:tasks.workunit.client.1.smithi087.stdout:0/187: truncate d4/dd/f13 1821437 0 2024-02-28T16:01:46.933 INFO:tasks.workunit.client.1.smithi087.stdout:2/114: rmdir d2/d7/df 39 2024-02-28T16:01:46.935 INFO:tasks.workunit.client.1.smithi087.stdout:6/139: getdents d4/dc/de 0 2024-02-28T16:01:46.936 INFO:tasks.workunit.client.1.smithi087.stdout:0/188: write d4/d6/d3e/f42 [138544,106376] 0 2024-02-28T16:01:46.936 INFO:tasks.workunit.client.1.smithi087.stdout:1/151: mknod d0/d1b/d1f/c2c 0 2024-02-28T16:01:46.937 INFO:tasks.workunit.client.1.smithi087.stdout:9/106: symlink d7/dc/l19 0 2024-02-28T16:01:46.938 INFO:tasks.workunit.client.1.smithi087.stdout:4/164: mknod d2/d9/d10/d22/c44 0 2024-02-28T16:01:46.938 INFO:tasks.workunit.client.1.smithi087.stdout:9/107: readlink l5 0 2024-02-28T16:01:46.941 INFO:tasks.workunit.client.1.smithi087.stdout:1/152: mknod d0/d1b/d1f/c2d 0 2024-02-28T16:01:46.944 INFO:tasks.workunit.client.1.smithi087.stdout:4/165: write d2/d9/da/d1a/d26/f3a [1000634,73727] 0 2024-02-28T16:01:46.944 INFO:tasks.workunit.client.1.smithi087.stdout:1/153: chown d0/d14/l19 45641277 1 2024-02-28T16:01:46.945 INFO:tasks.workunit.client.1.smithi087.stdout:5/125: rmdir d3/d9/d25 0 2024-02-28T16:01:46.946 INFO:tasks.workunit.client.1.smithi087.stdout:9/108: creat d7/dd/f1a x:0 0 0 2024-02-28T16:01:46.947 INFO:tasks.workunit.client.1.smithi087.stdout:4/166: chown d2/d9/da/c3c 0 1 2024-02-28T16:01:46.949 INFO:tasks.workunit.client.1.smithi087.stdout:9/109: dread - d7/dd/fe zero size 2024-02-28T16:01:46.950 INFO:tasks.workunit.client.0.smithi057.stdout:0/81: write d6/f19 [699494,1794] 0 2024-02-28T16:01:46.952 INFO:tasks.workunit.client.0.smithi057.stdout:5/73: link d2/d8/f16 d2/f1b 0 2024-02-28T16:01:46.953 INFO:tasks.workunit.client.1.smithi087.stdout:1/154: creat d0/d1a/f2e x:0 0 0 2024-02-28T16:01:46.955 INFO:tasks.workunit.client.0.smithi057.stdout:5/74: mkdir d2/d19/d1c 0 2024-02-28T16:01:46.956 INFO:tasks.workunit.client.0.smithi057.stdout:0/82: mkdir d6/d12/d17/d1a 0 2024-02-28T16:01:46.957 INFO:tasks.workunit.client.0.smithi057.stdout:5/75: dread - d2/d8/fc zero size 2024-02-28T16:01:46.958 INFO:tasks.workunit.client.0.smithi057.stdout:0/83: fsync d6/fd 0 2024-02-28T16:01:46.959 INFO:tasks.workunit.client.1.smithi087.stdout:4/167: symlink d2/d9/d10/d22/l45 0 2024-02-28T16:01:46.959 INFO:tasks.workunit.client.1.smithi087.stdout:0/189: creat d4/f48 x:0 0 0 2024-02-28T16:01:46.959 INFO:tasks.workunit.client.0.smithi057.stdout:5/76: write d2/d8/fc [748523,25858] 0 2024-02-28T16:01:46.960 INFO:tasks.workunit.client.1.smithi087.stdout:9/110: creat d7/dc/d10/f1b x:0 0 0 2024-02-28T16:01:46.960 INFO:tasks.workunit.client.0.smithi057.stdout:0/84: truncate d6/f19 1481143 0 2024-02-28T16:01:46.962 INFO:tasks.workunit.client.0.smithi057.stdout:5/77: mknod d2/d19/c1d 0 2024-02-28T16:01:46.963 INFO:tasks.workunit.client.0.smithi057.stdout:0/85: creat d6/d12/f1b x:0 0 0 2024-02-28T16:01:46.965 INFO:tasks.workunit.client.0.smithi057.stdout:5/78: symlink d2/l1e 0 2024-02-28T16:01:46.965 INFO:tasks.workunit.client.1.smithi087.stdout:6/140: dwrite d4/dc/d10/f2b [0,4194304] 0 2024-02-28T16:01:46.965 INFO:tasks.workunit.client.1.smithi087.stdout:0/190: write d4/dd/d20/d1f/f47 [647143,17356] 0 2024-02-28T16:01:46.966 INFO:tasks.workunit.client.0.smithi057.stdout:0/86: symlink d6/d12/d17/d1a/l1c 0 2024-02-28T16:01:46.967 INFO:tasks.workunit.client.0.smithi057.stdout:5/79: write d2/d8/fc [215016,62290] 0 2024-02-28T16:01:46.969 INFO:tasks.workunit.client.1.smithi087.stdout:6/141: dread - d4/dc/de/d13/f2a zero size 2024-02-28T16:01:46.970 INFO:tasks.workunit.client.1.smithi087.stdout:7/89: truncate d14/d15/f16 17216 0 2024-02-28T16:01:46.971 INFO:tasks.workunit.client.1.smithi087.stdout:7/90: readlink - no filename 2024-02-28T16:01:46.971 INFO:tasks.workunit.client.1.smithi087.stdout:2/115: rename d2/d7/c1b to d2/d7/df/d28/c29 0 2024-02-28T16:01:46.973 INFO:tasks.workunit.client.0.smithi057.stdout:5/80: link d2/d8/fb d2/d15/f1f 0 2024-02-28T16:01:46.976 INFO:tasks.workunit.client.1.smithi087.stdout:4/168: symlink d2/d9/da/d1a/l46 0 2024-02-28T16:01:46.976 INFO:tasks.workunit.client.0.smithi057.stdout:5/81: mknod d2/d19/d1c/c20 0 2024-02-28T16:01:46.982 INFO:tasks.workunit.client.1.smithi087.stdout:9/111: write d7/dd/fe [190879,4769] 0 2024-02-28T16:01:46.983 INFO:tasks.workunit.client.1.smithi087.stdout:1/155: dwrite d0/d14/f25 [0,4194304] 0 2024-02-28T16:01:46.984 INFO:tasks.workunit.client.1.smithi087.stdout:2/116: readlink d2/d7/l20 0 2024-02-28T16:01:46.988 INFO:tasks.workunit.client.1.smithi087.stdout:6/142: rename d4/dc/de to d4/d30 0 2024-02-28T16:01:46.990 INFO:tasks.workunit.client.0.smithi057.stdout:0/87: dwrite d6/d12/f1b [0,4194304] 0 2024-02-28T16:01:46.991 INFO:tasks.workunit.client.1.smithi087.stdout:4/169: creat d2/df/d2e/f47 x:0 0 0 2024-02-28T16:01:46.998 INFO:tasks.workunit.client.1.smithi087.stdout:5/126: rename d3/d6/f1a to d3/d6/f26 0 2024-02-28T16:01:47.000 INFO:tasks.workunit.client.0.smithi057.stdout:5/82: rmdir d2 39 2024-02-28T16:01:47.001 INFO:tasks.workunit.client.1.smithi087.stdout:2/117: mkdir d2/d2a 0 2024-02-28T16:01:47.001 INFO:tasks.workunit.client.1.smithi087.stdout:6/143: chown d4/d30/d13/d1c/f1e 23869 1 2024-02-28T16:01:47.002 INFO:tasks.workunit.client.1.smithi087.stdout:6/144: stat d4/d30 0 2024-02-28T16:01:47.003 INFO:tasks.workunit.client.1.smithi087.stdout:9/112: rename d7/fa to d7/dc/d10/f1c 0 2024-02-28T16:01:47.004 INFO:tasks.workunit.client.0.smithi057.stdout:0/88: link d6/c15 d6/d12/c1d 0 2024-02-28T16:01:47.007 INFO:tasks.workunit.client.0.smithi057.stdout:0/89: rmdir d6 39 2024-02-28T16:01:47.015 INFO:tasks.workunit.client.1.smithi087.stdout:4/170: dread d2/df/f13 [0,4194304] 0 2024-02-28T16:01:47.017 INFO:tasks.workunit.client.1.smithi087.stdout:6/145: symlink d4/d30/d13/d1c/l31 0 2024-02-28T16:01:47.018 INFO:tasks.workunit.client.1.smithi087.stdout:0/191: dread d4/dd/f1b [0,4194304] 0 2024-02-28T16:01:47.019 INFO:tasks.workunit.client.1.smithi087.stdout:1/156: link d0/d1d/d24/c2a d0/d1a/d28/c2f 0 2024-02-28T16:01:47.022 INFO:tasks.workunit.client.1.smithi087.stdout:6/146: chown d4/dc/d10/f19 39370573 1 2024-02-28T16:01:47.022 INFO:tasks.workunit.client.1.smithi087.stdout:1/157: symlink d0/d1a/l30 0 2024-02-28T16:01:47.023 INFO:tasks.workunit.client.1.smithi087.stdout:0/192: chown d4/dd/d20 885 1 2024-02-28T16:01:47.028 INFO:tasks.workunit.client.1.smithi087.stdout:7/91: link d14/d15/f16 d14/f18 0 2024-02-28T16:01:47.028 INFO:tasks.workunit.client.1.smithi087.stdout:4/171: creat d2/d9/f48 x:0 0 0 2024-02-28T16:01:47.029 INFO:tasks.workunit.client.1.smithi087.stdout:0/193: write d4/dd/d20/d1f/f47 [1259593,59775] 0 2024-02-28T16:01:47.030 INFO:tasks.workunit.client.1.smithi087.stdout:7/92: chown cf 49771 1 2024-02-28T16:01:47.031 INFO:tasks.workunit.client.1.smithi087.stdout:4/172: mkdir d2/d49 0 2024-02-28T16:01:47.034 INFO:tasks.workunit.client.0.smithi057.stdout:5/83: dwrite d2/d8/fb [0,4194304] 0 2024-02-28T16:01:47.034 INFO:tasks.workunit.client.1.smithi087.stdout:7/93: truncate f10 433475 0 2024-02-28T16:01:47.034 INFO:tasks.workunit.client.0.smithi057.stdout:0/90: dwrite d6/f16 [0,4194304] 0 2024-02-28T16:01:47.037 INFO:tasks.workunit.client.1.smithi087.stdout:0/194: write d4/d6/d3e/f42 [1088071,79444] 0 2024-02-28T16:01:47.037 INFO:tasks.workunit.client.1.smithi087.stdout:9/113: mknod d7/dd/d15/c1d 0 2024-02-28T16:01:47.038 INFO:tasks.workunit.client.0.smithi057.stdout:5/84: mknod d2/c21 0 2024-02-28T16:01:47.040 INFO:tasks.workunit.client.1.smithi087.stdout:1/158: dread d0/fb [0,4194304] 0 2024-02-28T16:01:47.041 INFO:tasks.workunit.client.1.smithi087.stdout:7/94: creat d14/f19 x:0 0 0 2024-02-28T16:01:47.041 INFO:tasks.workunit.client.1.smithi087.stdout:4/173: rmdir d2/d9/da/d1a 39 2024-02-28T16:01:47.042 INFO:tasks.workunit.client.0.smithi057.stdout:5/85: creat d2/f22 x:0 0 0 2024-02-28T16:01:47.043 INFO:tasks.workunit.client.0.smithi057.stdout:5/86: dread - d2/f13 zero size 2024-02-28T16:01:47.044 INFO:tasks.workunit.client.1.smithi087.stdout:2/118: dread d2/d7/f11 [0,4194304] 0 2024-02-28T16:01:47.045 INFO:tasks.workunit.client.0.smithi057.stdout:5/87: write d2/d8/fb [1659743,13230] 0 2024-02-28T16:01:47.045 INFO:tasks.workunit.client.1.smithi087.stdout:0/195: write d4/dd/d26/f2b [2143663,127880] 0 2024-02-28T16:01:47.047 INFO:tasks.workunit.client.0.smithi057.stdout:5/88: mknod d2/d8/c23 0 2024-02-28T16:01:47.048 INFO:tasks.workunit.client.0.smithi057.stdout:5/89: stat d2/d12 0 2024-02-28T16:01:47.048 INFO:tasks.workunit.client.1.smithi087.stdout:7/95: write f12 [5269276,53050] 0 2024-02-28T16:01:47.050 INFO:tasks.workunit.client.0.smithi057.stdout:0/91: dread d6/fa [0,4194304] 0 2024-02-28T16:01:47.050 INFO:tasks.workunit.client.1.smithi087.stdout:9/114: mkdir d7/d1e 0 2024-02-28T16:01:47.051 INFO:tasks.workunit.client.1.smithi087.stdout:1/159: symlink d0/d1a/d28/l31 0 2024-02-28T16:01:47.052 INFO:tasks.workunit.client.0.smithi057.stdout:5/90: creat d2/d12/f24 x:0 0 0 2024-02-28T16:01:47.054 INFO:tasks.workunit.client.0.smithi057.stdout:0/92: write d6/f8 [2285201,33461] 0 2024-02-28T16:01:47.054 INFO:tasks.workunit.client.1.smithi087.stdout:5/127: dwrite d3/d6/f19 [0,4194304] 0 2024-02-28T16:01:47.055 INFO:tasks.workunit.client.1.smithi087.stdout:4/174: dread - d2/d9/f48 zero size 2024-02-28T16:01:47.055 INFO:tasks.workunit.client.0.smithi057.stdout:5/91: truncate d2/d8/fb 4803189 0 2024-02-28T16:01:47.056 INFO:tasks.workunit.client.0.smithi057.stdout:0/93: write d6/fd [1240037,68008] 0 2024-02-28T16:01:47.056 INFO:tasks.workunit.client.1.smithi087.stdout:1/160: fdatasync d0/f12 0 2024-02-28T16:01:47.057 INFO:tasks.workunit.client.0.smithi057.stdout:5/92: fdatasync d2/d8/f9 0 2024-02-28T16:01:47.060 INFO:tasks.workunit.client.0.smithi057.stdout:5/93: write d2/d15/f17 [811598,29027] 0 2024-02-28T16:01:47.064 INFO:tasks.workunit.client.1.smithi087.stdout:2/119: write d2/d7/df/f13 [668601,120172] 0 2024-02-28T16:01:47.064 INFO:tasks.workunit.client.0.smithi057.stdout:5/94: fdatasync d2/d8/fb 0 2024-02-28T16:01:47.065 INFO:tasks.workunit.client.0.smithi057.stdout:0/94: fdatasync d6/f8 0 2024-02-28T16:01:47.065 INFO:tasks.workunit.client.1.smithi087.stdout:0/196: mknod d4/d6/dc/d45/c49 0 2024-02-28T16:01:47.066 INFO:tasks.workunit.client.1.smithi087.stdout:6/147: dwrite d4/f23 [0,4194304] 0 2024-02-28T16:01:47.069 INFO:tasks.workunit.client.0.smithi057.stdout:5/95: creat d2/d8/f25 x:0 0 0 2024-02-28T16:01:47.070 INFO:tasks.workunit.client.1.smithi087.stdout:7/96: mknod d14/d15/c1a 0 2024-02-28T16:01:47.070 INFO:tasks.workunit.client.1.smithi087.stdout:0/197: write d4/dd/d20/d1f/d34/f35 [571207,14783] 0 2024-02-28T16:01:47.072 INFO:tasks.workunit.client.0.smithi057.stdout:5/96: creat d2/d19/d1c/f26 x:0 0 0 2024-02-28T16:01:47.078 INFO:tasks.workunit.client.1.smithi087.stdout:1/161: rmdir d0/d1d/d24 39 2024-02-28T16:01:47.079 INFO:tasks.workunit.client.0.smithi057.stdout:5/97: mkdir d2/d27 0 2024-02-28T16:01:47.080 INFO:tasks.workunit.client.0.smithi057.stdout:0/95: dread d6/f16 [0,4194304] 0 2024-02-28T16:01:47.080 INFO:tasks.workunit.client.0.smithi057.stdout:5/98: chown d2/d8/f25 490 1 2024-02-28T16:01:47.081 INFO:tasks.workunit.client.0.smithi057.stdout:0/96: stat d6/d12/d17/d1a/l1c 0 2024-02-28T16:01:47.083 INFO:tasks.workunit.client.1.smithi087.stdout:4/175: dread d2/f8 [0,4194304] 0 2024-02-28T16:01:47.083 INFO:tasks.workunit.client.0.smithi057.stdout:5/99: mknod d2/d19/d1c/c28 0 2024-02-28T16:01:47.085 INFO:tasks.workunit.client.1.smithi087.stdout:9/115: creat d7/dd/d15/f1f x:0 0 0 2024-02-28T16:01:47.086 INFO:tasks.workunit.client.0.smithi057.stdout:0/97: creat d6/d12/d17/d1a/f1e x:0 0 0 2024-02-28T16:01:47.087 INFO:tasks.workunit.client.0.smithi057.stdout:5/100: creat d2/d19/f29 x:0 0 0 2024-02-28T16:01:47.087 INFO:tasks.workunit.client.0.smithi057.stdout:0/98: write d6/fd [506180,28343] 0 2024-02-28T16:01:47.088 INFO:tasks.workunit.client.1.smithi087.stdout:2/120: rename d2/d7/le to d2/d7/df/d28/l2b 0 2024-02-28T16:01:47.089 INFO:tasks.workunit.client.1.smithi087.stdout:1/162: creat d0/f32 x:0 0 0 2024-02-28T16:01:47.090 INFO:tasks.workunit.client.1.smithi087.stdout:0/198: dread d4/d6/f12 [0,4194304] 0 2024-02-28T16:01:47.091 INFO:tasks.workunit.client.1.smithi087.stdout:1/163: dread - d0/f32 zero size 2024-02-28T16:01:47.092 INFO:tasks.workunit.client.1.smithi087.stdout:9/116: stat d7/dc/l19 0 2024-02-28T16:01:47.095 INFO:tasks.workunit.client.1.smithi087.stdout:9/117: dread - d7/dc/d10/f1b zero size 2024-02-28T16:01:47.095 INFO:tasks.workunit.client.1.smithi087.stdout:1/164: write d0/d14/f17 [756984,54253] 0 2024-02-28T16:01:47.097 INFO:tasks.workunit.client.1.smithi087.stdout:1/165: read d0/f12 [1845285,69156] 0 2024-02-28T16:01:47.098 INFO:tasks.workunit.client.1.smithi087.stdout:7/97: rmdir d14 39 2024-02-28T16:01:47.098 INFO:tasks.workunit.client.0.smithi057.stdout:0/99: dread d6/f16 [0,4194304] 0 2024-02-28T16:01:47.099 INFO:tasks.workunit.client.0.smithi057.stdout:0/100: fdatasync f0 0 2024-02-28T16:01:47.101 INFO:tasks.workunit.client.0.smithi057.stdout:0/101: write d6/f8 [343778,25248] 0 2024-02-28T16:01:47.104 INFO:tasks.workunit.client.1.smithi087.stdout:6/148: write d4/d30/ff [2367462,115528] 0 2024-02-28T16:01:47.105 INFO:tasks.workunit.client.0.smithi057.stdout:0/102: mknod d6/c1f 0 2024-02-28T16:01:47.109 INFO:tasks.workunit.client.1.smithi087.stdout:1/166: symlink d0/d1d/l33 0 2024-02-28T16:01:47.110 INFO:tasks.workunit.client.0.smithi057.stdout:0/103: getdents d6/d12 0 2024-02-28T16:01:47.111 INFO:tasks.workunit.client.1.smithi087.stdout:6/149: write d4/d30/d13/d1c/f1e [1486555,120676] 0 2024-02-28T16:01:47.114 INFO:tasks.workunit.client.1.smithi087.stdout:7/98: rename d14/d15/f16 to d14/d15/f1b 0 2024-02-28T16:01:47.114 INFO:tasks.workunit.client.1.smithi087.stdout:1/167: truncate d0/ff 996567 0 2024-02-28T16:01:47.116 INFO:tasks.workunit.client.1.smithi087.stdout:4/176: dwrite d2/d9/da/d1a/d26/f3d [0,4194304] 0 2024-02-28T16:01:47.116 INFO:tasks.workunit.client.1.smithi087.stdout:9/118: write d7/f8 [187277,85124] 0 2024-02-28T16:01:47.117 INFO:tasks.workunit.client.1.smithi087.stdout:6/150: fsync d4/d30/f1d 0 2024-02-28T16:01:47.121 INFO:tasks.workunit.client.1.smithi087.stdout:5/128: dread d3/d6/f8 [0,4194304] 0 2024-02-28T16:01:47.124 INFO:tasks.workunit.client.1.smithi087.stdout:0/199: dwrite d4/d6/f22 [0,4194304] 0 2024-02-28T16:01:47.125 INFO:tasks.workunit.client.1.smithi087.stdout:1/168: rename d0/fb to d0/d1a/f34 0 2024-02-28T16:01:47.126 INFO:tasks.workunit.client.1.smithi087.stdout:6/151: rmdir d4 39 2024-02-28T16:01:47.127 INFO:tasks.workunit.client.1.smithi087.stdout:0/200: chown d4/d6/dc 0 1 2024-02-28T16:01:47.128 INFO:tasks.workunit.client.0.smithi057.stdout:0/104: dwrite d6/fa [0,4194304] 0 2024-02-28T16:01:47.129 INFO:tasks.workunit.client.1.smithi087.stdout:1/169: fsync d0/fd 0 2024-02-28T16:01:47.129 INFO:tasks.workunit.client.1.smithi087.stdout:5/129: chown d3/d9/f15 110134 1 2024-02-28T16:01:47.129 INFO:tasks.workunit.client.1.smithi087.stdout:7/99: link ce d14/c1c 0 2024-02-28T16:01:47.134 INFO:tasks.workunit.client.1.smithi087.stdout:0/201: symlink d4/dd/l4a 0 2024-02-28T16:01:47.135 INFO:tasks.workunit.client.0.smithi057.stdout:0/105: mkdir d6/d12/d20 0 2024-02-28T16:01:47.136 INFO:tasks.workunit.client.1.smithi087.stdout:7/100: creat d14/f1d x:0 0 0 2024-02-28T16:01:47.137 INFO:tasks.workunit.client.1.smithi087.stdout:0/202: chown d4/dd/d20/d1f 1439307 1 2024-02-28T16:01:47.138 INFO:tasks.workunit.client.0.smithi057.stdout:0/106: rmdir d6/d12/d17 39 2024-02-28T16:01:47.139 INFO:tasks.workunit.client.1.smithi087.stdout:1/170: unlink d0/d1a/l1e 0 2024-02-28T16:01:47.142 INFO:tasks.workunit.client.1.smithi087.stdout:1/171: stat d0/f12 0 2024-02-28T16:01:47.143 INFO:tasks.workunit.client.1.smithi087.stdout:9/119: dread d7/dc/d10/f1c [0,4194304] 0 2024-02-28T16:01:47.144 INFO:tasks.workunit.client.0.smithi057.stdout:0/107: symlink d6/d12/d20/l21 0 2024-02-28T16:01:47.147 INFO:tasks.workunit.client.1.smithi087.stdout:0/203: symlink d4/dd/d20/d1f/l4b 0 2024-02-28T16:01:47.148 INFO:tasks.workunit.client.1.smithi087.stdout:4/177: dwrite d2/d9/f48 [0,4194304] 0 2024-02-28T16:01:47.148 INFO:tasks.workunit.client.1.smithi087.stdout:1/172: symlink d0/d1a/l35 0 2024-02-28T16:01:47.149 INFO:tasks.workunit.client.0.smithi057.stdout:0/108: symlink d6/d12/l22 0 2024-02-28T16:01:47.150 INFO:tasks.workunit.client.1.smithi087.stdout:0/204: chown d4/dd/d20/d1f/l4b 69869792 1 2024-02-28T16:01:47.151 INFO:tasks.workunit.client.0.smithi057.stdout:0/109: rmdir d6 39 2024-02-28T16:01:47.152 INFO:tasks.workunit.client.1.smithi087.stdout:0/205: read - d4/dd/d20/f44 zero size 2024-02-28T16:01:47.153 INFO:tasks.workunit.client.1.smithi087.stdout:1/173: chown d0/d1b/d1f/c2c 75 1 2024-02-28T16:01:47.153 INFO:tasks.workunit.client.1.smithi087.stdout:6/152: dwrite d4/f23 [0,4194304] 0 2024-02-28T16:01:47.154 INFO:tasks.workunit.client.0.smithi057.stdout:0/110: read d6/d12/f1b [2418667,70032] 0 2024-02-28T16:01:47.155 INFO:tasks.workunit.client.1.smithi087.stdout:4/178: stat d2/d9/da/d1a/d26/f35 0 2024-02-28T16:01:47.157 INFO:tasks.workunit.client.1.smithi087.stdout:9/120: write d7/dc/d10/f1b [539996,115927] 0 2024-02-28T16:01:47.157 INFO:tasks.workunit.client.1.smithi087.stdout:5/130: link d3/c11 d3/d9/c27 0 2024-02-28T16:01:47.158 INFO:tasks.workunit.client.1.smithi087.stdout:4/179: fsync d2/df/f13 0 2024-02-28T16:01:47.159 INFO:tasks.workunit.client.1.smithi087.stdout:1/174: truncate d0/f32 432634 0 2024-02-28T16:01:47.159 INFO:tasks.workunit.client.1.smithi087.stdout:0/206: truncate d4/f48 82395 0 2024-02-28T16:01:47.160 INFO:tasks.workunit.client.1.smithi087.stdout:1/175: chown d0/d14/f18 32 1 2024-02-28T16:01:47.163 INFO:tasks.workunit.client.1.smithi087.stdout:0/207: dread d4/f48 [0,4194304] 0 2024-02-28T16:01:47.163 INFO:tasks.workunit.client.1.smithi087.stdout:4/180: rmdir d2/df/d2e 39 2024-02-28T16:01:47.164 INFO:tasks.workunit.client.1.smithi087.stdout:0/208: dread d4/f48 [0,4194304] 0 2024-02-28T16:01:47.169 INFO:tasks.workunit.client.1.smithi087.stdout:5/131: creat d3/d6/f28 x:0 0 0 2024-02-28T16:01:47.169 INFO:tasks.workunit.client.1.smithi087.stdout:1/176: rename d0/f16 to d0/d1d/d24/f36 0 2024-02-28T16:01:47.171 INFO:tasks.workunit.client.1.smithi087.stdout:5/132: dread - d3/f22 zero size 2024-02-28T16:01:47.172 INFO:tasks.workunit.client.1.smithi087.stdout:0/209: mknod d4/dd/c4c 0 2024-02-28T16:01:47.174 INFO:tasks.workunit.client.1.smithi087.stdout:5/133: truncate d3/d6/f26 553964 0 2024-02-28T16:01:47.176 INFO:tasks.workunit.client.0.smithi057.stdout:0/111: truncate d6/d12/f1b 882929 0 2024-02-28T16:01:47.177 INFO:tasks.workunit.client.1.smithi087.stdout:1/177: link d0/d1a/l35 d0/d1b/d1f/l37 0 2024-02-28T16:01:47.178 INFO:tasks.workunit.client.1.smithi087.stdout:5/134: symlink d3/l29 0 2024-02-28T16:01:47.181 INFO:tasks.workunit.client.1.smithi087.stdout:0/210: unlink d4/dd/d20/d1f/c2c 0 2024-02-28T16:01:47.182 INFO:tasks.workunit.client.1.smithi087.stdout:4/181: dread d2/d9/f2c [0,4194304] 0 2024-02-28T16:01:47.184 INFO:tasks.workunit.client.1.smithi087.stdout:0/211: write d4/dd/d20/d1f/f47 [1583329,32867] 0 2024-02-28T16:01:47.185 INFO:tasks.workunit.client.0.smithi057.stdout:0/112: unlink d6/d12/f1b 0 2024-02-28T16:01:47.185 INFO:tasks.workunit.client.1.smithi087.stdout:0/212: rename d4 to d4/d1c/d4d 22 2024-02-28T16:01:47.188 INFO:tasks.workunit.client.0.smithi057.stdout:0/113: symlink d6/d12/l23 0 2024-02-28T16:01:47.191 INFO:tasks.workunit.client.1.smithi087.stdout:1/178: write d0/d1d/d24/f36 [1152510,122028] 0 2024-02-28T16:01:47.196 INFO:tasks.workunit.client.0.smithi057.stdout:0/114: truncate d6/fd 643543 0 2024-02-28T16:01:47.200 INFO:tasks.workunit.client.0.smithi057.stdout:0/115: symlink d6/d12/d17/d1a/l24 0 2024-02-28T16:01:47.201 INFO:tasks.workunit.client.0.smithi057.stdout:0/116: dread - d6/d12/d17/d1a/f1e zero size 2024-02-28T16:01:47.205 INFO:tasks.workunit.client.1.smithi087.stdout:5/135: creat d3/d9/f2a x:0 0 0 2024-02-28T16:01:47.207 INFO:tasks.workunit.client.0.smithi057.stdout:0/117: mkdir d6/d12/d17/d25 0 2024-02-28T16:01:47.208 INFO:tasks.workunit.client.1.smithi087.stdout:7/101: truncate f12 1524627 0 2024-02-28T16:01:47.209 INFO:tasks.workunit.client.1.smithi087.stdout:9/121: write f4 [5031802,74190] 0 2024-02-28T16:01:47.211 INFO:tasks.workunit.client.1.smithi087.stdout:8/132: sync 2024-02-28T16:01:47.213 INFO:tasks.workunit.client.1.smithi087.stdout:8/133: chown d2/d18/d25/f21 116074 1 2024-02-28T16:01:47.214 INFO:tasks.workunit.client.1.smithi087.stdout:1/179: symlink d0/d1a/d28/l38 0 2024-02-28T16:01:47.216 INFO:tasks.workunit.client.0.smithi057.stdout:0/118: dread f0 [0,4194304] 0 2024-02-28T16:01:47.217 INFO:tasks.workunit.client.1.smithi087.stdout:4/182: mkdir d2/df/d2e/d4a 0 2024-02-28T16:01:47.221 INFO:tasks.workunit.client.1.smithi087.stdout:7/102: chown d14/c1c 3555566 1 2024-02-28T16:01:47.221 INFO:tasks.workunit.client.1.smithi087.stdout:7/103: readlink - no filename 2024-02-28T16:01:47.224 INFO:tasks.workunit.client.1.smithi087.stdout:9/122: creat d7/dd/f20 x:0 0 0 2024-02-28T16:01:47.229 INFO:tasks.workunit.client.1.smithi087.stdout:8/134: rename d2/d18/d25/l15 to d2/d9/l26 0 2024-02-28T16:01:47.231 INFO:tasks.workunit.client.1.smithi087.stdout:0/213: dread d4/dd/f13 [0,4194304] 0 2024-02-28T16:01:47.232 INFO:tasks.workunit.client.0.smithi057.stdout:0/119: dwrite d6/f16 [0,4194304] 0 2024-02-28T16:01:47.234 INFO:tasks.workunit.client.0.smithi057.stdout:0/120: write d6/d12/d17/d1a/f1e [655027,66513] 0 2024-02-28T16:01:47.236 INFO:tasks.workunit.client.1.smithi087.stdout:4/183: dwrite d2/df/f13 [0,4194304] 0 2024-02-28T16:01:47.238 INFO:tasks.workunit.client.0.smithi057.stdout:0/121: symlink d6/d12/l26 0 2024-02-28T16:01:47.239 INFO:tasks.workunit.client.1.smithi087.stdout:7/104: rmdir d14 39 2024-02-28T16:01:47.240 INFO:tasks.workunit.client.1.smithi087.stdout:7/105: chown cd 621784 1 2024-02-28T16:01:47.241 INFO:tasks.workunit.client.1.smithi087.stdout:5/136: creat d3/d6/f2b x:0 0 0 2024-02-28T16:01:47.242 INFO:tasks.workunit.client.1.smithi087.stdout:4/184: write d2/d9/da/f3f [725717,17832] 0 2024-02-28T16:01:47.242 INFO:tasks.workunit.client.1.smithi087.stdout:0/214: dread d4/dd/d20/d1f/f33 [0,4194304] 0 2024-02-28T16:01:47.243 INFO:tasks.workunit.client.0.smithi057.stdout:0/122: symlink d6/d12/l27 0 2024-02-28T16:01:47.245 INFO:tasks.workunit.client.1.smithi087.stdout:0/215: chown d4 505887 1 2024-02-28T16:01:47.249 INFO:tasks.workunit.client.1.smithi087.stdout:0/216: write d4/dd/f1b [5909910,49574] 0 2024-02-28T16:01:47.249 INFO:tasks.workunit.client.1.smithi087.stdout:9/123: dwrite d7/f8 [0,4194304] 0 2024-02-28T16:01:47.256 INFO:tasks.workunit.client.1.smithi087.stdout:1/180: link d0/lc d0/d1b/l39 0 2024-02-28T16:01:47.258 INFO:tasks.workunit.client.0.smithi057.stdout:0/123: dread d6/f16 [0,4194304] 0 2024-02-28T16:01:47.262 INFO:tasks.workunit.client.0.smithi057.stdout:0/124: chown d6/d12/c1d 727 1 2024-02-28T16:01:47.263 INFO:tasks.workunit.client.0.smithi057.stdout:0/125: fsync d6/f8 0 2024-02-28T16:01:47.263 INFO:tasks.workunit.client.1.smithi087.stdout:5/137: dwrite d3/d9/f1e [0,4194304] 0 2024-02-28T16:01:47.268 INFO:tasks.workunit.client.0.smithi057.stdout:0/126: mknod d6/d12/d17/d1a/c28 0 2024-02-28T16:01:47.268 INFO:tasks.workunit.client.1.smithi087.stdout:9/124: dread d7/dc/d10/f1b [0,4194304] 0 2024-02-28T16:01:47.279 INFO:tasks.workunit.client.1.smithi087.stdout:7/106: creat d14/f1e x:0 0 0 2024-02-28T16:01:47.280 INFO:tasks.workunit.client.1.smithi087.stdout:1/181: creat d0/d1a/f3a x:0 0 0 2024-02-28T16:01:47.287 INFO:tasks.workunit.client.1.smithi087.stdout:9/125: dwrite d7/f14 [0,4194304] 0 2024-02-28T16:01:47.288 INFO:tasks.workunit.client.1.smithi087.stdout:9/126: dread - d7/dd/f20 zero size 2024-02-28T16:01:47.290 INFO:tasks.workunit.client.0.smithi057.stdout:0/127: dwrite d6/fa [0,4194304] 0 2024-02-28T16:01:47.294 INFO:tasks.workunit.client.0.smithi057.stdout:0/128: chown d6/lb 7 1 2024-02-28T16:01:47.294 INFO:tasks.workunit.client.1.smithi087.stdout:8/135: getdents d2/d9/d10 0 2024-02-28T16:01:47.297 INFO:tasks.workunit.client.1.smithi087.stdout:9/127: creat d7/dc/d10/f21 x:0 0 0 2024-02-28T16:01:47.304 INFO:tasks.workunit.client.1.smithi087.stdout:8/136: link d2/d9/f17 d2/f27 0 2024-02-28T16:01:47.306 INFO:tasks.workunit.client.0.smithi057.stdout:0/129: creat d6/f29 x:0 0 0 2024-02-28T16:01:47.308 INFO:tasks.workunit.client.1.smithi087.stdout:5/138: dwrite d3/d6/f26 [0,4194304] 0 2024-02-28T16:01:47.308 INFO:tasks.workunit.client.0.smithi057.stdout:0/130: chown d6/d12/l26 73061971 1 2024-02-28T16:01:47.312 INFO:tasks.workunit.client.1.smithi087.stdout:0/217: rename d4/d6/c24 to d4/dd/d20/d1f/c4e 0 2024-02-28T16:01:47.314 INFO:tasks.workunit.client.1.smithi087.stdout:1/182: fsync d0/d1a/f3a 0 2024-02-28T16:01:47.315 INFO:tasks.workunit.client.1.smithi087.stdout:8/137: readlink d2/d18/d25/l11 0 2024-02-28T16:01:47.319 INFO:tasks.workunit.client.1.smithi087.stdout:7/107: unlink f4 0 2024-02-28T16:01:47.320 INFO:tasks.workunit.client.1.smithi087.stdout:8/138: readlink d2/d9/d10/l1f 0 2024-02-28T16:01:47.321 INFO:tasks.workunit.client.1.smithi087.stdout:4/185: dwrite d2/d9/da/d1a/d26/f29 [0,4194304] 0 2024-02-28T16:01:47.322 INFO:tasks.workunit.client.1.smithi087.stdout:7/108: fsync f13 0 2024-02-28T16:01:47.326 INFO:tasks.workunit.client.1.smithi087.stdout:8/139: rename d2 to d2/d18/d28 22 2024-02-28T16:01:47.332 INFO:tasks.workunit.client.0.smithi057.stdout:0/131: dwrite d6/f16 [0,4194304] 0 2024-02-28T16:01:47.332 INFO:tasks.workunit.client.1.smithi087.stdout:7/109: mkdir d14/d1f 0 2024-02-28T16:01:47.334 INFO:tasks.workunit.client.1.smithi087.stdout:9/128: dwrite d7/dc/f11 [0,4194304] 0 2024-02-28T16:01:47.336 INFO:tasks.workunit.client.1.smithi087.stdout:1/183: dread d0/d14/f17 [0,4194304] 0 2024-02-28T16:01:47.338 INFO:tasks.workunit.client.1.smithi087.stdout:4/186: write d2/d9/da/d1a/d26/f35 [979897,24796] 0 2024-02-28T16:01:47.340 INFO:tasks.workunit.client.0.smithi057.stdout:0/132: unlink d6/d12/l27 0 2024-02-28T16:01:47.342 INFO:tasks.workunit.client.1.smithi087.stdout:7/110: chown d14/f19 0 1 2024-02-28T16:01:47.346 INFO:tasks.workunit.client.1.smithi087.stdout:3/131: sync 2024-02-28T16:01:47.347 INFO:tasks.workunit.client.1.smithi087.stdout:4/187: chown d2/df/f13 7128 1 2024-02-28T16:01:47.348 INFO:tasks.workunit.client.1.smithi087.stdout:1/184: fsync d0/d1a/f34 0 2024-02-28T16:01:47.354 INFO:tasks.workunit.client.1.smithi087.stdout:9/129: getdents d7 0 2024-02-28T16:01:47.354 INFO:tasks.workunit.client.1.smithi087.stdout:1/185: fdatasync d0/d1a/f2e 0 2024-02-28T16:01:47.354 INFO:tasks.workunit.client.1.smithi087.stdout:5/139: dwrite d3/d9/f1e [0,4194304] 0 2024-02-28T16:01:47.358 INFO:tasks.workunit.client.1.smithi087.stdout:0/218: dwrite d4/d6/f22 [0,4194304] 0 2024-02-28T16:01:47.362 INFO:tasks.workunit.client.1.smithi087.stdout:8/140: truncate d2/d9/fb 2835447 0 2024-02-28T16:01:47.363 INFO:tasks.workunit.client.1.smithi087.stdout:4/188: mknod d2/d9/da/c4b 0 2024-02-28T16:01:47.364 INFO:tasks.workunit.client.1.smithi087.stdout:9/130: creat d7/dd/d15/f22 x:0 0 0 2024-02-28T16:01:47.366 INFO:tasks.workunit.client.1.smithi087.stdout:5/140: write d3/d6/f8 [874760,98124] 0 2024-02-28T16:01:47.369 INFO:tasks.workunit.client.0.smithi057.stdout:0/133: dread d6/fd [0,4194304] 0 2024-02-28T16:01:47.369 INFO:tasks.workunit.client.1.smithi087.stdout:0/219: mknod d4/dd/d37/d39/d3a/c4f 0 2024-02-28T16:01:47.370 INFO:tasks.workunit.client.1.smithi087.stdout:4/189: write d2/df/f13 [4287379,3901] 0 2024-02-28T16:01:47.376 INFO:tasks.workunit.client.1.smithi087.stdout:7/111: dread fc [0,4194304] 0 2024-02-28T16:01:47.376 INFO:tasks.workunit.client.1.smithi087.stdout:0/220: write d4/dd/f29 [522672,122998] 0 2024-02-28T16:01:47.377 INFO:tasks.workunit.client.1.smithi087.stdout:3/132: dwrite d11/f1e [0,4194304] 0 2024-02-28T16:01:47.384 INFO:tasks.workunit.client.0.smithi057.stdout:0/134: dread d6/f8 [0,4194304] 0 2024-02-28T16:01:47.387 INFO:tasks.workunit.client.1.smithi087.stdout:9/131: dwrite d7/f8 [0,4194304] 0 2024-02-28T16:01:47.393 INFO:tasks.workunit.client.1.smithi087.stdout:4/190: dwrite d2/df/d2e/f43 [0,4194304] 0 2024-02-28T16:01:47.393 INFO:tasks.workunit.client.1.smithi087.stdout:9/132: write d7/dc/f11 [5012027,92318] 0 2024-02-28T16:01:47.393 INFO:tasks.workunit.client.0.smithi057.stdout:0/135: creat d6/f2a x:0 0 0 2024-02-28T16:01:47.395 INFO:tasks.workunit.client.1.smithi087.stdout:9/133: rename d7 to d7/dc/d23 22 2024-02-28T16:01:47.396 INFO:tasks.workunit.client.1.smithi087.stdout:9/134: chown d7 381846175 1 2024-02-28T16:01:47.398 INFO:tasks.workunit.client.0.smithi057.stdout:0/136: rename d6/d12/c18 to d6/d12/d20/c2b 0 2024-02-28T16:01:47.407 INFO:tasks.workunit.client.1.smithi087.stdout:4/191: dread d2/d9/f2c [0,4194304] 0 2024-02-28T16:01:47.415 INFO:tasks.workunit.client.1.smithi087.stdout:4/192: dread d2/df/f13 [0,4194304] 0 2024-02-28T16:01:47.416 INFO:tasks.workunit.client.0.smithi057.stdout:0/137: unlink d6/d12/d20/c2b 0 2024-02-28T16:01:47.418 INFO:tasks.workunit.client.0.smithi057.stdout:0/138: chown d6/d12/l22 120 1 2024-02-28T16:01:47.422 INFO:tasks.workunit.client.1.smithi087.stdout:3/133: creat d11/f35 x:0 0 0 2024-02-28T16:01:47.423 INFO:tasks.workunit.client.1.smithi087.stdout:3/134: dread - d11/f28 zero size 2024-02-28T16:01:47.424 INFO:tasks.workunit.client.1.smithi087.stdout:7/112: rename d14/c17 to d14/c20 0 2024-02-28T16:01:47.425 INFO:tasks.workunit.client.0.smithi057.stdout:0/139: dread d6/f19 [0,4194304] 0 2024-02-28T16:01:47.427 INFO:tasks.workunit.client.1.smithi087.stdout:0/221: symlink d4/dd/l50 0 2024-02-28T16:01:47.432 INFO:tasks.workunit.client.1.smithi087.stdout:9/135: rename d7/dc/d10/f1b to d7/d1e/f24 0 2024-02-28T16:01:47.434 INFO:tasks.workunit.client.1.smithi087.stdout:4/193: write d2/d9/de/f19 [972760,60728] 0 2024-02-28T16:01:47.438 INFO:tasks.workunit.client.1.smithi087.stdout:8/141: dwrite d2/d9/f17 [0,4194304] 0 2024-02-28T16:01:47.439 INFO:tasks.workunit.client.1.smithi087.stdout:0/222: creat d4/dd/d20/d1f/d2e/d31/f51 x:0 0 0 2024-02-28T16:01:47.440 INFO:tasks.workunit.client.0.smithi057.stdout:0/140: dwrite d6/d12/d17/d1a/f1e [0,4194304] 0 2024-02-28T16:01:47.443 INFO:tasks.workunit.client.1.smithi087.stdout:9/136: symlink d7/dc/l25 0 2024-02-28T16:01:47.446 INFO:tasks.workunit.client.1.smithi087.stdout:4/194: unlink d2/d9/d10/f1d 0 2024-02-28T16:01:47.447 INFO:tasks.workunit.client.1.smithi087.stdout:5/141: link d3/d6/le d3/d9/l2c 0 2024-02-28T16:01:47.448 INFO:tasks.workunit.client.1.smithi087.stdout:4/195: stat d2/df/d2e/d4a 0 2024-02-28T16:01:47.449 INFO:tasks.workunit.client.1.smithi087.stdout:0/223: mkdir d4/dd/d21/d52 0 2024-02-28T16:01:47.452 INFO:tasks.workunit.client.1.smithi087.stdout:7/113: rmdir d14/d1f 0 2024-02-28T16:01:47.454 INFO:tasks.workunit.client.1.smithi087.stdout:7/114: fsync d14/f1d 0 2024-02-28T16:01:47.455 INFO:tasks.workunit.client.1.smithi087.stdout:5/142: creat d3/d9/f2d x:0 0 0 2024-02-28T16:01:47.455 INFO:tasks.workunit.client.1.smithi087.stdout:4/196: chown d2/d9/da/d1a/l25 806 1 2024-02-28T16:01:47.457 INFO:tasks.workunit.client.1.smithi087.stdout:3/135: getdents d11 0 2024-02-28T16:01:47.460 INFO:tasks.workunit.client.1.smithi087.stdout:3/136: fdatasync d11/f2f 0 2024-02-28T16:01:47.461 INFO:tasks.workunit.client.0.smithi057.stdout:0/141: dwrite d6/f2a [0,4194304] 0 2024-02-28T16:01:47.461 INFO:tasks.workunit.client.1.smithi087.stdout:9/137: link d7/dd/d15/f22 d7/dc/d10/f26 0 2024-02-28T16:01:47.461 INFO:tasks.workunit.client.1.smithi087.stdout:3/137: fsync d11/f1d 0 2024-02-28T16:01:47.462 INFO:tasks.workunit.client.0.smithi057.stdout:0/142: chown d6/c15 9602 1 2024-02-28T16:01:47.464 INFO:tasks.workunit.client.0.smithi057.stdout:0/143: readlink d6/d12/d20/l21 0 2024-02-28T16:01:47.464 INFO:tasks.workunit.client.1.smithi087.stdout:0/224: dread d4/dd/d20/d1f/d34/f35 [0,4194304] 0 2024-02-28T16:01:47.465 INFO:tasks.workunit.client.0.smithi057.stdout:0/144: chown d6/d12/d17 3936 1 2024-02-28T16:01:47.474 INFO:tasks.workunit.client.1.smithi087.stdout:7/115: unlink d14/c20 0 2024-02-28T16:01:47.474 INFO:tasks.workunit.client.1.smithi087.stdout:0/225: write d4/dd/f1b [2531506,101765] 0 2024-02-28T16:01:47.475 INFO:tasks.workunit.client.1.smithi087.stdout:4/197: symlink d2/df/l4c 0 2024-02-28T16:01:47.475 INFO:tasks.workunit.client.1.smithi087.stdout:3/138: creat d11/f36 x:0 0 0 2024-02-28T16:01:47.477 INFO:tasks.workunit.client.1.smithi087.stdout:3/139: fsync d11/f17 0 2024-02-28T16:01:47.479 INFO:tasks.workunit.client.1.smithi087.stdout:7/116: mkdir d14/d21 0 2024-02-28T16:01:47.479 INFO:tasks.workunit.client.1.smithi087.stdout:8/142: dread d2/f8 [0,4194304] 0 2024-02-28T16:01:47.483 INFO:tasks.workunit.client.1.smithi087.stdout:7/117: write d14/f1e [716550,32969] 0 2024-02-28T16:01:47.484 INFO:tasks.workunit.client.1.smithi087.stdout:8/143: chown d2/f8 196700 1 2024-02-28T16:01:47.487 INFO:tasks.workunit.client.1.smithi087.stdout:5/143: link d3/d6/f8 d3/d6/f2e 0 2024-02-28T16:01:47.487 INFO:tasks.workunit.client.1.smithi087.stdout:7/118: write d14/f19 [203827,75553] 0 2024-02-28T16:01:47.489 INFO:tasks.workunit.client.1.smithi087.stdout:9/138: dwrite d7/dc/f18 [0,4194304] 0 2024-02-28T16:01:47.491 INFO:tasks.workunit.client.1.smithi087.stdout:5/144: write d3/f22 [863501,97868] 0 2024-02-28T16:01:47.493 INFO:tasks.workunit.client.1.smithi087.stdout:0/226: creat d4/f53 x:0 0 0 2024-02-28T16:01:47.494 INFO:tasks.workunit.client.1.smithi087.stdout:4/198: creat d2/d9/f4d x:0 0 0 2024-02-28T16:01:47.496 INFO:tasks.workunit.client.1.smithi087.stdout:5/145: fsync d3/d6/f1d 0 2024-02-28T16:01:47.496 INFO:tasks.workunit.client.1.smithi087.stdout:8/144: read d2/d9/d10/f12 [1448092,20770] 0 2024-02-28T16:01:47.497 INFO:tasks.workunit.client.0.smithi057.stdout:0/145: truncate d6/f19 1983676 0 2024-02-28T16:01:47.498 INFO:tasks.workunit.client.1.smithi087.stdout:0/227: dread - d4/f53 zero size 2024-02-28T16:01:47.499 INFO:tasks.workunit.client.1.smithi087.stdout:9/139: write d7/dc/ff [2533594,64717] 0 2024-02-28T16:01:47.506 INFO:tasks.workunit.client.1.smithi087.stdout:0/228: rmdir d4/d1c 39 2024-02-28T16:01:47.507 INFO:tasks.workunit.client.1.smithi087.stdout:3/140: dwrite d11/f31 [0,4194304] 0 2024-02-28T16:01:47.508 INFO:tasks.workunit.client.1.smithi087.stdout:9/140: write d7/dc/d10/f21 [63759,59620] 0 2024-02-28T16:01:47.509 INFO:tasks.workunit.client.1.smithi087.stdout:2/121: sync 2024-02-28T16:01:47.509 INFO:tasks.workunit.client.1.smithi087.stdout:6/153: sync 2024-02-28T16:01:47.510 INFO:tasks.workunit.client.1.smithi087.stdout:3/141: dread - d11/f26 zero size 2024-02-28T16:01:47.512 INFO:tasks.workunit.client.1.smithi087.stdout:9/141: chown d7/f8 386 1 2024-02-28T16:01:47.514 INFO:tasks.workunit.client.1.smithi087.stdout:3/142: readlink d11/l27 0 2024-02-28T16:01:47.519 INFO:tasks.workunit.client.1.smithi087.stdout:0/229: chown d4/d6/dc 982661098 1 2024-02-28T16:01:47.519 INFO:tasks.workunit.client.1.smithi087.stdout:4/199: dread d2/d9/f24 [0,4194304] 0 2024-02-28T16:01:47.522 INFO:tasks.workunit.client.1.smithi087.stdout:0/230: rename d4/dd to d4/dd/d21/d32/d54 22 2024-02-28T16:01:47.523 INFO:tasks.workunit.client.1.smithi087.stdout:9/142: chown d7/d1e/f24 4718473 1 2024-02-28T16:01:47.524 INFO:tasks.workunit.client.1.smithi087.stdout:9/143: chown d7/lb 2595 1 2024-02-28T16:01:47.525 INFO:tasks.workunit.client.1.smithi087.stdout:2/122: creat d2/d7/d17/f2c x:0 0 0 2024-02-28T16:01:47.525 INFO:tasks.workunit.client.1.smithi087.stdout:3/143: rename d11/f2d to d11/f37 0 2024-02-28T16:01:47.526 INFO:tasks.workunit.client.1.smithi087.stdout:5/146: getdents d3/d6 0 2024-02-28T16:01:47.531 INFO:tasks.workunit.client.1.smithi087.stdout:2/123: chown d2/d7/df/c16 1119 1 2024-02-28T16:01:47.536 INFO:tasks.workunit.client.1.smithi087.stdout:7/119: truncate f7 1135676 0 2024-02-28T16:01:47.538 INFO:tasks.workunit.client.1.smithi087.stdout:5/147: creat d3/d6/f2f x:0 0 0 2024-02-28T16:01:47.539 INFO:tasks.workunit.client.1.smithi087.stdout:4/200: mknod d2/d9/d10/c4e 0 2024-02-28T16:01:47.539 INFO:tasks.workunit.client.1.smithi087.stdout:8/145: dwrite d2/d9/d10/f12 [8388608,4194304] 0 2024-02-28T16:01:47.541 INFO:tasks.workunit.client.1.smithi087.stdout:4/201: fsync d2/f3b 0 2024-02-28T16:01:47.541 INFO:tasks.workunit.client.1.smithi087.stdout:3/144: rmdir d11 39 2024-02-28T16:01:47.545 INFO:tasks.workunit.client.1.smithi087.stdout:6/154: truncate d4/d12/f21 193445 0 2024-02-28T16:01:47.545 INFO:tasks.workunit.client.1.smithi087.stdout:1/186: sync 2024-02-28T16:01:47.545 INFO:tasks.workunit.client.1.smithi087.stdout:4/202: fsync d2/df/d2e/f47 0 2024-02-28T16:01:47.548 INFO:tasks.workunit.client.1.smithi087.stdout:0/231: write d4/f48 [106306,118987] 0 2024-02-28T16:01:47.549 INFO:tasks.workunit.client.1.smithi087.stdout:9/144: dwrite d7/dc/f13 [4194304,4194304] 0 2024-02-28T16:01:47.550 INFO:tasks.workunit.client.1.smithi087.stdout:1/187: dread - d0/d1a/d28/f29 zero size 2024-02-28T16:01:47.558 INFO:tasks.workunit.client.1.smithi087.stdout:8/146: dread d2/f5 [0,4194304] 0 2024-02-28T16:01:47.558 INFO:tasks.workunit.client.1.smithi087.stdout:3/145: stat d11/f2b 0 2024-02-28T16:01:47.558 INFO:tasks.workunit.client.1.smithi087.stdout:6/155: mknod d4/c32 0 2024-02-28T16:01:47.559 INFO:tasks.workunit.client.1.smithi087.stdout:5/148: mkdir d3/d6/d30 0 2024-02-28T16:01:47.559 INFO:tasks.workunit.client.1.smithi087.stdout:4/203: creat d2/df/d2e/f4f x:0 0 0 2024-02-28T16:01:47.561 INFO:tasks.workunit.client.1.smithi087.stdout:1/188: dread d0/f32 [0,4194304] 0 2024-02-28T16:01:47.563 INFO:tasks.workunit.client.1.smithi087.stdout:2/124: creat d2/d7/f2d x:0 0 0 2024-02-28T16:01:47.565 INFO:tasks.workunit.client.1.smithi087.stdout:1/189: stat d0/d14 0 2024-02-28T16:01:47.565 INFO:tasks.workunit.client.1.smithi087.stdout:4/204: write d2/d9/da/f36 [3244461,13564] 0 2024-02-28T16:01:47.568 INFO:tasks.workunit.client.1.smithi087.stdout:4/205: chown d2/f4 2 1 2024-02-28T16:01:47.573 INFO:tasks.workunit.client.1.smithi087.stdout:7/120: chown f7 7401 1 2024-02-28T16:01:47.574 INFO:tasks.workunit.client.1.smithi087.stdout:0/232: dread d4/d6/f2a [0,4194304] 0 2024-02-28T16:01:47.576 INFO:tasks.workunit.client.1.smithi087.stdout:6/156: mknod d4/c33 0 2024-02-28T16:01:47.582 INFO:tasks.workunit.client.1.smithi087.stdout:2/125: truncate d2/d7/df/f1e 841086 0 2024-02-28T16:01:47.582 INFO:tasks.workunit.client.1.smithi087.stdout:5/149: fsync d3/d9/f15 0 2024-02-28T16:01:47.582 INFO:tasks.workunit.client.1.smithi087.stdout:9/145: dread d7/dc/d10/f1c [0,4194304] 0 2024-02-28T16:01:47.582 INFO:tasks.workunit.client.1.smithi087.stdout:6/157: write d4/dc/f1f [1504199,100380] 0 2024-02-28T16:01:47.585 INFO:tasks.workunit.client.1.smithi087.stdout:6/158: readlink d4/dc/l29 0 2024-02-28T16:01:47.586 INFO:tasks.workunit.client.1.smithi087.stdout:3/146: rename c4 to d11/c38 0 2024-02-28T16:01:47.587 INFO:tasks.workunit.client.0.smithi057.stdout:0/146: dwrite d6/f19 [0,4194304] 0 2024-02-28T16:01:47.588 INFO:tasks.workunit.client.1.smithi087.stdout:7/121: creat d14/d15/f22 x:0 0 0 2024-02-28T16:01:47.591 INFO:tasks.workunit.client.1.smithi087.stdout:2/126: creat d2/d7/df/d28/f2e x:0 0 0 2024-02-28T16:01:47.591 INFO:tasks.workunit.client.1.smithi087.stdout:8/147: dread d2/d9/f16 [4194304,4194304] 0 2024-02-28T16:01:47.592 INFO:tasks.workunit.client.0.smithi057.stdout:0/147: symlink d6/l2c 0 2024-02-28T16:01:47.593 INFO:tasks.workunit.client.1.smithi087.stdout:5/150: mkdir d3/d9/d31 0 2024-02-28T16:01:47.596 INFO:tasks.workunit.client.1.smithi087.stdout:1/190: dwrite d0/d14/f20 [0,4194304] 0 2024-02-28T16:01:47.598 INFO:tasks.workunit.client.1.smithi087.stdout:0/233: mkdir d4/d6/d55 0 2024-02-28T16:01:47.599 INFO:tasks.workunit.client.1.smithi087.stdout:3/147: rename d11/d33/l34 to d11/l39 0 2024-02-28T16:01:47.603 INFO:tasks.workunit.client.1.smithi087.stdout:4/206: symlink d2/d9/l50 0 2024-02-28T16:01:47.606 INFO:tasks.workunit.client.1.smithi087.stdout:7/122: dread d14/f1e [0,4194304] 0 2024-02-28T16:01:47.608 INFO:tasks.workunit.client.0.smithi057.stdout:0/148: dwrite d6/fa [0,4194304] 0 2024-02-28T16:01:47.609 INFO:tasks.workunit.client.1.smithi087.stdout:8/148: mknod d2/d9/c29 0 2024-02-28T16:01:47.614 INFO:tasks.workunit.client.0.smithi057.stdout:0/149: chown d6/le 246842 1 2024-02-28T16:01:47.618 INFO:tasks.workunit.client.0.smithi057.stdout:0/150: mknod d6/c2d 0 2024-02-28T16:01:47.618 INFO:tasks.workunit.client.1.smithi087.stdout:4/207: rmdir d2/d9/d10 39 2024-02-28T16:01:47.621 INFO:tasks.workunit.client.1.smithi087.stdout:5/151: dwrite d3/d9/f2a [0,4194304] 0 2024-02-28T16:01:47.622 INFO:tasks.workunit.client.0.smithi057.stdout:0/151: mknod d6/d12/c2e 0 2024-02-28T16:01:47.626 INFO:tasks.workunit.client.0.smithi057.stdout:0/152: creat d6/f2f x:0 0 0 2024-02-28T16:01:47.629 INFO:tasks.workunit.client.0.smithi057.stdout:0/153: symlink d6/l30 0 2024-02-28T16:01:47.629 INFO:tasks.workunit.client.1.smithi087.stdout:1/191: dwrite d0/d1d/d24/f36 [4194304,4194304] 0 2024-02-28T16:01:47.629 INFO:tasks.workunit.client.0.smithi057.stdout:0/154: stat d6/c2d 0 2024-02-28T16:01:47.630 INFO:tasks.workunit.client.0.smithi057.stdout:0/155: read d6/fd [471449,19347] 0 2024-02-28T16:01:47.634 INFO:tasks.workunit.client.1.smithi087.stdout:7/123: mknod d14/d21/c23 0 2024-02-28T16:01:47.635 INFO:tasks.workunit.client.1.smithi087.stdout:9/146: getdents d7/dc/d10 0 2024-02-28T16:01:47.639 INFO:tasks.workunit.client.1.smithi087.stdout:6/159: write d4/f26 [730202,32584] 0 2024-02-28T16:01:47.642 INFO:tasks.workunit.client.1.smithi087.stdout:3/148: dwrite d11/f2a [0,4194304] 0 2024-02-28T16:01:47.642 INFO:tasks.workunit.client.1.smithi087.stdout:9/147: write d7/dd/f20 [512027,41206] 0 2024-02-28T16:01:47.643 INFO:tasks.workunit.client.1.smithi087.stdout:8/149: symlink d2/d9/d1a/l2a 0 2024-02-28T16:01:47.648 INFO:tasks.workunit.client.1.smithi087.stdout:7/124: chown ce 0 1 2024-02-28T16:01:47.648 INFO:tasks.workunit.client.1.smithi087.stdout:3/149: stat d11/f29 0 2024-02-28T16:01:47.648 INFO:tasks.workunit.client.1.smithi087.stdout:4/208: link d2/d9/da/f36 d2/d49/f51 0 2024-02-28T16:01:47.650 INFO:tasks.workunit.client.1.smithi087.stdout:2/127: dwrite d2/d7/f18 [0,4194304] 0 2024-02-28T16:01:47.651 INFO:tasks.workunit.client.1.smithi087.stdout:5/152: getdents d3/d6/d30 0 2024-02-28T16:01:47.652 INFO:tasks.workunit.client.1.smithi087.stdout:8/150: stat d2/d9/f17 0 2024-02-28T16:01:47.654 INFO:tasks.workunit.client.1.smithi087.stdout:5/153: write d3/f13 [537288,105153] 0 2024-02-28T16:01:47.655 INFO:tasks.workunit.client.1.smithi087.stdout:8/151: chown d2/d9/f23 0 1 2024-02-28T16:01:47.655 INFO:tasks.workunit.client.1.smithi087.stdout:1/192: link d0/d1a/f3a d0/d1a/d28/f3b 0 2024-02-28T16:01:47.657 INFO:tasks.workunit.client.0.smithi057.stdout:0/156: rmdir d6 39 2024-02-28T16:01:47.659 INFO:tasks.workunit.client.1.smithi087.stdout:9/148: rename d7/lb to d7/l27 0 2024-02-28T16:01:47.660 INFO:tasks.workunit.client.1.smithi087.stdout:3/150: mkdir d11/d3a 0 2024-02-28T16:01:47.662 INFO:tasks.workunit.client.1.smithi087.stdout:2/128: readlink d2/d7/l23 0 2024-02-28T16:01:47.665 INFO:tasks.workunit.client.0.smithi057.stdout:0/157: rename d6/f16 to d6/d12/d20/f31 0 2024-02-28T16:01:47.665 INFO:tasks.workunit.client.1.smithi087.stdout:2/129: write d2/d7/d17/f24 [440466,7149] 0 2024-02-28T16:01:47.666 INFO:tasks.workunit.client.1.smithi087.stdout:8/152: creat d2/d9/d10/f2b x:0 0 0 2024-02-28T16:01:47.667 INFO:tasks.workunit.client.1.smithi087.stdout:1/193: symlink d0/d1d/d24/l3c 0 2024-02-28T16:01:47.668 INFO:tasks.workunit.client.0.smithi057.stdout:0/158: chown d6/lb 1722227051 1 2024-02-28T16:01:47.668 INFO:tasks.workunit.client.1.smithi087.stdout:5/154: read d3/d6/f8 [4055477,112826] 0 2024-02-28T16:01:47.669 INFO:tasks.workunit.client.0.smithi057.stdout:0/159: stat d6/d12/d17/d1a 0 2024-02-28T16:01:47.669 INFO:tasks.workunit.client.1.smithi087.stdout:0/234: truncate d4/d6/f22 3890234 0 2024-02-28T16:01:47.672 INFO:tasks.workunit.client.1.smithi087.stdout:4/209: mknod d2/d9/d10/d22/c52 0 2024-02-28T16:01:47.672 INFO:tasks.workunit.client.1.smithi087.stdout:9/149: fsync d7/dc/f11 0 2024-02-28T16:01:47.674 INFO:tasks.workunit.client.1.smithi087.stdout:2/130: fdatasync d2/d7/f11 0 2024-02-28T16:01:47.674 INFO:tasks.workunit.client.0.smithi057.stdout:0/160: creat d6/d12/d17/d25/f32 x:0 0 0 2024-02-28T16:01:47.675 INFO:tasks.workunit.client.1.smithi087.stdout:9/150: fsync d7/f14 0 2024-02-28T16:01:47.677 INFO:tasks.workunit.client.1.smithi087.stdout:4/210: stat d2/d9/d10/d22/f27 0 2024-02-28T16:01:47.677 INFO:tasks.workunit.client.0.smithi057.stdout:0/161: creat d6/d12/d17/d25/f33 x:0 0 0 2024-02-28T16:01:47.678 INFO:tasks.workunit.client.0.smithi057.stdout:0/162: dread - d6/f29 zero size 2024-02-28T16:01:47.680 INFO:tasks.workunit.client.1.smithi087.stdout:1/194: unlink d0/f32 0 2024-02-28T16:01:47.681 INFO:tasks.workunit.client.1.smithi087.stdout:2/131: chown d2/d2a 711554 1 2024-02-28T16:01:47.681 INFO:tasks.workunit.client.1.smithi087.stdout:6/160: read d4/f26 [331006,76297] 0 2024-02-28T16:01:47.684 INFO:tasks.workunit.client.1.smithi087.stdout:7/125: dwrite d14/f1e [0,4194304] 0 2024-02-28T16:01:47.685 INFO:tasks.workunit.client.1.smithi087.stdout:8/153: creat d2/d9/d1a/f2c x:0 0 0 2024-02-28T16:01:47.687 INFO:tasks.workunit.client.1.smithi087.stdout:5/155: chown d3/d6/f28 0 1 2024-02-28T16:01:47.687 INFO:tasks.workunit.client.1.smithi087.stdout:2/132: chown d2/d7/df/f1c 10 1 2024-02-28T16:01:47.689 INFO:tasks.workunit.client.1.smithi087.stdout:8/154: readlink d2/d9/d10/l1f 0 2024-02-28T16:01:47.690 INFO:tasks.workunit.client.1.smithi087.stdout:9/151: read - d7/dd/d15/f22 zero size 2024-02-28T16:01:47.691 INFO:tasks.workunit.client.1.smithi087.stdout:2/133: readlink d2/d7/l20 0 2024-02-28T16:01:47.695 INFO:tasks.workunit.client.1.smithi087.stdout:1/195: truncate d0/fd 2409296 0 2024-02-28T16:01:47.696 INFO:tasks.workunit.client.0.smithi057.stdout:0/163: dwrite d6/f19 [0,4194304] 0 2024-02-28T16:01:47.699 INFO:tasks.workunit.client.0.smithi057.stdout:0/164: chown d6/f19 0 1 2024-02-28T16:01:47.703 INFO:tasks.workunit.client.0.smithi057.stdout:0/165: mkdir d6/d12/d17/d34 0 2024-02-28T16:01:47.704 INFO:tasks.workunit.client.1.smithi087.stdout:8/155: mknod d2/d9/c2d 0 2024-02-28T16:01:47.710 INFO:tasks.workunit.client.1.smithi087.stdout:9/152: rename d7/dc/ff to d7/dd/f28 0 2024-02-28T16:01:47.713 INFO:tasks.workunit.client.0.smithi057.stdout:0/166: rename d6/d12/d17/d1a/l24 to d6/d12/d17/d25/l35 0 2024-02-28T16:01:47.715 INFO:tasks.workunit.client.0.smithi057.stdout:0/167: chown d6/fd 1595522 1 2024-02-28T16:01:47.715 INFO:tasks.workunit.client.0.smithi057.stdout:0/168: readlink d6/d12/l26 0 2024-02-28T16:01:47.717 INFO:tasks.workunit.client.1.smithi087.stdout:0/235: dwrite d4/d6/f12 [0,4194304] 0 2024-02-28T16:01:47.719 INFO:tasks.workunit.client.0.smithi057.stdout:0/169: getdents d6/d12/d17/d34 0 2024-02-28T16:01:47.721 INFO:tasks.workunit.client.0.smithi057.stdout:0/170: unlink d6/d12/l22 0 2024-02-28T16:01:47.722 INFO:tasks.workunit.client.1.smithi087.stdout:1/196: dread d0/fa [0,4194304] 0 2024-02-28T16:01:47.725 INFO:tasks.workunit.client.1.smithi087.stdout:6/161: link d4/dc/l29 d4/d30/d13/d1c/l34 0 2024-02-28T16:01:47.726 INFO:tasks.workunit.client.0.smithi057.stdout:0/171: creat d6/d12/d20/f36 x:0 0 0 2024-02-28T16:01:47.727 INFO:tasks.workunit.client.1.smithi087.stdout:3/151: dread f10 [0,4194304] 0 2024-02-28T16:01:47.728 INFO:tasks.workunit.client.1.smithi087.stdout:7/126: link cd d14/d21/c24 0 2024-02-28T16:01:47.729 INFO:tasks.workunit.client.1.smithi087.stdout:9/153: mknod d7/c29 0 2024-02-28T16:01:47.733 INFO:tasks.workunit.client.0.smithi057.stdout:0/172: creat d6/d12/d17/f37 x:0 0 0 2024-02-28T16:01:47.733 INFO:tasks.workunit.client.1.smithi087.stdout:7/127: symlink d14/l25 0 2024-02-28T16:01:47.736 INFO:tasks.workunit.client.1.smithi087.stdout:9/154: write d7/dd/fe [1035560,39530] 0 2024-02-28T16:01:47.736 INFO:tasks.workunit.client.1.smithi087.stdout:6/162: symlink d4/l35 0 2024-02-28T16:01:47.737 INFO:tasks.workunit.client.1.smithi087.stdout:5/156: dwrite d3/d6/f1d [0,4194304] 0 2024-02-28T16:01:47.739 INFO:tasks.workunit.client.0.smithi057.stdout:0/173: mkdir d6/d12/d38 0 2024-02-28T16:01:47.743 INFO:tasks.workunit.client.1.smithi087.stdout:8/156: dwrite d2/d9/d10/f12 [8388608,4194304] 0 2024-02-28T16:01:47.746 INFO:tasks.workunit.client.1.smithi087.stdout:7/128: creat d14/d21/f26 x:0 0 0 2024-02-28T16:01:47.752 INFO:tasks.workunit.client.1.smithi087.stdout:0/236: dwrite d4/dd/d37/f3d [0,4194304] 0 2024-02-28T16:01:47.760 INFO:tasks.workunit.client.1.smithi087.stdout:8/157: write d2/d9/f19 [1499852,127457] 0 2024-02-28T16:01:47.761 INFO:tasks.workunit.client.1.smithi087.stdout:9/155: rename d7/dc/f11 to d7/dd/d15/f2a 0 2024-02-28T16:01:47.762 INFO:tasks.workunit.client.1.smithi087.stdout:3/152: dwrite d11/f36 [0,4194304] 0 2024-02-28T16:01:47.763 INFO:tasks.workunit.client.1.smithi087.stdout:8/158: dread - d2/d18/f22 zero size 2024-02-28T16:01:47.769 INFO:tasks.workunit.client.1.smithi087.stdout:0/237: mknod d4/dd/d20/d1f/c56 0 2024-02-28T16:01:47.772 INFO:tasks.workunit.client.1.smithi087.stdout:9/156: fsync d7/dc/d10/f26 0 2024-02-28T16:01:47.773 INFO:tasks.workunit.client.1.smithi087.stdout:8/159: write d2/d9/d10/f12 [2667849,25663] 0 2024-02-28T16:01:47.773 INFO:tasks.workunit.client.1.smithi087.stdout:2/134: truncate d2/d7/f15 3488 0 2024-02-28T16:01:47.780 INFO:tasks.workunit.client.1.smithi087.stdout:6/163: dwrite d4/d30/d13/f2d [0,4194304] 0 2024-02-28T16:01:47.784 INFO:tasks.workunit.client.1.smithi087.stdout:9/157: unlink d7/dc/f13 0 2024-02-28T16:01:47.789 INFO:tasks.workunit.client.1.smithi087.stdout:0/238: truncate d4/dd/d37/d39/d3a/f46 365614 0 2024-02-28T16:01:47.791 INFO:tasks.workunit.client.1.smithi087.stdout:1/197: dwrite d0/d1a/d28/f3b [0,4194304] 0 2024-02-28T16:01:47.797 INFO:tasks.workunit.client.1.smithi087.stdout:7/129: write f7 [206990,27344] 0 2024-02-28T16:01:47.798 INFO:tasks.workunit.client.1.smithi087.stdout:5/157: dwrite d3/d6/f19 [0,4194304] 0 2024-02-28T16:01:47.801 INFO:tasks.workunit.client.1.smithi087.stdout:7/130: write d14/f19 [1235989,22507] 0 2024-02-28T16:01:47.802 INFO:tasks.workunit.client.1.smithi087.stdout:9/158: dread d7/d1e/f24 [0,4194304] 0 2024-02-28T16:01:47.804 INFO:tasks.workunit.client.1.smithi087.stdout:6/164: creat d4/dc/d10/f36 x:0 0 0 2024-02-28T16:01:47.809 INFO:tasks.workunit.client.1.smithi087.stdout:8/160: link d2/d18/d25/f21 d2/d9/d1a/f2e 0 2024-02-28T16:01:47.809 INFO:tasks.workunit.client.1.smithi087.stdout:1/198: creat d0/d1b/f3d x:0 0 0 2024-02-28T16:01:47.819 INFO:tasks.workunit.client.1.smithi087.stdout:2/135: dread d2/d7/f15 [0,4194304] 0 2024-02-28T16:01:47.819 INFO:tasks.workunit.client.1.smithi087.stdout:8/161: write d2/d9/d10/f2b [550660,37108] 0 2024-02-28T16:01:47.819 INFO:tasks.workunit.client.1.smithi087.stdout:1/199: mknod d0/d1a/c3e 0 2024-02-28T16:01:47.820 INFO:tasks.workunit.client.1.smithi087.stdout:9/159: getdents d7 0 2024-02-28T16:01:47.822 INFO:tasks.workunit.client.1.smithi087.stdout:1/200: chown d0/d14 1675977077 1 2024-02-28T16:01:47.826 INFO:tasks.workunit.client.1.smithi087.stdout:2/136: readlink d2/d7/d17/l26 0 2024-02-28T16:01:47.827 INFO:tasks.workunit.client.1.smithi087.stdout:9/160: dread d7/dc/d10/f21 [0,4194304] 0 2024-02-28T16:01:47.827 INFO:tasks.workunit.client.1.smithi087.stdout:2/137: stat d2/fb 0 2024-02-28T16:01:47.829 INFO:tasks.workunit.client.1.smithi087.stdout:5/158: dread d3/d6/f8 [0,4194304] 0 2024-02-28T16:01:47.829 INFO:tasks.workunit.client.1.smithi087.stdout:1/201: mkdir d0/d14/d3f 0 2024-02-28T16:01:47.831 INFO:tasks.workunit.client.1.smithi087.stdout:7/131: dwrite d14/d15/f22 [0,4194304] 0 2024-02-28T16:01:47.831 INFO:tasks.workunit.client.1.smithi087.stdout:0/239: truncate d4/dd/d20/d1f/f47 1257077 0 2024-02-28T16:01:47.834 INFO:tasks.workunit.client.1.smithi087.stdout:1/202: fdatasync d0/d1a/f3a 0 2024-02-28T16:01:47.834 INFO:tasks.workunit.client.1.smithi087.stdout:5/159: write d3/f21 [164933,99717] 0 2024-02-28T16:01:47.837 INFO:tasks.workunit.client.1.smithi087.stdout:6/165: dwrite d4/f23 [0,4194304] 0 2024-02-28T16:01:47.837 INFO:tasks.workunit.client.1.smithi087.stdout:8/162: mknod d2/d9/d10/d24/c2f 0 2024-02-28T16:01:47.840 INFO:tasks.workunit.client.1.smithi087.stdout:9/161: rename d7/dc/l19 to d7/d1e/l2b 0 2024-02-28T16:01:47.841 INFO:tasks.workunit.client.1.smithi087.stdout:9/162: chown d7/d1e/f24 56242 1 2024-02-28T16:01:47.847 INFO:tasks.workunit.client.1.smithi087.stdout:5/160: fsync d3/d6/f2b 0 2024-02-28T16:01:47.851 INFO:tasks.workunit.client.1.smithi087.stdout:8/163: creat d2/f30 x:0 0 0 2024-02-28T16:01:47.852 INFO:tasks.workunit.client.1.smithi087.stdout:6/166: symlink d4/d30/l37 0 2024-02-28T16:01:47.857 INFO:tasks.workunit.client.1.smithi087.stdout:7/132: dwrite d14/f1e [0,4194304] 0 2024-02-28T16:01:47.860 INFO:tasks.workunit.client.1.smithi087.stdout:9/163: dwrite d7/f14 [0,4194304] 0 2024-02-28T16:01:47.863 INFO:tasks.workunit.client.1.smithi087.stdout:0/240: rmdir d4 39 2024-02-28T16:01:47.871 INFO:tasks.workunit.client.1.smithi087.stdout:7/133: mkdir d14/d27 0 2024-02-28T16:01:47.872 INFO:tasks.workunit.client.1.smithi087.stdout:7/134: chown d14 113 1 2024-02-28T16:01:47.874 INFO:tasks.workunit.client.1.smithi087.stdout:6/167: rmdir d4/d30/d13/d1c 39 2024-02-28T16:01:47.876 INFO:tasks.workunit.client.1.smithi087.stdout:2/138: truncate d2/d7/f12 2125249 0 2024-02-28T16:01:47.877 INFO:tasks.workunit.client.1.smithi087.stdout:1/203: truncate d0/d14/f20 589184 0 2024-02-28T16:01:47.879 INFO:tasks.workunit.client.1.smithi087.stdout:1/204: read - d0/d1a/f2e zero size 2024-02-28T16:01:47.882 INFO:tasks.workunit.client.1.smithi087.stdout:2/139: symlink d2/d7/df/l2f 0 2024-02-28T16:01:47.884 INFO:tasks.workunit.client.1.smithi087.stdout:7/135: getdents d14/d21 0 2024-02-28T16:01:47.885 INFO:tasks.workunit.client.1.smithi087.stdout:1/205: symlink d0/l40 0 2024-02-28T16:01:47.887 INFO:tasks.workunit.client.1.smithi087.stdout:6/168: getdents d4/dc/d10 0 2024-02-28T16:01:47.889 INFO:tasks.workunit.client.1.smithi087.stdout:7/136: write d14/f19 [1759256,130741] 0 2024-02-28T16:01:47.889 INFO:tasks.workunit.client.1.smithi087.stdout:1/206: write d0/d1d/d24/f36 [153370,125550] 0 2024-02-28T16:01:47.890 INFO:tasks.workunit.client.1.smithi087.stdout:8/164: write d2/f5 [476401,126707] 0 2024-02-28T16:01:47.894 INFO:tasks.workunit.client.1.smithi087.stdout:9/164: write d7/d1e/f24 [395081,87552] 0 2024-02-28T16:01:47.900 INFO:tasks.workunit.client.1.smithi087.stdout:1/207: creat d0/d1b/d1f/f41 x:0 0 0 2024-02-28T16:01:47.901 INFO:tasks.workunit.client.1.smithi087.stdout:8/165: mknod d2/d18/c31 0 2024-02-28T16:01:47.903 INFO:tasks.workunit.client.1.smithi087.stdout:6/169: getdents d4 0 2024-02-28T16:01:47.904 INFO:tasks.workunit.client.1.smithi087.stdout:8/166: fsync d2/d9/d1a/f2c 0 2024-02-28T16:01:47.906 INFO:tasks.workunit.client.1.smithi087.stdout:1/208: creat d0/d14/f42 x:0 0 0 2024-02-28T16:01:47.909 INFO:tasks.workunit.client.1.smithi087.stdout:6/170: mkdir d4/d30/d13/d38 0 2024-02-28T16:01:47.912 INFO:tasks.workunit.client.1.smithi087.stdout:7/137: dwrite d14/f19 [0,4194304] 0 2024-02-28T16:01:47.912 INFO:tasks.workunit.client.1.smithi087.stdout:1/209: mkdir d0/d1b/d43 0 2024-02-28T16:01:47.918 INFO:tasks.workunit.client.1.smithi087.stdout:2/140: dwrite d2/d7/f15 [0,4194304] 0 2024-02-28T16:01:47.919 INFO:tasks.workunit.client.1.smithi087.stdout:1/210: mknod d0/d1a/d28/c44 0 2024-02-28T16:01:47.922 INFO:tasks.workunit.client.1.smithi087.stdout:1/211: fsync d0/d1a/f3a 0 2024-02-28T16:01:47.925 INFO:tasks.workunit.client.1.smithi087.stdout:7/138: creat d14/d27/f28 x:0 0 0 2024-02-28T16:01:47.928 INFO:tasks.workunit.client.1.smithi087.stdout:7/139: symlink d14/d27/l29 0 2024-02-28T16:01:47.932 INFO:tasks.workunit.client.1.smithi087.stdout:9/165: dwrite d7/f8 [0,4194304] 0 2024-02-28T16:01:47.932 INFO:tasks.workunit.client.1.smithi087.stdout:1/212: chown d0/d14/f20 3 1 2024-02-28T16:01:47.937 INFO:tasks.workunit.client.1.smithi087.stdout:7/140: rename d14/f19 to d14/f2a 0 2024-02-28T16:01:47.940 INFO:tasks.workunit.client.1.smithi087.stdout:9/166: read d7/dd/d15/f2a [1720916,479] 0 2024-02-28T16:01:47.941 INFO:tasks.workunit.client.1.smithi087.stdout:7/141: rmdir d14/d21 39 2024-02-28T16:01:47.944 INFO:tasks.workunit.client.1.smithi087.stdout:9/167: write f4 [2998968,107006] 0 2024-02-28T16:01:47.945 INFO:tasks.workunit.client.1.smithi087.stdout:7/142: fdatasync f7 0 2024-02-28T16:01:47.947 INFO:tasks.workunit.client.1.smithi087.stdout:1/213: link d0/d14/f42 d0/d1b/f45 0 2024-02-28T16:01:47.949 INFO:tasks.workunit.client.1.smithi087.stdout:7/143: fdatasync d14/d15/f22 0 2024-02-28T16:01:47.949 INFO:tasks.workunit.client.1.smithi087.stdout:2/141: dwrite d2/d7/f15 [0,4194304] 0 2024-02-28T16:01:47.951 INFO:tasks.workunit.client.1.smithi087.stdout:8/167: dwrite d2/d9/d1a/f2e [0,4194304] 0 2024-02-28T16:01:47.952 INFO:tasks.workunit.client.1.smithi087.stdout:9/168: write d7/f8 [3165488,58565] 0 2024-02-28T16:01:47.954 INFO:tasks.workunit.client.1.smithi087.stdout:8/168: write d2/f6 [116650,81137] 0 2024-02-28T16:01:47.955 INFO:tasks.workunit.client.1.smithi087.stdout:9/169: chown d7/dd/f20 7938 1 2024-02-28T16:01:47.957 INFO:tasks.workunit.client.1.smithi087.stdout:2/142: mknod d2/d2a/c30 0 2024-02-28T16:01:47.958 INFO:tasks.workunit.client.1.smithi087.stdout:2/143: dread - d2/d7/f2d zero size 2024-02-28T16:01:47.960 INFO:tasks.workunit.client.1.smithi087.stdout:6/171: dread d4/f9 [0,4194304] 0 2024-02-28T16:01:47.967 INFO:tasks.workunit.client.1.smithi087.stdout:8/169: truncate d2/d9/fb 3623197 0 2024-02-28T16:01:47.969 INFO:tasks.workunit.client.1.smithi087.stdout:6/172: read d4/d30/d13/f2a [72779,124453] 0 2024-02-28T16:01:47.972 INFO:tasks.workunit.client.1.smithi087.stdout:8/170: chown d2/d9/f19 24 1 2024-02-28T16:01:47.977 INFO:tasks.workunit.client.1.smithi087.stdout:8/171: write d2/d9/d1a/f2c [56596,36143] 0 2024-02-28T16:01:47.979 INFO:tasks.workunit.client.1.smithi087.stdout:6/173: creat d4/d30/d13/d1c/f39 x:0 0 0 2024-02-28T16:01:47.980 INFO:tasks.workunit.client.1.smithi087.stdout:1/214: dwrite d0/d14/f42 [0,4194304] 0 2024-02-28T16:01:47.980 INFO:tasks.workunit.client.1.smithi087.stdout:9/170: dwrite d7/dd/f28 [4194304,4194304] 0 2024-02-28T16:01:47.987 INFO:tasks.workunit.client.1.smithi087.stdout:6/174: rename d4/dc/d10/f2e to d4/d30/d13/d38/f3a 0 2024-02-28T16:01:47.987 INFO:tasks.workunit.client.1.smithi087.stdout:8/172: fsync d2/d18/d25/f21 0 2024-02-28T16:01:47.989 INFO:tasks.workunit.client.1.smithi087.stdout:1/215: rename d0/d1d/l33 to d0/d1d/d24/l46 0 2024-02-28T16:01:47.991 INFO:tasks.workunit.client.1.smithi087.stdout:1/216: dread - d0/d1b/f22 zero size 2024-02-28T16:01:47.999 INFO:tasks.workunit.client.1.smithi087.stdout:6/175: rename d4/d30/d13/d1c/f1e to d4/d30/d13/f3b 0 2024-02-28T16:01:48.001 INFO:tasks.workunit.client.1.smithi087.stdout:9/171: dwrite d7/dd/f1a [0,4194304] 0 2024-02-28T16:01:48.002 INFO:tasks.workunit.client.1.smithi087.stdout:6/176: mkdir d4/d3c 0 2024-02-28T16:01:48.006 INFO:tasks.workunit.client.1.smithi087.stdout:6/177: write d4/d30/d13/d38/f3a [138933,6781] 0 2024-02-28T16:01:48.006 INFO:tasks.workunit.client.1.smithi087.stdout:9/172: unlink d7/dd/d15/f2a 0 2024-02-28T16:01:48.008 INFO:tasks.workunit.client.1.smithi087.stdout:9/173: dread - d7/dd/d15/f22 zero size 2024-02-28T16:01:48.015 INFO:tasks.workunit.client.1.smithi087.stdout:9/174: truncate d7/dc/d10/f21 746731 0 2024-02-28T16:01:48.016 INFO:tasks.workunit.client.1.smithi087.stdout:9/175: stat d7/dc/d10 0 2024-02-28T16:01:48.019 INFO:tasks.workunit.client.1.smithi087.stdout:9/176: write d7/dd/f20 [1356279,73633] 0 2024-02-28T16:01:48.023 INFO:tasks.workunit.client.1.smithi087.stdout:9/177: mknod d7/c2c 0 2024-02-28T16:01:48.024 INFO:tasks.workunit.client.1.smithi087.stdout:6/178: dwrite d4/f26 [0,4194304] 0 2024-02-28T16:01:48.026 INFO:tasks.workunit.client.1.smithi087.stdout:6/179: read d4/d30/d13/f3b [1484827,40687] 0 2024-02-28T16:01:48.030 INFO:tasks.workunit.client.1.smithi087.stdout:6/180: rmdir d4/d3c 0 2024-02-28T16:01:48.037 INFO:tasks.workunit.client.1.smithi087.stdout:9/178: creat d7/dd/f2d x:0 0 0 2024-02-28T16:01:48.043 INFO:tasks.workunit.client.1.smithi087.stdout:6/181: dread d4/d30/d13/f2a [0,4194304] 0 2024-02-28T16:01:48.048 INFO:tasks.workunit.client.1.smithi087.stdout:6/182: dread d4/dc/d10/f19 [0,4194304] 0 2024-02-28T16:01:48.053 INFO:tasks.workunit.client.1.smithi087.stdout:6/183: rename d4/d30/ff to d4/dc/d10/f3d 0 2024-02-28T16:01:48.055 INFO:tasks.workunit.client.1.smithi087.stdout:9/179: dwrite d7/dd/d15/f22 [0,4194304] 0 2024-02-28T16:01:48.057 INFO:tasks.workunit.client.1.smithi087.stdout:6/184: mknod d4/c3e 0 2024-02-28T16:01:48.060 INFO:tasks.workunit.client.1.smithi087.stdout:6/185: creat d4/d30/d13/f3f x:0 0 0 2024-02-28T16:01:48.067 INFO:tasks.workunit.client.1.smithi087.stdout:6/186: write d4/d12/f21 [241652,104168] 0 2024-02-28T16:01:48.069 INFO:tasks.workunit.client.1.smithi087.stdout:6/187: stat d4/dc/c1b 0 2024-02-28T16:01:48.076 INFO:tasks.workunit.client.1.smithi087.stdout:4/211: sync 2024-02-28T16:01:48.081 INFO:tasks.workunit.client.1.smithi087.stdout:4/212: rename c0 to d2/d49/c53 0 2024-02-28T16:01:48.083 INFO:tasks.workunit.client.1.smithi087.stdout:6/188: dread d4/dc/d10/f3d [0,4194304] 0 2024-02-28T16:01:48.086 INFO:tasks.workunit.client.1.smithi087.stdout:6/189: creat d4/dc/d10/f40 x:0 0 0 2024-02-28T16:01:48.088 INFO:tasks.workunit.client.1.smithi087.stdout:6/190: symlink d4/d12/l41 0 2024-02-28T16:01:48.090 INFO:tasks.workunit.client.1.smithi087.stdout:6/191: write d4/f20 [3847445,111099] 0 2024-02-28T16:01:48.091 INFO:tasks.workunit.client.1.smithi087.stdout:4/213: dread d2/d9/da/f36 [0,4194304] 0 2024-02-28T16:01:48.094 INFO:tasks.workunit.client.1.smithi087.stdout:4/214: chown d2/c3 564 1 2024-02-28T16:01:48.102 INFO:tasks.workunit.client.1.smithi087.stdout:6/192: dwrite d4/d30/d13/d1c/f28 [0,4194304] 0 2024-02-28T16:01:48.104 INFO:tasks.workunit.client.1.smithi087.stdout:4/215: dread d2/d9/da/d1a/d26/f29 [0,4194304] 0 2024-02-28T16:01:48.105 INFO:tasks.workunit.client.1.smithi087.stdout:6/193: unlink d4/f9 0 2024-02-28T16:01:48.107 INFO:tasks.workunit.client.1.smithi087.stdout:4/216: mkdir d2/df/d54 0 2024-02-28T16:01:48.107 INFO:tasks.workunit.client.1.smithi087.stdout:6/194: chown d4/d30/d13/c1a 518948 1 2024-02-28T16:01:48.108 INFO:tasks.workunit.client.1.smithi087.stdout:4/217: write d2/df/d2e/f47 [381685,5218] 0 2024-02-28T16:01:48.109 INFO:tasks.workunit.client.1.smithi087.stdout:6/195: write d4/d30/d13/d38/f3a [307970,71518] 0 2024-02-28T16:01:48.113 INFO:tasks.workunit.client.1.smithi087.stdout:4/218: mknod d2/df/d54/c55 0 2024-02-28T16:01:48.114 INFO:tasks.workunit.client.1.smithi087.stdout:6/196: mkdir d4/d30/d42 0 2024-02-28T16:01:48.117 INFO:tasks.workunit.client.1.smithi087.stdout:6/197: mknod d4/dc/d10/c43 0 2024-02-28T16:01:48.121 INFO:tasks.workunit.client.1.smithi087.stdout:4/219: link d2/d9/d10/d22/c52 d2/d9/da/c56 0 2024-02-28T16:01:48.125 INFO:tasks.workunit.client.1.smithi087.stdout:4/220: dread d2/df/d2e/f47 [0,4194304] 0 2024-02-28T16:01:48.126 INFO:tasks.workunit.client.1.smithi087.stdout:4/221: readlink d2/l7 0 2024-02-28T16:01:48.127 INFO:tasks.workunit.client.1.smithi087.stdout:4/222: dread - d2/df/d2e/f4f zero size 2024-02-28T16:01:48.128 INFO:tasks.workunit.client.1.smithi087.stdout:4/223: fdatasync d2/f2f 0 2024-02-28T16:01:48.133 INFO:tasks.workunit.client.1.smithi087.stdout:6/198: dwrite d4/d12/f16 [0,4194304] 0 2024-02-28T16:01:48.146 INFO:tasks.workunit.client.1.smithi087.stdout:4/224: dwrite d2/d9/d10/d22/f27 [0,4194304] 0 2024-02-28T16:01:48.147 INFO:tasks.workunit.client.1.smithi087.stdout:6/199: dwrite d4/d30/d13/d1c/f28 [0,4194304] 0 2024-02-28T16:01:48.149 INFO:tasks.workunit.client.1.smithi087.stdout:6/200: chown d4/d30/d13/c18 410 1 2024-02-28T16:01:48.150 INFO:tasks.workunit.client.1.smithi087.stdout:4/225: symlink d2/d9/l57 0 2024-02-28T16:01:48.153 INFO:tasks.workunit.client.1.smithi087.stdout:6/201: mkdir d4/d30/d13/d44 0 2024-02-28T16:01:48.159 INFO:tasks.workunit.client.1.smithi087.stdout:6/202: rename d4/d30/d13/d1c to d4/d12/d45 0 2024-02-28T16:01:48.162 INFO:tasks.workunit.client.1.smithi087.stdout:6/203: write d4/d12/d45/f28 [1055000,15825] 0 2024-02-28T16:01:48.169 INFO:tasks.workunit.client.1.smithi087.stdout:4/226: dwrite d2/df/f13 [4194304,4194304] 0 2024-02-28T16:01:48.174 INFO:tasks.workunit.client.1.smithi087.stdout:4/227: chown d2/d9/d10/d11 0 1 2024-02-28T16:01:48.174 INFO:tasks.workunit.client.1.smithi087.stdout:6/204: link d4/d30/l2c d4/d30/d13/d38/l46 0 2024-02-28T16:01:48.177 INFO:tasks.workunit.client.1.smithi087.stdout:6/205: write d4/dc/d10/f2b [1153096,65074] 0 2024-02-28T16:01:48.182 INFO:tasks.workunit.client.1.smithi087.stdout:6/206: creat d4/d30/d13/d38/f47 x:0 0 0 2024-02-28T16:01:48.186 INFO:tasks.workunit.client.1.smithi087.stdout:6/207: readlink d4/d12/d45/l34 0 2024-02-28T16:01:48.189 INFO:tasks.workunit.client.1.smithi087.stdout:6/208: symlink d4/d12/d45/l48 0 2024-02-28T16:01:48.196 INFO:tasks.workunit.client.1.smithi087.stdout:4/228: dwrite d2/f4 [0,4194304] 0 2024-02-28T16:01:48.204 INFO:tasks.workunit.client.1.smithi087.stdout:4/229: rename d2/d9/de/f33 to d2/df/d2e/d4a/f58 0 2024-02-28T16:01:48.210 INFO:tasks.workunit.client.1.smithi087.stdout:6/209: dwrite d4/fa [0,4194304] 0 2024-02-28T16:01:48.219 INFO:tasks.workunit.client.1.smithi087.stdout:4/230: dread d2/d9/da/f2d [0,4194304] 0 2024-02-28T16:01:48.222 INFO:tasks.workunit.client.1.smithi087.stdout:4/231: mknod d2/df/d54/c59 0 2024-02-28T16:01:48.233 INFO:tasks.workunit.client.1.smithi087.stdout:6/210: dwrite d4/d30/d13/d38/f47 [0,4194304] 0 2024-02-28T16:01:48.236 INFO:tasks.workunit.client.1.smithi087.stdout:6/211: write d4/dc/f1f [255220,49630] 0 2024-02-28T16:01:48.241 INFO:tasks.workunit.client.1.smithi087.stdout:4/232: dwrite d2/df/d2e/f47 [0,4194304] 0 2024-02-28T16:01:48.242 INFO:tasks.workunit.client.1.smithi087.stdout:6/212: mknod d4/d30/d42/c49 0 2024-02-28T16:01:48.243 INFO:tasks.workunit.client.1.smithi087.stdout:6/213: dread - d4/dc/d10/f36 zero size 2024-02-28T16:01:48.247 INFO:tasks.workunit.client.1.smithi087.stdout:4/233: symlink d2/df/d54/l5a 0 2024-02-28T16:01:48.250 INFO:tasks.workunit.client.1.smithi087.stdout:4/234: mkdir d2/d9/d10/d22/d5b 0 2024-02-28T16:01:48.262 INFO:tasks.workunit.client.1.smithi087.stdout:6/214: dwrite d4/f23 [0,4194304] 0 2024-02-28T16:01:48.267 INFO:tasks.workunit.client.1.smithi087.stdout:6/215: creat d4/d30/d13/d44/f4a x:0 0 0 2024-02-28T16:01:48.268 INFO:tasks.workunit.client.1.smithi087.stdout:4/235: dwrite d2/d9/f4d [0,4194304] 0 2024-02-28T16:01:48.269 INFO:tasks.workunit.client.1.smithi087.stdout:6/216: mknod d4/c4b 0 2024-02-28T16:01:48.270 INFO:tasks.workunit.client.1.smithi087.stdout:4/236: chown d2/df/f39 35864 1 2024-02-28T16:01:48.273 INFO:tasks.workunit.client.1.smithi087.stdout:4/237: mkdir d2/d9/d10/d22/d5b/d5c 0 2024-02-28T16:01:48.276 INFO:tasks.workunit.client.1.smithi087.stdout:4/238: unlink d2/d9/f21 0 2024-02-28T16:01:48.278 INFO:tasks.workunit.client.1.smithi087.stdout:3/153: sync 2024-02-28T16:01:48.279 INFO:tasks.workunit.client.1.smithi087.stdout:4/239: mknod d2/df/d2e/d4a/c5d 0 2024-02-28T16:01:48.280 INFO:tasks.workunit.client.1.smithi087.stdout:3/154: mknod d11/d33/c3b 0 2024-02-28T16:01:48.281 INFO:tasks.workunit.client.1.smithi087.stdout:4/240: symlink d2/d9/d10/d22/l5e 0 2024-02-28T16:01:48.281 INFO:tasks.workunit.client.1.smithi087.stdout:3/155: truncate d11/f17 4639853 0 2024-02-28T16:01:48.288 INFO:tasks.workunit.client.1.smithi087.stdout:3/156: read d11/f29 [3938240,129474] 0 2024-02-28T16:01:48.292 INFO:tasks.workunit.client.1.smithi087.stdout:3/157: mkdir d11/d3a/d3c 0 2024-02-28T16:01:48.294 INFO:tasks.workunit.client.1.smithi087.stdout:3/158: creat d11/d33/f3d x:0 0 0 2024-02-28T16:01:48.298 INFO:tasks.workunit.client.1.smithi087.stdout:3/159: mknod d11/c3e 0 2024-02-28T16:01:48.306 INFO:tasks.workunit.client.1.smithi087.stdout:4/241: truncate d2/df/d2e/f43 738737 0 2024-02-28T16:01:48.307 INFO:tasks.workunit.client.1.smithi087.stdout:4/242: chown d2/f3b 821 1 2024-02-28T16:01:48.319 INFO:tasks.workunit.client.1.smithi087.stdout:4/243: dwrite d2/d9/da/d1a/d26/f29 [0,4194304] 0 2024-02-28T16:01:48.326 INFO:tasks.workunit.client.1.smithi087.stdout:4/244: dread d2/d9/da/f3f [0,4194304] 0 2024-02-28T16:01:48.331 INFO:tasks.workunit.client.1.smithi087.stdout:4/245: rename d2/d9/da/c14 to d2/c5f 0 2024-02-28T16:01:48.333 INFO:tasks.workunit.client.1.smithi087.stdout:4/246: unlink d2/df/d2e/f4f 0 2024-02-28T16:01:48.337 INFO:tasks.workunit.client.1.smithi087.stdout:4/247: link d2/d9/l50 d2/df/l60 0 2024-02-28T16:01:48.339 INFO:tasks.workunit.client.1.smithi087.stdout:4/248: symlink d2/d9/da/d1a/l61 0 2024-02-28T16:01:48.340 INFO:tasks.workunit.client.1.smithi087.stdout:4/249: readlink d2/d9/de/l1b 0 2024-02-28T16:01:48.352 INFO:tasks.workunit.client.1.smithi087.stdout:4/250: dwrite d2/d9/da/f2d [0,4194304] 0 2024-02-28T16:01:48.354 INFO:tasks.workunit.client.1.smithi087.stdout:4/251: readlink d2/df/d2e/l38 0 2024-02-28T16:01:48.357 INFO:tasks.workunit.client.1.smithi087.stdout:4/252: read d2/d9/de/f19 [2400134,21467] 0 2024-02-28T16:01:48.379 INFO:tasks.workunit.client.1.smithi087.stdout:4/253: dwrite d2/df/d2e/f43 [0,4194304] 0 2024-02-28T16:01:48.404 INFO:tasks.workunit.client.1.smithi087.stdout:4/254: dread d2/d9/da/d1a/d26/f3d [0,4194304] 0 2024-02-28T16:01:48.420 INFO:tasks.workunit.client.1.smithi087.stdout:4/255: dwrite d2/f3b [0,4194304] 0 2024-02-28T16:01:48.422 INFO:tasks.workunit.client.1.smithi087.stdout:4/256: truncate d2/f32 509446 0 2024-02-28T16:01:48.427 INFO:tasks.workunit.client.1.smithi087.stdout:4/257: getdents d2/d9/d10/d11 0 2024-02-28T16:01:48.429 INFO:tasks.workunit.client.1.smithi087.stdout:4/258: chown d2/l41 28 1 2024-02-28T16:01:48.441 INFO:tasks.workunit.client.1.smithi087.stdout:4/259: dread d2/d49/f51 [0,4194304] 0 2024-02-28T16:01:48.443 INFO:tasks.workunit.client.1.smithi087.stdout:4/260: read d2/df/f13 [7442241,33385] 0 2024-02-28T16:01:48.451 INFO:tasks.workunit.client.1.smithi087.stdout:4/261: rename d2/df/d54 to d2/df/d62 0 2024-02-28T16:01:48.453 INFO:tasks.workunit.client.1.smithi087.stdout:4/262: chown d2/df/d2e/f47 1023181 1 2024-02-28T16:01:48.456 INFO:tasks.workunit.client.1.smithi087.stdout:4/263: chown d2/d9/d10/d22/f27 0 1 2024-02-28T16:01:48.458 INFO:tasks.workunit.client.1.smithi087.stdout:4/264: write d2/d9/f2c [528562,119018] 0 2024-02-28T16:01:48.460 INFO:tasks.workunit.client.1.smithi087.stdout:5/161: sync 2024-02-28T16:01:48.462 INFO:tasks.workunit.client.1.smithi087.stdout:4/265: fsync d2/d9/da/f36 0 2024-02-28T16:01:48.464 INFO:tasks.workunit.client.1.smithi087.stdout:4/266: fsync d2/f32 0 2024-02-28T16:01:48.469 INFO:tasks.workunit.client.1.smithi087.stdout:4/267: rename d2/df/l60 to d2/d49/l63 0 2024-02-28T16:01:48.471 INFO:tasks.workunit.client.1.smithi087.stdout:4/268: fsync d2/df/f39 0 2024-02-28T16:01:48.475 INFO:tasks.workunit.client.1.smithi087.stdout:5/162: dwrite d3/f13 [0,4194304] 0 2024-02-28T16:01:48.478 INFO:tasks.workunit.client.1.smithi087.stdout:5/163: creat d3/d6/d30/f32 x:0 0 0 2024-02-28T16:01:48.489 INFO:tasks.workunit.client.1.smithi087.stdout:5/164: getdents d3/d6/d30 0 2024-02-28T16:01:48.491 INFO:tasks.workunit.client.1.smithi087.stdout:5/165: stat d3/d9/f2a 0 2024-02-28T16:01:48.512 INFO:tasks.workunit.client.1.smithi087.stdout:5/166: dwrite d3/d9/f2a [0,4194304] 0 2024-02-28T16:01:48.573 INFO:tasks.workunit.client.1.smithi087.stdout:7/144: sync 2024-02-28T16:01:48.573 INFO:tasks.workunit.client.1.smithi087.stdout:0/241: sync 2024-02-28T16:01:48.580 INFO:tasks.workunit.client.1.smithi087.stdout:7/145: chown f12 51346 1 2024-02-28T16:01:48.589 INFO:tasks.workunit.client.1.smithi087.stdout:0/242: rename d4/d6/d55 to d4/dd/d37/d39/d3a/d57 0 2024-02-28T16:01:48.593 INFO:tasks.workunit.client.1.smithi087.stdout:7/146: mkdir d14/d15/d2b 0 2024-02-28T16:01:48.594 INFO:tasks.workunit.client.1.smithi087.stdout:7/147: fdatasync f13 0 2024-02-28T16:01:48.596 INFO:tasks.workunit.client.1.smithi087.stdout:0/243: mkdir d4/dd/d20/d1f/d2e/d31/d58 0 2024-02-28T16:01:48.604 INFO:tasks.workunit.client.1.smithi087.stdout:0/244: creat d4/dd/d37/f59 x:0 0 0 2024-02-28T16:01:48.640 INFO:tasks.workunit.client.1.smithi087.stdout:7/148: write f12 [948700,30811] 0 2024-02-28T16:01:48.640 INFO:tasks.workunit.client.1.smithi087.stdout:7/149: fdatasync d14/d21/f26 0 2024-02-28T16:01:48.640 INFO:tasks.workunit.client.1.smithi087.stdout:7/150: truncate d14/f1e 4710905 0 2024-02-28T16:01:48.640 INFO:tasks.workunit.client.1.smithi087.stdout:7/151: creat d14/d15/d2b/f2c x:0 0 0 2024-02-28T16:01:48.640 INFO:tasks.workunit.client.1.smithi087.stdout:7/152: mknod d14/d15/c2d 0 2024-02-28T16:01:48.640 INFO:tasks.workunit.client.1.smithi087.stdout:7/153: dread - d14/d27/f28 zero size 2024-02-28T16:01:48.645 INFO:tasks.workunit.client.1.smithi087.stdout:0/245: dread d4/d6/f22 [0,4194304] 0 2024-02-28T16:01:48.649 INFO:tasks.workunit.client.1.smithi087.stdout:7/154: rename d14/d15 to d14/d2e 0 2024-02-28T16:01:48.651 INFO:tasks.workunit.client.1.smithi087.stdout:0/246: creat d4/dd/d37/d39/f5a x:0 0 0 2024-02-28T16:01:48.676 INFO:tasks.workunit.client.1.smithi087.stdout:8/173: sync 2024-02-28T16:01:48.676 INFO:tasks.workunit.client.1.smithi087.stdout:2/144: sync 2024-02-28T16:01:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:48 smithi057 ceph-mon[28763]: pgmap v26: 65 pgs: 65 active+clean; 553 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 2.5 MiB/s rd, 59 MiB/s wr, 328 op/s 2024-02-28T16:01:48.678 INFO:tasks.workunit.client.1.smithi087.stdout:2/145: readlink d2/d7/d17/l26 0 2024-02-28T16:01:48.694 INFO:tasks.workunit.client.1.smithi087.stdout:0/247: dwrite d4/dd/f13 [0,4194304] 0 2024-02-28T16:01:48.695 INFO:tasks.workunit.client.1.smithi087.stdout:0/248: readlink d4/dd/l30 0 2024-02-28T16:01:48.697 INFO:tasks.workunit.client.1.smithi087.stdout:0/249: chown d4/f53 1 1 2024-02-28T16:01:48.698 INFO:tasks.workunit.client.1.smithi087.stdout:8/174: rename d2/ce to d2/d9/d10/d24/c32 0 2024-02-28T16:01:48.704 INFO:tasks.workunit.client.1.smithi087.stdout:0/250: chown d4/d6/d3e 0 1 2024-02-28T16:01:48.704 INFO:tasks.workunit.client.1.smithi087.stdout:1/217: sync 2024-02-28T16:01:48.704 INFO:tasks.workunit.client.1.smithi087.stdout:6/217: sync 2024-02-28T16:01:48.704 INFO:tasks.workunit.client.1.smithi087.stdout:9/180: sync 2024-02-28T16:01:48.704 INFO:tasks.workunit.client.1.smithi087.stdout:4/269: sync 2024-02-28T16:01:48.705 INFO:tasks.workunit.client.1.smithi087.stdout:3/160: sync 2024-02-28T16:01:48.705 INFO:tasks.workunit.client.1.smithi087.stdout:5/167: sync 2024-02-28T16:01:48.709 INFO:tasks.workunit.client.1.smithi087.stdout:2/146: rename d2/d7/d17/l26 to d2/d7/l31 0 2024-02-28T16:01:48.710 INFO:tasks.workunit.client.1.smithi087.stdout:7/155: dread f13 [0,4194304] 0 2024-02-28T16:01:48.710 INFO:tasks.workunit.client.1.smithi087.stdout:1/218: chown d0/d1d/l2b 2945 1 2024-02-28T16:01:48.712 INFO:tasks.workunit.client.1.smithi087.stdout:0/251: unlink d4/cb 0 2024-02-28T16:01:48.713 INFO:tasks.workunit.client.1.smithi087.stdout:4/270: write d2/d9/f2c [4346636,58412] 0 2024-02-28T16:01:48.713 INFO:tasks.workunit.client.1.smithi087.stdout:6/218: truncate d4/dc/d10/f40 511327 0 2024-02-28T16:01:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:48 smithi087 ceph-mon[37122]: pgmap v26: 65 pgs: 65 active+clean; 553 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 2.5 MiB/s rd, 59 MiB/s wr, 328 op/s 2024-02-28T16:01:48.715 INFO:tasks.workunit.client.1.smithi087.stdout:5/168: unlink d3/d6/f28 0 2024-02-28T16:01:48.718 INFO:tasks.workunit.client.1.smithi087.stdout:9/181: write d7/dc/d10/f26 [708621,86506] 0 2024-02-28T16:01:48.719 INFO:tasks.workunit.client.1.smithi087.stdout:3/161: creat d11/d3a/d3c/f3f x:0 0 0 2024-02-28T16:01:48.720 INFO:tasks.workunit.client.1.smithi087.stdout:7/156: symlink d14/l2f 0 2024-02-28T16:01:48.720 INFO:tasks.workunit.client.1.smithi087.stdout:1/219: creat d0/d1b/f47 x:0 0 0 2024-02-28T16:01:48.722 INFO:tasks.workunit.client.1.smithi087.stdout:6/219: unlink d4/d30/l37 0 2024-02-28T16:01:48.730 INFO:tasks.workunit.client.1.smithi087.stdout:8/175: dwrite d2/d18/f22 [0,4194304] 0 2024-02-28T16:01:48.730 INFO:tasks.workunit.client.1.smithi087.stdout:2/147: link d2/d7/d17/f2c d2/d7/df/d28/f32 0 2024-02-28T16:01:48.735 INFO:tasks.workunit.client.1.smithi087.stdout:7/157: chown cb 1537376 1 2024-02-28T16:01:48.736 INFO:tasks.workunit.client.1.smithi087.stdout:9/182: fdatasync d7/dc/d10/f21 0 2024-02-28T16:01:48.736 INFO:tasks.workunit.client.1.smithi087.stdout:2/148: chown d2/d7/df/c1f 3090 1 2024-02-28T16:01:48.737 INFO:tasks.workunit.client.1.smithi087.stdout:5/169: getdents d3/d9 0 2024-02-28T16:01:48.737 INFO:tasks.workunit.client.1.smithi087.stdout:7/158: write d14/f1d [803752,53046] 0 2024-02-28T16:01:48.740 INFO:tasks.workunit.client.1.smithi087.stdout:3/162: creat d11/d3a/d3c/f40 x:0 0 0 2024-02-28T16:01:48.744 INFO:tasks.workunit.client.1.smithi087.stdout:4/271: rename d2/d9/de/c1f to d2/df/d2e/c64 0 2024-02-28T16:01:48.745 INFO:tasks.workunit.client.1.smithi087.stdout:8/176: mkdir d2/d33 0 2024-02-28T16:01:48.749 INFO:tasks.workunit.client.1.smithi087.stdout:0/252: write d4/dd/d20/f1d [610111,3623] 0 2024-02-28T16:01:48.749 INFO:tasks.workunit.client.1.smithi087.stdout:8/177: stat d2/d9/d1a 0 2024-02-28T16:01:48.749 INFO:tasks.workunit.client.1.smithi087.stdout:9/183: mkdir d7/dc/d10/d2e 0 2024-02-28T16:01:48.751 INFO:tasks.workunit.client.1.smithi087.stdout:8/178: chown d2/d9/c29 6 1 2024-02-28T16:01:48.751 INFO:tasks.workunit.client.1.smithi087.stdout:5/170: creat d3/d9/f33 x:0 0 0 2024-02-28T16:01:48.753 INFO:tasks.workunit.client.1.smithi087.stdout:6/220: link d4/dc/d10/f40 d4/d12/f4c 0 2024-02-28T16:01:48.754 INFO:tasks.workunit.client.1.smithi087.stdout:3/163: symlink d11/d3a/d3c/l41 0 2024-02-28T16:01:48.756 INFO:tasks.workunit.client.1.smithi087.stdout:2/149: rename d2/d7/df/f1c to d2/d7/d17/f33 0 2024-02-28T16:01:48.757 INFO:tasks.workunit.client.1.smithi087.stdout:7/159: mkdir d14/d30 0 2024-02-28T16:01:48.760 INFO:tasks.workunit.client.1.smithi087.stdout:9/184: stat d7/l27 0 2024-02-28T16:01:48.761 INFO:tasks.workunit.client.1.smithi087.stdout:8/179: creat d2/d9/d10/d24/f34 x:0 0 0 2024-02-28T16:01:48.766 INFO:tasks.workunit.client.1.smithi087.stdout:3/164: creat d11/d3a/f42 x:0 0 0 2024-02-28T16:01:48.768 INFO:tasks.workunit.client.1.smithi087.stdout:2/150: rename d2/d2a to d2/d7/d17/d34 0 2024-02-28T16:01:48.769 INFO:tasks.workunit.client.1.smithi087.stdout:1/220: dread d0/d14/f25 [0,4194304] 0 2024-02-28T16:01:48.770 INFO:tasks.workunit.client.1.smithi087.stdout:2/151: chown d2/f21 73331 1 2024-02-28T16:01:48.774 INFO:tasks.workunit.client.1.smithi087.stdout:3/165: creat d11/d3a/f43 x:0 0 0 2024-02-28T16:01:48.776 INFO:tasks.workunit.client.1.smithi087.stdout:5/171: creat d3/f34 x:0 0 0 2024-02-28T16:01:48.778 INFO:tasks.workunit.client.1.smithi087.stdout:8/180: creat d2/d33/f35 x:0 0 0 2024-02-28T16:01:48.780 INFO:tasks.workunit.client.1.smithi087.stdout:5/172: chown d3/f13 1741745 1 2024-02-28T16:01:48.780 INFO:tasks.workunit.client.1.smithi087.stdout:1/221: mkdir d0/d14/d48 0 2024-02-28T16:01:48.781 INFO:tasks.workunit.client.1.smithi087.stdout:4/272: truncate d2/d9/f48 3474995 0 2024-02-28T16:01:48.782 INFO:tasks.workunit.client.1.smithi087.stdout:5/173: fsync d3/d9/f2d 0 2024-02-28T16:01:48.785 INFO:tasks.workunit.client.1.smithi087.stdout:2/152: chown d2/d7/f12 204 1 2024-02-28T16:01:48.787 INFO:tasks.workunit.client.1.smithi087.stdout:3/166: stat d11/c38 0 2024-02-28T16:01:48.787 INFO:tasks.workunit.client.1.smithi087.stdout:8/181: mkdir d2/d18/d36 0 2024-02-28T16:01:48.789 INFO:tasks.workunit.client.1.smithi087.stdout:7/160: write d14/f18 [212060,130645] 0 2024-02-28T16:01:48.790 INFO:tasks.workunit.client.1.smithi087.stdout:4/273: chown d2/d9/da/d1a/l46 563 1 2024-02-28T16:01:48.790 INFO:tasks.workunit.client.1.smithi087.stdout:6/221: link d4/l7 d4/d30/d13/l4d 0 2024-02-28T16:01:48.793 INFO:tasks.workunit.client.1.smithi087.stdout:9/185: dwrite d7/dc/d10/f1c [4194304,4194304] 0 2024-02-28T16:01:48.793 INFO:tasks.workunit.client.1.smithi087.stdout:1/222: dread d0/ff [0,4194304] 0 2024-02-28T16:01:48.794 INFO:tasks.workunit.client.1.smithi087.stdout:8/182: creat d2/f37 x:0 0 0 2024-02-28T16:01:48.796 INFO:tasks.workunit.client.1.smithi087.stdout:3/167: chown d11/f24 16 1 2024-02-28T16:01:48.796 INFO:tasks.workunit.client.1.smithi087.stdout:0/253: dwrite d4/d6/f2a [0,4194304] 0 2024-02-28T16:01:48.801 INFO:tasks.workunit.client.1.smithi087.stdout:7/161: mknod d14/d2e/d2b/c31 0 2024-02-28T16:01:48.801 INFO:tasks.workunit.client.1.smithi087.stdout:9/186: creat d7/dc/d10/f2f x:0 0 0 2024-02-28T16:01:48.802 INFO:tasks.workunit.client.1.smithi087.stdout:4/274: chown d2/c5f 124 1 2024-02-28T16:01:48.810 INFO:tasks.workunit.client.1.smithi087.stdout:2/153: rename d2/d7/df/f22 to d2/d7/df/f35 0 2024-02-28T16:01:48.811 INFO:tasks.workunit.client.1.smithi087.stdout:6/222: creat d4/d30/d13/d38/f4e x:0 0 0 2024-02-28T16:01:48.817 INFO:tasks.workunit.client.1.smithi087.stdout:9/187: getdents d7/dc/d10/d2e 0 2024-02-28T16:01:48.819 INFO:tasks.workunit.client.1.smithi087.stdout:4/275: mkdir d2/df/d65 0 2024-02-28T16:01:48.822 INFO:tasks.workunit.client.1.smithi087.stdout:9/188: read d7/dd/d15/f22 [1799904,45302] 0 2024-02-28T16:01:48.823 INFO:tasks.workunit.client.1.smithi087.stdout:1/223: link d0/fa d0/d1d/f49 0 2024-02-28T16:01:48.825 INFO:tasks.workunit.client.1.smithi087.stdout:8/183: getdents d2/d18 0 2024-02-28T16:01:48.829 INFO:tasks.workunit.client.1.smithi087.stdout:1/224: read - d0/d1a/f2e zero size 2024-02-28T16:01:48.832 INFO:tasks.workunit.client.1.smithi087.stdout:8/184: chown d2/d9/f17 128246987 1 2024-02-28T16:01:48.832 INFO:tasks.workunit.client.1.smithi087.stdout:7/162: dwrite f12 [0,4194304] 0 2024-02-28T16:01:48.834 INFO:tasks.workunit.client.1.smithi087.stdout:2/154: getdents d2/d7/df/d28 0 2024-02-28T16:01:48.835 INFO:tasks.workunit.client.1.smithi087.stdout:8/185: dread - d2/f30 zero size 2024-02-28T16:01:48.836 INFO:tasks.workunit.client.1.smithi087.stdout:3/168: dwrite d11/f19 [0,4194304] 0 2024-02-28T16:01:48.839 INFO:tasks.workunit.client.1.smithi087.stdout:7/163: write d14/d21/f26 [248918,65091] 0 2024-02-28T16:01:48.841 INFO:tasks.workunit.client.1.smithi087.stdout:7/164: read d14/f18 [301020,79140] 0 2024-02-28T16:01:48.843 INFO:tasks.workunit.client.1.smithi087.stdout:6/223: truncate d4/fa 1486681 0 2024-02-28T16:01:48.844 INFO:tasks.workunit.client.1.smithi087.stdout:8/186: write d2/f8 [9303511,52452] 0 2024-02-28T16:01:48.846 INFO:tasks.workunit.client.1.smithi087.stdout:3/169: mkdir d11/d44 0 2024-02-28T16:01:48.847 INFO:tasks.workunit.client.1.smithi087.stdout:6/224: write d4/d30/d13/d38/f3a [132311,83020] 0 2024-02-28T16:01:48.847 INFO:tasks.workunit.client.1.smithi087.stdout:8/187: write d2/d9/d1a/f2c [412278,24280] 0 2024-02-28T16:01:48.852 INFO:tasks.workunit.client.1.smithi087.stdout:3/170: dread - d11/f2f zero size 2024-02-28T16:01:48.854 INFO:tasks.workunit.client.1.smithi087.stdout:9/189: truncate f4 1114931 0 2024-02-28T16:01:48.856 INFO:tasks.workunit.client.1.smithi087.stdout:2/155: write d2/d7/f12 [2744505,18736] 0 2024-02-28T16:01:48.857 INFO:tasks.workunit.client.1.smithi087.stdout:6/225: creat d4/d12/f4f x:0 0 0 2024-02-28T16:01:48.857 INFO:tasks.workunit.client.1.smithi087.stdout:3/171: mkdir d11/d45 0 2024-02-28T16:01:48.858 INFO:tasks.workunit.client.1.smithi087.stdout:7/165: read d14/f1e [4542727,113103] 0 2024-02-28T16:01:48.861 INFO:tasks.workunit.client.1.smithi087.stdout:2/156: dread - d2/fc zero size 2024-02-28T16:01:48.867 INFO:tasks.workunit.client.1.smithi087.stdout:9/190: write d7/dd/d15/f1f [724774,95370] 0 2024-02-28T16:01:48.868 INFO:tasks.workunit.client.1.smithi087.stdout:7/166: unlink d14/l25 0 2024-02-28T16:01:48.868 INFO:tasks.workunit.client.1.smithi087.stdout:1/225: dwrite d0/d1b/d1f/f41 [0,4194304] 0 2024-02-28T16:01:48.870 INFO:tasks.workunit.client.1.smithi087.stdout:7/167: readlink d14/l2f 0 2024-02-28T16:01:48.871 INFO:tasks.workunit.client.1.smithi087.stdout:2/157: mknod d2/d7/df/c36 0 2024-02-28T16:01:48.876 INFO:tasks.workunit.client.1.smithi087.stdout:2/158: fsync d2/d7/f2d 0 2024-02-28T16:01:48.882 INFO:tasks.workunit.client.1.smithi087.stdout:7/168: creat d14/d21/f32 x:0 0 0 2024-02-28T16:01:48.883 INFO:tasks.workunit.client.1.smithi087.stdout:6/226: rename d4/d30/d13/d38/l46 to d4/l50 0 2024-02-28T16:01:48.885 INFO:tasks.workunit.client.1.smithi087.stdout:3/172: dread d11/f19 [0,4194304] 0 2024-02-28T16:01:48.895 INFO:tasks.workunit.client.1.smithi087.stdout:6/227: write d4/d30/f24 [1450906,129491] 0 2024-02-28T16:01:48.896 INFO:tasks.workunit.client.1.smithi087.stdout:4/276: dread d2/f2f [0,4194304] 0 2024-02-28T16:01:48.899 INFO:tasks.workunit.client.1.smithi087.stdout:7/169: creat d14/d2e/d2b/f33 x:0 0 0 2024-02-28T16:01:48.899 INFO:tasks.workunit.client.1.smithi087.stdout:1/226: dwrite d0/d1a/f3a [0,4194304] 0 2024-02-28T16:01:48.905 INFO:tasks.workunit.client.1.smithi087.stdout:2/159: link d2/d7/df/l2f d2/d7/l37 0 2024-02-28T16:01:48.908 INFO:tasks.workunit.client.1.smithi087.stdout:2/160: fsync d2/d7/f15 0 2024-02-28T16:01:48.910 INFO:tasks.workunit.client.1.smithi087.stdout:9/191: dwrite d7/d1e/f24 [0,4194304] 0 2024-02-28T16:01:48.912 INFO:tasks.workunit.client.1.smithi087.stdout:1/227: creat d0/d1b/d1f/f4a x:0 0 0 2024-02-28T16:01:48.914 INFO:tasks.workunit.client.1.smithi087.stdout:8/188: dread d2/d9/f16 [4194304,4194304] 0 2024-02-28T16:01:48.916 INFO:tasks.workunit.client.1.smithi087.stdout:6/228: getdents d4/d30/d13/d38 0 2024-02-28T16:01:48.918 INFO:tasks.workunit.client.1.smithi087.stdout:3/173: dwrite d11/f2e [0,4194304] 0 2024-02-28T16:01:48.918 INFO:tasks.workunit.client.1.smithi087.stdout:2/161: rmdir d2/d7/df 39 2024-02-28T16:01:48.919 INFO:tasks.workunit.client.1.smithi087.stdout:3/174: readlink d11/l21 0 2024-02-28T16:01:48.926 INFO:tasks.workunit.client.1.smithi087.stdout:4/277: write d2/df/f13 [7741530,79166] 0 2024-02-28T16:01:48.926 INFO:tasks.workunit.client.1.smithi087.stdout:2/162: creat d2/f38 x:0 0 0 2024-02-28T16:01:48.931 INFO:tasks.workunit.client.1.smithi087.stdout:6/229: write d4/d12/d45/f39 [47080,88179] 0 2024-02-28T16:01:48.934 INFO:tasks.workunit.client.1.smithi087.stdout:1/228: getdents d0 0 2024-02-28T16:01:48.935 INFO:tasks.workunit.client.1.smithi087.stdout:3/175: rename d11/d3a/f43 to d11/f46 0 2024-02-28T16:01:48.935 INFO:tasks.workunit.client.1.smithi087.stdout:9/192: chown f4 27 1 2024-02-28T16:01:48.941 INFO:tasks.workunit.client.1.smithi087.stdout:2/163: readlink d2/d7/l37 0 2024-02-28T16:01:48.941 INFO:tasks.workunit.client.1.smithi087.stdout:5/174: sync 2024-02-28T16:01:48.941 INFO:tasks.workunit.client.1.smithi087.stdout:4/278: read d2/df/d2e/f47 [667237,108531] 0 2024-02-28T16:01:48.941 INFO:tasks.workunit.client.1.smithi087.stdout:7/170: dwrite d14/f1d [0,4194304] 0 2024-02-28T16:01:48.944 INFO:tasks.workunit.client.1.smithi087.stdout:6/230: symlink d4/dc/d10/l51 0 2024-02-28T16:01:48.951 INFO:tasks.workunit.client.1.smithi087.stdout:7/171: fdatasync fc 0 2024-02-28T16:01:48.953 INFO:tasks.workunit.client.1.smithi087.stdout:6/231: unlink d4/d30/d13/d44/f4a 0 2024-02-28T16:01:48.954 INFO:tasks.workunit.client.1.smithi087.stdout:3/176: creat d11/d45/f47 x:0 0 0 2024-02-28T16:01:48.954 INFO:tasks.workunit.client.1.smithi087.stdout:1/229: creat d0/d1b/d43/f4b x:0 0 0 2024-02-28T16:01:48.959 INFO:tasks.workunit.client.1.smithi087.stdout:2/164: unlink d2/d7/fd 0 2024-02-28T16:01:48.959 INFO:tasks.workunit.client.1.smithi087.stdout:9/193: write d7/dc/d10/f26 [130167,29059] 0 2024-02-28T16:01:48.961 INFO:tasks.workunit.client.1.smithi087.stdout:7/172: mkdir d14/d27/d34 0 2024-02-28T16:01:48.963 INFO:tasks.workunit.client.1.smithi087.stdout:4/279: truncate d2/d9/da/d1a/d26/f29 2162422 0 2024-02-28T16:01:48.965 INFO:tasks.workunit.client.1.smithi087.stdout:2/165: read d2/d7/f11 [253364,75281] 0 2024-02-28T16:01:48.965 INFO:tasks.workunit.client.1.smithi087.stdout:4/280: readlink d2/ld 0 2024-02-28T16:01:48.966 INFO:tasks.workunit.client.1.smithi087.stdout:3/177: mkdir d11/d3a/d48 0 2024-02-28T16:01:48.967 INFO:tasks.workunit.client.1.smithi087.stdout:2/166: readlink d2/d7/l20 0 2024-02-28T16:01:48.967 INFO:tasks.workunit.client.1.smithi087.stdout:6/232: symlink d4/dc/l52 0 2024-02-28T16:01:48.969 INFO:tasks.workunit.client.1.smithi087.stdout:3/178: chown d11/l22 13947184 1 2024-02-28T16:01:48.970 INFO:tasks.workunit.client.1.smithi087.stdout:5/175: link d3/c5 d3/d6/d30/c35 0 2024-02-28T16:01:48.972 INFO:tasks.workunit.client.1.smithi087.stdout:6/233: write d4/d30/d13/d38/f47 [3951873,22810] 0 2024-02-28T16:01:48.972 INFO:tasks.workunit.client.1.smithi087.stdout:8/189: dread d2/f27 [0,4194304] 0 2024-02-28T16:01:48.972 INFO:tasks.workunit.client.1.smithi087.stdout:9/194: rmdir d7/dc/d10 39 2024-02-28T16:01:48.976 INFO:tasks.workunit.client.1.smithi087.stdout:1/230: dwrite d0/d1a/f2e [0,4194304] 0 2024-02-28T16:01:48.979 INFO:tasks.workunit.client.1.smithi087.stdout:1/231: chown d0/ce 4644 1 2024-02-28T16:01:48.979 INFO:tasks.workunit.client.1.smithi087.stdout:7/173: symlink d14/d2e/d2b/l35 0 2024-02-28T16:01:48.980 INFO:tasks.workunit.client.1.smithi087.stdout:1/232: write d0/d1d/d24/f36 [76368,91457] 0 2024-02-28T16:01:48.980 INFO:tasks.workunit.client.1.smithi087.stdout:1/233: stat d0/c8 0 2024-02-28T16:01:48.981 INFO:tasks.workunit.client.1.smithi087.stdout:3/179: mknod d11/d33/c49 0 2024-02-28T16:01:48.986 INFO:tasks.workunit.client.1.smithi087.stdout:1/234: write d0/d1a/d28/f29 [425824,75570] 0 2024-02-28T16:01:48.987 INFO:tasks.workunit.client.1.smithi087.stdout:9/195: creat d7/d1e/f30 x:0 0 0 2024-02-28T16:01:48.988 INFO:tasks.workunit.client.1.smithi087.stdout:0/254: sync 2024-02-28T16:01:48.988 INFO:tasks.workunit.client.1.smithi087.stdout:6/234: creat d4/d12/d45/f53 x:0 0 0 2024-02-28T16:01:48.991 INFO:tasks.workunit.client.1.smithi087.stdout:8/190: symlink d2/l38 0 2024-02-28T16:01:48.992 INFO:tasks.workunit.client.1.smithi087.stdout:4/281: symlink d2/df/d65/l66 0 2024-02-28T16:01:48.992 INFO:tasks.workunit.client.1.smithi087.stdout:2/167: rename d2/d7/df/f35 to d2/d7/df/f39 0 2024-02-28T16:01:48.997 INFO:tasks.workunit.client.1.smithi087.stdout:0/255: mknod d4/dd/d20/d1f/c5b 0 2024-02-28T16:01:49.002 INFO:tasks.workunit.client.1.smithi087.stdout:7/174: symlink d14/l36 0 2024-02-28T16:01:49.006 INFO:tasks.workunit.client.1.smithi087.stdout:0/256: readlink d4/dd/d37/d39/d3a/l3f 0 2024-02-28T16:01:49.015 INFO:tasks.workunit.client.1.smithi087.stdout:5/176: dwrite d3/d6/f23 [0,4194304] 0 2024-02-28T16:01:49.017 INFO:tasks.workunit.client.1.smithi087.stdout:4/282: symlink d2/d9/da/d1a/d26/l67 0 2024-02-28T16:01:49.018 INFO:tasks.workunit.client.1.smithi087.stdout:3/180: dwrite d11/d3a/d3c/f3f [0,4194304] 0 2024-02-28T16:01:49.023 INFO:tasks.workunit.client.1.smithi087.stdout:9/196: symlink d7/dc/d10/d2e/l31 0 2024-02-28T16:01:49.024 INFO:tasks.workunit.client.1.smithi087.stdout:4/283: stat d2/d9/da/c3c 0 2024-02-28T16:01:49.024 INFO:tasks.workunit.client.1.smithi087.stdout:2/168: rmdir d2 39 2024-02-28T16:01:49.024 INFO:tasks.workunit.client.1.smithi087.stdout:5/177: write d3/d6/f2b [306831,106920] 0 2024-02-28T16:01:49.024 INFO:tasks.workunit.client.1.smithi087.stdout:7/175: write d14/d2e/f1b [836888,121037] 0 2024-02-28T16:01:49.027 INFO:tasks.workunit.client.1.smithi087.stdout:7/176: fdatasync f7 0 2024-02-28T16:01:49.027 INFO:tasks.workunit.client.1.smithi087.stdout:6/235: dwrite d4/d30/d13/f2d [4194304,4194304] 0 2024-02-28T16:01:49.028 INFO:tasks.workunit.client.1.smithi087.stdout:2/169: fsync d2/d7/f19 0 2024-02-28T16:01:49.039 INFO:tasks.workunit.client.1.smithi087.stdout:4/284: mkdir d2/d9/d10/d22/d5b/d5c/d68 0 2024-02-28T16:01:49.042 INFO:tasks.workunit.client.1.smithi087.stdout:6/236: mknod d4/d12/c54 0 2024-02-28T16:01:49.047 INFO:tasks.workunit.client.1.smithi087.stdout:4/285: chown d2/d9/da/d1a/d26/l28 209 1 2024-02-28T16:01:49.051 INFO:tasks.workunit.client.1.smithi087.stdout:9/197: rename d7/dd/d15/f17 to d7/f32 0 2024-02-28T16:01:49.052 INFO:tasks.workunit.client.1.smithi087.stdout:5/178: dwrite d3/d6/f1d [0,4194304] 0 2024-02-28T16:01:49.055 INFO:tasks.workunit.client.1.smithi087.stdout:3/181: dwrite d11/f28 [0,4194304] 0 2024-02-28T16:01:49.059 INFO:tasks.workunit.client.1.smithi087.stdout:8/191: dread d2/d9/d10/f12 [0,4194304] 0 2024-02-28T16:01:49.069 INFO:tasks.workunit.client.1.smithi087.stdout:6/237: rename d4/d12/f4c to d4/dc/f55 0 2024-02-28T16:01:49.072 INFO:tasks.workunit.client.1.smithi087.stdout:4/286: mkdir d2/d9/da/d1a/d26/d69 0 2024-02-28T16:01:49.072 INFO:tasks.workunit.client.1.smithi087.stdout:9/198: chown d7/dd/d15/f22 476608 1 2024-02-28T16:01:49.073 INFO:tasks.workunit.client.1.smithi087.stdout:5/179: mkdir d3/d6/d30/d36 0 2024-02-28T16:01:49.074 INFO:tasks.workunit.client.1.smithi087.stdout:6/238: chown d4/d30/d42/c49 1449964 1 2024-02-28T16:01:49.077 INFO:tasks.workunit.client.1.smithi087.stdout:2/170: dwrite d2/d7/df/f39 [0,4194304] 0 2024-02-28T16:01:49.079 INFO:tasks.workunit.client.1.smithi087.stdout:8/192: symlink d2/d9/l39 0 2024-02-28T16:01:49.079 INFO:tasks.workunit.client.1.smithi087.stdout:2/171: fsync d2/d7/f12 0 2024-02-28T16:01:49.090 INFO:tasks.workunit.client.1.smithi087.stdout:7/177: dwrite d14/f1e [0,4194304] 0 2024-02-28T16:01:49.186 INFO:tasks.workunit.client.1.smithi087.stdout:8/193: rename d2/f5 to d2/d9/d10/f3a 0 2024-02-28T16:01:49.187 INFO:tasks.workunit.client.1.smithi087.stdout:7/178: readlink d14/l36 0 2024-02-28T16:01:49.188 INFO:tasks.workunit.client.1.smithi087.stdout:6/239: link d4/d12/f21 d4/dc/f56 0 2024-02-28T16:01:49.191 INFO:tasks.workunit.client.1.smithi087.stdout:5/180: creat d3/f37 x:0 0 0 2024-02-28T16:01:49.193 INFO:tasks.workunit.client.1.smithi087.stdout:8/194: write d2/d9/d10/d24/f34 [351691,113894] 0 2024-02-28T16:01:49.196 INFO:tasks.workunit.client.1.smithi087.stdout:6/240: read d4/dc/d10/f3d [1271564,98708] 0 2024-02-28T16:01:49.197 INFO:tasks.workunit.client.1.smithi087.stdout:3/182: dwrite d11/f18 [4194304,4194304] 0 2024-02-28T16:01:49.197 INFO:tasks.workunit.client.1.smithi087.stdout:7/179: rmdir d14/d27/d34 0 2024-02-28T16:01:49.199 INFO:tasks.workunit.client.1.smithi087.stdout:8/195: chown d2/d9/c29 2062 1 2024-02-28T16:01:49.203 INFO:tasks.workunit.client.1.smithi087.stdout:4/287: dwrite d2/d9/da/f3f [0,4194304] 0 2024-02-28T16:01:49.203 INFO:tasks.workunit.client.1.smithi087.stdout:3/183: write d11/f2f [879653,12506] 0 2024-02-28T16:01:49.206 INFO:tasks.workunit.client.1.smithi087.stdout:6/241: mkdir d4/d12/d45/d57 0 2024-02-28T16:01:49.206 INFO:tasks.workunit.client.1.smithi087.stdout:7/180: read - d14/d2e/d2b/f33 zero size 2024-02-28T16:01:49.206 INFO:tasks.workunit.client.1.smithi087.stdout:5/181: creat d3/d6/f38 x:0 0 0 2024-02-28T16:01:49.208 INFO:tasks.workunit.client.1.smithi087.stdout:8/196: symlink d2/d18/d36/l3b 0 2024-02-28T16:01:49.209 INFO:tasks.workunit.client.1.smithi087.stdout:7/181: write d14/f1d [3021123,62349] 0 2024-02-28T16:01:49.210 INFO:tasks.workunit.client.1.smithi087.stdout:5/182: write d3/d6/f38 [626865,89726] 0 2024-02-28T16:01:49.211 INFO:tasks.workunit.client.1.smithi087.stdout:3/184: symlink d11/l4a 0 2024-02-28T16:01:49.215 INFO:tasks.workunit.client.1.smithi087.stdout:4/288: creat d2/d9/d10/d22/f6a x:0 0 0 2024-02-28T16:01:49.216 INFO:tasks.workunit.client.1.smithi087.stdout:2/172: dread d2/d7/f12 [0,4194304] 0 2024-02-28T16:01:49.222 INFO:tasks.workunit.client.1.smithi087.stdout:3/185: write f10 [4489091,70975] 0 2024-02-28T16:01:49.223 INFO:tasks.workunit.client.1.smithi087.stdout:7/182: dread f12 [0,4194304] 0 2024-02-28T16:01:49.224 INFO:tasks.workunit.client.1.smithi087.stdout:8/197: rename d2/d9/d1a/f2c to d2/d18/f3c 0 2024-02-28T16:01:49.228 INFO:tasks.workunit.client.1.smithi087.stdout:8/198: truncate d2/d18/f3c 801080 0 2024-02-28T16:01:49.231 INFO:tasks.workunit.client.1.smithi087.stdout:5/183: getdents d3/d9/d31 0 2024-02-28T16:01:49.231 INFO:tasks.workunit.client.1.smithi087.stdout:8/199: write d2/d9/f23 [1032410,103583] 0 2024-02-28T16:01:49.233 INFO:tasks.workunit.client.1.smithi087.stdout:7/183: symlink d14/d27/l37 0 2024-02-28T16:01:49.234 INFO:tasks.workunit.client.1.smithi087.stdout:3/186: rename d11/f1e to d11/d3a/f4b 0 2024-02-28T16:01:49.238 INFO:tasks.workunit.client.1.smithi087.stdout:0/257: sync 2024-02-28T16:01:49.238 INFO:tasks.workunit.client.1.smithi087.stdout:1/235: sync 2024-02-28T16:01:49.239 INFO:tasks.workunit.client.1.smithi087.stdout:6/242: creat d4/d30/d13/f58 x:0 0 0 2024-02-28T16:01:49.246 INFO:tasks.workunit.client.1.smithi087.stdout:6/243: mknod d4/dc/c59 0 2024-02-28T16:01:49.249 INFO:tasks.workunit.client.1.smithi087.stdout:8/200: link d2/f8 d2/d9/d10/f3d 0 2024-02-28T16:01:49.249 INFO:tasks.workunit.client.1.smithi087.stdout:3/187: symlink d11/d3a/d48/l4c 0 2024-02-28T16:01:49.250 INFO:tasks.workunit.client.1.smithi087.stdout:2/173: dwrite d2/f3 [0,4194304] 0 2024-02-28T16:01:49.251 INFO:tasks.workunit.client.1.smithi087.stdout:1/236: dread d0/d14/f20 [0,4194304] 0 2024-02-28T16:01:49.253 INFO:tasks.workunit.client.1.smithi087.stdout:5/184: rename d3/c5 to d3/d6/d30/c39 0 2024-02-28T16:01:49.260 INFO:tasks.workunit.client.1.smithi087.stdout:3/188: write d11/f46 [257851,18941] 0 2024-02-28T16:01:49.260 INFO:tasks.workunit.client.1.smithi087.stdout:4/289: dwrite d2/d9/da/f36 [0,4194304] 0 2024-02-28T16:01:49.266 INFO:tasks.workunit.client.1.smithi087.stdout:0/258: dwrite d4/dd/d20/f1d [0,4194304] 0 2024-02-28T16:01:49.266 INFO:tasks.workunit.client.1.smithi087.stdout:3/189: chown d11/c23 32551 1 2024-02-28T16:01:49.266 INFO:tasks.workunit.client.1.smithi087.stdout:2/174: readlink d2/d7/l31 0 2024-02-28T16:01:49.268 INFO:tasks.workunit.client.1.smithi087.stdout:6/244: link d4/d12/d45/f39 d4/d12/d45/f5a 0 2024-02-28T16:01:49.268 INFO:tasks.workunit.client.1.smithi087.stdout:7/184: rename d14/l36 to d14/d27/l38 0 2024-02-28T16:01:49.271 INFO:tasks.workunit.client.1.smithi087.stdout:1/237: symlink d0/d1b/d1f/l4c 0 2024-02-28T16:01:49.272 INFO:tasks.workunit.client.1.smithi087.stdout:0/259: chown d4/dd/d20/d1f/f33 6 1 2024-02-28T16:01:49.272 INFO:tasks.workunit.client.1.smithi087.stdout:1/238: chown d0/d14/f20 1747 1 2024-02-28T16:01:49.275 INFO:tasks.workunit.client.1.smithi087.stdout:3/190: write d11/d3a/f4b [4310796,27934] 0 2024-02-28T16:01:49.276 INFO:tasks.workunit.client.1.smithi087.stdout:8/201: write d2/d9/fb [3875045,85126] 0 2024-02-28T16:01:49.279 INFO:tasks.workunit.client.1.smithi087.stdout:2/175: creat d2/d7/d17/d34/f3a x:0 0 0 2024-02-28T16:01:49.281 INFO:tasks.workunit.client.1.smithi087.stdout:7/185: unlink c8 0 2024-02-28T16:01:49.282 INFO:tasks.workunit.client.1.smithi087.stdout:6/245: mknod d4/dc/c5b 0 2024-02-28T16:01:49.283 INFO:tasks.workunit.client.1.smithi087.stdout:4/290: symlink d2/d9/da/d1a/d26/d69/l6b 0 2024-02-28T16:01:49.284 INFO:tasks.workunit.client.1.smithi087.stdout:1/239: mkdir d0/d1b/d43/d4d 0 2024-02-28T16:01:49.285 INFO:tasks.workunit.client.1.smithi087.stdout:3/191: mknod d11/c4d 0 2024-02-28T16:01:49.288 INFO:tasks.workunit.client.1.smithi087.stdout:9/199: sync 2024-02-28T16:01:49.290 INFO:tasks.workunit.client.1.smithi087.stdout:1/240: fdatasync d0/d1b/f3d 0 2024-02-28T16:01:49.290 INFO:tasks.workunit.client.1.smithi087.stdout:6/246: write d4/d12/d45/f28 [1327802,42757] 0 2024-02-28T16:01:49.291 INFO:tasks.workunit.client.1.smithi087.stdout:8/202: creat d2/d33/f3e x:0 0 0 2024-02-28T16:01:49.292 INFO:tasks.workunit.client.1.smithi087.stdout:3/192: read d11/f1b [485900,52556] 0 2024-02-28T16:01:49.295 INFO:tasks.workunit.client.1.smithi087.stdout:7/186: dread d14/d21/f26 [0,4194304] 0 2024-02-28T16:01:49.300 INFO:tasks.workunit.client.1.smithi087.stdout:5/185: rename d3/f1f to d3/d6/f3a 0 2024-02-28T16:01:49.303 INFO:tasks.workunit.client.1.smithi087.stdout:2/176: symlink d2/d7/l3b 0 2024-02-28T16:01:49.307 INFO:tasks.workunit.client.1.smithi087.stdout:1/241: rmdir d0/d1b/d1f 39 2024-02-28T16:01:49.308 INFO:tasks.workunit.client.1.smithi087.stdout:6/247: mknod d4/dc/c5c 0 2024-02-28T16:01:49.310 INFO:tasks.workunit.client.1.smithi087.stdout:8/203: mknod d2/d9/d1a/c3f 0 2024-02-28T16:01:49.311 INFO:tasks.workunit.client.1.smithi087.stdout:4/291: dread d2/d9/f4d [0,4194304] 0 2024-02-28T16:01:49.312 INFO:tasks.workunit.client.1.smithi087.stdout:3/193: mknod d11/d45/c4e 0 2024-02-28T16:01:49.314 INFO:tasks.workunit.client.1.smithi087.stdout:7/187: symlink d14/d21/l39 0 2024-02-28T16:01:49.316 INFO:tasks.workunit.client.1.smithi087.stdout:0/260: rename d4/d6/dc/d45/c49 to d4/dd/d20/c5c 0 2024-02-28T16:01:49.318 INFO:tasks.workunit.client.1.smithi087.stdout:4/292: stat d2/d9/da/d1a/d26/l67 0 2024-02-28T16:01:49.319 INFO:tasks.workunit.client.1.smithi087.stdout:2/177: creat d2/d7/df/f3c x:0 0 0 2024-02-28T16:01:49.319 INFO:tasks.workunit.client.1.smithi087.stdout:9/200: dwrite d7/dc/d10/f26 [4194304,4194304] 0 2024-02-28T16:01:49.321 INFO:tasks.workunit.client.1.smithi087.stdout:9/201: readlink d7/dc/l25 0 2024-02-28T16:01:49.324 INFO:tasks.workunit.client.1.smithi087.stdout:6/248: creat d4/d12/d45/f5d x:0 0 0 2024-02-28T16:01:49.326 INFO:tasks.workunit.client.1.smithi087.stdout:6/249: write d4/d30/d13/f2d [6377728,94977] 0 2024-02-28T16:01:49.328 INFO:tasks.workunit.client.1.smithi087.stdout:8/204: symlink d2/d18/d36/l40 0 2024-02-28T16:01:49.330 INFO:tasks.workunit.client.1.smithi087.stdout:5/186: getdents d3/d9/d31 0 2024-02-28T16:01:49.331 INFO:tasks.workunit.client.1.smithi087.stdout:3/194: dwrite d11/f24 [0,4194304] 0 2024-02-28T16:01:49.332 INFO:tasks.workunit.client.1.smithi087.stdout:0/261: unlink d4/f53 0 2024-02-28T16:01:49.335 INFO:tasks.workunit.client.1.smithi087.stdout:3/195: chown d11/f31 5097 1 2024-02-28T16:01:49.338 INFO:tasks.workunit.client.1.smithi087.stdout:1/242: creat d0/d14/d48/f4e x:0 0 0 2024-02-28T16:01:49.340 INFO:tasks.workunit.client.1.smithi087.stdout:5/187: creat d3/d6/d30/f3b x:0 0 0 2024-02-28T16:01:49.347 INFO:tasks.workunit.client.1.smithi087.stdout:4/293: creat d2/d9/d10/f6c x:0 0 0 2024-02-28T16:01:49.353 INFO:tasks.workunit.client.1.smithi087.stdout:4/294: fdatasync d2/d9/da/d1a/d26/f29 0 2024-02-28T16:01:49.354 INFO:tasks.workunit.client.1.smithi087.stdout:7/188: dwrite d14/f1e [4194304,4194304] 0 2024-02-28T16:01:49.357 INFO:tasks.workunit.client.1.smithi087.stdout:5/188: dread d3/d6/f2b [0,4194304] 0 2024-02-28T16:01:49.358 INFO:tasks.workunit.client.1.smithi087.stdout:1/243: mknod d0/d1b/d1f/c4f 0 2024-02-28T16:01:49.359 INFO:tasks.workunit.client.1.smithi087.stdout:8/205: dwrite d2/d18/f22 [0,4194304] 0 2024-02-28T16:01:49.367 INFO:tasks.workunit.client.1.smithi087.stdout:5/189: write d3/d9/f2d [995262,46225] 0 2024-02-28T16:01:49.368 INFO:tasks.workunit.client.1.smithi087.stdout:2/178: truncate d2/d7/df/f13 2054535 0 2024-02-28T16:01:49.369 INFO:tasks.workunit.client.1.smithi087.stdout:4/295: truncate d2/d9/d10/d22/f6a 397409 0 2024-02-28T16:01:49.374 INFO:tasks.workunit.client.1.smithi087.stdout:0/262: rename d4/d6/l1a to d4/l5d 0 2024-02-28T16:01:49.375 INFO:tasks.workunit.client.1.smithi087.stdout:8/206: creat d2/d18/d36/f41 x:0 0 0 2024-02-28T16:01:49.376 INFO:tasks.workunit.client.1.smithi087.stdout:3/196: truncate d11/f2a 694673 0 2024-02-28T16:01:49.379 INFO:tasks.workunit.client.1.smithi087.stdout:6/250: write d4/fa [244568,122927] 0 2024-02-28T16:01:49.380 INFO:tasks.workunit.client.1.smithi087.stdout:2/179: mkdir d2/d7/d17/d3d 0 2024-02-28T16:01:49.380 INFO:tasks.workunit.client.1.smithi087.stdout:9/202: dwrite f4 [0,4194304] 0 2024-02-28T16:01:49.383 INFO:tasks.workunit.client.1.smithi087.stdout:0/263: dread - d4/dd/d37/f59 zero size 2024-02-28T16:01:49.386 INFO:tasks.workunit.client.1.smithi087.stdout:4/296: creat d2/d9/de/f6d x:0 0 0 2024-02-28T16:01:49.389 INFO:tasks.workunit.client.1.smithi087.stdout:3/197: unlink d11/f19 0 2024-02-28T16:01:49.389 INFO:tasks.workunit.client.1.smithi087.stdout:2/180: readlink d2/d7/l23 0 2024-02-28T16:01:49.394 INFO:tasks.workunit.client.1.smithi087.stdout:6/251: rmdir d4/d12 39 2024-02-28T16:01:49.395 INFO:tasks.workunit.client.1.smithi087.stdout:2/181: unlink d2/d7/f18 0 2024-02-28T16:01:49.399 INFO:tasks.workunit.client.1.smithi087.stdout:9/203: mknod d7/dc/d10/d2e/c33 0 2024-02-28T16:01:49.399 INFO:tasks.workunit.client.1.smithi087.stdout:5/190: dread d3/d9/f2d [0,4194304] 0 2024-02-28T16:01:49.399 INFO:tasks.workunit.client.1.smithi087.stdout:4/297: fdatasync d2/d9/da/f3f 0 2024-02-28T16:01:49.400 INFO:tasks.workunit.client.1.smithi087.stdout:7/189: dwrite d14/d2e/f22 [0,4194304] 0 2024-02-28T16:01:49.403 INFO:tasks.workunit.client.1.smithi087.stdout:6/252: unlink d4/l35 0 2024-02-28T16:01:49.405 INFO:tasks.workunit.client.1.smithi087.stdout:9/204: fdatasync d7/dc/d10/f21 0 2024-02-28T16:01:49.408 INFO:tasks.workunit.client.1.smithi087.stdout:1/244: dwrite d0/d14/f42 [0,4194304] 0 2024-02-28T16:01:49.409 INFO:tasks.workunit.client.1.smithi087.stdout:7/190: dread d14/d21/f26 [0,4194304] 0 2024-02-28T16:01:49.415 INFO:tasks.workunit.client.1.smithi087.stdout:5/191: unlink d3/d9/f33 0 2024-02-28T16:01:49.421 INFO:tasks.workunit.client.1.smithi087.stdout:9/205: creat d7/dc/d10/d2e/f34 x:0 0 0 2024-02-28T16:01:49.422 INFO:tasks.workunit.client.1.smithi087.stdout:0/264: getdents d4/dd/d37/d39/d3a 0 2024-02-28T16:01:49.428 INFO:tasks.workunit.client.1.smithi087.stdout:3/198: dwrite d11/d45/f47 [0,4194304] 0 2024-02-28T16:01:49.433 INFO:tasks.workunit.client.1.smithi087.stdout:3/199: dread - d11/f1d zero size 2024-02-28T16:01:49.437 INFO:tasks.workunit.client.1.smithi087.stdout:6/253: rename d4/d30/d13/d44 to d4/d12/d45/d5e 0 2024-02-28T16:01:49.438 INFO:tasks.workunit.client.1.smithi087.stdout:1/245: dread d0/d1a/d28/f29 [0,4194304] 0 2024-02-28T16:01:49.441 INFO:tasks.workunit.client.1.smithi087.stdout:0/265: mkdir d4/dd/d20/d1f/d2e/d5e 0 2024-02-28T16:01:49.443 INFO:tasks.workunit.client.1.smithi087.stdout:2/182: dwrite d2/d7/df/f39 [4194304,4194304] 0 2024-02-28T16:01:49.446 INFO:tasks.workunit.client.1.smithi087.stdout:4/298: getdents d2/d9/da 0 2024-02-28T16:01:49.447 INFO:tasks.workunit.client.1.smithi087.stdout:6/254: truncate d4/fa 2313361 0 2024-02-28T16:01:49.448 INFO:tasks.workunit.client.1.smithi087.stdout:9/206: mknod d7/c35 0 2024-02-28T16:01:49.454 INFO:tasks.workunit.client.1.smithi087.stdout:7/191: dwrite d14/d27/f28 [0,4194304] 0 2024-02-28T16:01:49.455 INFO:tasks.workunit.client.1.smithi087.stdout:3/200: creat d11/d3a/d48/f4f x:0 0 0 2024-02-28T16:01:49.459 INFO:tasks.workunit.client.1.smithi087.stdout:5/192: getdents d3/d6 0 2024-02-28T16:01:49.459 INFO:tasks.workunit.client.1.smithi087.stdout:0/266: mkdir d4/dd/d21/d5f 0 2024-02-28T16:01:49.460 INFO:tasks.workunit.client.1.smithi087.stdout:8/207: dread d2/d9/d10/f3d [4194304,4194304] 0 2024-02-28T16:01:49.463 INFO:tasks.workunit.client.1.smithi087.stdout:4/299: mknod d2/d49/c6e 0 2024-02-28T16:01:49.463 INFO:tasks.workunit.client.1.smithi087.stdout:2/183: fsync d2/d7/df/d28/f32 0 2024-02-28T16:01:49.469 INFO:tasks.workunit.client.1.smithi087.stdout:3/201: stat d11/l39 0 2024-02-28T16:01:49.470 INFO:tasks.workunit.client.1.smithi087.stdout:7/192: rmdir d14/d21 39 2024-02-28T16:01:49.471 INFO:tasks.workunit.client.1.smithi087.stdout:3/202: read - d11/f32 zero size 2024-02-28T16:01:49.474 INFO:tasks.workunit.client.1.smithi087.stdout:2/184: creat d2/f3e x:0 0 0 2024-02-28T16:01:49.476 INFO:tasks.workunit.client.1.smithi087.stdout:4/300: fdatasync d2/d9/da/d1a/d26/f3d 0 2024-02-28T16:01:49.477 INFO:tasks.workunit.client.1.smithi087.stdout:8/208: mkdir d2/d18/d42 0 2024-02-28T16:01:49.480 INFO:tasks.workunit.client.1.smithi087.stdout:7/193: mknod d14/d30/c3a 0 2024-02-28T16:01:49.484 INFO:tasks.workunit.client.1.smithi087.stdout:5/193: creat d3/f3c x:0 0 0 2024-02-28T16:01:49.485 INFO:tasks.workunit.client.1.smithi087.stdout:6/255: dwrite d4/d30/d13/f3f [0,4194304] 0 2024-02-28T16:01:49.486 INFO:tasks.workunit.client.1.smithi087.stdout:2/185: chown d2/d7/df/d28/l2b 4078 1 2024-02-28T16:01:49.487 INFO:tasks.workunit.client.1.smithi087.stdout:3/203: mknod d11/d44/c50 0 2024-02-28T16:01:49.488 INFO:tasks.workunit.client.1.smithi087.stdout:7/194: truncate f12 4641412 0 2024-02-28T16:01:49.489 INFO:tasks.workunit.client.1.smithi087.stdout:1/246: write d0/fd [1626045,100549] 0 2024-02-28T16:01:49.490 INFO:tasks.workunit.client.1.smithi087.stdout:9/207: dwrite f4 [0,4194304] 0 2024-02-28T16:01:49.493 INFO:tasks.workunit.client.1.smithi087.stdout:5/194: fdatasync d3/d6/d30/f3b 0 2024-02-28T16:01:49.498 INFO:tasks.workunit.client.1.smithi087.stdout:2/186: chown d2/d7/d17 26 1 2024-02-28T16:01:49.498 INFO:tasks.workunit.client.1.smithi087.stdout:9/208: chown d7/dc/f18 8 1 2024-02-28T16:01:49.502 INFO:tasks.workunit.client.1.smithi087.stdout:3/204: stat d11/d3a/f4b 0 2024-02-28T16:01:49.502 INFO:tasks.workunit.client.1.smithi087.stdout:7/195: fdatasync d14/f1e 0 2024-02-28T16:01:49.508 INFO:tasks.workunit.client.1.smithi087.stdout:9/209: mkdir d7/dd/d36 0 2024-02-28T16:01:49.508 INFO:tasks.workunit.client.1.smithi087.stdout:0/267: dwrite d4/f8 [0,4194304] 0 2024-02-28T16:01:49.509 INFO:tasks.workunit.client.1.smithi087.stdout:3/205: fsync d11/f30 0 2024-02-28T16:01:49.511 INFO:tasks.workunit.client.1.smithi087.stdout:5/195: rmdir d3 39 2024-02-28T16:01:49.513 INFO:tasks.workunit.client.1.smithi087.stdout:3/206: fsync d11/f1d 0 2024-02-28T16:01:49.521 INFO:tasks.workunit.client.1.smithi087.stdout:3/207: chown fa 11890 1 2024-02-28T16:01:49.525 INFO:tasks.workunit.client.1.smithi087.stdout:8/209: dwrite d2/d9/f19 [0,4194304] 0 2024-02-28T16:01:49.529 INFO:tasks.workunit.client.1.smithi087.stdout:4/301: dwrite d2/d9/de/f6d [0,4194304] 0 2024-02-28T16:01:49.529 INFO:tasks.workunit.client.1.smithi087.stdout:6/256: dwrite d4/d30/d13/f58 [0,4194304] 0 2024-02-28T16:01:49.530 INFO:tasks.workunit.client.1.smithi087.stdout:5/196: chown d3/f37 2 1 2024-02-28T16:01:49.532 INFO:tasks.workunit.client.1.smithi087.stdout:8/210: write d2/d18/f22 [2040977,43621] 0 2024-02-28T16:01:49.535 INFO:tasks.workunit.client.1.smithi087.stdout:1/247: dread d0/d1a/f3a [0,4194304] 0 2024-02-28T16:01:49.537 INFO:tasks.workunit.client.1.smithi087.stdout:7/196: dread d14/f1d [0,4194304] 0 2024-02-28T16:01:49.538 INFO:tasks.workunit.client.1.smithi087.stdout:7/197: chown fc 1156543924 1 2024-02-28T16:01:49.538 INFO:tasks.workunit.client.1.smithi087.stdout:8/211: read d2/d9/d10/f3a [481388,2611] 0 2024-02-28T16:01:49.542 INFO:tasks.workunit.client.1.smithi087.stdout:2/187: dread d2/d7/df/f39 [0,4194304] 0 2024-02-28T16:01:49.545 INFO:tasks.workunit.client.1.smithi087.stdout:8/212: write d2/d9/f19 [3808221,126208] 0 2024-02-28T16:01:49.547 INFO:tasks.workunit.client.1.smithi087.stdout:2/188: write d2/d7/df/f3c [862652,104592] 0 2024-02-28T16:01:49.549 INFO:tasks.workunit.client.1.smithi087.stdout:7/198: rename d14/d2e/c2d to d14/d2e/c3b 0 2024-02-28T16:01:49.551 INFO:tasks.workunit.client.1.smithi087.stdout:5/197: symlink d3/d6/d30/d36/l3d 0 2024-02-28T16:01:49.552 INFO:tasks.workunit.client.1.smithi087.stdout:6/257: mknod d4/d12/d45/d57/c5f 0 2024-02-28T16:01:49.553 INFO:tasks.workunit.client.1.smithi087.stdout:0/268: dwrite d4/dd/f1b [0,4194304] 0 2024-02-28T16:01:49.554 INFO:tasks.workunit.client.1.smithi087.stdout:7/199: fsync d14/d2e/f1b 0 2024-02-28T16:01:49.554 INFO:tasks.workunit.client.1.smithi087.stdout:4/302: getdents d2/d9/d10/d22/d5b/d5c/d68 0 2024-02-28T16:01:49.556 INFO:tasks.workunit.client.1.smithi087.stdout:0/269: readlink d4/dd/l30 0 2024-02-28T16:01:49.566 INFO:tasks.workunit.client.1.smithi087.stdout:1/248: rename d0/lc to d0/d1b/d43/l50 0 2024-02-28T16:01:49.566 INFO:tasks.workunit.client.1.smithi087.stdout:4/303: stat d2/df/d2e/l38 0 2024-02-28T16:01:49.566 INFO:tasks.workunit.client.1.smithi087.stdout:5/198: write d3/f13 [1666715,101951] 0 2024-02-28T16:01:49.566 INFO:tasks.workunit.client.1.smithi087.stdout:8/213: creat d2/d18/d42/f43 x:0 0 0 2024-02-28T16:01:49.566 INFO:tasks.workunit.client.1.smithi087.stdout:5/199: fdatasync d3/d6/f26 0 2024-02-28T16:01:49.567 INFO:tasks.workunit.client.1.smithi087.stdout:6/258: write d4/d30/d13/f3b [972014,27187] 0 2024-02-28T16:01:49.567 INFO:tasks.workunit.client.1.smithi087.stdout:7/200: dread d14/d21/f26 [0,4194304] 0 2024-02-28T16:01:49.569 INFO:tasks.workunit.client.1.smithi087.stdout:5/200: write d3/f22 [1487597,121866] 0 2024-02-28T16:01:49.569 INFO:tasks.workunit.client.1.smithi087.stdout:7/201: chown d14/d21/c23 35283696 1 2024-02-28T16:01:49.571 INFO:tasks.workunit.client.1.smithi087.stdout:5/201: read - d3/d6/f2f zero size 2024-02-28T16:01:49.572 INFO:tasks.workunit.client.1.smithi087.stdout:2/189: rename d2/d7/d17/f24 to d2/d7/df/f3f 0 2024-02-28T16:01:49.575 INFO:tasks.workunit.client.1.smithi087.stdout:2/190: truncate d2/f3e 486155 0 2024-02-28T16:01:49.575 INFO:tasks.workunit.client.1.smithi087.stdout:2/191: stat d2/f3e 0 2024-02-28T16:01:49.576 INFO:tasks.workunit.client.1.smithi087.stdout:8/214: creat d2/d9/d1a/f44 x:0 0 0 2024-02-28T16:01:49.577 INFO:tasks.workunit.client.1.smithi087.stdout:6/259: symlink d4/d30/d13/d38/l60 0 2024-02-28T16:01:49.578 INFO:tasks.workunit.client.1.smithi087.stdout:7/202: creat d14/d27/f3c x:0 0 0 2024-02-28T16:01:49.582 INFO:tasks.workunit.client.1.smithi087.stdout:4/304: symlink d2/d9/d10/l6f 0 2024-02-28T16:01:49.582 INFO:tasks.workunit.client.1.smithi087.stdout:3/208: truncate ff 562866 0 2024-02-28T16:01:49.585 INFO:tasks.workunit.client.1.smithi087.stdout:2/192: creat d2/d7/d17/f40 x:0 0 0 2024-02-28T16:01:49.587 INFO:tasks.workunit.client.1.smithi087.stdout:0/270: dread d4/dd/d20/d1f/d34/f35 [0,4194304] 0 2024-02-28T16:01:49.587 INFO:tasks.workunit.client.1.smithi087.stdout:8/215: creat d2/d9/d1a/f45 x:0 0 0 2024-02-28T16:01:49.590 INFO:tasks.workunit.client.1.smithi087.stdout:7/203: creat d14/d2e/f3d x:0 0 0 2024-02-28T16:01:49.596 INFO:tasks.workunit.client.1.smithi087.stdout:2/193: symlink d2/d7/df/d28/l41 0 2024-02-28T16:01:49.596 INFO:tasks.workunit.client.1.smithi087.stdout:6/260: dread d4/dc/d10/f40 [0,4194304] 0 2024-02-28T16:01:49.599 INFO:tasks.workunit.client.1.smithi087.stdout:5/202: dwrite d3/f3c [0,4194304] 0 2024-02-28T16:01:49.599 INFO:tasks.workunit.client.1.smithi087.stdout:7/204: dread f10 [0,4194304] 0 2024-02-28T16:01:49.599 INFO:tasks.workunit.client.1.smithi087.stdout:8/216: creat d2/d9/d1a/f46 x:0 0 0 2024-02-28T16:01:49.600 INFO:tasks.workunit.client.1.smithi087.stdout:0/271: mkdir d4/dd/d20/d1f/d60 0 2024-02-28T16:01:49.603 INFO:tasks.workunit.client.1.smithi087.stdout:2/194: mkdir d2/d42 0 2024-02-28T16:01:49.603 INFO:tasks.workunit.client.1.smithi087.stdout:9/210: dread d7/f8 [4194304,4194304] 0 2024-02-28T16:01:49.606 INFO:tasks.workunit.client.1.smithi087.stdout:8/217: mknod d2/d18/d25/c47 0 2024-02-28T16:01:49.609 INFO:tasks.workunit.client.1.smithi087.stdout:4/305: dread d2/df/d2e/f47 [0,4194304] 0 2024-02-28T16:01:49.610 INFO:tasks.workunit.client.1.smithi087.stdout:7/205: rename d14/f1e to d14/d21/f3e 0 2024-02-28T16:01:49.612 INFO:tasks.workunit.client.1.smithi087.stdout:2/195: creat d2/d7/df/d28/f43 x:0 0 0 2024-02-28T16:01:49.612 INFO:tasks.workunit.client.1.smithi087.stdout:9/211: creat d7/dd/f37 x:0 0 0 2024-02-28T16:01:49.613 INFO:tasks.workunit.client.1.smithi087.stdout:5/203: mkdir d3/d6/d30/d3e 0 2024-02-28T16:01:49.615 INFO:tasks.workunit.client.1.smithi087.stdout:5/204: chown d3/d9/l18 105441 1 2024-02-28T16:01:49.615 INFO:tasks.workunit.client.1.smithi087.stdout:4/306: creat d2/df/d2e/f70 x:0 0 0 2024-02-28T16:01:49.618 INFO:tasks.workunit.client.1.smithi087.stdout:8/218: creat d2/d9/d1a/f48 x:0 0 0 2024-02-28T16:01:49.619 INFO:tasks.workunit.client.1.smithi087.stdout:0/272: creat d4/dd/d20/d1f/d2e/d31/d58/f61 x:0 0 0 2024-02-28T16:01:49.624 INFO:tasks.workunit.client.1.smithi087.stdout:8/219: write d2/d9/f16 [9342818,124544] 0 2024-02-28T16:01:49.624 INFO:tasks.workunit.client.1.smithi087.stdout:5/205: mknod d3/d6/d30/d3e/c3f 0 2024-02-28T16:01:49.625 INFO:tasks.workunit.client.1.smithi087.stdout:0/273: chown d4/d6/f14 23 1 2024-02-28T16:01:49.627 INFO:tasks.workunit.client.1.smithi087.stdout:4/307: truncate d2/d9/f48 3106205 0 2024-02-28T16:01:49.627 INFO:tasks.workunit.client.1.smithi087.stdout:9/212: creat d7/f38 x:0 0 0 2024-02-28T16:01:49.629 INFO:tasks.workunit.client.1.smithi087.stdout:0/274: dread - d4/dd/d37/f59 zero size 2024-02-28T16:01:49.630 INFO:tasks.workunit.client.1.smithi087.stdout:5/206: creat d3/d6/d30/d3e/f40 x:0 0 0 2024-02-28T16:01:49.631 INFO:tasks.workunit.client.1.smithi087.stdout:8/220: write d2/d18/f3c [1646261,38339] 0 2024-02-28T16:01:49.635 INFO:tasks.workunit.client.1.smithi087.stdout:2/196: dwrite d2/d7/f12 [0,4194304] 0 2024-02-28T16:01:49.635 INFO:tasks.workunit.client.1.smithi087.stdout:8/221: fsync d2/f27 0 2024-02-28T16:01:49.636 INFO:tasks.workunit.client.1.smithi087.stdout:0/275: fdatasync d4/dd/d20/d1f/d2e/d31/f51 0 2024-02-28T16:01:49.637 INFO:tasks.workunit.client.1.smithi087.stdout:5/207: rmdir d3/d9/d31 0 2024-02-28T16:01:49.641 INFO:tasks.workunit.client.1.smithi087.stdout:0/276: write d4/dd/d26/f2b [3090552,63550] 0 2024-02-28T16:01:49.642 INFO:tasks.workunit.client.1.smithi087.stdout:8/222: write d2/d9/d10/f12 [9669863,11737] 0 2024-02-28T16:01:49.643 INFO:tasks.workunit.client.1.smithi087.stdout:5/208: write d3/f12 [4724211,39665] 0 2024-02-28T16:01:49.648 INFO:tasks.workunit.client.1.smithi087.stdout:0/277: write d4/dd/f29 [1185140,91011] 0 2024-02-28T16:01:49.648 INFO:tasks.workunit.client.1.smithi087.stdout:5/209: chown d3/d6/f23 0 1 2024-02-28T16:01:49.649 INFO:tasks.workunit.client.1.smithi087.stdout:9/213: dread d7/dd/fe [0,4194304] 0 2024-02-28T16:01:49.650 INFO:tasks.workunit.client.1.smithi087.stdout:8/223: mknod d2/d18/c49 0 2024-02-28T16:01:49.653 INFO:tasks.workunit.client.1.smithi087.stdout:6/261: dread d4/d12/d45/f28 [0,4194304] 0 2024-02-28T16:01:49.656 INFO:tasks.workunit.client.1.smithi087.stdout:4/308: dwrite d2/d9/d10/d22/f6a [0,4194304] 0 2024-02-28T16:01:49.660 INFO:tasks.workunit.client.1.smithi087.stdout:8/224: dread - d2/d9/d1a/f48 zero size 2024-02-28T16:01:49.662 INFO:tasks.workunit.client.1.smithi087.stdout:6/262: mkdir d4/dc/d61 0 2024-02-28T16:01:49.663 INFO:tasks.workunit.client.1.smithi087.stdout:2/197: truncate d2/f21 111239 0 2024-02-28T16:01:49.664 INFO:tasks.workunit.client.1.smithi087.stdout:2/198: chown d2 187459 1 2024-02-28T16:01:49.666 INFO:tasks.workunit.client.1.smithi087.stdout:0/278: rename d4/dd/d37/d39/d3a/c4f to d4/dd/d21/c62 0 2024-02-28T16:01:49.672 INFO:tasks.workunit.client.1.smithi087.stdout:6/263: write d4/d30/d13/f3b [1467176,54955] 0 2024-02-28T16:01:49.675 INFO:tasks.workunit.client.1.smithi087.stdout:2/199: truncate d2/d7/d17/d34/f3a 147015 0 2024-02-28T16:01:49.677 INFO:tasks.workunit.client.1.smithi087.stdout:4/309: getdents d2 0 2024-02-28T16:01:49.679 INFO:tasks.workunit.client.1.smithi087.stdout:6/264: write d4/dc/d10/f3d [985846,44839] 0 2024-02-28T16:01:49.683 INFO:tasks.workunit.client.1.smithi087.stdout:9/214: dread d7/d1e/f24 [0,4194304] 0 2024-02-28T16:01:49.683 INFO:tasks.workunit.client.1.smithi087.stdout:5/210: dwrite d3/d6/f2f [0,4194304] 0 2024-02-28T16:01:49.685 INFO:tasks.workunit.client.1.smithi087.stdout:5/211: readlink d3/d9/l18 0 2024-02-28T16:01:49.686 INFO:tasks.workunit.client.1.smithi087.stdout:2/200: dread d2/fb [0,4194304] 0 2024-02-28T16:01:49.687 INFO:tasks.workunit.client.1.smithi087.stdout:6/265: fdatasync d4/d12/d45/f28 0 2024-02-28T16:01:49.690 INFO:tasks.workunit.client.1.smithi087.stdout:9/215: fdatasync d7/dd/f28 0 2024-02-28T16:01:49.692 INFO:tasks.workunit.client.1.smithi087.stdout:4/310: symlink d2/d9/d10/d22/l71 0 2024-02-28T16:01:49.692 INFO:tasks.workunit.client.1.smithi087.stdout:5/212: chown d3/d6/d30/d36/l3d 0 1 2024-02-28T16:01:49.695 INFO:tasks.workunit.client.1.smithi087.stdout:8/225: dwrite d2/d9/d1a/f45 [0,4194304] 0 2024-02-28T16:01:49.695 INFO:tasks.workunit.client.1.smithi087.stdout:2/201: creat d2/d42/f44 x:0 0 0 2024-02-28T16:01:49.697 INFO:tasks.workunit.client.1.smithi087.stdout:9/216: write d7/dd/f20 [486114,70684] 0 2024-02-28T16:01:49.698 INFO:tasks.workunit.client.1.smithi087.stdout:4/311: creat d2/d9/d10/d22/f72 x:0 0 0 2024-02-28T16:01:49.700 INFO:tasks.workunit.client.1.smithi087.stdout:2/202: dread - d2/d7/d17/f40 zero size 2024-02-28T16:01:49.702 INFO:tasks.workunit.client.1.smithi087.stdout:8/226: write d2/d9/f16 [9807238,122131] 0 2024-02-28T16:01:49.702 INFO:tasks.workunit.client.1.smithi087.stdout:9/217: readlink d7/dc/l25 0 2024-02-28T16:01:49.706 INFO:tasks.workunit.client.1.smithi087.stdout:2/203: truncate d2/fc 1044517 0 2024-02-28T16:01:49.710 INFO:tasks.workunit.client.1.smithi087.stdout:5/213: rename d3/d6/d30/d36/l3d to d3/d6/d30/l41 0 2024-02-28T16:01:49.711 INFO:tasks.workunit.client.1.smithi087.stdout:9/218: write f4 [3412770,64664] 0 2024-02-28T16:01:49.714 INFO:tasks.workunit.client.1.smithi087.stdout:8/227: mknod d2/d18/d42/c4a 0 2024-02-28T16:01:49.720 INFO:tasks.workunit.client.1.smithi087.stdout:0/279: dwrite d4/dd/d20/d1f/f33 [0,4194304] 0 2024-02-28T16:01:49.721 INFO:tasks.workunit.client.1.smithi087.stdout:5/214: write d3/d6/f23 [799413,40113] 0 2024-02-28T16:01:49.724 INFO:tasks.workunit.client.1.smithi087.stdout:5/215: fdatasync d3/d6/f20 0 2024-02-28T16:01:49.725 INFO:tasks.workunit.client.1.smithi087.stdout:2/204: rename d2/d7/df/d28/c29 to d2/d7/d17/d34/c45 0 2024-02-28T16:01:49.730 INFO:tasks.workunit.client.1.smithi087.stdout:5/216: symlink d3/d6/d30/d36/l42 0 2024-02-28T16:01:49.731 INFO:tasks.workunit.client.1.smithi087.stdout:5/217: fsync d3/f12 0 2024-02-28T16:01:49.735 INFO:tasks.workunit.client.1.smithi087.stdout:9/219: rename d7/dc/d10 to d7/dd/d15/d39 0 2024-02-28T16:01:49.735 INFO:tasks.workunit.client.1.smithi087.stdout:6/266: dread d4/d30/d13/f2a [0,4194304] 0 2024-02-28T16:01:49.737 INFO:tasks.workunit.client.1.smithi087.stdout:0/280: link d4/dd/d37/f3d d4/d6/dc/d45/f63 0 2024-02-28T16:01:49.739 INFO:tasks.workunit.client.1.smithi087.stdout:0/281: readlink d4/dd/d20/d1f/l4b 0 2024-02-28T16:01:49.739 INFO:tasks.workunit.client.1.smithi087.stdout:4/312: truncate d2/d9/f2c 104081 0 2024-02-28T16:01:49.741 INFO:tasks.workunit.client.1.smithi087.stdout:4/313: fsync d2/df/f13 0 2024-02-28T16:01:49.741 INFO:tasks.workunit.client.1.smithi087.stdout:0/282: read d4/dd/f29 [790409,24467] 0 2024-02-28T16:01:49.746 INFO:tasks.workunit.client.1.smithi087.stdout:8/228: rename d2/d9/fb to d2/d9/d1a/f4b 0 2024-02-28T16:01:49.746 INFO:tasks.workunit.client.1.smithi087.stdout:0/283: read d4/d6/f14 [587731,45163] 0 2024-02-28T16:01:49.747 INFO:tasks.workunit.client.1.smithi087.stdout:6/267: creat d4/d12/d45/d57/f62 x:0 0 0 2024-02-28T16:01:49.747 INFO:tasks.workunit.client.1.smithi087.stdout:0/284: chown d4/d6/dc 0 1 2024-02-28T16:01:49.752 INFO:tasks.workunit.client.1.smithi087.stdout:6/268: chown d4/l50 20 1 2024-02-28T16:01:49.753 INFO:tasks.workunit.client.1.smithi087.stdout:2/205: creat d2/d7/f46 x:0 0 0 2024-02-28T16:01:49.755 INFO:tasks.workunit.client.0.smithi057.stdout:4/2: sync 2024-02-28T16:01:49.758 INFO:tasks.workunit.client.1.smithi087.stdout:5/218: creat d3/f43 x:0 0 0 2024-02-28T16:01:49.758 INFO:tasks.workunit.client.0.smithi057.stdout:4/3: mkdir d1 0 2024-02-28T16:01:49.759 INFO:tasks.workunit.client.1.smithi087.stdout:2/206: rmdir d2/d7/df 39 2024-02-28T16:01:49.759 INFO:tasks.workunit.client.0.smithi057.stdout:4/4: chown d1 4045 1 2024-02-28T16:01:49.760 INFO:tasks.workunit.client.0.smithi057.stdout:4/5: truncate - no filename 2024-02-28T16:01:49.760 INFO:tasks.workunit.client.0.smithi057.stdout:4/6: chown d1 11 1 2024-02-28T16:01:49.760 INFO:tasks.workunit.client.0.smithi057.stdout:4/7: truncate - no filename 2024-02-28T16:01:49.765 INFO:tasks.workunit.client.0.smithi057.stdout:4/8: creat d1/f2 x:0 0 0 2024-02-28T16:01:49.769 INFO:tasks.workunit.client.0.smithi057.stdout:4/9: unlink d1/f2 0 2024-02-28T16:01:49.772 INFO:tasks.workunit.client.0.smithi057.stdout:4/10: mknod d1/c3 0 2024-02-28T16:01:49.775 INFO:tasks.workunit.client.1.smithi087.stdout:8/229: dwrite d2/f30 [0,4194304] 0 2024-02-28T16:01:49.777 INFO:tasks.workunit.client.0.smithi057.stdout:4/11: creat d1/f4 x:0 0 0 2024-02-28T16:01:49.779 INFO:tasks.workunit.client.1.smithi087.stdout:9/220: truncate d7/dd/f1a 720949 0 2024-02-28T16:01:49.780 INFO:tasks.workunit.client.1.smithi087.stdout:4/314: dwrite d2/d9/da/f36 [0,4194304] 0 2024-02-28T16:01:49.780 INFO:tasks.workunit.client.1.smithi087.stdout:0/285: truncate d4/dd/f2d 2041379 0 2024-02-28T16:01:49.781 INFO:tasks.workunit.client.0.smithi057.stdout:4/12: creat d1/f5 x:0 0 0 2024-02-28T16:01:49.783 INFO:tasks.workunit.client.0.smithi057.stdout:4/13: fdatasync d1/f4 0 2024-02-28T16:01:49.785 INFO:tasks.workunit.client.0.smithi057.stdout:4/14: dread - d1/f4 zero size 2024-02-28T16:01:49.795 INFO:tasks.workunit.client.1.smithi087.stdout:6/269: dwrite d4/d12/f4f [0,4194304] 0 2024-02-28T16:01:49.798 INFO:tasks.workunit.client.1.smithi087.stdout:5/219: dwrite d3/d9/f1e [0,4194304] 0 2024-02-28T16:01:49.804 INFO:tasks.workunit.client.1.smithi087.stdout:4/315: mkdir d2/d9/d10/d22/d73 0 2024-02-28T16:01:49.807 INFO:tasks.workunit.client.1.smithi087.stdout:5/220: mkdir d3/d6/d30/d44 0 2024-02-28T16:01:49.809 INFO:tasks.workunit.client.1.smithi087.stdout:6/270: creat d4/dc/d61/f63 x:0 0 0 2024-02-28T16:01:49.814 INFO:tasks.workunit.client.1.smithi087.stdout:6/271: readlink d4/d12/d45/l34 0 2024-02-28T16:01:49.816 INFO:tasks.workunit.client.1.smithi087.stdout:8/230: dwrite d2/f37 [0,4194304] 0 2024-02-28T16:01:49.820 INFO:tasks.workunit.client.1.smithi087.stdout:5/221: rename d3/d6/f19 to d3/d6/d30/d36/f45 0 2024-02-28T16:01:49.820 INFO:tasks.workunit.client.1.smithi087.stdout:9/221: dwrite d7/dd/d15/d39/d2e/f34 [0,4194304] 0 2024-02-28T16:01:49.822 INFO:tasks.workunit.client.1.smithi087.stdout:4/316: dread d2/d9/da/f2d [0,4194304] 0 2024-02-28T16:01:49.824 INFO:tasks.workunit.client.1.smithi087.stdout:9/222: mknod d7/dd/d15/d39/d2e/c3a 0 2024-02-28T16:01:49.824 INFO:tasks.workunit.client.1.smithi087.stdout:6/272: creat d4/d30/d13/d38/f64 x:0 0 0 2024-02-28T16:01:49.828 INFO:tasks.workunit.client.1.smithi087.stdout:8/231: rename d2/d18/c49 to d2/d9/d10/c4c 0 2024-02-28T16:01:49.829 INFO:tasks.workunit.client.0.smithi057.stdout:4/15: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:01:49.829 INFO:tasks.workunit.client.1.smithi087.stdout:6/273: chown d4/d30/d13 40 1 2024-02-28T16:01:49.830 INFO:tasks.workunit.client.1.smithi087.stdout:4/317: stat d2/d9/d10/f6c 0 2024-02-28T16:01:49.830 INFO:tasks.workunit.client.0.smithi057.stdout:4/16: readlink l0 0 2024-02-28T16:01:49.831 INFO:tasks.workunit.client.0.smithi057.stdout:4/17: readlink l0 0 2024-02-28T16:01:49.834 INFO:tasks.workunit.client.0.smithi057.stdout:4/18: truncate d1/f5 890662 0 2024-02-28T16:01:49.835 INFO:tasks.workunit.client.1.smithi087.stdout:2/207: dread d2/d7/f19 [0,4194304] 0 2024-02-28T16:01:49.838 INFO:tasks.workunit.client.1.smithi087.stdout:4/318: creat d2/d9/da/d1a/d26/d69/f74 x:0 0 0 2024-02-28T16:01:49.839 INFO:tasks.workunit.client.1.smithi087.stdout:8/232: unlink d2/d9/d10/f3d 0 2024-02-28T16:01:49.840 INFO:tasks.workunit.client.1.smithi087.stdout:8/233: fdatasync d2/d9/f19 0 2024-02-28T16:01:49.841 INFO:tasks.workunit.client.1.smithi087.stdout:9/223: creat d7/dd/d36/f3b x:0 0 0 2024-02-28T16:01:49.844 INFO:tasks.workunit.client.1.smithi087.stdout:9/224: write d7/dd/d15/f22 [5816603,85901] 0 2024-02-28T16:01:49.845 INFO:tasks.workunit.client.1.smithi087.stdout:9/225: fsync d7/dd/f37 0 2024-02-28T16:01:49.847 INFO:tasks.workunit.client.1.smithi087.stdout:4/319: creat d2/d9/d10/d22/d5b/f75 x:0 0 0 2024-02-28T16:01:49.850 INFO:tasks.workunit.client.1.smithi087.stdout:5/222: rename d3/d6/f1d to d3/d9/f46 0 2024-02-28T16:01:49.854 INFO:tasks.workunit.client.1.smithi087.stdout:4/320: symlink d2/df/d65/l76 0 2024-02-28T16:01:49.856 INFO:tasks.workunit.client.1.smithi087.stdout:8/234: dread d2/d9/d10/f12 [0,4194304] 0 2024-02-28T16:01:49.859 INFO:tasks.workunit.client.1.smithi087.stdout:2/208: link d2/d7/l23 d2/d7/df/l47 0 2024-02-28T16:01:49.860 INFO:tasks.workunit.client.1.smithi087.stdout:8/235: mknod d2/d33/c4d 0 2024-02-28T16:01:49.861 INFO:tasks.workunit.client.1.smithi087.stdout:2/209: dread - d2/d7/d17/f40 zero size 2024-02-28T16:01:49.863 INFO:tasks.workunit.client.1.smithi087.stdout:9/226: dwrite d7/dd/d15/f1f [0,4194304] 0 2024-02-28T16:01:49.864 INFO:tasks.workunit.client.0.smithi057.stdout:4/19: dwrite d1/f5 [0,4194304] 0 2024-02-28T16:01:49.867 INFO:tasks.workunit.client.1.smithi087.stdout:8/236: read d2/d9/d1a/f4b [1195413,77192] 0 2024-02-28T16:01:49.868 INFO:tasks.workunit.client.1.smithi087.stdout:9/227: write d7/f8 [5958556,36926] 0 2024-02-28T16:01:49.868 INFO:tasks.workunit.client.1.smithi087.stdout:2/210: symlink d2/d7/d17/d3d/l48 0 2024-02-28T16:01:49.868 INFO:tasks.workunit.client.1.smithi087.stdout:8/237: fdatasync d2/d9/d1a/f45 0 2024-02-28T16:01:49.870 INFO:tasks.workunit.client.0.smithi057.stdout:4/20: creat d1/f6 x:0 0 0 2024-02-28T16:01:49.872 INFO:tasks.workunit.client.1.smithi087.stdout:2/211: truncate d2/d7/f2d 569716 0 2024-02-28T16:01:49.873 INFO:tasks.workunit.client.1.smithi087.stdout:4/321: dread d2/d9/da/f36 [0,4194304] 0 2024-02-28T16:01:49.874 INFO:tasks.workunit.client.1.smithi087.stdout:9/228: getdents d7/dc 0 2024-02-28T16:01:49.875 INFO:tasks.workunit.client.1.smithi087.stdout:4/322: fsync d2/f2f 0 2024-02-28T16:01:49.875 INFO:tasks.workunit.client.1.smithi087.stdout:8/238: mkdir d2/d18/d4e 0 2024-02-28T16:01:49.877 INFO:tasks.workunit.client.1.smithi087.stdout:6/274: truncate d4/f23 1548914 0 2024-02-28T16:01:49.879 INFO:tasks.workunit.client.1.smithi087.stdout:2/212: write d2/d7/df/f1e [157442,82114] 0 2024-02-28T16:01:49.880 INFO:tasks.workunit.client.1.smithi087.stdout:4/323: fdatasync d2/d9/da/f3f 0 2024-02-28T16:01:49.881 INFO:tasks.workunit.client.1.smithi087.stdout:9/229: mkdir d7/dd/d3c 0 2024-02-28T16:01:49.884 INFO:tasks.workunit.client.1.smithi087.stdout:9/230: chown d7/f14 65831711 1 2024-02-28T16:01:49.884 INFO:tasks.workunit.client.1.smithi087.stdout:2/213: truncate d2/d7/f46 222167 0 2024-02-28T16:01:49.886 INFO:tasks.workunit.client.1.smithi087.stdout:9/231: stat d7/dd/d15/d39/f2f 0 2024-02-28T16:01:49.888 INFO:tasks.workunit.client.1.smithi087.stdout:6/275: unlink d4/d12/d45/l2f 0 2024-02-28T16:01:49.889 INFO:tasks.workunit.client.1.smithi087.stdout:5/223: creat d3/d6/d30/d3e/f47 x:0 0 0 2024-02-28T16:01:49.891 INFO:tasks.workunit.client.1.smithi087.stdout:2/214: rename d2/d7/d17/d3d/l48 to d2/l49 0 2024-02-28T16:01:49.892 INFO:tasks.workunit.client.1.smithi087.stdout:9/232: readlink d7/d1e/l2b 0 2024-02-28T16:01:49.892 INFO:tasks.workunit.client.1.smithi087.stdout:2/215: fdatasync d2/d7/df/f1e 0 2024-02-28T16:01:49.894 INFO:tasks.workunit.client.1.smithi087.stdout:4/324: symlink d2/d9/l77 0 2024-02-28T16:01:49.897 INFO:tasks.workunit.client.1.smithi087.stdout:2/216: creat d2/d7/d17/d34/f4a x:0 0 0 2024-02-28T16:01:49.900 INFO:tasks.workunit.client.1.smithi087.stdout:5/224: unlink d3/d6/f8 0 2024-02-28T16:01:49.903 INFO:tasks.workunit.client.1.smithi087.stdout:2/217: mkdir d2/d42/d4b 0 2024-02-28T16:01:49.908 INFO:tasks.workunit.client.1.smithi087.stdout:8/239: truncate d2/f6 289420 0 2024-02-28T16:01:49.910 INFO:tasks.workunit.client.1.smithi087.stdout:2/218: chown d2/d7/c1d 42600367 1 2024-02-28T16:01:49.913 INFO:tasks.workunit.client.1.smithi087.stdout:5/225: rename d3/f3c to d3/d6/d30/d36/f48 0 2024-02-28T16:01:49.917 INFO:tasks.workunit.client.1.smithi087.stdout:6/276: dwrite d4/f26 [0,4194304] 0 2024-02-28T16:01:49.920 INFO:tasks.workunit.client.1.smithi087.stdout:5/226: write d3/d9/f1e [3210242,10288] 0 2024-02-28T16:01:49.921 INFO:tasks.workunit.client.1.smithi087.stdout:9/233: dwrite d7/f38 [0,4194304] 0 2024-02-28T16:01:49.923 INFO:tasks.workunit.client.1.smithi087.stdout:6/277: dread d4/dc/d10/f40 [0,4194304] 0 2024-02-28T16:01:49.928 INFO:tasks.workunit.client.1.smithi087.stdout:4/325: write d2/d9/f2c [167742,84466] 0 2024-02-28T16:01:49.933 INFO:tasks.workunit.client.1.smithi087.stdout:9/234: unlink d7/f38 0 2024-02-28T16:01:49.934 INFO:tasks.workunit.client.1.smithi087.stdout:9/235: chown d7 465658 1 2024-02-28T16:01:49.940 INFO:tasks.workunit.client.1.smithi087.stdout:8/240: dread d2/d9/f17 [0,4194304] 0 2024-02-28T16:01:49.943 INFO:tasks.workunit.client.1.smithi087.stdout:4/326: mknod d2/d9/d10/d22/c78 0 2024-02-28T16:01:49.945 INFO:tasks.workunit.client.1.smithi087.stdout:5/227: dwrite d3/d6/d30/f32 [0,4194304] 0 2024-02-28T16:01:49.948 INFO:tasks.workunit.client.1.smithi087.stdout:4/327: truncate d2/df/d2e/d4a/f58 348545 0 2024-02-28T16:01:49.949 INFO:tasks.workunit.client.1.smithi087.stdout:6/278: symlink d4/dc/d61/l65 0 2024-02-28T16:01:49.949 INFO:tasks.workunit.client.1.smithi087.stdout:8/241: mkdir d2/d9/d10/d4f 0 2024-02-28T16:01:49.949 INFO:tasks.workunit.client.1.smithi087.stdout:9/236: creat d7/dd/d36/f3d x:0 0 0 2024-02-28T16:01:49.952 INFO:tasks.workunit.client.1.smithi087.stdout:9/237: rmdir d7/d1e 39 2024-02-28T16:01:49.954 INFO:tasks.workunit.client.1.smithi087.stdout:4/328: dread d2/df/d2e/d4a/f58 [0,4194304] 0 2024-02-28T16:01:49.955 INFO:tasks.workunit.client.1.smithi087.stdout:6/279: creat d4/dc/d61/f66 x:0 0 0 2024-02-28T16:01:49.957 INFO:tasks.workunit.client.1.smithi087.stdout:4/329: read - d2/d9/d10/d22/d5b/f75 zero size 2024-02-28T16:01:49.959 INFO:tasks.workunit.client.1.smithi087.stdout:8/242: symlink d2/d9/d10/l50 0 2024-02-28T16:01:49.962 INFO:tasks.workunit.client.1.smithi087.stdout:8/243: write d2/d33/f35 [354984,43492] 0 2024-02-28T16:01:49.965 INFO:tasks.workunit.client.1.smithi087.stdout:2/219: write d2/d7/d17/f33 [35433,31065] 0 2024-02-28T16:01:49.968 INFO:tasks.workunit.client.1.smithi087.stdout:9/238: write d7/d1e/f24 [856553,48873] 0 2024-02-28T16:01:49.968 INFO:tasks.workunit.client.1.smithi087.stdout:2/220: write d2/d7/d17/f33 [670025,13176] 0 2024-02-28T16:01:49.974 INFO:tasks.workunit.client.1.smithi087.stdout:6/280: mkdir d4/d30/d13/d67 0 2024-02-28T16:01:49.977 INFO:tasks.workunit.client.0.smithi057.stdout:8/1: sync 2024-02-28T16:01:49.977 INFO:tasks.workunit.client.0.smithi057.stdout:6/2: sync 2024-02-28T16:01:49.977 INFO:tasks.workunit.client.0.smithi057.stdout:8/2: truncate - no filename 2024-02-28T16:01:49.979 INFO:tasks.workunit.client.1.smithi087.stdout:4/330: dwrite d2/d9/da/d1a/d26/f3d [0,4194304] 0 2024-02-28T16:01:49.981 INFO:tasks.workunit.client.1.smithi087.stdout:5/228: dread d3/d9/f46 [0,4194304] 0 2024-02-28T16:01:49.981 INFO:tasks.workunit.client.0.smithi057.stdout:6/3: symlink l1 0 2024-02-28T16:01:49.983 INFO:tasks.workunit.client.0.smithi057.stdout:8/3: creat f0 x:0 0 0 2024-02-28T16:01:49.983 INFO:tasks.workunit.client.1.smithi087.stdout:5/229: write d3/f43 [757412,128570] 0 2024-02-28T16:01:49.986 INFO:tasks.workunit.client.1.smithi087.stdout:6/281: rmdir d4/dc/d61 39 2024-02-28T16:01:49.986 INFO:tasks.workunit.client.0.smithi057.stdout:8/4: creat f1 x:0 0 0 2024-02-28T16:01:49.988 INFO:tasks.workunit.client.0.smithi057.stdout:8/5: fdatasync f1 0 2024-02-28T16:01:49.992 INFO:tasks.workunit.client.1.smithi087.stdout:4/331: rename d2/d9/da/c3c to d2/d9/da/d1a/d26/c79 0 2024-02-28T16:01:49.993 INFO:tasks.workunit.client.0.smithi057.stdout:8/6: symlink l2 0 2024-02-28T16:01:49.993 INFO:tasks.workunit.client.0.smithi057.stdout:8/7: dread - f0 zero size 2024-02-28T16:01:49.995 INFO:tasks.workunit.client.0.smithi057.stdout:8/8: dread - f0 zero size 2024-02-28T16:01:49.995 INFO:tasks.workunit.client.1.smithi087.stdout:9/239: truncate d7/dd/d15/d39/f1c 7875946 0 2024-02-28T16:01:49.996 INFO:tasks.workunit.client.0.smithi057.stdout:8/9: dread - f0 zero size 2024-02-28T16:01:49.996 INFO:tasks.workunit.client.1.smithi087.stdout:6/282: dread d4/d12/d45/f39 [0,4194304] 0 2024-02-28T16:01:49.996 INFO:tasks.workunit.client.0.smithi057.stdout:4/21: fsync d1/f6 0 2024-02-28T16:01:49.997 INFO:tasks.workunit.client.0.smithi057.stdout:6/4: getdents . 0 2024-02-28T16:01:49.997 INFO:tasks.workunit.client.0.smithi057.stdout:4/22: stat d1/c3 0 2024-02-28T16:01:49.998 INFO:tasks.workunit.client.1.smithi087.stdout:2/221: dwrite d2/d7/f15 [0,4194304] 0 2024-02-28T16:01:49.998 INFO:tasks.workunit.client.0.smithi057.stdout:8/10: write f1 [23555,73315] 0 2024-02-28T16:01:49.999 INFO:tasks.workunit.client.0.smithi057.stdout:8/11: stat f0 0 2024-02-28T16:01:49.999 INFO:tasks.workunit.client.1.smithi087.stdout:3/209: sync 2024-02-28T16:01:49.999 INFO:tasks.workunit.client.1.smithi087.stdout:7/206: sync 2024-02-28T16:01:49.999 INFO:tasks.workunit.client.1.smithi087.stdout:1/249: sync 2024-02-28T16:01:50.000 INFO:tasks.workunit.client.0.smithi057.stdout:8/12: chown f1 3 1 2024-02-28T16:01:50.000 INFO:tasks.workunit.client.0.smithi057.stdout:4/23: truncate d1/f6 434614 0 2024-02-28T16:01:50.002 INFO:tasks.workunit.client.1.smithi087.stdout:9/240: mknod d7/dc/c3e 0 2024-02-28T16:01:50.003 INFO:tasks.workunit.client.0.smithi057.stdout:4/24: write d1/f6 [1112156,10435] 0 2024-02-28T16:01:50.003 INFO:tasks.workunit.client.1.smithi087.stdout:3/210: chown d11/d45/f47 4 1 2024-02-28T16:01:50.004 INFO:tasks.workunit.client.0.smithi057.stdout:8/13: creat f3 x:0 0 0 2024-02-28T16:01:50.004 INFO:tasks.workunit.client.0.smithi057.stdout:8/14: fdatasync f0 0 2024-02-28T16:01:50.007 INFO:tasks.workunit.client.0.smithi057.stdout:8/15: mknod c4 0 2024-02-28T16:01:50.009 INFO:tasks.workunit.client.0.smithi057.stdout:4/25: link d1/f6 d1/f7 0 2024-02-28T16:01:50.009 INFO:tasks.workunit.client.1.smithi087.stdout:1/250: chown d0/d14/f20 40930 1 2024-02-28T16:01:50.010 INFO:tasks.workunit.client.1.smithi087.stdout:7/207: creat d14/d27/f3f x:0 0 0 2024-02-28T16:01:50.011 INFO:tasks.workunit.client.1.smithi087.stdout:6/283: rmdir d4/d30/d13/d38 39 2024-02-28T16:01:50.012 INFO:tasks.workunit.client.1.smithi087.stdout:8/244: dread d2/d9/f16 [4194304,4194304] 0 2024-02-28T16:01:50.012 INFO:tasks.workunit.client.1.smithi087.stdout:9/241: write d7/dd/d15/d39/f16 [417395,81343] 0 2024-02-28T16:01:50.012 INFO:tasks.workunit.client.1.smithi087.stdout:4/332: symlink d2/d9/d10/d22/d73/l7a 0 2024-02-28T16:01:50.012 INFO:tasks.workunit.client.1.smithi087.stdout:7/208: write d14/d27/f28 [4977405,18576] 0 2024-02-28T16:01:50.013 INFO:tasks.workunit.client.1.smithi087.stdout:2/222: creat d2/d7/d17/d34/f4c x:0 0 0 2024-02-28T16:01:50.014 INFO:tasks.workunit.client.1.smithi087.stdout:3/211: unlink d11/d3a/d48/l4c 0 2024-02-28T16:01:50.015 INFO:tasks.workunit.client.0.smithi057.stdout:4/26: truncate d1/f4 4487624 0 2024-02-28T16:01:50.016 INFO:tasks.workunit.client.1.smithi087.stdout:4/333: unlink d2/l1c 0 2024-02-28T16:01:50.018 INFO:tasks.workunit.client.1.smithi087.stdout:8/245: readlink d2/d18/d25/l11 0 2024-02-28T16:01:50.021 INFO:tasks.workunit.client.1.smithi087.stdout:4/334: fsync d2/d9/d10/d22/f72 0 2024-02-28T16:01:50.022 INFO:tasks.workunit.client.1.smithi087.stdout:8/246: truncate d2/f30 5096575 0 2024-02-28T16:01:50.022 INFO:tasks.workunit.client.1.smithi087.stdout:3/212: fdatasync ff 0 2024-02-28T16:01:50.022 INFO:tasks.workunit.client.1.smithi087.stdout:1/251: creat d0/d1b/d43/d4d/f51 x:0 0 0 2024-02-28T16:01:50.023 INFO:tasks.workunit.client.0.smithi057.stdout:6/5: dwrite f0 [0,4194304] 0 2024-02-28T16:01:50.023 INFO:tasks.workunit.client.1.smithi087.stdout:9/242: dread d7/dd/d15/d39/f16 [0,4194304] 0 2024-02-28T16:01:50.024 INFO:tasks.workunit.client.0.smithi057.stdout:8/16: getdents . 0 2024-02-28T16:01:50.026 INFO:tasks.workunit.client.0.smithi057.stdout:4/27: rmdir d1 39 2024-02-28T16:01:50.027 INFO:tasks.workunit.client.1.smithi087.stdout:4/335: fsync d2/d9/d10/d22/f27 0 2024-02-28T16:01:50.028 INFO:tasks.workunit.client.0.smithi057.stdout:6/6: creat f2 x:0 0 0 2024-02-28T16:01:50.028 INFO:tasks.workunit.client.1.smithi087.stdout:1/252: write d0/d1b/f22 [272139,75166] 0 2024-02-28T16:01:50.028 INFO:tasks.workunit.client.1.smithi087.stdout:2/223: rename d2/f3 to d2/d7/df/f4d 0 2024-02-28T16:01:50.029 INFO:tasks.workunit.client.0.smithi057.stdout:8/17: mkdir d5 0 2024-02-28T16:01:50.031 INFO:tasks.workunit.client.0.smithi057.stdout:6/7: write f2 [367712,4026] 0 2024-02-28T16:01:50.031 INFO:tasks.workunit.client.0.smithi057.stdout:8/18: truncate f0 21991 0 2024-02-28T16:01:50.032 INFO:tasks.workunit.client.0.smithi057.stdout:6/8: chown l1 22 1 2024-02-28T16:01:50.034 INFO:tasks.workunit.client.0.smithi057.stdout:4/28: rename d1/f5 to d1/f8 0 2024-02-28T16:01:50.034 INFO:tasks.workunit.client.0.smithi057.stdout:2/9: sync 2024-02-28T16:01:50.034 INFO:tasks.workunit.client.0.smithi057.stdout:3/6: sync 2024-02-28T16:01:50.036 INFO:tasks.workunit.client.0.smithi057.stdout:6/9: creat f3 x:0 0 0 2024-02-28T16:01:50.037 INFO:tasks.workunit.client.0.smithi057.stdout:8/19: mkdir d5/d6 0 2024-02-28T16:01:50.038 INFO:tasks.workunit.client.1.smithi087.stdout:8/247: dread d2/d18/f3c [0,4194304] 0 2024-02-28T16:01:50.038 INFO:tasks.workunit.client.0.smithi057.stdout:3/7: mknod c2 0 2024-02-28T16:01:50.038 INFO:tasks.workunit.client.0.smithi057.stdout:3/8: fdatasync - no filename 2024-02-28T16:01:50.039 INFO:tasks.workunit.client.0.smithi057.stdout:6/10: readlink l1 0 2024-02-28T16:01:50.041 INFO:tasks.workunit.client.1.smithi087.stdout:5/230: dwrite d3/d6/f3a [0,4194304] 0 2024-02-28T16:01:50.041 INFO:tasks.workunit.client.1.smithi087.stdout:9/243: mkdir d7/dd/d15/d3f 0 2024-02-28T16:01:50.043 INFO:tasks.workunit.client.0.smithi057.stdout:3/9: creat f3 x:0 0 0 2024-02-28T16:01:50.045 INFO:tasks.workunit.client.1.smithi087.stdout:9/244: write d7/d1e/f30 [923090,54025] 0 2024-02-28T16:01:50.045 INFO:tasks.workunit.client.0.smithi057.stdout:2/10: dread f2 [0,4194304] 0 2024-02-28T16:01:50.046 INFO:tasks.workunit.client.0.smithi057.stdout:3/10: creat f4 x:0 0 0 2024-02-28T16:01:50.047 INFO:tasks.workunit.client.0.smithi057.stdout:4/29: write d1/f6 [1417738,104366] 0 2024-02-28T16:01:50.048 INFO:tasks.workunit.client.0.smithi057.stdout:3/11: symlink l5 0 2024-02-28T16:01:50.051 INFO:tasks.workunit.client.1.smithi087.stdout:2/224: mknod d2/d42/c4e 0 2024-02-28T16:01:50.053 INFO:tasks.workunit.client.1.smithi087.stdout:2/225: chown d2/d7/df 290741 1 2024-02-28T16:01:50.056 INFO:tasks.workunit.client.0.smithi057.stdout:8/20: getdents d5 0 2024-02-28T16:01:50.057 INFO:tasks.workunit.client.1.smithi087.stdout:4/336: write d2/df/d2e/d4a/f58 [222684,90759] 0 2024-02-28T16:01:50.062 INFO:tasks.workunit.client.1.smithi087.stdout:6/284: rename d4/d30/f1d to d4/d30/d13/d38/f68 0 2024-02-28T16:01:50.063 INFO:tasks.workunit.client.1.smithi087.stdout:0/286: sync 2024-02-28T16:01:50.063 INFO:tasks.workunit.client.1.smithi087.stdout:1/253: dwrite d0/f5 [4194304,4194304] 0 2024-02-28T16:01:50.064 INFO:tasks.workunit.client.0.smithi057.stdout:8/21: link f1 d5/f7 0 2024-02-28T16:01:50.064 INFO:tasks.workunit.client.1.smithi087.stdout:5/231: creat d3/d6/d30/d3e/f49 x:0 0 0 2024-02-28T16:01:50.069 INFO:tasks.workunit.client.1.smithi087.stdout:2/226: unlink d2/d7/d17/f2c 0 2024-02-28T16:01:50.072 INFO:tasks.workunit.client.1.smithi087.stdout:8/248: dwrite d2/d9/d1a/f44 [0,4194304] 0 2024-02-28T16:01:50.075 INFO:tasks.workunit.client.1.smithi087.stdout:5/232: write d3/d6/d30/f3b [378816,4367] 0 2024-02-28T16:01:50.076 INFO:tasks.workunit.client.1.smithi087.stdout:4/337: mknod d2/df/d65/c7b 0 2024-02-28T16:01:50.077 INFO:tasks.workunit.client.1.smithi087.stdout:1/254: write d0/d1b/f3d [430941,115883] 0 2024-02-28T16:01:50.079 INFO:tasks.workunit.client.1.smithi087.stdout:6/285: mkdir d4/d30/d13/d38/d69 0 2024-02-28T16:01:50.080 INFO:tasks.workunit.client.1.smithi087.stdout:0/287: creat d4/dd/d20/d1f/d2e/d31/d58/f64 x:0 0 0 2024-02-28T16:01:50.084 INFO:tasks.workunit.client.1.smithi087.stdout:7/209: truncate d14/f2a 1681471 0 2024-02-28T16:01:50.084 INFO:tasks.workunit.client.1.smithi087.stdout:8/249: write d2/d18/d42/f43 [40494,27475] 0 2024-02-28T16:01:50.086 INFO:tasks.workunit.client.1.smithi087.stdout:5/233: dread - d3/f37 zero size 2024-02-28T16:01:50.087 INFO:tasks.workunit.client.0.smithi057.stdout:9/39: sync 2024-02-28T16:01:50.087 INFO:tasks.workunit.client.0.smithi057.stdout:5/101: sync 2024-02-28T16:01:50.087 INFO:tasks.workunit.client.0.smithi057.stdout:7/15: sync 2024-02-28T16:01:50.087 INFO:tasks.workunit.client.0.smithi057.stdout:1/84: sync 2024-02-28T16:01:50.087 INFO:tasks.workunit.client.0.smithi057.stdout:0/174: sync 2024-02-28T16:01:50.088 INFO:tasks.workunit.client.1.smithi087.stdout:4/338: write d2/df/f39 [305363,109178] 0 2024-02-28T16:01:50.089 INFO:tasks.workunit.client.1.smithi087.stdout:3/213: truncate d11/f29 1070117 0 2024-02-28T16:01:50.089 INFO:tasks.workunit.client.1.smithi087.stdout:9/245: dwrite d7/dd/f37 [0,4194304] 0 2024-02-28T16:01:50.093 INFO:tasks.workunit.client.1.smithi087.stdout:7/210: readlink d14/d2e/d2b/l35 0 2024-02-28T16:01:50.094 INFO:tasks.workunit.client.1.smithi087.stdout:6/286: write d4/d30/d13/d38/f47 [4722808,108617] 0 2024-02-28T16:01:50.095 INFO:tasks.workunit.client.1.smithi087.stdout:1/255: write d0/d1b/d43/d4d/f51 [232242,38549] 0 2024-02-28T16:01:50.098 INFO:tasks.workunit.client.1.smithi087.stdout:1/256: chown d0/d1b 25 1 2024-02-28T16:01:50.099 INFO:tasks.workunit.client.1.smithi087.stdout:4/339: creat d2/f7c x:0 0 0 2024-02-28T16:01:50.102 INFO:tasks.workunit.client.1.smithi087.stdout:4/340: dread - d2/d9/d10/d22/d5b/f75 zero size 2024-02-28T16:01:50.103 INFO:tasks.workunit.client.1.smithi087.stdout:8/250: mknod d2/d9/d10/c51 0 2024-02-28T16:01:50.106 INFO:tasks.workunit.client.1.smithi087.stdout:3/214: rename d11/l25 to d11/d3a/l51 0 2024-02-28T16:01:50.106 INFO:tasks.workunit.client.1.smithi087.stdout:8/251: read - d2/d33/f3e zero size 2024-02-28T16:01:50.107 INFO:tasks.workunit.client.1.smithi087.stdout:3/215: fdatasync d11/f2b 0 2024-02-28T16:01:50.113 INFO:tasks.workunit.client.1.smithi087.stdout:1/257: symlink d0/d1b/d43/d4d/l52 0 2024-02-28T16:01:50.113 INFO:tasks.workunit.client.1.smithi087.stdout:6/287: dread - d4/dc/d61/f63 zero size 2024-02-28T16:01:50.115 INFO:tasks.workunit.client.1.smithi087.stdout:5/234: dread d3/d9/fd [0,4194304] 0 2024-02-28T16:01:50.117 INFO:tasks.workunit.client.1.smithi087.stdout:3/216: fdatasync d11/f15 0 2024-02-28T16:01:50.118 INFO:tasks.workunit.client.1.smithi087.stdout:1/258: readlink d0/d1b/d43/d4d/l52 0 2024-02-28T16:01:50.121 INFO:tasks.workunit.client.1.smithi087.stdout:4/341: creat d2/d9/d10/d22/d5b/d5c/f7d x:0 0 0 2024-02-28T16:01:50.124 INFO:tasks.workunit.client.1.smithi087.stdout:0/288: link d4/dd/l4a d4/dd/d37/d39/l65 0 2024-02-28T16:01:50.124 INFO:tasks.workunit.client.1.smithi087.stdout:1/259: read - d0/d1b/d43/f4b zero size 2024-02-28T16:01:50.124 INFO:tasks.workunit.client.1.smithi087.stdout:7/211: creat d14/f40 x:0 0 0 2024-02-28T16:01:50.127 INFO:tasks.workunit.client.1.smithi087.stdout:6/288: truncate d4/dc/d10/f19 1136143 0 2024-02-28T16:01:50.128 INFO:tasks.workunit.client.1.smithi087.stdout:1/260: stat d0/c9 0 2024-02-28T16:01:50.130 INFO:tasks.workunit.client.1.smithi087.stdout:0/289: write d4/dd/d37/d39/d3a/f46 [952743,19674] 0 2024-02-28T16:01:50.132 INFO:tasks.workunit.client.1.smithi087.stdout:2/227: dread d2/d7/df/f4d [0,4194304] 0 2024-02-28T16:01:50.133 INFO:tasks.workunit.client.1.smithi087.stdout:9/246: dwrite d7/f12 [0,4194304] 0 2024-02-28T16:01:50.135 INFO:tasks.workunit.client.1.smithi087.stdout:6/289: truncate d4/fa 3267613 0 2024-02-28T16:01:50.136 INFO:tasks.workunit.client.1.smithi087.stdout:4/342: creat d2/d9/f7e x:0 0 0 2024-02-28T16:01:50.137 INFO:tasks.workunit.client.1.smithi087.stdout:8/252: dread d2/d9/f19 [0,4194304] 0 2024-02-28T16:01:50.139 INFO:tasks.workunit.client.1.smithi087.stdout:0/290: write d4/dd/d37/d39/f5a [371120,39664] 0 2024-02-28T16:01:50.142 INFO:tasks.workunit.client.1.smithi087.stdout:7/212: truncate d14/d27/f3c 117623 0 2024-02-28T16:01:50.144 INFO:tasks.workunit.client.1.smithi087.stdout:9/247: symlink d7/dd/l40 0 2024-02-28T16:01:50.146 INFO:tasks.workunit.client.1.smithi087.stdout:7/213: readlink d14/d2e/d2b/l35 0 2024-02-28T16:01:50.147 INFO:tasks.workunit.client.1.smithi087.stdout:5/235: dread d3/d9/fd [0,4194304] 0 2024-02-28T16:01:50.150 INFO:tasks.workunit.client.1.smithi087.stdout:6/290: creat d4/d12/d45/d57/f6a x:0 0 0 2024-02-28T16:01:50.152 INFO:tasks.workunit.client.1.smithi087.stdout:6/291: readlink d4/d12/d45/l34 0 2024-02-28T16:01:50.155 INFO:tasks.workunit.client.1.smithi087.stdout:4/343: unlink d2/d49/c53 0 2024-02-28T16:01:50.155 INFO:tasks.workunit.client.1.smithi087.stdout:8/253: rename d2/d18/d25/l13 to d2/d9/d1a/l52 0 2024-02-28T16:01:50.156 INFO:tasks.workunit.client.0.smithi057.stdout:8/22: stat f1 0 2024-02-28T16:01:50.156 INFO:tasks.workunit.client.1.smithi087.stdout:0/291: mknod d4/dd/d21/c66 0 2024-02-28T16:01:50.158 INFO:tasks.workunit.client.0.smithi057.stdout:2/11: truncate f2 111185 0 2024-02-28T16:01:50.159 INFO:tasks.workunit.client.1.smithi087.stdout:1/261: getdents d0/d1d/d24 0 2024-02-28T16:01:50.159 INFO:tasks.workunit.client.1.smithi087.stdout:3/217: dread d11/f17 [0,4194304] 0 2024-02-28T16:01:50.161 INFO:tasks.workunit.client.1.smithi087.stdout:6/292: rmdir d4/dc/d61 39 2024-02-28T16:01:50.163 INFO:tasks.workunit.client.1.smithi087.stdout:7/214: rename d14/d2e/d2b/f33 to d14/d21/f41 0 2024-02-28T16:01:50.163 INFO:tasks.workunit.client.0.smithi057.stdout:9/40: write f0 [4375059,102105] 0 2024-02-28T16:01:50.165 INFO:tasks.workunit.client.0.smithi057.stdout:5/102: write d2/f22 [201601,89354] 0 2024-02-28T16:01:50.167 INFO:tasks.workunit.client.0.smithi057.stdout:1/85: mknod d1/d3/c1c 0 2024-02-28T16:01:50.168 INFO:tasks.workunit.client.1.smithi087.stdout:1/262: write d0/d1b/f47 [677521,70079] 0 2024-02-28T16:01:50.168 INFO:tasks.workunit.client.1.smithi087.stdout:0/292: dread - d4/dd/d20/d1f/d2e/d31/d58/f64 zero size 2024-02-28T16:01:50.168 INFO:tasks.workunit.client.0.smithi057.stdout:8/23: symlink d5/l8 0 2024-02-28T16:01:50.169 INFO:tasks.workunit.client.1.smithi087.stdout:8/254: mkdir d2/d9/d10/d24/d53 0 2024-02-28T16:01:50.171 INFO:tasks.workunit.client.1.smithi087.stdout:4/344: mknod d2/d9/d10/c7f 0 2024-02-28T16:01:50.171 INFO:tasks.workunit.client.1.smithi087.stdout:6/293: write d4/d12/f16 [131384,28659] 0 2024-02-28T16:01:50.172 INFO:tasks.workunit.client.1.smithi087.stdout:2/228: dwrite d2/d7/d17/f33 [0,4194304] 0 2024-02-28T16:01:50.172 INFO:tasks.workunit.client.1.smithi087.stdout:7/215: creat d14/d21/f42 x:0 0 0 2024-02-28T16:01:50.174 INFO:tasks.workunit.client.1.smithi087.stdout:9/248: dwrite d7/d1e/f24 [0,4194304] 0 2024-02-28T16:01:50.175 INFO:tasks.workunit.client.0.smithi057.stdout:7/16: getdents . 0 2024-02-28T16:01:50.176 INFO:tasks.workunit.client.0.smithi057.stdout:2/12: chown f2 4046544 1 2024-02-28T16:01:50.177 INFO:tasks.workunit.client.0.smithi057.stdout:9/41: symlink d2/d5/l11 0 2024-02-28T16:01:50.181 INFO:tasks.workunit.client.0.smithi057.stdout:3/12: dwrite f3 [0,4194304] 0 2024-02-28T16:01:50.182 INFO:tasks.workunit.client.1.smithi087.stdout:8/255: symlink d2/d18/d36/l54 0 2024-02-28T16:01:50.183 INFO:tasks.workunit.client.0.smithi057.stdout:4/30: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:01:50.185 INFO:tasks.workunit.client.1.smithi087.stdout:1/263: read d0/fa [166649,127007] 0 2024-02-28T16:01:50.186 INFO:tasks.workunit.client.0.smithi057.stdout:9/42: write d2/d6/f10 [380696,109927] 0 2024-02-28T16:01:50.188 INFO:tasks.workunit.client.1.smithi087.stdout:1/264: stat d0/c9 0 2024-02-28T16:01:50.190 INFO:tasks.workunit.client.1.smithi087.stdout:8/256: read d2/d9/d1a/f45 [4167627,130424] 0 2024-02-28T16:01:50.192 INFO:tasks.workunit.client.0.smithi057.stdout:7/17: mkdir d6 0 2024-02-28T16:01:50.193 INFO:tasks.workunit.client.0.smithi057.stdout:7/18: chown c2 964711 1 2024-02-28T16:01:50.193 INFO:tasks.workunit.client.1.smithi087.stdout:3/218: read d11/f29 [659275,13702] 0 2024-02-28T16:01:50.195 INFO:tasks.workunit.client.1.smithi087.stdout:8/257: write d2/f37 [846663,126905] 0 2024-02-28T16:01:50.196 INFO:tasks.workunit.client.0.smithi057.stdout:7/19: truncate f4 17055 0 2024-02-28T16:01:50.198 INFO:tasks.workunit.client.1.smithi087.stdout:9/249: dread d7/f32 [0,4194304] 0 2024-02-28T16:01:50.199 INFO:tasks.workunit.client.0.smithi057.stdout:7/20: chown d6 4 1 2024-02-28T16:01:50.199 INFO:tasks.workunit.client.0.smithi057.stdout:0/175: getdents d6 0 2024-02-28T16:01:50.200 INFO:tasks.workunit.client.1.smithi087.stdout:5/236: dwrite d3/d6/f26 [0,4194304] 0 2024-02-28T16:01:50.204 INFO:tasks.workunit.client.0.smithi057.stdout:8/24: creat d5/d6/f9 x:0 0 0 2024-02-28T16:01:50.204 INFO:tasks.workunit.client.0.smithi057.stdout:1/86: rename d1/c6 to d1/d3/dc/d15/c1d 0 2024-02-28T16:01:50.205 INFO:tasks.workunit.client.1.smithi087.stdout:1/265: mknod d0/d14/c53 0 2024-02-28T16:01:50.206 INFO:tasks.workunit.client.0.smithi057.stdout:4/31: symlink d1/l9 0 2024-02-28T16:01:50.207 INFO:tasks.workunit.client.1.smithi087.stdout:0/293: dwrite d4/d6/f12 [4194304,4194304] 0 2024-02-28T16:01:50.209 INFO:tasks.workunit.client.1.smithi087.stdout:3/219: creat d11/d3a/d48/f52 x:0 0 0 2024-02-28T16:01:50.209 INFO:tasks.workunit.client.0.smithi057.stdout:1/87: chown d1/f19 531229 1 2024-02-28T16:01:50.210 INFO:tasks.workunit.client.0.smithi057.stdout:2/13: rename c1 to c4 0 2024-02-28T16:01:50.212 INFO:tasks.workunit.client.0.smithi057.stdout:3/13: dread f3 [0,4194304] 0 2024-02-28T16:01:50.213 INFO:tasks.workunit.client.1.smithi087.stdout:8/258: write d2/d9/d10/d24/f34 [682753,112333] 0 2024-02-28T16:01:50.214 INFO:tasks.workunit.client.1.smithi087.stdout:6/294: link d4/d12/d45/f28 d4/d30/f6b 0 2024-02-28T16:01:50.214 INFO:tasks.workunit.client.1.smithi087.stdout:5/237: mkdir d3/d9/d4a 0 2024-02-28T16:01:50.214 INFO:tasks.workunit.client.0.smithi057.stdout:4/32: rmdir d1 39 2024-02-28T16:01:50.216 INFO:tasks.workunit.client.0.smithi057.stdout:4/33: readlink l0 0 2024-02-28T16:01:50.218 INFO:tasks.workunit.client.1.smithi087.stdout:1/266: rename d0/d1d/f49 to d0/d14/f54 0 2024-02-28T16:01:50.219 INFO:tasks.workunit.client.1.smithi087.stdout:6/295: stat d4/d30/d13/c1a 0 2024-02-28T16:01:50.220 INFO:tasks.workunit.client.0.smithi057.stdout:7/21: mknod d6/c7 0 2024-02-28T16:01:50.220 INFO:tasks.workunit.client.0.smithi057.stdout:8/25: creat d5/d6/fa x:0 0 0 2024-02-28T16:01:50.220 INFO:tasks.workunit.client.0.smithi057.stdout:3/14: mknod c6 0 2024-02-28T16:01:50.221 INFO:tasks.workunit.client.0.smithi057.stdout:2/14: symlink l5 0 2024-02-28T16:01:50.221 INFO:tasks.workunit.client.1.smithi087.stdout:3/220: symlink d11/l53 0 2024-02-28T16:01:50.223 INFO:tasks.workunit.client.1.smithi087.stdout:0/294: fdatasync d4/dd/d20/d1f/d2e/d31/d58/f64 0 2024-02-28T16:01:50.223 INFO:tasks.workunit.client.1.smithi087.stdout:4/345: dwrite d2/d9/de/f6d [4194304,4194304] 0 2024-02-28T16:01:50.224 INFO:tasks.workunit.client.0.smithi057.stdout:3/15: chown l1 1254672186 1 2024-02-28T16:01:50.225 INFO:tasks.workunit.client.1.smithi087.stdout:3/221: chown d11/f17 6397 1 2024-02-28T16:01:50.226 INFO:tasks.workunit.client.0.smithi057.stdout:7/22: truncate f4 864433 0 2024-02-28T16:01:50.226 INFO:tasks.workunit.client.0.smithi057.stdout:3/16: readlink l1 0 2024-02-28T16:01:50.226 INFO:tasks.workunit.client.0.smithi057.stdout:8/26: write d5/d6/fa [272209,22938] 0 2024-02-28T16:01:50.227 INFO:tasks.workunit.client.0.smithi057.stdout:8/27: chown d5 11178972 1 2024-02-28T16:01:50.227 INFO:tasks.workunit.client.0.smithi057.stdout:0/176: mkdir d6/d12/d38/d39 0 2024-02-28T16:01:50.229 INFO:tasks.workunit.client.1.smithi087.stdout:0/295: write d4/f8 [762564,116853] 0 2024-02-28T16:01:50.229 INFO:tasks.workunit.client.1.smithi087.stdout:4/346: stat d2/f4 0 2024-02-28T16:01:50.229 INFO:tasks.workunit.client.0.smithi057.stdout:9/43: dwrite f0 [0,4194304] 0 2024-02-28T16:01:50.232 INFO:tasks.workunit.client.1.smithi087.stdout:1/267: symlink d0/d1a/l55 0 2024-02-28T16:01:50.233 INFO:tasks.workunit.client.1.smithi087.stdout:5/238: link d3/d9/f1e d3/d6/d30/d3e/f4b 0 2024-02-28T16:01:50.234 INFO:tasks.workunit.client.1.smithi087.stdout:3/222: mkdir d11/d3a/d48/d54 0 2024-02-28T16:01:50.235 INFO:tasks.workunit.client.0.smithi057.stdout:4/34: write d1/f6 [1229213,16043] 0 2024-02-28T16:01:50.235 INFO:tasks.workunit.client.0.smithi057.stdout:3/17: creat f7 x:0 0 0 2024-02-28T16:01:50.236 INFO:tasks.workunit.client.1.smithi087.stdout:9/250: dread d7/f12 [0,4194304] 0 2024-02-28T16:01:50.237 INFO:tasks.workunit.client.0.smithi057.stdout:3/18: fdatasync f4 0 2024-02-28T16:01:50.238 INFO:tasks.workunit.client.0.smithi057.stdout:8/28: mknod d5/cb 0 2024-02-28T16:01:50.238 INFO:tasks.workunit.client.1.smithi087.stdout:1/268: mknod d0/d1a/c56 0 2024-02-28T16:01:50.239 INFO:tasks.workunit.client.0.smithi057.stdout:7/23: creat d6/f8 x:0 0 0 2024-02-28T16:01:50.240 INFO:tasks.workunit.client.1.smithi087.stdout:9/251: dread d7/dd/d15/d39/f16 [0,4194304] 0 2024-02-28T16:01:50.241 INFO:tasks.workunit.client.0.smithi057.stdout:1/88: rename d1/d3/l4 to d1/d3/dc/d15/l1e 0 2024-02-28T16:01:50.241 INFO:tasks.workunit.client.1.smithi087.stdout:1/269: write d0/f5 [6051615,107060] 0 2024-02-28T16:01:50.242 INFO:tasks.workunit.client.0.smithi057.stdout:7/24: write d6/f8 [752986,71549] 0 2024-02-28T16:01:50.246 INFO:tasks.workunit.client.1.smithi087.stdout:4/347: unlink d2/d9/da/d1a/d26/c79 0 2024-02-28T16:01:50.252 INFO:tasks.workunit.client.1.smithi087.stdout:5/239: mknod d3/d6/d30/d44/c4c 0 2024-02-28T16:01:50.254 INFO:tasks.workunit.client.0.smithi057.stdout:4/35: mknod d1/ca 0 2024-02-28T16:01:50.256 INFO:tasks.workunit.client.0.smithi057.stdout:3/19: mkdir d8 0 2024-02-28T16:01:50.258 INFO:tasks.workunit.client.0.smithi057.stdout:0/177: mknod d6/d12/c3a 0 2024-02-28T16:01:50.258 INFO:tasks.workunit.client.0.smithi057.stdout:8/29: mknod d5/d6/cc 0 2024-02-28T16:01:50.258 INFO:tasks.workunit.client.1.smithi087.stdout:6/296: getdents d4/d12/d45/d57 0 2024-02-28T16:01:50.258 INFO:tasks.workunit.client.0.smithi057.stdout:1/89: creat d1/d3/dc/f1f x:0 0 0 2024-02-28T16:01:50.259 INFO:tasks.workunit.client.1.smithi087.stdout:9/252: creat d7/dd/d3c/f41 x:0 0 0 2024-02-28T16:01:50.260 INFO:tasks.workunit.client.1.smithi087.stdout:5/240: mknod d3/d6/d30/d36/c4d 0 2024-02-28T16:01:50.261 INFO:tasks.workunit.client.0.smithi057.stdout:7/25: symlink d6/l9 0 2024-02-28T16:01:50.261 INFO:tasks.workunit.client.1.smithi087.stdout:6/297: chown d4/f26 62128 1 2024-02-28T16:01:50.262 INFO:tasks.workunit.client.0.smithi057.stdout:0/178: fdatasync d6/f19 0 2024-02-28T16:01:50.263 INFO:tasks.workunit.client.1.smithi087.stdout:5/241: stat d3/d6/d30/d3e/c3f 0 2024-02-28T16:01:50.263 INFO:tasks.workunit.client.1.smithi087.stdout:1/270: rename d0/d1d/d24/l3c to d0/d1d/l57 0 2024-02-28T16:01:50.265 INFO:tasks.workunit.client.0.smithi057.stdout:4/36: unlink d1/c3 0 2024-02-28T16:01:50.265 INFO:tasks.workunit.client.1.smithi087.stdout:5/242: write d3/d6/f3a [2535209,82340] 0 2024-02-28T16:01:50.267 INFO:tasks.workunit.client.0.smithi057.stdout:1/90: unlink d1/d3/dc/f1f 0 2024-02-28T16:01:50.267 INFO:tasks.workunit.client.0.smithi057.stdout:8/30: truncate d5/d6/fa 1126041 0 2024-02-28T16:01:50.267 INFO:tasks.workunit.client.1.smithi087.stdout:4/348: getdents d2/df/d65 0 2024-02-28T16:01:50.269 INFO:tasks.workunit.client.0.smithi057.stdout:7/26: mknod d6/ca 0 2024-02-28T16:01:50.271 INFO:tasks.workunit.client.1.smithi087.stdout:6/298: read d4/d12/f21 [26739,58845] 0 2024-02-28T16:01:50.271 INFO:tasks.workunit.client.0.smithi057.stdout:3/20: mknod d8/c9 0 2024-02-28T16:01:50.272 INFO:tasks.workunit.client.0.smithi057.stdout:4/37: symlink d1/lb 0 2024-02-28T16:01:50.273 INFO:tasks.workunit.client.0.smithi057.stdout:8/31: write d5/d6/f9 [206605,89423] 0 2024-02-28T16:01:50.273 INFO:tasks.workunit.client.0.smithi057.stdout:5/103: dwrite d2/d8/f16 [0,4194304] 0 2024-02-28T16:01:50.274 INFO:tasks.workunit.client.0.smithi057.stdout:0/179: rename d6/f2a to d6/d12/d17/f3b 0 2024-02-28T16:01:50.274 INFO:tasks.workunit.client.1.smithi087.stdout:5/243: creat d3/d6/d30/d36/f4e x:0 0 0 2024-02-28T16:01:50.275 INFO:tasks.workunit.client.0.smithi057.stdout:7/27: rename d6/f8 to d6/fb 0 2024-02-28T16:01:50.275 INFO:tasks.workunit.client.1.smithi087.stdout:6/299: dread - d4/dc/d61/f66 zero size 2024-02-28T16:01:50.277 INFO:tasks.workunit.client.1.smithi087.stdout:1/271: dread d0/ff [0,4194304] 0 2024-02-28T16:01:50.278 INFO:tasks.workunit.client.1.smithi087.stdout:5/244: read d3/d6/f2f [744281,42245] 0 2024-02-28T16:01:50.279 INFO:tasks.workunit.client.1.smithi087.stdout:6/300: stat d4/d30/d13/d38/f4e 0 2024-02-28T16:01:50.280 INFO:tasks.workunit.client.0.smithi057.stdout:1/91: symlink d1/d3/dc/d15/l20 0 2024-02-28T16:01:50.283 INFO:tasks.workunit.client.1.smithi087.stdout:8/259: dread d2/d18/f22 [0,4194304] 0 2024-02-28T16:01:50.283 INFO:tasks.workunit.client.0.smithi057.stdout:8/32: write f0 [252200,51323] 0 2024-02-28T16:01:50.284 INFO:tasks.workunit.client.1.smithi087.stdout:6/301: write d4/dc/f17 [361759,47825] 0 2024-02-28T16:01:50.286 INFO:tasks.workunit.client.0.smithi057.stdout:6/11: sync 2024-02-28T16:01:50.287 INFO:tasks.workunit.client.0.smithi057.stdout:4/38: write d1/f8 [3982186,61389] 0 2024-02-28T16:01:50.289 INFO:tasks.workunit.client.0.smithi057.stdout:7/28: mkdir d6/dc 0 2024-02-28T16:01:50.291 INFO:tasks.workunit.client.1.smithi087.stdout:1/272: readlink d0/d1a/l35 0 2024-02-28T16:01:50.292 INFO:tasks.workunit.client.0.smithi057.stdout:5/104: symlink d2/l2a 0 2024-02-28T16:01:50.293 INFO:tasks.workunit.client.1.smithi087.stdout:9/253: dread d7/dd/f20 [0,4194304] 0 2024-02-28T16:01:50.295 INFO:tasks.workunit.client.0.smithi057.stdout:6/12: symlink l4 0 2024-02-28T16:01:50.296 INFO:tasks.workunit.client.1.smithi087.stdout:5/245: write d3/d9/f1e [2606345,47251] 0 2024-02-28T16:01:50.298 INFO:tasks.workunit.client.0.smithi057.stdout:4/39: creat d1/fc x:0 0 0 2024-02-28T16:01:50.298 INFO:tasks.workunit.client.1.smithi087.stdout:5/246: readlink d3/d9/l17 0 2024-02-28T16:01:50.298 INFO:tasks.workunit.client.0.smithi057.stdout:8/33: creat d5/d6/fd x:0 0 0 2024-02-28T16:01:50.299 INFO:tasks.workunit.client.1.smithi087.stdout:9/254: readlink d7/l27 0 2024-02-28T16:01:50.299 INFO:tasks.workunit.client.0.smithi057.stdout:6/13: chown f0 40956366 1 2024-02-28T16:01:50.300 INFO:tasks.workunit.client.0.smithi057.stdout:5/105: truncate d2/d8/f16 5026310 0 2024-02-28T16:01:50.300 INFO:tasks.workunit.client.1.smithi087.stdout:9/255: chown d7/dd 34427 1 2024-02-28T16:01:50.302 INFO:tasks.workunit.client.1.smithi087.stdout:4/349: dread d2/d9/da/d1a/d26/f3d [0,4194304] 0 2024-02-28T16:01:50.304 INFO:tasks.workunit.client.0.smithi057.stdout:8/34: chown d5/d6/fd 610502 1 2024-02-28T16:01:50.305 INFO:tasks.workunit.client.0.smithi057.stdout:3/21: dread f3 [0,4194304] 0 2024-02-28T16:01:50.306 INFO:tasks.workunit.client.1.smithi087.stdout:4/350: read - d2/f7c zero size 2024-02-28T16:01:50.308 INFO:tasks.workunit.client.0.smithi057.stdout:5/106: symlink d2/d19/d1c/l2b 0 2024-02-28T16:01:50.309 INFO:tasks.workunit.client.0.smithi057.stdout:2/15: dread f2 [0,4194304] 0 2024-02-28T16:01:50.310 INFO:tasks.workunit.client.1.smithi087.stdout:5/247: mkdir d3/d6/d30/d36/d4f 0 2024-02-28T16:01:50.310 INFO:tasks.workunit.client.0.smithi057.stdout:4/40: rename d1/l9 to d1/ld 0 2024-02-28T16:01:50.312 INFO:tasks.workunit.client.0.smithi057.stdout:4/41: fsync d1/f6 0 2024-02-28T16:01:50.313 INFO:tasks.workunit.client.1.smithi087.stdout:9/256: creat d7/dd/f42 x:0 0 0 2024-02-28T16:01:50.313 INFO:tasks.workunit.client.1.smithi087.stdout:5/248: chown d3 223 1 2024-02-28T16:01:50.313 INFO:tasks.workunit.client.0.smithi057.stdout:8/35: mkdir d5/de 0 2024-02-28T16:01:50.314 INFO:tasks.workunit.client.0.smithi057.stdout:8/36: readlink l2 0 2024-02-28T16:01:50.314 INFO:tasks.workunit.client.0.smithi057.stdout:4/42: fdatasync d1/f6 0 2024-02-28T16:01:50.316 INFO:tasks.workunit.client.1.smithi087.stdout:6/302: dwrite d4/dc/d61/f66 [0,4194304] 0 2024-02-28T16:01:50.317 INFO:tasks.workunit.client.1.smithi087.stdout:4/351: rename d2/d9/d10/d11/c17 to d2/df/d62/c80 0 2024-02-28T16:01:50.317 INFO:tasks.workunit.client.0.smithi057.stdout:3/22: creat d8/fa x:0 0 0 2024-02-28T16:01:50.317 INFO:tasks.workunit.client.0.smithi057.stdout:7/29: creat d6/dc/fd x:0 0 0 2024-02-28T16:01:50.324 INFO:tasks.workunit.client.1.smithi087.stdout:1/273: dwrite d0/fd [0,4194304] 0 2024-02-28T16:01:50.327 INFO:tasks.workunit.client.1.smithi087.stdout:1/274: stat d0/d1b/d1f/c4f 0 2024-02-28T16:01:50.328 INFO:tasks.workunit.client.0.smithi057.stdout:3/23: unlink d8/c9 0 2024-02-28T16:01:50.331 INFO:tasks.workunit.client.0.smithi057.stdout:7/30: symlink d6/dc/le 0 2024-02-28T16:01:50.333 INFO:tasks.workunit.client.1.smithi087.stdout:6/303: mknod d4/dc/c6c 0 2024-02-28T16:01:50.334 INFO:tasks.workunit.client.0.smithi057.stdout:2/16: rename c4 to c6 0 2024-02-28T16:01:50.337 INFO:tasks.workunit.client.1.smithi087.stdout:1/275: read d0/d14/f18 [187650,66542] 0 2024-02-28T16:01:50.338 INFO:tasks.workunit.client.0.smithi057.stdout:2/17: chown f2 14 1 2024-02-28T16:01:50.338 INFO:tasks.workunit.client.1.smithi087.stdout:3/223: dwrite fa [4194304,4194304] 0 2024-02-28T16:01:50.340 INFO:tasks.workunit.client.0.smithi057.stdout:5/107: link d2/d15/f17 d2/d19/d1c/f2c 0 2024-02-28T16:01:50.344 INFO:tasks.workunit.client.0.smithi057.stdout:9/44: dwrite d2/d5/f8 [0,4194304] 0 2024-02-28T16:01:50.349 INFO:tasks.workunit.client.1.smithi087.stdout:9/257: dwrite d7/dd/d15/d39/f2f [0,4194304] 0 2024-02-28T16:01:50.350 INFO:tasks.workunit.client.1.smithi087.stdout:1/276: creat d0/d1d/d24/f58 x:0 0 0 2024-02-28T16:01:50.352 INFO:tasks.workunit.client.1.smithi087.stdout:9/258: write d7/f12 [4962037,99143] 0 2024-02-28T16:01:50.352 INFO:tasks.workunit.client.0.smithi057.stdout:9/45: fsync d2/d6/ff 0 2024-02-28T16:01:50.352 INFO:tasks.workunit.client.0.smithi057.stdout:4/43: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:01:50.353 INFO:tasks.workunit.client.1.smithi087.stdout:1/277: creat d0/d1a/d28/f59 x:0 0 0 2024-02-28T16:01:50.356 INFO:tasks.workunit.client.1.smithi087.stdout:1/278: mknod d0/d1a/d28/c5a 0 2024-02-28T16:01:50.356 INFO:tasks.workunit.client.1.smithi087.stdout:9/259: creat d7/dd/d3c/f43 x:0 0 0 2024-02-28T16:01:50.360 INFO:tasks.workunit.client.1.smithi087.stdout:8/260: dread d2/f8 [0,4194304] 0 2024-02-28T16:01:50.365 INFO:tasks.workunit.client.0.smithi057.stdout:4/44: read - d1/fc zero size 2024-02-28T16:01:50.368 INFO:tasks.workunit.client.1.smithi087.stdout:8/261: rmdir d2/d9/d1a 39 2024-02-28T16:01:50.373 INFO:tasks.workunit.client.1.smithi087.stdout:1/279: dread d0/d1a/d28/f3b [0,4194304] 0 2024-02-28T16:01:50.374 INFO:tasks.workunit.client.0.smithi057.stdout:4/45: creat d1/fe x:0 0 0 2024-02-28T16:01:50.377 INFO:tasks.workunit.client.0.smithi057.stdout:4/46: readlink l0 0 2024-02-28T16:01:50.379 INFO:tasks.workunit.client.0.smithi057.stdout:8/37: write f1 [554534,75199] 0 2024-02-28T16:01:50.380 INFO:tasks.workunit.client.1.smithi087.stdout:6/304: write d4/d30/f6b [2803103,2530] 0 2024-02-28T16:01:50.380 INFO:tasks.workunit.client.1.smithi087.stdout:4/352: truncate d2/d49/f51 3495785 0 2024-02-28T16:01:50.381 INFO:tasks.workunit.client.0.smithi057.stdout:7/31: rmdir d6/dc 39 2024-02-28T16:01:50.383 INFO:tasks.workunit.client.0.smithi057.stdout:3/24: rmdir d8 39 2024-02-28T16:01:50.387 INFO:tasks.workunit.client.0.smithi057.stdout:0/180: truncate d6/d12/d17/d25/f33 260251 0 2024-02-28T16:01:50.389 INFO:tasks.workunit.client.1.smithi087.stdout:6/305: creat d4/d12/f6d x:0 0 0 2024-02-28T16:01:50.390 INFO:tasks.workunit.client.1.smithi087.stdout:9/260: dwrite d7/dd/d15/d39/f16 [0,4194304] 0 2024-02-28T16:01:50.395 INFO:tasks.workunit.client.0.smithi057.stdout:4/47: creat d1/ff x:0 0 0 2024-02-28T16:01:50.395 INFO:tasks.workunit.client.0.smithi057.stdout:3/25: write f7 [890956,67557] 0 2024-02-28T16:01:50.395 INFO:tasks.workunit.client.0.smithi057.stdout:1/92: dwrite d1/d3/dc/d15/f16 [0,4194304] 0 2024-02-28T16:01:50.396 INFO:tasks.workunit.client.1.smithi087.stdout:8/262: dwrite d2/d33/f35 [0,4194304] 0 2024-02-28T16:01:50.398 INFO:tasks.workunit.client.1.smithi087.stdout:5/249: dread d3/d9/f2a [0,4194304] 0 2024-02-28T16:01:50.398 INFO:tasks.workunit.client.1.smithi087.stdout:6/306: truncate d4/d30/f24 1686900 0 2024-02-28T16:01:50.398 INFO:tasks.workunit.client.1.smithi087.stdout:8/263: chown d2/d18/d25/l11 15657 1 2024-02-28T16:01:50.402 INFO:tasks.workunit.client.0.smithi057.stdout:7/32: chown d6/ca 7551 1 2024-02-28T16:01:50.404 INFO:tasks.workunit.client.1.smithi087.stdout:8/264: truncate d2/d9/d10/d24/f34 1084028 0 2024-02-28T16:01:50.405 INFO:tasks.workunit.client.0.smithi057.stdout:4/48: chown d1 16 1 2024-02-28T16:01:50.406 INFO:tasks.workunit.client.0.smithi057.stdout:5/108: dwrite d2/f22 [0,4194304] 0 2024-02-28T16:01:50.407 INFO:tasks.workunit.client.1.smithi087.stdout:8/265: symlink d2/d18/l55 0 2024-02-28T16:01:50.410 INFO:tasks.workunit.client.0.smithi057.stdout:9/46: dread d2/d5/f8 [0,4194304] 0 2024-02-28T16:01:50.413 INFO:tasks.workunit.client.1.smithi087.stdout:8/266: rename d2/d9/d10/f2b to d2/d18/f56 0 2024-02-28T16:01:50.414 INFO:tasks.workunit.client.1.smithi087.stdout:5/250: dread d3/d9/f1e [0,4194304] 0 2024-02-28T16:01:50.419 INFO:tasks.workunit.client.0.smithi057.stdout:4/49: mkdir d1/d10 0 2024-02-28T16:01:50.422 INFO:tasks.workunit.client.1.smithi087.stdout:6/307: dwrite d4/fa [0,4194304] 0 2024-02-28T16:01:50.423 INFO:tasks.workunit.client.0.smithi057.stdout:1/93: write d1/d3/f11 [3971060,124004] 0 2024-02-28T16:01:50.428 INFO:tasks.workunit.client.1.smithi087.stdout:8/267: write d2/d9/d1a/f45 [853965,38033] 0 2024-02-28T16:01:50.432 INFO:tasks.workunit.client.0.smithi057.stdout:3/26: creat d8/fb x:0 0 0 2024-02-28T16:01:50.434 INFO:tasks.workunit.client.1.smithi087.stdout:6/308: creat d4/dc/d10/f6e x:0 0 0 2024-02-28T16:01:50.437 INFO:tasks.workunit.client.1.smithi087.stdout:4/353: write d2/d9/da/d1a/d26/f29 [846187,14214] 0 2024-02-28T16:01:50.437 INFO:tasks.workunit.client.1.smithi087.stdout:8/268: write d2/d18/d25/f21 [4865553,38440] 0 2024-02-28T16:01:50.438 INFO:tasks.workunit.client.1.smithi087.stdout:9/261: dwrite d7/dd/d15/d39/f2f [0,4194304] 0 2024-02-28T16:01:50.438 INFO:tasks.workunit.client.1.smithi087.stdout:5/251: getdents d3/d6/d30/d44 0 2024-02-28T16:01:50.442 INFO:tasks.workunit.client.1.smithi087.stdout:1/280: dwrite d0/d14/f54 [0,4194304] 0 2024-02-28T16:01:50.443 INFO:tasks.workunit.client.0.smithi057.stdout:1/94: unlink d1/l13 0 2024-02-28T16:01:50.446 INFO:tasks.workunit.client.1.smithi087.stdout:4/354: dread d2/f32 [0,4194304] 0 2024-02-28T16:01:50.448 INFO:tasks.workunit.client.0.smithi057.stdout:7/33: creat d6/ff x:0 0 0 2024-02-28T16:01:50.451 INFO:tasks.workunit.client.1.smithi087.stdout:5/252: dread d3/d6/d30/f3b [0,4194304] 0 2024-02-28T16:01:50.453 INFO:tasks.workunit.client.1.smithi087.stdout:9/262: readlink d7/dc/l25 0 2024-02-28T16:01:50.454 INFO:tasks.workunit.client.1.smithi087.stdout:1/281: link d0/c10 d0/d1b/d43/c5b 0 2024-02-28T16:01:50.455 INFO:tasks.workunit.client.0.smithi057.stdout:2/18: dwrite f2 [0,4194304] 0 2024-02-28T16:01:50.455 INFO:tasks.workunit.client.0.smithi057.stdout:5/109: dread d2/d19/d1c/f2c [0,4194304] 0 2024-02-28T16:01:50.460 INFO:tasks.workunit.client.1.smithi087.stdout:4/355: mknod d2/d9/da/c81 0 2024-02-28T16:01:50.460 INFO:tasks.workunit.client.1.smithi087.stdout:9/263: mkdir d7/d1e/d44 0 2024-02-28T16:01:50.460 INFO:tasks.workunit.client.1.smithi087.stdout:1/282: mkdir d0/d1d/d24/d5c 0 2024-02-28T16:01:50.460 INFO:tasks.workunit.client.0.smithi057.stdout:4/50: rename d1/f8 to d1/f11 0 2024-02-28T16:01:50.463 INFO:tasks.workunit.client.1.smithi087.stdout:4/356: fdatasync d2/df/f13 0 2024-02-28T16:01:50.467 INFO:tasks.workunit.client.1.smithi087.stdout:6/309: dread d4/fa [0,4194304] 0 2024-02-28T16:01:50.468 INFO:tasks.workunit.client.0.smithi057.stdout:1/95: readlink d1/d3/dc/l1a 0 2024-02-28T16:01:50.472 INFO:tasks.workunit.client.0.smithi057.stdout:7/34: readlink d6/dc/le 0 2024-02-28T16:01:50.473 INFO:tasks.workunit.client.0.smithi057.stdout:2/19: creat f7 x:0 0 0 2024-02-28T16:01:50.474 INFO:tasks.workunit.client.0.smithi057.stdout:5/110: mknod d2/d8/c2d 0 2024-02-28T16:01:50.476 INFO:tasks.workunit.client.1.smithi087.stdout:1/283: rename d0/d1b/f3d to d0/d1b/f5d 0 2024-02-28T16:01:50.476 INFO:tasks.workunit.client.1.smithi087.stdout:8/269: dwrite d2/d9/d1a/f46 [0,4194304] 0 2024-02-28T16:01:50.476 INFO:tasks.workunit.client.0.smithi057.stdout:8/38: dwrite d5/d6/fa [0,4194304] 0 2024-02-28T16:01:50.478 INFO:tasks.workunit.client.0.smithi057.stdout:4/51: mkdir d1/d10/d12 0 2024-02-28T16:01:50.479 INFO:tasks.workunit.client.0.smithi057.stdout:2/20: mknod c8 0 2024-02-28T16:01:50.480 INFO:tasks.workunit.client.0.smithi057.stdout:0/181: dwrite d6/f29 [0,4194304] 0 2024-02-28T16:01:50.484 INFO:tasks.workunit.client.1.smithi087.stdout:5/253: dwrite d3/f12 [0,4194304] 0 2024-02-28T16:01:50.486 INFO:tasks.workunit.client.0.smithi057.stdout:9/47: dwrite d2/d6/f10 [0,4194304] 0 2024-02-28T16:01:50.487 INFO:tasks.workunit.client.0.smithi057.stdout:5/111: unlink d2/d8/ld 0 2024-02-28T16:01:50.488 INFO:tasks.workunit.client.0.smithi057.stdout:0/182: dread - d6/d12/d17/d25/f32 zero size 2024-02-28T16:01:50.488 INFO:tasks.workunit.client.0.smithi057.stdout:8/39: mknod d5/cf 0 2024-02-28T16:01:50.495 INFO:tasks.workunit.client.1.smithi087.stdout:8/270: rmdir d2/d18/d4e 0 2024-02-28T16:01:50.496 INFO:tasks.workunit.client.1.smithi087.stdout:5/254: creat d3/d9/d4a/f50 x:0 0 0 2024-02-28T16:01:50.496 INFO:tasks.workunit.client.1.smithi087.stdout:9/264: dread d7/dd/d15/f1f [0,4194304] 0 2024-02-28T16:01:50.498 INFO:tasks.workunit.client.0.smithi057.stdout:5/112: dread - d2/f13 zero size 2024-02-28T16:01:50.501 INFO:tasks.workunit.client.1.smithi087.stdout:9/265: readlink d7/l27 0 2024-02-28T16:01:50.504 INFO:tasks.workunit.client.1.smithi087.stdout:4/357: dwrite d2/f8 [0,4194304] 0 2024-02-28T16:01:50.505 INFO:tasks.workunit.client.0.smithi057.stdout:2/21: link f7 f9 0 2024-02-28T16:01:50.507 INFO:tasks.workunit.client.1.smithi087.stdout:8/271: fdatasync d2/d18/f22 0 2024-02-28T16:01:50.510 INFO:tasks.workunit.client.0.smithi057.stdout:8/40: creat d5/de/f10 x:0 0 0 2024-02-28T16:01:50.511 INFO:tasks.workunit.client.1.smithi087.stdout:5/255: unlink d3/d6/f3a 0 2024-02-28T16:01:50.513 INFO:tasks.workunit.client.1.smithi087.stdout:4/358: dread - d2/d9/d10/d22/d5b/d5c/f7d zero size 2024-02-28T16:01:50.513 INFO:tasks.workunit.client.1.smithi087.stdout:9/266: creat d7/dd/d36/f45 x:0 0 0 2024-02-28T16:01:50.514 INFO:tasks.workunit.client.0.smithi057.stdout:2/22: read f2 [3723773,121182] 0 2024-02-28T16:01:50.515 INFO:tasks.workunit.client.0.smithi057.stdout:2/23: rmdir - no directory 2024-02-28T16:01:50.516 INFO:tasks.workunit.client.1.smithi087.stdout:1/284: dwrite d0/d1b/f22 [0,4194304] 0 2024-02-28T16:01:50.517 INFO:tasks.workunit.client.0.smithi057.stdout:8/41: write f0 [104348,125317] 0 2024-02-28T16:01:50.517 INFO:tasks.workunit.client.0.smithi057.stdout:5/113: write d2/d8/f16 [1536124,52945] 0 2024-02-28T16:01:50.518 INFO:tasks.workunit.client.1.smithi087.stdout:5/256: mknod d3/d6/d30/d44/c51 0 2024-02-28T16:01:50.521 INFO:tasks.workunit.client.1.smithi087.stdout:4/359: creat d2/d49/f82 x:0 0 0 2024-02-28T16:01:50.522 INFO:tasks.workunit.client.1.smithi087.stdout:9/267: write d7/d1e/f30 [318862,11572] 0 2024-02-28T16:01:50.527 INFO:tasks.workunit.client.1.smithi087.stdout:5/257: creat d3/f52 x:0 0 0 2024-02-28T16:01:50.532 INFO:tasks.workunit.client.1.smithi087.stdout:4/360: symlink d2/d9/d10/d22/d73/l83 0 2024-02-28T16:01:50.537 INFO:tasks.workunit.client.0.smithi057.stdout:7/35: dwrite d6/ff [0,4194304] 0 2024-02-28T16:01:50.538 INFO:tasks.workunit.client.0.smithi057.stdout:8/42: creat d5/d6/f11 x:0 0 0 2024-02-28T16:01:50.539 INFO:tasks.workunit.client.0.smithi057.stdout:2/24: rename f7 to fa 0 2024-02-28T16:01:50.539 INFO:tasks.workunit.client.0.smithi057.stdout:1/96: dread d1/d3/dc/d15/f16 [0,4194304] 0 2024-02-28T16:01:50.541 INFO:tasks.workunit.client.1.smithi087.stdout:4/361: rename d2/df/d62/c59 to d2/d9/da/d1a/d26/c84 0 2024-02-28T16:01:50.543 INFO:tasks.workunit.client.0.smithi057.stdout:5/114: mknod d2/d27/c2e 0 2024-02-28T16:01:50.544 INFO:tasks.workunit.client.1.smithi087.stdout:4/362: chown d2/l7 11945608 1 2024-02-28T16:01:50.547 INFO:tasks.workunit.client.1.smithi087.stdout:4/363: write d2/df/d2e/d4a/f58 [632487,104661] 0 2024-02-28T16:01:50.547 INFO:tasks.workunit.client.0.smithi057.stdout:2/25: mknod cb 0 2024-02-28T16:01:50.549 INFO:tasks.workunit.client.1.smithi087.stdout:2/229: sync 2024-02-28T16:01:50.549 INFO:tasks.workunit.client.1.smithi087.stdout:1/285: dread d0/d1a/d28/f29 [0,4194304] 0 2024-02-28T16:01:50.550 INFO:tasks.workunit.client.0.smithi057.stdout:1/97: unlink d1/fe 0 2024-02-28T16:01:50.552 INFO:tasks.workunit.client.1.smithi087.stdout:6/310: dread d4/d30/d13/d38/f47 [0,4194304] 0 2024-02-28T16:01:50.553 INFO:tasks.workunit.client.0.smithi057.stdout:2/26: stat l5 0 2024-02-28T16:01:50.553 INFO:tasks.workunit.client.0.smithi057.stdout:5/115: dread - d2/d8/f25 zero size 2024-02-28T16:01:50.554 INFO:tasks.workunit.client.0.smithi057.stdout:4/52: dwrite d1/f11 [0,4194304] 0 2024-02-28T16:01:50.555 INFO:tasks.workunit.client.0.smithi057.stdout:8/43: write f3 [659389,71540] 0 2024-02-28T16:01:50.558 INFO:tasks.workunit.client.1.smithi087.stdout:6/311: readlink d4/dc/l52 0 2024-02-28T16:01:50.560 INFO:tasks.workunit.client.1.smithi087.stdout:2/230: dread d2/d7/d17/d34/f3a [0,4194304] 0 2024-02-28T16:01:50.562 INFO:tasks.workunit.client.0.smithi057.stdout:7/36: creat d6/dc/f10 x:0 0 0 2024-02-28T16:01:50.564 INFO:tasks.workunit.client.0.smithi057.stdout:1/98: read - d1/d3/dc/f10 zero size 2024-02-28T16:01:50.564 INFO:tasks.workunit.client.1.smithi087.stdout:8/272: dread d2/d9/d10/d24/f34 [0,4194304] 0 2024-02-28T16:01:50.566 INFO:tasks.workunit.client.0.smithi057.stdout:2/27: unlink l5 0 2024-02-28T16:01:50.568 INFO:tasks.workunit.client.1.smithi087.stdout:4/364: dwrite d2/f4 [4194304,4194304] 0 2024-02-28T16:01:50.569 INFO:tasks.workunit.client.0.smithi057.stdout:5/116: chown d2/d8/f9 14 1 2024-02-28T16:01:50.570 INFO:tasks.workunit.client.0.smithi057.stdout:0/183: dwrite d6/d12/d17/f3b [0,4194304] 0 2024-02-28T16:01:50.570 INFO:tasks.workunit.client.0.smithi057.stdout:4/53: mknod d1/c13 0 2024-02-28T16:01:50.571 INFO:tasks.workunit.client.0.smithi057.stdout:9/48: dwrite d2/d5/d9/fb [0,4194304] 0 2024-02-28T16:01:50.572 INFO:tasks.workunit.client.1.smithi087.stdout:6/312: truncate d4/d12/f21 189938 0 2024-02-28T16:01:50.573 INFO:tasks.workunit.client.1.smithi087.stdout:6/313: stat d4/dc/c6c 0 2024-02-28T16:01:50.573 INFO:tasks.workunit.client.0.smithi057.stdout:7/37: creat d6/dc/f11 x:0 0 0 2024-02-28T16:01:50.574 INFO:tasks.workunit.client.1.smithi087.stdout:8/273: creat d2/f57 x:0 0 0 2024-02-28T16:01:50.575 INFO:tasks.workunit.client.0.smithi057.stdout:5/117: write d2/f13 [673521,34983] 0 2024-02-28T16:01:50.575 INFO:tasks.workunit.client.0.smithi057.stdout:1/99: dread - d1/d3/dc/d15/f17 zero size 2024-02-28T16:01:50.575 INFO:tasks.workunit.client.1.smithi087.stdout:2/231: fdatasync d2/d7/df/f4d 0 2024-02-28T16:01:50.575 INFO:tasks.workunit.client.1.smithi087.stdout:9/268: dread d7/dd/d15/f22 [0,4194304] 0 2024-02-28T16:01:50.578 INFO:tasks.workunit.client.0.smithi057.stdout:4/54: mkdir d1/d14 0 2024-02-28T16:01:50.580 INFO:tasks.workunit.client.1.smithi087.stdout:2/232: rmdir d2/d7/d17/d34 39 2024-02-28T16:01:50.582 INFO:tasks.workunit.client.0.smithi057.stdout:7/38: chown l0 186571692 1 2024-02-28T16:01:50.584 INFO:tasks.workunit.client.0.smithi057.stdout:1/100: chown d1/d3/dc/c18 286850335 1 2024-02-28T16:01:50.585 INFO:tasks.workunit.client.0.smithi057.stdout:0/184: truncate d6/f19 607404 0 2024-02-28T16:01:50.586 INFO:tasks.workunit.client.1.smithi087.stdout:2/233: mknod d2/c4f 0 2024-02-28T16:01:50.591 INFO:tasks.workunit.client.1.smithi087.stdout:9/269: rename d7/dd/d15/d39/f21 to d7/d1e/d44/f46 0 2024-02-28T16:01:50.592 INFO:tasks.workunit.client.0.smithi057.stdout:7/39: dread - d6/dc/f10 zero size 2024-02-28T16:01:50.592 INFO:tasks.workunit.client.0.smithi057.stdout:4/55: mkdir d1/d10/d12/d15 0 2024-02-28T16:01:50.592 INFO:tasks.workunit.client.0.smithi057.stdout:0/185: symlink d6/l3c 0 2024-02-28T16:01:50.592 INFO:tasks.workunit.client.0.smithi057.stdout:1/101: write d1/d3/dc/ff [1385978,36255] 0 2024-02-28T16:01:50.592 INFO:tasks.workunit.client.0.smithi057.stdout:7/40: read - d6/dc/f10 zero size 2024-02-28T16:01:50.594 INFO:tasks.workunit.client.0.smithi057.stdout:6/14: sync 2024-02-28T16:01:50.599 INFO:tasks.workunit.client.0.smithi057.stdout:4/56: symlink d1/d10/d12/l16 0 2024-02-28T16:01:50.601 INFO:tasks.workunit.client.0.smithi057.stdout:6/15: creat f5 x:0 0 0 2024-02-28T16:01:50.602 INFO:tasks.workunit.client.1.smithi087.stdout:8/274: dwrite d2/d18/d36/f41 [0,4194304] 0 2024-02-28T16:01:50.603 INFO:tasks.workunit.client.1.smithi087.stdout:9/270: write d7/dd/fe [1166214,125281] 0 2024-02-28T16:01:50.603 INFO:tasks.workunit.client.0.smithi057.stdout:7/41: write d6/dc/f10 [79794,25415] 0 2024-02-28T16:01:50.604 INFO:tasks.workunit.client.0.smithi057.stdout:9/49: dread d2/d6/f10 [0,4194304] 0 2024-02-28T16:01:50.604 INFO:tasks.workunit.client.0.smithi057.stdout:4/57: read d1/f4 [2701315,50280] 0 2024-02-28T16:01:50.608 INFO:tasks.workunit.client.1.smithi087.stdout:9/271: rmdir d7/dc 39 2024-02-28T16:01:50.609 INFO:tasks.workunit.client.0.smithi057.stdout:8/44: dwrite d5/d6/f9 [0,4194304] 0 2024-02-28T16:01:50.612 INFO:tasks.workunit.client.1.smithi087.stdout:2/234: dwrite d2/d7/f2d [0,4194304] 0 2024-02-28T16:01:50.612 INFO:tasks.workunit.client.1.smithi087.stdout:9/272: write d7/dd/d36/f45 [1002206,10600] 0 2024-02-28T16:01:50.613 INFO:tasks.workunit.client.0.smithi057.stdout:6/16: creat f6 x:0 0 0 2024-02-28T16:01:50.613 INFO:tasks.workunit.client.0.smithi057.stdout:2/28: fsync f9 0 2024-02-28T16:01:50.615 INFO:tasks.workunit.client.0.smithi057.stdout:7/42: mkdir d6/dc/d12 0 2024-02-28T16:01:50.619 INFO:tasks.workunit.client.1.smithi087.stdout:4/365: rmdir d2/d9/d10/d22 39 2024-02-28T16:01:50.621 INFO:tasks.workunit.client.1.smithi087.stdout:9/273: rmdir d7/dd/d15/d39 39 2024-02-28T16:01:50.621 INFO:tasks.workunit.client.1.smithi087.stdout:4/366: write d2/d9/f7e [555947,127319] 0 2024-02-28T16:01:50.623 INFO:tasks.workunit.client.0.smithi057.stdout:5/118: dread d2/f13 [0,4194304] 0 2024-02-28T16:01:50.624 INFO:tasks.workunit.client.0.smithi057.stdout:4/58: creat d1/d10/f17 x:0 0 0 2024-02-28T16:01:50.624 INFO:tasks.workunit.client.1.smithi087.stdout:4/367: write d2/d9/f7e [48956,70819] 0 2024-02-28T16:01:50.625 INFO:tasks.workunit.client.1.smithi087.stdout:2/235: rename d2/d7/f11 to d2/d42/f50 0 2024-02-28T16:01:50.628 INFO:tasks.workunit.client.0.smithi057.stdout:6/17: truncate f2 700463 0 2024-02-28T16:01:50.628 INFO:tasks.workunit.client.0.smithi057.stdout:8/45: creat d5/f12 x:0 0 0 2024-02-28T16:01:50.630 INFO:tasks.workunit.client.1.smithi087.stdout:2/236: read d2/d7/df/f39 [7620389,119048] 0 2024-02-28T16:01:50.630 INFO:tasks.workunit.client.0.smithi057.stdout:9/50: symlink d2/d6/de/l12 0 2024-02-28T16:01:50.631 INFO:tasks.workunit.client.1.smithi087.stdout:4/368: creat d2/d9/de/f85 x:0 0 0 2024-02-28T16:01:50.633 INFO:tasks.workunit.client.1.smithi087.stdout:1/286: truncate d0/f5 6055994 0 2024-02-28T16:01:50.633 INFO:tasks.workunit.client.1.smithi087.stdout:9/274: rmdir d7/dc 39 2024-02-28T16:01:50.634 INFO:tasks.workunit.client.1.smithi087.stdout:2/237: chown d2/d7/l31 1042725 1 2024-02-28T16:01:50.635 INFO:tasks.workunit.client.0.smithi057.stdout:2/29: symlink lc 0 2024-02-28T16:01:50.638 INFO:tasks.workunit.client.1.smithi087.stdout:4/369: creat d2/d9/de/f86 x:0 0 0 2024-02-28T16:01:50.639 INFO:tasks.workunit.client.0.smithi057.stdout:0/186: rename d6/d12/d38/d39 to d6/d12/d3d 0 2024-02-28T16:01:50.640 INFO:tasks.workunit.client.0.smithi057.stdout:8/46: write d5/d6/fa [2196489,91435] 0 2024-02-28T16:01:50.641 INFO:tasks.workunit.client.0.smithi057.stdout:1/102: dwrite d1/f19 [0,4194304] 0 2024-02-28T16:01:50.643 INFO:tasks.workunit.client.0.smithi057.stdout:8/47: rename d5 to d5/d13 22 2024-02-28T16:01:50.644 INFO:tasks.workunit.client.0.smithi057.stdout:5/119: dread d2/d8/f16 [4194304,4194304] 0 2024-02-28T16:01:50.644 INFO:tasks.workunit.client.0.smithi057.stdout:6/18: symlink l7 0 2024-02-28T16:01:50.644 INFO:tasks.workunit.client.0.smithi057.stdout:7/43: symlink d6/dc/d12/l13 0 2024-02-28T16:01:50.648 INFO:tasks.workunit.client.0.smithi057.stdout:7/44: read f4 [172395,48366] 0 2024-02-28T16:01:50.649 INFO:tasks.workunit.client.1.smithi087.stdout:2/238: creat d2/d7/d17/d34/f51 x:0 0 0 2024-02-28T16:01:50.649 INFO:tasks.workunit.client.0.smithi057.stdout:2/30: symlink ld 0 2024-02-28T16:01:50.649 INFO:tasks.workunit.client.0.smithi057.stdout:8/48: write d5/d6/f9 [3708636,32548] 0 2024-02-28T16:01:50.654 INFO:tasks.workunit.client.1.smithi087.stdout:9/275: getdents d7/dd/d36 0 2024-02-28T16:01:50.658 INFO:tasks.workunit.client.1.smithi087.stdout:4/370: creat d2/d9/d10/d22/d5b/d5c/d68/f87 x:0 0 0 2024-02-28T16:01:50.659 INFO:tasks.workunit.client.1.smithi087.stdout:2/239: creat d2/d42/d4b/f52 x:0 0 0 2024-02-28T16:01:50.659 INFO:tasks.workunit.client.0.smithi057.stdout:6/19: symlink l8 0 2024-02-28T16:01:50.661 INFO:tasks.workunit.client.0.smithi057.stdout:6/20: dread - f6 zero size 2024-02-28T16:01:50.662 INFO:tasks.workunit.client.1.smithi087.stdout:1/287: unlink d0/f5 0 2024-02-28T16:01:50.662 INFO:tasks.workunit.client.0.smithi057.stdout:3/27: sync 2024-02-28T16:01:50.664 INFO:tasks.workunit.client.1.smithi087.stdout:4/371: mknod d2/d9/da/d1a/d26/c88 0 2024-02-28T16:01:50.665 INFO:tasks.workunit.client.1.smithi087.stdout:8/275: dread d2/d18/d25/f21 [0,4194304] 0 2024-02-28T16:01:50.666 INFO:tasks.workunit.client.1.smithi087.stdout:9/276: mknod d7/c47 0 2024-02-28T16:01:50.667 INFO:tasks.workunit.client.0.smithi057.stdout:2/31: unlink fa 0 2024-02-28T16:01:50.667 INFO:tasks.workunit.client.0.smithi057.stdout:9/51: rmdir d2/d6 39 2024-02-28T16:01:50.669 INFO:tasks.workunit.client.1.smithi087.stdout:4/372: stat d2/df/d2e/l38 0 2024-02-28T16:01:50.670 INFO:tasks.workunit.client.0.smithi057.stdout:6/21: write f3 [603433,34873] 0 2024-02-28T16:01:50.670 INFO:tasks.workunit.client.0.smithi057.stdout:0/187: symlink d6/d12/d17/d34/l3e 0 2024-02-28T16:01:50.671 INFO:tasks.workunit.client.1.smithi087.stdout:2/240: dread d2/d7/df/f3f [0,4194304] 0 2024-02-28T16:01:50.671 INFO:tasks.workunit.client.0.smithi057.stdout:2/32: chown ld 31731 1 2024-02-28T16:01:50.672 INFO:tasks.workunit.client.1.smithi087.stdout:8/276: fdatasync d2/d9/d1a/f2e 0 2024-02-28T16:01:50.673 INFO:tasks.workunit.client.1.smithi087.stdout:8/277: readlink d2/d18/d36/l54 0 2024-02-28T16:01:50.674 INFO:tasks.workunit.client.1.smithi087.stdout:2/241: truncate d2/f38 765464 0 2024-02-28T16:01:50.674 INFO:tasks.workunit.client.0.smithi057.stdout:3/28: unlink d8/fb 0 2024-02-28T16:01:50.675 INFO:tasks.workunit.client.0.smithi057.stdout:1/103: dwrite d1/f19 [0,4194304] 0 2024-02-28T16:01:50.676 INFO:tasks.workunit.client.1.smithi087.stdout:8/278: chown d2/d9/l26 0 1 2024-02-28T16:01:50.676 INFO:tasks.workunit.client.0.smithi057.stdout:6/22: write f3 [785809,3792] 0 2024-02-28T16:01:50.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:50 smithi057 ceph-mon[28763]: pgmap v27: 65 pgs: 65 active+clean; 553 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 2.1 MiB/s rd, 58 MiB/s wr, 230 op/s 2024-02-28T16:01:50.680 INFO:tasks.workunit.client.0.smithi057.stdout:2/33: creat fe x:0 0 0 2024-02-28T16:01:50.683 INFO:tasks.workunit.client.0.smithi057.stdout:4/59: truncate d1/f6 1632675 0 2024-02-28T16:01:50.684 INFO:tasks.workunit.client.1.smithi087.stdout:2/242: creat d2/d7/d17/d34/f53 x:0 0 0 2024-02-28T16:01:50.687 INFO:tasks.workunit.client.0.smithi057.stdout:0/188: creat d6/d12/d17/d34/f3f x:0 0 0 2024-02-28T16:01:50.687 INFO:tasks.workunit.client.0.smithi057.stdout:8/49: dwrite d5/d6/f11 [0,4194304] 0 2024-02-28T16:01:50.687 INFO:tasks.workunit.client.1.smithi087.stdout:1/288: dwrite d0/d14/f42 [0,4194304] 0 2024-02-28T16:01:50.688 INFO:tasks.workunit.client.0.smithi057.stdout:7/45: creat d6/f14 x:0 0 0 2024-02-28T16:01:50.689 INFO:tasks.workunit.client.0.smithi057.stdout:5/120: write d2/f22 [4325564,117982] 0 2024-02-28T16:01:50.690 INFO:tasks.workunit.client.0.smithi057.stdout:8/50: write d5/f12 [454002,112087] 0 2024-02-28T16:01:50.692 INFO:tasks.workunit.client.1.smithi087.stdout:4/373: link d2/d9/da/d1a/d26/f3a d2/d9/d10/d22/d5b/d5c/d68/f89 0 2024-02-28T16:01:50.692 INFO:tasks.workunit.client.0.smithi057.stdout:2/34: rename c8 to cf 0 2024-02-28T16:01:50.693 INFO:tasks.workunit.client.0.smithi057.stdout:5/121: readlink d2/d8/lf 0 2024-02-28T16:01:50.693 INFO:tasks.workunit.client.0.smithi057.stdout:6/23: dread f2 [0,4194304] 0 2024-02-28T16:01:50.694 INFO:tasks.workunit.client.1.smithi087.stdout:9/277: truncate f4 4123735 0 2024-02-28T16:01:50.694 INFO:tasks.workunit.client.1.smithi087.stdout:7/216: sync 2024-02-28T16:01:50.694 INFO:tasks.workunit.client.1.smithi087.stdout:0/296: sync 2024-02-28T16:01:50.694 INFO:tasks.workunit.client.1.smithi087.stdout:3/224: sync 2024-02-28T16:01:50.695 INFO:tasks.workunit.client.0.smithi057.stdout:1/104: mkdir d1/d21 0 2024-02-28T16:01:50.696 INFO:tasks.workunit.client.1.smithi087.stdout:1/289: symlink d0/d1b/d1f/l5e 0 2024-02-28T16:01:50.697 INFO:tasks.workunit.client.0.smithi057.stdout:0/189: dread - d6/d12/d17/f37 zero size 2024-02-28T16:01:50.697 INFO:tasks.workunit.client.0.smithi057.stdout:7/46: dread - d6/dc/f11 zero size 2024-02-28T16:01:50.698 INFO:tasks.workunit.client.0.smithi057.stdout:2/35: creat f10 x:0 0 0 2024-02-28T16:01:50.700 INFO:tasks.workunit.client.1.smithi087.stdout:8/279: dread d2/d9/f19 [0,4194304] 0 2024-02-28T16:01:50.700 INFO:tasks.workunit.client.0.smithi057.stdout:5/122: fdatasync d2/f1b 0 2024-02-28T16:01:50.703 INFO:tasks.workunit.client.0.smithi057.stdout:4/60: mknod d1/d10/d12/d15/c18 0 2024-02-28T16:01:50.705 INFO:tasks.workunit.client.0.smithi057.stdout:9/52: dread d2/d5/f8 [0,4194304] 0 2024-02-28T16:01:50.705 INFO:tasks.workunit.client.0.smithi057.stdout:7/47: chown d6/dc/le 10 1 2024-02-28T16:01:50.708 INFO:tasks.workunit.client.0.smithi057.stdout:6/24: creat f9 x:0 0 0 2024-02-28T16:01:50.708 INFO:tasks.workunit.client.1.smithi087.stdout:2/243: mkdir d2/d7/df/d28/d54 0 2024-02-28T16:01:50.710 INFO:tasks.workunit.client.0.smithi057.stdout:7/48: stat c5 0 2024-02-28T16:01:50.712 INFO:tasks.workunit.client.1.smithi087.stdout:1/290: rename d0/d14/c23 to d0/c5f 0 2024-02-28T16:01:50.713 INFO:tasks.workunit.client.0.smithi057.stdout:1/105: rename d1/ld to d1/d21/l22 0 2024-02-28T16:01:50.713 INFO:tasks.workunit.client.0.smithi057.stdout:7/49: stat d6/fb 0 2024-02-28T16:01:50.714 INFO:tasks.workunit.client.1.smithi087.stdout:0/297: rename d4 to d4/dd/d37/d39/d67 22 2024-02-28T16:01:50.714 INFO:tasks.workunit.client.1.smithi087.stdout:8/280: truncate d2/d9/d10/d24/f34 19637 0 2024-02-28T16:01:50.715 INFO:tasks.workunit.client.0.smithi057.stdout:3/29: dwrite f4 [0,4194304] 0 2024-02-28T16:01:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:50 smithi087 ceph-mon[37122]: pgmap v27: 65 pgs: 65 active+clean; 553 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 2.1 MiB/s rd, 58 MiB/s wr, 230 op/s 2024-02-28T16:01:50.718 INFO:tasks.workunit.client.1.smithi087.stdout:7/217: dwrite d14/d2e/f3d [0,4194304] 0 2024-02-28T16:01:50.719 INFO:tasks.workunit.client.1.smithi087.stdout:8/281: read d2/d9/d1a/f44 [3650807,65418] 0 2024-02-28T16:01:50.719 INFO:tasks.workunit.client.0.smithi057.stdout:5/123: creat d2/d27/f2f x:0 0 0 2024-02-28T16:01:50.719 INFO:tasks.workunit.client.0.smithi057.stdout:1/106: readlink d1/d3/dc/d15/l1e 0 2024-02-28T16:01:50.720 INFO:tasks.workunit.client.0.smithi057.stdout:3/30: chown l5 9350679 1 2024-02-28T16:01:50.720 INFO:tasks.workunit.client.1.smithi087.stdout:3/225: dwrite fa [4194304,4194304] 0 2024-02-28T16:01:50.721 INFO:tasks.workunit.client.1.smithi087.stdout:2/244: creat d2/d7/d17/d3d/f55 x:0 0 0 2024-02-28T16:01:50.722 INFO:tasks.workunit.client.1.smithi087.stdout:7/218: stat d14/d2e/d2b/f2c 0 2024-02-28T16:01:50.724 INFO:tasks.workunit.client.1.smithi087.stdout:3/226: chown d11/f1b 5211657 1 2024-02-28T16:01:50.726 INFO:tasks.workunit.client.1.smithi087.stdout:9/278: mknod d7/dc/c48 0 2024-02-28T16:01:50.727 INFO:tasks.workunit.client.1.smithi087.stdout:4/374: link d2/d9/d10/d22/l71 d2/d9/da/l8a 0 2024-02-28T16:01:50.728 INFO:tasks.workunit.client.1.smithi087.stdout:3/227: write d11/f18 [8566852,22572] 0 2024-02-28T16:01:50.729 INFO:tasks.workunit.client.1.smithi087.stdout:3/228: chown d11/l39 205696 1 2024-02-28T16:01:50.732 INFO:tasks.workunit.client.0.smithi057.stdout:5/124: write d2/d8/f25 [750724,111554] 0 2024-02-28T16:01:50.732 INFO:tasks.workunit.client.0.smithi057.stdout:4/61: mkdir d1/d10/d12/d15/d19 0 2024-02-28T16:01:50.733 INFO:tasks.workunit.client.1.smithi087.stdout:8/282: creat d2/d18/f58 x:0 0 0 2024-02-28T16:01:50.733 INFO:tasks.workunit.client.1.smithi087.stdout:7/219: mknod d14/d2e/d2b/c43 0 2024-02-28T16:01:50.735 INFO:tasks.workunit.client.1.smithi087.stdout:8/283: fsync d2/f30 0 2024-02-28T16:01:50.737 INFO:tasks.workunit.client.1.smithi087.stdout:2/245: rename d2/d7/d17/f40 to d2/d42/d4b/f56 0 2024-02-28T16:01:50.737 INFO:tasks.workunit.client.0.smithi057.stdout:4/62: fdatasync d1/f11 0 2024-02-28T16:01:50.737 INFO:tasks.workunit.client.0.smithi057.stdout:7/50: rename c5 to d6/dc/d12/c15 0 2024-02-28T16:01:50.738 INFO:tasks.workunit.client.1.smithi087.stdout:0/298: mknod d4/dd/d20/d1f/d60/c68 0 2024-02-28T16:01:50.742 INFO:tasks.workunit.client.0.smithi057.stdout:3/31: unlink f7 0 2024-02-28T16:01:50.742 INFO:tasks.workunit.client.0.smithi057.stdout:7/51: stat d6/c7 0 2024-02-28T16:01:50.743 INFO:tasks.workunit.client.1.smithi087.stdout:7/220: unlink d14/d27/f3c 0 2024-02-28T16:01:50.747 INFO:tasks.workunit.client.1.smithi087.stdout:0/299: creat d4/dd/d21/f69 x:0 0 0 2024-02-28T16:01:50.753 INFO:tasks.workunit.client.0.smithi057.stdout:3/32: rename d8 to d8/dc 22 2024-02-28T16:01:50.754 INFO:tasks.workunit.client.1.smithi087.stdout:7/221: fdatasync d14/f1d 0 2024-02-28T16:01:50.754 INFO:tasks.workunit.client.1.smithi087.stdout:9/279: dwrite d7/dd/fe [0,4194304] 0 2024-02-28T16:01:50.757 INFO:tasks.workunit.client.1.smithi087.stdout:8/284: dread d2/d9/d1a/f2e [0,4194304] 0 2024-02-28T16:01:50.758 INFO:tasks.workunit.client.1.smithi087.stdout:0/300: creat d4/d6/dc/d45/f6a x:0 0 0 2024-02-28T16:01:50.758 INFO:tasks.workunit.client.0.smithi057.stdout:5/125: dread d2/d8/fc [0,4194304] 0 2024-02-28T16:01:50.765 INFO:tasks.workunit.client.1.smithi087.stdout:2/246: dread - d2/d7/df/d28/f43 zero size 2024-02-28T16:01:50.766 INFO:tasks.workunit.client.1.smithi087.stdout:8/285: creat d2/f59 x:0 0 0 2024-02-28T16:01:50.767 INFO:tasks.workunit.client.1.smithi087.stdout:7/222: mknod d14/c44 0 2024-02-28T16:01:50.767 INFO:tasks.workunit.client.1.smithi087.stdout:2/247: chown d2/f21 2920389 1 2024-02-28T16:01:50.768 INFO:tasks.workunit.client.1.smithi087.stdout:9/280: dread d7/dd/f20 [0,4194304] 0 2024-02-28T16:01:50.768 INFO:tasks.workunit.client.0.smithi057.stdout:9/53: dwrite d2/d5/d9/fb [0,4194304] 0 2024-02-28T16:01:50.771 INFO:tasks.workunit.client.0.smithi057.stdout:2/36: write fe [186712,8351] 0 2024-02-28T16:01:50.771 INFO:tasks.workunit.client.0.smithi057.stdout:6/25: dwrite f6 [0,4194304] 0 2024-02-28T16:01:50.771 INFO:tasks.workunit.client.0.smithi057.stdout:1/107: dwrite d1/f8 [0,4194304] 0 2024-02-28T16:01:50.772 INFO:tasks.workunit.client.1.smithi087.stdout:8/286: dread - d2/d33/f3e zero size 2024-02-28T16:01:50.777 INFO:tasks.workunit.client.0.smithi057.stdout:8/51: getdents d5/d6 0 2024-02-28T16:01:50.779 INFO:tasks.workunit.client.0.smithi057.stdout:0/190: getdents d6/d12 0 2024-02-28T16:01:50.781 INFO:tasks.workunit.client.0.smithi057.stdout:8/52: truncate d5/d6/fd 333693 0 2024-02-28T16:01:50.783 INFO:tasks.workunit.client.1.smithi087.stdout:8/287: creat d2/d9/d10/d24/f5a x:0 0 0 2024-02-28T16:01:50.786 INFO:tasks.workunit.client.0.smithi057.stdout:7/52: fsync d6/fb 0 2024-02-28T16:01:50.793 INFO:tasks.workunit.client.0.smithi057.stdout:6/26: dread f3 [0,4194304] 0 2024-02-28T16:01:50.793 INFO:tasks.workunit.client.0.smithi057.stdout:6/27: rmdir - no directory 2024-02-28T16:01:50.793 INFO:tasks.workunit.client.1.smithi087.stdout:3/229: dread d11/f36 [0,4194304] 0 2024-02-28T16:01:50.795 INFO:tasks.workunit.client.1.smithi087.stdout:3/230: readlink d11/l53 0 2024-02-28T16:01:50.796 INFO:tasks.workunit.client.0.smithi057.stdout:9/54: dread d2/d5/f8 [0,4194304] 0 2024-02-28T16:01:50.798 INFO:tasks.workunit.client.0.smithi057.stdout:3/33: mkdir d8/dd 0 2024-02-28T16:01:50.799 INFO:tasks.workunit.client.1.smithi087.stdout:1/291: dwrite d0/d1b/f22 [4194304,4194304] 0 2024-02-28T16:01:50.799 INFO:tasks.workunit.client.1.smithi087.stdout:3/231: stat d11/c38 0 2024-02-28T16:01:50.807 INFO:tasks.workunit.client.1.smithi087.stdout:8/288: link d2/d33/f35 d2/d9/d1a/f5b 0 2024-02-28T16:01:50.809 INFO:tasks.workunit.client.0.smithi057.stdout:5/126: creat d2/d12/f30 x:0 0 0 2024-02-28T16:01:50.810 INFO:tasks.workunit.client.1.smithi087.stdout:7/223: getdents d14 0 2024-02-28T16:01:50.812 INFO:tasks.workunit.client.1.smithi087.stdout:2/248: write d2/f21 [4661537,107180] 0 2024-02-28T16:01:50.812 INFO:tasks.workunit.client.1.smithi087.stdout:0/301: dwrite d4/dd/d37/d39/d3a/f46 [0,4194304] 0 2024-02-28T16:01:50.813 INFO:tasks.workunit.client.1.smithi087.stdout:1/292: symlink d0/d1b/d1f/l60 0 2024-02-28T16:01:50.814 INFO:tasks.workunit.client.1.smithi087.stdout:3/232: rename d11/d33/c49 to d11/d3a/d48/d54/c55 0 2024-02-28T16:01:50.816 INFO:tasks.workunit.client.0.smithi057.stdout:1/108: symlink d1/d3/dc/l23 0 2024-02-28T16:01:50.818 INFO:tasks.workunit.client.1.smithi087.stdout:2/249: fdatasync d2/d7/d17/d34/f4a 0 2024-02-28T16:01:50.820 INFO:tasks.workunit.client.1.smithi087.stdout:9/281: dwrite d7/d1e/d44/f46 [0,4194304] 0 2024-02-28T16:01:50.820 INFO:tasks.workunit.client.1.smithi087.stdout:7/224: write f12 [4372267,101270] 0 2024-02-28T16:01:50.825 INFO:tasks.workunit.client.1.smithi087.stdout:0/302: symlink d4/dd/d21/l6b 0 2024-02-28T16:01:50.825 INFO:tasks.workunit.client.1.smithi087.stdout:9/282: chown d7/d1e/d44/f46 85 1 2024-02-28T16:01:50.828 INFO:tasks.workunit.client.0.smithi057.stdout:8/53: mknod d5/d6/c14 0 2024-02-28T16:01:50.828 INFO:tasks.workunit.client.1.smithi087.stdout:1/293: dread d0/d1b/d43/d4d/f51 [0,4194304] 0 2024-02-28T16:01:50.831 INFO:tasks.workunit.client.0.smithi057.stdout:7/53: symlink d6/dc/d12/l16 0 2024-02-28T16:01:50.835 INFO:tasks.workunit.client.1.smithi087.stdout:8/289: dread d2/d9/d1a/f45 [0,4194304] 0 2024-02-28T16:01:50.835 INFO:tasks.workunit.client.1.smithi087.stdout:2/250: mknod d2/d42/d4b/c57 0 2024-02-28T16:01:50.837 INFO:tasks.workunit.client.1.smithi087.stdout:0/303: truncate d4/dd/f29 522051 0 2024-02-28T16:01:50.841 INFO:tasks.workunit.client.1.smithi087.stdout:6/314: sync 2024-02-28T16:01:50.841 INFO:tasks.workunit.client.1.smithi087.stdout:5/258: sync 2024-02-28T16:01:50.845 INFO:tasks.workunit.client.1.smithi087.stdout:3/233: getdents d11/d3a/d3c 0 2024-02-28T16:01:50.845 INFO:tasks.workunit.client.0.smithi057.stdout:8/54: rmdir d5/d6 39 2024-02-28T16:01:50.845 INFO:tasks.workunit.client.1.smithi087.stdout:8/290: chown d2/d9/d10/c4c 1868 1 2024-02-28T16:01:50.846 INFO:tasks.workunit.client.1.smithi087.stdout:6/315: chown d4/d12/f16 5 1 2024-02-28T16:01:50.846 INFO:tasks.workunit.client.0.smithi057.stdout:8/55: readlink l2 0 2024-02-28T16:01:50.847 INFO:tasks.workunit.client.0.smithi057.stdout:1/109: dwrite d1/d3/dc/f10 [0,4194304] 0 2024-02-28T16:01:50.849 INFO:tasks.workunit.client.1.smithi087.stdout:9/283: creat d7/dd/d15/d39/d2e/f49 x:0 0 0 2024-02-28T16:01:50.850 INFO:tasks.workunit.client.0.smithi057.stdout:1/110: read - d1/d3/dc/f12 zero size 2024-02-28T16:01:50.851 INFO:tasks.workunit.client.1.smithi087.stdout:2/251: stat d2/d7/d17/d34/c45 0 2024-02-28T16:01:50.851 INFO:tasks.workunit.client.1.smithi087.stdout:5/259: mkdir d3/d6/d30/d53 0 2024-02-28T16:01:50.851 INFO:tasks.workunit.client.0.smithi057.stdout:1/111: readlink d1/d3/l9 0 2024-02-28T16:01:50.853 INFO:tasks.workunit.client.0.smithi057.stdout:6/28: unlink f3 0 2024-02-28T16:01:50.854 INFO:tasks.workunit.client.0.smithi057.stdout:7/54: creat d6/dc/f17 x:0 0 0 2024-02-28T16:01:50.854 INFO:tasks.workunit.client.1.smithi087.stdout:9/284: dread - d7/dd/d36/f3b zero size 2024-02-28T16:01:50.856 INFO:tasks.workunit.client.1.smithi087.stdout:3/234: creat d11/d44/f56 x:0 0 0 2024-02-28T16:01:50.857 INFO:tasks.workunit.client.1.smithi087.stdout:1/294: dwrite d0/d1a/f2e [0,4194304] 0 2024-02-28T16:01:50.861 INFO:tasks.workunit.client.0.smithi057.stdout:9/55: write d2/d6/f10 [4048199,28854] 0 2024-02-28T16:01:50.861 INFO:tasks.workunit.client.1.smithi087.stdout:8/291: truncate d2/f6 1130492 0 2024-02-28T16:01:50.866 INFO:tasks.workunit.client.1.smithi087.stdout:1/295: read d0/d1b/f5d [501074,80128] 0 2024-02-28T16:01:50.867 INFO:tasks.workunit.client.0.smithi057.stdout:5/127: truncate d2/d8/fb 2359926 0 2024-02-28T16:01:50.871 INFO:tasks.workunit.client.0.smithi057.stdout:0/191: truncate d6/f8 1447681 0 2024-02-28T16:01:50.871 INFO:tasks.workunit.client.0.smithi057.stdout:5/128: dread - d2/d12/f24 zero size 2024-02-28T16:01:50.871 INFO:tasks.workunit.client.0.smithi057.stdout:4/63: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:01:50.873 INFO:tasks.workunit.client.0.smithi057.stdout:0/192: chown d6/d12/d17 3 1 2024-02-28T16:01:50.874 INFO:tasks.workunit.client.1.smithi087.stdout:2/252: rename d2/f38 to d2/d7/d17/d3d/f58 0 2024-02-28T16:01:50.875 INFO:tasks.workunit.client.1.smithi087.stdout:9/285: creat d7/dd/d15/d39/f4a x:0 0 0 2024-02-28T16:01:50.876 INFO:tasks.workunit.client.0.smithi057.stdout:5/129: write d2/d12/f30 [790318,126622] 0 2024-02-28T16:01:50.876 INFO:tasks.workunit.client.1.smithi087.stdout:8/292: read d2/d18/f56 [132050,25995] 0 2024-02-28T16:01:50.877 INFO:tasks.workunit.client.0.smithi057.stdout:0/193: dread - d6/d12/d20/f36 zero size 2024-02-28T16:01:50.878 INFO:tasks.workunit.client.1.smithi087.stdout:2/253: write d2/fc [1291438,64476] 0 2024-02-28T16:01:50.878 INFO:tasks.workunit.client.0.smithi057.stdout:5/130: write d2/f10 [141395,30650] 0 2024-02-28T16:01:50.880 INFO:tasks.workunit.client.1.smithi087.stdout:3/235: creat d11/d44/f57 x:0 0 0 2024-02-28T16:01:50.881 INFO:tasks.workunit.client.0.smithi057.stdout:8/56: truncate d5/d6/f11 4955180 0 2024-02-28T16:01:50.884 INFO:tasks.workunit.client.0.smithi057.stdout:8/57: write d5/d6/fd [118724,64682] 0 2024-02-28T16:01:50.886 INFO:tasks.workunit.client.0.smithi057.stdout:5/131: write d2/d8/f9 [811351,77430] 0 2024-02-28T16:01:50.887 INFO:tasks.workunit.client.1.smithi087.stdout:1/296: truncate d0/d1b/d43/d4d/f51 1070286 0 2024-02-28T16:01:50.887 INFO:tasks.workunit.client.0.smithi057.stdout:6/29: mknod ca 0 2024-02-28T16:01:50.889 INFO:tasks.workunit.client.1.smithi087.stdout:7/225: dread f12 [0,4194304] 0 2024-02-28T16:01:50.892 INFO:tasks.workunit.client.0.smithi057.stdout:1/112: symlink d1/d3/dc/l24 0 2024-02-28T16:01:50.899 INFO:tasks.workunit.client.0.smithi057.stdout:0/194: dread d6/d12/d17/d1a/f1e [0,4194304] 0 2024-02-28T16:01:50.900 INFO:tasks.workunit.client.0.smithi057.stdout:2/37: write f9 [731260,74309] 0 2024-02-28T16:01:50.901 INFO:tasks.workunit.client.1.smithi087.stdout:9/286: fdatasync d7/dd/d15/f22 0 2024-02-28T16:01:50.901 INFO:tasks.workunit.client.1.smithi087.stdout:7/226: creat d14/d21/f45 x:0 0 0 2024-02-28T16:01:50.904 INFO:tasks.workunit.client.1.smithi087.stdout:8/293: truncate d2/d9/f19 1444720 0 2024-02-28T16:01:50.906 INFO:tasks.workunit.client.1.smithi087.stdout:6/316: dread d4/d30/f6b [0,4194304] 0 2024-02-28T16:01:50.906 INFO:tasks.workunit.client.0.smithi057.stdout:1/113: dread d1/f8 [0,4194304] 0 2024-02-28T16:01:50.906 INFO:tasks.workunit.client.0.smithi057.stdout:3/34: truncate f4 2904101 0 2024-02-28T16:01:50.908 INFO:tasks.workunit.client.1.smithi087.stdout:3/236: dwrite d11/f13 [0,4194304] 0 2024-02-28T16:01:50.908 INFO:tasks.workunit.client.1.smithi087.stdout:8/294: chown d2/f57 43 1 2024-02-28T16:01:50.909 INFO:tasks.workunit.client.1.smithi087.stdout:6/317: chown d4/d12/d45/l48 0 1 2024-02-28T16:01:50.909 INFO:tasks.workunit.client.1.smithi087.stdout:9/287: unlink d7/dd/d15/c1d 0 2024-02-28T16:01:50.910 INFO:tasks.workunit.client.1.smithi087.stdout:8/295: readlink d2/d18/d36/l3b 0 2024-02-28T16:01:50.911 INFO:tasks.workunit.client.0.smithi057.stdout:5/132: mknod d2/d8/c31 0 2024-02-28T16:01:50.913 INFO:tasks.workunit.client.1.smithi087.stdout:8/296: chown d2/d33/c4d 5417410 1 2024-02-28T16:01:50.914 INFO:tasks.workunit.client.1.smithi087.stdout:7/227: write d14/d21/f26 [10997,5960] 0 2024-02-28T16:01:50.915 INFO:tasks.workunit.client.0.smithi057.stdout:5/133: write d2/f1b [2349815,129706] 0 2024-02-28T16:01:50.915 INFO:tasks.workunit.client.0.smithi057.stdout:8/58: creat d5/de/f15 x:0 0 0 2024-02-28T16:01:50.916 INFO:tasks.workunit.client.1.smithi087.stdout:5/260: truncate d3/d9/f46 2459672 0 2024-02-28T16:01:50.918 INFO:tasks.workunit.client.1.smithi087.stdout:3/237: mkdir d11/d33/d58 0 2024-02-28T16:01:50.923 INFO:tasks.workunit.client.1.smithi087.stdout:7/228: fsync d14/d21/f26 0 2024-02-28T16:01:50.925 INFO:tasks.workunit.client.0.smithi057.stdout:5/134: chown d2/d19/d1c/l2b 1004 1 2024-02-28T16:01:50.928 INFO:tasks.workunit.client.1.smithi087.stdout:5/261: mkdir d3/d6/d30/d44/d54 0 2024-02-28T16:01:50.929 INFO:tasks.workunit.client.0.smithi057.stdout:4/64: mknod d1/d14/c1a 0 2024-02-28T16:01:50.930 INFO:tasks.workunit.client.1.smithi087.stdout:3/238: rmdir d11/d45 39 2024-02-28T16:01:50.932 INFO:tasks.workunit.client.0.smithi057.stdout:4/65: truncate d1/f11 5174442 0 2024-02-28T16:01:50.935 INFO:tasks.workunit.client.0.smithi057.stdout:0/195: creat d6/d12/d17/d34/f40 x:0 0 0 2024-02-28T16:01:50.936 INFO:tasks.workunit.client.0.smithi057.stdout:1/114: mkdir d1/d21/d25 0 2024-02-28T16:01:50.936 INFO:tasks.workunit.client.1.smithi087.stdout:2/254: link d2/d42/f50 d2/d7/d17/f59 0 2024-02-28T16:01:50.937 INFO:tasks.workunit.client.1.smithi087.stdout:7/229: write d14/d21/f3e [6192825,79151] 0 2024-02-28T16:01:50.938 INFO:tasks.workunit.client.0.smithi057.stdout:5/135: dread d2/d8/f25 [0,4194304] 0 2024-02-28T16:01:50.939 INFO:tasks.workunit.client.0.smithi057.stdout:1/115: chown d1/l5 188255 1 2024-02-28T16:01:50.939 INFO:tasks.workunit.client.1.smithi087.stdout:9/288: rename d7/dd/d36/f45 to d7/dd/d15/f4b 0 2024-02-28T16:01:50.940 INFO:tasks.workunit.client.1.smithi087.stdout:4/375: sync 2024-02-28T16:01:50.941 INFO:tasks.workunit.client.1.smithi087.stdout:8/297: creat d2/d9/f5c x:0 0 0 2024-02-28T16:01:50.942 INFO:tasks.workunit.client.0.smithi057.stdout:8/59: dwrite d5/d6/fa [0,4194304] 0 2024-02-28T16:01:50.943 INFO:tasks.workunit.client.0.smithi057.stdout:8/60: stat d5/f12 0 2024-02-28T16:01:50.944 INFO:tasks.workunit.client.1.smithi087.stdout:5/262: link d3/f43 d3/d6/d30/d3e/f55 0 2024-02-28T16:01:50.944 INFO:tasks.workunit.client.1.smithi087.stdout:4/376: read d2/f3b [350724,58595] 0 2024-02-28T16:01:50.945 INFO:tasks.workunit.client.0.smithi057.stdout:8/61: chown d5/de/f10 99 1 2024-02-28T16:01:50.946 INFO:tasks.workunit.client.1.smithi087.stdout:2/255: creat d2/f5a x:0 0 0 2024-02-28T16:01:50.947 INFO:tasks.workunit.client.1.smithi087.stdout:1/297: dwrite d0/d1b/d43/d4d/f51 [0,4194304] 0 2024-02-28T16:01:50.949 INFO:tasks.workunit.client.1.smithi087.stdout:7/230: write d14/d21/f41 [825762,27901] 0 2024-02-28T16:01:50.952 INFO:tasks.workunit.client.1.smithi087.stdout:6/318: truncate d4/dc/d10/f3d 1559005 0 2024-02-28T16:01:50.954 INFO:tasks.workunit.client.1.smithi087.stdout:3/239: rename d11/l4a to d11/d3a/d3c/l59 0 2024-02-28T16:01:50.954 INFO:tasks.workunit.client.1.smithi087.stdout:9/289: mkdir d7/dd/d3c/d4c 0 2024-02-28T16:01:50.956 INFO:tasks.workunit.client.1.smithi087.stdout:3/240: dread - d11/f32 zero size 2024-02-28T16:01:50.957 INFO:tasks.workunit.client.1.smithi087.stdout:5/263: symlink d3/d6/d30/l56 0 2024-02-28T16:01:50.958 INFO:tasks.workunit.client.1.smithi087.stdout:4/377: creat d2/d9/d10/d22/f8b x:0 0 0 2024-02-28T16:01:50.960 INFO:tasks.workunit.client.1.smithi087.stdout:7/231: mkdir d14/d46 0 2024-02-28T16:01:50.960 INFO:tasks.workunit.client.1.smithi087.stdout:3/241: dread - d11/f1d zero size 2024-02-28T16:01:50.961 INFO:tasks.workunit.client.1.smithi087.stdout:4/378: stat d2/ld 0 2024-02-28T16:01:50.962 INFO:tasks.workunit.client.1.smithi087.stdout:3/242: dread - d11/d44/f57 zero size 2024-02-28T16:01:50.963 INFO:tasks.workunit.client.0.smithi057.stdout:4/66: creat d1/d14/f1b x:0 0 0 2024-02-28T16:01:50.963 INFO:tasks.workunit.client.0.smithi057.stdout:5/136: creat d2/d12/f32 x:0 0 0 2024-02-28T16:01:50.965 INFO:tasks.workunit.client.1.smithi087.stdout:1/298: mkdir d0/d14/d3f/d61 0 2024-02-28T16:01:50.966 INFO:tasks.workunit.client.1.smithi087.stdout:1/299: readlink d0/d14/l19 0 2024-02-28T16:01:50.967 INFO:tasks.workunit.client.1.smithi087.stdout:6/319: creat d4/d30/d13/d38/d69/f6f x:0 0 0 2024-02-28T16:01:50.970 INFO:tasks.workunit.client.1.smithi087.stdout:6/320: stat d4/f20 0 2024-02-28T16:01:50.973 INFO:tasks.workunit.client.0.smithi057.stdout:9/56: getdents d2/d6 0 2024-02-28T16:01:50.974 INFO:tasks.workunit.client.1.smithi087.stdout:7/232: creat d14/d21/f47 x:0 0 0 2024-02-28T16:01:50.976 INFO:tasks.workunit.client.1.smithi087.stdout:1/300: fdatasync d0/d1a/d28/f29 0 2024-02-28T16:01:50.978 INFO:tasks.workunit.client.1.smithi087.stdout:8/298: rename d2/d18/f58 to d2/d9/f5d 0 2024-02-28T16:01:50.981 INFO:tasks.workunit.client.1.smithi087.stdout:6/321: mknod d4/d12/d45/c70 0 2024-02-28T16:01:50.982 INFO:tasks.workunit.client.1.smithi087.stdout:4/379: dwrite d2/d9/de/f6d [0,4194304] 0 2024-02-28T16:01:50.984 INFO:tasks.workunit.client.0.smithi057.stdout:1/116: getdents d1/d21/d25 0 2024-02-28T16:01:50.984 INFO:tasks.workunit.client.0.smithi057.stdout:0/196: dwrite d6/d12/d17/d25/f32 [0,4194304] 0 2024-02-28T16:01:50.986 INFO:tasks.workunit.client.0.smithi057.stdout:8/62: mknod d5/c16 0 2024-02-28T16:01:50.987 INFO:tasks.workunit.client.1.smithi087.stdout:2/256: getdents d2/d7/df 0 2024-02-28T16:01:50.990 INFO:tasks.workunit.client.0.smithi057.stdout:2/38: getdents . 0 2024-02-28T16:01:50.990 INFO:tasks.workunit.client.0.smithi057.stdout:8/63: readlink l2 0 2024-02-28T16:01:50.992 INFO:tasks.workunit.client.1.smithi087.stdout:2/257: write d2/d7/f12 [5173985,113240] 0 2024-02-28T16:01:50.992 INFO:tasks.workunit.client.0.smithi057.stdout:6/30: dwrite f2 [0,4194304] 0 2024-02-28T16:01:50.992 INFO:tasks.workunit.client.0.smithi057.stdout:9/57: mkdir d2/d5/d13 0 2024-02-28T16:01:50.993 INFO:tasks.workunit.client.1.smithi087.stdout:4/380: read d2/df/d2e/f47 [465324,52112] 0 2024-02-28T16:01:50.993 INFO:tasks.workunit.client.0.smithi057.stdout:5/137: symlink d2/l33 0 2024-02-28T16:01:50.994 INFO:tasks.workunit.client.1.smithi087.stdout:1/301: mknod d0/d14/d48/c62 0 2024-02-28T16:01:50.998 INFO:tasks.workunit.client.1.smithi087.stdout:6/322: creat d4/dc/d61/f71 x:0 0 0 2024-02-28T16:01:50.999 INFO:tasks.workunit.client.1.smithi087.stdout:9/290: link d7/l27 d7/dc/l4d 0 2024-02-28T16:01:50.999 INFO:tasks.workunit.client.0.smithi057.stdout:3/35: dwrite f3 [0,4194304] 0 2024-02-28T16:01:51.000 INFO:tasks.workunit.client.0.smithi057.stdout:1/117: mkdir d1/d21/d25/d26 0 2024-02-28T16:01:51.000 INFO:tasks.workunit.client.0.smithi057.stdout:5/138: fsync d2/d12/f32 0 2024-02-28T16:01:51.000 INFO:tasks.workunit.client.1.smithi087.stdout:6/323: readlink d4/d30/d13/d38/l60 0 2024-02-28T16:01:51.002 INFO:tasks.workunit.client.1.smithi087.stdout:7/233: mknod d14/d2e/d2b/c48 0 2024-02-28T16:01:51.003 INFO:tasks.workunit.client.0.smithi057.stdout:3/36: rename d8 to d8/dd/de 22 2024-02-28T16:01:51.003 INFO:tasks.workunit.client.0.smithi057.stdout:4/67: link d1/d10/d12/l16 d1/d10/d12/d15/l1c 0 2024-02-28T16:01:51.004 INFO:tasks.workunit.client.1.smithi087.stdout:7/234: write d14/d21/f47 [850286,31516] 0 2024-02-28T16:01:51.005 INFO:tasks.workunit.client.0.smithi057.stdout:3/37: dread - d8/fa zero size 2024-02-28T16:01:51.005 INFO:tasks.workunit.client.1.smithi087.stdout:7/235: chown f7 1193 1 2024-02-28T16:01:51.007 INFO:tasks.workunit.client.0.smithi057.stdout:4/68: chown d1/d10/d12/d15/d19 0 1 2024-02-28T16:01:51.013 INFO:tasks.workunit.client.0.smithi057.stdout:2/39: rename c3 to c11 0 2024-02-28T16:01:51.013 INFO:tasks.workunit.client.0.smithi057.stdout:1/118: mknod d1/d3/c27 0 2024-02-28T16:01:51.014 INFO:tasks.workunit.client.1.smithi087.stdout:9/291: mknod d7/dd/d15/d39/d2e/c4e 0 2024-02-28T16:01:51.016 INFO:tasks.workunit.client.0.smithi057.stdout:1/119: chown d1/d3/c1c 23911 1 2024-02-28T16:01:51.016 INFO:tasks.workunit.client.0.smithi057.stdout:0/197: creat d6/f41 x:0 0 0 2024-02-28T16:01:51.018 INFO:tasks.workunit.client.1.smithi087.stdout:9/292: write d7/dd/d15/d39/f4a [315288,85735] 0 2024-02-28T16:01:51.018 INFO:tasks.workunit.client.0.smithi057.stdout:3/38: rename l1 to d8/dd/lf 0 2024-02-28T16:01:51.019 INFO:tasks.workunit.client.1.smithi087.stdout:8/299: rmdir d2/d9/d10/d4f 0 2024-02-28T16:01:51.019 INFO:tasks.workunit.client.0.smithi057.stdout:0/198: dread - d6/d12/d20/f36 zero size 2024-02-28T16:01:51.019 INFO:tasks.workunit.client.1.smithi087.stdout:3/243: dread d11/d45/f47 [0,4194304] 0 2024-02-28T16:01:51.019 INFO:tasks.workunit.client.1.smithi087.stdout:7/236: mknod d14/d2e/c49 0 2024-02-28T16:01:51.021 INFO:tasks.workunit.client.1.smithi087.stdout:2/258: fdatasync d2/d7/df/d28/f32 0 2024-02-28T16:01:51.022 INFO:tasks.workunit.client.0.smithi057.stdout:9/58: rmdir d2/d5/d13 0 2024-02-28T16:01:51.027 INFO:tasks.workunit.client.1.smithi087.stdout:9/293: creat d7/dd/d36/f4f x:0 0 0 2024-02-28T16:01:51.028 INFO:tasks.workunit.client.0.smithi057.stdout:2/40: fsync f2 0 2024-02-28T16:01:51.028 INFO:tasks.workunit.client.0.smithi057.stdout:8/64: getdents d5 0 2024-02-28T16:01:51.028 INFO:tasks.workunit.client.1.smithi087.stdout:3/244: fsync d11/f36 0 2024-02-28T16:01:51.029 INFO:tasks.workunit.client.0.smithi057.stdout:9/59: fsync d2/d5/d9/fb 0 2024-02-28T16:01:51.029 INFO:tasks.workunit.client.0.smithi057.stdout:0/199: mknod d6/d12/d17/d25/c42 0 2024-02-28T16:01:51.029 INFO:tasks.workunit.client.1.smithi087.stdout:8/300: mkdir d2/d9/d5e 0 2024-02-28T16:01:51.029 INFO:tasks.workunit.client.1.smithi087.stdout:7/237: chown d14/d21/c24 239 1 2024-02-28T16:01:51.029 INFO:tasks.workunit.client.0.smithi057.stdout:8/65: stat d5/cb 0 2024-02-28T16:01:51.030 INFO:tasks.workunit.client.0.smithi057.stdout:5/139: getdents d2/d8 0 2024-02-28T16:01:51.030 INFO:tasks.workunit.client.0.smithi057.stdout:2/41: truncate fe 1142552 0 2024-02-28T16:01:51.030 INFO:tasks.workunit.client.0.smithi057.stdout:2/42: rmdir - no directory 2024-02-28T16:01:51.032 INFO:tasks.workunit.client.1.smithi087.stdout:8/301: creat d2/d33/f5f x:0 0 0 2024-02-28T16:01:51.033 INFO:tasks.workunit.client.0.smithi057.stdout:2/43: readlink ld 0 2024-02-28T16:01:51.037 INFO:tasks.workunit.client.1.smithi087.stdout:8/302: symlink d2/d18/d36/l60 0 2024-02-28T16:01:51.038 INFO:tasks.workunit.client.1.smithi087.stdout:4/381: write d2/d9/f48 [2772906,30313] 0 2024-02-28T16:01:51.040 INFO:tasks.workunit.client.1.smithi087.stdout:9/294: write d7/dd/f1a [746477,57804] 0 2024-02-28T16:01:51.040 INFO:tasks.workunit.client.0.smithi057.stdout:9/60: creat d2/d6/f14 x:0 0 0 2024-02-28T16:01:51.041 INFO:tasks.workunit.client.0.smithi057.stdout:3/39: dread f3 [0,4194304] 0 2024-02-28T16:01:51.042 INFO:tasks.workunit.client.0.smithi057.stdout:3/40: dread - d8/fa zero size 2024-02-28T16:01:51.043 INFO:tasks.workunit.client.0.smithi057.stdout:0/200: mknod d6/d12/d38/c43 0 2024-02-28T16:01:51.045 INFO:tasks.workunit.client.1.smithi087.stdout:6/324: dwrite d4/d12/d45/f39 [0,4194304] 0 2024-02-28T16:01:51.046 INFO:tasks.workunit.client.0.smithi057.stdout:8/66: rename f3 to d5/f17 0 2024-02-28T16:01:51.046 INFO:tasks.workunit.client.0.smithi057.stdout:2/44: chown c6 3032622 1 2024-02-28T16:01:51.046 INFO:tasks.workunit.client.0.smithi057.stdout:9/61: creat d2/d6/de/f15 x:0 0 0 2024-02-28T16:01:51.047 INFO:tasks.workunit.client.1.smithi087.stdout:4/382: write d2/df/d2e/f43 [1200369,47781] 0 2024-02-28T16:01:51.048 INFO:tasks.workunit.client.1.smithi087.stdout:8/303: rename d2/f57 to d2/d18/f61 0 2024-02-28T16:01:51.051 INFO:tasks.workunit.client.1.smithi087.stdout:9/295: symlink d7/d1e/d44/l50 0 2024-02-28T16:01:51.054 INFO:tasks.workunit.client.1.smithi087.stdout:4/383: chown d2/d9/da/c56 627217 1 2024-02-28T16:01:51.055 INFO:tasks.workunit.client.0.smithi057.stdout:5/140: rename d2/d8/fc to d2/d19/d1c/f34 0 2024-02-28T16:01:51.056 INFO:tasks.workunit.client.1.smithi087.stdout:7/238: dwrite d14/d21/f26 [0,4194304] 0 2024-02-28T16:01:51.057 INFO:tasks.workunit.client.1.smithi087.stdout:2/259: dread d2/d7/df/f4d [0,4194304] 0 2024-02-28T16:01:51.058 INFO:tasks.workunit.client.0.smithi057.stdout:9/62: mknod d2/d5/c16 0 2024-02-28T16:01:51.058 INFO:tasks.workunit.client.1.smithi087.stdout:6/325: creat d4/d30/d13/d67/f72 x:0 0 0 2024-02-28T16:01:51.060 INFO:tasks.workunit.client.1.smithi087.stdout:7/239: write d14/d21/f42 [622292,41775] 0 2024-02-28T16:01:51.060 INFO:tasks.workunit.client.1.smithi087.stdout:2/260: stat d2/d7/df/c36 0 2024-02-28T16:01:51.061 INFO:tasks.workunit.client.1.smithi087.stdout:9/296: readlink d7/dc/l4d 0 2024-02-28T16:01:51.064 INFO:tasks.workunit.client.0.smithi057.stdout:0/201: readlink d6/d12/d17/d25/l35 0 2024-02-28T16:01:51.064 INFO:tasks.workunit.client.0.smithi057.stdout:5/141: rmdir d2/d12 39 2024-02-28T16:01:51.065 INFO:tasks.workunit.client.1.smithi087.stdout:8/304: dread d2/d9/d10/f3a [0,4194304] 0 2024-02-28T16:01:51.067 INFO:tasks.workunit.client.0.smithi057.stdout:2/45: creat f12 x:0 0 0 2024-02-28T16:01:51.069 INFO:tasks.workunit.client.1.smithi087.stdout:2/261: mknod d2/d7/d17/c5b 0 2024-02-28T16:01:51.070 INFO:tasks.workunit.client.1.smithi087.stdout:6/326: link d4/dc/d61/f66 d4/d12/d45/f73 0 2024-02-28T16:01:51.074 INFO:tasks.workunit.client.1.smithi087.stdout:6/327: fsync d4/d12/d45/d57/f62 0 2024-02-28T16:01:51.074 INFO:tasks.workunit.client.1.smithi087.stdout:7/240: truncate d14/f18 404201 0 2024-02-28T16:01:51.074 INFO:tasks.workunit.client.0.smithi057.stdout:9/63: creat d2/d6/f17 x:0 0 0 2024-02-28T16:01:51.075 INFO:tasks.workunit.client.0.smithi057.stdout:3/41: dwrite f3 [0,4194304] 0 2024-02-28T16:01:51.076 INFO:tasks.workunit.client.0.smithi057.stdout:3/42: dread - d8/fa zero size 2024-02-28T16:01:51.076 INFO:tasks.workunit.client.1.smithi087.stdout:2/262: dread d2/f3e [0,4194304] 0 2024-02-28T16:01:51.080 INFO:tasks.workunit.client.0.smithi057.stdout:0/202: truncate f0 1963785 0 2024-02-28T16:01:51.080 INFO:tasks.workunit.client.0.smithi057.stdout:8/67: stat d5/c16 0 2024-02-28T16:01:51.081 INFO:tasks.workunit.client.1.smithi087.stdout:7/241: creat d14/d30/f4a x:0 0 0 2024-02-28T16:01:51.082 INFO:tasks.workunit.client.0.smithi057.stdout:9/64: truncate d2/d6/de/f15 634693 0 2024-02-28T16:01:51.083 INFO:tasks.workunit.client.0.smithi057.stdout:5/142: creat d2/f35 x:0 0 0 2024-02-28T16:01:51.086 INFO:tasks.workunit.client.0.smithi057.stdout:3/43: readlink d8/dd/lf 0 2024-02-28T16:01:51.086 INFO:tasks.workunit.client.1.smithi087.stdout:0/304: sync 2024-02-28T16:01:51.089 INFO:tasks.workunit.client.0.smithi057.stdout:3/44: write f3 [3851563,34394] 0 2024-02-28T16:01:51.089 INFO:tasks.workunit.client.1.smithi087.stdout:9/297: dwrite d7/dd/f28 [4194304,4194304] 0 2024-02-28T16:01:51.092 INFO:tasks.workunit.client.0.smithi057.stdout:0/203: unlink d6/d12/l13 0 2024-02-28T16:01:51.092 INFO:tasks.workunit.client.1.smithi087.stdout:0/305: dread - d4/dd/d20/d1f/d2e/d31/d58/f64 zero size 2024-02-28T16:01:51.092 INFO:tasks.workunit.client.1.smithi087.stdout:2/263: mknod d2/d7/d17/d3d/c5c 0 2024-02-28T16:01:51.094 INFO:tasks.workunit.client.0.smithi057.stdout:9/65: write d2/d6/f14 [762017,106953] 0 2024-02-28T16:01:51.094 INFO:tasks.workunit.client.1.smithi087.stdout:0/306: chown d4/d6 24264 1 2024-02-28T16:01:51.098 INFO:tasks.workunit.client.0.smithi057.stdout:3/45: rename l5 to d8/dd/l10 0 2024-02-28T16:01:51.099 INFO:tasks.workunit.client.1.smithi087.stdout:8/305: dwrite d2/d18/d36/f41 [0,4194304] 0 2024-02-28T16:01:51.100 INFO:tasks.workunit.client.0.smithi057.stdout:2/46: dwrite fe [0,4194304] 0 2024-02-28T16:01:51.100 INFO:tasks.workunit.client.0.smithi057.stdout:0/204: read d6/d12/d17/d25/f32 [964571,125528] 0 2024-02-28T16:01:51.100 INFO:tasks.workunit.client.1.smithi087.stdout:2/264: rename d2/d7/f12 to d2/d7/df/f5d 0 2024-02-28T16:01:51.100 INFO:tasks.workunit.client.0.smithi057.stdout:8/68: getdents d5 0 2024-02-28T16:01:51.104 INFO:tasks.workunit.client.0.smithi057.stdout:3/46: chown d8/dd 849 1 2024-02-28T16:01:51.104 INFO:tasks.workunit.client.0.smithi057.stdout:3/47: dread - d8/fa zero size 2024-02-28T16:01:51.104 INFO:tasks.workunit.client.0.smithi057.stdout:2/47: readlink ld 0 2024-02-28T16:01:51.105 INFO:tasks.workunit.client.1.smithi087.stdout:6/328: dread d4/d30/d13/d38/f47 [0,4194304] 0 2024-02-28T16:01:51.105 INFO:tasks.workunit.client.1.smithi087.stdout:8/306: write d2/f59 [878196,5674] 0 2024-02-28T16:01:51.107 INFO:tasks.workunit.client.1.smithi087.stdout:7/242: write f10 [483531,120417] 0 2024-02-28T16:01:51.107 INFO:tasks.workunit.client.0.smithi057.stdout:9/66: symlink d2/d6/l18 0 2024-02-28T16:01:51.107 INFO:tasks.workunit.client.1.smithi087.stdout:2/265: truncate d2/d7/d17/d34/f53 356712 0 2024-02-28T16:01:51.108 INFO:tasks.workunit.client.1.smithi087.stdout:6/329: chown d4/d12/l41 342147860 1 2024-02-28T16:01:51.111 INFO:tasks.workunit.client.0.smithi057.stdout:5/143: link d2/f35 d2/d19/d1c/f36 0 2024-02-28T16:01:51.112 INFO:tasks.workunit.client.1.smithi087.stdout:0/307: rename d4/dd/d20/c40 to d4/dd/d20/d1f/d2e/d5e/c6c 0 2024-02-28T16:01:51.113 INFO:tasks.workunit.client.0.smithi057.stdout:2/48: unlink f2 0 2024-02-28T16:01:51.115 INFO:tasks.workunit.client.0.smithi057.stdout:5/144: symlink d2/d15/l37 0 2024-02-28T16:01:51.116 INFO:tasks.workunit.client.1.smithi087.stdout:2/266: write d2/fc [657732,83878] 0 2024-02-28T16:01:51.118 INFO:tasks.workunit.client.1.smithi087.stdout:6/330: unlink d4/dc/f17 0 2024-02-28T16:01:51.119 INFO:tasks.workunit.client.1.smithi087.stdout:4/384: dread d2/df/d2e/f47 [0,4194304] 0 2024-02-28T16:01:51.120 INFO:tasks.workunit.client.1.smithi087.stdout:2/267: read d2/d7/f19 [3126756,90] 0 2024-02-28T16:01:51.121 INFO:tasks.workunit.client.0.smithi057.stdout:0/205: getdents d6 0 2024-02-28T16:01:51.122 INFO:tasks.workunit.client.1.smithi087.stdout:7/243: creat d14/d2e/d2b/f4b x:0 0 0 2024-02-28T16:01:51.122 INFO:tasks.workunit.client.1.smithi087.stdout:4/385: fsync d2/f8 0 2024-02-28T16:01:51.126 INFO:tasks.workunit.client.0.smithi057.stdout:0/206: dread - d6/f41 zero size 2024-02-28T16:01:51.129 INFO:tasks.workunit.client.0.smithi057.stdout:9/67: getdents d2/d6/de 0 2024-02-28T16:01:51.132 INFO:tasks.workunit.client.1.smithi087.stdout:7/244: creat d14/d46/f4c x:0 0 0 2024-02-28T16:01:51.132 INFO:tasks.workunit.client.0.smithi057.stdout:9/68: dread - d2/d6/f17 zero size 2024-02-28T16:01:51.133 INFO:tasks.workunit.client.0.smithi057.stdout:8/69: dwrite f1 [0,4194304] 0 2024-02-28T16:01:51.135 INFO:tasks.workunit.client.0.smithi057.stdout:0/207: symlink d6/d12/d17/d34/l44 0 2024-02-28T16:01:51.135 INFO:tasks.workunit.client.0.smithi057.stdout:2/49: link c6 c13 0 2024-02-28T16:01:51.136 INFO:tasks.workunit.client.0.smithi057.stdout:9/69: chown d2/d5/d9/ld 2895489 1 2024-02-28T16:01:51.139 INFO:tasks.workunit.client.0.smithi057.stdout:2/50: truncate f10 626512 0 2024-02-28T16:01:51.141 INFO:tasks.workunit.client.0.smithi057.stdout:8/70: creat d5/f18 x:0 0 0 2024-02-28T16:01:51.142 INFO:tasks.workunit.client.1.smithi087.stdout:6/331: dwrite d4/d30/d13/f3b [0,4194304] 0 2024-02-28T16:01:51.144 INFO:tasks.workunit.client.0.smithi057.stdout:0/208: unlink d6/l11 0 2024-02-28T16:01:51.145 INFO:tasks.workunit.client.1.smithi087.stdout:7/245: mkdir d14/d27/d4d 0 2024-02-28T16:01:51.146 INFO:tasks.workunit.client.1.smithi087.stdout:0/308: dwrite d4/d6/f12 [4194304,4194304] 0 2024-02-28T16:01:51.146 INFO:tasks.workunit.client.1.smithi087.stdout:7/246: readlink d14/d27/l37 0 2024-02-28T16:01:51.149 INFO:tasks.workunit.client.0.smithi057.stdout:2/51: dread f10 [0,4194304] 0 2024-02-28T16:01:51.151 INFO:tasks.workunit.client.1.smithi087.stdout:0/309: write d4/dd/d26/f2b [5054221,32220] 0 2024-02-28T16:01:51.151 INFO:tasks.workunit.client.1.smithi087.stdout:7/247: mkdir d14/d2e/d2b/d4e 0 2024-02-28T16:01:51.153 INFO:tasks.workunit.client.0.smithi057.stdout:3/48: chown d8/dd/l10 6 1 2024-02-28T16:01:51.154 INFO:tasks.workunit.client.1.smithi087.stdout:2/268: dwrite d2/d7/df/f4d [0,4194304] 0 2024-02-28T16:01:51.154 INFO:tasks.workunit.client.1.smithi087.stdout:6/332: mkdir d4/d12/d45/d74 0 2024-02-28T16:01:51.156 INFO:tasks.workunit.client.0.smithi057.stdout:2/52: stat fe 0 2024-02-28T16:01:51.157 INFO:tasks.workunit.client.0.smithi057.stdout:0/209: mkdir d6/d12/d45 0 2024-02-28T16:01:51.162 INFO:tasks.workunit.client.1.smithi087.stdout:2/269: symlink d2/d7/df/l5e 0 2024-02-28T16:01:51.162 INFO:tasks.workunit.client.0.smithi057.stdout:9/70: dwrite d2/d5/d9/fb [0,4194304] 0 2024-02-28T16:01:51.168 INFO:tasks.workunit.client.1.smithi087.stdout:9/298: dread d7/f8 [0,4194304] 0 2024-02-28T16:01:51.169 INFO:tasks.workunit.client.1.smithi087.stdout:6/333: creat d4/d30/d42/f75 x:0 0 0 2024-02-28T16:01:51.174 INFO:tasks.workunit.client.0.smithi057.stdout:9/71: getdents d2/d6/de 0 2024-02-28T16:01:51.179 INFO:tasks.workunit.client.1.smithi087.stdout:9/299: stat d7/dd/d15/d39/d2e/c33 0 2024-02-28T16:01:51.183 INFO:tasks.workunit.client.0.smithi057.stdout:9/72: symlink d2/d5/d9/l19 0 2024-02-28T16:01:51.186 INFO:tasks.workunit.client.1.smithi087.stdout:7/248: dwrite d14/d2e/d2b/f2c [0,4194304] 0 2024-02-28T16:01:51.186 INFO:tasks.workunit.client.1.smithi087.stdout:6/334: creat d4/f76 x:0 0 0 2024-02-28T16:01:51.189 INFO:tasks.workunit.client.1.smithi087.stdout:9/300: creat d7/d1e/f51 x:0 0 0 2024-02-28T16:01:51.190 INFO:tasks.workunit.client.0.smithi057.stdout:2/53: getdents . 0 2024-02-28T16:01:51.190 INFO:tasks.workunit.client.0.smithi057.stdout:2/54: readlink lc 0 2024-02-28T16:01:51.192 INFO:tasks.workunit.client.1.smithi087.stdout:0/310: dwrite d4/dd/d37/d39/f5a [0,4194304] 0 2024-02-28T16:01:51.192 INFO:tasks.workunit.client.1.smithi087.stdout:7/249: chown d14/d2e/d2b/c43 185 1 2024-02-28T16:01:51.193 INFO:tasks.workunit.client.0.smithi057.stdout:9/73: unlink d2/d5/l11 0 2024-02-28T16:01:51.195 INFO:tasks.workunit.client.1.smithi087.stdout:4/386: dwrite d2/d9/da/d1a/d26/f3a [0,4194304] 0 2024-02-28T16:01:51.196 INFO:tasks.workunit.client.1.smithi087.stdout:6/335: creat d4/d12/d45/f77 x:0 0 0 2024-02-28T16:01:51.199 INFO:tasks.workunit.client.1.smithi087.stdout:6/336: dread - d4/d30/d13/d38/f64 zero size 2024-02-28T16:01:51.199 INFO:tasks.workunit.client.1.smithi087.stdout:9/301: mknod d7/dd/d15/d39/d2e/c52 0 2024-02-28T16:01:51.199 INFO:tasks.workunit.client.1.smithi087.stdout:0/311: truncate d4/d6/dc/d45/f63 4411819 0 2024-02-28T16:01:51.203 INFO:tasks.workunit.client.1.smithi087.stdout:9/302: dread - d7/dd/d36/f3d zero size 2024-02-28T16:01:51.205 INFO:tasks.workunit.client.1.smithi087.stdout:6/337: truncate d4/d30/d13/d38/f4e 950400 0 2024-02-28T16:01:51.205 INFO:tasks.workunit.client.1.smithi087.stdout:7/250: unlink d14/d2e/f3d 0 2024-02-28T16:01:51.206 INFO:tasks.workunit.client.0.smithi057.stdout:8/71: write d5/d6/fa [2997399,110107] 0 2024-02-28T16:01:51.212 INFO:tasks.workunit.client.1.smithi087.stdout:9/303: creat d7/dd/d3c/f53 x:0 0 0 2024-02-28T16:01:51.213 INFO:tasks.workunit.client.1.smithi087.stdout:7/251: mkdir d14/d21/d4f 0 2024-02-28T16:01:51.217 INFO:tasks.workunit.client.0.smithi057.stdout:3/49: dwrite f4 [0,4194304] 0 2024-02-28T16:01:51.218 INFO:tasks.workunit.client.1.smithi087.stdout:7/252: dread - d14/d27/f3f zero size 2024-02-28T16:01:51.220 INFO:tasks.workunit.client.1.smithi087.stdout:2/270: dwrite d2/d7/df/f13 [0,4194304] 0 2024-02-28T16:01:51.221 INFO:tasks.workunit.client.0.smithi057.stdout:8/72: rename d5/d6/f11 to d5/d6/f19 0 2024-02-28T16:01:51.221 INFO:tasks.workunit.client.0.smithi057.stdout:3/50: rmdir d8 39 2024-02-28T16:01:51.221 INFO:tasks.workunit.client.1.smithi087.stdout:7/253: chown d14/d2e/f22 2987024 1 2024-02-28T16:01:51.222 INFO:tasks.workunit.client.1.smithi087.stdout:4/387: dread d2/df/d2e/d4a/f58 [0,4194304] 0 2024-02-28T16:01:51.223 INFO:tasks.workunit.client.1.smithi087.stdout:9/304: symlink d7/dd/d15/d39/d2e/l54 0 2024-02-28T16:01:51.225 INFO:tasks.workunit.client.0.smithi057.stdout:9/74: dwrite d2/d6/f10 [0,4194304] 0 2024-02-28T16:01:51.226 INFO:tasks.workunit.client.0.smithi057.stdout:8/73: dread - d5/de/f15 zero size 2024-02-28T16:01:51.226 INFO:tasks.workunit.client.1.smithi087.stdout:9/305: write d7/dd/f37 [2630462,69037] 0 2024-02-28T16:01:51.227 INFO:tasks.workunit.client.1.smithi087.stdout:2/271: creat d2/d7/d17/d3d/f5f x:0 0 0 2024-02-28T16:01:51.232 INFO:tasks.workunit.client.1.smithi087.stdout:2/272: mkdir d2/d7/d17/d3d/d60 0 2024-02-28T16:01:51.232 INFO:tasks.workunit.client.0.smithi057.stdout:2/55: dwrite fe [0,4194304] 0 2024-02-28T16:01:51.232 INFO:tasks.workunit.client.1.smithi087.stdout:9/306: write d7/dd/f20 [2183180,34893] 0 2024-02-28T16:01:51.233 INFO:tasks.workunit.client.1.smithi087.stdout:7/254: dread d14/d2e/f1b [0,4194304] 0 2024-02-28T16:01:51.234 INFO:tasks.workunit.client.0.smithi057.stdout:2/56: fsync f12 0 2024-02-28T16:01:51.237 INFO:tasks.workunit.client.1.smithi087.stdout:9/307: read d7/dd/fe [1959093,14824] 0 2024-02-28T16:01:51.237 INFO:tasks.workunit.client.0.smithi057.stdout:9/75: creat d2/d5/f1a x:0 0 0 2024-02-28T16:01:51.238 INFO:tasks.workunit.client.0.smithi057.stdout:2/57: fsync f12 0 2024-02-28T16:01:51.238 INFO:tasks.workunit.client.0.smithi057.stdout:9/76: chown d2/d5/d9 2514428 1 2024-02-28T16:01:51.239 INFO:tasks.workunit.client.0.smithi057.stdout:2/58: stat f12 0 2024-02-28T16:01:51.244 INFO:tasks.workunit.client.0.smithi057.stdout:2/59: truncate f10 1062416 0 2024-02-28T16:01:51.247 INFO:tasks.workunit.client.0.smithi057.stdout:2/60: write f12 [736087,34537] 0 2024-02-28T16:01:51.250 INFO:tasks.workunit.client.0.smithi057.stdout:2/61: symlink l14 0 2024-02-28T16:01:51.253 INFO:tasks.workunit.client.1.smithi087.stdout:9/308: write d7/f8 [9371015,78090] 0 2024-02-28T16:01:51.254 INFO:tasks.workunit.client.0.smithi057.stdout:2/62: chown f12 8018403 1 2024-02-28T16:01:51.255 INFO:tasks.workunit.client.1.smithi087.stdout:0/312: truncate d4/f8 1303949 0 2024-02-28T16:01:51.260 INFO:tasks.workunit.client.0.smithi057.stdout:8/74: getdents d5/d6 0 2024-02-28T16:01:51.261 INFO:tasks.workunit.client.1.smithi087.stdout:7/255: rename d14/f1d to d14/d2e/d2b/f50 0 2024-02-28T16:01:51.261 INFO:tasks.workunit.client.1.smithi087.stdout:0/313: fsync d4/dd/d26/f2b 0 2024-02-28T16:01:51.262 INFO:tasks.workunit.client.1.smithi087.stdout:6/338: truncate d4/dc/f1f 1390736 0 2024-02-28T16:01:51.263 INFO:tasks.workunit.client.0.smithi057.stdout:3/51: truncate f3 116692 0 2024-02-28T16:01:51.265 INFO:tasks.workunit.client.0.smithi057.stdout:8/75: symlink d5/d6/l1a 0 2024-02-28T16:01:51.269 INFO:tasks.workunit.client.0.smithi057.stdout:9/77: dwrite d2/d6/de/f15 [0,4194304] 0 2024-02-28T16:01:51.270 INFO:tasks.workunit.client.1.smithi087.stdout:0/314: mknod d4/dd/d20/d1f/d2e/d5e/c6d 0 2024-02-28T16:01:51.270 INFO:tasks.workunit.client.1.smithi087.stdout:9/309: read d7/f14 [2452174,92596] 0 2024-02-28T16:01:51.272 INFO:tasks.workunit.client.1.smithi087.stdout:4/388: dread d2/d49/f51 [0,4194304] 0 2024-02-28T16:01:51.273 INFO:tasks.workunit.client.0.smithi057.stdout:8/76: mkdir d5/de/d1b 0 2024-02-28T16:01:51.274 INFO:tasks.workunit.client.0.smithi057.stdout:9/78: mkdir d2/d5/d1b 0 2024-02-28T16:01:51.276 INFO:tasks.workunit.client.0.smithi057.stdout:8/77: mkdir d5/d1c 0 2024-02-28T16:01:51.277 INFO:tasks.workunit.client.0.smithi057.stdout:9/79: readlink d2/d6/de/l12 0 2024-02-28T16:01:51.280 INFO:tasks.workunit.client.1.smithi087.stdout:9/310: unlink d7/dd/d15/d39/d2e/l54 0 2024-02-28T16:01:51.285 INFO:tasks.workunit.client.1.smithi087.stdout:0/315: creat d4/dd/d21/d52/f6e x:0 0 0 2024-02-28T16:01:51.291 INFO:tasks.workunit.client.1.smithi087.stdout:0/316: creat d4/d6/d3e/f6f x:0 0 0 2024-02-28T16:01:51.293 INFO:tasks.workunit.client.1.smithi087.stdout:2/273: dread d2/d7/d17/f33 [0,4194304] 0 2024-02-28T16:01:51.294 INFO:tasks.workunit.client.1.smithi087.stdout:4/389: dwrite d2/d9/de/f6d [0,4194304] 0 2024-02-28T16:01:51.296 INFO:tasks.workunit.client.1.smithi087.stdout:2/274: chown d2/d7/df/c36 439514 1 2024-02-28T16:01:51.299 INFO:tasks.workunit.client.1.smithi087.stdout:2/275: stat d2/d42/d4b/f56 0 2024-02-28T16:01:51.304 INFO:tasks.workunit.client.1.smithi087.stdout:2/276: mknod d2/d42/c61 0 2024-02-28T16:01:51.308 INFO:tasks.workunit.client.0.smithi057.stdout:7/55: sync 2024-02-28T16:01:51.309 INFO:tasks.workunit.client.1.smithi087.stdout:2/277: symlink d2/d7/d17/d34/l62 0 2024-02-28T16:01:51.313 INFO:tasks.workunit.client.0.smithi057.stdout:2/63: fdatasync fe 0 2024-02-28T16:01:51.313 INFO:tasks.workunit.client.1.smithi087.stdout:9/311: dwrite d7/d1e/f51 [0,4194304] 0 2024-02-28T16:01:51.313 INFO:tasks.workunit.client.1.smithi087.stdout:7/256: dread d14/d21/f41 [0,4194304] 0 2024-02-28T16:01:51.315 INFO:tasks.workunit.client.1.smithi087.stdout:2/278: write d2/d7/d17/d34/f53 [628407,29815] 0 2024-02-28T16:01:51.317 INFO:tasks.workunit.client.1.smithi087.stdout:5/264: sync 2024-02-28T16:01:51.319 INFO:tasks.workunit.client.0.smithi057.stdout:2/64: rename l14 to l15 0 2024-02-28T16:01:51.321 INFO:tasks.workunit.client.1.smithi087.stdout:7/257: chown d14/d46/f4c 0 1 2024-02-28T16:01:51.322 INFO:tasks.workunit.client.1.smithi087.stdout:9/312: dread - d7/dd/d36/f4f zero size 2024-02-28T16:01:51.324 INFO:tasks.workunit.client.0.smithi057.stdout:2/65: rename c13 to c16 0 2024-02-28T16:01:51.325 INFO:tasks.workunit.client.1.smithi087.stdout:0/317: dwrite d4/dd/d20/f44 [0,4194304] 0 2024-02-28T16:01:51.325 INFO:tasks.workunit.client.1.smithi087.stdout:2/279: mknod d2/d7/d17/d34/c63 0 2024-02-28T16:01:51.328 INFO:tasks.workunit.client.0.smithi057.stdout:8/78: getdents d5/de 0 2024-02-28T16:01:51.331 INFO:tasks.workunit.client.0.smithi057.stdout:8/79: write d5/de/f10 [543125,26285] 0 2024-02-28T16:01:51.334 INFO:tasks.workunit.client.1.smithi087.stdout:7/258: link f10 d14/d2e/d2b/f51 0 2024-02-28T16:01:51.336 INFO:tasks.workunit.client.1.smithi087.stdout:7/259: fsync d14/d21/f45 0 2024-02-28T16:01:51.338 INFO:tasks.workunit.client.0.smithi057.stdout:8/80: mknod d5/d6/c1d 0 2024-02-28T16:01:51.338 INFO:tasks.workunit.client.0.smithi057.stdout:9/80: truncate d2/d5/d9/fb 470379 0 2024-02-28T16:01:51.339 INFO:tasks.workunit.client.0.smithi057.stdout:8/81: truncate d5/de/f10 701897 0 2024-02-28T16:01:51.340 INFO:tasks.workunit.client.1.smithi087.stdout:2/280: symlink d2/d7/df/d28/d54/l64 0 2024-02-28T16:01:51.341 INFO:tasks.workunit.client.0.smithi057.stdout:3/52: truncate f3 803889 0 2024-02-28T16:01:51.341 INFO:tasks.workunit.client.0.smithi057.stdout:8/82: readlink l2 0 2024-02-28T16:01:51.342 INFO:tasks.workunit.client.1.smithi087.stdout:4/390: dread d2/d9/f2c [0,4194304] 0 2024-02-28T16:01:51.343 INFO:tasks.workunit.client.1.smithi087.stdout:0/318: creat d4/dd/d37/d39/f70 x:0 0 0 2024-02-28T16:01:51.344 INFO:tasks.workunit.client.0.smithi057.stdout:7/56: write f4 [475632,118910] 0 2024-02-28T16:01:51.345 INFO:tasks.workunit.client.1.smithi087.stdout:7/260: write d14/d21/f42 [804936,30029] 0 2024-02-28T16:01:51.346 INFO:tasks.workunit.client.1.smithi087.stdout:2/281: mknod d2/d7/d17/d34/c65 0 2024-02-28T16:01:51.347 INFO:tasks.workunit.client.0.smithi057.stdout:2/66: chown l15 323201857 1 2024-02-28T16:01:51.347 INFO:tasks.workunit.client.0.smithi057.stdout:7/57: write d6/f14 [1037473,67526] 0 2024-02-28T16:01:51.348 INFO:tasks.workunit.client.1.smithi087.stdout:4/391: mkdir d2/df/d2e/d4a/d8c 0 2024-02-28T16:01:51.350 INFO:tasks.workunit.client.0.smithi057.stdout:9/81: getdents d2/d6 0 2024-02-28T16:01:51.350 INFO:tasks.workunit.client.0.smithi057.stdout:7/58: fdatasync d6/ff 0 2024-02-28T16:01:51.351 INFO:tasks.workunit.client.1.smithi087.stdout:6/339: dread d4/f20 [0,4194304] 0 2024-02-28T16:01:51.353 INFO:tasks.workunit.client.0.smithi057.stdout:3/53: mknod d8/dd/c11 0 2024-02-28T16:01:51.354 INFO:tasks.workunit.client.1.smithi087.stdout:6/340: write d4/dc/d10/f6e [876854,89126] 0 2024-02-28T16:01:51.354 INFO:tasks.workunit.client.0.smithi057.stdout:7/59: write f4 [1334696,15180] 0 2024-02-28T16:01:51.355 INFO:tasks.workunit.client.1.smithi087.stdout:2/282: symlink d2/d7/d17/d34/l66 0 2024-02-28T16:01:51.355 INFO:tasks.workunit.client.0.smithi057.stdout:2/67: mknod c17 0 2024-02-28T16:01:51.355 INFO:tasks.workunit.client.0.smithi057.stdout:3/54: fdatasync f4 0 2024-02-28T16:01:51.356 INFO:tasks.workunit.client.0.smithi057.stdout:9/82: creat d2/d5/d9/f1c x:0 0 0 2024-02-28T16:01:51.356 INFO:tasks.workunit.client.1.smithi087.stdout:6/341: readlink d4/d12/l41 0 2024-02-28T16:01:51.357 INFO:tasks.workunit.client.1.smithi087.stdout:4/392: mkdir d2/df/d65/d8d 0 2024-02-28T16:01:51.359 INFO:tasks.workunit.client.1.smithi087.stdout:6/342: fsync d4/d12/d45/f5d 0 2024-02-28T16:01:51.360 INFO:tasks.workunit.client.1.smithi087.stdout:2/283: chown d2/d7/d17/d34/c65 133415 1 2024-02-28T16:01:51.361 INFO:tasks.workunit.client.1.smithi087.stdout:4/393: write d2/df/f13 [132427,13772] 0 2024-02-28T16:01:51.361 INFO:tasks.workunit.client.0.smithi057.stdout:9/83: mkdir d2/d6/d1d 0 2024-02-28T16:01:51.361 INFO:tasks.workunit.client.1.smithi087.stdout:9/313: dwrite d7/dd/f28 [0,4194304] 0 2024-02-28T16:01:51.362 INFO:tasks.workunit.client.1.smithi087.stdout:2/284: stat d2/d7/d17/d3d 0 2024-02-28T16:01:51.362 INFO:tasks.workunit.client.1.smithi087.stdout:7/261: creat d14/d2e/d2b/d4e/f52 x:0 0 0 2024-02-28T16:01:51.364 INFO:tasks.workunit.client.0.smithi057.stdout:9/84: read - d2/d5/d9/f1c zero size 2024-02-28T16:01:51.367 INFO:tasks.workunit.client.1.smithi087.stdout:9/314: write d7/dd/d36/f4f [641448,23897] 0 2024-02-28T16:01:51.368 INFO:tasks.workunit.client.0.smithi057.stdout:9/85: dread - d2/d6/ff zero size 2024-02-28T16:01:51.372 INFO:tasks.workunit.client.1.smithi087.stdout:0/319: getdents d4/dd/d21 0 2024-02-28T16:01:51.375 INFO:tasks.workunit.client.0.smithi057.stdout:9/86: mknod d2/d6/de/c1e 0 2024-02-28T16:01:51.376 INFO:tasks.workunit.client.1.smithi087.stdout:0/320: chown d4/dd/d20/d1f/f33 0 1 2024-02-28T16:01:51.379 INFO:tasks.workunit.client.1.smithi087.stdout:2/285: creat d2/d7/d17/d3d/d60/f67 x:0 0 0 2024-02-28T16:01:51.379 INFO:tasks.workunit.client.0.smithi057.stdout:8/83: dwrite d5/d6/fd [0,4194304] 0 2024-02-28T16:01:51.382 INFO:tasks.workunit.client.1.smithi087.stdout:4/394: rmdir d2/df/d2e/d4a/d8c 0 2024-02-28T16:01:51.384 INFO:tasks.workunit.client.1.smithi087.stdout:2/286: truncate d2/d7/df/f3c 1198828 0 2024-02-28T16:01:51.388 INFO:tasks.workunit.client.0.smithi057.stdout:7/60: dwrite d6/f14 [0,4194304] 0 2024-02-28T16:01:51.388 INFO:tasks.workunit.client.0.smithi057.stdout:9/87: rename d2/d6/f17 to d2/d5/f1f 0 2024-02-28T16:01:51.389 INFO:tasks.workunit.client.1.smithi087.stdout:9/315: dread d7/f8 [0,4194304] 0 2024-02-28T16:01:51.389 INFO:tasks.workunit.client.1.smithi087.stdout:7/262: dread d14/d2e/d2b/f2c [0,4194304] 0 2024-02-28T16:01:51.390 INFO:tasks.workunit.client.1.smithi087.stdout:2/287: mknod d2/d42/d4b/c68 0 2024-02-28T16:01:51.392 INFO:tasks.workunit.client.0.smithi057.stdout:9/88: readlink d2/l4 0 2024-02-28T16:01:51.394 INFO:tasks.workunit.client.1.smithi087.stdout:7/263: dread - d14/d2e/d2b/d4e/f52 zero size 2024-02-28T16:01:51.394 INFO:tasks.workunit.client.0.smithi057.stdout:7/61: creat d6/dc/f18 x:0 0 0 2024-02-28T16:01:51.395 INFO:tasks.workunit.client.1.smithi087.stdout:2/288: chown d2/d7/d17/d3d/f55 11 1 2024-02-28T16:01:51.395 INFO:tasks.workunit.client.1.smithi087.stdout:7/264: fdatasync d14/d21/f45 0 2024-02-28T16:01:51.396 INFO:tasks.workunit.client.0.smithi057.stdout:9/89: truncate d2/d5/f1f 345419 0 2024-02-28T16:01:51.396 INFO:tasks.workunit.client.1.smithi087.stdout:4/395: rename d2/d9/d10/d22/d5b/d5c/d68/f87 to d2/df/d2e/f8e 0 2024-02-28T16:01:51.398 INFO:tasks.workunit.client.1.smithi087.stdout:7/265: fsync d14/f40 0 2024-02-28T16:01:51.399 INFO:tasks.workunit.client.0.smithi057.stdout:8/84: link d5/cf d5/d6/c1e 0 2024-02-28T16:01:51.400 INFO:tasks.workunit.client.1.smithi087.stdout:4/396: fdatasync d2/d9/d10/d22/d5b/d5c/f7d 0 2024-02-28T16:01:51.402 INFO:tasks.workunit.client.1.smithi087.stdout:6/343: dread d4/f23 [0,4194304] 0 2024-02-28T16:01:51.402 INFO:tasks.workunit.client.0.smithi057.stdout:7/62: symlink d6/dc/l19 0 2024-02-28T16:01:51.404 INFO:tasks.workunit.client.0.smithi057.stdout:7/63: write d6/f14 [1837228,37733] 0 2024-02-28T16:01:51.406 INFO:tasks.workunit.client.0.smithi057.stdout:9/90: fdatasync d2/d5/f8 0 2024-02-28T16:01:51.407 INFO:tasks.workunit.client.0.smithi057.stdout:7/64: dread - d6/dc/fd zero size 2024-02-28T16:01:51.408 INFO:tasks.workunit.client.1.smithi087.stdout:7/266: creat d14/d21/d4f/f53 x:0 0 0 2024-02-28T16:01:51.410 INFO:tasks.workunit.client.0.smithi057.stdout:8/85: chown d5/cf 334484 1 2024-02-28T16:01:51.413 INFO:tasks.workunit.client.1.smithi087.stdout:6/344: chown d4/d12/d45/d57/f6a 34430 1 2024-02-28T16:01:51.414 INFO:tasks.workunit.client.0.smithi057.stdout:7/65: dread d6/dc/f10 [0,4194304] 0 2024-02-28T16:01:51.415 INFO:tasks.workunit.client.1.smithi087.stdout:7/267: stat d14/d2e/d2b 0 2024-02-28T16:01:51.416 INFO:tasks.workunit.client.0.smithi057.stdout:7/66: dread - d6/dc/f17 zero size 2024-02-28T16:01:51.416 INFO:tasks.workunit.client.0.smithi057.stdout:9/91: creat d2/f20 x:0 0 0 2024-02-28T16:01:51.420 INFO:tasks.workunit.client.1.smithi087.stdout:0/321: dwrite d4/dd/f29 [0,4194304] 0 2024-02-28T16:01:51.422 INFO:tasks.workunit.client.0.smithi057.stdout:7/67: chown d6/dc/d12/c15 7437454 1 2024-02-28T16:01:51.423 INFO:tasks.workunit.client.1.smithi087.stdout:2/289: dwrite d2/d7/d17/d3d/f55 [0,4194304] 0 2024-02-28T16:01:51.423 INFO:tasks.workunit.client.0.smithi057.stdout:8/86: link d5/c16 d5/de/c1f 0 2024-02-28T16:01:51.424 INFO:tasks.workunit.client.0.smithi057.stdout:7/68: read - d6/dc/fd zero size 2024-02-28T16:01:51.424 INFO:tasks.workunit.client.0.smithi057.stdout:9/92: mknod d2/d6/d1d/c21 0 2024-02-28T16:01:51.427 INFO:tasks.workunit.client.0.smithi057.stdout:7/69: mkdir d6/dc/d12/d1a 0 2024-02-28T16:01:51.427 INFO:tasks.workunit.client.1.smithi087.stdout:2/290: chown d2/d42/d4b/f56 85 1 2024-02-28T16:01:51.428 INFO:tasks.workunit.client.1.smithi087.stdout:4/397: dwrite d2/d9/f4d [4194304,4194304] 0 2024-02-28T16:01:51.431 INFO:tasks.workunit.client.1.smithi087.stdout:0/322: rmdir d4/dd/d20/d1f/d2e/d31/d58 39 2024-02-28T16:01:51.436 INFO:tasks.workunit.client.0.smithi057.stdout:7/70: read f4 [474172,46173] 0 2024-02-28T16:01:51.437 INFO:tasks.workunit.client.0.smithi057.stdout:8/87: rename d5/d1c to d5/d20 0 2024-02-28T16:01:51.440 INFO:tasks.workunit.client.0.smithi057.stdout:8/88: read d5/d6/f19 [1591009,124057] 0 2024-02-28T16:01:51.441 INFO:tasks.workunit.client.0.smithi057.stdout:9/93: creat d2/d5/d1b/f22 x:0 0 0 2024-02-28T16:01:51.444 INFO:tasks.workunit.client.1.smithi087.stdout:4/398: write d2/d9/d10/d22/d5b/d5c/d68/f89 [208557,24493] 0 2024-02-28T16:01:51.446 INFO:tasks.workunit.client.0.smithi057.stdout:8/89: write d5/d6/fa [5155705,130349] 0 2024-02-28T16:01:51.449 INFO:tasks.workunit.client.1.smithi087.stdout:7/268: dwrite d14/d21/f45 [0,4194304] 0 2024-02-28T16:01:51.450 INFO:tasks.workunit.client.1.smithi087.stdout:6/345: dwrite d4/d12/d45/f39 [0,4194304] 0 2024-02-28T16:01:51.453 INFO:tasks.workunit.client.1.smithi087.stdout:4/399: write d2/d9/da/d1a/d26/f29 [1142647,108751] 0 2024-02-28T16:01:51.454 INFO:tasks.workunit.client.1.smithi087.stdout:2/291: link d2/d7/df/l47 d2/d7/df/d28/d54/l69 0 2024-02-28T16:01:51.455 INFO:tasks.workunit.client.1.smithi087.stdout:7/269: readlink d14/d21/l39 0 2024-02-28T16:01:51.457 INFO:tasks.workunit.client.1.smithi087.stdout:6/346: fsync d4/dc/d61/f71 0 2024-02-28T16:01:51.458 INFO:tasks.workunit.client.1.smithi087.stdout:4/400: creat d2/f8f x:0 0 0 2024-02-28T16:01:51.461 INFO:tasks.workunit.client.1.smithi087.stdout:0/323: dwrite d4/dd/f1b [4194304,4194304] 0 2024-02-28T16:01:51.462 INFO:tasks.workunit.client.1.smithi087.stdout:7/270: chown d14/d21/f26 481 1 2024-02-28T16:01:51.465 INFO:tasks.workunit.client.1.smithi087.stdout:2/292: creat d2/d7/f6a x:0 0 0 2024-02-28T16:01:51.465 INFO:tasks.workunit.client.1.smithi087.stdout:7/271: readlink d14/d27/l37 0 2024-02-28T16:01:51.472 INFO:tasks.workunit.client.0.smithi057.stdout:9/94: getdents d2 0 2024-02-28T16:01:51.474 INFO:tasks.workunit.client.1.smithi087.stdout:3/245: sync 2024-02-28T16:01:51.475 INFO:tasks.workunit.client.1.smithi087.stdout:8/307: sync 2024-02-28T16:01:51.475 INFO:tasks.workunit.client.1.smithi087.stdout:1/302: sync 2024-02-28T16:01:51.475 INFO:tasks.workunit.client.0.smithi057.stdout:7/71: dwrite d6/dc/f10 [0,4194304] 0 2024-02-28T16:01:51.478 INFO:tasks.workunit.client.1.smithi087.stdout:2/293: readlink d2/d7/df/d28/d54/l69 0 2024-02-28T16:01:51.482 INFO:tasks.workunit.client.0.smithi057.stdout:9/95: rmdir d2/d6/de 39 2024-02-28T16:01:51.483 INFO:tasks.workunit.client.0.smithi057.stdout:7/72: mknod d6/dc/c1b 0 2024-02-28T16:01:51.484 INFO:tasks.workunit.client.1.smithi087.stdout:9/316: dread f4 [0,4194304] 0 2024-02-28T16:01:51.487 INFO:tasks.workunit.client.0.smithi057.stdout:9/96: chown d2/d6/ca 25215311 1 2024-02-28T16:01:51.489 INFO:tasks.workunit.client.1.smithi087.stdout:6/347: dread d4/d30/d13/d38/f47 [0,4194304] 0 2024-02-28T16:01:51.490 INFO:tasks.workunit.client.1.smithi087.stdout:8/308: mkdir d2/d18/d42/d62 0 2024-02-28T16:01:51.491 INFO:tasks.workunit.client.1.smithi087.stdout:1/303: fdatasync d0/d14/f17 0 2024-02-28T16:01:51.494 INFO:tasks.workunit.client.0.smithi057.stdout:9/97: creat d2/d6/d1d/f23 x:0 0 0 2024-02-28T16:01:51.495 INFO:tasks.workunit.client.1.smithi087.stdout:1/304: chown d0/d1b/f22 125386 1 2024-02-28T16:01:51.497 INFO:tasks.workunit.client.1.smithi087.stdout:8/309: chown d2/d9/d10/f12 1070 1 2024-02-28T16:01:51.500 INFO:tasks.workunit.client.1.smithi087.stdout:8/310: readlink d2/d18/d36/l40 0 2024-02-28T16:01:51.502 INFO:tasks.workunit.client.1.smithi087.stdout:0/324: truncate d4/dd/f29 927280 0 2024-02-28T16:01:51.503 INFO:tasks.workunit.client.1.smithi087.stdout:9/317: rmdir d7/dd/d3c 39 2024-02-28T16:01:51.503 INFO:tasks.workunit.client.1.smithi087.stdout:7/272: dwrite d14/d27/f28 [0,4194304] 0 2024-02-28T16:01:51.504 INFO:tasks.workunit.client.1.smithi087.stdout:3/246: link f10 d11/d3a/d48/f5a 0 2024-02-28T16:01:51.504 INFO:tasks.workunit.client.0.smithi057.stdout:8/90: dwrite d5/d6/fa [4194304,4194304] 0 2024-02-28T16:01:51.506 INFO:tasks.workunit.client.1.smithi087.stdout:8/311: chown d2/f27 147818663 1 2024-02-28T16:01:51.507 INFO:tasks.workunit.client.1.smithi087.stdout:6/348: symlink d4/dc/d10/l78 0 2024-02-28T16:01:51.508 INFO:tasks.workunit.client.1.smithi087.stdout:4/401: dread d2/f2f [0,4194304] 0 2024-02-28T16:01:51.511 INFO:tasks.workunit.client.1.smithi087.stdout:9/318: mkdir d7/dd/d15/d55 0 2024-02-28T16:01:51.511 INFO:tasks.workunit.client.1.smithi087.stdout:7/273: readlink d14/d27/l37 0 2024-02-28T16:01:51.513 INFO:tasks.workunit.client.1.smithi087.stdout:0/325: creat d4/dd/d21/f71 x:0 0 0 2024-02-28T16:01:51.514 INFO:tasks.workunit.client.1.smithi087.stdout:4/402: chown d2/df/d2e/f8e 62 1 2024-02-28T16:01:51.514 INFO:tasks.workunit.client.1.smithi087.stdout:6/349: fsync d4/d30/d13/d38/f47 0 2024-02-28T16:01:51.516 INFO:tasks.workunit.client.0.smithi057.stdout:7/73: dwrite d6/f14 [0,4194304] 0 2024-02-28T16:01:51.517 INFO:tasks.workunit.client.1.smithi087.stdout:8/312: fsync d2/d9/d1a/f5b 0 2024-02-28T16:01:51.517 INFO:tasks.workunit.client.0.smithi057.stdout:8/91: chown d5/f12 70 1 2024-02-28T16:01:51.522 INFO:tasks.workunit.client.1.smithi087.stdout:7/274: write d14/d21/f32 [565890,51581] 0 2024-02-28T16:01:51.522 INFO:tasks.workunit.client.1.smithi087.stdout:9/319: mkdir d7/dd/d15/d39/d56 0 2024-02-28T16:01:51.523 INFO:tasks.workunit.client.0.smithi057.stdout:8/92: fsync d5/d6/f9 0 2024-02-28T16:01:51.524 INFO:tasks.workunit.client.1.smithi087.stdout:5/265: sync 2024-02-28T16:01:51.525 INFO:tasks.workunit.client.1.smithi087.stdout:2/294: dwrite d2/d7/f15 [4194304,4194304] 0 2024-02-28T16:01:51.529 INFO:tasks.workunit.client.0.smithi057.stdout:7/74: write d6/dc/f17 [515878,108295] 0 2024-02-28T16:01:51.530 INFO:tasks.workunit.client.1.smithi087.stdout:7/275: dread - d14/d21/d4f/f53 zero size 2024-02-28T16:01:51.532 INFO:tasks.workunit.client.1.smithi087.stdout:0/326: creat d4/dd/d21/d5f/f72 x:0 0 0 2024-02-28T16:01:51.532 INFO:tasks.workunit.client.1.smithi087.stdout:6/350: creat d4/d30/d13/d38/d69/f79 x:0 0 0 2024-02-28T16:01:51.534 INFO:tasks.workunit.client.1.smithi087.stdout:5/266: stat d3/d6/d30/d44/c51 0 2024-02-28T16:01:51.535 INFO:tasks.workunit.client.1.smithi087.stdout:8/313: read d2/d9/d1a/f4b [308911,65124] 0 2024-02-28T16:01:51.536 INFO:tasks.workunit.client.1.smithi087.stdout:1/305: dwrite d0/d1b/d43/f4b [0,4194304] 0 2024-02-28T16:01:51.536 INFO:tasks.workunit.client.1.smithi087.stdout:6/351: dread - d4/d12/f6d zero size 2024-02-28T16:01:51.537 INFO:tasks.workunit.client.1.smithi087.stdout:7/276: truncate fc 4714849 0 2024-02-28T16:01:51.537 INFO:tasks.workunit.client.1.smithi087.stdout:4/403: dread d2/df/d2e/d4a/f58 [0,4194304] 0 2024-02-28T16:01:51.538 INFO:tasks.workunit.client.0.smithi057.stdout:8/93: write d5/f7 [2269958,74252] 0 2024-02-28T16:01:51.541 INFO:tasks.workunit.client.0.smithi057.stdout:7/75: symlink d6/dc/l1c 0 2024-02-28T16:01:51.542 INFO:tasks.workunit.client.0.smithi057.stdout:8/94: write d5/f18 [31089,77530] 0 2024-02-28T16:01:51.543 INFO:tasks.workunit.client.1.smithi087.stdout:4/404: dread - d2/f8f zero size 2024-02-28T16:01:51.545 INFO:tasks.workunit.client.1.smithi087.stdout:2/295: symlink d2/d7/df/l6b 0 2024-02-28T16:01:51.545 INFO:tasks.workunit.client.0.smithi057.stdout:7/76: truncate d6/ff 4377597 0 2024-02-28T16:01:51.546 INFO:tasks.workunit.client.1.smithi087.stdout:0/327: symlink d4/d6/d3e/l73 0 2024-02-28T16:01:51.546 INFO:tasks.workunit.client.1.smithi087.stdout:5/267: rename d3/d6/d30/d3e to d3/d9/d57 0 2024-02-28T16:01:51.551 INFO:tasks.workunit.client.1.smithi087.stdout:7/277: fsync d14/d21/f41 0 2024-02-28T16:01:51.553 INFO:tasks.workunit.client.1.smithi087.stdout:8/314: fdatasync d2/d9/d1a/f4b 0 2024-02-28T16:01:51.553 INFO:tasks.workunit.client.1.smithi087.stdout:2/296: creat d2/d7/d17/d3d/f6c x:0 0 0 2024-02-28T16:01:51.557 INFO:tasks.workunit.client.0.smithi057.stdout:9/98: rename d2/d6 to d2/d24 0 2024-02-28T16:01:51.557 INFO:tasks.workunit.client.1.smithi087.stdout:0/328: rename d4/dd/d20 to d4/dd/d37/d39/d3a/d57/d74 0 2024-02-28T16:01:51.557 INFO:tasks.workunit.client.1.smithi087.stdout:9/320: dwrite d7/dd/d15/d39/f26 [4194304,4194304] 0 2024-02-28T16:01:51.560 INFO:tasks.workunit.client.0.smithi057.stdout:8/95: mknod d5/de/d1b/c21 0 2024-02-28T16:01:51.562 INFO:tasks.workunit.client.1.smithi087.stdout:4/405: mkdir d2/d9/d10/d22/d5b/d5c/d90 0 2024-02-28T16:01:51.562 INFO:tasks.workunit.client.1.smithi087.stdout:1/306: mkdir d0/d14/d3f/d61/d63 0 2024-02-28T16:01:51.564 INFO:tasks.workunit.client.0.smithi057.stdout:7/77: mknod d6/dc/d12/d1a/c1d 0 2024-02-28T16:01:51.564 INFO:tasks.workunit.client.1.smithi087.stdout:5/268: mknod d3/d6/c58 0 2024-02-28T16:01:51.565 INFO:tasks.workunit.client.0.smithi057.stdout:7/78: read d6/ff [1562503,97046] 0 2024-02-28T16:01:51.566 INFO:tasks.workunit.client.1.smithi087.stdout:2/297: symlink d2/d7/d17/d3d/d60/l6d 0 2024-02-28T16:01:51.569 INFO:tasks.workunit.client.1.smithi087.stdout:2/298: fsync d2/d7/df/f4d 0 2024-02-28T16:01:51.569 INFO:tasks.workunit.client.1.smithi087.stdout:4/406: mkdir d2/d9/d10/d22/d5b/d5c/d91 0 2024-02-28T16:01:51.573 INFO:tasks.workunit.client.0.smithi057.stdout:7/79: symlink d6/dc/l1e 0 2024-02-28T16:01:51.582 INFO:tasks.workunit.client.1.smithi087.stdout:4/407: write d2/d9/da/f3f [3063011,49464] 0 2024-02-28T16:01:51.583 INFO:tasks.workunit.client.1.smithi087.stdout:6/352: dread d4/dc/d10/f19 [0,4194304] 0 2024-02-28T16:01:51.584 INFO:tasks.workunit.client.0.smithi057.stdout:8/96: dwrite d5/f18 [0,4194304] 0 2024-02-28T16:01:51.586 INFO:tasks.workunit.client.1.smithi087.stdout:9/321: dread f4 [0,4194304] 0 2024-02-28T16:01:51.587 INFO:tasks.workunit.client.0.smithi057.stdout:8/97: write d5/f7 [1187755,33570] 0 2024-02-28T16:01:51.587 INFO:tasks.workunit.client.1.smithi087.stdout:7/278: rmdir d14/d27/d4d 0 2024-02-28T16:01:51.590 INFO:tasks.workunit.client.1.smithi087.stdout:4/408: readlink d2/d9/d10/l6f 0 2024-02-28T16:01:51.593 INFO:tasks.workunit.client.1.smithi087.stdout:2/299: truncate d2/d7/df/d28/f32 762661 0 2024-02-28T16:01:51.594 INFO:tasks.workunit.client.1.smithi087.stdout:7/279: write d14/f40 [335875,54925] 0 2024-02-28T16:01:51.595 INFO:tasks.workunit.client.1.smithi087.stdout:9/322: unlink d7/dd/d36/f3b 0 2024-02-28T16:01:51.597 INFO:tasks.workunit.client.1.smithi087.stdout:8/315: dwrite d2/d18/d42/f43 [0,4194304] 0 2024-02-28T16:01:51.598 INFO:tasks.workunit.client.0.smithi057.stdout:7/80: truncate d6/ff 4504406 0 2024-02-28T16:01:51.600 INFO:tasks.workunit.client.1.smithi087.stdout:2/300: chown d2/d7/df/d28/l2b 1845 1 2024-02-28T16:01:51.600 INFO:tasks.workunit.client.1.smithi087.stdout:4/409: fsync d2/d9/da/f3f 0 2024-02-28T16:01:51.601 INFO:tasks.workunit.client.0.smithi057.stdout:7/81: dread - d6/dc/f18 zero size 2024-02-28T16:01:51.602 INFO:tasks.workunit.client.1.smithi087.stdout:3/247: dread d11/f2a [0,4194304] 0 2024-02-28T16:01:51.605 INFO:tasks.workunit.client.1.smithi087.stdout:9/323: write d7/d1e/f30 [581438,91035] 0 2024-02-28T16:01:51.606 INFO:tasks.workunit.client.0.smithi057.stdout:9/99: link d2/d24/f10 d2/f25 0 2024-02-28T16:01:51.609 INFO:tasks.workunit.client.1.smithi087.stdout:3/248: write d11/f28 [5131872,54280] 0 2024-02-28T16:01:51.609 INFO:tasks.workunit.client.0.smithi057.stdout:9/100: write f0 [2308232,100587] 0 2024-02-28T16:01:51.613 INFO:tasks.workunit.client.1.smithi087.stdout:7/280: symlink d14/d2e/d2b/l54 0 2024-02-28T16:01:51.613 INFO:tasks.workunit.client.1.smithi087.stdout:5/269: dwrite d3/f21 [0,4194304] 0 2024-02-28T16:01:51.619 INFO:tasks.workunit.client.1.smithi087.stdout:3/249: write d11/f35 [596205,2152] 0 2024-02-28T16:01:51.621 INFO:tasks.workunit.client.0.smithi057.stdout:9/101: symlink d2/d24/d1d/l26 0 2024-02-28T16:01:51.621 INFO:tasks.workunit.client.1.smithi087.stdout:6/353: truncate d4/dc/d10/f3d 2278937 0 2024-02-28T16:01:51.623 INFO:tasks.workunit.client.1.smithi087.stdout:3/250: truncate d11/d44/f57 21573 0 2024-02-28T16:01:51.626 INFO:tasks.workunit.client.1.smithi087.stdout:9/324: stat d7/dd/d15/d39/f1c 0 2024-02-28T16:01:51.626 INFO:tasks.workunit.client.0.smithi057.stdout:9/102: write d2/d24/d1d/f23 [788232,111979] 0 2024-02-28T16:01:51.628 INFO:tasks.workunit.client.1.smithi087.stdout:2/301: rename d2/d42/f50 to d2/d7/d17/d34/f6e 0 2024-02-28T16:01:51.629 INFO:tasks.workunit.client.0.smithi057.stdout:9/103: readlink d2/d24/d1d/l26 0 2024-02-28T16:01:51.632 INFO:tasks.workunit.client.1.smithi087.stdout:7/281: mkdir d14/d27/d55 0 2024-02-28T16:01:51.634 INFO:tasks.workunit.client.1.smithi087.stdout:0/329: truncate d4/d6/dc/d45/f63 252416 0 2024-02-28T16:01:51.634 INFO:tasks.workunit.client.1.smithi087.stdout:2/302: truncate d2/d7/d17/d34/f53 812533 0 2024-02-28T16:01:51.635 INFO:tasks.workunit.client.0.smithi057.stdout:7/82: dwrite d6/dc/f18 [0,4194304] 0 2024-02-28T16:01:51.636 INFO:tasks.workunit.client.0.smithi057.stdout:9/104: symlink d2/d24/d1d/l27 0 2024-02-28T16:01:51.636 INFO:tasks.workunit.client.1.smithi087.stdout:7/282: write d14/d2e/f22 [4147301,129265] 0 2024-02-28T16:01:51.636 INFO:tasks.workunit.client.1.smithi087.stdout:4/410: dread d2/d9/d10/d22/d5b/d5c/d68/f89 [0,4194304] 0 2024-02-28T16:01:51.638 INFO:tasks.workunit.client.1.smithi087.stdout:1/307: truncate d0/d1a/d28/f3b 2174913 0 2024-02-28T16:01:51.639 INFO:tasks.workunit.client.0.smithi057.stdout:9/105: write f0 [2143338,115319] 0 2024-02-28T16:01:51.648 INFO:tasks.workunit.client.0.smithi057.stdout:9/106: chown d2/d24/de/l12 161 1 2024-02-28T16:01:51.649 INFO:tasks.workunit.client.1.smithi087.stdout:8/316: rename d2/d18/d36 to d2/d63 0 2024-02-28T16:01:51.651 INFO:tasks.workunit.client.0.smithi057.stdout:9/107: chown d2/d24/de/l12 5 1 2024-02-28T16:01:51.654 INFO:tasks.workunit.client.1.smithi087.stdout:2/303: mknod d2/d7/df/c6f 0 2024-02-28T16:01:51.655 INFO:tasks.workunit.client.1.smithi087.stdout:2/304: write d2/d7/d17/d3d/f6c [981549,38703] 0 2024-02-28T16:01:51.656 INFO:tasks.workunit.client.0.smithi057.stdout:9/108: dread - d2/d5/f1a zero size 2024-02-28T16:01:51.657 INFO:tasks.workunit.client.0.smithi057.stdout:7/83: dread d6/f14 [0,4194304] 0 2024-02-28T16:01:51.659 INFO:tasks.workunit.client.1.smithi087.stdout:0/330: truncate d4/dd/d37/d39/d3a/d57/d74/d1f/d34/f35 1085936 0 2024-02-28T16:01:51.664 INFO:tasks.workunit.client.0.smithi057.stdout:9/109: rename d2/d5/d1b/f22 to d2/d24/de/f28 0 2024-02-28T16:01:51.665 INFO:tasks.workunit.client.1.smithi087.stdout:7/283: rename d14/d30/f4a to d14/d2e/d2b/d4e/f56 0 2024-02-28T16:01:51.667 INFO:tasks.workunit.client.0.smithi057.stdout:9/110: fdatasync d2/d24/de/f15 0 2024-02-28T16:01:51.667 INFO:tasks.workunit.client.1.smithi087.stdout:8/317: creat d2/f64 x:0 0 0 2024-02-28T16:01:51.668 INFO:tasks.workunit.client.1.smithi087.stdout:5/270: creat d3/f59 x:0 0 0 2024-02-28T16:01:51.671 INFO:tasks.workunit.client.1.smithi087.stdout:9/325: link d7/dd/d15/d39/d2e/c3a d7/dd/d36/c57 0 2024-02-28T16:01:51.672 INFO:tasks.workunit.client.1.smithi087.stdout:5/271: write d3/f34 [1034444,113533] 0 2024-02-28T16:01:51.673 INFO:tasks.workunit.client.1.smithi087.stdout:6/354: truncate d4/d30/f24 1364923 0 2024-02-28T16:01:51.676 INFO:tasks.workunit.client.0.smithi057.stdout:7/84: truncate d6/f14 249253 0 2024-02-28T16:01:51.678 INFO:tasks.workunit.client.1.smithi087.stdout:1/308: rename d0/d1b/f22 to d0/d1b/d43/f64 0 2024-02-28T16:01:51.679 INFO:tasks.workunit.client.1.smithi087.stdout:2/305: dwrite d2/f5a [0,4194304] 0 2024-02-28T16:01:51.679 INFO:tasks.workunit.client.1.smithi087.stdout:7/284: mkdir d14/d2e/d2b/d57 0 2024-02-28T16:01:51.679 INFO:tasks.workunit.client.0.smithi057.stdout:7/85: mknod d6/dc/c1f 0 2024-02-28T16:01:51.680 INFO:tasks.workunit.client.1.smithi087.stdout:4/411: creat d2/d9/d10/f92 x:0 0 0 2024-02-28T16:01:51.682 INFO:tasks.workunit.client.0.smithi057.stdout:7/86: symlink d6/dc/l20 0 2024-02-28T16:01:51.685 INFO:tasks.workunit.client.1.smithi087.stdout:3/251: dwrite d11/f15 [0,4194304] 0 2024-02-28T16:01:51.687 INFO:tasks.workunit.client.0.smithi057.stdout:7/87: dread f4 [0,4194304] 0 2024-02-28T16:01:51.688 INFO:tasks.workunit.client.0.smithi057.stdout:7/88: chown d6/l9 717287400 1 2024-02-28T16:01:51.688 INFO:tasks.workunit.client.1.smithi087.stdout:5/272: stat d3/d6/le 0 2024-02-28T16:01:51.688 INFO:tasks.workunit.client.1.smithi087.stdout:2/306: readlink d2/d7/df/l5e 0 2024-02-28T16:01:51.691 INFO:tasks.workunit.client.0.smithi057.stdout:7/89: creat d6/dc/d12/f21 x:0 0 0 2024-02-28T16:01:51.701 INFO:tasks.workunit.client.1.smithi087.stdout:8/318: truncate d2/d18/f22 182664 0 2024-02-28T16:01:51.705 INFO:tasks.workunit.client.1.smithi087.stdout:0/331: write d4/dd/d37/d39/d3a/d57/d74/d1f/d34/f35 [1398424,73833] 0 2024-02-28T16:01:51.707 INFO:tasks.workunit.client.1.smithi087.stdout:0/332: truncate d4/f48 737382 0 2024-02-28T16:01:51.709 INFO:tasks.workunit.client.1.smithi087.stdout:8/319: symlink d2/l65 0 2024-02-28T16:01:51.711 INFO:tasks.workunit.client.0.smithi057.stdout:7/90: rmdir d6/dc/d12 39 2024-02-28T16:01:51.711 INFO:tasks.workunit.client.1.smithi087.stdout:8/320: write d2/f30 [6036179,42823] 0 2024-02-28T16:01:51.712 INFO:tasks.workunit.client.1.smithi087.stdout:8/321: readlink d2/l7 0 2024-02-28T16:01:51.713 INFO:tasks.workunit.client.1.smithi087.stdout:5/273: mknod d3/d6/d30/d36/d4f/c5a 0 2024-02-28T16:01:51.715 INFO:tasks.workunit.client.1.smithi087.stdout:9/326: rename d7/dd/d15/f4b to d7/f58 0 2024-02-28T16:01:51.717 INFO:tasks.workunit.client.0.smithi057.stdout:7/91: rmdir d6/dc/d12/d1a 39 2024-02-28T16:01:51.718 INFO:tasks.workunit.client.1.smithi087.stdout:0/333: rmdir d4/dd/d37/d39/d3a/d57/d74 39 2024-02-28T16:01:51.719 INFO:tasks.workunit.client.1.smithi087.stdout:7/285: link d14/d2e/d2b/l54 d14/d21/l58 0 2024-02-28T16:01:51.719 INFO:tasks.workunit.client.0.smithi057.stdout:7/92: mknod d6/c22 0 2024-02-28T16:01:51.720 INFO:tasks.workunit.client.1.smithi087.stdout:1/309: truncate d0/f2 1100438 0 2024-02-28T16:01:51.722 INFO:tasks.workunit.client.0.smithi057.stdout:7/93: truncate d6/ff 1021484 0 2024-02-28T16:01:51.724 INFO:tasks.workunit.client.1.smithi087.stdout:3/252: rename d11/d3a/d48 to d11/d44/d5b 0 2024-02-28T16:01:51.726 INFO:tasks.workunit.client.1.smithi087.stdout:3/253: read - d11/f2b zero size 2024-02-28T16:01:51.727 INFO:tasks.workunit.client.1.smithi087.stdout:7/286: chown d14/c44 225434297 1 2024-02-28T16:01:51.727 INFO:tasks.workunit.client.1.smithi087.stdout:0/334: chown d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e 202935 1 2024-02-28T16:01:51.729 INFO:tasks.workunit.client.1.smithi087.stdout:5/274: mkdir d3/d6/d30/d53/d5b 0 2024-02-28T16:01:51.730 INFO:tasks.workunit.client.1.smithi087.stdout:3/254: chown d11/d3a/d3c/f40 15 1 2024-02-28T16:01:51.731 INFO:tasks.workunit.client.1.smithi087.stdout:3/255: readlink d11/l39 0 2024-02-28T16:01:51.731 INFO:tasks.workunit.client.1.smithi087.stdout:5/275: chown d3/l29 771034 1 2024-02-28T16:01:51.733 INFO:tasks.workunit.client.1.smithi087.stdout:9/327: dwrite d7/dd/f37 [0,4194304] 0 2024-02-28T16:01:51.733 INFO:tasks.workunit.client.1.smithi087.stdout:3/256: fsync d11/d3a/d3c/f3f 0 2024-02-28T16:01:51.737 INFO:tasks.workunit.client.1.smithi087.stdout:7/287: write f12 [3255599,111271] 0 2024-02-28T16:01:51.740 INFO:tasks.workunit.client.1.smithi087.stdout:9/328: write d7/dd/f20 [1296956,125606] 0 2024-02-28T16:01:51.740 INFO:tasks.workunit.client.1.smithi087.stdout:3/257: chown d11/d33/f3d 51 1 2024-02-28T16:01:51.741 INFO:tasks.workunit.client.1.smithi087.stdout:7/288: stat d14/d2e/d2b 0 2024-02-28T16:01:51.743 INFO:tasks.workunit.client.1.smithi087.stdout:8/322: link d2/d9/d1a/l52 d2/d33/l66 0 2024-02-28T16:01:51.747 INFO:tasks.workunit.client.1.smithi087.stdout:3/258: write d11/f31 [886537,21595] 0 2024-02-28T16:01:51.749 INFO:tasks.workunit.client.1.smithi087.stdout:7/289: read fc [967861,17866] 0 2024-02-28T16:01:51.751 INFO:tasks.workunit.client.1.smithi087.stdout:9/329: write d7/dd/d15/d39/f4a [1059608,32374] 0 2024-02-28T16:01:51.758 INFO:tasks.workunit.client.1.smithi087.stdout:8/323: mkdir d2/d9/d1a/d67 0 2024-02-28T16:01:51.759 INFO:tasks.workunit.client.1.smithi087.stdout:8/324: readlink d2/l65 0 2024-02-28T16:01:51.759 INFO:tasks.workunit.client.1.smithi087.stdout:0/335: dwrite d4/d6/d3e/f42 [0,4194304] 0 2024-02-28T16:01:51.760 INFO:tasks.workunit.client.1.smithi087.stdout:3/259: dread ff [0,4194304] 0 2024-02-28T16:01:51.761 INFO:tasks.workunit.client.1.smithi087.stdout:3/260: readlink d11/l39 0 2024-02-28T16:01:51.762 INFO:tasks.workunit.client.1.smithi087.stdout:5/276: getdents d3/d6 0 2024-02-28T16:01:51.769 INFO:tasks.workunit.client.1.smithi087.stdout:8/325: mknod d2/d9/c68 0 2024-02-28T16:01:51.772 INFO:tasks.workunit.client.1.smithi087.stdout:3/261: write d11/f31 [1003341,9245] 0 2024-02-28T16:01:51.772 INFO:tasks.workunit.client.1.smithi087.stdout:9/330: rename d7/dd/f37 to d7/dc/f59 0 2024-02-28T16:01:51.776 INFO:tasks.workunit.client.1.smithi087.stdout:3/262: chown d11/l27 0 1 2024-02-28T16:01:51.776 INFO:tasks.workunit.client.1.smithi087.stdout:7/290: dwrite d14/d21/f26 [4194304,4194304] 0 2024-02-28T16:01:51.785 INFO:tasks.workunit.client.1.smithi087.stdout:5/277: getdents d3/d9 0 2024-02-28T16:01:51.786 INFO:tasks.workunit.client.1.smithi087.stdout:1/310: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:01:51.791 INFO:tasks.workunit.client.1.smithi087.stdout:3/263: symlink d11/d3a/l5c 0 2024-02-28T16:01:51.793 INFO:tasks.workunit.client.1.smithi087.stdout:7/291: symlink d14/d2e/d2b/d4e/l59 0 2024-02-28T16:01:51.795 INFO:tasks.workunit.client.1.smithi087.stdout:1/311: write d0/d1b/f5d [746631,94876] 0 2024-02-28T16:01:51.796 INFO:tasks.workunit.client.1.smithi087.stdout:0/336: getdents d4/dd/d37/d39/d3a/d57/d74/d1f 0 2024-02-28T16:01:51.805 INFO:tasks.workunit.client.1.smithi087.stdout:7/292: mknod d14/d30/c5a 0 2024-02-28T16:01:51.810 INFO:tasks.workunit.client.1.smithi087.stdout:1/312: fsync d0/d14/f18 0 2024-02-28T16:01:51.810 INFO:tasks.workunit.client.1.smithi087.stdout:0/337: write d4/dd/d26/f2b [2787555,20093] 0 2024-02-28T16:01:51.810 INFO:tasks.workunit.client.1.smithi087.stdout:3/264: getdents d11/d33 0 2024-02-28T16:01:51.815 INFO:tasks.workunit.client.1.smithi087.stdout:9/331: dwrite d7/dd/d3c/f43 [0,4194304] 0 2024-02-28T16:01:51.817 INFO:tasks.workunit.client.1.smithi087.stdout:8/326: dwrite d2/d9/d1a/f5b [0,4194304] 0 2024-02-28T16:01:51.818 INFO:tasks.workunit.client.1.smithi087.stdout:3/265: truncate d11/f46 603660 0 2024-02-28T16:01:51.820 INFO:tasks.workunit.client.1.smithi087.stdout:7/293: rename d14/d27/f28 to d14/f5b 0 2024-02-28T16:01:51.821 INFO:tasks.workunit.client.1.smithi087.stdout:5/278: dwrite d3/d9/f2a [0,4194304] 0 2024-02-28T16:01:51.824 INFO:tasks.workunit.client.1.smithi087.stdout:0/338: symlink d4/l75 0 2024-02-28T16:01:51.826 INFO:tasks.workunit.client.1.smithi087.stdout:9/332: unlink d7/dc/c3e 0 2024-02-28T16:01:51.830 INFO:tasks.workunit.client.1.smithi087.stdout:7/294: creat d14/d2e/f5c x:0 0 0 2024-02-28T16:01:51.830 INFO:tasks.workunit.client.1.smithi087.stdout:3/266: mknod d11/d3a/d3c/c5d 0 2024-02-28T16:01:51.830 INFO:tasks.workunit.client.1.smithi087.stdout:5/279: symlink d3/d6/l5c 0 2024-02-28T16:01:51.832 INFO:tasks.workunit.client.1.smithi087.stdout:0/339: readlink d4/d6/dc/l3c 0 2024-02-28T16:01:51.833 INFO:tasks.workunit.client.1.smithi087.stdout:5/280: fsync d3/f22 0 2024-02-28T16:01:51.833 INFO:tasks.workunit.client.1.smithi087.stdout:9/333: fdatasync d7/dd/fe 0 2024-02-28T16:01:51.834 INFO:tasks.workunit.client.1.smithi087.stdout:5/281: chown d3/f37 10685079 1 2024-02-28T16:01:51.849 INFO:tasks.workunit.client.1.smithi087.stdout:0/340: getdents d4/d6/dc 0 2024-02-28T16:01:51.851 INFO:tasks.workunit.client.1.smithi087.stdout:8/327: dwrite d2/d9/d1a/f45 [0,4194304] 0 2024-02-28T16:01:51.857 INFO:tasks.workunit.client.1.smithi087.stdout:9/334: dread d7/dd/d15/d39/f4a [0,4194304] 0 2024-02-28T16:01:51.862 INFO:tasks.workunit.client.1.smithi087.stdout:7/295: dread d14/d21/f26 [0,4194304] 0 2024-02-28T16:01:51.863 INFO:tasks.workunit.client.1.smithi087.stdout:0/341: unlink d4/dd/f29 0 2024-02-28T16:01:51.863 INFO:tasks.workunit.client.1.smithi087.stdout:3/267: dwrite d11/f35 [0,4194304] 0 2024-02-28T16:01:51.868 INFO:tasks.workunit.client.1.smithi087.stdout:9/335: rmdir d7/dd/d15/d39/d2e 39 2024-02-28T16:01:51.875 INFO:tasks.workunit.client.1.smithi087.stdout:8/328: rename d2/d63/l3b to d2/d9/d1a/l69 0 2024-02-28T16:01:51.876 INFO:tasks.workunit.client.1.smithi087.stdout:1/313: dread d0/d14/f25 [0,4194304] 0 2024-02-28T16:01:51.879 INFO:tasks.workunit.client.1.smithi087.stdout:5/282: symlink d3/d6/d30/d53/d5b/l5d 0 2024-02-28T16:01:51.879 INFO:tasks.workunit.client.1.smithi087.stdout:7/296: fdatasync d14/d2e/d2b/f2c 0 2024-02-28T16:01:51.889 INFO:tasks.workunit.client.1.smithi087.stdout:3/268: dwrite d11/d33/f3d [0,4194304] 0 2024-02-28T16:01:51.890 INFO:tasks.workunit.client.1.smithi087.stdout:8/329: rmdir d2/d9/d10/d24 39 2024-02-28T16:01:51.893 INFO:tasks.workunit.client.1.smithi087.stdout:5/283: mkdir d3/d9/d4a/d5e 0 2024-02-28T16:01:51.896 INFO:tasks.workunit.client.1.smithi087.stdout:0/342: getdents d4/dd/d21/d5f 0 2024-02-28T16:01:51.896 INFO:tasks.workunit.client.1.smithi087.stdout:3/269: chown d11/d44/c50 38130 1 2024-02-28T16:01:51.899 INFO:tasks.workunit.client.1.smithi087.stdout:3/270: readlink d11/l53 0 2024-02-28T16:01:51.899 INFO:tasks.workunit.client.1.smithi087.stdout:5/284: readlink d3/d6/d30/l41 0 2024-02-28T16:01:51.900 INFO:tasks.workunit.client.1.smithi087.stdout:8/330: rename d2/d63/l54 to d2/d33/l6a 0 2024-02-28T16:01:51.905 INFO:tasks.workunit.client.1.smithi087.stdout:3/271: fsync d11/f36 0 2024-02-28T16:01:51.906 INFO:tasks.workunit.client.1.smithi087.stdout:3/272: chown d11/d3a/f42 3 1 2024-02-28T16:01:51.907 INFO:tasks.workunit.client.1.smithi087.stdout:9/336: dwrite d7/dd/d15/f1f [4194304,4194304] 0 2024-02-28T16:01:51.908 INFO:tasks.workunit.client.1.smithi087.stdout:1/314: dwrite d0/d14/d48/f4e [0,4194304] 0 2024-02-28T16:01:51.913 INFO:tasks.workunit.client.1.smithi087.stdout:3/273: readlink d11/d3a/d3c/l41 0 2024-02-28T16:01:51.914 INFO:tasks.workunit.client.1.smithi087.stdout:8/331: rename d2/d9/d10/l1f to d2/d18/l6b 0 2024-02-28T16:01:51.919 INFO:tasks.workunit.client.1.smithi087.stdout:3/274: read - d11/d3a/d3c/f40 zero size 2024-02-28T16:01:51.922 INFO:tasks.workunit.client.1.smithi087.stdout:9/337: creat d7/dd/d15/f5a x:0 0 0 2024-02-28T16:01:51.927 INFO:tasks.workunit.client.1.smithi087.stdout:0/343: dwrite d4/d6/dc/d45/f6a [0,4194304] 0 2024-02-28T16:01:51.928 INFO:tasks.workunit.client.1.smithi087.stdout:8/332: creat d2/d18/d25/f6c x:0 0 0 2024-02-28T16:01:51.930 INFO:tasks.workunit.client.1.smithi087.stdout:9/338: symlink d7/dd/d3c/l5b 0 2024-02-28T16:01:51.931 INFO:tasks.workunit.client.1.smithi087.stdout:7/297: dwrite d14/f2a [0,4194304] 0 2024-02-28T16:01:51.934 INFO:tasks.workunit.client.1.smithi087.stdout:5/285: dwrite d3/d6/d30/d36/f48 [0,4194304] 0 2024-02-28T16:01:51.936 INFO:tasks.workunit.client.1.smithi087.stdout:7/298: chown f12 1470267 1 2024-02-28T16:01:51.937 INFO:tasks.workunit.client.1.smithi087.stdout:9/339: creat d7/d1e/f5c x:0 0 0 2024-02-28T16:01:51.946 INFO:tasks.workunit.client.1.smithi087.stdout:0/344: write d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/f64 [926460,128195] 0 2024-02-28T16:01:51.946 INFO:tasks.workunit.client.1.smithi087.stdout:8/333: getdents d2/d18/d25 0 2024-02-28T16:01:51.954 INFO:tasks.workunit.client.1.smithi087.stdout:1/315: dwrite d0/d1b/d43/d4d/f51 [4194304,4194304] 0 2024-02-28T16:01:51.959 INFO:tasks.workunit.client.1.smithi087.stdout:6/355: sync 2024-02-28T16:01:51.961 INFO:tasks.workunit.client.1.smithi087.stdout:8/334: dread d2/f59 [0,4194304] 0 2024-02-28T16:01:51.982 INFO:tasks.workunit.client.1.smithi087.stdout:5/286: dwrite d3/d9/fd [0,4194304] 0 2024-02-28T16:01:51.984 INFO:tasks.workunit.client.1.smithi087.stdout:8/335: creat d2/d18/d42/f6d x:0 0 0 2024-02-28T16:01:51.985 INFO:tasks.workunit.client.1.smithi087.stdout:8/336: stat d2/d33 0 2024-02-28T16:01:51.987 INFO:tasks.workunit.client.1.smithi087.stdout:7/299: dread d14/f5b [0,4194304] 0 2024-02-28T16:01:51.988 INFO:tasks.workunit.client.1.smithi087.stdout:9/340: dread d7/dc/f59 [0,4194304] 0 2024-02-28T16:01:51.988 INFO:tasks.workunit.client.1.smithi087.stdout:5/287: creat d3/d6/d30/d36/f5f x:0 0 0 2024-02-28T16:01:51.990 INFO:tasks.workunit.client.1.smithi087.stdout:1/316: dread d0/d1b/d43/f4b [0,4194304] 0 2024-02-28T16:01:52.115 INFO:tasks.workunit.client.1.smithi087.stdout:7/300: unlink d14/d27/l38 0 2024-02-28T16:01:52.115 INFO:tasks.workunit.client.1.smithi087.stdout:3/275: dread f10 [0,4194304] 0 2024-02-28T16:01:52.116 INFO:tasks.workunit.client.1.smithi087.stdout:9/341: getdents d7/dd/d15/d3f 0 2024-02-28T16:01:52.120 INFO:tasks.workunit.client.1.smithi087.stdout:9/342: chown d7/dd/d15/d39/f1c 75177797 1 2024-02-28T16:01:52.123 INFO:tasks.workunit.client.1.smithi087.stdout:5/288: rename d3/d6/c24 to d3/d6/d30/d44/c60 0 2024-02-28T16:01:52.123 INFO:tasks.workunit.client.1.smithi087.stdout:9/343: read d7/dd/fe [3304888,61098] 0 2024-02-28T16:01:52.124 INFO:tasks.workunit.client.1.smithi087.stdout:7/301: mkdir d14/d27/d5d 0 2024-02-28T16:01:52.127 INFO:tasks.workunit.client.1.smithi087.stdout:3/276: creat d11/d44/f5e x:0 0 0 2024-02-28T16:01:52.130 INFO:tasks.workunit.client.1.smithi087.stdout:3/277: dread - d11/f26 zero size 2024-02-28T16:01:52.130 INFO:tasks.workunit.client.1.smithi087.stdout:8/337: dwrite d2/f27 [0,4194304] 0 2024-02-28T16:01:52.133 INFO:tasks.workunit.client.1.smithi087.stdout:7/302: creat d14/d27/d5d/f5e x:0 0 0 2024-02-28T16:01:52.134 INFO:tasks.workunit.client.1.smithi087.stdout:8/338: chown d2/d9/d10/c20 4 1 2024-02-28T16:01:52.135 INFO:tasks.workunit.client.1.smithi087.stdout:9/344: symlink d7/dd/d36/l5d 0 2024-02-28T16:01:52.135 INFO:tasks.workunit.client.1.smithi087.stdout:8/339: stat d2/f8 0 2024-02-28T16:01:52.139 INFO:tasks.workunit.client.1.smithi087.stdout:8/340: chown d2/d18/f56 11 1 2024-02-28T16:01:52.140 INFO:tasks.workunit.client.1.smithi087.stdout:5/289: link d3/f34 d3/f61 0 2024-02-28T16:01:52.142 INFO:tasks.workunit.client.1.smithi087.stdout:5/290: read - d3/f59 zero size 2024-02-28T16:01:52.144 INFO:tasks.workunit.client.1.smithi087.stdout:2/307: sync 2024-02-28T16:01:52.144 INFO:tasks.workunit.client.1.smithi087.stdout:4/412: sync 2024-02-28T16:01:52.144 INFO:tasks.workunit.client.1.smithi087.stdout:3/278: rename d11/f18 to d11/d44/d5b/f5f 0 2024-02-28T16:01:52.153 INFO:tasks.workunit.client.1.smithi087.stdout:9/345: symlink d7/dd/d15/d39/d2e/l5e 0 2024-02-28T16:01:52.154 INFO:tasks.workunit.client.1.smithi087.stdout:8/341: symlink d2/d18/d42/d62/l6e 0 2024-02-28T16:01:52.158 INFO:tasks.workunit.client.1.smithi087.stdout:9/346: chown d7/dd/d3c/f53 543 1 2024-02-28T16:01:52.164 INFO:tasks.workunit.client.1.smithi087.stdout:5/291: rename d3/d6/f38 to d3/f62 0 2024-02-28T16:01:52.166 INFO:tasks.workunit.client.1.smithi087.stdout:8/342: unlink d2/d9/d1a/l69 0 2024-02-28T16:01:52.168 INFO:tasks.workunit.client.1.smithi087.stdout:1/317: dwrite d0/d1a/f3a [0,4194304] 0 2024-02-28T16:01:52.170 INFO:tasks.workunit.client.1.smithi087.stdout:9/347: mkdir d7/dd/d15/d3f/d5f 0 2024-02-28T16:01:52.170 INFO:tasks.workunit.client.1.smithi087.stdout:5/292: fsync d3/f21 0 2024-02-28T16:01:52.177 INFO:tasks.workunit.client.1.smithi087.stdout:1/318: readlink d0/d1b/d1f/l5e 0 2024-02-28T16:01:52.178 INFO:tasks.workunit.client.1.smithi087.stdout:4/413: dwrite d2/f7c [0,4194304] 0 2024-02-28T16:01:52.180 INFO:tasks.workunit.client.1.smithi087.stdout:3/279: dwrite d11/d33/f3d [0,4194304] 0 2024-02-28T16:01:52.184 INFO:tasks.workunit.client.1.smithi087.stdout:3/280: read f10 [1588805,75561] 0 2024-02-28T16:01:52.185 INFO:tasks.workunit.client.1.smithi087.stdout:1/319: fsync d0/d1a/f2e 0 2024-02-28T16:01:52.185 INFO:tasks.workunit.client.1.smithi087.stdout:2/308: dwrite d2/d7/df/d28/f43 [0,4194304] 0 2024-02-28T16:01:52.203 INFO:tasks.workunit.client.1.smithi087.stdout:4/414: dread d2/d9/da/f36 [0,4194304] 0 2024-02-28T16:01:52.204 INFO:tasks.workunit.client.1.smithi087.stdout:1/320: dread d0/f2 [0,4194304] 0 2024-02-28T16:01:52.219 INFO:tasks.workunit.client.1.smithi087.stdout:1/321: dread d0/d14/d48/f4e [0,4194304] 0 2024-02-28T16:01:52.221 INFO:tasks.workunit.client.1.smithi087.stdout:5/293: write d3/f61 [1409751,97006] 0 2024-02-28T16:01:52.227 INFO:tasks.workunit.client.1.smithi087.stdout:0/345: sync 2024-02-28T16:01:52.240 INFO:tasks.workunit.client.1.smithi087.stdout:2/309: symlink d2/d7/d17/d3d/l70 0 2024-02-28T16:01:52.247 INFO:tasks.workunit.client.1.smithi087.stdout:9/348: dwrite d7/f14 [4194304,4194304] 0 2024-02-28T16:01:52.247 INFO:tasks.workunit.client.1.smithi087.stdout:1/322: creat d0/d1a/d28/f65 x:0 0 0 2024-02-28T16:01:52.252 INFO:tasks.workunit.client.1.smithi087.stdout:9/349: readlink d7/dd/d36/l5d 0 2024-02-28T16:01:52.253 INFO:tasks.workunit.client.1.smithi087.stdout:8/343: getdents d2/d18/d42 0 2024-02-28T16:01:52.256 INFO:tasks.workunit.client.1.smithi087.stdout:0/346: mkdir d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d76 0 2024-02-28T16:01:52.260 INFO:tasks.workunit.client.1.smithi087.stdout:3/281: fdatasync d11/d33/f3d 0 2024-02-28T16:01:52.261 INFO:tasks.workunit.client.1.smithi087.stdout:3/282: chown d11/d45 345315 1 2024-02-28T16:01:52.269 INFO:tasks.workunit.client.1.smithi087.stdout:9/350: mkdir d7/d1e/d60 0 2024-02-28T16:01:52.272 INFO:tasks.workunit.client.1.smithi087.stdout:7/303: sync 2024-02-28T16:01:52.272 INFO:tasks.workunit.client.1.smithi087.stdout:6/356: sync 2024-02-28T16:01:52.274 INFO:tasks.workunit.client.1.smithi087.stdout:4/415: mknod d2/d9/d10/c93 0 2024-02-28T16:01:52.284 INFO:tasks.workunit.client.1.smithi087.stdout:5/294: rename d3/d6/d30/c39 to d3/d9/c63 0 2024-02-28T16:01:52.294 INFO:tasks.workunit.client.1.smithi087.stdout:9/351: dwrite d7/d1e/f5c [0,4194304] 0 2024-02-28T16:01:52.295 INFO:tasks.workunit.client.1.smithi087.stdout:4/416: unlink d2/d9/d10/l1e 0 2024-02-28T16:01:52.298 INFO:tasks.workunit.client.0.smithi057.stdout:6/31: sync 2024-02-28T16:01:52.301 INFO:tasks.workunit.client.1.smithi087.stdout:2/310: link d2/d7/df/d28/f2e d2/d42/f71 0 2024-02-28T16:01:52.303 INFO:tasks.workunit.client.0.smithi057.stdout:6/32: rename l8 to lb 0 2024-02-28T16:01:52.306 INFO:tasks.workunit.client.1.smithi087.stdout:2/311: chown d2/d7/d17/d34/c45 49166106 1 2024-02-28T16:01:52.308 INFO:tasks.workunit.client.1.smithi087.stdout:5/295: dread d3/f62 [0,4194304] 0 2024-02-28T16:01:52.309 INFO:tasks.workunit.client.0.smithi057.stdout:6/33: rename f0 to fc 0 2024-02-28T16:01:52.316 INFO:tasks.workunit.client.0.smithi057.stdout:6/34: symlink ld 0 2024-02-28T16:01:52.320 INFO:tasks.workunit.client.0.smithi057.stdout:6/35: link ld le 0 2024-02-28T16:01:52.322 INFO:tasks.workunit.client.1.smithi087.stdout:4/417: dwrite d2/d9/d10/d22/f27 [0,4194304] 0 2024-02-28T16:01:52.323 INFO:tasks.workunit.client.0.smithi057.stdout:6/36: mkdir df 0 2024-02-28T16:01:52.324 INFO:tasks.workunit.client.1.smithi087.stdout:8/344: mkdir d2/d9/d10/d24/d53/d6f 0 2024-02-28T16:01:52.324 INFO:tasks.workunit.client.1.smithi087.stdout:9/352: rename d7/dc/c48 to d7/dd/d15/d3f/d5f/c61 0 2024-02-28T16:01:52.325 INFO:tasks.workunit.client.0.smithi057.stdout:6/37: write f6 [2033542,130542] 0 2024-02-28T16:01:52.326 INFO:tasks.workunit.client.1.smithi087.stdout:0/347: getdents d4/dd/d21 0 2024-02-28T16:01:52.332 INFO:tasks.workunit.client.0.smithi057.stdout:6/38: mkdir df/d10 0 2024-02-28T16:01:52.335 INFO:tasks.workunit.client.1.smithi087.stdout:2/312: symlink d2/d7/df/l72 0 2024-02-28T16:01:52.335 INFO:tasks.workunit.client.0.smithi057.stdout:6/39: mkdir df/d11 0 2024-02-28T16:01:52.338 INFO:tasks.workunit.client.1.smithi087.stdout:2/313: write d2/d42/f44 [324021,38156] 0 2024-02-28T16:01:52.340 INFO:tasks.workunit.client.0.smithi057.stdout:6/40: rmdir df/d11 0 2024-02-28T16:01:52.345 INFO:tasks.workunit.client.1.smithi087.stdout:8/345: rename d2/d9/d1a/f4b to d2/d18/d42/f70 0 2024-02-28T16:01:52.346 INFO:tasks.workunit.client.0.smithi057.stdout:6/41: chown lb 28 1 2024-02-28T16:01:52.347 INFO:tasks.workunit.client.0.smithi057.stdout:6/42: chown f6 10 1 2024-02-28T16:01:52.348 INFO:tasks.workunit.client.0.smithi057.stdout:6/43: write f2 [2117214,84580] 0 2024-02-28T16:01:52.350 INFO:tasks.workunit.client.1.smithi087.stdout:0/348: mknod d4/dd/d37/d39/d3a/d57/d74/d1f/d34/c77 0 2024-02-28T16:01:52.352 INFO:tasks.workunit.client.1.smithi087.stdout:2/314: mknod d2/d7/df/c73 0 2024-02-28T16:01:52.357 INFO:tasks.workunit.client.1.smithi087.stdout:0/349: dread - d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/f51 zero size 2024-02-28T16:01:52.360 INFO:tasks.workunit.client.0.smithi057.stdout:6/44: truncate f6 1380778 0 2024-02-28T16:01:52.361 INFO:tasks.workunit.client.0.smithi057.stdout:6/45: read f2 [2388221,104807] 0 2024-02-28T16:01:52.363 INFO:tasks.workunit.client.1.smithi087.stdout:0/350: truncate d4/dd/d37/d39/f70 75744 0 2024-02-28T16:01:52.363 INFO:tasks.workunit.client.1.smithi087.stdout:6/357: mknod d4/d30/c7a 0 2024-02-28T16:01:52.372 INFO:tasks.workunit.client.1.smithi087.stdout:6/358: creat d4/d12/d45/d5e/f7b x:0 0 0 2024-02-28T16:01:52.372 INFO:tasks.workunit.client.1.smithi087.stdout:2/315: dwrite d2/d7/d17/d3d/d60/f67 [0,4194304] 0 2024-02-28T16:01:52.374 INFO:tasks.workunit.client.0.smithi057.stdout:6/46: dwrite f9 [0,4194304] 0 2024-02-28T16:01:52.375 INFO:tasks.workunit.client.1.smithi087.stdout:6/359: write d4/d12/d45/f5d [1045340,19663] 0 2024-02-28T16:01:52.376 INFO:tasks.workunit.client.1.smithi087.stdout:3/283: unlink cc 0 2024-02-28T16:01:52.376 INFO:tasks.workunit.client.0.smithi057.stdout:6/47: write f9 [87640,53896] 0 2024-02-28T16:01:52.378 INFO:tasks.workunit.client.1.smithi087.stdout:5/296: dread d3/f1c [0,4194304] 0 2024-02-28T16:01:52.379 INFO:tasks.workunit.client.1.smithi087.stdout:2/316: write d2/d7/d17/d34/f4a [692472,66620] 0 2024-02-28T16:01:52.382 INFO:tasks.workunit.client.1.smithi087.stdout:0/351: dread d4/dd/f1b [4194304,4194304] 0 2024-02-28T16:01:52.383 INFO:tasks.workunit.client.0.smithi057.stdout:6/48: creat df/f12 x:0 0 0 2024-02-28T16:01:52.384 INFO:tasks.workunit.client.1.smithi087.stdout:6/360: mknod d4/d30/d13/d38/c7c 0 2024-02-28T16:01:52.385 INFO:tasks.workunit.client.1.smithi087.stdout:6/361: chown d4/d30/d13 7327478 1 2024-02-28T16:01:52.388 INFO:tasks.workunit.client.1.smithi087.stdout:0/352: mknod d4/dd/d21/c78 0 2024-02-28T16:01:52.389 INFO:tasks.workunit.client.0.smithi057.stdout:6/49: mkdir df/d10/d13 0 2024-02-28T16:01:52.390 INFO:tasks.workunit.client.1.smithi087.stdout:6/362: rmdir d4/d30 39 2024-02-28T16:01:52.391 INFO:tasks.workunit.client.1.smithi087.stdout:1/323: mknod d0/c66 0 2024-02-28T16:01:52.392 INFO:tasks.workunit.client.1.smithi087.stdout:6/363: truncate d4/f76 1032192 0 2024-02-28T16:01:52.394 INFO:tasks.workunit.client.1.smithi087.stdout:6/364: chown d4/dc/c6c 207634 1 2024-02-28T16:01:52.398 INFO:tasks.workunit.client.1.smithi087.stdout:2/317: truncate d2/d7/df/f1e 494559 0 2024-02-28T16:01:52.400 INFO:tasks.workunit.client.1.smithi087.stdout:2/318: fdatasync d2/d7/f15 0 2024-02-28T16:01:52.407 INFO:tasks.workunit.client.1.smithi087.stdout:5/297: getdents d3/d6 0 2024-02-28T16:01:52.410 INFO:tasks.workunit.client.0.smithi057.stdout:6/50: getdents df 0 2024-02-28T16:01:52.411 INFO:tasks.workunit.client.1.smithi087.stdout:5/298: fsync d3/d6/f26 0 2024-02-28T16:01:52.411 INFO:tasks.workunit.client.1.smithi087.stdout:1/324: dwrite d0/d14/f17 [0,4194304] 0 2024-02-28T16:01:52.411 INFO:tasks.workunit.client.1.smithi087.stdout:3/284: mknod d11/c60 0 2024-02-28T16:01:52.412 INFO:tasks.workunit.client.0.smithi057.stdout:6/51: mkdir df/d14 0 2024-02-28T16:01:52.415 INFO:tasks.workunit.client.0.smithi057.stdout:6/52: unlink f2 0 2024-02-28T16:01:52.415 INFO:tasks.workunit.client.1.smithi087.stdout:9/353: rmdir d7/dd/d15 39 2024-02-28T16:01:52.416 INFO:tasks.workunit.client.0.smithi057.stdout:6/53: stat df/d14 0 2024-02-28T16:01:52.416 INFO:tasks.workunit.client.0.smithi057.stdout:6/54: dread - f5 zero size 2024-02-28T16:01:52.418 INFO:tasks.workunit.client.0.smithi057.stdout:6/55: read - df/f12 zero size 2024-02-28T16:01:52.418 INFO:tasks.workunit.client.1.smithi087.stdout:2/319: dread d2/d7/d17/d3d/f6c [0,4194304] 0 2024-02-28T16:01:52.419 INFO:tasks.workunit.client.1.smithi087.stdout:1/325: write d0/d1b/d43/d4d/f51 [4421536,12422] 0 2024-02-28T16:01:52.422 INFO:tasks.workunit.client.0.smithi057.stdout:6/56: mkdir df/d14/d15 0 2024-02-28T16:01:52.423 INFO:tasks.workunit.client.1.smithi087.stdout:6/365: dwrite d4/d30/d13/f3b [0,4194304] 0 2024-02-28T16:01:52.423 INFO:tasks.workunit.client.1.smithi087.stdout:4/418: truncate d2/d9/da/d1a/d26/f3d 2273665 0 2024-02-28T16:01:52.426 INFO:tasks.workunit.client.1.smithi087.stdout:2/320: creat d2/d7/d17/d3d/f74 x:0 0 0 2024-02-28T16:01:52.427 INFO:tasks.workunit.client.1.smithi087.stdout:1/326: mknod d0/d1a/c67 0 2024-02-28T16:01:52.432 INFO:tasks.workunit.client.1.smithi087.stdout:4/419: creat d2/d9/d10/d11/f94 x:0 0 0 2024-02-28T16:01:52.435 INFO:tasks.workunit.client.1.smithi087.stdout:2/321: read d2/d7/d17/d3d/d60/f67 [1446795,130917] 0 2024-02-28T16:01:52.438 INFO:tasks.workunit.client.1.smithi087.stdout:1/327: rename d0/d1b/d1f/c2c to d0/d1a/c68 0 2024-02-28T16:01:52.443 INFO:tasks.workunit.client.0.smithi057.stdout:6/57: dwrite fc [0,4194304] 0 2024-02-28T16:01:52.447 INFO:tasks.workunit.client.1.smithi087.stdout:5/299: truncate d3/d9/f1e 1405174 0 2024-02-28T16:01:52.448 INFO:tasks.workunit.client.0.smithi057.stdout:6/58: mkdir df/d14/d15/d16 0 2024-02-28T16:01:52.449 INFO:tasks.workunit.client.0.smithi057.stdout:6/59: truncate f5 450728 0 2024-02-28T16:01:52.450 INFO:tasks.workunit.client.0.smithi057.stdout:6/60: chown df/f12 23488 1 2024-02-28T16:01:52.450 INFO:tasks.workunit.client.1.smithi087.stdout:2/322: dread d2/d7/df/f1e [0,4194304] 0 2024-02-28T16:01:52.450 INFO:tasks.workunit.client.1.smithi087.stdout:5/300: mkdir d3/d64 0 2024-02-28T16:01:52.453 INFO:tasks.workunit.client.0.smithi057.stdout:6/61: creat df/d10/f17 x:0 0 0 2024-02-28T16:01:52.457 INFO:tasks.workunit.client.1.smithi087.stdout:1/328: truncate d0/d1a/f3a 4122307 0 2024-02-28T16:01:52.459 INFO:tasks.workunit.client.1.smithi087.stdout:1/329: chown d0/fa 4536133 1 2024-02-28T16:01:52.459 INFO:tasks.workunit.client.1.smithi087.stdout:2/323: symlink d2/d7/d17/d3d/l75 0 2024-02-28T16:01:52.461 INFO:tasks.workunit.client.1.smithi087.stdout:5/301: creat d3/d6/d30/f65 x:0 0 0 2024-02-28T16:01:52.463 INFO:tasks.workunit.client.1.smithi087.stdout:4/420: dwrite d2/df/d2e/f43 [0,4194304] 0 2024-02-28T16:01:52.465 INFO:tasks.workunit.client.1.smithi087.stdout:1/330: readlink d0/d1a/d28/l38 0 2024-02-28T16:01:52.466 INFO:tasks.workunit.client.1.smithi087.stdout:6/366: dwrite d4/dc/d61/f66 [0,4194304] 0 2024-02-28T16:01:52.467 INFO:tasks.workunit.client.1.smithi087.stdout:1/331: write d0/fd [1090130,3041] 0 2024-02-28T16:01:52.469 INFO:tasks.workunit.client.1.smithi087.stdout:4/421: dread - d2/d9/d10/d11/f94 zero size 2024-02-28T16:01:52.471 INFO:tasks.workunit.client.1.smithi087.stdout:5/302: rename d3/d9/f2d to d3/d6/d30/d53/d5b/f66 0 2024-02-28T16:01:52.471 INFO:tasks.workunit.client.1.smithi087.stdout:6/367: stat d4/d30/f24 0 2024-02-28T16:01:52.472 INFO:tasks.workunit.client.0.smithi057.stdout:6/62: dwrite fc [0,4194304] 0 2024-02-28T16:01:52.477 INFO:tasks.workunit.client.0.smithi057.stdout:6/63: mknod df/d10/d13/c18 0 2024-02-28T16:01:52.477 INFO:tasks.workunit.client.1.smithi087.stdout:4/422: rename d2/d9/d10/d22/l5e to d2/l95 0 2024-02-28T16:01:52.480 INFO:tasks.workunit.client.1.smithi087.stdout:6/368: fsync d4/d30/d13/d38/f68 0 2024-02-28T16:01:52.480 INFO:tasks.workunit.client.1.smithi087.stdout:4/423: chown d2/d9/d10/c93 0 1 2024-02-28T16:01:52.485 INFO:tasks.workunit.client.1.smithi087.stdout:2/324: getdents d2/d7/d17/d3d/d60 0 2024-02-28T16:01:52.485 INFO:tasks.workunit.client.1.smithi087.stdout:1/332: mkdir d0/d1d/d24/d5c/d69 0 2024-02-28T16:01:52.487 INFO:tasks.workunit.client.1.smithi087.stdout:5/303: mkdir d3/d64/d67 0 2024-02-28T16:01:52.487 INFO:tasks.workunit.client.1.smithi087.stdout:2/325: read - d2/d42/d4b/f52 zero size 2024-02-28T16:01:52.488 INFO:tasks.workunit.client.1.smithi087.stdout:6/369: truncate d4/d30/d13/d67/f72 562036 0 2024-02-28T16:01:52.488 INFO:tasks.workunit.client.1.smithi087.stdout:1/333: write d0/d1a/f2e [4556268,101982] 0 2024-02-28T16:01:52.491 INFO:tasks.workunit.client.1.smithi087.stdout:4/424: mkdir d2/d9/d10/d22/d5b/d5c/d90/d96 0 2024-02-28T16:01:52.495 INFO:tasks.workunit.client.1.smithi087.stdout:1/334: mknod d0/d14/c6a 0 2024-02-28T16:01:52.496 INFO:tasks.workunit.client.1.smithi087.stdout:6/370: mkdir d4/d7d 0 2024-02-28T16:01:52.497 INFO:tasks.workunit.client.0.smithi057.stdout:6/64: dread f9 [0,4194304] 0 2024-02-28T16:01:52.502 INFO:tasks.workunit.client.1.smithi087.stdout:2/326: link d2/d7/df/f4d d2/d42/f76 0 2024-02-28T16:01:52.505 INFO:tasks.workunit.client.1.smithi087.stdout:4/425: rename d2/d9/d10/d22/d5b/f75 to d2/d9/d10/d22/d5b/d5c/d91/f97 0 2024-02-28T16:01:52.509 INFO:tasks.workunit.client.1.smithi087.stdout:6/371: read d4/dc/d10/f2b [4130864,22731] 0 2024-02-28T16:01:52.510 INFO:tasks.workunit.client.1.smithi087.stdout:1/335: link d0/d14/f20 d0/d1a/d28/f6b 0 2024-02-28T16:01:52.513 INFO:tasks.workunit.client.1.smithi087.stdout:4/426: creat d2/d9/d10/d11/f98 x:0 0 0 2024-02-28T16:01:52.514 INFO:tasks.workunit.client.1.smithi087.stdout:1/336: mkdir d0/d14/d6c 0 2024-02-28T16:01:52.517 INFO:tasks.workunit.client.1.smithi087.stdout:6/372: mkdir d4/dc/d7e 0 2024-02-28T16:01:52.517 INFO:tasks.workunit.client.0.smithi057.stdout:6/65: dread f6 [0,4194304] 0 2024-02-28T16:01:52.519 INFO:tasks.workunit.client.1.smithi087.stdout:1/337: symlink d0/d1b/d43/l6d 0 2024-02-28T16:01:52.519 INFO:tasks.workunit.client.1.smithi087.stdout:6/373: write d4/dc/d61/f63 [764062,87516] 0 2024-02-28T16:01:52.524 INFO:tasks.workunit.client.0.smithi057.stdout:6/66: link ld df/d14/d15/l19 0 2024-02-28T16:01:52.525 INFO:tasks.workunit.client.1.smithi087.stdout:6/374: write d4/d12/d45/f28 [1369195,36634] 0 2024-02-28T16:01:52.527 INFO:tasks.workunit.client.0.smithi057.stdout:6/67: rmdir df/d10/d13 39 2024-02-28T16:01:52.531 INFO:tasks.workunit.client.1.smithi087.stdout:5/304: write d3/d9/d57/f4b [1753358,116615] 0 2024-02-28T16:01:52.533 INFO:tasks.workunit.client.1.smithi087.stdout:6/375: getdents d4/d12/d45 0 2024-02-28T16:01:52.535 INFO:tasks.workunit.client.1.smithi087.stdout:5/305: rmdir d3/d64 39 2024-02-28T16:01:52.535 INFO:tasks.workunit.client.1.smithi087.stdout:1/338: dread d0/d14/f17 [0,4194304] 0 2024-02-28T16:01:52.537 INFO:tasks.workunit.client.1.smithi087.stdout:2/327: dread d2/d7/f2d [0,4194304] 0 2024-02-28T16:01:52.539 INFO:tasks.workunit.client.1.smithi087.stdout:1/339: fdatasync d0/d1a/d28/f6b 0 2024-02-28T16:01:52.540 INFO:tasks.workunit.client.1.smithi087.stdout:6/376: write d4/dc/d10/f19 [49078,124147] 0 2024-02-28T16:01:52.542 INFO:tasks.workunit.client.1.smithi087.stdout:5/306: link d3/f52 d3/d9/f68 0 2024-02-28T16:01:52.542 INFO:tasks.workunit.client.0.smithi057.stdout:6/68: dwrite f9 [0,4194304] 0 2024-02-28T16:01:52.543 INFO:tasks.workunit.client.1.smithi087.stdout:2/328: symlink d2/d7/d17/l77 0 2024-02-28T16:01:52.545 INFO:tasks.workunit.client.1.smithi087.stdout:5/307: mkdir d3/d6/d69 0 2024-02-28T16:01:52.546 INFO:tasks.workunit.client.0.smithi057.stdout:6/69: symlink df/d10/l1a 0 2024-02-28T16:01:52.547 INFO:tasks.workunit.client.1.smithi087.stdout:6/377: symlink d4/d30/d13/l7f 0 2024-02-28T16:01:52.549 INFO:tasks.workunit.client.1.smithi087.stdout:1/340: getdents d0/d1b/d43 0 2024-02-28T16:01:52.549 INFO:tasks.workunit.client.1.smithi087.stdout:2/329: mkdir d2/d7/df/d28/d78 0 2024-02-28T16:01:52.552 INFO:tasks.workunit.client.1.smithi087.stdout:6/378: mknod d4/d12/d45/d57/c80 0 2024-02-28T16:01:52.553 INFO:tasks.workunit.client.1.smithi087.stdout:2/330: unlink d2/d7/df/c6f 0 2024-02-28T16:01:52.555 INFO:tasks.workunit.client.1.smithi087.stdout:2/331: chown d2/d7/df/l6b 3829105 1 2024-02-28T16:01:52.557 INFO:tasks.workunit.client.1.smithi087.stdout:1/341: rmdir d0/d14/d6c 0 2024-02-28T16:01:52.558 INFO:tasks.workunit.client.0.smithi057.stdout:6/70: getdents df/d10 0 2024-02-28T16:01:52.559 INFO:tasks.workunit.client.0.smithi057.stdout:6/71: chown f9 1743682 1 2024-02-28T16:01:52.560 INFO:tasks.workunit.client.1.smithi087.stdout:6/379: rename d4/d12/d45/f28 to d4/d30/d42/f81 0 2024-02-28T16:01:52.563 INFO:tasks.workunit.client.1.smithi087.stdout:7/304: sync 2024-02-28T16:01:52.564 INFO:tasks.workunit.client.0.smithi057.stdout:6/72: dread f6 [0,4194304] 0 2024-02-28T16:01:52.565 INFO:tasks.workunit.client.0.smithi057.stdout:6/73: chown df/d14/d15 233 1 2024-02-28T16:01:52.567 INFO:tasks.workunit.client.0.smithi057.stdout:6/74: creat df/f1b x:0 0 0 2024-02-28T16:01:52.569 INFO:tasks.workunit.client.1.smithi087.stdout:6/380: mknod d4/c82 0 2024-02-28T16:01:52.569 INFO:tasks.workunit.client.1.smithi087.stdout:7/305: dread f10 [0,4194304] 0 2024-02-28T16:01:52.570 INFO:tasks.workunit.client.1.smithi087.stdout:1/342: creat d0/d1d/f6e x:0 0 0 2024-02-28T16:01:52.572 INFO:tasks.workunit.client.1.smithi087.stdout:5/308: symlink d3/d6/d69/l6a 0 2024-02-28T16:01:52.575 INFO:tasks.workunit.client.1.smithi087.stdout:7/306: symlink d14/d2e/d2b/l5f 0 2024-02-28T16:01:52.576 INFO:tasks.workunit.client.0.smithi057.stdout:6/75: dread f9 [0,4194304] 0 2024-02-28T16:01:52.577 INFO:tasks.workunit.client.1.smithi087.stdout:2/332: write d2/d7/d17/d34/f6e [4915967,98001] 0 2024-02-28T16:01:52.578 INFO:tasks.workunit.client.0.smithi057.stdout:6/76: write df/d10/f17 [132450,123473] 0 2024-02-28T16:01:52.581 INFO:tasks.workunit.client.1.smithi087.stdout:7/307: symlink d14/l60 0 2024-02-28T16:01:52.582 INFO:tasks.workunit.client.1.smithi087.stdout:5/309: link d3/d6/d69/l6a d3/d9/d4a/l6b 0 2024-02-28T16:01:52.586 INFO:tasks.workunit.client.1.smithi087.stdout:7/308: fsync d14/d2e/d2b/f50 0 2024-02-28T16:01:52.586 INFO:tasks.workunit.client.1.smithi087.stdout:5/310: chown d3/d6/f23 1904065473 1 2024-02-28T16:01:52.589 INFO:tasks.workunit.client.1.smithi087.stdout:1/343: dwrite d0/d1d/d24/f36 [4194304,4194304] 0 2024-02-28T16:01:52.590 INFO:tasks.workunit.client.1.smithi087.stdout:7/309: creat d14/d21/f61 x:0 0 0 2024-02-28T16:01:52.591 INFO:tasks.workunit.client.0.smithi057.stdout:6/77: dwrite df/d10/f17 [0,4194304] 0 2024-02-28T16:01:52.593 INFO:tasks.workunit.client.1.smithi087.stdout:5/311: creat d3/d6/d30/d53/d5b/f6c x:0 0 0 2024-02-28T16:01:52.593 INFO:tasks.workunit.client.1.smithi087.stdout:6/381: dwrite d4/d12/f6d [0,4194304] 0 2024-02-28T16:01:52.596 INFO:tasks.workunit.client.1.smithi087.stdout:7/310: write d14/d21/f47 [1715552,111815] 0 2024-02-28T16:01:52.597 INFO:tasks.workunit.client.0.smithi057.stdout:6/78: dread f5 [0,4194304] 0 2024-02-28T16:01:52.599 INFO:tasks.workunit.client.1.smithi087.stdout:1/344: symlink d0/d1d/l6f 0 2024-02-28T16:01:52.600 INFO:tasks.workunit.client.0.smithi057.stdout:6/79: chown df 43 1 2024-02-28T16:01:52.601 INFO:tasks.workunit.client.1.smithi087.stdout:6/382: mkdir d4/d30/d83 0 2024-02-28T16:01:52.603 INFO:tasks.workunit.client.1.smithi087.stdout:7/311: mknod d14/c62 0 2024-02-28T16:01:52.604 INFO:tasks.workunit.client.1.smithi087.stdout:5/312: mknod d3/d64/d67/c6d 0 2024-02-28T16:01:52.608 INFO:tasks.workunit.client.0.smithi057.stdout:6/80: creat df/d14/f1c x:0 0 0 2024-02-28T16:01:52.608 INFO:tasks.workunit.client.0.smithi057.stdout:6/81: symlink df/d10/l1d 0 2024-02-28T16:01:52.608 INFO:tasks.workunit.client.1.smithi087.stdout:7/312: truncate d14/f2a 5237414 0 2024-02-28T16:01:52.608 INFO:tasks.workunit.client.1.smithi087.stdout:1/345: chown d0/d14/f42 693988 1 2024-02-28T16:01:52.612 INFO:tasks.workunit.client.1.smithi087.stdout:2/333: dwrite d2/d7/df/d28/f32 [0,4194304] 0 2024-02-28T16:01:52.614 INFO:tasks.workunit.client.1.smithi087.stdout:7/313: rmdir d14/d46 39 2024-02-28T16:01:52.614 INFO:tasks.workunit.client.1.smithi087.stdout:1/346: creat d0/f70 x:0 0 0 2024-02-28T16:01:52.616 INFO:tasks.workunit.client.1.smithi087.stdout:7/314: readlink d14/d27/l29 0 2024-02-28T16:01:52.620 INFO:tasks.workunit.client.1.smithi087.stdout:6/383: dread d4/dc/d61/f63 [0,4194304] 0 2024-02-28T16:01:52.621 INFO:tasks.workunit.client.0.smithi057.stdout:6/82: rename f5 to df/d10/d13/f1e 0 2024-02-28T16:01:52.623 INFO:tasks.workunit.client.1.smithi087.stdout:7/315: rename d14/d2e/c3b to d14/d2e/d2b/c63 0 2024-02-28T16:01:52.624 INFO:tasks.workunit.client.1.smithi087.stdout:7/316: chown d14/d21 28694946 1 2024-02-28T16:01:52.626 INFO:tasks.workunit.client.1.smithi087.stdout:7/317: write f7 [1784025,17624] 0 2024-02-28T16:01:52.627 INFO:tasks.workunit.client.1.smithi087.stdout:6/384: creat d4/d30/f84 x:0 0 0 2024-02-28T16:01:52.630 INFO:tasks.workunit.client.1.smithi087.stdout:7/318: fdatasync d14/d21/f41 0 2024-02-28T16:01:52.630 INFO:tasks.workunit.client.0.smithi057.stdout:6/83: dread fc [0,4194304] 0 2024-02-28T16:01:52.632 INFO:tasks.workunit.client.1.smithi087.stdout:1/347: write d0/d1a/d28/f3b [3890458,106435] 0 2024-02-28T16:01:52.634 INFO:tasks.workunit.client.0.smithi057.stdout:6/84: creat df/f1f x:0 0 0 2024-02-28T16:01:52.635 INFO:tasks.workunit.client.0.smithi057.stdout:6/85: dread - df/d14/f1c zero size 2024-02-28T16:01:52.636 INFO:tasks.workunit.client.1.smithi087.stdout:7/319: write d14/d21/f26 [5410442,27096] 0 2024-02-28T16:01:52.638 INFO:tasks.workunit.client.0.smithi057.stdout:6/86: read df/d10/f17 [1029673,91354] 0 2024-02-28T16:01:52.638 INFO:tasks.workunit.client.1.smithi087.stdout:5/313: dwrite d3/d9/d57/f47 [0,4194304] 0 2024-02-28T16:01:52.640 INFO:tasks.workunit.client.1.smithi087.stdout:5/314: chown d3/d6/d30/d36/d4f 3214173 1 2024-02-28T16:01:52.642 INFO:tasks.workunit.client.0.smithi057.stdout:6/87: symlink df/l20 0 2024-02-28T16:01:52.642 INFO:tasks.workunit.client.1.smithi087.stdout:1/348: mkdir d0/d1b/d1f/d71 0 2024-02-28T16:01:52.643 INFO:tasks.workunit.client.1.smithi087.stdout:5/315: readlink d3/d9/d4a/l6b 0 2024-02-28T16:01:52.648 INFO:tasks.workunit.client.1.smithi087.stdout:7/320: link d14/d2e/d2b/f2c d14/f64 0 2024-02-28T16:01:52.649 INFO:tasks.workunit.client.1.smithi087.stdout:7/321: fsync d14/d21/f61 0 2024-02-28T16:01:52.651 INFO:tasks.workunit.client.1.smithi087.stdout:1/349: rename d0/d14/d48/f4e to d0/d1d/f72 0 2024-02-28T16:01:52.654 INFO:tasks.workunit.client.1.smithi087.stdout:5/316: read d3/d6/f23 [1554125,85399] 0 2024-02-28T16:01:52.654 INFO:tasks.workunit.client.1.smithi087.stdout:6/385: dwrite d4/dc/f55 [0,4194304] 0 2024-02-28T16:01:52.657 INFO:tasks.workunit.client.1.smithi087.stdout:7/322: rename d14/d2e/d2b/c43 to d14/d27/d5d/c65 0 2024-02-28T16:01:52.657 INFO:tasks.workunit.client.1.smithi087.stdout:1/350: creat d0/d1a/f73 x:0 0 0 2024-02-28T16:01:52.659 INFO:tasks.workunit.client.1.smithi087.stdout:7/323: chown d14/d2e/f22 62550 1 2024-02-28T16:01:52.661 INFO:tasks.workunit.client.1.smithi087.stdout:6/386: creat d4/d12/d45/d74/f85 x:0 0 0 2024-02-28T16:01:52.661 INFO:tasks.workunit.client.1.smithi087.stdout:7/324: chown d14/d2e/d2b/f4b 0 1 2024-02-28T16:01:52.662 INFO:tasks.workunit.client.1.smithi087.stdout:5/317: creat d3/d6/d30/d44/d54/f6e x:0 0 0 2024-02-28T16:01:52.664 INFO:tasks.workunit.client.1.smithi087.stdout:1/351: creat d0/d1b/d43/d4d/f74 x:0 0 0 2024-02-28T16:01:52.664 INFO:tasks.workunit.client.1.smithi087.stdout:7/325: truncate d14/d21/f47 2718405 0 2024-02-28T16:01:52.665 INFO:tasks.workunit.client.0.smithi057.stdout:6/88: dwrite df/d10/f17 [0,4194304] 0 2024-02-28T16:01:52.665 INFO:tasks.workunit.client.1.smithi087.stdout:5/318: chown d3/d9/f15 1008132632 1 2024-02-28T16:01:52.666 INFO:tasks.workunit.client.1.smithi087.stdout:1/352: chown d0/d14/f20 3839329 1 2024-02-28T16:01:52.667 INFO:tasks.workunit.client.1.smithi087.stdout:1/353: readlink d0/l40 0 2024-02-28T16:01:52.667 INFO:tasks.workunit.client.1.smithi087.stdout:6/387: creat d4/d12/d45/f86 x:0 0 0 2024-02-28T16:01:52.668 INFO:tasks.workunit.client.0.smithi057.stdout:6/89: read df/d10/d13/f1e [18486,43014] 0 2024-02-28T16:01:52.669 INFO:tasks.workunit.client.0.smithi057.stdout:6/90: rmdir df/d10 39 2024-02-28T16:01:52.671 INFO:tasks.workunit.client.1.smithi087.stdout:5/319: symlink d3/d6/l6f 0 2024-02-28T16:01:52.672 INFO:tasks.workunit.client.0.smithi057.stdout:6/91: symlink df/d14/d15/l21 0 2024-02-28T16:01:52.675 INFO:tasks.workunit.client.0.smithi057.stdout:6/92: rmdir df/d10/d13 39 2024-02-28T16:01:52.676 INFO:tasks.workunit.client.1.smithi087.stdout:6/388: unlink d4/d12/d45/d5e/f7b 0 2024-02-28T16:01:52.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:52 smithi057 ceph-mon[28763]: pgmap v28: 65 pgs: 65 active+clean; 553 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 2.1 MiB/s rd, 58 MiB/s wr, 230 op/s 2024-02-28T16:01:52.677 INFO:tasks.workunit.client.1.smithi087.stdout:1/354: symlink d0/d14/d3f/d61/l75 0 2024-02-28T16:01:52.680 INFO:tasks.workunit.client.0.smithi057.stdout:6/93: rename df/d14/f1c to df/d10/f22 0 2024-02-28T16:01:52.681 INFO:tasks.workunit.client.1.smithi087.stdout:5/320: creat d3/d6/f70 x:0 0 0 2024-02-28T16:01:52.681 INFO:tasks.workunit.client.1.smithi087.stdout:6/389: dread - d4/d30/d13/d38/d69/f6f zero size 2024-02-28T16:01:52.682 INFO:tasks.workunit.client.0.smithi057.stdout:6/94: write df/f1b [133250,42497] 0 2024-02-28T16:01:52.684 INFO:tasks.workunit.client.1.smithi087.stdout:6/390: creat d4/d30/d13/d67/f87 x:0 0 0 2024-02-28T16:01:52.687 INFO:tasks.workunit.client.1.smithi087.stdout:7/326: dread d14/d21/f47 [0,4194304] 0 2024-02-28T16:01:52.687 INFO:tasks.workunit.client.0.smithi057.stdout:6/95: dread f6 [0,4194304] 0 2024-02-28T16:01:52.692 INFO:tasks.workunit.client.1.smithi087.stdout:5/321: dread d3/d9/f2a [0,4194304] 0 2024-02-28T16:01:52.692 INFO:tasks.workunit.client.0.smithi057.stdout:6/96: fdatasync f6 0 2024-02-28T16:01:52.694 INFO:tasks.workunit.client.1.smithi087.stdout:5/322: chown d3/d6/f2f 702580807 1 2024-02-28T16:01:52.696 INFO:tasks.workunit.client.1.smithi087.stdout:1/355: dread d0/d14/f20 [0,4194304] 0 2024-02-28T16:01:52.697 INFO:tasks.workunit.client.1.smithi087.stdout:5/323: stat d3/d6/d30/f32 0 2024-02-28T16:01:52.699 INFO:tasks.workunit.client.1.smithi087.stdout:5/324: symlink d3/d6/d69/l71 0 2024-02-28T16:01:52.702 INFO:tasks.workunit.client.1.smithi087.stdout:7/327: dwrite d14/d21/f26 [0,4194304] 0 2024-02-28T16:01:52.702 INFO:tasks.workunit.client.1.smithi087.stdout:1/356: rename d0/d1b/d1f/c27 to d0/d1b/c76 0 2024-02-28T16:01:52.705 INFO:tasks.workunit.client.1.smithi087.stdout:7/328: write d14/d21/f47 [1208568,38211] 0 2024-02-28T16:01:52.706 INFO:tasks.workunit.client.1.smithi087.stdout:7/329: fsync d14/d2e/d2b/d4e/f52 0 2024-02-28T16:01:52.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:52 smithi087 ceph-mon[37122]: pgmap v28: 65 pgs: 65 active+clean; 553 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 2.1 MiB/s rd, 58 MiB/s wr, 230 op/s 2024-02-28T16:01:52.718 INFO:tasks.workunit.client.1.smithi087.stdout:1/357: dwrite d0/d1a/f2e [4194304,4194304] 0 2024-02-28T16:01:52.724 INFO:tasks.workunit.client.1.smithi087.stdout:5/325: dwrite d3/f62 [0,4194304] 0 2024-02-28T16:01:52.726 INFO:tasks.workunit.client.1.smithi087.stdout:5/326: chown d3/d9/f2a 191 1 2024-02-28T16:01:52.729 INFO:tasks.workunit.client.1.smithi087.stdout:7/330: dwrite d14/d2e/d2b/f4b [0,4194304] 0 2024-02-28T16:01:52.730 INFO:tasks.workunit.client.1.smithi087.stdout:1/358: truncate d0/d14/f18 68865 0 2024-02-28T16:01:52.731 INFO:tasks.workunit.client.1.smithi087.stdout:5/327: read d3/d9/f15 [850700,59322] 0 2024-02-28T16:01:52.737 INFO:tasks.workunit.client.1.smithi087.stdout:1/359: rename d0/d1a/d28/f3b to d0/d1b/d1f/f77 0 2024-02-28T16:01:52.739 INFO:tasks.workunit.client.1.smithi087.stdout:7/331: link d14/d21/d4f/f53 d14/d2e/f66 0 2024-02-28T16:01:52.740 INFO:tasks.workunit.client.1.smithi087.stdout:1/360: mkdir d0/d1d/d24/d78 0 2024-02-28T16:01:52.741 INFO:tasks.workunit.client.1.smithi087.stdout:5/328: creat d3/d6/f72 x:0 0 0 2024-02-28T16:01:52.744 INFO:tasks.workunit.client.1.smithi087.stdout:1/361: chown d0/d1d/d24/l46 26351856 1 2024-02-28T16:01:52.746 INFO:tasks.workunit.client.1.smithi087.stdout:7/332: link d14/d21/f3e d14/d2e/d2b/f67 0 2024-02-28T16:01:52.749 INFO:tasks.workunit.client.1.smithi087.stdout:7/333: mkdir d14/d46/d68 0 2024-02-28T16:01:52.751 INFO:tasks.workunit.client.1.smithi087.stdout:7/334: creat d14/d2e/d2b/f69 x:0 0 0 2024-02-28T16:01:52.753 INFO:tasks.workunit.client.1.smithi087.stdout:7/335: mkdir d14/d27/d5d/d6a 0 2024-02-28T16:01:52.758 INFO:tasks.workunit.client.1.smithi087.stdout:7/336: getdents d14 0 2024-02-28T16:01:52.758 INFO:tasks.workunit.client.1.smithi087.stdout:5/329: dwrite d3/d6/f20 [0,4194304] 0 2024-02-28T16:01:52.759 INFO:tasks.workunit.client.1.smithi087.stdout:7/337: chown d14/d21/c24 40 1 2024-02-28T16:01:52.759 INFO:tasks.workunit.client.1.smithi087.stdout:5/330: readlink d3/d6/d30/d36/l42 0 2024-02-28T16:01:52.760 INFO:tasks.workunit.client.1.smithi087.stdout:5/331: readlink d3/d6/l5c 0 2024-02-28T16:01:52.762 INFO:tasks.workunit.client.1.smithi087.stdout:7/338: unlink f10 0 2024-02-28T16:01:52.763 INFO:tasks.workunit.client.1.smithi087.stdout:5/332: symlink d3/d6/d30/d36/l73 0 2024-02-28T16:01:52.766 INFO:tasks.workunit.client.1.smithi087.stdout:5/333: mknod d3/d6/d30/d44/d54/c74 0 2024-02-28T16:01:52.771 INFO:tasks.workunit.client.1.smithi087.stdout:7/339: dread d14/f5b [0,4194304] 0 2024-02-28T16:01:52.774 INFO:tasks.workunit.client.1.smithi087.stdout:7/340: mknod d14/d46/d68/c6b 0 2024-02-28T16:01:52.775 INFO:tasks.workunit.client.1.smithi087.stdout:7/341: dread - d14/d46/f4c zero size 2024-02-28T16:01:52.779 INFO:tasks.workunit.client.1.smithi087.stdout:7/342: symlink d14/d30/l6c 0 2024-02-28T16:01:52.781 INFO:tasks.workunit.client.1.smithi087.stdout:5/334: dwrite d3/d6/d30/d36/f4e [0,4194304] 0 2024-02-28T16:01:52.781 INFO:tasks.workunit.client.1.smithi087.stdout:7/343: creat d14/d27/f6d x:0 0 0 2024-02-28T16:01:52.783 INFO:tasks.workunit.client.1.smithi087.stdout:7/344: truncate d14/d21/f61 404497 0 2024-02-28T16:01:52.785 INFO:tasks.workunit.client.1.smithi087.stdout:7/345: write d14/d2e/d2b/d4e/f52 [335673,68845] 0 2024-02-28T16:01:52.795 INFO:tasks.workunit.client.1.smithi087.stdout:5/335: dwrite d3/d6/d30/d53/d5b/f66 [0,4194304] 0 2024-02-28T16:01:52.798 INFO:tasks.workunit.client.1.smithi087.stdout:5/336: creat d3/d6/d30/d44/d54/f75 x:0 0 0 2024-02-28T16:01:52.802 INFO:tasks.workunit.client.1.smithi087.stdout:5/337: link d3/f52 d3/d64/d67/f76 0 2024-02-28T16:01:52.804 INFO:tasks.workunit.client.1.smithi087.stdout:5/338: mknod d3/d64/c77 0 2024-02-28T16:01:52.805 INFO:tasks.workunit.client.1.smithi087.stdout:5/339: creat d3/d9/d57/f78 x:0 0 0 2024-02-28T16:01:52.807 INFO:tasks.workunit.client.1.smithi087.stdout:5/340: creat d3/d9/f79 x:0 0 0 2024-02-28T16:01:52.812 INFO:tasks.workunit.client.1.smithi087.stdout:5/341: link d3/d9/d4a/f50 d3/d6/d30/d36/f7a 0 2024-02-28T16:01:52.813 INFO:tasks.workunit.client.1.smithi087.stdout:8/346: sync 2024-02-28T16:01:52.815 INFO:tasks.workunit.client.1.smithi087.stdout:5/342: creat d3/d64/d67/f7b x:0 0 0 2024-02-28T16:01:52.817 INFO:tasks.workunit.client.1.smithi087.stdout:5/343: read - d3/d6/d30/d44/d54/f75 zero size 2024-02-28T16:01:52.826 INFO:tasks.workunit.client.1.smithi087.stdout:8/347: dwrite d2/d33/f35 [0,4194304] 0 2024-02-28T16:01:52.829 INFO:tasks.workunit.client.1.smithi087.stdout:8/348: creat d2/d33/f71 x:0 0 0 2024-02-28T16:01:52.831 INFO:tasks.workunit.client.1.smithi087.stdout:8/349: readlink d2/d18/d42/d62/l6e 0 2024-02-28T16:01:52.834 INFO:tasks.workunit.client.1.smithi087.stdout:8/350: chown d2/d18/d25/l11 6882 1 2024-02-28T16:01:52.835 INFO:tasks.workunit.client.1.smithi087.stdout:5/344: dwrite d3/d6/d30/d53/d5b/f66 [0,4194304] 0 2024-02-28T16:01:52.837 INFO:tasks.workunit.client.1.smithi087.stdout:5/345: dread - d3/d6/d30/d44/d54/f6e zero size 2024-02-28T16:01:52.838 INFO:tasks.workunit.client.1.smithi087.stdout:8/351: creat d2/d9/d10/d24/d53/f72 x:0 0 0 2024-02-28T16:01:52.840 INFO:tasks.workunit.client.1.smithi087.stdout:5/346: chown d3/d6/cc 169517 1 2024-02-28T16:01:52.841 INFO:tasks.workunit.client.1.smithi087.stdout:8/352: rename d2/l38 to d2/d63/l73 0 2024-02-28T16:01:52.841 INFO:tasks.workunit.client.1.smithi087.stdout:5/347: stat d3/d6/l5c 0 2024-02-28T16:01:52.843 INFO:tasks.workunit.client.1.smithi087.stdout:5/348: mkdir d3/d64/d67/d7c 0 2024-02-28T16:01:52.844 INFO:tasks.workunit.client.1.smithi087.stdout:8/353: creat d2/d9/d10/d24/d53/d6f/f74 x:0 0 0 2024-02-28T16:01:52.845 INFO:tasks.workunit.client.1.smithi087.stdout:5/349: stat d3/d6/d30/d36/c4d 0 2024-02-28T16:01:52.846 INFO:tasks.workunit.client.1.smithi087.stdout:8/354: truncate d2/f8 10229576 0 2024-02-28T16:01:52.848 INFO:tasks.workunit.client.1.smithi087.stdout:5/350: creat d3/d6/d69/f7d x:0 0 0 2024-02-28T16:01:52.849 INFO:tasks.workunit.client.1.smithi087.stdout:5/351: read d3/f62 [4150847,17448] 0 2024-02-28T16:01:52.852 INFO:tasks.workunit.client.1.smithi087.stdout:5/352: chown d3/d6/d30/d36/f4e 4 1 2024-02-28T16:01:52.855 INFO:tasks.workunit.client.1.smithi087.stdout:5/353: mknod d3/d6/d30/d53/c7e 0 2024-02-28T16:01:52.857 INFO:tasks.workunit.client.1.smithi087.stdout:5/354: rmdir d3/d64 39 2024-02-28T16:01:52.861 INFO:tasks.workunit.client.1.smithi087.stdout:5/355: write d3/d64/d67/f7b [288158,43118] 0 2024-02-28T16:01:52.861 INFO:tasks.workunit.client.1.smithi087.stdout:8/355: dwrite d2/d33/f3e [0,4194304] 0 2024-02-28T16:01:52.864 INFO:tasks.workunit.client.1.smithi087.stdout:8/356: write d2/f27 [2890931,105828] 0 2024-02-28T16:01:52.866 INFO:tasks.workunit.client.1.smithi087.stdout:8/357: symlink d2/d18/d42/d62/l75 0 2024-02-28T16:01:52.868 INFO:tasks.workunit.client.1.smithi087.stdout:8/358: symlink d2/d18/d42/l76 0 2024-02-28T16:01:52.879 INFO:tasks.workunit.client.1.smithi087.stdout:5/356: dwrite d3/d9/f79 [0,4194304] 0 2024-02-28T16:01:52.887 INFO:tasks.workunit.client.0.smithi057.stdout:4/69: sync 2024-02-28T16:01:52.887 INFO:tasks.workunit.client.0.smithi057.stdout:1/120: sync 2024-02-28T16:01:52.927 INFO:tasks.workunit.client.0.smithi057.stdout:1/121: dread d1/d3/dc/f10 [0,4194304] 0 2024-02-28T16:01:52.931 INFO:tasks.workunit.client.0.smithi057.stdout:4/70: truncate d1/f11 3747658 0 2024-02-28T16:01:52.934 INFO:tasks.workunit.client.0.smithi057.stdout:1/122: write d1/d3/dc/f10 [4991156,3302] 0 2024-02-28T16:01:52.936 INFO:tasks.workunit.client.0.smithi057.stdout:1/123: write d1/f19 [1790670,67037] 0 2024-02-28T16:01:52.940 INFO:tasks.workunit.client.0.smithi057.stdout:1/124: symlink d1/d21/d25/l28 0 2024-02-28T16:01:52.940 INFO:tasks.workunit.client.0.smithi057.stdout:4/71: link d1/f4 d1/d10/d12/f1d 0 2024-02-28T16:01:52.944 INFO:tasks.workunit.client.1.smithi087.stdout:7/346: write d14/d2e/d2b/f2c [2820409,36176] 0 2024-02-28T16:01:52.944 INFO:tasks.workunit.client.0.smithi057.stdout:1/125: dread - d1/d3/dc/f12 zero size 2024-02-28T16:01:52.944 INFO:tasks.workunit.client.0.smithi057.stdout:4/72: mknod d1/c1e 0 2024-02-28T16:01:52.947 INFO:tasks.workunit.client.1.smithi087.stdout:9/354: sync 2024-02-28T16:01:52.947 INFO:tasks.workunit.client.1.smithi087.stdout:3/285: sync 2024-02-28T16:01:52.947 INFO:tasks.workunit.client.1.smithi087.stdout:0/353: sync 2024-02-28T16:01:52.947 INFO:tasks.workunit.client.1.smithi087.stdout:2/334: sync 2024-02-28T16:01:52.948 INFO:tasks.workunit.client.0.smithi057.stdout:1/126: rename d1/d3/fb to d1/d3/dc/f29 0 2024-02-28T16:01:52.948 INFO:tasks.workunit.client.1.smithi087.stdout:4/427: sync 2024-02-28T16:01:52.949 INFO:tasks.workunit.client.0.smithi057.stdout:1/127: write d1/d3/dc/f10 [4215413,125593] 0 2024-02-28T16:01:52.950 INFO:tasks.workunit.client.1.smithi087.stdout:5/357: getdents d3/d6/d30/d36 0 2024-02-28T16:01:52.950 INFO:tasks.workunit.client.1.smithi087.stdout:3/286: fdatasync d11/d44/f56 0 2024-02-28T16:01:52.952 INFO:tasks.workunit.client.1.smithi087.stdout:9/355: write d7/f8 [9448963,128343] 0 2024-02-28T16:01:52.952 INFO:tasks.workunit.client.1.smithi087.stdout:5/358: readlink d3/d9/l17 0 2024-02-28T16:01:52.953 INFO:tasks.workunit.client.0.smithi057.stdout:1/128: dread - d1/d3/dc/f12 zero size 2024-02-28T16:01:52.955 INFO:tasks.workunit.client.1.smithi087.stdout:4/428: mknod d2/d9/da/c99 0 2024-02-28T16:01:52.955 INFO:tasks.workunit.client.1.smithi087.stdout:5/359: chown d3/d9/d4a 1 1 2024-02-28T16:01:52.955 INFO:tasks.workunit.client.1.smithi087.stdout:2/335: mkdir d2/d7/df/d28/d79 0 2024-02-28T16:01:52.957 INFO:tasks.workunit.client.1.smithi087.stdout:3/287: fsync d11/d45/f47 0 2024-02-28T16:01:52.960 INFO:tasks.workunit.client.1.smithi087.stdout:3/288: readlink d11/l27 0 2024-02-28T16:01:52.960 INFO:tasks.workunit.client.0.smithi057.stdout:1/129: creat d1/d3/f2a x:0 0 0 2024-02-28T16:01:52.961 INFO:tasks.workunit.client.1.smithi087.stdout:3/289: chown d11/f36 2000743 1 2024-02-28T16:01:52.963 INFO:tasks.workunit.client.1.smithi087.stdout:8/359: truncate d2/d9/d1a/f46 407117 0 2024-02-28T16:01:52.965 INFO:tasks.workunit.client.0.smithi057.stdout:1/130: read d1/d3/f11 [2225273,118265] 0 2024-02-28T16:01:52.967 INFO:tasks.workunit.client.0.smithi057.stdout:4/73: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:01:52.969 INFO:tasks.workunit.client.1.smithi087.stdout:0/354: dwrite d4/f48 [0,4194304] 0 2024-02-28T16:01:52.969 INFO:tasks.workunit.client.1.smithi087.stdout:4/429: getdents d2/d9/da/d1a 0 2024-02-28T16:01:52.970 INFO:tasks.workunit.client.1.smithi087.stdout:3/290: mkdir d11/d61 0 2024-02-28T16:01:52.971 INFO:tasks.workunit.client.0.smithi057.stdout:1/131: symlink d1/d21/d25/d26/l2b 0 2024-02-28T16:01:52.972 INFO:tasks.workunit.client.1.smithi087.stdout:8/360: fsync d2/d9/f5d 0 2024-02-28T16:01:52.974 INFO:tasks.workunit.client.1.smithi087.stdout:9/356: dwrite d7/dd/d3c/f53 [0,4194304] 0 2024-02-28T16:01:52.975 INFO:tasks.workunit.client.1.smithi087.stdout:8/361: dread - d2/d9/d1a/f48 zero size 2024-02-28T16:01:52.975 INFO:tasks.workunit.client.0.smithi057.stdout:4/74: chown d1/d10/d12/d15/l1c 8722 1 2024-02-28T16:01:52.976 INFO:tasks.workunit.client.1.smithi087.stdout:0/355: read d4/dd/d37/d39/f70 [21958,49535] 0 2024-02-28T16:01:52.976 INFO:tasks.workunit.client.1.smithi087.stdout:2/336: rename d2/d7/df/l6b to d2/d7/l7a 0 2024-02-28T16:01:52.976 INFO:tasks.workunit.client.1.smithi087.stdout:9/357: read d7/dc/f59 [3469968,23304] 0 2024-02-28T16:01:52.978 INFO:tasks.workunit.client.1.smithi087.stdout:1/362: sync 2024-02-28T16:01:52.979 INFO:tasks.workunit.client.1.smithi087.stdout:6/391: sync 2024-02-28T16:01:52.980 INFO:tasks.workunit.client.1.smithi087.stdout:4/430: stat d2/d9/l50 0 2024-02-28T16:01:52.980 INFO:tasks.workunit.client.1.smithi087.stdout:7/347: mknod d14/d2e/d2b/c6e 0 2024-02-28T16:01:52.980 INFO:tasks.workunit.client.1.smithi087.stdout:2/337: chown d2/d7/f19 565 1 2024-02-28T16:01:52.981 INFO:tasks.workunit.client.1.smithi087.stdout:3/291: symlink d11/d44/d5b/d54/l62 0 2024-02-28T16:01:52.982 INFO:tasks.workunit.client.1.smithi087.stdout:8/362: symlink d2/d18/d25/l77 0 2024-02-28T16:01:52.985 INFO:tasks.workunit.client.1.smithi087.stdout:1/363: write d0/d1d/d24/f36 [3292585,3497] 0 2024-02-28T16:01:52.985 INFO:tasks.workunit.client.1.smithi087.stdout:9/358: creat d7/d1e/d44/f62 x:0 0 0 2024-02-28T16:01:52.987 INFO:tasks.workunit.client.1.smithi087.stdout:5/360: rename d3/d6/d69/l6a to d3/d6/d30/d36/d4f/l7f 0 2024-02-28T16:01:52.987 INFO:tasks.workunit.client.1.smithi087.stdout:1/364: chown d0/d1a 27406 1 2024-02-28T16:01:52.988 INFO:tasks.workunit.client.0.smithi057.stdout:1/132: dread d1/d3/dc/f10 [0,4194304] 0 2024-02-28T16:01:52.998 INFO:tasks.workunit.client.0.smithi057.stdout:1/133: link d1/d3/dc/d15/l20 d1/d21/l2c 0 2024-02-28T16:01:53.004 INFO:tasks.workunit.client.1.smithi087.stdout:5/361: creat d3/d64/d67/f80 x:0 0 0 2024-02-28T16:01:53.004 INFO:tasks.workunit.client.1.smithi087.stdout:6/392: truncate d4/dc/f56 1086483 0 2024-02-28T16:01:53.006 INFO:tasks.workunit.client.1.smithi087.stdout:2/338: dread d2/d7/d17/d3d/d60/f67 [0,4194304] 0 2024-02-28T16:01:53.006 INFO:tasks.workunit.client.1.smithi087.stdout:8/363: mknod d2/d9/d1a/d67/c78 0 2024-02-28T16:01:53.009 INFO:tasks.workunit.client.1.smithi087.stdout:0/356: dread d4/d6/dc/d45/f63 [0,4194304] 0 2024-02-28T16:01:53.010 INFO:tasks.workunit.client.1.smithi087.stdout:1/365: creat d0/d1b/f79 x:0 0 0 2024-02-28T16:01:53.011 INFO:tasks.workunit.client.0.smithi057.stdout:4/75: fdatasync d1/f6 0 2024-02-28T16:01:53.013 INFO:tasks.workunit.client.1.smithi087.stdout:2/339: write d2/d7/f19 [607117,118045] 0 2024-02-28T16:01:53.014 INFO:tasks.workunit.client.1.smithi087.stdout:0/357: readlink d4/dd/d21/d32/l43 0 2024-02-28T16:01:53.014 INFO:tasks.workunit.client.1.smithi087.stdout:6/393: link d4/c3e d4/d12/d45/d5e/c88 0 2024-02-28T16:01:53.015 INFO:tasks.workunit.client.0.smithi057.stdout:4/76: truncate d1/d10/f17 390717 0 2024-02-28T16:01:53.017 INFO:tasks.workunit.client.0.smithi057.stdout:4/77: write d1/d14/f1b [910620,88607] 0 2024-02-28T16:01:53.018 INFO:tasks.workunit.client.1.smithi087.stdout:8/364: dread d2/f6 [0,4194304] 0 2024-02-28T16:01:53.020 INFO:tasks.workunit.client.1.smithi087.stdout:1/366: write d0/d14/f42 [166342,51720] 0 2024-02-28T16:01:53.020 INFO:tasks.workunit.client.0.smithi057.stdout:4/78: mkdir d1/d1f 0 2024-02-28T16:01:53.021 INFO:tasks.workunit.client.0.smithi057.stdout:1/134: write d1/d3/dc/f29 [246201,52096] 0 2024-02-28T16:01:53.026 INFO:tasks.workunit.client.1.smithi087.stdout:0/358: read d4/dd/f13 [997205,73028] 0 2024-02-28T16:01:53.026 INFO:tasks.workunit.client.1.smithi087.stdout:6/394: fsync d4/dc/d10/f6e 0 2024-02-28T16:01:53.029 INFO:tasks.workunit.client.0.smithi057.stdout:1/135: write d1/f7 [4370553,102968] 0 2024-02-28T16:01:53.029 INFO:tasks.workunit.client.1.smithi087.stdout:2/340: creat d2/d7/df/d28/d54/f7b x:0 0 0 2024-02-28T16:01:53.032 INFO:tasks.workunit.client.0.smithi057.stdout:1/136: symlink d1/d21/d25/d26/l2d 0 2024-02-28T16:01:53.033 INFO:tasks.workunit.client.1.smithi087.stdout:0/359: dread - d4/dd/d37/f59 zero size 2024-02-28T16:01:53.033 INFO:tasks.workunit.client.1.smithi087.stdout:4/431: dwrite d2/df/d2e/d4a/f58 [0,4194304] 0 2024-02-28T16:01:53.036 INFO:tasks.workunit.client.0.smithi057.stdout:4/79: dread d1/f4 [0,4194304] 0 2024-02-28T16:01:53.038 INFO:tasks.workunit.client.0.smithi057.stdout:1/137: unlink d1/d3/dc/d15/l20 0 2024-02-28T16:01:53.039 INFO:tasks.workunit.client.1.smithi087.stdout:6/395: mkdir d4/dc/d61/d89 0 2024-02-28T16:01:53.039 INFO:tasks.workunit.client.1.smithi087.stdout:2/341: creat d2/f7c x:0 0 0 2024-02-28T16:01:53.039 INFO:tasks.workunit.client.0.smithi057.stdout:4/80: symlink d1/d10/l20 0 2024-02-28T16:01:53.044 INFO:tasks.workunit.client.0.smithi057.stdout:4/81: read d1/f11 [910153,112829] 0 2024-02-28T16:01:53.048 INFO:tasks.workunit.client.1.smithi087.stdout:7/348: dread f12 [0,4194304] 0 2024-02-28T16:01:53.048 INFO:tasks.workunit.client.1.smithi087.stdout:3/292: dread d11/d3a/d3c/f3f [0,4194304] 0 2024-02-28T16:01:53.049 INFO:tasks.workunit.client.1.smithi087.stdout:0/360: symlink d4/dd/l79 0 2024-02-28T16:01:53.052 INFO:tasks.workunit.client.1.smithi087.stdout:4/432: rename d2/d9/f7e to d2/df/d2e/f9a 0 2024-02-28T16:01:53.054 INFO:tasks.workunit.client.1.smithi087.stdout:6/396: creat d4/d12/d45/f8a x:0 0 0 2024-02-28T16:01:53.057 INFO:tasks.workunit.client.1.smithi087.stdout:8/365: dwrite d2/d33/f3e [4194304,4194304] 0 2024-02-28T16:01:53.059 INFO:tasks.workunit.client.0.smithi057.stdout:1/138: dwrite d1/d3/dc/d15/f17 [0,4194304] 0 2024-02-28T16:01:53.060 INFO:tasks.workunit.client.1.smithi087.stdout:4/433: fsync d2/d49/f51 0 2024-02-28T16:01:53.061 INFO:tasks.workunit.client.1.smithi087.stdout:1/367: dwrite d0/d14/f42 [0,4194304] 0 2024-02-28T16:01:53.062 INFO:tasks.workunit.client.0.smithi057.stdout:4/82: dread d1/f6 [0,4194304] 0 2024-02-28T16:01:53.062 INFO:tasks.workunit.client.0.smithi057.stdout:1/139: truncate d1/d3/dc/f12 465331 0 2024-02-28T16:01:53.064 INFO:tasks.workunit.client.1.smithi087.stdout:5/362: dread d3/d6/f26 [0,4194304] 0 2024-02-28T16:01:53.064 INFO:tasks.workunit.client.1.smithi087.stdout:3/293: unlink d11/d3a/d3c/l59 0 2024-02-28T16:01:53.068 INFO:tasks.workunit.client.1.smithi087.stdout:1/368: fdatasync d0/f70 0 2024-02-28T16:01:53.069 INFO:tasks.workunit.client.1.smithi087.stdout:0/361: chown d4/dd/d37/d39/d3a/d57/d74/d1f/f33 314722964 1 2024-02-28T16:01:53.070 INFO:tasks.workunit.client.1.smithi087.stdout:6/397: dread - d4/d12/d45/f8a zero size 2024-02-28T16:01:53.070 INFO:tasks.workunit.client.0.smithi057.stdout:4/83: rename d1/ca to d1/d10/d12/c21 0 2024-02-28T16:01:53.074 INFO:tasks.workunit.client.1.smithi087.stdout:4/434: creat d2/d9/d10/d22/d5b/f9b x:0 0 0 2024-02-28T16:01:53.075 INFO:tasks.workunit.client.0.smithi057.stdout:4/84: truncate d1/f7 3352604 0 2024-02-28T16:01:53.077 INFO:tasks.workunit.client.1.smithi087.stdout:6/398: readlink d4/dc/d10/l78 0 2024-02-28T16:01:53.079 INFO:tasks.workunit.client.0.smithi057.stdout:4/85: fdatasync d1/f6 0 2024-02-28T16:01:53.080 INFO:tasks.workunit.client.0.smithi057.stdout:4/86: chown d1/d14 26636 1 2024-02-28T16:01:53.080 INFO:tasks.workunit.client.1.smithi087.stdout:2/342: dwrite d2/d7/d17/d3d/f55 [4194304,4194304] 0 2024-02-28T16:01:53.080 INFO:tasks.workunit.client.1.smithi087.stdout:5/363: rename d3/d9/d57 to d3/d64/d81 0 2024-02-28T16:01:53.080 INFO:tasks.workunit.client.1.smithi087.stdout:4/435: dread - d2/d9/d10/d22/f72 zero size 2024-02-28T16:01:53.084 INFO:tasks.workunit.client.1.smithi087.stdout:7/349: dwrite d14/d21/f45 [0,4194304] 0 2024-02-28T16:01:53.085 INFO:tasks.workunit.client.1.smithi087.stdout:5/364: readlink d3/d9/l18 0 2024-02-28T16:01:53.089 INFO:tasks.workunit.client.1.smithi087.stdout:7/350: chown d14/l60 49 1 2024-02-28T16:01:53.091 INFO:tasks.workunit.client.1.smithi087.stdout:8/366: dread d2/d9/f17 [0,4194304] 0 2024-02-28T16:01:53.091 INFO:tasks.workunit.client.1.smithi087.stdout:3/294: rename d11/d3a/d3c/f3f to d11/d61/f63 0 2024-02-28T16:01:53.095 INFO:tasks.workunit.client.1.smithi087.stdout:6/399: mknod d4/d30/d13/d38/c8b 0 2024-02-28T16:01:53.100 INFO:tasks.workunit.client.0.smithi057.stdout:1/140: rename d1/d21/d25/d26/l2d to d1/l2e 0 2024-02-28T16:01:53.108 INFO:tasks.workunit.client.0.smithi057.stdout:1/141: creat d1/d21/d25/d26/f2f x:0 0 0 2024-02-28T16:01:53.109 INFO:tasks.workunit.client.1.smithi087.stdout:3/295: mknod d11/d45/c64 0 2024-02-28T16:01:53.109 INFO:tasks.workunit.client.1.smithi087.stdout:4/436: rename d2/l6 to d2/df/d62/l9c 0 2024-02-28T16:01:53.113 INFO:tasks.workunit.client.1.smithi087.stdout:8/367: creat d2/d18/f79 x:0 0 0 2024-02-28T16:01:53.114 INFO:tasks.workunit.client.1.smithi087.stdout:5/365: truncate d3/d64/d67/f76 440184 0 2024-02-28T16:01:53.121 INFO:tasks.workunit.client.1.smithi087.stdout:3/296: mkdir d11/d61/d65 0 2024-02-28T16:01:53.121 INFO:tasks.workunit.client.1.smithi087.stdout:6/400: link d4/d30/d13/d38/f3a d4/d12/d45/d74/f8c 0 2024-02-28T16:01:53.125 INFO:tasks.workunit.client.1.smithi087.stdout:0/362: dread d4/d6/f22 [0,4194304] 0 2024-02-28T16:01:53.127 INFO:tasks.workunit.client.0.smithi057.stdout:4/87: dwrite d1/f4 [4194304,4194304] 0 2024-02-28T16:01:53.131 INFO:tasks.workunit.client.0.smithi057.stdout:4/88: mkdir d1/d22 0 2024-02-28T16:01:53.133 INFO:tasks.workunit.client.1.smithi087.stdout:7/351: getdents d14/d27 0 2024-02-28T16:01:53.134 INFO:tasks.workunit.client.1.smithi087.stdout:2/343: dwrite d2/d7/f2d [4194304,4194304] 0 2024-02-28T16:01:53.135 INFO:tasks.workunit.client.0.smithi057.stdout:4/89: creat d1/d14/f23 x:0 0 0 2024-02-28T16:01:53.135 INFO:tasks.workunit.client.0.smithi057.stdout:1/142: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:01:53.136 INFO:tasks.workunit.client.1.smithi087.stdout:5/366: mkdir d3/d6/d30/d36/d4f/d82 0 2024-02-28T16:01:53.137 INFO:tasks.workunit.client.1.smithi087.stdout:5/367: dread - d3/f37 zero size 2024-02-28T16:01:53.138 INFO:tasks.workunit.client.1.smithi087.stdout:4/437: dwrite d2/d9/de/f86 [0,4194304] 0 2024-02-28T16:01:53.138 INFO:tasks.workunit.client.0.smithi057.stdout:4/90: chown d1/d10/d12/f1d 5409 1 2024-02-28T16:01:53.138 INFO:tasks.workunit.client.0.smithi057.stdout:1/143: mknod d1/d3/dc/c30 0 2024-02-28T16:01:53.142 INFO:tasks.workunit.client.0.smithi057.stdout:1/144: write d1/d3/dc/f12 [1496879,100415] 0 2024-02-28T16:01:53.144 INFO:tasks.workunit.client.0.smithi057.stdout:4/91: creat d1/d22/f24 x:0 0 0 2024-02-28T16:01:53.147 INFO:tasks.workunit.client.1.smithi087.stdout:6/401: mknod d4/d12/d45/d5e/c8d 0 2024-02-28T16:01:53.148 INFO:tasks.workunit.client.1.smithi087.stdout:2/344: mkdir d2/d7d 0 2024-02-28T16:01:53.148 INFO:tasks.workunit.client.0.smithi057.stdout:1/145: creat d1/d3/dc/f31 x:0 0 0 2024-02-28T16:01:53.152 INFO:tasks.workunit.client.0.smithi057.stdout:1/146: mknod d1/d3/dc/c32 0 2024-02-28T16:01:53.156 INFO:tasks.workunit.client.1.smithi087.stdout:6/402: truncate d4/d30/d13/f3f 4986808 0 2024-02-28T16:01:53.156 INFO:tasks.workunit.client.1.smithi087.stdout:8/368: link d2/d18/d42/f6d d2/d9/d10/d24/d53/d6f/f7a 0 2024-02-28T16:01:53.157 INFO:tasks.workunit.client.0.smithi057.stdout:1/147: unlink d1/d3/c1c 0 2024-02-28T16:01:53.158 INFO:tasks.workunit.client.1.smithi087.stdout:0/363: link d4/dd/d37/d39/f5a d4/dd/d21/d32/f7a 0 2024-02-28T16:01:53.158 INFO:tasks.workunit.client.1.smithi087.stdout:6/403: chown d4/d30/d13/d38/f68 764830404 1 2024-02-28T16:01:53.160 INFO:tasks.workunit.client.1.smithi087.stdout:3/297: link d11/f2a d11/d33/f66 0 2024-02-28T16:01:53.162 INFO:tasks.workunit.client.1.smithi087.stdout:0/364: read d4/d6/f22 [1470560,54524] 0 2024-02-28T16:01:53.163 INFO:tasks.workunit.client.1.smithi087.stdout:8/369: mkdir d2/d18/d42/d7b 0 2024-02-28T16:01:53.164 INFO:tasks.workunit.client.1.smithi087.stdout:3/298: truncate d11/d61/f63 4421233 0 2024-02-28T16:01:53.168 INFO:tasks.workunit.client.0.smithi057.stdout:1/148: rename d1/d3/dc/f29 to d1/d21/d25/f33 0 2024-02-28T16:01:53.169 INFO:tasks.workunit.client.1.smithi087.stdout:1/369: dread d0/d1a/f34 [0,4194304] 0 2024-02-28T16:01:53.169 INFO:tasks.workunit.client.1.smithi087.stdout:9/359: sync 2024-02-28T16:01:53.171 INFO:tasks.workunit.client.1.smithi087.stdout:1/370: readlink d0/d1b/d43/d4d/l52 0 2024-02-28T16:01:53.173 INFO:tasks.workunit.client.1.smithi087.stdout:8/370: mkdir d2/d7c 0 2024-02-28T16:01:53.173 INFO:tasks.workunit.client.0.smithi057.stdout:4/92: dwrite d1/fe [0,4194304] 0 2024-02-28T16:01:53.174 INFO:tasks.workunit.client.1.smithi087.stdout:0/365: fsync d4/d6/f14 0 2024-02-28T16:01:53.174 INFO:tasks.workunit.client.1.smithi087.stdout:7/352: dwrite d14/f5b [0,4194304] 0 2024-02-28T16:01:53.176 INFO:tasks.workunit.client.0.smithi057.stdout:4/93: getdents d1/d10/d12/d15/d19 0 2024-02-28T16:01:53.179 INFO:tasks.workunit.client.0.smithi057.stdout:4/94: write d1/d22/f24 [1003777,12391] 0 2024-02-28T16:01:53.180 INFO:tasks.workunit.client.0.smithi057.stdout:4/95: fdatasync d1/f7 0 2024-02-28T16:01:53.183 INFO:tasks.workunit.client.1.smithi087.stdout:6/404: rename d4/d12/d45/f73 to d4/dc/f8e 0 2024-02-28T16:01:53.185 INFO:tasks.workunit.client.1.smithi087.stdout:2/345: dwrite d2/d7/d17/d34/f53 [0,4194304] 0 2024-02-28T16:01:53.185 INFO:tasks.workunit.client.1.smithi087.stdout:4/438: link d2/d9/da/d1a/d26/f3d d2/d9/d10/d22/d73/f9d 0 2024-02-28T16:01:53.185 INFO:tasks.workunit.client.1.smithi087.stdout:1/371: readlink d0/d1d/l57 0 2024-02-28T16:01:53.192 INFO:tasks.workunit.client.1.smithi087.stdout:9/360: write d7/dd/d15/f5a [810919,45780] 0 2024-02-28T16:01:53.201 INFO:tasks.workunit.client.1.smithi087.stdout:3/299: rename d11/d44/d5b/d54 to d11/d33/d67 0 2024-02-28T16:01:53.202 INFO:tasks.workunit.client.0.smithi057.stdout:1/149: dwrite d1/d3/dc/f10 [0,4194304] 0 2024-02-28T16:01:53.206 INFO:tasks.workunit.client.0.smithi057.stdout:1/150: fdatasync d1/d3/dc/d15/f17 0 2024-02-28T16:01:53.210 INFO:tasks.workunit.client.1.smithi087.stdout:6/405: unlink d4/d12/d45/d57/c5f 0 2024-02-28T16:01:53.210 INFO:tasks.workunit.client.0.smithi057.stdout:1/151: write d1/d3/dc/f12 [2091762,124774] 0 2024-02-28T16:01:53.221 INFO:tasks.workunit.client.1.smithi087.stdout:8/371: link d2/d18/d25/l11 d2/d18/d42/d62/l7d 0 2024-02-28T16:01:53.221 INFO:tasks.workunit.client.1.smithi087.stdout:4/439: chown d2/d9/da/d1a/d26/c31 49 1 2024-02-28T16:01:53.221 INFO:tasks.workunit.client.1.smithi087.stdout:5/368: dwrite d3/d9/d4a/f50 [0,4194304] 0 2024-02-28T16:01:53.227 INFO:tasks.workunit.client.1.smithi087.stdout:6/406: stat d4/d12/f21 0 2024-02-28T16:01:53.232 INFO:tasks.workunit.client.1.smithi087.stdout:3/300: symlink d11/d61/d65/l68 0 2024-02-28T16:01:53.232 INFO:tasks.workunit.client.1.smithi087.stdout:7/353: dwrite d14/d2e/f22 [0,4194304] 0 2024-02-28T16:01:53.234 INFO:tasks.workunit.client.1.smithi087.stdout:2/346: creat d2/d7/d17/f7e x:0 0 0 2024-02-28T16:01:53.240 INFO:tasks.workunit.client.1.smithi087.stdout:0/366: dwrite d4/dd/d37/d39/d3a/d57/d74/f44 [0,4194304] 0 2024-02-28T16:01:53.240 INFO:tasks.workunit.client.1.smithi087.stdout:6/407: readlink d4/d30/l2c 0 2024-02-28T16:01:53.242 INFO:tasks.workunit.client.1.smithi087.stdout:1/372: dwrite d0/d14/f54 [0,4194304] 0 2024-02-28T16:01:53.247 INFO:tasks.workunit.client.1.smithi087.stdout:9/361: dwrite d7/dd/d15/f1f [0,4194304] 0 2024-02-28T16:01:53.251 INFO:tasks.workunit.client.1.smithi087.stdout:7/354: rename d14/c1c to d14/d30/c6f 0 2024-02-28T16:01:53.253 INFO:tasks.workunit.client.1.smithi087.stdout:3/301: symlink d11/d61/d65/l69 0 2024-02-28T16:01:53.254 INFO:tasks.workunit.client.1.smithi087.stdout:6/408: symlink d4/d30/d13/d67/l8f 0 2024-02-28T16:01:53.255 INFO:tasks.workunit.client.1.smithi087.stdout:1/373: creat d0/f7a x:0 0 0 2024-02-28T16:01:53.257 INFO:tasks.workunit.client.1.smithi087.stdout:3/302: fdatasync d11/d44/d5b/f4f 0 2024-02-28T16:01:53.258 INFO:tasks.workunit.client.1.smithi087.stdout:9/362: chown d7/dd/d15/d39/f4a 86817795 1 2024-02-28T16:01:53.258 INFO:tasks.workunit.client.1.smithi087.stdout:0/367: creat d4/d6/dc/d45/f7b x:0 0 0 2024-02-28T16:01:53.259 INFO:tasks.workunit.client.1.smithi087.stdout:9/363: stat f4 0 2024-02-28T16:01:53.264 INFO:tasks.workunit.client.1.smithi087.stdout:8/372: dwrite d2/d9/f5c [0,4194304] 0 2024-02-28T16:01:53.265 INFO:tasks.workunit.client.0.smithi057.stdout:4/96: truncate d1/d22/f24 728607 0 2024-02-28T16:01:53.265 INFO:tasks.workunit.client.1.smithi087.stdout:2/347: creat d2/d7/f7f x:0 0 0 2024-02-28T16:01:53.268 INFO:tasks.workunit.client.1.smithi087.stdout:1/374: truncate d0/d1a/d28/f65 746138 0 2024-02-28T16:01:53.275 INFO:tasks.workunit.client.1.smithi087.stdout:9/364: fsync d7/f58 0 2024-02-28T16:01:53.275 INFO:tasks.workunit.client.1.smithi087.stdout:4/440: dread d2/df/d2e/d4a/f58 [0,4194304] 0 2024-02-28T16:01:53.279 INFO:tasks.workunit.client.1.smithi087.stdout:5/369: dwrite d3/d6/d30/d36/f7a [0,4194304] 0 2024-02-28T16:01:53.279 INFO:tasks.workunit.client.1.smithi087.stdout:3/303: rename d11/d3a/f42 to d11/d61/f6a 0 2024-02-28T16:01:53.284 INFO:tasks.workunit.client.1.smithi087.stdout:8/373: creat d2/d18/d42/d62/f7e x:0 0 0 2024-02-28T16:01:53.291 INFO:tasks.workunit.client.0.smithi057.stdout:4/97: dwrite d1/d14/f23 [0,4194304] 0 2024-02-28T16:01:53.294 INFO:tasks.workunit.client.0.smithi057.stdout:4/98: creat d1/d10/d12/d15/f25 x:0 0 0 2024-02-28T16:01:53.297 INFO:tasks.workunit.client.0.smithi057.stdout:4/99: creat d1/d10/d12/f26 x:0 0 0 2024-02-28T16:01:53.305 INFO:tasks.workunit.client.1.smithi087.stdout:4/441: chown d2/d9/da/l8a 899083738 1 2024-02-28T16:01:53.306 INFO:tasks.workunit.client.0.smithi057.stdout:1/152: creat d1/f34 x:0 0 0 2024-02-28T16:01:53.306 INFO:tasks.workunit.client.0.smithi057.stdout:1/153: rmdir d1/d3/dc/d15 39 2024-02-28T16:01:53.307 INFO:tasks.workunit.client.1.smithi087.stdout:1/375: dread d0/d1b/f45 [0,4194304] 0 2024-02-28T16:01:53.311 INFO:tasks.workunit.client.1.smithi087.stdout:3/304: mknod d11/d44/d5b/c6b 0 2024-02-28T16:01:53.313 INFO:tasks.workunit.client.0.smithi057.stdout:1/154: mknod d1/d3/dc/c35 0 2024-02-28T16:01:53.313 INFO:tasks.workunit.client.1.smithi087.stdout:6/409: rmdir d4/d30 39 2024-02-28T16:01:53.315 INFO:tasks.workunit.client.1.smithi087.stdout:7/355: dread f13 [0,4194304] 0 2024-02-28T16:01:53.317 INFO:tasks.workunit.client.1.smithi087.stdout:2/348: getdents d2/d7/df/d28/d79 0 2024-02-28T16:01:53.320 INFO:tasks.workunit.client.1.smithi087.stdout:4/442: readlink d2/d9/l40 0 2024-02-28T16:01:53.323 INFO:tasks.workunit.client.1.smithi087.stdout:5/370: mknod d3/d9/d4a/d5e/c83 0 2024-02-28T16:01:53.326 INFO:tasks.workunit.client.1.smithi087.stdout:3/305: fsync d11/f29 0 2024-02-28T16:01:53.328 INFO:tasks.workunit.client.0.smithi057.stdout:4/100: dwrite d1/d10/d12/d15/f25 [0,4194304] 0 2024-02-28T16:01:53.330 INFO:tasks.workunit.client.1.smithi087.stdout:3/306: write d11/d45/f47 [2267098,120332] 0 2024-02-28T16:01:53.330 INFO:tasks.workunit.client.1.smithi087.stdout:3/307: readlink d11/l39 0 2024-02-28T16:01:53.333 INFO:tasks.workunit.client.1.smithi087.stdout:6/410: write d4/dc/f8e [3017892,41353] 0 2024-02-28T16:01:53.338 INFO:tasks.workunit.client.0.smithi057.stdout:1/155: truncate d1/f19 261437 0 2024-02-28T16:01:53.338 INFO:tasks.workunit.client.1.smithi087.stdout:6/411: readlink d4/d12/d45/l48 0 2024-02-28T16:01:53.340 INFO:tasks.workunit.client.1.smithi087.stdout:2/349: readlink d2/d7/df/d28/l2b 0 2024-02-28T16:01:53.342 INFO:tasks.workunit.client.1.smithi087.stdout:6/412: chown d4/dc/d10 41 1 2024-02-28T16:01:53.343 INFO:tasks.workunit.client.0.smithi057.stdout:1/156: symlink d1/d21/d25/d26/l36 0 2024-02-28T16:01:53.348 INFO:tasks.workunit.client.1.smithi087.stdout:9/365: getdents d7/dd/d15 0 2024-02-28T16:01:53.353 INFO:tasks.workunit.client.0.smithi057.stdout:4/101: dread d1/d14/f23 [0,4194304] 0 2024-02-28T16:01:53.353 INFO:tasks.workunit.client.1.smithi087.stdout:1/376: dwrite d0/d1a/d28/f65 [0,4194304] 0 2024-02-28T16:01:53.353 INFO:tasks.workunit.client.1.smithi087.stdout:5/371: read d3/d64/d67/f76 [279909,52203] 0 2024-02-28T16:01:53.353 INFO:tasks.workunit.client.1.smithi087.stdout:7/356: link d14/d2e/f22 d14/d27/d5d/f70 0 2024-02-28T16:01:53.354 INFO:tasks.workunit.client.1.smithi087.stdout:9/366: write d7/d1e/d44/f46 [2746328,83559] 0 2024-02-28T16:01:53.355 INFO:tasks.workunit.client.0.smithi057.stdout:4/102: write d1/ff [762559,71540] 0 2024-02-28T16:01:53.358 INFO:tasks.workunit.client.1.smithi087.stdout:7/357: chown d14/d21/f41 101 1 2024-02-28T16:01:53.359 INFO:tasks.workunit.client.0.smithi057.stdout:4/103: creat d1/d10/f27 x:0 0 0 2024-02-28T16:01:53.369 INFO:tasks.workunit.client.0.smithi057.stdout:1/157: dread d1/d3/dc/f12 [0,4194304] 0 2024-02-28T16:01:53.370 INFO:tasks.workunit.client.1.smithi087.stdout:4/443: dwrite d2/d9/de/f86 [4194304,4194304] 0 2024-02-28T16:01:53.375 INFO:tasks.workunit.client.1.smithi087.stdout:0/368: dread d4/dd/d37/d39/d3a/d57/d74/f1d [0,4194304] 0 2024-02-28T16:01:53.378 INFO:tasks.workunit.client.1.smithi087.stdout:3/308: fdatasync d11/d33/f66 0 2024-02-28T16:01:53.379 INFO:tasks.workunit.client.1.smithi087.stdout:8/374: truncate d2/d18/d42/f70 2398491 0 2024-02-28T16:01:53.381 INFO:tasks.workunit.client.0.smithi057.stdout:4/104: write d1/f11 [3631047,68971] 0 2024-02-28T16:01:53.382 INFO:tasks.workunit.client.1.smithi087.stdout:8/375: fsync d2/f30 0 2024-02-28T16:01:53.386 INFO:tasks.workunit.client.0.smithi057.stdout:1/158: unlink d1/f19 0 2024-02-28T16:01:53.386 INFO:tasks.workunit.client.1.smithi087.stdout:2/350: symlink d2/d7/df/d28/l80 0 2024-02-28T16:01:53.389 INFO:tasks.workunit.client.0.smithi057.stdout:1/159: mknod d1/d21/c37 0 2024-02-28T16:01:53.390 INFO:tasks.workunit.client.1.smithi087.stdout:0/369: mkdir d4/d6/d3e/d7c 0 2024-02-28T16:01:53.393 INFO:tasks.workunit.client.1.smithi087.stdout:9/367: creat d7/d1e/d60/f63 x:0 0 0 2024-02-28T16:01:53.393 INFO:tasks.workunit.client.1.smithi087.stdout:5/372: mknod d3/d64/d67/d7c/c84 0 2024-02-28T16:01:53.395 INFO:tasks.workunit.client.0.smithi057.stdout:1/160: rename d1/d3/dc/d15/l1e to d1/d3/l38 0 2024-02-28T16:01:53.395 INFO:tasks.workunit.client.1.smithi087.stdout:9/368: readlink l5 0 2024-02-28T16:01:53.397 INFO:tasks.workunit.client.1.smithi087.stdout:6/413: dwrite d4/d30/d13/d67/f72 [0,4194304] 0 2024-02-28T16:01:53.397 INFO:tasks.workunit.client.0.smithi057.stdout:1/161: chown d1/f34 49 1 2024-02-28T16:01:53.403 INFO:tasks.workunit.client.1.smithi087.stdout:1/377: dwrite d0/d14/f25 [0,4194304] 0 2024-02-28T16:01:53.404 INFO:tasks.workunit.client.1.smithi087.stdout:4/444: rename d2/df/d2e/d4a to d2/d9/d9e 0 2024-02-28T16:01:53.405 INFO:tasks.workunit.client.0.smithi057.stdout:4/105: dwrite d1/f11 [0,4194304] 0 2024-02-28T16:01:53.406 INFO:tasks.workunit.client.0.smithi057.stdout:5/145: sync 2024-02-28T16:01:53.406 INFO:tasks.workunit.client.0.smithi057.stdout:0/210: sync 2024-02-28T16:01:53.407 INFO:tasks.workunit.client.1.smithi087.stdout:5/373: truncate d3/d6/f2f 2558216 0 2024-02-28T16:01:53.407 INFO:tasks.workunit.client.0.smithi057.stdout:4/106: fsync d1/f4 0 2024-02-28T16:01:53.414 INFO:tasks.workunit.client.0.smithi057.stdout:4/107: unlink d1/fc 0 2024-02-28T16:01:53.414 INFO:tasks.workunit.client.0.smithi057.stdout:5/146: rename d2/d8/l11 to d2/d19/l38 0 2024-02-28T16:01:53.417 INFO:tasks.workunit.client.0.smithi057.stdout:0/211: creat d6/d12/d3d/f46 x:0 0 0 2024-02-28T16:01:53.418 INFO:tasks.workunit.client.1.smithi087.stdout:0/370: link d4/dd/f1b d4/dd/d37/d39/d3a/f7d 0 2024-02-28T16:01:53.418 INFO:tasks.workunit.client.1.smithi087.stdout:8/376: rename d2/d18/c1d to d2/d9/d10/d24/d53/d6f/c7f 0 2024-02-28T16:01:53.423 INFO:tasks.workunit.client.0.smithi057.stdout:0/212: truncate d6/d12/d17/f37 955011 0 2024-02-28T16:01:53.424 INFO:tasks.workunit.client.1.smithi087.stdout:1/378: mknod d0/d1b/d43/c7b 0 2024-02-28T16:01:53.426 INFO:tasks.workunit.client.1.smithi087.stdout:8/377: chown d2/d9/l26 176 1 2024-02-28T16:01:53.427 INFO:tasks.workunit.client.1.smithi087.stdout:0/371: chown d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d76 50609671 1 2024-02-28T16:01:53.431 INFO:tasks.workunit.client.1.smithi087.stdout:5/374: creat d3/d6/d30/d44/f85 x:0 0 0 2024-02-28T16:01:53.431 INFO:tasks.workunit.client.1.smithi087.stdout:2/351: rename d2/d7/df/d28/d78 to d2/d7/d17/d3d/d81 0 2024-02-28T16:01:53.436 INFO:tasks.workunit.client.0.smithi057.stdout:1/162: creat d1/d21/f39 x:0 0 0 2024-02-28T16:01:53.436 INFO:tasks.workunit.client.1.smithi087.stdout:4/445: symlink d2/d9/d10/d22/d5b/d5c/l9f 0 2024-02-28T16:01:53.438 INFO:tasks.workunit.client.0.smithi057.stdout:0/213: dread d6/d12/d17/f37 [0,4194304] 0 2024-02-28T16:01:53.439 INFO:tasks.workunit.client.1.smithi087.stdout:8/378: symlink d2/d9/d10/d24/d53/d6f/l80 0 2024-02-28T16:01:53.440 INFO:tasks.workunit.client.1.smithi087.stdout:2/352: rename d2/d7/d17/d3d/d81 to d2/d7/d17/d3d/d81/d82 22 2024-02-28T16:01:53.443 INFO:tasks.workunit.client.0.smithi057.stdout:1/163: truncate d1/d3/f2a 888238 0 2024-02-28T16:01:53.443 INFO:tasks.workunit.client.1.smithi087.stdout:9/369: dwrite d7/f8 [4194304,4194304] 0 2024-02-28T16:01:53.444 INFO:tasks.workunit.client.1.smithi087.stdout:8/379: truncate d2/d9/f5d 926493 0 2024-02-28T16:01:53.448 INFO:tasks.workunit.client.0.smithi057.stdout:5/147: dwrite d2/d8/f9 [0,4194304] 0 2024-02-28T16:01:53.450 INFO:tasks.workunit.client.0.smithi057.stdout:1/164: write d1/d3/dc/d15/f16 [2270125,116251] 0 2024-02-28T16:01:53.453 INFO:tasks.workunit.client.1.smithi087.stdout:1/379: creat d0/d1d/d24/d5c/d69/f7c x:0 0 0 2024-02-28T16:01:53.454 INFO:tasks.workunit.client.0.smithi057.stdout:5/148: symlink d2/d19/d1c/l39 0 2024-02-28T16:01:53.454 INFO:tasks.workunit.client.1.smithi087.stdout:8/380: truncate d2/d18/d42/d62/f7e 564711 0 2024-02-28T16:01:53.457 INFO:tasks.workunit.client.0.smithi057.stdout:4/108: dwrite d1/d10/d12/d15/f25 [0,4194304] 0 2024-02-28T16:01:53.457 INFO:tasks.workunit.client.0.smithi057.stdout:1/165: creat d1/d3/f3a x:0 0 0 2024-02-28T16:01:53.457 INFO:tasks.workunit.client.1.smithi087.stdout:8/381: stat d2/d33/f35 0 2024-02-28T16:01:53.457 INFO:tasks.workunit.client.1.smithi087.stdout:1/380: chown d0/d14/f25 71717702 1 2024-02-28T16:01:53.460 INFO:tasks.workunit.client.0.smithi057.stdout:1/166: truncate d1/d21/d25/d26/f2f 92339 0 2024-02-28T16:01:53.461 INFO:tasks.workunit.client.1.smithi087.stdout:8/382: readlink d2/d18/d42/l76 0 2024-02-28T16:01:53.463 INFO:tasks.workunit.client.1.smithi087.stdout:9/370: mkdir d7/d1e/d60/d64 0 2024-02-28T16:01:53.465 INFO:tasks.workunit.client.0.smithi057.stdout:5/149: getdents d2/d19 0 2024-02-28T16:01:53.476 INFO:tasks.workunit.client.1.smithi087.stdout:6/414: dread d4/d12/d45/f5a [0,4194304] 0 2024-02-28T16:01:53.483 INFO:tasks.workunit.client.1.smithi087.stdout:5/375: rename d3/d6/d30/d44/c60 to d3/d6/d30/d36/d4f/c86 0 2024-02-28T16:01:53.484 INFO:tasks.workunit.client.1.smithi087.stdout:9/371: mkdir d7/d65 0 2024-02-28T16:01:53.486 INFO:tasks.workunit.client.1.smithi087.stdout:3/309: dwrite d11/f24 [4194304,4194304] 0 2024-02-28T16:01:53.491 INFO:tasks.workunit.client.1.smithi087.stdout:2/353: dread d2/d7/d17/d3d/f55 [4194304,4194304] 0 2024-02-28T16:01:53.494 INFO:tasks.workunit.client.1.smithi087.stdout:2/354: stat d2/d7/d17/d34/f4a 0 2024-02-28T16:01:53.498 INFO:tasks.workunit.client.1.smithi087.stdout:4/446: rename d2/d9/da/c99 to d2/d9/da/d1a/ca0 0 2024-02-28T16:01:53.499 INFO:tasks.workunit.client.1.smithi087.stdout:5/376: mkdir d3/d6/d69/d87 0 2024-02-28T16:01:53.507 INFO:tasks.workunit.client.1.smithi087.stdout:5/377: stat d3/d9/c63 0 2024-02-28T16:01:53.509 INFO:tasks.workunit.client.1.smithi087.stdout:1/381: dwrite d0/d14/f42 [0,4194304] 0 2024-02-28T16:01:53.509 INFO:tasks.workunit.client.1.smithi087.stdout:9/372: unlink d7/dd/d15/d39/d2e/f49 0 2024-02-28T16:01:53.519 INFO:tasks.workunit.client.1.smithi087.stdout:1/382: creat d0/d1a/f7d x:0 0 0 2024-02-28T16:01:53.529 INFO:tasks.workunit.client.1.smithi087.stdout:2/355: dwrite d2/d42/d4b/f52 [0,4194304] 0 2024-02-28T16:01:53.532 INFO:tasks.workunit.client.1.smithi087.stdout:1/383: truncate d0/f2 2729363 0 2024-02-28T16:01:53.533 INFO:tasks.workunit.client.0.smithi057.stdout:1/167: getdents d1/d3/dc/d15 0 2024-02-28T16:01:53.533 INFO:tasks.workunit.client.0.smithi057.stdout:4/109: dread d1/d14/f1b [0,4194304] 0 2024-02-28T16:01:53.539 INFO:tasks.workunit.client.0.smithi057.stdout:4/110: creat d1/f28 x:0 0 0 2024-02-28T16:01:53.539 INFO:tasks.workunit.client.0.smithi057.stdout:1/168: fdatasync d1/d21/d25/f33 0 2024-02-28T16:01:53.541 INFO:tasks.workunit.client.1.smithi087.stdout:0/372: dread d4/dd/f1b [0,4194304] 0 2024-02-28T16:01:53.546 INFO:tasks.workunit.client.0.smithi057.stdout:4/111: mknod d1/d10/c29 0 2024-02-28T16:01:53.546 INFO:tasks.workunit.client.0.smithi057.stdout:1/169: fsync d1/d3/dc/f12 0 2024-02-28T16:01:53.548 INFO:tasks.workunit.client.1.smithi087.stdout:1/384: rmdir d0/d1b/d43 39 2024-02-28T16:01:53.552 INFO:tasks.workunit.client.1.smithi087.stdout:5/378: dwrite d3/d6/d30/f3b [0,4194304] 0 2024-02-28T16:01:53.555 INFO:tasks.workunit.client.0.smithi057.stdout:1/170: unlink d1/d3/dc/f31 0 2024-02-28T16:01:53.561 INFO:tasks.workunit.client.0.smithi057.stdout:1/171: creat d1/d3/f3b x:0 0 0 2024-02-28T16:01:53.561 INFO:tasks.workunit.client.1.smithi087.stdout:2/356: dwrite d2/d7/d17/d3d/f74 [0,4194304] 0 2024-02-28T16:01:53.561 INFO:tasks.workunit.client.1.smithi087.stdout:8/383: dread d2/d18/d42/f43 [0,4194304] 0 2024-02-28T16:01:53.562 INFO:tasks.workunit.client.1.smithi087.stdout:8/384: chown d2/f27 5117 1 2024-02-28T16:01:53.565 INFO:tasks.workunit.client.1.smithi087.stdout:3/310: truncate d11/f46 149042 0 2024-02-28T16:01:53.566 INFO:tasks.workunit.client.1.smithi087.stdout:0/373: creat d4/dd/d21/d52/f7e x:0 0 0 2024-02-28T16:01:53.574 INFO:tasks.workunit.client.1.smithi087.stdout:1/385: creat d0/d1b/d1f/f7e x:0 0 0 2024-02-28T16:01:53.580 INFO:tasks.workunit.client.1.smithi087.stdout:8/385: link d2/d9/d1a/f5b d2/d18/d42/f81 0 2024-02-28T16:01:53.580 INFO:tasks.workunit.client.1.smithi087.stdout:0/374: chown d4/dd/f2d 114846147 1 2024-02-28T16:01:53.580 INFO:tasks.workunit.client.1.smithi087.stdout:5/379: dread d3/f61 [0,4194304] 0 2024-02-28T16:01:53.582 INFO:tasks.workunit.client.1.smithi087.stdout:2/357: creat d2/d7/df/d28/f83 x:0 0 0 2024-02-28T16:01:53.583 INFO:tasks.workunit.client.0.smithi057.stdout:4/112: dwrite d1/d22/f24 [0,4194304] 0 2024-02-28T16:01:53.585 INFO:tasks.workunit.client.0.smithi057.stdout:4/113: write d1/d10/d12/f1d [5190030,68016] 0 2024-02-28T16:01:53.589 INFO:tasks.workunit.client.0.smithi057.stdout:4/114: unlink d1/c1e 0 2024-02-28T16:01:53.596 INFO:tasks.workunit.client.1.smithi087.stdout:8/386: link d2/l7 d2/d63/l82 0 2024-02-28T16:01:53.606 INFO:tasks.workunit.client.1.smithi087.stdout:8/387: mknod d2/d7c/c83 0 2024-02-28T16:01:53.609 INFO:tasks.workunit.client.1.smithi087.stdout:0/375: dwrite d4/dd/d37/d39/d3a/d57/d74/d1f/d34/f35 [0,4194304] 0 2024-02-28T16:01:53.613 INFO:tasks.workunit.client.1.smithi087.stdout:1/386: dread d0/fd [0,4194304] 0 2024-02-28T16:01:53.616 INFO:tasks.workunit.client.1.smithi087.stdout:8/388: creat d2/d18/d42/f84 x:0 0 0 2024-02-28T16:01:53.620 INFO:tasks.workunit.client.0.smithi057.stdout:4/115: fdatasync d1/d22/f24 0 2024-02-28T16:01:53.621 INFO:tasks.workunit.client.1.smithi087.stdout:3/311: truncate d11/f46 254686 0 2024-02-28T16:01:53.622 INFO:tasks.workunit.client.0.smithi057.stdout:4/116: creat d1/d22/f2a x:0 0 0 2024-02-28T16:01:53.623 INFO:tasks.workunit.client.1.smithi087.stdout:1/387: creat d0/d1a/d28/f7f x:0 0 0 2024-02-28T16:01:53.626 INFO:tasks.workunit.client.0.smithi057.stdout:4/117: creat d1/d10/d12/d15/d19/f2b x:0 0 0 2024-02-28T16:01:53.628 INFO:tasks.workunit.client.1.smithi087.stdout:3/312: symlink d11/d61/d65/l6c 0 2024-02-28T16:01:53.629 INFO:tasks.workunit.client.0.smithi057.stdout:4/118: mkdir d1/d10/d12/d2c 0 2024-02-28T16:01:53.632 INFO:tasks.workunit.client.1.smithi087.stdout:1/388: write d0/d1b/d1f/f77 [1846781,8543] 0 2024-02-28T16:01:53.632 INFO:tasks.workunit.client.0.smithi057.stdout:4/119: mknod d1/d10/d12/c2d 0 2024-02-28T16:01:53.632 INFO:tasks.workunit.client.1.smithi087.stdout:5/380: dread d3/d6/d30/d36/f48 [0,4194304] 0 2024-02-28T16:01:53.635 INFO:tasks.workunit.client.1.smithi087.stdout:0/376: dwrite d4/d6/dc/d45/f6a [0,4194304] 0 2024-02-28T16:01:53.637 INFO:tasks.workunit.client.1.smithi087.stdout:2/358: dwrite d2/d7/df/d28/f2e [0,4194304] 0 2024-02-28T16:01:53.637 INFO:tasks.workunit.client.0.smithi057.stdout:4/120: write d1/fe [215003,34372] 0 2024-02-28T16:01:53.642 INFO:tasks.workunit.client.0.smithi057.stdout:4/121: creat d1/d10/d12/d15/f2e x:0 0 0 2024-02-28T16:01:53.643 INFO:tasks.workunit.client.1.smithi087.stdout:2/359: mknod d2/d42/c84 0 2024-02-28T16:01:53.646 INFO:tasks.workunit.client.1.smithi087.stdout:5/381: creat d3/d6/d69/f88 x:0 0 0 2024-02-28T16:01:53.646 INFO:tasks.workunit.client.0.smithi057.stdout:4/122: getdents d1/d10/d12/d2c 0 2024-02-28T16:01:53.649 INFO:tasks.workunit.client.1.smithi087.stdout:0/377: mknod d4/d6/c7f 0 2024-02-28T16:01:53.651 INFO:tasks.workunit.client.0.smithi057.stdout:4/123: getdents d1/d14 0 2024-02-28T16:01:53.653 INFO:tasks.workunit.client.1.smithi087.stdout:3/313: dwrite d11/f2f [0,4194304] 0 2024-02-28T16:01:53.655 INFO:tasks.workunit.client.1.smithi087.stdout:0/378: fdatasync d4/dd/d37/d39/d3a/f46 0 2024-02-28T16:01:53.656 INFO:tasks.workunit.client.1.smithi087.stdout:0/379: dread - d4/dd/d21/f69 zero size 2024-02-28T16:01:53.659 INFO:tasks.workunit.client.1.smithi087.stdout:8/389: dread d2/d63/f41 [0,4194304] 0 2024-02-28T16:01:53.665 INFO:tasks.workunit.client.1.smithi087.stdout:0/380: chown d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/c6d 441519 1 2024-02-28T16:01:53.669 INFO:tasks.workunit.client.1.smithi087.stdout:8/390: symlink d2/d9/l85 0 2024-02-28T16:01:53.670 INFO:tasks.workunit.client.1.smithi087.stdout:2/360: dwrite d2/d7/d17/d3d/d60/f67 [0,4194304] 0 2024-02-28T16:01:53.670 INFO:tasks.workunit.client.1.smithi087.stdout:0/381: mknod d4/d6/d3e/c80 0 2024-02-28T16:01:53.670 INFO:tasks.workunit.client.1.smithi087.stdout:5/382: link d3/d6/c58 d3/d9/d4a/c89 0 2024-02-28T16:01:53.671 INFO:tasks.workunit.client.0.smithi057.stdout:4/124: dwrite d1/f11 [0,4194304] 0 2024-02-28T16:01:53.671 INFO:tasks.workunit.client.1.smithi087.stdout:8/391: dread - d2/d9/d1a/f48 zero size 2024-02-28T16:01:53.672 INFO:tasks.workunit.client.1.smithi087.stdout:5/383: readlink d3/d9/l2c 0 2024-02-28T16:01:53.673 INFO:tasks.workunit.client.1.smithi087.stdout:2/361: creat d2/f85 x:0 0 0 2024-02-28T16:01:53.675 INFO:tasks.workunit.client.1.smithi087.stdout:8/392: fdatasync d2/d18/d25/f6c 0 2024-02-28T16:01:53.679 INFO:tasks.workunit.client.0.smithi057.stdout:4/125: link d1/d14/f23 d1/d1f/f2f 0 2024-02-28T16:01:53.683 INFO:tasks.workunit.client.1.smithi087.stdout:5/384: creat d3/f8a x:0 0 0 2024-02-28T16:01:53.686 INFO:tasks.workunit.client.1.smithi087.stdout:5/385: mknod d3/d64/d67/d7c/c8b 0 2024-02-28T16:01:53.690 INFO:tasks.workunit.client.1.smithi087.stdout:5/386: write d3/d6/d30/d36/f5f [499601,17956] 0 2024-02-28T16:01:53.692 INFO:tasks.workunit.client.1.smithi087.stdout:3/314: truncate d11/f35 3233377 0 2024-02-28T16:01:53.693 INFO:tasks.workunit.client.1.smithi087.stdout:8/393: write d2/d33/f35 [3958966,105990] 0 2024-02-28T16:01:53.693 INFO:tasks.workunit.client.1.smithi087.stdout:0/382: write d4/d6/dc/d45/f63 [1272027,121569] 0 2024-02-28T16:01:53.697 INFO:tasks.workunit.client.1.smithi087.stdout:2/362: dwrite d2/d7/d17/d34/f51 [0,4194304] 0 2024-02-28T16:01:53.700 INFO:tasks.workunit.client.0.smithi057.stdout:4/126: dwrite d1/d14/f23 [0,4194304] 0 2024-02-28T16:01:53.701 INFO:tasks.workunit.client.1.smithi087.stdout:5/387: unlink d3/d6/d30/d44/d54/f75 0 2024-02-28T16:01:53.705 INFO:tasks.workunit.client.0.smithi057.stdout:4/127: symlink d1/l30 0 2024-02-28T16:01:53.706 INFO:tasks.workunit.client.0.smithi057.stdout:4/128: chown d1/f7 0 1 2024-02-28T16:01:53.708 INFO:tasks.workunit.client.0.smithi057.stdout:4/129: dread - d1/d10/d12/d15/d19/f2b zero size 2024-02-28T16:01:53.708 INFO:tasks.workunit.client.0.smithi057.stdout:4/130: stat d1/d1f/f2f 0 2024-02-28T16:01:53.713 INFO:tasks.workunit.client.1.smithi087.stdout:2/363: mknod d2/d7/df/d28/d79/c86 0 2024-02-28T16:01:53.718 INFO:tasks.workunit.client.1.smithi087.stdout:2/364: write d2/d7/df/d28/d54/f7b [222480,51200] 0 2024-02-28T16:01:53.720 INFO:tasks.workunit.client.0.smithi057.stdout:4/131: truncate d1/d1f/f2f 1229589 0 2024-02-28T16:01:53.723 INFO:tasks.workunit.client.1.smithi087.stdout:0/383: dwrite d4/dd/f1b [4194304,4194304] 0 2024-02-28T16:01:53.727 INFO:tasks.workunit.client.1.smithi087.stdout:8/394: write d2/d9/d10/d24/d53/d6f/f7a [453879,96986] 0 2024-02-28T16:01:53.727 INFO:tasks.workunit.client.1.smithi087.stdout:2/365: rename d2/d7/d17/d3d/f6c to d2/f87 0 2024-02-28T16:01:53.729 INFO:tasks.workunit.client.1.smithi087.stdout:5/388: dwrite d3/f59 [0,4194304] 0 2024-02-28T16:01:53.731 INFO:tasks.workunit.client.1.smithi087.stdout:8/395: mknod d2/d33/c86 0 2024-02-28T16:01:53.732 INFO:tasks.workunit.client.1.smithi087.stdout:5/389: stat d3/d6/d30/d36/l42 0 2024-02-28T16:01:53.739 INFO:tasks.workunit.client.1.smithi087.stdout:2/366: mkdir d2/d7/d17/d34/d88 0 2024-02-28T16:01:53.739 INFO:tasks.workunit.client.0.smithi057.stdout:4/132: dread d1/d1f/f2f [0,4194304] 0 2024-02-28T16:01:53.744 INFO:tasks.workunit.client.0.smithi057.stdout:4/133: mkdir d1/d10/d31 0 2024-02-28T16:01:53.744 INFO:tasks.workunit.client.0.smithi057.stdout:4/134: fdatasync d1/f4 0 2024-02-28T16:01:53.744 INFO:tasks.workunit.client.1.smithi087.stdout:5/390: write d3/f34 [1657491,129343] 0 2024-02-28T16:01:53.745 INFO:tasks.workunit.client.1.smithi087.stdout:5/391: fsync d3/f13 0 2024-02-28T16:01:53.747 INFO:tasks.workunit.client.1.smithi087.stdout:8/396: creat d2/d9/d5e/f87 x:0 0 0 2024-02-28T16:01:53.748 INFO:tasks.workunit.client.0.smithi057.stdout:4/135: creat d1/d10/d12/d15/d19/f32 x:0 0 0 2024-02-28T16:01:53.751 INFO:tasks.workunit.client.1.smithi087.stdout:0/384: getdents d4/d1c 0 2024-02-28T16:01:53.751 INFO:tasks.workunit.client.1.smithi087.stdout:5/392: write d3/d9/f1e [131584,10462] 0 2024-02-28T16:01:53.751 INFO:tasks.workunit.client.0.smithi057.stdout:4/136: stat d1/d10/d12/c2d 0 2024-02-28T16:01:53.757 INFO:tasks.workunit.client.1.smithi087.stdout:0/385: rmdir d4 39 2024-02-28T16:01:53.759 INFO:tasks.workunit.client.1.smithi087.stdout:5/393: rename d3/d6/d30/f3b to d3/d6/d30/d44/d54/f8c 0 2024-02-28T16:01:53.759 INFO:tasks.workunit.client.1.smithi087.stdout:3/315: dread d11/f31 [0,4194304] 0 2024-02-28T16:01:53.759 INFO:tasks.workunit.client.1.smithi087.stdout:8/397: mknod d2/d9/d10/c88 0 2024-02-28T16:01:53.763 INFO:tasks.workunit.client.1.smithi087.stdout:5/394: write d3/d64/d67/f80 [171433,101011] 0 2024-02-28T16:01:53.763 INFO:tasks.workunit.client.1.smithi087.stdout:3/316: mknod d11/d33/d58/c6d 0 2024-02-28T16:01:53.763 INFO:tasks.workunit.client.0.smithi057.stdout:4/137: dwrite d1/ff [0,4194304] 0 2024-02-28T16:01:53.765 INFO:tasks.workunit.client.1.smithi087.stdout:8/398: mkdir d2/d9/d10/d24/d53/d89 0 2024-02-28T16:01:53.765 INFO:tasks.workunit.client.1.smithi087.stdout:0/386: truncate d4/dd/d21/d52/f6e 202059 0 2024-02-28T16:01:53.767 INFO:tasks.workunit.client.1.smithi087.stdout:8/399: stat d2/d9/d10/f3a 0 2024-02-28T16:01:53.769 INFO:tasks.workunit.client.1.smithi087.stdout:3/317: creat d11/d33/d67/f6e x:0 0 0 2024-02-28T16:01:53.770 INFO:tasks.workunit.client.0.smithi057.stdout:4/138: rename d1/d10/d12/f26 to d1/d14/f33 0 2024-02-28T16:01:53.770 INFO:tasks.workunit.client.1.smithi087.stdout:5/395: unlink d3/d6/f2f 0 2024-02-28T16:01:53.772 INFO:tasks.workunit.client.1.smithi087.stdout:3/318: truncate d11/f1d 925314 0 2024-02-28T16:01:53.776 INFO:tasks.workunit.client.0.smithi057.stdout:4/139: rename d1/f11 to d1/d14/f34 0 2024-02-28T16:01:53.779 INFO:tasks.workunit.client.1.smithi087.stdout:3/319: fsync d11/f37 0 2024-02-28T16:01:53.779 INFO:tasks.workunit.client.1.smithi087.stdout:2/367: dread d2/d7/d17/f59 [0,4194304] 0 2024-02-28T16:01:53.779 INFO:tasks.workunit.client.1.smithi087.stdout:5/396: link d3/f13 d3/d64/f8d 0 2024-02-28T16:01:53.780 INFO:tasks.workunit.client.0.smithi057.stdout:4/140: unlink d1/d10/f17 0 2024-02-28T16:01:53.784 INFO:tasks.workunit.client.1.smithi087.stdout:0/387: dread d4/dd/d37/d39/d3a/d57/d74/f1d [0,4194304] 0 2024-02-28T16:01:53.784 INFO:tasks.workunit.client.0.smithi057.stdout:4/141: link d1/d14/f23 d1/d22/f35 0 2024-02-28T16:01:53.786 INFO:tasks.workunit.client.1.smithi087.stdout:3/320: dread d11/f46 [0,4194304] 0 2024-02-28T16:01:53.786 INFO:tasks.workunit.client.1.smithi087.stdout:0/388: readlink d4/dd/l50 0 2024-02-28T16:01:53.788 INFO:tasks.workunit.client.1.smithi087.stdout:0/389: chown d4/dd/d21/d32 1 1 2024-02-28T16:01:53.789 INFO:tasks.workunit.client.0.smithi057.stdout:4/142: mkdir d1/d10/d31/d36 0 2024-02-28T16:01:53.792 INFO:tasks.workunit.client.0.smithi057.stdout:4/143: mkdir d1/d10/d12/d2c/d37 0 2024-02-28T16:01:53.795 INFO:tasks.workunit.client.1.smithi087.stdout:3/321: link d11/d3a/d3c/l41 d11/d33/d58/l6f 0 2024-02-28T16:01:53.798 INFO:tasks.workunit.client.1.smithi087.stdout:8/400: dwrite d2/d9/d1a/f46 [0,4194304] 0 2024-02-28T16:01:53.799 INFO:tasks.workunit.client.1.smithi087.stdout:7/358: sync 2024-02-28T16:01:53.803 INFO:tasks.workunit.client.0.smithi057.stdout:4/144: dread d1/d10/d12/f1d [0,4194304] 0 2024-02-28T16:01:53.803 INFO:tasks.workunit.client.1.smithi087.stdout:2/368: dwrite d2/d7/f19 [4194304,4194304] 0 2024-02-28T16:01:53.803 INFO:tasks.workunit.client.1.smithi087.stdout:0/390: getdents d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31 0 2024-02-28T16:01:53.806 INFO:tasks.workunit.client.0.smithi057.stdout:4/145: symlink d1/d10/d12/d15/l38 0 2024-02-28T16:01:53.807 INFO:tasks.workunit.client.1.smithi087.stdout:5/397: dwrite d3/f43 [0,4194304] 0 2024-02-28T16:01:53.807 INFO:tasks.workunit.client.0.smithi057.stdout:4/146: dread - d1/d14/f33 zero size 2024-02-28T16:01:53.809 INFO:tasks.workunit.client.1.smithi087.stdout:0/391: truncate d4/d6/dc/d45/f6a 4435969 0 2024-02-28T16:01:53.811 INFO:tasks.workunit.client.1.smithi087.stdout:8/401: mknod d2/d9/d10/d24/c8a 0 2024-02-28T16:01:53.811 INFO:tasks.workunit.client.0.smithi057.stdout:4/147: unlink d1/d10/d12/f1d 0 2024-02-28T16:01:53.813 INFO:tasks.workunit.client.0.smithi057.stdout:4/148: read - d1/d10/f27 zero size 2024-02-28T16:01:53.818 INFO:tasks.workunit.client.1.smithi087.stdout:8/402: fdatasync d2/d9/d5e/f87 0 2024-02-28T16:01:53.822 INFO:tasks.workunit.client.1.smithi087.stdout:5/398: mknod d3/d6/c8e 0 2024-02-28T16:01:53.823 INFO:tasks.workunit.client.1.smithi087.stdout:7/359: getdents d14/d27/d5d 0 2024-02-28T16:01:53.829 INFO:tasks.workunit.client.1.smithi087.stdout:7/360: stat d14/d2e/f66 0 2024-02-28T16:01:53.829 INFO:tasks.workunit.client.1.smithi087.stdout:0/392: getdents d4/dd/d37/d39/d3a 0 2024-02-28T16:01:53.829 INFO:tasks.workunit.client.1.smithi087.stdout:3/322: dwrite d11/d44/f5e [0,4194304] 0 2024-02-28T16:01:53.829 INFO:tasks.workunit.client.1.smithi087.stdout:5/399: mkdir d3/d6/d30/d8f 0 2024-02-28T16:01:53.834 INFO:tasks.workunit.client.1.smithi087.stdout:2/369: dwrite d2/d7/d17/f59 [4194304,4194304] 0 2024-02-28T16:01:53.835 INFO:tasks.workunit.client.1.smithi087.stdout:8/403: rmdir d2/d9/d10 39 2024-02-28T16:01:53.837 INFO:tasks.workunit.client.1.smithi087.stdout:7/361: symlink d14/d21/d4f/l71 0 2024-02-28T16:01:53.837 INFO:tasks.workunit.client.1.smithi087.stdout:0/393: readlink d4/dd/l4a 0 2024-02-28T16:01:53.838 INFO:tasks.workunit.client.0.smithi057.stdout:4/149: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:01:53.839 INFO:tasks.workunit.client.1.smithi087.stdout:5/400: mknod d3/d6/d30/c90 0 2024-02-28T16:01:53.842 INFO:tasks.workunit.client.1.smithi087.stdout:8/404: write d2/d9/d1a/f46 [3924217,112147] 0 2024-02-28T16:01:53.842 INFO:tasks.workunit.client.1.smithi087.stdout:7/362: rmdir d14/d30 39 2024-02-28T16:01:53.844 INFO:tasks.workunit.client.0.smithi057.stdout:6/97: sync 2024-02-28T16:01:53.844 INFO:tasks.workunit.client.0.smithi057.stdout:2/68: sync 2024-02-28T16:01:53.844 INFO:tasks.workunit.client.0.smithi057.stdout:7/94: sync 2024-02-28T16:01:53.844 INFO:tasks.workunit.client.0.smithi057.stdout:9/111: sync 2024-02-28T16:01:53.844 INFO:tasks.workunit.client.0.smithi057.stdout:8/98: sync 2024-02-28T16:01:53.844 INFO:tasks.workunit.client.0.smithi057.stdout:3/55: sync 2024-02-28T16:01:53.845 INFO:tasks.workunit.client.1.smithi087.stdout:7/363: dread - d14/d21/d4f/f53 zero size 2024-02-28T16:01:53.847 INFO:tasks.workunit.client.0.smithi057.stdout:6/98: fsync df/f1f 0 2024-02-28T16:01:53.848 INFO:tasks.workunit.client.1.smithi087.stdout:2/370: mknod d2/d7/d17/d34/c89 0 2024-02-28T16:01:53.849 INFO:tasks.workunit.client.0.smithi057.stdout:2/69: write f12 [479930,47921] 0 2024-02-28T16:01:53.851 INFO:tasks.workunit.client.1.smithi087.stdout:5/401: creat d3/d6/d30/d36/d4f/f91 x:0 0 0 2024-02-28T16:01:53.853 INFO:tasks.workunit.client.0.smithi057.stdout:8/99: write d5/d6/fa [2166371,83526] 0 2024-02-28T16:01:53.855 INFO:tasks.workunit.client.1.smithi087.stdout:8/405: rename d2/d18/d42/d62/l75 to d2/d63/l8b 0 2024-02-28T16:01:53.856 INFO:tasks.workunit.client.1.smithi087.stdout:2/371: chown d2/d7/d17/d3d/l70 10218263 1 2024-02-28T16:01:53.858 INFO:tasks.workunit.client.1.smithi087.stdout:8/406: stat d2/d9/f5c 0 2024-02-28T16:01:53.858 INFO:tasks.workunit.client.1.smithi087.stdout:2/372: write d2/f5a [1781093,60057] 0 2024-02-28T16:01:53.859 INFO:tasks.workunit.client.1.smithi087.stdout:3/323: dwrite d11/f36 [0,4194304] 0 2024-02-28T16:01:53.859 INFO:tasks.workunit.client.1.smithi087.stdout:5/402: creat d3/d6/d69/f92 x:0 0 0 2024-02-28T16:01:53.860 INFO:tasks.workunit.client.0.smithi057.stdout:8/100: write d5/de/f10 [414882,67049] 0 2024-02-28T16:01:53.860 INFO:tasks.workunit.client.0.smithi057.stdout:6/99: unlink df/l20 0 2024-02-28T16:01:53.865 INFO:tasks.workunit.client.0.smithi057.stdout:4/150: mkdir d1/d10/d12/d39 0 2024-02-28T16:01:53.865 INFO:tasks.workunit.client.0.smithi057.stdout:8/101: chown d5/d6/c1d 0 1 2024-02-28T16:01:53.865 INFO:tasks.workunit.client.0.smithi057.stdout:9/112: symlink d2/d24/d1d/l29 0 2024-02-28T16:01:53.867 INFO:tasks.workunit.client.1.smithi087.stdout:3/324: creat d11/d61/d65/f70 x:0 0 0 2024-02-28T16:01:53.867 INFO:tasks.workunit.client.1.smithi087.stdout:5/403: mknod d3/d6/d30/d53/c93 0 2024-02-28T16:01:53.869 INFO:tasks.workunit.client.0.smithi057.stdout:6/100: write df/f12 [906381,370] 0 2024-02-28T16:01:53.870 INFO:tasks.workunit.client.1.smithi087.stdout:5/404: chown d3/d6/d30/d53/d5b/f66 2212985 1 2024-02-28T16:01:53.870 INFO:tasks.workunit.client.0.smithi057.stdout:8/102: readlink d5/l8 0 2024-02-28T16:01:53.871 INFO:tasks.workunit.client.1.smithi087.stdout:3/325: creat d11/d33/d67/f71 x:0 0 0 2024-02-28T16:01:53.874 INFO:tasks.workunit.client.1.smithi087.stdout:3/326: rename d11/l53 to d11/d61/l72 0 2024-02-28T16:01:53.875 INFO:tasks.workunit.client.1.smithi087.stdout:5/405: truncate d3/d6/d30/f32 4218054 0 2024-02-28T16:01:53.877 INFO:tasks.workunit.client.0.smithi057.stdout:3/56: dread f3 [0,4194304] 0 2024-02-28T16:01:53.877 INFO:tasks.workunit.client.0.smithi057.stdout:7/95: creat d6/f23 x:0 0 0 2024-02-28T16:01:53.877 INFO:tasks.workunit.client.1.smithi087.stdout:3/327: mkdir d11/d45/d73 0 2024-02-28T16:01:53.877 INFO:tasks.workunit.client.0.smithi057.stdout:2/70: symlink l18 0 2024-02-28T16:01:53.878 INFO:tasks.workunit.client.1.smithi087.stdout:5/406: write d3/d64/d81/f49 [80687,12468] 0 2024-02-28T16:01:53.879 INFO:tasks.workunit.client.0.smithi057.stdout:4/151: mknod d1/d10/d12/c3a 0 2024-02-28T16:01:53.880 INFO:tasks.workunit.client.1.smithi087.stdout:3/328: mkdir d11/d33/d74 0 2024-02-28T16:01:53.880 INFO:tasks.workunit.client.0.smithi057.stdout:6/101: write df/f1b [569114,105514] 0 2024-02-28T16:01:53.881 INFO:tasks.workunit.client.1.smithi087.stdout:5/407: unlink d3/l29 0 2024-02-28T16:01:53.884 INFO:tasks.workunit.client.1.smithi087.stdout:5/408: creat d3/d6/d30/d53/d5b/f94 x:0 0 0 2024-02-28T16:01:53.885 INFO:tasks.workunit.client.0.smithi057.stdout:9/113: creat d2/d5/d9/f2a x:0 0 0 2024-02-28T16:01:53.885 INFO:tasks.workunit.client.0.smithi057.stdout:6/102: chown df/f1f 17959 1 2024-02-28T16:01:53.885 INFO:tasks.workunit.client.0.smithi057.stdout:8/103: creat d5/d6/f22 x:0 0 0 2024-02-28T16:01:53.886 INFO:tasks.workunit.client.1.smithi087.stdout:5/409: fsync d3/d9/f46 0 2024-02-28T16:01:53.891 INFO:tasks.workunit.client.1.smithi087.stdout:2/373: truncate d2/d7/d17/d3d/d60/f67 748157 0 2024-02-28T16:01:53.892 INFO:tasks.workunit.client.0.smithi057.stdout:8/104: unlink d5/d6/c14 0 2024-02-28T16:01:53.892 INFO:tasks.workunit.client.0.smithi057.stdout:6/103: fdatasync df/d10/f22 0 2024-02-28T16:01:53.892 INFO:tasks.workunit.client.1.smithi087.stdout:0/394: dread d4/f8 [0,4194304] 0 2024-02-28T16:01:53.893 INFO:tasks.workunit.client.0.smithi057.stdout:4/152: mknod d1/d10/d12/c3b 0 2024-02-28T16:01:53.898 INFO:tasks.workunit.client.0.smithi057.stdout:7/96: creat d6/dc/d12/d1a/f24 x:0 0 0 2024-02-28T16:01:53.898 INFO:tasks.workunit.client.0.smithi057.stdout:6/104: chown df/f12 1194553440 1 2024-02-28T16:01:53.898 INFO:tasks.workunit.client.1.smithi087.stdout:0/395: read d4/dd/d26/f2b [628438,65593] 0 2024-02-28T16:01:53.898 INFO:tasks.workunit.client.1.smithi087.stdout:2/374: mknod d2/d7/d17/d3d/d60/c8a 0 2024-02-28T16:01:53.898 INFO:tasks.workunit.client.1.smithi087.stdout:3/329: dwrite d11/d44/d5b/f52 [0,4194304] 0 2024-02-28T16:01:53.900 INFO:tasks.workunit.client.0.smithi057.stdout:9/114: symlink d2/d24/l2b 0 2024-02-28T16:01:53.900 INFO:tasks.workunit.client.0.smithi057.stdout:2/71: dread f12 [0,4194304] 0 2024-02-28T16:01:53.900 INFO:tasks.workunit.client.1.smithi087.stdout:3/330: chown c6 804552 1 2024-02-28T16:01:53.901 INFO:tasks.workunit.client.0.smithi057.stdout:7/97: readlink d6/dc/d12/l13 0 2024-02-28T16:01:53.903 INFO:tasks.workunit.client.1.smithi087.stdout:2/375: fdatasync d2/d7/df/f3f 0 2024-02-28T16:01:53.903 INFO:tasks.workunit.client.1.smithi087.stdout:3/331: write d11/f37 [435542,67372] 0 2024-02-28T16:01:53.905 INFO:tasks.workunit.client.1.smithi087.stdout:0/396: truncate d4/dd/d37/d39/f5a 5152775 0 2024-02-28T16:01:53.907 INFO:tasks.workunit.client.0.smithi057.stdout:6/105: unlink df/d10/f17 0 2024-02-28T16:01:53.908 INFO:tasks.workunit.client.1.smithi087.stdout:5/410: dwrite d3/d64/d81/f4b [0,4194304] 0 2024-02-28T16:01:53.908 INFO:tasks.workunit.client.1.smithi087.stdout:2/376: dread - d2/d7/f7f zero size 2024-02-28T16:01:53.911 INFO:tasks.workunit.client.0.smithi057.stdout:3/57: dread f4 [0,4194304] 0 2024-02-28T16:01:53.912 INFO:tasks.workunit.client.1.smithi087.stdout:2/377: fdatasync d2/d7/df/d28/f83 0 2024-02-28T16:01:53.915 INFO:tasks.workunit.client.1.smithi087.stdout:0/397: unlink d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/f61 0 2024-02-28T16:01:53.917 INFO:tasks.workunit.client.1.smithi087.stdout:5/411: symlink d3/d6/l95 0 2024-02-28T16:01:53.918 INFO:tasks.workunit.client.1.smithi087.stdout:0/398: write d4/dd/d21/d5f/f72 [269210,2973] 0 2024-02-28T16:01:53.920 INFO:tasks.workunit.client.1.smithi087.stdout:2/378: truncate d2/d7/f15 7837384 0 2024-02-28T16:01:53.922 INFO:tasks.workunit.client.1.smithi087.stdout:3/332: dread d11/f31 [0,4194304] 0 2024-02-28T16:01:53.922 INFO:tasks.workunit.client.0.smithi057.stdout:6/106: rename df/f1b to df/d14/f23 0 2024-02-28T16:01:53.923 INFO:tasks.workunit.client.0.smithi057.stdout:3/58: stat d8/dd/lf 0 2024-02-28T16:01:53.923 INFO:tasks.workunit.client.0.smithi057.stdout:9/115: dread d2/d24/d1d/f23 [0,4194304] 0 2024-02-28T16:01:53.924 INFO:tasks.workunit.client.1.smithi087.stdout:2/379: chown d2/d7/d17/d34/c65 7024 1 2024-02-28T16:01:53.924 INFO:tasks.workunit.client.0.smithi057.stdout:7/98: dread f4 [0,4194304] 0 2024-02-28T16:01:53.924 INFO:tasks.workunit.client.1.smithi087.stdout:3/333: chown d11/l27 113839 1 2024-02-28T16:01:53.926 INFO:tasks.workunit.client.1.smithi087.stdout:5/412: write d3/d6/f2b [856307,1398] 0 2024-02-28T16:01:53.928 INFO:tasks.workunit.client.1.smithi087.stdout:2/380: mknod d2/c8b 0 2024-02-28T16:01:53.929 INFO:tasks.workunit.client.0.smithi057.stdout:8/105: dwrite d5/d6/f9 [0,4194304] 0 2024-02-28T16:01:53.929 INFO:tasks.workunit.client.0.smithi057.stdout:2/72: dread f10 [0,4194304] 0 2024-02-28T16:01:53.930 INFO:tasks.workunit.client.1.smithi087.stdout:5/413: chown d3/d6/d30/d53/c7e 363 1 2024-02-28T16:01:53.933 INFO:tasks.workunit.client.0.smithi057.stdout:7/99: dread - d6/dc/fd zero size 2024-02-28T16:01:53.933 INFO:tasks.workunit.client.0.smithi057.stdout:2/73: chown c17 27 1 2024-02-28T16:01:53.933 INFO:tasks.workunit.client.0.smithi057.stdout:2/74: readlink l15 0 2024-02-28T16:01:53.933 INFO:tasks.workunit.client.1.smithi087.stdout:2/381: write d2/f85 [120918,127517] 0 2024-02-28T16:01:53.934 INFO:tasks.workunit.client.0.smithi057.stdout:7/100: readlink d6/dc/l20 0 2024-02-28T16:01:53.938 INFO:tasks.workunit.client.0.smithi057.stdout:2/75: chown l15 171544883 1 2024-02-28T16:01:53.942 INFO:tasks.workunit.client.1.smithi087.stdout:3/334: dwrite fa [0,4194304] 0 2024-02-28T16:01:53.942 INFO:tasks.workunit.client.0.smithi057.stdout:8/106: read d5/de/f10 [121763,96400] 0 2024-02-28T16:01:53.943 INFO:tasks.workunit.client.1.smithi087.stdout:5/414: truncate d3/d6/f26 727852 0 2024-02-28T16:01:53.943 INFO:tasks.workunit.client.0.smithi057.stdout:3/59: getdents d8/dd 0 2024-02-28T16:01:53.944 INFO:tasks.workunit.client.1.smithi087.stdout:0/399: dwrite d4/d6/dc/d45/f6a [4194304,4194304] 0 2024-02-28T16:01:53.946 INFO:tasks.workunit.client.0.smithi057.stdout:3/60: readlink d8/dd/l10 0 2024-02-28T16:01:53.954 INFO:tasks.workunit.client.0.smithi057.stdout:6/107: dread df/d14/f23 [0,4194304] 0 2024-02-28T16:01:53.956 INFO:tasks.workunit.client.0.smithi057.stdout:7/101: symlink d6/dc/l25 0 2024-02-28T16:01:53.956 INFO:tasks.workunit.client.0.smithi057.stdout:3/61: creat d8/f12 x:0 0 0 2024-02-28T16:01:53.957 INFO:tasks.workunit.client.1.smithi087.stdout:2/382: dwrite d2/d7/df/d28/f32 [0,4194304] 0 2024-02-28T16:01:53.957 INFO:tasks.workunit.client.1.smithi087.stdout:3/335: truncate d11/f24 147766 0 2024-02-28T16:01:53.961 INFO:tasks.workunit.client.1.smithi087.stdout:2/383: chown d2/d7/f19 229484638 1 2024-02-28T16:01:53.962 INFO:tasks.workunit.client.0.smithi057.stdout:7/102: chown d6/dc/f11 0 1 2024-02-28T16:01:53.963 INFO:tasks.workunit.client.0.smithi057.stdout:6/108: unlink ca 0 2024-02-28T16:01:53.969 INFO:tasks.workunit.client.1.smithi087.stdout:5/415: dwrite d3/d6/d30/d53/d5b/f94 [0,4194304] 0 2024-02-28T16:01:53.970 INFO:tasks.workunit.client.0.smithi057.stdout:3/62: creat d8/f13 x:0 0 0 2024-02-28T16:01:53.970 INFO:tasks.workunit.client.0.smithi057.stdout:8/107: link d5/cf d5/de/c23 0 2024-02-28T16:01:53.970 INFO:tasks.workunit.client.0.smithi057.stdout:8/108: chown d5/de 114 1 2024-02-28T16:01:53.970 INFO:tasks.workunit.client.0.smithi057.stdout:3/63: readlink d8/dd/lf 0 2024-02-28T16:01:53.971 INFO:tasks.workunit.client.0.smithi057.stdout:6/109: creat df/d14/f24 x:0 0 0 2024-02-28T16:01:53.974 INFO:tasks.workunit.client.0.smithi057.stdout:3/64: read - d8/f13 zero size 2024-02-28T16:01:53.976 INFO:tasks.workunit.client.1.smithi087.stdout:0/400: dwrite d4/d6/f14 [4194304,4194304] 0 2024-02-28T16:01:53.977 INFO:tasks.workunit.client.0.smithi057.stdout:3/65: dread - d8/fa zero size 2024-02-28T16:01:53.978 INFO:tasks.workunit.client.0.smithi057.stdout:6/110: chown df/f12 140356 1 2024-02-28T16:01:53.980 INFO:tasks.workunit.client.0.smithi057.stdout:6/111: readlink df/d14/d15/l21 0 2024-02-28T16:01:53.981 INFO:tasks.workunit.client.1.smithi087.stdout:5/416: rename d3/d6/l95 to d3/d6/l96 0 2024-02-28T16:01:53.986 INFO:tasks.workunit.client.1.smithi087.stdout:5/417: creat d3/d6/d30/f97 x:0 0 0 2024-02-28T16:01:53.987 INFO:tasks.workunit.client.0.smithi057.stdout:3/66: mkdir d8/dd/d14 0 2024-02-28T16:01:53.990 INFO:tasks.workunit.client.1.smithi087.stdout:3/336: dwrite d11/d44/f57 [0,4194304] 0 2024-02-28T16:01:53.991 INFO:tasks.workunit.client.0.smithi057.stdout:3/67: chown d8 1823217 1 2024-02-28T16:01:53.991 INFO:tasks.workunit.client.0.smithi057.stdout:9/116: getdents d2/d24 0 2024-02-28T16:01:53.995 INFO:tasks.workunit.client.1.smithi087.stdout:5/418: write d3/f37 [180505,77538] 0 2024-02-28T16:01:53.996 INFO:tasks.workunit.client.1.smithi087.stdout:6/415: sync 2024-02-28T16:01:53.996 INFO:tasks.workunit.client.1.smithi087.stdout:2/384: dwrite d2/d7/d17/d34/f6e [0,4194304] 0 2024-02-28T16:01:53.997 INFO:tasks.workunit.client.0.smithi057.stdout:3/68: creat d8/f15 x:0 0 0 2024-02-28T16:01:53.999 INFO:tasks.workunit.client.0.smithi057.stdout:2/76: write f10 [969686,87644] 0 2024-02-28T16:01:54.001 INFO:tasks.workunit.client.1.smithi087.stdout:2/385: chown d2/d7/d17/d34/f6e 161 1 2024-02-28T16:01:54.002 INFO:tasks.workunit.client.1.smithi087.stdout:5/419: symlink d3/d6/d30/d8f/l98 0 2024-02-28T16:01:54.002 INFO:tasks.workunit.client.0.smithi057.stdout:9/117: creat d2/d5/d9/f2c x:0 0 0 2024-02-28T16:01:54.004 INFO:tasks.workunit.client.0.smithi057.stdout:3/69: dread - d8/f15 zero size 2024-02-28T16:01:54.004 INFO:tasks.workunit.client.1.smithi087.stdout:3/337: getdents d11/d45 0 2024-02-28T16:01:54.005 INFO:tasks.workunit.client.0.smithi057.stdout:2/77: readlink lc 0 2024-02-28T16:01:54.006 INFO:tasks.workunit.client.1.smithi087.stdout:5/420: fdatasync d3/d6/d30/d36/d4f/f91 0 2024-02-28T16:01:54.007 INFO:tasks.workunit.client.0.smithi057.stdout:3/70: dread - d8/f15 zero size 2024-02-28T16:01:54.007 INFO:tasks.workunit.client.0.smithi057.stdout:7/103: dwrite d6/dc/fd [0,4194304] 0 2024-02-28T16:01:54.011 INFO:tasks.workunit.client.1.smithi087.stdout:5/421: chown d3/d9/d4a/d5e 1 1 2024-02-28T16:01:54.013 INFO:tasks.workunit.client.1.smithi087.stdout:2/386: symlink d2/d7/l8c 0 2024-02-28T16:01:54.016 INFO:tasks.workunit.client.1.smithi087.stdout:2/387: stat d2/d7/d17/d34 0 2024-02-28T16:01:54.017 INFO:tasks.workunit.client.0.smithi057.stdout:7/104: chown d6/dc/d12/d1a/c1d 12104 1 2024-02-28T16:01:54.019 INFO:tasks.workunit.client.1.smithi087.stdout:5/422: link d3/f22 d3/d64/d67/d7c/f99 0 2024-02-28T16:01:54.021 INFO:tasks.workunit.client.0.smithi057.stdout:2/78: mkdir d19 0 2024-02-28T16:01:54.021 INFO:tasks.workunit.client.0.smithi057.stdout:8/109: dread d5/d6/fa [0,4194304] 0 2024-02-28T16:01:54.022 INFO:tasks.workunit.client.1.smithi087.stdout:5/423: chown d3/d64/d67/f7b 0 1 2024-02-28T16:01:54.024 INFO:tasks.workunit.client.0.smithi057.stdout:6/112: dwrite df/d10/f22 [0,4194304] 0 2024-02-28T16:01:54.024 INFO:tasks.workunit.client.1.smithi087.stdout:3/338: dread ff [0,4194304] 0 2024-02-28T16:01:54.025 INFO:tasks.workunit.client.1.smithi087.stdout:2/388: dread d2/d7/f46 [0,4194304] 0 2024-02-28T16:01:54.029 INFO:tasks.workunit.client.1.smithi087.stdout:3/339: write d11/f2f [3882907,57062] 0 2024-02-28T16:01:54.029 INFO:tasks.workunit.client.0.smithi057.stdout:9/118: rename d2/c3 to d2/d24/c2d 0 2024-02-28T16:01:54.030 INFO:tasks.workunit.client.1.smithi087.stdout:5/424: symlink d3/d6/l9a 0 2024-02-28T16:01:54.032 INFO:tasks.workunit.client.1.smithi087.stdout:2/389: creat d2/d7/d17/d34/f8d x:0 0 0 2024-02-28T16:01:54.033 INFO:tasks.workunit.client.1.smithi087.stdout:5/425: rmdir d3/d6/d30/d8f 39 2024-02-28T16:01:54.037 INFO:tasks.workunit.client.1.smithi087.stdout:2/390: mknod d2/d7d/c8e 0 2024-02-28T16:01:54.038 INFO:tasks.workunit.client.0.smithi057.stdout:6/113: creat df/d14/d15/f25 x:0 0 0 2024-02-28T16:01:54.040 INFO:tasks.workunit.client.1.smithi087.stdout:6/416: dwrite d4/d12/d45/d74/f8c [0,4194304] 0 2024-02-28T16:01:54.041 INFO:tasks.workunit.client.0.smithi057.stdout:3/71: symlink d8/dd/d14/l16 0 2024-02-28T16:01:54.049 INFO:tasks.workunit.client.0.smithi057.stdout:7/105: mkdir d6/d26 0 2024-02-28T16:01:54.064 INFO:tasks.workunit.client.0.smithi057.stdout:6/114: dread fc [0,4194304] 0 2024-02-28T16:01:54.064 INFO:tasks.workunit.client.1.smithi087.stdout:6/417: dwrite d4/d12/d45/f5d [0,4194304] 0 2024-02-28T16:01:54.066 INFO:tasks.workunit.client.0.smithi057.stdout:8/110: link d5/d6/cc d5/de/d1b/c24 0 2024-02-28T16:01:54.066 INFO:tasks.workunit.client.1.smithi087.stdout:2/391: dwrite d2/d7/d17/d34/f8d [0,4194304] 0 2024-02-28T16:01:54.069 INFO:tasks.workunit.client.0.smithi057.stdout:3/72: link d8/fa d8/dd/d14/f17 0 2024-02-28T16:01:54.071 INFO:tasks.workunit.client.0.smithi057.stdout:3/73: chown d8/dd 33 1 2024-02-28T16:01:54.071 INFO:tasks.workunit.client.1.smithi087.stdout:6/418: mknod d4/d12/d45/c90 0 2024-02-28T16:01:54.076 INFO:tasks.workunit.client.0.smithi057.stdout:8/111: creat d5/de/d1b/f25 x:0 0 0 2024-02-28T16:01:54.076 INFO:tasks.workunit.client.1.smithi087.stdout:2/392: write d2/f21 [1674718,23990] 0 2024-02-28T16:01:54.076 INFO:tasks.workunit.client.1.smithi087.stdout:3/340: dread f10 [0,4194304] 0 2024-02-28T16:01:54.077 INFO:tasks.workunit.client.1.smithi087.stdout:6/419: write d4/d12/d45/d74/f85 [36422,126200] 0 2024-02-28T16:01:54.077 INFO:tasks.workunit.client.1.smithi087.stdout:5/426: dwrite d3/d64/d67/f76 [0,4194304] 0 2024-02-28T16:01:54.080 INFO:tasks.workunit.client.1.smithi087.stdout:3/341: fdatasync d11/d44/f57 0 2024-02-28T16:01:54.080 INFO:tasks.workunit.client.0.smithi057.stdout:3/74: truncate d8/f15 514541 0 2024-02-28T16:01:54.086 INFO:tasks.workunit.client.0.smithi057.stdout:7/106: dwrite d6/f23 [0,4194304] 0 2024-02-28T16:01:54.086 INFO:tasks.workunit.client.0.smithi057.stdout:8/112: mknod d5/de/c26 0 2024-02-28T16:01:54.087 INFO:tasks.workunit.client.1.smithi087.stdout:6/420: rename d4/f26 to d4/d12/d45/f91 0 2024-02-28T16:01:54.088 INFO:tasks.workunit.client.0.smithi057.stdout:3/75: creat d8/f18 x:0 0 0 2024-02-28T16:01:54.091 INFO:tasks.workunit.client.1.smithi087.stdout:6/421: chown d4/d12 90 1 2024-02-28T16:01:54.093 INFO:tasks.workunit.client.0.smithi057.stdout:8/113: fdatasync d5/f7 0 2024-02-28T16:01:54.094 INFO:tasks.workunit.client.1.smithi087.stdout:6/422: write d4/d30/d13/d38/d69/f6f [579917,67958] 0 2024-02-28T16:01:54.096 INFO:tasks.workunit.client.1.smithi087.stdout:3/342: link d11/d33/c3b d11/d3a/c75 0 2024-02-28T16:01:54.098 INFO:tasks.workunit.client.1.smithi087.stdout:5/427: getdents d3/d9/d4a/d5e 0 2024-02-28T16:01:54.098 INFO:tasks.workunit.client.0.smithi057.stdout:3/76: mkdir d8/dd/d19 0 2024-02-28T16:01:54.099 INFO:tasks.workunit.client.0.smithi057.stdout:7/107: readlink d6/dc/d12/l16 0 2024-02-28T16:01:54.102 INFO:tasks.workunit.client.1.smithi087.stdout:6/423: mkdir d4/d12/d45/d92 0 2024-02-28T16:01:54.103 INFO:tasks.workunit.client.1.smithi087.stdout:6/424: chown d4 324112 1 2024-02-28T16:01:54.111 INFO:tasks.workunit.client.1.smithi087.stdout:2/393: dwrite d2/d42/f76 [0,4194304] 0 2024-02-28T16:01:54.114 INFO:tasks.workunit.client.0.smithi057.stdout:9/119: dwrite d2/d24/de/f28 [0,4194304] 0 2024-02-28T16:01:54.114 INFO:tasks.workunit.client.0.smithi057.stdout:3/77: mknod d8/dd/d14/c1a 0 2024-02-28T16:01:54.114 INFO:tasks.workunit.client.0.smithi057.stdout:2/79: truncate f12 562922 0 2024-02-28T16:01:54.114 INFO:tasks.workunit.client.0.smithi057.stdout:7/108: dread - d6/dc/d12/f21 zero size 2024-02-28T16:01:54.117 INFO:tasks.workunit.client.1.smithi087.stdout:2/394: getdents d2/d7/d17/d34 0 2024-02-28T16:01:54.120 INFO:tasks.workunit.client.0.smithi057.stdout:6/115: dwrite df/f12 [0,4194304] 0 2024-02-28T16:01:54.122 INFO:tasks.workunit.client.0.smithi057.stdout:9/120: chown d2/d24/de/l12 3 1 2024-02-28T16:01:54.125 INFO:tasks.workunit.client.1.smithi087.stdout:2/395: fdatasync d2/d7/d17/d3d/f58 0 2024-02-28T16:01:54.126 INFO:tasks.workunit.client.1.smithi087.stdout:5/428: dwrite d3/d9/f79 [0,4194304] 0 2024-02-28T16:01:54.127 INFO:tasks.workunit.client.0.smithi057.stdout:6/116: truncate f6 128524 0 2024-02-28T16:01:54.129 INFO:tasks.workunit.client.0.smithi057.stdout:2/80: creat d19/f1a x:0 0 0 2024-02-28T16:01:54.131 INFO:tasks.workunit.client.1.smithi087.stdout:2/396: mknod d2/d7/df/c8f 0 2024-02-28T16:01:54.132 INFO:tasks.workunit.client.1.smithi087.stdout:5/429: mkdir d3/d9/d9b 0 2024-02-28T16:01:54.133 INFO:tasks.workunit.client.0.smithi057.stdout:9/121: mkdir d2/d5/d1b/d2e 0 2024-02-28T16:01:54.134 INFO:tasks.workunit.client.1.smithi087.stdout:5/430: write d3/f21 [1075077,1443] 0 2024-02-28T16:01:54.136 INFO:tasks.workunit.client.0.smithi057.stdout:3/78: link f4 d8/dd/d14/f1b 0 2024-02-28T16:01:54.140 INFO:tasks.workunit.client.1.smithi087.stdout:2/397: rename d2/d7/f19 to d2/d7/df/d28/d79/f90 0 2024-02-28T16:01:54.144 INFO:tasks.workunit.client.0.smithi057.stdout:3/79: truncate d8/f12 30147 0 2024-02-28T16:01:54.144 INFO:tasks.workunit.client.0.smithi057.stdout:2/81: write d19/f1a [274753,83884] 0 2024-02-28T16:01:54.144 INFO:tasks.workunit.client.1.smithi087.stdout:5/431: creat d3/d9/d9b/f9c x:0 0 0 2024-02-28T16:01:54.149 INFO:tasks.workunit.client.0.smithi057.stdout:8/114: dwrite d5/de/f15 [0,4194304] 0 2024-02-28T16:01:54.151 INFO:tasks.workunit.client.1.smithi087.stdout:2/398: rename d2/d7/df/d28/f32 to d2/d7/df/d28/d54/f91 0 2024-02-28T16:01:54.151 INFO:tasks.workunit.client.0.smithi057.stdout:8/115: readlink d5/d6/l1a 0 2024-02-28T16:01:54.153 INFO:tasks.workunit.client.0.smithi057.stdout:8/116: write d5/f18 [320291,97153] 0 2024-02-28T16:01:54.154 INFO:tasks.workunit.client.1.smithi087.stdout:3/343: dwrite d11/f1b [0,4194304] 0 2024-02-28T16:01:54.155 INFO:tasks.workunit.client.0.smithi057.stdout:7/109: rename d6/dc/c1b to d6/dc/d12/c27 0 2024-02-28T16:01:54.155 INFO:tasks.workunit.client.1.smithi087.stdout:6/425: dwrite d4/dc/f1f [0,4194304] 0 2024-02-28T16:01:54.159 INFO:tasks.workunit.client.1.smithi087.stdout:3/344: unlink d11/d33/d67/f71 0 2024-02-28T16:01:54.159 INFO:tasks.workunit.client.1.smithi087.stdout:5/432: link d3/d6/f26 d3/d6/f9d 0 2024-02-28T16:01:54.160 INFO:tasks.workunit.client.1.smithi087.stdout:2/399: symlink d2/d7/df/d28/l92 0 2024-02-28T16:01:54.161 INFO:tasks.workunit.client.0.smithi057.stdout:9/122: creat d2/d5/d1b/d2e/f2f x:0 0 0 2024-02-28T16:01:54.162 INFO:tasks.workunit.client.0.smithi057.stdout:2/82: mknod d19/c1b 0 2024-02-28T16:01:54.164 INFO:tasks.workunit.client.1.smithi087.stdout:5/433: creat d3/d6/d30/d44/f9e x:0 0 0 2024-02-28T16:01:54.165 INFO:tasks.workunit.client.1.smithi087.stdout:3/345: truncate d11/d44/f56 736088 0 2024-02-28T16:01:54.166 INFO:tasks.workunit.client.1.smithi087.stdout:2/400: creat d2/d7/df/d28/d79/f93 x:0 0 0 2024-02-28T16:01:54.166 INFO:tasks.workunit.client.0.smithi057.stdout:6/117: mknod df/d14/d15/d16/c26 0 2024-02-28T16:01:54.166 INFO:tasks.workunit.client.0.smithi057.stdout:2/83: write d19/f1a [1016017,43354] 0 2024-02-28T16:01:54.167 INFO:tasks.workunit.client.1.smithi087.stdout:6/426: getdents d4/dc/d61 0 2024-02-28T16:01:54.167 INFO:tasks.workunit.client.1.smithi087.stdout:3/346: chown d11/d33/d74 1270 1 2024-02-28T16:01:54.168 INFO:tasks.workunit.client.1.smithi087.stdout:5/434: creat d3/d9/f9f x:0 0 0 2024-02-28T16:01:54.170 INFO:tasks.workunit.client.1.smithi087.stdout:2/401: mkdir d2/d7d/d94 0 2024-02-28T16:01:54.171 INFO:tasks.workunit.client.1.smithi087.stdout:1/389: sync 2024-02-28T16:01:54.171 INFO:tasks.workunit.client.1.smithi087.stdout:9/373: sync 2024-02-28T16:01:54.171 INFO:tasks.workunit.client.1.smithi087.stdout:4/447: sync 2024-02-28T16:01:54.172 INFO:tasks.workunit.client.1.smithi087.stdout:3/347: mkdir d11/d44/d76 0 2024-02-28T16:01:54.174 INFO:tasks.workunit.client.1.smithi087.stdout:5/435: symlink d3/d9/d4a/d5e/la0 0 2024-02-28T16:01:54.175 INFO:tasks.workunit.client.1.smithi087.stdout:6/427: creat d4/d30/d13/f93 x:0 0 0 2024-02-28T16:01:54.176 INFO:tasks.workunit.client.1.smithi087.stdout:2/402: creat d2/d42/d4b/f95 x:0 0 0 2024-02-28T16:01:54.178 INFO:tasks.workunit.client.0.smithi057.stdout:9/123: creat d2/d5/f30 x:0 0 0 2024-02-28T16:01:54.180 INFO:tasks.workunit.client.0.smithi057.stdout:3/80: mkdir d8/dd/d19/d1c 0 2024-02-28T16:01:54.182 INFO:tasks.workunit.client.0.smithi057.stdout:3/81: write d8/f18 [397030,46369] 0 2024-02-28T16:01:54.185 INFO:tasks.workunit.client.1.smithi087.stdout:4/448: rename d2/d9/de/f6d to d2/d9/d10/d22/fa1 0 2024-02-28T16:01:54.186 INFO:tasks.workunit.client.1.smithi087.stdout:3/348: rename d11/d44/d76 to d11/d44/d76/d77 22 2024-02-28T16:01:54.187 INFO:tasks.workunit.client.0.smithi057.stdout:2/84: stat cf 0 2024-02-28T16:01:54.188 INFO:tasks.workunit.client.0.smithi057.stdout:3/82: chown c2 4098888 1 2024-02-28T16:01:54.189 INFO:tasks.workunit.client.1.smithi087.stdout:9/374: rmdir d7/d65 0 2024-02-28T16:01:54.190 INFO:tasks.workunit.client.1.smithi087.stdout:1/390: fsync d0/d1b/d43/f64 0 2024-02-28T16:01:54.191 INFO:tasks.workunit.client.0.smithi057.stdout:3/83: write d8/f18 [293154,120633] 0 2024-02-28T16:01:54.194 INFO:tasks.workunit.client.0.smithi057.stdout:3/84: chown d8/f15 3206229 1 2024-02-28T16:01:54.194 INFO:tasks.workunit.client.1.smithi087.stdout:2/403: dread d2/d7/d17/d34/f6e [0,4194304] 0 2024-02-28T16:01:54.195 INFO:tasks.workunit.client.1.smithi087.stdout:9/375: rmdir d7/dd/d15/d39/d2e 39 2024-02-28T16:01:54.197 INFO:tasks.workunit.client.0.smithi057.stdout:2/85: mknod d19/c1c 0 2024-02-28T16:01:54.199 INFO:tasks.workunit.client.1.smithi087.stdout:6/428: link d4/d30/d13/d38/f3a d4/d12/d45/d92/f94 0 2024-02-28T16:01:54.200 INFO:tasks.workunit.client.1.smithi087.stdout:2/404: readlink d2/d7/df/d28/l41 0 2024-02-28T16:01:54.203 INFO:tasks.workunit.client.1.smithi087.stdout:6/429: read d4/dc/f56 [945629,126634] 0 2024-02-28T16:01:54.204 INFO:tasks.workunit.client.1.smithi087.stdout:9/376: mknod d7/dd/d15/d39/c66 0 2024-02-28T16:01:54.205 INFO:tasks.workunit.client.0.smithi057.stdout:7/110: creat d6/f28 x:0 0 0 2024-02-28T16:01:54.206 INFO:tasks.workunit.client.1.smithi087.stdout:2/405: truncate d2/d7/df/d28/d79/f93 77012 0 2024-02-28T16:01:54.206 INFO:tasks.workunit.client.1.smithi087.stdout:6/430: rmdir d4/d12/d45/d92 39 2024-02-28T16:01:54.207 INFO:tasks.workunit.client.0.smithi057.stdout:2/86: mkdir d19/d1d 0 2024-02-28T16:01:54.209 INFO:tasks.workunit.client.1.smithi087.stdout:9/377: unlink d7/dd/f42 0 2024-02-28T16:01:54.209 INFO:tasks.workunit.client.1.smithi087.stdout:2/406: chown d2/d7/d17/f7e 0 1 2024-02-28T16:01:54.210 INFO:tasks.workunit.client.1.smithi087.stdout:1/391: dwrite d0/d1b/d43/f64 [0,4194304] 0 2024-02-28T16:01:54.211 INFO:tasks.workunit.client.0.smithi057.stdout:3/85: mknod d8/dd/d19/d1c/c1d 0 2024-02-28T16:01:54.213 INFO:tasks.workunit.client.0.smithi057.stdout:2/87: readlink l18 0 2024-02-28T16:01:54.215 INFO:tasks.workunit.client.1.smithi087.stdout:2/407: creat d2/d7/df/d28/d79/f96 x:0 0 0 2024-02-28T16:01:54.215 INFO:tasks.workunit.client.1.smithi087.stdout:9/378: link l5 d7/dd/d15/d55/l67 0 2024-02-28T16:01:54.217 INFO:tasks.workunit.client.1.smithi087.stdout:9/379: fsync d7/d1e/f24 0 2024-02-28T16:01:54.229 INFO:tasks.workunit.client.0.smithi057.stdout:7/111: mkdir d6/dc/d12/d29 0 2024-02-28T16:01:54.231 INFO:tasks.workunit.client.1.smithi087.stdout:6/431: dwrite d4/d30/f24 [0,4194304] 0 2024-02-28T16:01:54.233 INFO:tasks.workunit.client.0.smithi057.stdout:8/117: dwrite d5/f17 [0,4194304] 0 2024-02-28T16:01:54.234 INFO:tasks.workunit.client.1.smithi087.stdout:9/380: truncate d7/dd/d15/d39/f16 763269 0 2024-02-28T16:01:54.236 INFO:tasks.workunit.client.1.smithi087.stdout:2/408: dwrite d2/d7/df/f39 [4194304,4194304] 0 2024-02-28T16:01:54.238 INFO:tasks.workunit.client.0.smithi057.stdout:9/124: dwrite d2/d24/ff [0,4194304] 0 2024-02-28T16:01:54.238 INFO:tasks.workunit.client.1.smithi087.stdout:6/432: unlink d4/d30/d13/d38/l60 0 2024-02-28T16:01:54.239 INFO:tasks.workunit.client.1.smithi087.stdout:9/381: chown d7/dd/d3c/f43 302 1 2024-02-28T16:01:54.241 INFO:tasks.workunit.client.1.smithi087.stdout:2/409: fdatasync d2/d7/df/d28/d79/f93 0 2024-02-28T16:01:54.246 INFO:tasks.workunit.client.1.smithi087.stdout:2/410: write d2/d7/d17/d34/f4a [372131,28775] 0 2024-02-28T16:01:54.254 INFO:tasks.workunit.client.0.smithi057.stdout:8/118: rename d5/d6/f9 to d5/d20/f27 0 2024-02-28T16:01:54.257 INFO:tasks.workunit.client.1.smithi087.stdout:6/433: rename d4/d30/d42/c49 to d4/d12/d45/d92/c95 0 2024-02-28T16:01:54.257 INFO:tasks.workunit.client.1.smithi087.stdout:2/411: rmdir d2/d7d 39 2024-02-28T16:01:54.261 INFO:tasks.workunit.client.0.smithi057.stdout:2/88: dwrite f9 [0,4194304] 0 2024-02-28T16:01:54.261 INFO:tasks.workunit.client.1.smithi087.stdout:3/349: dread d11/d33/f3d [0,4194304] 0 2024-02-28T16:01:54.262 INFO:tasks.workunit.client.0.smithi057.stdout:3/86: write f3 [872496,68499] 0 2024-02-28T16:01:54.262 INFO:tasks.workunit.client.1.smithi087.stdout:2/412: write d2/d42/d4b/f56 [1044314,21612] 0 2024-02-28T16:01:54.263 INFO:tasks.workunit.client.0.smithi057.stdout:7/112: getdents d6/dc/d12 0 2024-02-28T16:01:54.263 INFO:tasks.workunit.client.1.smithi087.stdout:6/434: mkdir d4/d96 0 2024-02-28T16:01:54.264 INFO:tasks.workunit.client.1.smithi087.stdout:9/382: link d7/dd/d15/d39/d2e/c52 d7/d1e/d44/c68 0 2024-02-28T16:01:54.264 INFO:tasks.workunit.client.0.smithi057.stdout:8/119: chown d5/cf 3 1 2024-02-28T16:01:54.268 INFO:tasks.workunit.client.1.smithi087.stdout:2/413: rmdir d2/d7/df/d28/d54 39 2024-02-28T16:01:54.268 INFO:tasks.workunit.client.1.smithi087.stdout:6/435: write d4/d12/f6d [2343471,76804] 0 2024-02-28T16:01:54.272 INFO:tasks.workunit.client.1.smithi087.stdout:6/436: truncate d4/d30/d13/f93 391889 0 2024-02-28T16:01:54.274 INFO:tasks.workunit.client.0.smithi057.stdout:3/87: mknod d8/dd/d19/c1e 0 2024-02-28T16:01:54.274 INFO:tasks.workunit.client.1.smithi087.stdout:2/414: getdents d2/d7/d17/d34/d88 0 2024-02-28T16:01:54.277 INFO:tasks.workunit.client.0.smithi057.stdout:8/120: rename d5/de/c23 to d5/de/d1b/c28 0 2024-02-28T16:01:54.278 INFO:tasks.workunit.client.1.smithi087.stdout:6/437: rmdir d4/d30/d13/d67 39 2024-02-28T16:01:54.281 INFO:tasks.workunit.client.1.smithi087.stdout:6/438: unlink d4/d12/d45/d74/f85 0 2024-02-28T16:01:54.282 INFO:tasks.workunit.client.0.smithi057.stdout:9/125: fsync d2/d5/f1f 0 2024-02-28T16:01:54.284 INFO:tasks.workunit.client.0.smithi057.stdout:7/113: dread d6/dc/f17 [0,4194304] 0 2024-02-28T16:01:54.292 INFO:tasks.workunit.client.0.smithi057.stdout:3/88: getdents d8/dd/d19/d1c 0 2024-02-28T16:01:54.294 INFO:tasks.workunit.client.1.smithi087.stdout:9/383: truncate d7/dd/d15/d39/f26 6677641 0 2024-02-28T16:01:54.295 INFO:tasks.workunit.client.0.smithi057.stdout:9/126: symlink d2/d24/l31 0 2024-02-28T16:01:54.297 INFO:tasks.workunit.client.0.smithi057.stdout:9/127: chown d2 3 1 2024-02-28T16:01:54.299 INFO:tasks.workunit.client.1.smithi087.stdout:6/439: dwrite d4/d12/d45/f39 [0,4194304] 0 2024-02-28T16:01:54.300 INFO:tasks.workunit.client.0.smithi057.stdout:3/89: creat d8/dd/f1f x:0 0 0 2024-02-28T16:01:54.301 INFO:tasks.workunit.client.1.smithi087.stdout:8/407: sync 2024-02-28T16:01:54.302 INFO:tasks.workunit.client.1.smithi087.stdout:0/401: sync 2024-02-28T16:01:54.302 INFO:tasks.workunit.client.1.smithi087.stdout:7/364: sync 2024-02-28T16:01:54.304 INFO:tasks.workunit.client.1.smithi087.stdout:3/350: dwrite d11/f2a [0,4194304] 0 2024-02-28T16:01:54.305 INFO:tasks.workunit.client.0.smithi057.stdout:2/89: dwrite f10 [0,4194304] 0 2024-02-28T16:01:54.309 INFO:tasks.workunit.client.0.smithi057.stdout:9/128: creat d2/d5/d9/f32 x:0 0 0 2024-02-28T16:01:54.310 INFO:tasks.workunit.client.0.smithi057.stdout:2/90: creat d19/f1e x:0 0 0 2024-02-28T16:01:54.312 INFO:tasks.workunit.client.1.smithi087.stdout:0/402: creat d4/dd/d21/f81 x:0 0 0 2024-02-28T16:01:54.315 INFO:tasks.workunit.client.0.smithi057.stdout:3/90: creat d8/dd/d14/f20 x:0 0 0 2024-02-28T16:01:54.316 INFO:tasks.workunit.client.1.smithi087.stdout:8/408: truncate d2/d18/f22 161754 0 2024-02-28T16:01:54.317 INFO:tasks.workunit.client.1.smithi087.stdout:0/403: write d4/d6/dc/d45/f7b [782867,106270] 0 2024-02-28T16:01:54.318 INFO:tasks.workunit.client.0.smithi057.stdout:8/121: dread d5/f18 [0,4194304] 0 2024-02-28T16:01:54.321 INFO:tasks.workunit.client.0.smithi057.stdout:3/91: write d8/f12 [486091,100412] 0 2024-02-28T16:01:54.326 INFO:tasks.workunit.client.1.smithi087.stdout:8/409: creat d2/d9/d10/d24/d53/f8c x:0 0 0 2024-02-28T16:01:54.326 INFO:tasks.workunit.client.1.smithi087.stdout:6/440: dwrite d4/d30/d13/d67/f87 [0,4194304] 0 2024-02-28T16:01:54.328 INFO:tasks.workunit.client.0.smithi057.stdout:7/114: truncate d6/dc/fd 3602773 0 2024-02-28T16:01:54.329 INFO:tasks.workunit.client.1.smithi087.stdout:3/351: dread d11/d44/d5b/f52 [0,4194304] 0 2024-02-28T16:01:54.329 INFO:tasks.workunit.client.0.smithi057.stdout:7/115: readlink d6/dc/l20 0 2024-02-28T16:01:54.330 INFO:tasks.workunit.client.0.smithi057.stdout:8/122: chown d5/de/d1b/c24 1502792356 1 2024-02-28T16:01:54.332 INFO:tasks.workunit.client.0.smithi057.stdout:3/92: symlink d8/l21 0 2024-02-28T16:01:54.334 INFO:tasks.workunit.client.0.smithi057.stdout:8/123: chown d5/f17 344192 1 2024-02-28T16:01:54.334 INFO:tasks.workunit.client.1.smithi087.stdout:8/410: rename d2/d9/d10/d24/c32 to d2/d18/c8d 0 2024-02-28T16:01:54.337 INFO:tasks.workunit.client.0.smithi057.stdout:2/91: link d19/c1c d19/d1d/c1f 0 2024-02-28T16:01:54.337 INFO:tasks.workunit.client.0.smithi057.stdout:9/129: rename d2/d24/de to d2/d33 0 2024-02-28T16:01:54.337 INFO:tasks.workunit.client.1.smithi087.stdout:8/411: fsync d2/d9/d10/d24/d53/d6f/f74 0 2024-02-28T16:01:54.339 INFO:tasks.workunit.client.0.smithi057.stdout:9/130: chown d2/f25 6717370 1 2024-02-28T16:01:54.339 INFO:tasks.workunit.client.0.smithi057.stdout:3/93: mknod d8/dd/d19/c22 0 2024-02-28T16:01:54.342 INFO:tasks.workunit.client.0.smithi057.stdout:3/94: readlink d8/dd/lf 0 2024-02-28T16:01:54.342 INFO:tasks.workunit.client.0.smithi057.stdout:9/131: write d2/d33/f28 [2901823,97765] 0 2024-02-28T16:01:54.342 INFO:tasks.workunit.client.1.smithi087.stdout:8/412: truncate d2/f64 157256 0 2024-02-28T16:01:54.343 INFO:tasks.workunit.client.0.smithi057.stdout:2/92: rename f9 to d19/d1d/f20 0 2024-02-28T16:01:54.345 INFO:tasks.workunit.client.0.smithi057.stdout:2/93: readlink l15 0 2024-02-28T16:01:54.347 INFO:tasks.workunit.client.1.smithi087.stdout:8/413: write d2/d9/d1a/f5b [5059929,23296] 0 2024-02-28T16:01:54.348 INFO:tasks.workunit.client.1.smithi087.stdout:0/404: dwrite d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/f51 [0,4194304] 0 2024-02-28T16:01:54.349 INFO:tasks.workunit.client.0.smithi057.stdout:7/116: link d6/dc/f10 d6/dc/f2a 0 2024-02-28T16:01:54.349 INFO:tasks.workunit.client.0.smithi057.stdout:8/124: creat d5/f29 x:0 0 0 2024-02-28T16:01:54.350 INFO:tasks.workunit.client.0.smithi057.stdout:3/95: mknod d8/dd/c23 0 2024-02-28T16:01:54.350 INFO:tasks.workunit.client.0.smithi057.stdout:9/132: fsync d2/d33/f15 0 2024-02-28T16:01:54.356 INFO:tasks.workunit.client.0.smithi057.stdout:9/133: read d2/d24/ff [285076,64159] 0 2024-02-28T16:01:54.356 INFO:tasks.workunit.client.0.smithi057.stdout:3/96: mknod d8/c24 0 2024-02-28T16:01:54.357 INFO:tasks.workunit.client.0.smithi057.stdout:7/117: symlink d6/l2b 0 2024-02-28T16:01:54.362 INFO:tasks.workunit.client.0.smithi057.stdout:3/97: write d8/dd/d14/f20 [138772,51473] 0 2024-02-28T16:01:54.364 INFO:tasks.workunit.client.0.smithi057.stdout:9/134: write d2/f20 [1048443,116934] 0 2024-02-28T16:01:54.369 INFO:tasks.workunit.client.0.smithi057.stdout:3/98: write f3 [149585,37927] 0 2024-02-28T16:01:54.369 INFO:tasks.workunit.client.1.smithi087.stdout:7/365: dwrite d14/f18 [0,4194304] 0 2024-02-28T16:01:54.375 INFO:tasks.workunit.client.0.smithi057.stdout:8/125: rmdir d5 39 2024-02-28T16:01:54.377 INFO:tasks.workunit.client.0.smithi057.stdout:8/126: unlink c4 0 2024-02-28T16:01:54.381 INFO:tasks.workunit.client.1.smithi087.stdout:3/352: dread d11/f17 [0,4194304] 0 2024-02-28T16:01:54.381 INFO:tasks.workunit.client.0.smithi057.stdout:8/127: chown l2 21 1 2024-02-28T16:01:54.381 INFO:tasks.workunit.client.1.smithi087.stdout:7/366: symlink d14/d46/d68/l72 0 2024-02-28T16:01:54.382 INFO:tasks.workunit.client.1.smithi087.stdout:9/384: dread d7/dd/d15/d39/f26 [0,4194304] 0 2024-02-28T16:01:54.382 INFO:tasks.workunit.client.0.smithi057.stdout:7/118: dread d6/fb [0,4194304] 0 2024-02-28T16:01:54.385 INFO:tasks.workunit.client.1.smithi087.stdout:3/353: creat d11/d44/d5b/f78 x:0 0 0 2024-02-28T16:01:54.386 INFO:tasks.workunit.client.0.smithi057.stdout:7/119: chown d6/dc/f18 0 1 2024-02-28T16:01:54.387 INFO:tasks.workunit.client.1.smithi087.stdout:9/385: mkdir d7/d1e/d60/d69 0 2024-02-28T16:01:54.388 INFO:tasks.workunit.client.1.smithi087.stdout:3/354: symlink d11/d33/d58/l79 0 2024-02-28T16:01:54.389 INFO:tasks.workunit.client.1.smithi087.stdout:3/355: readlink d11/d33/d58/l79 0 2024-02-28T16:01:54.391 INFO:tasks.workunit.client.1.smithi087.stdout:9/386: creat d7/dd/d15/d39/d2e/f6a x:0 0 0 2024-02-28T16:01:54.392 INFO:tasks.workunit.client.1.smithi087.stdout:7/367: mknod d14/d2e/d2b/d4e/c73 0 2024-02-28T16:01:54.392 INFO:tasks.workunit.client.1.smithi087.stdout:3/356: fdatasync d11/d44/d5b/f4f 0 2024-02-28T16:01:54.392 INFO:tasks.workunit.client.1.smithi087.stdout:9/387: fsync d7/f8 0 2024-02-28T16:01:54.395 INFO:tasks.workunit.client.1.smithi087.stdout:3/357: chown d11/d33/d58/l6f 326981 1 2024-02-28T16:01:54.396 INFO:tasks.workunit.client.1.smithi087.stdout:9/388: mkdir d7/d6b 0 2024-02-28T16:01:54.396 INFO:tasks.workunit.client.1.smithi087.stdout:0/405: dread d4/d6/f12 [0,4194304] 0 2024-02-28T16:01:54.396 INFO:tasks.workunit.client.0.smithi057.stdout:7/120: read d6/f14 [14949,103021] 0 2024-02-28T16:01:54.396 INFO:tasks.workunit.client.0.smithi057.stdout:2/94: dwrite d19/d1d/f20 [0,4194304] 0 2024-02-28T16:01:54.399 INFO:tasks.workunit.client.1.smithi087.stdout:3/358: mkdir d11/d45/d73/d7a 0 2024-02-28T16:01:54.401 INFO:tasks.workunit.client.1.smithi087.stdout:0/406: creat d4/dd/f82 x:0 0 0 2024-02-28T16:01:54.402 INFO:tasks.workunit.client.1.smithi087.stdout:3/359: write d11/d44/f5e [2935672,98512] 0 2024-02-28T16:01:54.407 INFO:tasks.workunit.client.0.smithi057.stdout:7/121: mknod d6/dc/d12/c2c 0 2024-02-28T16:01:54.410 INFO:tasks.workunit.client.1.smithi087.stdout:3/360: mkdir d11/d7b 0 2024-02-28T16:01:54.412 INFO:tasks.workunit.client.0.smithi057.stdout:7/122: rmdir d6/dc/d12 39 2024-02-28T16:01:54.412 INFO:tasks.workunit.client.0.smithi057.stdout:9/135: dwrite d2/d33/f15 [0,4194304] 0 2024-02-28T16:01:54.413 INFO:tasks.workunit.client.1.smithi087.stdout:3/361: mkdir d11/d61/d7c 0 2024-02-28T16:01:54.417 INFO:tasks.workunit.client.1.smithi087.stdout:3/362: write d11/d44/d5b/f5f [6487043,90988] 0 2024-02-28T16:01:54.420 INFO:tasks.workunit.client.0.smithi057.stdout:9/136: creat d2/d5/d1b/f34 x:0 0 0 2024-02-28T16:01:54.421 INFO:tasks.workunit.client.1.smithi087.stdout:7/368: dread d14/d2e/d2b/f50 [0,4194304] 0 2024-02-28T16:01:54.422 INFO:tasks.workunit.client.1.smithi087.stdout:7/369: readlink d14/d21/l39 0 2024-02-28T16:01:54.423 INFO:tasks.workunit.client.1.smithi087.stdout:3/363: creat d11/d33/d58/f7d x:0 0 0 2024-02-28T16:01:54.424 INFO:tasks.workunit.client.0.smithi057.stdout:8/128: dwrite d5/de/f15 [0,4194304] 0 2024-02-28T16:01:54.425 INFO:tasks.workunit.client.1.smithi087.stdout:0/407: dwrite d4/dd/d37/d39/d3a/d57/d74/f1d [0,4194304] 0 2024-02-28T16:01:54.425 INFO:tasks.workunit.client.0.smithi057.stdout:2/95: dwrite d19/f1e [0,4194304] 0 2024-02-28T16:01:54.428 INFO:tasks.workunit.client.0.smithi057.stdout:8/129: write d5/f17 [5190001,23085] 0 2024-02-28T16:01:54.430 INFO:tasks.workunit.client.1.smithi087.stdout:9/389: truncate d7/dd/d3c/f53 12707 0 2024-02-28T16:01:54.432 INFO:tasks.workunit.client.1.smithi087.stdout:3/364: mknod d11/d45/d73/d7a/c7e 0 2024-02-28T16:01:54.434 INFO:tasks.workunit.client.1.smithi087.stdout:9/390: creat d7/dd/d15/d55/f6c x:0 0 0 2024-02-28T16:01:54.435 INFO:tasks.workunit.client.0.smithi057.stdout:7/123: rename d6/dc/f17 to d6/dc/d12/f2d 0 2024-02-28T16:01:54.436 INFO:tasks.workunit.client.1.smithi087.stdout:3/365: read d11/f15 [1251259,14816] 0 2024-02-28T16:01:54.437 INFO:tasks.workunit.client.1.smithi087.stdout:3/366: dread - d11/f26 zero size 2024-02-28T16:01:54.441 INFO:tasks.workunit.client.1.smithi087.stdout:3/367: creat d11/d61/d7c/f7f x:0 0 0 2024-02-28T16:01:54.444 INFO:tasks.workunit.client.0.smithi057.stdout:7/124: dread d6/dc/d12/f2d [0,4194304] 0 2024-02-28T16:01:54.444 INFO:tasks.workunit.client.0.smithi057.stdout:8/130: dread d5/d6/f19 [0,4194304] 0 2024-02-28T16:01:54.445 INFO:tasks.workunit.client.1.smithi087.stdout:3/368: creat d11/d33/d67/f80 x:0 0 0 2024-02-28T16:01:54.445 INFO:tasks.workunit.client.1.smithi087.stdout:3/369: read - d11/f30 zero size 2024-02-28T16:01:54.446 INFO:tasks.workunit.client.1.smithi087.stdout:0/408: write d4/d6/f2a [1941086,89660] 0 2024-02-28T16:01:54.447 INFO:tasks.workunit.client.1.smithi087.stdout:9/391: truncate d7/dd/f20 1813660 0 2024-02-28T16:01:54.448 INFO:tasks.workunit.client.1.smithi087.stdout:0/409: mknod d4/dd/d37/c83 0 2024-02-28T16:01:54.450 INFO:tasks.workunit.client.0.smithi057.stdout:7/125: mknod d6/d26/c2e 0 2024-02-28T16:01:54.452 INFO:tasks.workunit.client.1.smithi087.stdout:0/410: creat d4/d6/dc/f84 x:0 0 0 2024-02-28T16:01:54.453 INFO:tasks.workunit.client.0.smithi057.stdout:8/131: creat d5/f2a x:0 0 0 2024-02-28T16:01:54.453 INFO:tasks.workunit.client.1.smithi087.stdout:3/370: getdents d11/d61/d65 0 2024-02-28T16:01:54.459 INFO:tasks.workunit.client.0.smithi057.stdout:7/126: creat d6/dc/f2f x:0 0 0 2024-02-28T16:01:54.460 INFO:tasks.workunit.client.1.smithi087.stdout:9/392: dread d7/dd/d15/f22 [0,4194304] 0 2024-02-28T16:01:54.460 INFO:tasks.workunit.client.0.smithi057.stdout:8/132: chown d5/c16 6 1 2024-02-28T16:01:54.461 INFO:tasks.workunit.client.1.smithi087.stdout:3/371: rename d11/d3a/f4b to d11/d33/d58/f81 0 2024-02-28T16:01:54.461 INFO:tasks.workunit.client.0.smithi057.stdout:9/137: dread d2/f25 [0,4194304] 0 2024-02-28T16:01:54.463 INFO:tasks.workunit.client.1.smithi087.stdout:9/393: chown d7/dd/d15/d39/d2e/c3a 4717652 1 2024-02-28T16:01:54.464 INFO:tasks.workunit.client.1.smithi087.stdout:3/372: creat d11/f82 x:0 0 0 2024-02-28T16:01:54.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:54 smithi087 ceph-mon[37122]: pgmap v29: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 149 MiB/s wr, 384 op/s 2024-02-28T16:01:54.465 INFO:tasks.workunit.client.0.smithi057.stdout:8/133: unlink d5/d6/c1d 0 2024-02-28T16:01:54.466 INFO:tasks.workunit.client.1.smithi087.stdout:9/394: mkdir d7/dd/d15/d3f/d6d 0 2024-02-28T16:01:54.467 INFO:tasks.workunit.client.1.smithi087.stdout:3/373: symlink d11/d45/l83 0 2024-02-28T16:01:54.469 INFO:tasks.workunit.client.0.smithi057.stdout:9/138: creat d2/d5/d9/f35 x:0 0 0 2024-02-28T16:01:54.469 INFO:tasks.workunit.client.1.smithi087.stdout:3/374: chown d11/c4d 4 1 2024-02-28T16:01:54.471 INFO:tasks.workunit.client.0.smithi057.stdout:8/134: creat d5/de/f2b x:0 0 0 2024-02-28T16:01:54.473 INFO:tasks.workunit.client.1.smithi087.stdout:3/375: truncate d11/d44/d5b/f78 912436 0 2024-02-28T16:01:54.474 INFO:tasks.workunit.client.1.smithi087.stdout:0/411: truncate d4/f48 633270 0 2024-02-28T16:01:54.474 INFO:tasks.workunit.client.1.smithi087.stdout:3/376: fsync d11/d44/d5b/f78 0 2024-02-28T16:01:54.475 INFO:tasks.workunit.client.0.smithi057.stdout:8/135: chown d5/de/f10 41235 1 2024-02-28T16:01:54.475 INFO:tasks.workunit.client.1.smithi087.stdout:3/377: read - d11/f26 zero size 2024-02-28T16:01:54.477 INFO:tasks.workunit.client.1.smithi087.stdout:3/378: write d11/f28 [4361054,82006] 0 2024-02-28T16:01:54.478 INFO:tasks.workunit.client.0.smithi057.stdout:9/139: creat d2/d5/d9/f36 x:0 0 0 2024-02-28T16:01:54.479 INFO:tasks.workunit.client.1.smithi087.stdout:0/412: read d4/d6/dc/d45/f7b [741314,23623] 0 2024-02-28T16:01:54.479 INFO:tasks.workunit.client.0.smithi057.stdout:8/136: fdatasync d5/d6/f22 0 2024-02-28T16:01:54.479 INFO:tasks.workunit.client.0.smithi057.stdout:2/96: truncate d19/f1e 3206164 0 2024-02-28T16:01:54.481 INFO:tasks.workunit.client.1.smithi087.stdout:3/379: creat d11/d61/d7c/f84 x:0 0 0 2024-02-28T16:01:54.482 INFO:tasks.workunit.client.1.smithi087.stdout:9/395: write d7/dc/f18 [3788216,6722] 0 2024-02-28T16:01:54.483 INFO:tasks.workunit.client.1.smithi087.stdout:0/413: read d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/f51 [4062513,82752] 0 2024-02-28T16:01:54.484 INFO:tasks.workunit.client.1.smithi087.stdout:3/380: dread - d11/f26 zero size 2024-02-28T16:01:54.485 INFO:tasks.workunit.client.0.smithi057.stdout:9/140: chown d2/d5/f30 327 1 2024-02-28T16:01:54.486 INFO:tasks.workunit.client.0.smithi057.stdout:2/97: symlink d19/d1d/l21 0 2024-02-28T16:01:54.490 INFO:tasks.workunit.client.0.smithi057.stdout:8/137: symlink d5/l2c 0 2024-02-28T16:01:54.490 INFO:tasks.workunit.client.0.smithi057.stdout:2/98: chown lc 0 1 2024-02-28T16:01:54.491 INFO:tasks.workunit.client.1.smithi087.stdout:3/381: rmdir d11/d44/d76 0 2024-02-28T16:01:54.494 INFO:tasks.workunit.client.1.smithi087.stdout:3/382: mknod d11/d33/d74/c85 0 2024-02-28T16:01:54.497 INFO:tasks.workunit.client.0.smithi057.stdout:7/127: dwrite d6/dc/d12/d1a/f24 [0,4194304] 0 2024-02-28T16:01:54.499 INFO:tasks.workunit.client.1.smithi087.stdout:0/414: dwrite d4/dd/d21/f81 [0,4194304] 0 2024-02-28T16:01:54.511 INFO:tasks.workunit.client.0.smithi057.stdout:7/128: symlink d6/dc/d12/d29/l30 0 2024-02-28T16:01:54.512 INFO:tasks.workunit.client.0.smithi057.stdout:2/99: getdents d19/d1d 0 2024-02-28T16:01:54.514 INFO:tasks.workunit.client.1.smithi087.stdout:3/383: dwrite d11/d61/d7c/f84 [0,4194304] 0 2024-02-28T16:01:54.516 INFO:tasks.workunit.client.1.smithi087.stdout:3/384: readlink d11/d61/d65/l68 0 2024-02-28T16:01:54.521 INFO:tasks.workunit.client.0.smithi057.stdout:8/138: dread d5/f18 [0,4194304] 0 2024-02-28T16:01:54.522 INFO:tasks.workunit.client.1.smithi087.stdout:3/385: getdents d11/d45/d73/d7a 0 2024-02-28T16:01:54.523 INFO:tasks.workunit.client.0.smithi057.stdout:8/139: write f0 [997648,122782] 0 2024-02-28T16:01:54.524 INFO:tasks.workunit.client.0.smithi057.stdout:7/129: fdatasync d6/dc/f10 0 2024-02-28T16:01:54.525 INFO:tasks.workunit.client.0.smithi057.stdout:9/141: dread d2/d5/f8 [0,4194304] 0 2024-02-28T16:01:54.526 INFO:tasks.workunit.client.0.smithi057.stdout:8/140: readlink d5/l2c 0 2024-02-28T16:01:54.529 INFO:tasks.workunit.client.1.smithi087.stdout:0/415: dwrite d4/dd/d37/d39/f70 [0,4194304] 0 2024-02-28T16:01:54.534 INFO:tasks.workunit.client.0.smithi057.stdout:8/141: write d5/d6/fd [5039,54236] 0 2024-02-28T16:01:54.535 INFO:tasks.workunit.client.0.smithi057.stdout:7/130: mknod d6/dc/d12/d1a/c31 0 2024-02-28T16:01:54.536 INFO:tasks.workunit.client.0.smithi057.stdout:9/142: rmdir d2/d5/d1b 39 2024-02-28T16:01:54.537 INFO:tasks.workunit.client.1.smithi087.stdout:0/416: fdatasync d4/dd/d37/d39/d3a/d57/d74/d1f/d34/f35 0 2024-02-28T16:01:54.541 INFO:tasks.workunit.client.1.smithi087.stdout:3/386: dwrite d11/d61/d7c/f7f [0,4194304] 0 2024-02-28T16:01:54.542 INFO:tasks.workunit.client.0.smithi057.stdout:9/143: readlink d2/d5/d9/l19 0 2024-02-28T16:01:54.544 INFO:tasks.workunit.client.0.smithi057.stdout:2/100: dwrite d19/f1a [0,4194304] 0 2024-02-28T16:01:54.547 INFO:tasks.workunit.client.1.smithi087.stdout:0/417: creat d4/dd/d37/d39/d3a/d57/d74/f85 x:0 0 0 2024-02-28T16:01:54.549 INFO:tasks.workunit.client.1.smithi087.stdout:3/387: mknod d11/d33/d58/c86 0 2024-02-28T16:01:54.553 INFO:tasks.workunit.client.1.smithi087.stdout:0/418: write d4/dd/d37/f3d [26354,37776] 0 2024-02-28T16:01:54.554 INFO:tasks.workunit.client.1.smithi087.stdout:9/396: dread d7/dc/f59 [0,4194304] 0 2024-02-28T16:01:54.555 INFO:tasks.workunit.client.0.smithi057.stdout:9/144: chown d2/d5/d1b/d2e/f2f 5312562 1 2024-02-28T16:01:54.556 INFO:tasks.workunit.client.1.smithi087.stdout:3/388: rename d11/f2e to d11/d44/f87 0 2024-02-28T16:01:54.557 INFO:tasks.workunit.client.1.smithi087.stdout:9/397: mknod d7/d6b/c6e 0 2024-02-28T16:01:54.558 INFO:tasks.workunit.client.1.smithi087.stdout:0/419: mknod d4/dd/d21/d32/c86 0 2024-02-28T16:01:54.561 INFO:tasks.workunit.client.0.smithi057.stdout:9/145: readlink d2/d24/d1d/l26 0 2024-02-28T16:01:54.564 INFO:tasks.workunit.client.1.smithi087.stdout:0/420: creat d4/dd/d37/d39/d3a/f87 x:0 0 0 2024-02-28T16:01:54.569 INFO:tasks.workunit.client.1.smithi087.stdout:0/421: read d4/dd/f13 [1947158,54364] 0 2024-02-28T16:01:54.573 INFO:tasks.workunit.client.1.smithi087.stdout:0/422: symlink d4/dd/d21/d5f/l88 0 2024-02-28T16:01:54.574 INFO:tasks.workunit.client.1.smithi087.stdout:3/389: dread d11/d44/f57 [0,4194304] 0 2024-02-28T16:01:54.577 INFO:tasks.workunit.client.1.smithi087.stdout:0/423: creat d4/f89 x:0 0 0 2024-02-28T16:01:54.584 INFO:tasks.workunit.client.0.smithi057.stdout:9/146: rename d2/d5/d9/f2c to d2/d5/f37 0 2024-02-28T16:01:54.584 INFO:tasks.workunit.client.1.smithi087.stdout:0/424: fdatasync d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/f51 0 2024-02-28T16:01:54.584 INFO:tasks.workunit.client.0.smithi057.stdout:7/131: dwrite d6/dc/f2f [0,4194304] 0 2024-02-28T16:01:54.585 INFO:tasks.workunit.client.0.smithi057.stdout:8/142: dwrite d5/d6/fa [0,4194304] 0 2024-02-28T16:01:54.585 INFO:tasks.workunit.client.1.smithi087.stdout:9/398: dwrite d7/dd/d15/f22 [0,4194304] 0 2024-02-28T16:01:54.587 INFO:tasks.workunit.client.0.smithi057.stdout:7/132: chown d6/dc 6 1 2024-02-28T16:01:54.587 INFO:tasks.workunit.client.0.smithi057.stdout:2/101: dwrite fe [0,4194304] 0 2024-02-28T16:01:54.589 INFO:tasks.workunit.client.0.smithi057.stdout:8/143: creat d5/d6/f2d x:0 0 0 2024-02-28T16:01:54.594 INFO:tasks.workunit.client.0.smithi057.stdout:7/133: dread - d6/dc/d12/f21 zero size 2024-02-28T16:01:54.595 INFO:tasks.workunit.client.1.smithi087.stdout:9/399: truncate d7/dd/fe 4715479 0 2024-02-28T16:01:54.596 INFO:tasks.workunit.client.0.smithi057.stdout:7/134: write d6/f23 [4684811,5205] 0 2024-02-28T16:01:54.596 INFO:tasks.workunit.client.1.smithi087.stdout:0/425: getdents d4/dd/d37/d39/d3a/d57 0 2024-02-28T16:01:54.598 INFO:tasks.workunit.client.0.smithi057.stdout:8/144: creat d5/de/d1b/f2e x:0 0 0 2024-02-28T16:01:54.600 INFO:tasks.workunit.client.1.smithi087.stdout:9/400: creat d7/dd/d3c/f6f x:0 0 0 2024-02-28T16:01:54.602 INFO:tasks.workunit.client.0.smithi057.stdout:2/102: mkdir d19/d1d/d22 0 2024-02-28T16:01:54.607 INFO:tasks.workunit.client.1.smithi087.stdout:9/401: rename d7/dd/l40 to d7/d1e/d60/d64/l70 0 2024-02-28T16:01:54.607 INFO:tasks.workunit.client.0.smithi057.stdout:7/135: symlink d6/dc/d12/l32 0 2024-02-28T16:01:54.611 INFO:tasks.workunit.client.0.smithi057.stdout:8/145: creat d5/f2f x:0 0 0 2024-02-28T16:01:54.613 INFO:tasks.workunit.client.1.smithi087.stdout:9/402: truncate d7/dd/f20 1659364 0 2024-02-28T16:01:54.615 INFO:tasks.workunit.client.0.smithi057.stdout:8/146: creat d5/de/d1b/f30 x:0 0 0 2024-02-28T16:01:54.616 INFO:tasks.workunit.client.1.smithi087.stdout:9/403: truncate d7/d1e/d60/f63 953846 0 2024-02-28T16:01:54.629 INFO:tasks.workunit.client.1.smithi087.stdout:9/404: fsync d7/dd/d15/d39/f26 0 2024-02-28T16:01:54.630 INFO:tasks.workunit.client.1.smithi087.stdout:0/426: write d4/dd/d37/d39/f5a [995861,34077] 0 2024-02-28T16:01:54.630 INFO:tasks.workunit.client.0.smithi057.stdout:2/103: fdatasync fe 0 2024-02-28T16:01:54.631 INFO:tasks.workunit.client.0.smithi057.stdout:8/147: dwrite d5/de/d1b/f25 [0,4194304] 0 2024-02-28T16:01:54.631 INFO:tasks.workunit.client.0.smithi057.stdout:9/147: truncate d2/d33/f28 3763658 0 2024-02-28T16:01:54.631 INFO:tasks.workunit.client.1.smithi087.stdout:9/405: read d7/dd/d15/f22 [3555010,97392] 0 2024-02-28T16:01:54.633 INFO:tasks.workunit.client.1.smithi087.stdout:9/406: read - d7/dd/d3c/f41 zero size 2024-02-28T16:01:54.633 INFO:tasks.workunit.client.1.smithi087.stdout:0/427: mknod d4/dd/d37/d39/d3a/d57/d74/c8a 0 2024-02-28T16:01:54.634 INFO:tasks.workunit.client.0.smithi057.stdout:8/148: readlink d5/l2c 0 2024-02-28T16:01:54.635 INFO:tasks.workunit.client.0.smithi057.stdout:2/104: creat d19/f23 x:0 0 0 2024-02-28T16:01:54.637 INFO:tasks.workunit.client.1.smithi087.stdout:0/428: creat d4/dd/d37/d39/d3a/d57/d74/d1f/d60/f8b x:0 0 0 2024-02-28T16:01:54.638 INFO:tasks.workunit.client.0.smithi057.stdout:9/148: symlink d2/d5/d1b/l38 0 2024-02-28T16:01:54.640 INFO:tasks.workunit.client.1.smithi087.stdout:0/429: write d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/f51 [1844893,100034] 0 2024-02-28T16:01:54.642 INFO:tasks.workunit.client.0.smithi057.stdout:2/105: write d19/d1d/f20 [4258219,26929] 0 2024-02-28T16:01:54.642 INFO:tasks.workunit.client.0.smithi057.stdout:8/149: fdatasync d5/d20/f27 0 2024-02-28T16:01:54.644 INFO:tasks.workunit.client.1.smithi087.stdout:0/430: write d4/dd/d37/d39/d3a/d57/d74/d1f/f33 [3821423,1977] 0 2024-02-28T16:01:54.647 INFO:tasks.workunit.client.0.smithi057.stdout:2/106: write d19/f23 [566035,68812] 0 2024-02-28T16:01:54.647 INFO:tasks.workunit.client.0.smithi057.stdout:9/149: write d2/d24/d1d/f23 [929293,34424] 0 2024-02-28T16:01:54.648 INFO:tasks.workunit.client.1.smithi087.stdout:0/431: creat d4/dd/d37/d39/d3a/d57/d74/d1f/d60/f8c x:0 0 0 2024-02-28T16:01:54.649 INFO:tasks.workunit.client.0.smithi057.stdout:2/107: fsync d19/f1a 0 2024-02-28T16:01:54.650 INFO:tasks.workunit.client.1.smithi087.stdout:9/407: dread d7/dd/f28 [8388608,4194304] 0 2024-02-28T16:01:54.655 INFO:tasks.workunit.client.0.smithi057.stdout:9/150: mkdir d2/d39 0 2024-02-28T16:01:54.658 INFO:tasks.workunit.client.1.smithi087.stdout:9/408: getdents d7/dd/d15/d3f/d5f 0 2024-02-28T16:01:54.661 INFO:tasks.workunit.client.0.smithi057.stdout:8/150: dread f0 [0,4194304] 0 2024-02-28T16:01:54.662 INFO:tasks.workunit.client.0.smithi057.stdout:8/151: stat d5/d6/f22 0 2024-02-28T16:01:54.664 INFO:tasks.workunit.client.1.smithi087.stdout:0/432: dwrite d4/dd/f13 [0,4194304] 0 2024-02-28T16:01:54.665 INFO:tasks.workunit.client.0.smithi057.stdout:9/151: fdatasync d2/d33/f28 0 2024-02-28T16:01:54.666 INFO:tasks.workunit.client.0.smithi057.stdout:2/108: dread d19/d1d/f20 [0,4194304] 0 2024-02-28T16:01:54.667 INFO:tasks.workunit.client.1.smithi087.stdout:0/433: symlink d4/dd/l8d 0 2024-02-28T16:01:54.669 INFO:tasks.workunit.client.0.smithi057.stdout:8/152: write d5/d20/f27 [935744,44912] 0 2024-02-28T16:01:54.670 INFO:tasks.workunit.client.1.smithi087.stdout:0/434: write d4/d6/f12 [110850,88582] 0 2024-02-28T16:01:54.673 INFO:tasks.workunit.client.0.smithi057.stdout:9/152: creat d2/f3a x:0 0 0 2024-02-28T16:01:54.675 INFO:tasks.workunit.client.1.smithi087.stdout:0/435: truncate d4/dd/d37/d39/d3a/d57/d74/f85 778270 0 2024-02-28T16:01:54.676 INFO:tasks.workunit.client.0.smithi057.stdout:2/109: symlink d19/d1d/d22/l24 0 2024-02-28T16:01:54.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:54 smithi057 ceph-mon[28763]: pgmap v29: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 149 MiB/s wr, 384 op/s 2024-02-28T16:01:54.678 INFO:tasks.workunit.client.0.smithi057.stdout:8/153: creat d5/f31 x:0 0 0 2024-02-28T16:01:54.678 INFO:tasks.workunit.client.1.smithi087.stdout:0/436: creat d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f8e x:0 0 0 2024-02-28T16:01:54.680 INFO:tasks.workunit.client.0.smithi057.stdout:2/110: chown d19/c1b 79 1 2024-02-28T16:01:54.681 INFO:tasks.workunit.client.0.smithi057.stdout:8/154: symlink d5/de/d1b/l32 0 2024-02-28T16:01:54.683 INFO:tasks.workunit.client.1.smithi087.stdout:0/437: rename d4/dd/d37/d39/f5a to d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f8f 0 2024-02-28T16:01:54.685 INFO:tasks.workunit.client.0.smithi057.stdout:8/155: creat d5/f33 x:0 0 0 2024-02-28T16:01:54.686 INFO:tasks.workunit.client.1.smithi087.stdout:0/438: unlink d4/dd/d37/d39/d3a/d57/d74/d1f/f33 0 2024-02-28T16:01:54.688 INFO:tasks.workunit.client.1.smithi087.stdout:5/436: sync 2024-02-28T16:01:54.688 INFO:tasks.workunit.client.1.smithi087.stdout:4/449: sync 2024-02-28T16:01:54.688 INFO:tasks.workunit.client.1.smithi087.stdout:0/439: mknod d4/dd/d21/d5f/c90 0 2024-02-28T16:01:54.690 INFO:tasks.workunit.client.1.smithi087.stdout:5/437: truncate d3/f13 4711903 0 2024-02-28T16:01:54.690 INFO:tasks.workunit.client.1.smithi087.stdout:5/438: fdatasync d3/f37 0 2024-02-28T16:01:54.692 INFO:tasks.workunit.client.1.smithi087.stdout:4/450: truncate d2/d9/d10/d22/d5b/d5c/d91/f97 1026988 0 2024-02-28T16:01:54.692 INFO:tasks.workunit.client.1.smithi087.stdout:5/439: fdatasync d3/f22 0 2024-02-28T16:01:54.695 INFO:tasks.workunit.client.1.smithi087.stdout:4/451: stat d2/d9/da/d1a/d26 0 2024-02-28T16:01:54.696 INFO:tasks.workunit.client.1.smithi087.stdout:5/440: chown d3/d6/d30/d53/d5b/f94 278 1 2024-02-28T16:01:54.697 INFO:tasks.workunit.client.1.smithi087.stdout:4/452: mknod d2/d9/da/ca2 0 2024-02-28T16:01:54.698 INFO:tasks.workunit.client.0.smithi057.stdout:9/153: dwrite d2/d5/f1f [0,4194304] 0 2024-02-28T16:01:54.702 INFO:tasks.workunit.client.1.smithi087.stdout:4/453: mknod d2/d9/d10/d22/d5b/d5c/ca3 0 2024-02-28T16:01:54.703 INFO:tasks.workunit.client.0.smithi057.stdout:2/111: dwrite d19/f1a [0,4194304] 0 2024-02-28T16:01:54.703 INFO:tasks.workunit.client.1.smithi087.stdout:4/454: readlink d2/d9/d10/d22/l30 0 2024-02-28T16:01:54.704 INFO:tasks.workunit.client.1.smithi087.stdout:4/455: readlink d2/l3e 0 2024-02-28T16:01:54.704 INFO:tasks.workunit.client.0.smithi057.stdout:9/154: mknod d2/d24/c3b 0 2024-02-28T16:01:54.705 INFO:tasks.workunit.client.0.smithi057.stdout:9/155: chown d2/d24 1 1 2024-02-28T16:01:54.706 INFO:tasks.workunit.client.0.smithi057.stdout:8/156: dwrite d5/de/f15 [0,4194304] 0 2024-02-28T16:01:54.708 INFO:tasks.workunit.client.0.smithi057.stdout:9/156: read d2/d5/f8 [154505,101531] 0 2024-02-28T16:01:54.708 INFO:tasks.workunit.client.0.smithi057.stdout:2/112: rename c17 to d19/d1d/c25 0 2024-02-28T16:01:54.711 INFO:tasks.workunit.client.1.smithi087.stdout:4/456: readlink d2/d9/da/d1a/l61 0 2024-02-28T16:01:54.711 INFO:tasks.workunit.client.0.smithi057.stdout:8/157: write d5/f17 [3954760,101345] 0 2024-02-28T16:01:54.713 INFO:tasks.workunit.client.0.smithi057.stdout:2/113: write d19/f23 [396108,18597] 0 2024-02-28T16:01:54.714 INFO:tasks.workunit.client.0.smithi057.stdout:8/158: readlink d5/d6/l1a 0 2024-02-28T16:01:54.715 INFO:tasks.workunit.client.1.smithi087.stdout:4/457: creat d2/df/d65/d8d/fa4 x:0 0 0 2024-02-28T16:01:54.717 INFO:tasks.workunit.client.1.smithi087.stdout:5/441: dwrite d3/d6/d30/d53/d5b/f6c [0,4194304] 0 2024-02-28T16:01:54.717 INFO:tasks.workunit.client.0.smithi057.stdout:9/157: rmdir d2/d39 0 2024-02-28T16:01:54.719 INFO:tasks.workunit.client.1.smithi087.stdout:5/442: stat d3/f21 0 2024-02-28T16:01:54.719 INFO:tasks.workunit.client.0.smithi057.stdout:2/114: mkdir d19/d1d/d26 0 2024-02-28T16:01:54.721 INFO:tasks.workunit.client.1.smithi087.stdout:4/458: symlink d2/df/d62/la5 0 2024-02-28T16:01:54.722 INFO:tasks.workunit.client.1.smithi087.stdout:5/443: dread - d3/d6/d69/f92 zero size 2024-02-28T16:01:54.727 INFO:tasks.workunit.client.0.smithi057.stdout:9/158: write d2/f20 [1871417,29090] 0 2024-02-28T16:01:54.727 INFO:tasks.workunit.client.0.smithi057.stdout:8/159: symlink d5/de/l34 0 2024-02-28T16:01:54.727 INFO:tasks.workunit.client.1.smithi087.stdout:4/459: fsync d2/d9/da/d1a/d26/f29 0 2024-02-28T16:01:54.728 INFO:tasks.workunit.client.1.smithi087.stdout:5/444: mkdir d3/d9/d4a/d5e/da1 0 2024-02-28T16:01:54.731 INFO:tasks.workunit.client.0.smithi057.stdout:9/159: unlink d2/f25 0 2024-02-28T16:01:54.732 INFO:tasks.workunit.client.1.smithi087.stdout:4/460: read d2/d9/de/f86 [5226393,14246] 0 2024-02-28T16:01:54.732 INFO:tasks.workunit.client.1.smithi087.stdout:4/461: readlink d2/ld 0 2024-02-28T16:01:54.734 INFO:tasks.workunit.client.0.smithi057.stdout:2/115: dread f12 [0,4194304] 0 2024-02-28T16:01:54.735 INFO:tasks.workunit.client.0.smithi057.stdout:8/160: unlink d5/f2a 0 2024-02-28T16:01:54.736 INFO:tasks.workunit.client.1.smithi087.stdout:4/462: creat d2/d9/da/d1a/d26/d69/fa6 x:0 0 0 2024-02-28T16:01:54.738 INFO:tasks.workunit.client.0.smithi057.stdout:2/116: chown d19/d1d/d22/l24 0 1 2024-02-28T16:01:54.738 INFO:tasks.workunit.client.0.smithi057.stdout:9/160: creat d2/d5/d1b/f3c x:0 0 0 2024-02-28T16:01:54.740 INFO:tasks.workunit.client.0.smithi057.stdout:9/161: chown d2/d5/d9/f36 7 1 2024-02-28T16:01:54.740 INFO:tasks.workunit.client.1.smithi087.stdout:4/463: getdents d2/d9/d10/d22 0 2024-02-28T16:01:54.745 INFO:tasks.workunit.client.1.smithi087.stdout:4/464: truncate d2/df/d65/d8d/fa4 231556 0 2024-02-28T16:01:54.745 INFO:tasks.workunit.client.1.smithi087.stdout:5/445: dwrite d3/d6/d30/d36/f48 [0,4194304] 0 2024-02-28T16:01:54.751 INFO:tasks.workunit.client.1.smithi087.stdout:4/465: mkdir d2/d9/da/d1a/d26/da7 0 2024-02-28T16:01:54.753 INFO:tasks.workunit.client.1.smithi087.stdout:5/446: creat d3/d6/d30/d8f/fa2 x:0 0 0 2024-02-28T16:01:54.754 INFO:tasks.workunit.client.0.smithi057.stdout:2/117: dread d19/f1a [0,4194304] 0 2024-02-28T16:01:54.756 INFO:tasks.workunit.client.1.smithi087.stdout:4/466: write d2/d9/de/f19 [26341,112582] 0 2024-02-28T16:01:54.760 INFO:tasks.workunit.client.1.smithi087.stdout:4/467: getdents d2/df/d62 0 2024-02-28T16:01:54.761 INFO:tasks.workunit.client.0.smithi057.stdout:8/161: dwrite d5/d6/f2d [0,4194304] 0 2024-02-28T16:01:54.762 INFO:tasks.workunit.client.0.smithi057.stdout:9/162: dwrite d2/d5/d1b/d2e/f2f [0,4194304] 0 2024-02-28T16:01:54.763 INFO:tasks.workunit.client.1.smithi087.stdout:4/468: symlink d2/d9/d10/d22/d5b/d5c/la8 0 2024-02-28T16:01:54.767 INFO:tasks.workunit.client.1.smithi087.stdout:4/469: unlink d2/d9/de/f85 0 2024-02-28T16:01:54.767 INFO:tasks.workunit.client.0.smithi057.stdout:8/162: creat d5/de/d1b/f35 x:0 0 0 2024-02-28T16:01:54.770 INFO:tasks.workunit.client.0.smithi057.stdout:2/118: getdents d19 0 2024-02-28T16:01:54.770 INFO:tasks.workunit.client.0.smithi057.stdout:8/163: read - d5/f29 zero size 2024-02-28T16:01:54.771 INFO:tasks.workunit.client.1.smithi087.stdout:5/447: dwrite d3/d6/d69/f7d [0,4194304] 0 2024-02-28T16:01:54.772 INFO:tasks.workunit.client.1.smithi087.stdout:4/470: mkdir d2/d9/d10/d22/d5b/d5c/d91/da9 0 2024-02-28T16:01:54.776 INFO:tasks.workunit.client.1.smithi087.stdout:4/471: mknod d2/df/d65/caa 0 2024-02-28T16:01:54.777 INFO:tasks.workunit.client.1.smithi087.stdout:5/448: rename d3/d6/d30/d53/d5b/l5d to d3/d6/d30/d53/d5b/la3 0 2024-02-28T16:01:54.782 INFO:tasks.workunit.client.1.smithi087.stdout:4/472: link d2/df/d65/l66 d2/d9/d10/d22/d5b/d5c/lab 0 2024-02-28T16:01:54.785 INFO:tasks.workunit.client.1.smithi087.stdout:5/449: readlink d3/d6/d30/d53/d5b/la3 0 2024-02-28T16:01:54.786 INFO:tasks.workunit.client.1.smithi087.stdout:4/473: creat d2/d9/d10/d22/d5b/d5c/fac x:0 0 0 2024-02-28T16:01:54.790 INFO:tasks.workunit.client.0.smithi057.stdout:9/163: dwrite d2/f20 [0,4194304] 0 2024-02-28T16:01:54.790 INFO:tasks.workunit.client.1.smithi087.stdout:4/474: mkdir d2/df/d2e/dad 0 2024-02-28T16:01:54.792 INFO:tasks.workunit.client.0.smithi057.stdout:9/164: write d2/d24/d1d/f23 [550923,5561] 0 2024-02-28T16:01:54.793 INFO:tasks.workunit.client.0.smithi057.stdout:2/119: dread d19/f1a [0,4194304] 0 2024-02-28T16:01:54.793 INFO:tasks.workunit.client.0.smithi057.stdout:8/164: dread d5/d6/f2d [0,4194304] 0 2024-02-28T16:01:54.795 INFO:tasks.workunit.client.0.smithi057.stdout:9/165: readlink d2/d24/l31 0 2024-02-28T16:01:54.799 INFO:tasks.workunit.client.0.smithi057.stdout:2/120: creat d19/f27 x:0 0 0 2024-02-28T16:01:54.799 INFO:tasks.workunit.client.0.smithi057.stdout:8/165: creat d5/d6/f36 x:0 0 0 2024-02-28T16:01:54.800 INFO:tasks.workunit.client.1.smithi087.stdout:4/475: link d2/d9/l57 d2/d9/da/d1a/d26/da7/lae 0 2024-02-28T16:01:54.801 INFO:tasks.workunit.client.0.smithi057.stdout:9/166: creat d2/d33/f3d x:0 0 0 2024-02-28T16:01:54.802 INFO:tasks.workunit.client.0.smithi057.stdout:2/121: symlink d19/d1d/d22/l28 0 2024-02-28T16:01:54.814 INFO:tasks.workunit.client.1.smithi087.stdout:4/476: dwrite d2/f32 [0,4194304] 0 2024-02-28T16:01:54.818 INFO:tasks.workunit.client.1.smithi087.stdout:4/477: creat d2/df/d65/d8d/faf x:0 0 0 2024-02-28T16:01:54.819 INFO:tasks.workunit.client.0.smithi057.stdout:2/122: write f12 [706942,109245] 0 2024-02-28T16:01:54.819 INFO:tasks.workunit.client.0.smithi057.stdout:9/167: truncate d2/d33/f15 3098928 0 2024-02-28T16:01:54.819 INFO:tasks.workunit.client.1.smithi087.stdout:5/450: dread d3/d6/d30/d36/f45 [0,4194304] 0 2024-02-28T16:01:54.820 INFO:tasks.workunit.client.0.smithi057.stdout:9/168: chown d2/d5/d9 5466594 1 2024-02-28T16:01:54.820 INFO:tasks.workunit.client.0.smithi057.stdout:2/123: readlink d19/d1d/l21 0 2024-02-28T16:01:54.825 INFO:tasks.workunit.client.0.smithi057.stdout:8/166: dwrite d5/d6/f2d [4194304,4194304] 0 2024-02-28T16:01:54.827 INFO:tasks.workunit.client.1.smithi087.stdout:5/451: dread d3/d6/d30/d36/f5f [0,4194304] 0 2024-02-28T16:01:54.829 INFO:tasks.workunit.client.1.smithi087.stdout:5/452: dread - d3/d6/d69/f92 zero size 2024-02-28T16:01:54.829 INFO:tasks.workunit.client.0.smithi057.stdout:8/167: fsync d5/d6/fd 0 2024-02-28T16:01:54.830 INFO:tasks.workunit.client.0.smithi057.stdout:2/124: creat d19/f29 x:0 0 0 2024-02-28T16:01:54.830 INFO:tasks.workunit.client.1.smithi087.stdout:4/478: dread d2/d9/f24 [0,4194304] 0 2024-02-28T16:01:54.830 INFO:tasks.workunit.client.1.smithi087.stdout:5/453: dread - d3/d6/d30/d8f/fa2 zero size 2024-02-28T16:01:54.832 INFO:tasks.workunit.client.1.smithi087.stdout:5/454: chown d3/f8a 120 1 2024-02-28T16:01:54.832 INFO:tasks.workunit.client.0.smithi057.stdout:8/168: fsync d5/de/d1b/f35 0 2024-02-28T16:01:54.833 INFO:tasks.workunit.client.0.smithi057.stdout:2/125: truncate d19/f29 513687 0 2024-02-28T16:01:54.833 INFO:tasks.workunit.client.1.smithi087.stdout:4/479: truncate d2/df/d2e/f8e 163724 0 2024-02-28T16:01:54.835 INFO:tasks.workunit.client.0.smithi057.stdout:9/169: link d2/d5/d9/l19 d2/l3e 0 2024-02-28T16:01:54.837 INFO:tasks.workunit.client.0.smithi057.stdout:2/126: symlink d19/d1d/l2a 0 2024-02-28T16:01:54.837 INFO:tasks.workunit.client.0.smithi057.stdout:8/169: symlink d5/de/d1b/l37 0 2024-02-28T16:01:54.837 INFO:tasks.workunit.client.1.smithi087.stdout:5/455: rename d3/f34 to d3/d64/d67/fa4 0 2024-02-28T16:01:54.841 INFO:tasks.workunit.client.1.smithi087.stdout:4/480: link d2/d9/de/f19 d2/d9/fb0 0 2024-02-28T16:01:54.842 INFO:tasks.workunit.client.1.smithi087.stdout:5/456: symlink d3/d6/d30/d53/d5b/la5 0 2024-02-28T16:01:54.842 INFO:tasks.workunit.client.0.smithi057.stdout:9/170: creat d2/f3f x:0 0 0 2024-02-28T16:01:54.843 INFO:tasks.workunit.client.1.smithi087.stdout:4/481: stat d2/d9/d10/d22/d5b/d5c/d91/f97 0 2024-02-28T16:01:54.843 INFO:tasks.workunit.client.0.smithi057.stdout:2/127: rmdir d19/d1d/d22 39 2024-02-28T16:01:54.844 INFO:tasks.workunit.client.0.smithi057.stdout:8/170: creat d5/d20/f38 x:0 0 0 2024-02-28T16:01:54.844 INFO:tasks.workunit.client.1.smithi087.stdout:5/457: creat d3/d64/d67/fa6 x:0 0 0 2024-02-28T16:01:54.846 INFO:tasks.workunit.client.0.smithi057.stdout:9/171: write d2/d5/d1b/d2e/f2f [1980682,109100] 0 2024-02-28T16:01:54.846 INFO:tasks.workunit.client.0.smithi057.stdout:8/171: chown d5/de/d1b 4444966 1 2024-02-28T16:01:54.846 INFO:tasks.workunit.client.1.smithi087.stdout:4/482: symlink d2/d9/da/d1a/d26/lb1 0 2024-02-28T16:01:54.847 INFO:tasks.workunit.client.0.smithi057.stdout:2/128: creat d19/f2b x:0 0 0 2024-02-28T16:01:54.848 INFO:tasks.workunit.client.1.smithi087.stdout:5/458: write d3/d6/d30/d36/f5f [1006767,10296] 0 2024-02-28T16:01:54.849 INFO:tasks.workunit.client.0.smithi057.stdout:8/172: chown d5/de/d1b/f35 1928527 1 2024-02-28T16:01:54.850 INFO:tasks.workunit.client.1.smithi087.stdout:4/483: mknod d2/df/d65/cb2 0 2024-02-28T16:01:54.851 INFO:tasks.workunit.client.1.smithi087.stdout:5/459: mknod d3/d6/d30/d53/ca7 0 2024-02-28T16:01:54.852 INFO:tasks.workunit.client.1.smithi087.stdout:4/484: write d2/d9/d10/d22/d5b/f9b [527210,13847] 0 2024-02-28T16:01:54.852 INFO:tasks.workunit.client.0.smithi057.stdout:9/172: rmdir d2/d5/d1b/d2e 39 2024-02-28T16:01:54.855 INFO:tasks.workunit.client.0.smithi057.stdout:8/173: mkdir d5/d20/d39 0 2024-02-28T16:01:54.855 INFO:tasks.workunit.client.1.smithi087.stdout:1/392: sync 2024-02-28T16:01:54.855 INFO:tasks.workunit.client.1.smithi087.stdout:6/441: sync 2024-02-28T16:01:54.855 INFO:tasks.workunit.client.1.smithi087.stdout:2/415: sync 2024-02-28T16:01:54.855 INFO:tasks.workunit.client.1.smithi087.stdout:5/460: symlink d3/d9/d4a/d5e/la8 0 2024-02-28T16:01:54.855 INFO:tasks.workunit.client.1.smithi087.stdout:1/393: fdatasync d0/d1b/d43/d4d/f51 0 2024-02-28T16:01:54.856 INFO:tasks.workunit.client.1.smithi087.stdout:4/485: mkdir d2/d9/d10/d22/db3 0 2024-02-28T16:01:54.857 INFO:tasks.workunit.client.1.smithi087.stdout:1/394: dread - d0/f7a zero size 2024-02-28T16:01:54.858 INFO:tasks.workunit.client.0.smithi057.stdout:9/173: mkdir d2/d5/d9/d40 0 2024-02-28T16:01:54.858 INFO:tasks.workunit.client.1.smithi087.stdout:6/442: chown d4/d12/d45/d5e/c88 31787 1 2024-02-28T16:01:54.859 INFO:tasks.workunit.client.1.smithi087.stdout:2/416: mkdir d2/d7/d17/d97 0 2024-02-28T16:01:54.859 INFO:tasks.workunit.client.1.smithi087.stdout:5/461: symlink d3/d6/d69/d87/la9 0 2024-02-28T16:01:54.860 INFO:tasks.workunit.client.0.smithi057.stdout:8/174: rename d5/l2c to d5/d6/l3a 0 2024-02-28T16:01:54.861 INFO:tasks.workunit.client.1.smithi087.stdout:2/417: chown d2/f85 3250 1 2024-02-28T16:01:54.862 INFO:tasks.workunit.client.1.smithi087.stdout:4/486: truncate d2/d9/d10/d22/d5b/d5c/f7d 273858 0 2024-02-28T16:01:54.864 INFO:tasks.workunit.client.1.smithi087.stdout:2/418: fsync d2/d7/df/d28/d79/f96 0 2024-02-28T16:01:54.865 INFO:tasks.workunit.client.1.smithi087.stdout:5/462: dread d3/d64/d67/f7b [0,4194304] 0 2024-02-28T16:01:54.865 INFO:tasks.workunit.client.0.smithi057.stdout:8/175: rename d5/c16 to d5/d6/c3b 0 2024-02-28T16:01:54.865 INFO:tasks.workunit.client.1.smithi087.stdout:6/443: rename d4/dc/f55 to d4/d12/d45/f97 0 2024-02-28T16:01:54.867 INFO:tasks.workunit.client.1.smithi087.stdout:2/419: read d2/d7/df/f4d [644679,89580] 0 2024-02-28T16:01:54.868 INFO:tasks.workunit.client.1.smithi087.stdout:5/463: fsync d3/d9/d4a/f50 0 2024-02-28T16:01:54.869 INFO:tasks.workunit.client.1.smithi087.stdout:4/487: symlink d2/d9/d10/lb4 0 2024-02-28T16:01:54.869 INFO:tasks.workunit.client.1.smithi087.stdout:6/444: fdatasync d4/d30/d13/d38/f64 0 2024-02-28T16:01:54.870 INFO:tasks.workunit.client.0.smithi057.stdout:8/176: mknod d5/d6/c3c 0 2024-02-28T16:01:54.870 INFO:tasks.workunit.client.0.smithi057.stdout:2/129: dwrite d19/f1a [0,4194304] 0 2024-02-28T16:01:54.872 INFO:tasks.workunit.client.1.smithi087.stdout:5/464: write d3/d64/d67/fa6 [717591,87305] 0 2024-02-28T16:01:54.875 INFO:tasks.workunit.client.1.smithi087.stdout:1/395: dwrite d0/d1b/f45 [0,4194304] 0 2024-02-28T16:01:54.876 INFO:tasks.workunit.client.0.smithi057.stdout:2/130: mkdir d19/d2c 0 2024-02-28T16:01:54.876 INFO:tasks.workunit.client.1.smithi087.stdout:2/420: dread d2/d7/df/f1e [0,4194304] 0 2024-02-28T16:01:54.880 INFO:tasks.workunit.client.0.smithi057.stdout:9/174: dwrite d2/d5/d9/f35 [0,4194304] 0 2024-02-28T16:01:54.880 INFO:tasks.workunit.client.1.smithi087.stdout:6/445: creat d4/d96/f98 x:0 0 0 2024-02-28T16:01:54.880 INFO:tasks.workunit.client.1.smithi087.stdout:5/465: symlink d3/d9/d4a/d5e/laa 0 2024-02-28T16:01:54.881 INFO:tasks.workunit.client.0.smithi057.stdout:2/131: write d19/d1d/f20 [4929088,2663] 0 2024-02-28T16:01:54.884 INFO:tasks.workunit.client.0.smithi057.stdout:2/132: write d19/f1a [2566479,18872] 0 2024-02-28T16:01:54.884 INFO:tasks.workunit.client.1.smithi087.stdout:5/466: chown d3/d9/d4a/d5e/da1 16728 1 2024-02-28T16:01:54.888 INFO:tasks.workunit.client.1.smithi087.stdout:2/421: creat d2/d7/d17/d34/f98 x:0 0 0 2024-02-28T16:01:54.899 INFO:tasks.workunit.client.0.smithi057.stdout:9/175: stat d2/d5/d1b/d2e/f2f 0 2024-02-28T16:01:54.900 INFO:tasks.workunit.client.0.smithi057.stdout:8/177: rmdir d5/d6 39 2024-02-28T16:01:54.901 INFO:tasks.workunit.client.0.smithi057.stdout:8/178: chown d5/d6/fa 742 1 2024-02-28T16:01:54.906 INFO:tasks.workunit.client.0.smithi057.stdout:9/176: dwrite d2/d5/f1a [0,4194304] 0 2024-02-28T16:01:54.909 INFO:tasks.workunit.client.0.smithi057.stdout:9/177: truncate d2/f20 4764116 0 2024-02-28T16:01:54.910 INFO:tasks.workunit.client.0.smithi057.stdout:8/179: link d5/de/d1b/f25 d5/de/d1b/f3d 0 2024-02-28T16:01:54.912 INFO:tasks.workunit.client.0.smithi057.stdout:8/180: fdatasync d5/de/d1b/f30 0 2024-02-28T16:01:54.913 INFO:tasks.workunit.client.0.smithi057.stdout:9/178: symlink d2/d33/l41 0 2024-02-28T16:01:54.914 INFO:tasks.workunit.client.0.smithi057.stdout:9/179: fsync d2/f3f 0 2024-02-28T16:01:54.914 INFO:tasks.workunit.client.0.smithi057.stdout:8/181: chown d5/de/d1b/f25 168 1 2024-02-28T16:01:54.919 INFO:tasks.workunit.client.0.smithi057.stdout:9/180: fsync d2/d24/f10 0 2024-02-28T16:01:54.920 INFO:tasks.workunit.client.0.smithi057.stdout:9/181: dread - d2/d5/f37 zero size 2024-02-28T16:01:54.933 INFO:tasks.workunit.client.0.smithi057.stdout:8/182: dwrite d5/de/f15 [0,4194304] 0 2024-02-28T16:01:54.934 INFO:tasks.workunit.client.1.smithi087.stdout:1/396: write d0/d1b/d1f/f4a [420175,32724] 0 2024-02-28T16:01:54.936 INFO:tasks.workunit.client.1.smithi087.stdout:1/397: stat d0/d1b/d43/f4b 0 2024-02-28T16:01:54.937 INFO:tasks.workunit.client.0.smithi057.stdout:8/183: stat d5/de/d1b/f30 0 2024-02-28T16:01:54.940 INFO:tasks.workunit.client.1.smithi087.stdout:2/422: rename d2/d7/df to d2/d99 0 2024-02-28T16:01:54.940 INFO:tasks.workunit.client.0.smithi057.stdout:8/184: write d5/f7 [4849178,37809] 0 2024-02-28T16:01:54.942 INFO:tasks.workunit.client.0.smithi057.stdout:9/182: dwrite d2/d5/f1a [0,4194304] 0 2024-02-28T16:01:54.945 INFO:tasks.workunit.client.1.smithi087.stdout:5/467: dwrite d3/d6/d30/d44/d54/f6e [0,4194304] 0 2024-02-28T16:01:54.945 INFO:tasks.workunit.client.1.smithi087.stdout:2/423: mkdir d2/d9a 0 2024-02-28T16:01:54.945 INFO:tasks.workunit.client.1.smithi087.stdout:6/446: dwrite d4/dc/d61/f63 [0,4194304] 0 2024-02-28T16:01:54.946 INFO:tasks.workunit.client.1.smithi087.stdout:5/468: stat d3/d64/d81/f4b 0 2024-02-28T16:01:54.947 INFO:tasks.workunit.client.1.smithi087.stdout:2/424: chown d2/d99/d28/l80 13 1 2024-02-28T16:01:54.952 INFO:tasks.workunit.client.1.smithi087.stdout:6/447: mkdir d4/d30/d13/d38/d69/d99 0 2024-02-28T16:01:54.955 INFO:tasks.workunit.client.1.smithi087.stdout:5/469: creat d3/d6/d69/fab x:0 0 0 2024-02-28T16:01:54.955 INFO:tasks.workunit.client.0.smithi057.stdout:8/185: mknod d5/d20/d39/c3e 0 2024-02-28T16:01:54.957 INFO:tasks.workunit.client.1.smithi087.stdout:2/425: rename d2/f7c to d2/d7/d17/d3d/f9b 0 2024-02-28T16:01:54.958 INFO:tasks.workunit.client.0.smithi057.stdout:9/183: symlink d2/d24/d1d/l42 0 2024-02-28T16:01:54.959 INFO:tasks.workunit.client.1.smithi087.stdout:6/448: mkdir d4/d12/d45/d74/d9a 0 2024-02-28T16:01:54.961 INFO:tasks.workunit.client.0.smithi057.stdout:9/184: unlink d2/d5/f1f 0 2024-02-28T16:01:54.961 INFO:tasks.workunit.client.1.smithi087.stdout:5/470: mkdir d3/d6/d30/d8f/dac 0 2024-02-28T16:01:54.962 INFO:tasks.workunit.client.1.smithi087.stdout:2/426: symlink d2/d9a/l9c 0 2024-02-28T16:01:54.964 INFO:tasks.workunit.client.1.smithi087.stdout:6/449: mkdir d4/d30/d9b 0 2024-02-28T16:01:54.964 INFO:tasks.workunit.client.1.smithi087.stdout:2/427: readlink d2/d99/l5e 0 2024-02-28T16:01:54.968 INFO:tasks.workunit.client.1.smithi087.stdout:5/471: mknod d3/d9/d4a/d5e/da1/cad 0 2024-02-28T16:01:54.969 INFO:tasks.workunit.client.1.smithi087.stdout:2/428: unlink d2/d7d/c8e 0 2024-02-28T16:01:54.970 INFO:tasks.workunit.client.0.smithi057.stdout:9/185: link d2/d24/c3b d2/d5/d9/d40/c43 0 2024-02-28T16:01:54.971 INFO:tasks.workunit.client.1.smithi087.stdout:2/429: write d2/d42/f44 [959926,86258] 0 2024-02-28T16:01:54.973 INFO:tasks.workunit.client.1.smithi087.stdout:5/472: mknod d3/d6/d30/d8f/cae 0 2024-02-28T16:01:54.974 INFO:tasks.workunit.client.0.smithi057.stdout:8/186: dread d5/d20/f27 [0,4194304] 0 2024-02-28T16:01:54.976 INFO:tasks.workunit.client.1.smithi087.stdout:2/430: symlink d2/d7/d17/d3d/l9d 0 2024-02-28T16:01:54.977 INFO:tasks.workunit.client.1.smithi087.stdout:5/473: mknod d3/d6/d69/d87/caf 0 2024-02-28T16:01:54.981 INFO:tasks.workunit.client.0.smithi057.stdout:9/186: truncate d2/d33/f28 2313230 0 2024-02-28T16:01:54.983 INFO:tasks.workunit.client.0.smithi057.stdout:8/187: creat d5/d6/f3f x:0 0 0 2024-02-28T16:01:54.985 INFO:tasks.workunit.client.0.smithi057.stdout:9/187: mkdir d2/d5/d1b/d2e/d44 0 2024-02-28T16:01:54.986 INFO:tasks.workunit.client.0.smithi057.stdout:8/188: write d5/de/f15 [1445278,39490] 0 2024-02-28T16:01:54.996 INFO:tasks.workunit.client.1.smithi087.stdout:1/398: dread d0/d1d/f72 [0,4194304] 0 2024-02-28T16:01:54.999 INFO:tasks.workunit.client.1.smithi087.stdout:1/399: fsync d0/ff 0 2024-02-28T16:01:55.000 INFO:tasks.workunit.client.0.smithi057.stdout:8/189: fdatasync d5/de/d1b/f3d 0 2024-02-28T16:01:55.002 INFO:tasks.workunit.client.1.smithi087.stdout:6/450: dwrite d4/f23 [0,4194304] 0 2024-02-28T16:01:55.003 INFO:tasks.workunit.client.1.smithi087.stdout:2/431: dread d2/d99/d28/f43 [0,4194304] 0 2024-02-28T16:01:55.004 INFO:tasks.workunit.client.1.smithi087.stdout:1/400: write d0/ff [403645,27904] 0 2024-02-28T16:01:55.005 INFO:tasks.workunit.client.0.smithi057.stdout:9/188: getdents d2/d5/d1b 0 2024-02-28T16:01:55.005 INFO:tasks.workunit.client.0.smithi057.stdout:8/190: mknod d5/d20/d39/c40 0 2024-02-28T16:01:55.005 INFO:tasks.workunit.client.0.smithi057.stdout:9/189: dread - d2/f3a zero size 2024-02-28T16:01:55.006 INFO:tasks.workunit.client.0.smithi057.stdout:8/191: read d5/de/d1b/f25 [299821,68809] 0 2024-02-28T16:01:55.007 INFO:tasks.workunit.client.1.smithi087.stdout:6/451: creat d4/dc/d7e/f9c x:0 0 0 2024-02-28T16:01:55.008 INFO:tasks.workunit.client.1.smithi087.stdout:2/432: mknod d2/d7/d17/d3d/c9e 0 2024-02-28T16:01:55.009 INFO:tasks.workunit.client.0.smithi057.stdout:9/190: read d2/d33/f28 [492765,65522] 0 2024-02-28T16:01:55.013 INFO:tasks.workunit.client.0.smithi057.stdout:8/192: creat d5/f41 x:0 0 0 2024-02-28T16:01:55.013 INFO:tasks.workunit.client.1.smithi087.stdout:6/452: fsync d4/dc/d10/f3d 0 2024-02-28T16:01:55.014 INFO:tasks.workunit.client.0.smithi057.stdout:9/191: creat d2/d5/d1b/d2e/f45 x:0 0 0 2024-02-28T16:01:55.014 INFO:tasks.workunit.client.1.smithi087.stdout:6/453: readlink d4/l25 0 2024-02-28T16:01:55.017 INFO:tasks.workunit.client.0.smithi057.stdout:8/193: creat d5/d20/d39/f42 x:0 0 0 2024-02-28T16:01:55.017 INFO:tasks.workunit.client.1.smithi087.stdout:6/454: creat d4/dc/d61/d89/f9d x:0 0 0 2024-02-28T16:01:55.018 INFO:tasks.workunit.client.0.smithi057.stdout:9/192: mkdir d2/d46 0 2024-02-28T16:01:55.019 INFO:tasks.workunit.client.0.smithi057.stdout:9/193: dread - d2/d5/d1b/f34 zero size 2024-02-28T16:01:55.020 INFO:tasks.workunit.client.1.smithi087.stdout:6/455: write d4/d12/d45/f91 [3476504,90700] 0 2024-02-28T16:01:55.020 INFO:tasks.workunit.client.1.smithi087.stdout:1/401: write d0/f2 [3404562,66567] 0 2024-02-28T16:01:55.021 INFO:tasks.workunit.client.1.smithi087.stdout:6/456: chown d4/d96 1714756 1 2024-02-28T16:01:55.021 INFO:tasks.workunit.client.0.smithi057.stdout:8/194: creat d5/f43 x:0 0 0 2024-02-28T16:01:55.023 INFO:tasks.workunit.client.1.smithi087.stdout:2/433: write d2/d7/d17/d34/f3a [1177627,71173] 0 2024-02-28T16:01:55.023 INFO:tasks.workunit.client.1.smithi087.stdout:6/457: readlink d4/l6 0 2024-02-28T16:01:55.024 INFO:tasks.workunit.client.1.smithi087.stdout:1/402: fsync d0/f12 0 2024-02-28T16:01:55.024 INFO:tasks.workunit.client.1.smithi087.stdout:6/458: readlink d4/l6 0 2024-02-28T16:01:55.026 INFO:tasks.workunit.client.0.smithi057.stdout:8/195: write d5/d6/f19 [4901538,112538] 0 2024-02-28T16:01:55.026 INFO:tasks.workunit.client.1.smithi087.stdout:6/459: dread - d4/d96/f98 zero size 2024-02-28T16:01:55.029 INFO:tasks.workunit.client.1.smithi087.stdout:2/434: truncate d2/d7/d17/d34/f8d 4945440 0 2024-02-28T16:01:55.029 INFO:tasks.workunit.client.1.smithi087.stdout:6/460: fdatasync d4/dc/d10/f36 0 2024-02-28T16:01:55.030 INFO:tasks.workunit.client.0.smithi057.stdout:8/196: mknod d5/d6/c44 0 2024-02-28T16:01:55.030 INFO:tasks.workunit.client.0.smithi057.stdout:8/197: dread - d5/d20/f38 zero size 2024-02-28T16:01:55.031 INFO:tasks.workunit.client.1.smithi087.stdout:2/435: readlink d2/l49 0 2024-02-28T16:01:55.032 INFO:tasks.workunit.client.1.smithi087.stdout:6/461: write d4/d30/d42/f75 [609345,114988] 0 2024-02-28T16:01:55.032 INFO:tasks.workunit.client.0.smithi057.stdout:8/198: write d5/de/f2b [549072,53351] 0 2024-02-28T16:01:55.033 INFO:tasks.workunit.client.1.smithi087.stdout:2/436: dread - d2/d7/f6a zero size 2024-02-28T16:01:55.035 INFO:tasks.workunit.client.1.smithi087.stdout:1/403: truncate d0/d14/f25 3705950 0 2024-02-28T16:01:55.035 INFO:tasks.workunit.client.0.smithi057.stdout:9/194: dread d2/d5/f1a [0,4194304] 0 2024-02-28T16:01:55.036 INFO:tasks.workunit.client.1.smithi087.stdout:2/437: mkdir d2/d99/d28/d79/d9f 0 2024-02-28T16:01:55.037 INFO:tasks.workunit.client.0.smithi057.stdout:8/199: unlink d5/d20/f27 0 2024-02-28T16:01:55.037 INFO:tasks.workunit.client.1.smithi087.stdout:1/404: write d0/d1a/d28/f7f [380924,27520] 0 2024-02-28T16:01:55.038 INFO:tasks.workunit.client.1.smithi087.stdout:1/405: dread - d0/f70 zero size 2024-02-28T16:01:55.040 INFO:tasks.workunit.client.0.smithi057.stdout:9/195: creat d2/f47 x:0 0 0 2024-02-28T16:01:55.040 INFO:tasks.workunit.client.1.smithi087.stdout:2/438: rename d2/fb to d2/d7/d17/d97/fa0 0 2024-02-28T16:01:55.041 INFO:tasks.workunit.client.1.smithi087.stdout:1/406: symlink d0/d1b/d43/l80 0 2024-02-28T16:01:55.042 INFO:tasks.workunit.client.0.smithi057.stdout:8/200: mkdir d5/de/d1b/d45 0 2024-02-28T16:01:55.042 INFO:tasks.workunit.client.0.smithi057.stdout:9/196: chown d2/d24/ff 343632569 1 2024-02-28T16:01:55.042 INFO:tasks.workunit.client.1.smithi087.stdout:8/414: sync 2024-02-28T16:01:55.042 INFO:tasks.workunit.client.1.smithi087.stdout:7/370: sync 2024-02-28T16:01:55.043 INFO:tasks.workunit.client.1.smithi087.stdout:3/390: sync 2024-02-28T16:01:55.044 INFO:tasks.workunit.client.0.smithi057.stdout:9/197: dread - d2/f3f zero size 2024-02-28T16:01:55.045 INFO:tasks.workunit.client.1.smithi087.stdout:0/440: sync 2024-02-28T16:01:55.045 INFO:tasks.workunit.client.1.smithi087.stdout:9/409: sync 2024-02-28T16:01:55.045 INFO:tasks.workunit.client.1.smithi087.stdout:2/439: creat d2/d7/d17/d97/fa1 x:0 0 0 2024-02-28T16:01:55.046 INFO:tasks.workunit.client.1.smithi087.stdout:7/371: write d14/d2e/f5c [992536,46258] 0 2024-02-28T16:01:55.046 INFO:tasks.workunit.client.1.smithi087.stdout:0/441: rename d4 to d4/dd/d37/d39/d3a/d57/d74/d91 22 2024-02-28T16:01:55.047 INFO:tasks.workunit.client.1.smithi087.stdout:2/440: readlink d2/d7/l3b 0 2024-02-28T16:01:55.048 INFO:tasks.workunit.client.0.smithi057.stdout:8/201: unlink d5/d20/d39/c40 0 2024-02-28T16:01:55.048 INFO:tasks.workunit.client.0.smithi057.stdout:9/198: stat d2/d24/l18 0 2024-02-28T16:01:55.048 INFO:tasks.workunit.client.1.smithi087.stdout:6/462: truncate d4/dc/d10/f40 117996 0 2024-02-28T16:01:55.052 INFO:tasks.workunit.client.0.smithi057.stdout:9/199: write d2/d5/f1a [3503288,39220] 0 2024-02-28T16:01:55.053 INFO:tasks.workunit.client.1.smithi087.stdout:3/391: rmdir d11/d45/d73/d7a 39 2024-02-28T16:01:55.053 INFO:tasks.workunit.client.1.smithi087.stdout:1/407: dread d0/d1b/d1f/f4a [0,4194304] 0 2024-02-28T16:01:55.054 INFO:tasks.workunit.client.1.smithi087.stdout:7/372: creat d14/d46/f74 x:0 0 0 2024-02-28T16:01:55.056 INFO:tasks.workunit.client.1.smithi087.stdout:0/442: symlink d4/d6/dc/d45/l92 0 2024-02-28T16:01:55.057 INFO:tasks.workunit.client.0.smithi057.stdout:9/200: creat d2/d5/d1b/d2e/d44/f48 x:0 0 0 2024-02-28T16:01:55.058 INFO:tasks.workunit.client.1.smithi087.stdout:3/392: mkdir d11/d45/d88 0 2024-02-28T16:01:55.063 INFO:tasks.workunit.client.0.smithi057.stdout:9/201: creat d2/d5/d1b/f49 x:0 0 0 2024-02-28T16:01:55.065 INFO:tasks.workunit.client.0.smithi057.stdout:8/202: truncate d5/d6/f2d 7141178 0 2024-02-28T16:01:55.066 INFO:tasks.workunit.client.1.smithi087.stdout:7/373: truncate f13 963797 0 2024-02-28T16:01:55.071 INFO:tasks.workunit.client.0.smithi057.stdout:8/203: rename d5/de/d1b/l37 to d5/de/d1b/l46 0 2024-02-28T16:01:55.072 INFO:tasks.workunit.client.1.smithi087.stdout:3/393: symlink d11/d44/l89 0 2024-02-28T16:01:55.072 INFO:tasks.workunit.client.1.smithi087.stdout:8/415: dwrite d2/d9/f5c [0,4194304] 0 2024-02-28T16:01:55.072 INFO:tasks.workunit.client.1.smithi087.stdout:3/394: write d11/d33/d67/f6e [548127,57827] 0 2024-02-28T16:01:55.076 INFO:tasks.workunit.client.1.smithi087.stdout:3/395: readlink d11/d33/d58/l79 0 2024-02-28T16:01:55.077 INFO:tasks.workunit.client.1.smithi087.stdout:6/463: dwrite d4/dc/f8e [0,4194304] 0 2024-02-28T16:01:55.079 INFO:tasks.workunit.client.0.smithi057.stdout:8/204: mkdir d5/de/d47 0 2024-02-28T16:01:55.079 INFO:tasks.workunit.client.1.smithi087.stdout:7/374: creat d14/d27/d5d/f75 x:0 0 0 2024-02-28T16:01:55.084 INFO:tasks.workunit.client.0.smithi057.stdout:8/205: mknod d5/d20/d39/c48 0 2024-02-28T16:01:55.085 INFO:tasks.workunit.client.1.smithi087.stdout:7/375: truncate d14/d27/f6d 582135 0 2024-02-28T16:01:55.089 INFO:tasks.workunit.client.0.smithi057.stdout:8/206: unlink f0 0 2024-02-28T16:01:55.089 INFO:tasks.workunit.client.1.smithi087.stdout:0/443: getdents d4/d6/dc/d45 0 2024-02-28T16:01:55.090 INFO:tasks.workunit.client.1.smithi087.stdout:2/441: dread d2/d99/f13 [0,4194304] 0 2024-02-28T16:01:55.092 INFO:tasks.workunit.client.1.smithi087.stdout:8/416: mkdir d2/d9/d8e 0 2024-02-28T16:01:55.094 INFO:tasks.workunit.client.1.smithi087.stdout:1/408: dwrite d0/d1b/d1f/f4a [0,4194304] 0 2024-02-28T16:01:55.096 INFO:tasks.workunit.client.0.smithi057.stdout:8/207: write d5/f43 [901485,16285] 0 2024-02-28T16:01:55.097 INFO:tasks.workunit.client.1.smithi087.stdout:0/444: mkdir d4/dd/d26/d93 0 2024-02-28T16:01:55.102 INFO:tasks.workunit.client.1.smithi087.stdout:1/409: truncate d0/f7a 693868 0 2024-02-28T16:01:55.103 INFO:tasks.workunit.client.1.smithi087.stdout:0/445: dread - d4/dd/d21/f71 zero size 2024-02-28T16:01:55.103 INFO:tasks.workunit.client.1.smithi087.stdout:2/442: write d2/d7/d17/d34/f4a [1324084,10987] 0 2024-02-28T16:01:55.106 INFO:tasks.workunit.client.0.smithi057.stdout:9/202: dwrite d2/d5/d9/fb [0,4194304] 0 2024-02-28T16:01:55.106 INFO:tasks.workunit.client.0.smithi057.stdout:8/208: truncate d5/de/d1b/f35 826743 0 2024-02-28T16:01:55.108 INFO:tasks.workunit.client.0.smithi057.stdout:9/203: readlink d2/d24/l18 0 2024-02-28T16:01:55.112 INFO:tasks.workunit.client.0.smithi057.stdout:8/209: mkdir d5/d20/d39/d49 0 2024-02-28T16:01:55.115 INFO:tasks.workunit.client.0.smithi057.stdout:9/204: symlink d2/d5/l4a 0 2024-02-28T16:01:55.119 INFO:tasks.workunit.client.0.smithi057.stdout:8/210: creat d5/de/f4a x:0 0 0 2024-02-28T16:01:55.119 INFO:tasks.workunit.client.1.smithi087.stdout:1/410: dread d0/d1a/d28/f29 [0,4194304] 0 2024-02-28T16:01:55.120 INFO:tasks.workunit.client.1.smithi087.stdout:0/446: truncate d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/f51 4971188 0 2024-02-28T16:01:55.120 INFO:tasks.workunit.client.1.smithi087.stdout:7/376: dwrite d14/d21/f26 [4194304,4194304] 0 2024-02-28T16:01:55.123 INFO:tasks.workunit.client.0.smithi057.stdout:9/205: unlink d2/d33/f3d 0 2024-02-28T16:01:55.127 INFO:tasks.workunit.client.1.smithi087.stdout:2/443: getdents d2/d7/d17/d3d 0 2024-02-28T16:01:55.128 INFO:tasks.workunit.client.0.smithi057.stdout:9/206: write d2/d5/d1b/f49 [352894,114923] 0 2024-02-28T16:01:55.132 INFO:tasks.workunit.client.1.smithi087.stdout:2/444: stat d2/d99/d28/l2b 0 2024-02-28T16:01:55.133 INFO:tasks.workunit.client.0.smithi057.stdout:8/211: truncate d5/d6/fd 1198832 0 2024-02-28T16:01:55.133 INFO:tasks.workunit.client.0.smithi057.stdout:9/207: write d2/d5/f8 [1554557,89393] 0 2024-02-28T16:01:55.140 INFO:tasks.workunit.client.1.smithi087.stdout:3/396: dread d11/d33/d58/f81 [0,4194304] 0 2024-02-28T16:01:55.142 INFO:tasks.workunit.client.1.smithi087.stdout:3/397: read - d11/f82 zero size 2024-02-28T16:01:55.142 INFO:tasks.workunit.client.1.smithi087.stdout:8/417: dwrite d2/d9/d10/f3a [0,4194304] 0 2024-02-28T16:01:55.143 INFO:tasks.workunit.client.1.smithi087.stdout:7/377: fsync d14/d2e/d2b/f4b 0 2024-02-28T16:01:55.144 INFO:tasks.workunit.client.1.smithi087.stdout:6/464: dread d4/dc/d10/f2b [0,4194304] 0 2024-02-28T16:01:55.147 INFO:tasks.workunit.client.1.smithi087.stdout:6/465: stat d4/dc/f8e 0 2024-02-28T16:01:55.152 INFO:tasks.workunit.client.0.smithi057.stdout:9/208: dwrite d2/d5/d1b/f49 [0,4194304] 0 2024-02-28T16:01:55.153 INFO:tasks.workunit.client.1.smithi087.stdout:2/445: mknod d2/d7/d17/ca2 0 2024-02-28T16:01:55.156 INFO:tasks.workunit.client.0.smithi057.stdout:9/209: creat d2/d5/d9/f4b x:0 0 0 2024-02-28T16:01:55.156 INFO:tasks.workunit.client.1.smithi087.stdout:7/378: write d14/d2e/d2b/f50 [2769895,9699] 0 2024-02-28T16:01:55.159 INFO:tasks.workunit.client.1.smithi087.stdout:1/411: dwrite d0/d1b/d43/d4d/f74 [0,4194304] 0 2024-02-28T16:01:55.164 INFO:tasks.workunit.client.0.smithi057.stdout:9/210: write d2/d24/f10 [734429,106501] 0 2024-02-28T16:01:55.165 INFO:tasks.workunit.client.1.smithi087.stdout:3/398: symlink d11/d44/d5b/l8a 0 2024-02-28T16:01:55.166 INFO:tasks.workunit.client.1.smithi087.stdout:7/379: creat d14/d27/f76 x:0 0 0 2024-02-28T16:01:55.168 INFO:tasks.workunit.client.1.smithi087.stdout:7/380: dread - d14/d27/d5d/f5e zero size 2024-02-28T16:01:55.168 INFO:tasks.workunit.client.0.smithi057.stdout:9/211: truncate d2/d5/d9/f1c 411164 0 2024-02-28T16:01:55.169 INFO:tasks.workunit.client.1.smithi087.stdout:3/399: write d11/d61/d7c/f7f [4746633,108695] 0 2024-02-28T16:01:55.171 INFO:tasks.workunit.client.1.smithi087.stdout:7/381: write d14/d27/f3f [271635,126131] 0 2024-02-28T16:01:55.172 INFO:tasks.workunit.client.0.smithi057.stdout:9/212: write d2/d5/d1b/d2e/d44/f48 [254221,90962] 0 2024-02-28T16:01:55.175 INFO:tasks.workunit.client.1.smithi087.stdout:1/412: link d0/d1a/d28/f29 d0/d1b/d1f/d71/f81 0 2024-02-28T16:01:55.176 INFO:tasks.workunit.client.1.smithi087.stdout:8/418: dwrite d2/d33/f35 [0,4194304] 0 2024-02-28T16:01:55.177 INFO:tasks.workunit.client.0.smithi057.stdout:9/213: write d2/d5/f30 [93277,129064] 0 2024-02-28T16:01:55.177 INFO:tasks.workunit.client.1.smithi087.stdout:3/400: symlink d11/d33/l8b 0 2024-02-28T16:01:55.179 INFO:tasks.workunit.client.1.smithi087.stdout:3/401: chown d11/d3a/d3c 266937064 1 2024-02-28T16:01:55.179 INFO:tasks.workunit.client.1.smithi087.stdout:7/382: write d14/d2e/d2b/d4e/f52 [1251045,19318] 0 2024-02-28T16:01:55.181 INFO:tasks.workunit.client.0.smithi057.stdout:9/214: dread - d2/d5/d1b/f34 zero size 2024-02-28T16:01:55.186 INFO:tasks.workunit.client.1.smithi087.stdout:3/402: rmdir d11/d45/d73 39 2024-02-28T16:01:55.186 INFO:tasks.workunit.client.1.smithi087.stdout:7/383: symlink d14/d27/d5d/d6a/l77 0 2024-02-28T16:01:55.187 INFO:tasks.workunit.client.1.smithi087.stdout:6/466: dwrite d4/d30/d13/d38/f64 [0,4194304] 0 2024-02-28T16:01:55.190 INFO:tasks.workunit.client.1.smithi087.stdout:1/413: rename d0/d1a/l55 to d0/d1b/d1f/l82 0 2024-02-28T16:01:55.205 INFO:tasks.workunit.client.0.smithi057.stdout:9/215: dwrite d2/d5/d1b/f34 [0,4194304] 0 2024-02-28T16:01:55.207 INFO:tasks.workunit.client.0.smithi057.stdout:9/216: read d2/d5/d1b/f49 [3479137,5298] 0 2024-02-28T16:01:55.212 INFO:tasks.workunit.client.0.smithi057.stdout:9/217: write d2/d5/f37 [710000,15890] 0 2024-02-28T16:01:55.218 INFO:tasks.workunit.client.0.smithi057.stdout:9/218: stat d2/d24/ca 0 2024-02-28T16:01:55.222 INFO:tasks.workunit.client.0.smithi057.stdout:9/219: mkdir d2/d5/d1b/d2e/d4c 0 2024-02-28T16:01:55.225 INFO:tasks.workunit.client.0.smithi057.stdout:9/220: symlink d2/d5/d1b/d2e/d44/l4d 0 2024-02-28T16:01:55.226 INFO:tasks.workunit.client.0.smithi057.stdout:9/221: dread - d2/d5/d9/f32 zero size 2024-02-28T16:01:55.229 INFO:tasks.workunit.client.0.smithi057.stdout:9/222: unlink d2/l4 0 2024-02-28T16:01:55.233 INFO:tasks.workunit.client.0.smithi057.stdout:9/223: dread d2/f20 [4194304,4194304] 0 2024-02-28T16:01:55.237 INFO:tasks.workunit.client.0.smithi057.stdout:9/224: creat d2/f4e x:0 0 0 2024-02-28T16:01:55.238 INFO:tasks.workunit.client.0.smithi057.stdout:9/225: chown d2/d33/c1e 0 1 2024-02-28T16:01:55.240 INFO:tasks.workunit.client.0.smithi057.stdout:9/226: write d2/d5/f37 [660077,88646] 0 2024-02-28T16:01:55.242 INFO:tasks.workunit.client.0.smithi057.stdout:9/227: chown d2/d5/d9/f35 1 1 2024-02-28T16:01:55.244 INFO:tasks.workunit.client.0.smithi057.stdout:9/228: read d2/d5/f37 [460959,107588] 0 2024-02-28T16:01:55.255 INFO:tasks.workunit.client.1.smithi087.stdout:4/488: sync 2024-02-28T16:01:55.256 INFO:tasks.workunit.client.1.smithi087.stdout:3/403: mkdir d11/d33/d58/d8c 0 2024-02-28T16:01:55.256 INFO:tasks.workunit.client.1.smithi087.stdout:1/414: chown d0/d1b/d43/d4d/l52 310 1 2024-02-28T16:01:55.257 INFO:tasks.workunit.client.1.smithi087.stdout:7/384: fdatasync d14/d2e/d2b/d4e/f56 0 2024-02-28T16:01:55.261 INFO:tasks.workunit.client.1.smithi087.stdout:1/415: symlink d0/d1d/d24/l83 0 2024-02-28T16:01:55.262 INFO:tasks.workunit.client.1.smithi087.stdout:7/385: dread - d14/d2e/d2b/f69 zero size 2024-02-28T16:01:55.266 INFO:tasks.workunit.client.1.smithi087.stdout:1/416: mknod d0/d14/d3f/c84 0 2024-02-28T16:01:55.268 INFO:tasks.workunit.client.1.smithi087.stdout:8/419: dwrite d2/d9/d10/d24/d53/f8c [0,4194304] 0 2024-02-28T16:01:55.270 INFO:tasks.workunit.client.1.smithi087.stdout:6/467: dread d4/d30/d13/d38/f64 [0,4194304] 0 2024-02-28T16:01:55.270 INFO:tasks.workunit.client.1.smithi087.stdout:1/417: creat d0/d14/f85 x:0 0 0 2024-02-28T16:01:55.270 INFO:tasks.workunit.client.0.smithi057.stdout:9/229: dread f0 [0,4194304] 0 2024-02-28T16:01:55.272 INFO:tasks.workunit.client.0.smithi057.stdout:9/230: readlink d2/d5/l4a 0 2024-02-28T16:01:55.273 INFO:tasks.workunit.client.1.smithi087.stdout:3/404: write d11/d44/f87 [4463527,116798] 0 2024-02-28T16:01:55.273 INFO:tasks.workunit.client.1.smithi087.stdout:8/420: rmdir d2/d18/d42/d62 39 2024-02-28T16:01:55.276 INFO:tasks.workunit.client.1.smithi087.stdout:7/386: dread d14/d21/f32 [0,4194304] 0 2024-02-28T16:01:55.278 INFO:tasks.workunit.client.1.smithi087.stdout:6/468: write d4/f20 [1519104,41621] 0 2024-02-28T16:01:55.279 INFO:tasks.workunit.client.1.smithi087.stdout:8/421: rmdir d2/d9/d5e 39 2024-02-28T16:01:55.279 INFO:tasks.workunit.client.1.smithi087.stdout:3/405: write d11/f82 [598899,89365] 0 2024-02-28T16:01:55.281 INFO:tasks.workunit.client.1.smithi087.stdout:3/406: fsync d11/d44/f56 0 2024-02-28T16:01:55.283 INFO:tasks.workunit.client.1.smithi087.stdout:7/387: chown d14/d2e/d2b/c31 10213 1 2024-02-28T16:01:55.283 INFO:tasks.workunit.client.1.smithi087.stdout:3/407: stat d11/d61/d65/f70 0 2024-02-28T16:01:55.283 INFO:tasks.workunit.client.1.smithi087.stdout:7/388: fsync d14/f40 0 2024-02-28T16:01:55.286 INFO:tasks.workunit.client.1.smithi087.stdout:8/422: unlink d2/l65 0 2024-02-28T16:01:55.289 INFO:tasks.workunit.client.1.smithi087.stdout:7/389: chown d14/d2e/d2b/d4e/f56 6626635 1 2024-02-28T16:01:55.289 INFO:tasks.workunit.client.0.smithi057.stdout:9/231: dread d2/d24/ff [0,4194304] 0 2024-02-28T16:01:55.290 INFO:tasks.workunit.client.1.smithi087.stdout:3/408: rename d11/d33/d58/c86 to d11/d45/d88/c8d 0 2024-02-28T16:01:55.291 INFO:tasks.workunit.client.0.smithi057.stdout:9/232: readlink d2/d24/d1d/l27 0 2024-02-28T16:01:55.293 INFO:tasks.workunit.client.1.smithi087.stdout:7/390: write d14/f40 [796225,114038] 0 2024-02-28T16:01:55.293 INFO:tasks.workunit.client.0.smithi057.stdout:9/233: creat d2/d5/d1b/d2e/d44/f4f x:0 0 0 2024-02-28T16:01:55.294 INFO:tasks.workunit.client.1.smithi087.stdout:8/423: link d2/f8 d2/d33/f8f 0 2024-02-28T16:01:55.300 INFO:tasks.workunit.client.1.smithi087.stdout:7/391: creat d14/d2e/f78 x:0 0 0 2024-02-28T16:01:55.300 INFO:tasks.workunit.client.1.smithi087.stdout:8/424: mknod d2/d33/c90 0 2024-02-28T16:01:55.300 INFO:tasks.workunit.client.1.smithi087.stdout:1/418: dwrite d0/d1d/d24/d5c/d69/f7c [0,4194304] 0 2024-02-28T16:01:55.304 INFO:tasks.workunit.client.0.smithi057.stdout:9/234: rmdir d2/d5 39 2024-02-28T16:01:55.306 INFO:tasks.workunit.client.1.smithi087.stdout:1/419: mkdir d0/d14/d86 0 2024-02-28T16:01:55.306 INFO:tasks.workunit.client.1.smithi087.stdout:7/392: chown d14/d21/d4f/l71 978 1 2024-02-28T16:01:55.308 INFO:tasks.workunit.client.1.smithi087.stdout:1/420: stat d0/d1d/f6e 0 2024-02-28T16:01:55.308 INFO:tasks.workunit.client.0.smithi057.stdout:9/235: getdents d2/d5/d9/d40 0 2024-02-28T16:01:55.310 INFO:tasks.workunit.client.1.smithi087.stdout:6/469: dwrite d4/d12/d45/f53 [0,4194304] 0 2024-02-28T16:01:55.311 INFO:tasks.workunit.client.0.smithi057.stdout:9/236: creat d2/d5/d1b/d2e/d4c/f50 x:0 0 0 2024-02-28T16:01:55.314 INFO:tasks.workunit.client.1.smithi087.stdout:8/425: dread d2/f59 [0,4194304] 0 2024-02-28T16:01:55.315 INFO:tasks.workunit.client.0.smithi057.stdout:9/237: write d2/d5/d1b/d2e/d44/f48 [987606,111074] 0 2024-02-28T16:01:55.319 INFO:tasks.workunit.client.1.smithi087.stdout:8/426: write d2/d9/d10/d24/f5a [392426,130113] 0 2024-02-28T16:01:55.321 INFO:tasks.workunit.client.0.smithi057.stdout:9/238: mknod d2/d5/d1b/d2e/d4c/c51 0 2024-02-28T16:01:55.323 INFO:tasks.workunit.client.1.smithi087.stdout:8/427: readlink d2/d18/d25/l11 0 2024-02-28T16:01:55.326 INFO:tasks.workunit.client.1.smithi087.stdout:3/409: dwrite d11/f24 [0,4194304] 0 2024-02-28T16:01:55.327 INFO:tasks.workunit.client.1.smithi087.stdout:8/428: rmdir d2/d18 39 2024-02-28T16:01:55.328 INFO:tasks.workunit.client.0.smithi057.stdout:9/239: getdents d2/d46 0 2024-02-28T16:01:55.329 INFO:tasks.workunit.client.0.smithi057.stdout:9/240: chown d2/d5/d1b 5744 1 2024-02-28T16:01:55.330 INFO:tasks.workunit.client.1.smithi087.stdout:6/470: write d4/dc/d10/f40 [684109,7198] 0 2024-02-28T16:01:55.331 INFO:tasks.workunit.client.0.smithi057.stdout:9/241: unlink d2/d24/ca 0 2024-02-28T16:01:55.333 INFO:tasks.workunit.client.1.smithi087.stdout:7/393: dwrite fc [4194304,4194304] 0 2024-02-28T16:01:55.338 INFO:tasks.workunit.client.1.smithi087.stdout:7/394: mkdir d14/d27/d5d/d79 0 2024-02-28T16:01:55.340 INFO:tasks.workunit.client.1.smithi087.stdout:6/471: creat d4/d30/d9b/f9e x:0 0 0 2024-02-28T16:01:55.343 INFO:tasks.workunit.client.1.smithi087.stdout:7/395: chown f12 7 1 2024-02-28T16:01:55.344 INFO:tasks.workunit.client.1.smithi087.stdout:6/472: chown d4/d12/d45/d74/f8c 48 1 2024-02-28T16:01:55.346 INFO:tasks.workunit.client.1.smithi087.stdout:7/396: write d14/d21/f42 [572366,34269] 0 2024-02-28T16:01:55.356 INFO:tasks.workunit.client.0.smithi057.stdout:9/242: dwrite d2/d5/d1b/f3c [0,4194304] 0 2024-02-28T16:01:55.359 INFO:tasks.workunit.client.0.smithi057.stdout:9/243: write d2/d24/f10 [424781,65083] 0 2024-02-28T16:01:55.361 INFO:tasks.workunit.client.1.smithi087.stdout:7/397: truncate d14/d21/f42 223497 0 2024-02-28T16:01:55.362 INFO:tasks.workunit.client.1.smithi087.stdout:3/410: dread d11/f36 [0,4194304] 0 2024-02-28T16:01:55.364 INFO:tasks.workunit.client.1.smithi087.stdout:7/398: fdatasync d14/d2e/d2b/d4e/f56 0 2024-02-28T16:01:55.365 INFO:tasks.workunit.client.1.smithi087.stdout:8/429: dread d2/d9/d1a/f45 [0,4194304] 0 2024-02-28T16:01:55.367 INFO:tasks.workunit.client.1.smithi087.stdout:8/430: stat d2/d18/d25/l77 0 2024-02-28T16:01:55.368 INFO:tasks.workunit.client.0.smithi057.stdout:9/244: rename d2/d33/l41 to d2/d5/l52 0 2024-02-28T16:01:55.369 INFO:tasks.workunit.client.1.smithi087.stdout:7/399: unlink d14/d2e/d2b/l35 0 2024-02-28T16:01:55.371 INFO:tasks.workunit.client.1.smithi087.stdout:7/400: write d14/d21/f61 [1438354,75643] 0 2024-02-28T16:01:55.373 INFO:tasks.workunit.client.1.smithi087.stdout:3/411: link d11/f29 d11/d45/f8e 0 2024-02-28T16:01:55.375 INFO:tasks.workunit.client.1.smithi087.stdout:7/401: rmdir d14/d46/d68 39 2024-02-28T16:01:55.376 INFO:tasks.workunit.client.0.smithi057.stdout:9/245: link d2/d5/d1b/d2e/d44/f48 d2/d5/d1b/d2e/f53 0 2024-02-28T16:01:55.377 INFO:tasks.workunit.client.0.smithi057.stdout:0/214: sync 2024-02-28T16:01:55.377 INFO:tasks.workunit.client.1.smithi087.stdout:3/412: dread d11/f46 [0,4194304] 0 2024-02-28T16:01:55.378 INFO:tasks.workunit.client.1.smithi087.stdout:7/402: unlink d14/d2e/d2b/f4b 0 2024-02-28T16:01:55.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/246: creat d2/d5/d9/f54 x:0 0 0 2024-02-28T16:01:55.383 INFO:tasks.workunit.client.1.smithi087.stdout:3/413: mknod d11/d33/d74/c8f 0 2024-02-28T16:01:55.383 INFO:tasks.workunit.client.1.smithi087.stdout:8/431: write d2/d9/f23 [2091929,65702] 0 2024-02-28T16:01:55.385 INFO:tasks.workunit.client.1.smithi087.stdout:8/432: chown d2/d63/l60 3956111 1 2024-02-28T16:01:55.386 INFO:tasks.workunit.client.1.smithi087.stdout:7/403: creat d14/d46/d68/f7a x:0 0 0 2024-02-28T16:01:55.388 INFO:tasks.workunit.client.1.smithi087.stdout:6/473: dread d4/d30/d13/d38/f47 [0,4194304] 0 2024-02-28T16:01:55.388 INFO:tasks.workunit.client.0.smithi057.stdout:9/247: symlink d2/d5/d1b/l55 0 2024-02-28T16:01:55.389 INFO:tasks.workunit.client.1.smithi087.stdout:3/414: link d11/f36 d11/d33/d58/d8c/f90 0 2024-02-28T16:01:55.390 INFO:tasks.workunit.client.1.smithi087.stdout:8/433: creat d2/d9/d5e/f91 x:0 0 0 2024-02-28T16:01:55.398 INFO:tasks.workunit.client.1.smithi087.stdout:7/404: rmdir d14/d27/d5d/d79 0 2024-02-28T16:01:55.399 INFO:tasks.workunit.client.1.smithi087.stdout:7/405: chown d14/d27/l37 1174 1 2024-02-28T16:01:55.403 INFO:tasks.workunit.client.1.smithi087.stdout:3/415: getdents d11 0 2024-02-28T16:01:55.404 INFO:tasks.workunit.client.1.smithi087.stdout:7/406: mknod d14/d21/c7b 0 2024-02-28T16:01:55.405 INFO:tasks.workunit.client.1.smithi087.stdout:3/416: mkdir d11/d45/d88/d91 0 2024-02-28T16:01:55.406 INFO:tasks.workunit.client.1.smithi087.stdout:7/407: readlink d14/d46/d68/l72 0 2024-02-28T16:01:55.408 INFO:tasks.workunit.client.1.smithi087.stdout:6/474: dwrite d4/d12/d45/f53 [0,4194304] 0 2024-02-28T16:01:55.409 INFO:tasks.workunit.client.0.smithi057.stdout:9/248: dwrite d2/d5/d9/f32 [0,4194304] 0 2024-02-28T16:01:55.410 INFO:tasks.workunit.client.1.smithi087.stdout:7/408: truncate d14/d21/f45 5095070 0 2024-02-28T16:01:55.418 INFO:tasks.workunit.client.1.smithi087.stdout:8/434: dwrite d2/f59 [0,4194304] 0 2024-02-28T16:01:55.419 INFO:tasks.workunit.client.1.smithi087.stdout:5/474: sync 2024-02-28T16:01:55.419 INFO:tasks.workunit.client.1.smithi087.stdout:9/410: sync 2024-02-28T16:01:55.421 INFO:tasks.workunit.client.1.smithi087.stdout:8/435: chown d2/d9/d10/d24/d53/d6f/f74 3 1 2024-02-28T16:01:55.421 INFO:tasks.workunit.client.0.smithi057.stdout:9/249: rename d2/d5/d1b/d2e/d4c/f50 to d2/d33/f56 0 2024-02-28T16:01:55.423 INFO:tasks.workunit.client.1.smithi087.stdout:9/411: unlink d7/d1e/d44/l50 0 2024-02-28T16:01:55.426 INFO:tasks.workunit.client.1.smithi087.stdout:9/412: dread - d7/dd/d3c/f41 zero size 2024-02-28T16:01:55.427 INFO:tasks.workunit.client.1.smithi087.stdout:5/475: mknod d3/d6/d30/d8f/dac/cb0 0 2024-02-28T16:01:55.428 INFO:tasks.workunit.client.1.smithi087.stdout:7/409: truncate d14/f5b 3996252 0 2024-02-28T16:01:55.428 INFO:tasks.workunit.client.1.smithi087.stdout:5/476: chown d3/f8a 19 1 2024-02-28T16:01:55.429 INFO:tasks.workunit.client.1.smithi087.stdout:5/477: fsync d3/d9/f9f 0 2024-02-28T16:01:55.430 INFO:tasks.workunit.client.1.smithi087.stdout:3/417: dread d11/f2f [0,4194304] 0 2024-02-28T16:01:55.430 INFO:tasks.workunit.client.0.smithi057.stdout:0/215: dread d6/d12/d17/d1a/f1e [0,4194304] 0 2024-02-28T16:01:55.434 INFO:tasks.workunit.client.0.smithi057.stdout:0/216: mknod d6/d12/d17/d25/c47 0 2024-02-28T16:01:55.435 INFO:tasks.workunit.client.1.smithi087.stdout:3/418: read d11/f31 [2552456,381] 0 2024-02-28T16:01:55.435 INFO:tasks.workunit.client.1.smithi087.stdout:8/436: link d2/d9/d10/f12 d2/d9/d10/d24/d53/d89/f92 0 2024-02-28T16:01:55.437 INFO:tasks.workunit.client.1.smithi087.stdout:8/437: chown d2/d63/f41 3600 1 2024-02-28T16:01:55.438 INFO:tasks.workunit.client.1.smithi087.stdout:5/478: mknod d3/d6/d69/d87/cb1 0 2024-02-28T16:01:55.439 INFO:tasks.workunit.client.1.smithi087.stdout:3/419: rmdir d11/d33/d58 39 2024-02-28T16:01:55.439 INFO:tasks.workunit.client.1.smithi087.stdout:5/479: dread - d3/d6/d30/d44/f85 zero size 2024-02-28T16:01:55.440 INFO:tasks.workunit.client.0.smithi057.stdout:0/217: creat d6/d12/d3d/f48 x:0 0 0 2024-02-28T16:01:55.441 INFO:tasks.workunit.client.1.smithi087.stdout:9/413: dread d7/dc/f59 [0,4194304] 0 2024-02-28T16:01:55.441 INFO:tasks.workunit.client.1.smithi087.stdout:5/480: fsync d3/f21 0 2024-02-28T16:01:55.441 INFO:tasks.workunit.client.0.smithi057.stdout:9/250: dread d2/d5/d1b/f49 [0,4194304] 0 2024-02-28T16:01:55.441 INFO:tasks.workunit.client.0.smithi057.stdout:0/218: chown l5 4 1 2024-02-28T16:01:55.443 INFO:tasks.workunit.client.1.smithi087.stdout:9/414: write d7/dd/d3c/f6f [949657,89697] 0 2024-02-28T16:01:55.445 INFO:tasks.workunit.client.1.smithi087.stdout:9/415: stat d7/dd/d3c 0 2024-02-28T16:01:55.446 INFO:tasks.workunit.client.1.smithi087.stdout:3/420: symlink d11/d33/d58/d8c/l92 0 2024-02-28T16:01:55.448 INFO:tasks.workunit.client.1.smithi087.stdout:9/416: dread - d7/dd/d15/d39/d2e/f6a zero size 2024-02-28T16:01:55.448 INFO:tasks.workunit.client.1.smithi087.stdout:8/438: read d2/d18/f22 [62339,107692] 0 2024-02-28T16:01:55.458 INFO:tasks.workunit.client.1.smithi087.stdout:5/481: write d3/d9/f15 [916827,117909] 0 2024-02-28T16:01:55.462 INFO:tasks.workunit.client.1.smithi087.stdout:5/482: creat d3/fb2 x:0 0 0 2024-02-28T16:01:55.466 INFO:tasks.workunit.client.1.smithi087.stdout:5/483: mknod d3/d64/d81/cb3 0 2024-02-28T16:01:55.468 INFO:tasks.workunit.client.0.smithi057.stdout:0/219: dwrite d6/f2f [0,4194304] 0 2024-02-28T16:01:55.468 INFO:tasks.workunit.client.1.smithi087.stdout:5/484: readlink d3/d9/l2c 0 2024-02-28T16:01:55.469 INFO:tasks.workunit.client.1.smithi087.stdout:8/439: dwrite d2/d9/d5e/f87 [0,4194304] 0 2024-02-28T16:01:55.471 INFO:tasks.workunit.client.0.smithi057.stdout:0/220: dread - d6/d12/d17/d34/f40 zero size 2024-02-28T16:01:55.473 INFO:tasks.workunit.client.0.smithi057.stdout:0/221: dread - d6/d12/d3d/f46 zero size 2024-02-28T16:01:55.474 INFO:tasks.workunit.client.1.smithi087.stdout:5/485: truncate d3/d6/d69/f92 726383 0 2024-02-28T16:01:55.474 INFO:tasks.workunit.client.1.smithi087.stdout:8/440: dread - d2/d9/d10/d24/d53/f72 zero size 2024-02-28T16:01:55.474 INFO:tasks.workunit.client.1.smithi087.stdout:7/410: dread d14/d27/d5d/f70 [0,4194304] 0 2024-02-28T16:01:55.474 INFO:tasks.workunit.client.1.smithi087.stdout:6/475: dread d4/d12/d45/f91 [0,4194304] 0 2024-02-28T16:01:55.476 INFO:tasks.workunit.client.0.smithi057.stdout:0/222: fsync d6/d12/d17/f3b 0 2024-02-28T16:01:55.476 INFO:tasks.workunit.client.1.smithi087.stdout:5/486: truncate d3/fb2 2119 0 2024-02-28T16:01:55.477 INFO:tasks.workunit.client.1.smithi087.stdout:8/441: truncate d2/d33/f5f 751617 0 2024-02-28T16:01:55.479 INFO:tasks.workunit.client.1.smithi087.stdout:7/411: readlink d14/d30/l6c 0 2024-02-28T16:01:55.479 INFO:tasks.workunit.client.0.smithi057.stdout:0/223: getdents d6/d12/d45 0 2024-02-28T16:01:55.481 INFO:tasks.workunit.client.1.smithi087.stdout:6/476: mknod d4/d30/d13/d67/c9f 0 2024-02-28T16:01:55.483 INFO:tasks.workunit.client.1.smithi087.stdout:7/412: chown f13 29507471 1 2024-02-28T16:01:55.484 INFO:tasks.workunit.client.1.smithi087.stdout:6/477: readlink d4/d12/d45/l34 0 2024-02-28T16:01:55.484 INFO:tasks.workunit.client.1.smithi087.stdout:8/442: write d2/d18/f56 [789345,126302] 0 2024-02-28T16:01:55.488 INFO:tasks.workunit.client.1.smithi087.stdout:7/413: write d14/d21/f61 [2247148,114889] 0 2024-02-28T16:01:55.489 INFO:tasks.workunit.client.1.smithi087.stdout:8/443: dread - d2/d18/d42/f84 zero size 2024-02-28T16:01:55.491 INFO:tasks.workunit.client.1.smithi087.stdout:9/417: dread d7/d1e/f24 [0,4194304] 0 2024-02-28T16:01:55.492 INFO:tasks.workunit.client.1.smithi087.stdout:6/478: creat d4/d30/d13/d38/d69/d99/fa0 x:0 0 0 2024-02-28T16:01:55.492 INFO:tasks.workunit.client.1.smithi087.stdout:7/414: fsync d14/d2e/d2b/d4e/f56 0 2024-02-28T16:01:55.494 INFO:tasks.workunit.client.1.smithi087.stdout:6/479: dread - d4/d96/f98 zero size 2024-02-28T16:01:55.495 INFO:tasks.workunit.client.1.smithi087.stdout:8/444: unlink d2/d9/f23 0 2024-02-28T16:01:55.495 INFO:tasks.workunit.client.1.smithi087.stdout:5/487: dwrite d3/d64/d67/f76 [0,4194304] 0 2024-02-28T16:01:55.498 INFO:tasks.workunit.client.1.smithi087.stdout:7/415: write d14/d27/f76 [230698,54132] 0 2024-02-28T16:01:55.499 INFO:tasks.workunit.client.1.smithi087.stdout:5/488: readlink d3/d6/l5c 0 2024-02-28T16:01:55.500 INFO:tasks.workunit.client.1.smithi087.stdout:6/480: creat d4/d30/d13/d38/fa1 x:0 0 0 2024-02-28T16:01:55.502 INFO:tasks.workunit.client.0.smithi057.stdout:0/224: dwrite d6/fd [0,4194304] 0 2024-02-28T16:01:55.505 INFO:tasks.workunit.client.1.smithi087.stdout:7/416: mkdir d14/d46/d7c 0 2024-02-28T16:01:55.506 INFO:tasks.workunit.client.0.smithi057.stdout:0/225: fsync d6/d12/d17/d34/f40 0 2024-02-28T16:01:55.506 INFO:tasks.workunit.client.1.smithi087.stdout:5/489: mknod d3/d64/cb4 0 2024-02-28T16:01:55.508 INFO:tasks.workunit.client.1.smithi087.stdout:8/445: symlink d2/d18/d42/d62/l93 0 2024-02-28T16:01:55.509 INFO:tasks.workunit.client.0.smithi057.stdout:0/226: mknod d6/d12/d3d/c49 0 2024-02-28T16:01:55.510 INFO:tasks.workunit.client.1.smithi087.stdout:5/490: creat d3/d6/d30/d53/d5b/fb5 x:0 0 0 2024-02-28T16:01:55.511 INFO:tasks.workunit.client.1.smithi087.stdout:7/417: mkdir d14/d7d 0 2024-02-28T16:01:55.512 INFO:tasks.workunit.client.0.smithi057.stdout:0/227: dread - d6/d12/d17/d34/f40 zero size 2024-02-28T16:01:55.520 INFO:tasks.workunit.client.1.smithi087.stdout:5/491: link d3/d6/d30/d36/c4d d3/d9/cb6 0 2024-02-28T16:01:55.521 INFO:tasks.workunit.client.0.smithi057.stdout:0/228: dread d6/d12/d17/d1a/f1e [0,4194304] 0 2024-02-28T16:01:55.522 INFO:tasks.workunit.client.0.smithi057.stdout:0/229: readlink d6/le 0 2024-02-28T16:01:55.525 INFO:tasks.workunit.client.1.smithi087.stdout:5/492: fsync d3/d64/d81/f78 0 2024-02-28T16:01:55.527 INFO:tasks.workunit.client.0.smithi057.stdout:0/230: link d6/fa d6/d12/d3d/f4a 0 2024-02-28T16:01:55.529 INFO:tasks.workunit.client.1.smithi087.stdout:9/418: dwrite d7/dd/d3c/f53 [0,4194304] 0 2024-02-28T16:01:55.535 INFO:tasks.workunit.client.1.smithi087.stdout:6/481: dwrite d4/d12/d45/f91 [0,4194304] 0 2024-02-28T16:01:55.536 INFO:tasks.workunit.client.1.smithi087.stdout:5/493: creat d3/d64/fb7 x:0 0 0 2024-02-28T16:01:55.540 INFO:tasks.workunit.client.1.smithi087.stdout:8/446: dwrite d2/d18/d25/f6c [0,4194304] 0 2024-02-28T16:01:55.541 INFO:tasks.workunit.client.1.smithi087.stdout:6/482: write d4/d12/d45/f8a [990402,103493] 0 2024-02-28T16:01:55.543 INFO:tasks.workunit.client.1.smithi087.stdout:7/418: dwrite d14/d46/f74 [0,4194304] 0 2024-02-28T16:01:55.544 INFO:tasks.workunit.client.1.smithi087.stdout:9/419: rename l5 to d7/dd/d15/d55/l71 0 2024-02-28T16:01:55.547 INFO:tasks.workunit.client.0.smithi057.stdout:0/231: dwrite d6/d12/d17/d34/f3f [0,4194304] 0 2024-02-28T16:01:55.548 INFO:tasks.workunit.client.1.smithi087.stdout:8/447: write d2/d9/d10/f3a [4652789,31952] 0 2024-02-28T16:01:55.551 INFO:tasks.workunit.client.0.smithi057.stdout:0/232: fdatasync d6/d12/d3d/f4a 0 2024-02-28T16:01:55.556 INFO:tasks.workunit.client.0.smithi057.stdout:0/233: stat d6/d12/d17/d1a/c28 0 2024-02-28T16:01:55.557 INFO:tasks.workunit.client.0.smithi057.stdout:1/172: sync 2024-02-28T16:01:55.558 INFO:tasks.workunit.client.0.smithi057.stdout:5/150: sync 2024-02-28T16:01:55.560 INFO:tasks.workunit.client.1.smithi087.stdout:8/448: link d2/d9/d10/f3a d2/d9/d1a/d67/f94 0 2024-02-28T16:01:55.563 INFO:tasks.workunit.client.1.smithi087.stdout:7/419: getdents d14/d30 0 2024-02-28T16:01:55.564 INFO:tasks.workunit.client.0.smithi057.stdout:1/173: fsync d1/d3/dc/f10 0 2024-02-28T16:01:55.564 INFO:tasks.workunit.client.0.smithi057.stdout:5/151: chown d2/l2a 31625111 1 2024-02-28T16:01:55.564 INFO:tasks.workunit.client.1.smithi087.stdout:6/483: dread d4/d30/d13/d38/f4e [0,4194304] 0 2024-02-28T16:01:55.565 INFO:tasks.workunit.client.0.smithi057.stdout:0/234: write d6/f29 [1834154,109962] 0 2024-02-28T16:01:55.565 INFO:tasks.workunit.client.1.smithi087.stdout:0/447: sync 2024-02-28T16:01:55.569 INFO:tasks.workunit.client.1.smithi087.stdout:7/420: write f7 [1060357,12112] 0 2024-02-28T16:01:55.570 INFO:tasks.workunit.client.1.smithi087.stdout:5/494: dread d3/d6/f26 [0,4194304] 0 2024-02-28T16:01:55.571 INFO:tasks.workunit.client.0.smithi057.stdout:5/152: unlink d2/d19/d1c/c28 0 2024-02-28T16:01:55.576 INFO:tasks.workunit.client.1.smithi087.stdout:0/448: symlink d4/dd/d37/d39/d3a/d57/l94 0 2024-02-28T16:01:55.577 INFO:tasks.workunit.client.1.smithi087.stdout:5/495: chown d3/d6/d30/d36/l42 3647 1 2024-02-28T16:01:55.581 INFO:tasks.workunit.client.1.smithi087.stdout:9/420: dread d7/d1e/f24 [0,4194304] 0 2024-02-28T16:01:55.581 INFO:tasks.workunit.client.1.smithi087.stdout:0/449: chown d4/dd/f1b 25453 1 2024-02-28T16:01:55.583 INFO:tasks.workunit.client.0.smithi057.stdout:0/235: rename d6/d12/d20 to d6/d12/d17/d4b 0 2024-02-28T16:01:55.588 INFO:tasks.workunit.client.0.smithi057.stdout:5/153: rmdir d2/d12 39 2024-02-28T16:01:55.597 INFO:tasks.workunit.client.0.smithi057.stdout:1/174: truncate d1/f8 278960 0 2024-02-28T16:01:55.609 INFO:tasks.workunit.client.0.smithi057.stdout:0/236: dread f0 [0,4194304] 0 2024-02-28T16:01:55.620 INFO:tasks.workunit.client.1.smithi087.stdout:0/450: mknod d4/d6/d3e/d7c/c95 0 2024-02-28T16:01:55.621 INFO:tasks.workunit.client.0.smithi057.stdout:0/237: dread d6/d12/d17/d25/f33 [0,4194304] 0 2024-02-28T16:01:55.622 INFO:tasks.workunit.client.0.smithi057.stdout:5/154: dread d2/f22 [0,4194304] 0 2024-02-28T16:01:55.623 INFO:tasks.workunit.client.0.smithi057.stdout:1/175: dread d1/d3/dc/f12 [0,4194304] 0 2024-02-28T16:01:55.624 INFO:tasks.workunit.client.0.smithi057.stdout:5/155: chown d2/l5 56901990 1 2024-02-28T16:01:55.626 INFO:tasks.workunit.client.0.smithi057.stdout:0/238: symlink d6/d12/d38/l4c 0 2024-02-28T16:01:55.626 INFO:tasks.workunit.client.1.smithi087.stdout:8/449: dwrite d2/d9/f5c [0,4194304] 0 2024-02-28T16:01:55.627 INFO:tasks.workunit.client.0.smithi057.stdout:0/239: stat d6/l2c 0 2024-02-28T16:01:55.627 INFO:tasks.workunit.client.1.smithi087.stdout:0/451: creat d4/dd/d21/f96 x:0 0 0 2024-02-28T16:01:55.629 INFO:tasks.workunit.client.0.smithi057.stdout:0/240: chown d6/d12/d17/d25/f32 23 1 2024-02-28T16:01:55.629 INFO:tasks.workunit.client.0.smithi057.stdout:5/156: rename d2/d8/f25 to d2/d27/f3a 0 2024-02-28T16:01:55.629 INFO:tasks.workunit.client.0.smithi057.stdout:1/176: creat d1/d3/dc/d15/f3c x:0 0 0 2024-02-28T16:01:55.632 INFO:tasks.workunit.client.0.smithi057.stdout:0/241: write d6/d12/d17/d34/f3f [4724070,37950] 0 2024-02-28T16:01:55.633 INFO:tasks.workunit.client.1.smithi087.stdout:0/452: creat d4/dd/d37/d39/d3a/f97 x:0 0 0 2024-02-28T16:01:55.634 INFO:tasks.workunit.client.0.smithi057.stdout:5/157: rmdir d2/d8 39 2024-02-28T16:01:55.641 INFO:tasks.workunit.client.1.smithi087.stdout:8/450: creat d2/d18/d42/d7b/f95 x:0 0 0 2024-02-28T16:01:55.644 INFO:tasks.workunit.client.0.smithi057.stdout:0/242: read d6/f19 [436079,80004] 0 2024-02-28T16:01:55.648 INFO:tasks.workunit.client.1.smithi087.stdout:7/421: dread d14/f64 [0,4194304] 0 2024-02-28T16:01:55.648 INFO:tasks.workunit.client.1.smithi087.stdout:8/451: truncate d2/d18/f22 788191 0 2024-02-28T16:01:55.648 INFO:tasks.workunit.client.0.smithi057.stdout:0/243: creat d6/d12/d17/d34/f4d x:0 0 0 2024-02-28T16:01:55.655 INFO:tasks.workunit.client.1.smithi087.stdout:8/452: mkdir d2/d63/d96 0 2024-02-28T16:01:55.657 INFO:tasks.workunit.client.1.smithi087.stdout:5/496: dread d3/d6/f20 [0,4194304] 0 2024-02-28T16:01:55.657 INFO:tasks.workunit.client.0.smithi057.stdout:1/177: rmdir d1/d3 39 2024-02-28T16:01:55.658 INFO:tasks.workunit.client.0.smithi057.stdout:5/158: write d2/d15/f17 [1517089,11493] 0 2024-02-28T16:01:55.658 INFO:tasks.workunit.client.1.smithi087.stdout:8/453: chown d2/d63/l40 342583 1 2024-02-28T16:01:55.660 INFO:tasks.workunit.client.0.smithi057.stdout:5/159: write d2/f10 [5244190,80978] 0 2024-02-28T16:01:55.665 INFO:tasks.workunit.client.1.smithi087.stdout:8/454: creat d2/d63/f97 x:0 0 0 2024-02-28T16:01:55.666 INFO:tasks.workunit.client.1.smithi087.stdout:5/497: unlink d3/d6/d30/d44/d54/c74 0 2024-02-28T16:01:55.666 INFO:tasks.workunit.client.1.smithi087.stdout:9/421: dread d7/dd/d15/d39/f2f [0,4194304] 0 2024-02-28T16:01:55.666 INFO:tasks.workunit.client.0.smithi057.stdout:5/160: rename d2/d27 to d2/d15/d3b 0 2024-02-28T16:01:55.670 INFO:tasks.workunit.client.1.smithi087.stdout:5/498: creat d3/d6/d30/d36/d4f/fb8 x:0 0 0 2024-02-28T16:01:55.670 INFO:tasks.workunit.client.1.smithi087.stdout:7/422: dwrite d14/d2e/f1b [0,4194304] 0 2024-02-28T16:01:55.672 INFO:tasks.workunit.client.0.smithi057.stdout:0/244: dwrite d6/f19 [0,4194304] 0 2024-02-28T16:01:55.673 INFO:tasks.workunit.client.0.smithi057.stdout:0/245: readlink d6/l30 0 2024-02-28T16:01:55.677 INFO:tasks.workunit.client.1.smithi087.stdout:5/499: mkdir d3/d6/d30/d44/db9 0 2024-02-28T16:01:55.678 INFO:tasks.workunit.client.1.smithi087.stdout:0/453: dread d4/d6/dc/d45/f6a [4194304,4194304] 0 2024-02-28T16:01:55.678 INFO:tasks.workunit.client.1.smithi087.stdout:9/422: unlink d7/dd/d15/d39/f2f 0 2024-02-28T16:01:55.684 INFO:tasks.workunit.client.0.smithi057.stdout:0/246: rename d6/d12/d17/d25 to d6/d4e 0 2024-02-28T16:01:55.685 INFO:tasks.workunit.client.1.smithi087.stdout:8/455: dread d2/d9/d1a/d67/f94 [0,4194304] 0 2024-02-28T16:01:55.690 INFO:tasks.workunit.client.1.smithi087.stdout:3/421: sync 2024-02-28T16:01:55.690 INFO:tasks.workunit.client.1.smithi087.stdout:4/489: sync 2024-02-28T16:01:55.690 INFO:tasks.workunit.client.1.smithi087.stdout:1/421: sync 2024-02-28T16:01:55.690 INFO:tasks.workunit.client.1.smithi087.stdout:2/446: sync 2024-02-28T16:01:55.691 INFO:tasks.workunit.client.0.smithi057.stdout:1/178: dwrite d1/d21/f39 [0,4194304] 0 2024-02-28T16:01:55.693 INFO:tasks.workunit.client.1.smithi087.stdout:7/423: dwrite d14/d2e/d2b/f69 [0,4194304] 0 2024-02-28T16:01:55.695 INFO:tasks.workunit.client.0.smithi057.stdout:0/247: creat d6/d12/d45/f4f x:0 0 0 2024-02-28T16:01:55.696 INFO:tasks.workunit.client.1.smithi087.stdout:5/500: rename d3/d6 to d3/d9/d9b/dba 0 2024-02-28T16:01:55.697 INFO:tasks.workunit.client.0.smithi057.stdout:5/161: dwrite d2/d19/d1c/f2c [0,4194304] 0 2024-02-28T16:01:55.700 INFO:tasks.workunit.client.1.smithi087.stdout:4/490: dread d2/d9/de/f19 [0,4194304] 0 2024-02-28T16:01:55.701 INFO:tasks.workunit.client.1.smithi087.stdout:7/424: write d14/d27/f3f [363513,42523] 0 2024-02-28T16:01:55.701 INFO:tasks.workunit.client.1.smithi087.stdout:8/456: creat d2/d9/d8e/f98 x:0 0 0 2024-02-28T16:01:55.706 INFO:tasks.workunit.client.0.smithi057.stdout:0/248: creat d6/d12/d17/d1a/f50 x:0 0 0 2024-02-28T16:01:55.707 INFO:tasks.workunit.client.0.smithi057.stdout:1/179: link d1/d3/dc/f12 d1/d21/d25/f3d 0 2024-02-28T16:01:55.710 INFO:tasks.workunit.client.1.smithi087.stdout:2/447: mkdir d2/d99/d28/d79/da3 0 2024-02-28T16:01:55.711 INFO:tasks.workunit.client.1.smithi087.stdout:1/422: mknod d0/d1b/d43/d4d/c87 0 2024-02-28T16:01:55.712 INFO:tasks.workunit.client.1.smithi087.stdout:5/501: creat d3/d64/d67/d7c/fbb x:0 0 0 2024-02-28T16:01:55.712 INFO:tasks.workunit.client.0.smithi057.stdout:1/180: write d1/d3/dc/f10 [5638683,61467] 0 2024-02-28T16:01:55.713 INFO:tasks.workunit.client.0.smithi057.stdout:0/249: getdents d6/d12 0 2024-02-28T16:01:55.715 INFO:tasks.workunit.client.1.smithi087.stdout:0/454: dwrite d4/dd/d21/d52/f7e [0,4194304] 0 2024-02-28T16:01:55.718 INFO:tasks.workunit.client.0.smithi057.stdout:1/181: creat d1/d3/dc/d15/f3e x:0 0 0 2024-02-28T16:01:55.723 INFO:tasks.workunit.client.0.smithi057.stdout:0/250: creat d6/d12/d17/f51 x:0 0 0 2024-02-28T16:01:55.725 INFO:tasks.workunit.client.0.smithi057.stdout:1/182: mknod d1/d3/dc/c3f 0 2024-02-28T16:01:55.725 INFO:tasks.workunit.client.0.smithi057.stdout:0/251: chown d6/d12/d17/d1a/c28 582249 1 2024-02-28T16:01:55.726 INFO:tasks.workunit.client.1.smithi087.stdout:8/457: symlink d2/d18/d42/d7b/l99 0 2024-02-28T16:01:55.728 INFO:tasks.workunit.client.0.smithi057.stdout:0/252: chown d6/d12/d17/d34/f4d 41951 1 2024-02-28T16:01:55.729 INFO:tasks.workunit.client.1.smithi087.stdout:0/455: creat d4/d6/d3e/d7c/f98 x:0 0 0 2024-02-28T16:01:55.729 INFO:tasks.workunit.client.0.smithi057.stdout:1/183: mkdir d1/d3/dc/d40 0 2024-02-28T16:01:55.730 INFO:tasks.workunit.client.1.smithi087.stdout:3/422: dwrite d11/d33/f66 [0,4194304] 0 2024-02-28T16:01:55.730 INFO:tasks.workunit.client.0.smithi057.stdout:0/253: fsync d6/d12/d3d/f48 0 2024-02-28T16:01:55.732 INFO:tasks.workunit.client.1.smithi087.stdout:1/423: symlink d0/d14/d86/l88 0 2024-02-28T16:01:55.737 INFO:tasks.workunit.client.0.smithi057.stdout:0/254: creat d6/d12/d38/f52 x:0 0 0 2024-02-28T16:01:55.739 INFO:tasks.workunit.client.1.smithi087.stdout:8/458: unlink d2/d9/d1a/l52 0 2024-02-28T16:01:55.743 INFO:tasks.workunit.client.0.smithi057.stdout:0/255: symlink d6/d12/d17/d1a/l53 0 2024-02-28T16:01:55.743 INFO:tasks.workunit.client.0.smithi057.stdout:1/184: dread d1/d21/d25/f3d [0,4194304] 0 2024-02-28T16:01:55.746 INFO:tasks.workunit.client.1.smithi087.stdout:9/423: truncate d7/dd/d15/f1f 577760 0 2024-02-28T16:01:55.750 INFO:tasks.workunit.client.0.smithi057.stdout:0/256: creat d6/d12/d17/d1a/f54 x:0 0 0 2024-02-28T16:01:55.751 INFO:tasks.workunit.client.1.smithi087.stdout:7/425: dwrite d14/d46/d68/f7a [0,4194304] 0 2024-02-28T16:01:55.751 INFO:tasks.workunit.client.1.smithi087.stdout:5/502: dwrite d3/d9/f9f [0,4194304] 0 2024-02-28T16:01:55.752 INFO:tasks.workunit.client.1.smithi087.stdout:6/484: sync 2024-02-28T16:01:55.755 INFO:tasks.workunit.client.0.smithi057.stdout:1/185: rename d1/d3/ca to d1/d3/dc/d15/c41 0 2024-02-28T16:01:55.755 INFO:tasks.workunit.client.1.smithi087.stdout:6/485: stat d4/dc/d10/f3d 0 2024-02-28T16:01:55.756 INFO:tasks.workunit.client.1.smithi087.stdout:7/426: read d14/d21/f32 [189832,73175] 0 2024-02-28T16:01:55.757 INFO:tasks.workunit.client.1.smithi087.stdout:5/503: truncate d3/d9/f1e 4607169 0 2024-02-28T16:01:55.757 INFO:tasks.workunit.client.1.smithi087.stdout:8/459: mknod d2/d18/d25/c9a 0 2024-02-28T16:01:55.758 INFO:tasks.workunit.client.1.smithi087.stdout:0/456: dread d4/dd/d21/d52/f7e [0,4194304] 0 2024-02-28T16:01:55.761 INFO:tasks.workunit.client.1.smithi087.stdout:9/424: rmdir d7/d1e/d60 39 2024-02-28T16:01:55.762 INFO:tasks.workunit.client.1.smithi087.stdout:7/427: write d14/d21/f47 [642084,81040] 0 2024-02-28T16:01:55.765 INFO:tasks.workunit.client.1.smithi087.stdout:1/424: dread d0/d1b/f5d [0,4194304] 0 2024-02-28T16:01:55.765 INFO:tasks.workunit.client.1.smithi087.stdout:3/423: creat d11/d33/f93 x:0 0 0 2024-02-28T16:01:55.767 INFO:tasks.workunit.client.1.smithi087.stdout:8/460: chown d2/d9/d10/d24/d53/f72 454700404 1 2024-02-28T16:01:55.767 INFO:tasks.workunit.client.1.smithi087.stdout:6/486: write d4/d12/f6d [4753021,60076] 0 2024-02-28T16:01:55.772 INFO:tasks.workunit.client.1.smithi087.stdout:0/457: chown d4/dd/d37/d39/d3a/f87 428874 1 2024-02-28T16:01:55.773 INFO:tasks.workunit.client.1.smithi087.stdout:2/448: dread d2/d7/d17/d34/f4a [0,4194304] 0 2024-02-28T16:01:55.773 INFO:tasks.workunit.client.0.smithi057.stdout:1/186: mkdir d1/d21/d42 0 2024-02-28T16:01:55.773 INFO:tasks.workunit.client.0.smithi057.stdout:5/162: dwrite d2/f35 [0,4194304] 0 2024-02-28T16:01:55.775 INFO:tasks.workunit.client.0.smithi057.stdout:1/187: chown d1/d3/dc/d15/f3e 133 1 2024-02-28T16:01:55.775 INFO:tasks.workunit.client.1.smithi087.stdout:5/504: unlink d3/d9/d9b/dba/d30/d53/d5b/f94 0 2024-02-28T16:01:55.776 INFO:tasks.workunit.client.0.smithi057.stdout:5/163: creat d2/d15/f3c x:0 0 0 2024-02-28T16:01:55.781 INFO:tasks.workunit.client.1.smithi087.stdout:1/425: creat d0/d14/d86/f89 x:0 0 0 2024-02-28T16:01:55.783 INFO:tasks.workunit.client.0.smithi057.stdout:5/164: chown d2/d19/d1c/f34 22577 1 2024-02-28T16:01:55.786 INFO:tasks.workunit.client.1.smithi087.stdout:4/491: dwrite d2/d9/da/f36 [0,4194304] 0 2024-02-28T16:01:55.792 INFO:tasks.workunit.client.1.smithi087.stdout:4/492: truncate d2/f8f 190017 0 2024-02-28T16:01:55.793 INFO:tasks.workunit.client.1.smithi087.stdout:8/461: mkdir d2/d63/d9b 0 2024-02-28T16:01:55.793 INFO:tasks.workunit.client.1.smithi087.stdout:7/428: dread f7 [0,4194304] 0 2024-02-28T16:01:55.794 INFO:tasks.workunit.client.1.smithi087.stdout:3/424: mknod d11/d33/d58/d8c/c94 0 2024-02-28T16:01:55.797 INFO:tasks.workunit.client.0.smithi057.stdout:1/188: dwrite d1/d21/d25/d26/f2f [0,4194304] 0 2024-02-28T16:01:55.797 INFO:tasks.workunit.client.1.smithi087.stdout:0/458: creat d4/d6/dc/f99 x:0 0 0 2024-02-28T16:01:55.799 INFO:tasks.workunit.client.1.smithi087.stdout:2/449: rmdir d2/d9a 39 2024-02-28T16:01:55.799 INFO:tasks.workunit.client.1.smithi087.stdout:4/493: write d2/df/d65/d8d/faf [728049,2582] 0 2024-02-28T16:01:55.802 INFO:tasks.workunit.client.1.smithi087.stdout:5/505: creat d3/d64/d67/d7c/fbc x:0 0 0 2024-02-28T16:01:55.803 INFO:tasks.workunit.client.1.smithi087.stdout:4/494: readlink d2/d9/da/d1a/d26/l28 0 2024-02-28T16:01:55.805 INFO:tasks.workunit.client.1.smithi087.stdout:4/495: fsync d2/df/d2e/f43 0 2024-02-28T16:01:55.808 INFO:tasks.workunit.client.0.smithi057.stdout:0/257: rename d6/d12/d17/d1a to d6/d12/d45/d55 0 2024-02-28T16:01:55.808 INFO:tasks.workunit.client.0.smithi057.stdout:0/258: chown d6 494 1 2024-02-28T16:01:55.811 INFO:tasks.workunit.client.0.smithi057.stdout:0/259: chown d6/d12/l26 3 1 2024-02-28T16:01:55.812 INFO:tasks.workunit.client.1.smithi087.stdout:8/462: mkdir d2/d9/d5e/d9c 0 2024-02-28T16:01:55.812 INFO:tasks.workunit.client.1.smithi087.stdout:4/496: dread d2/d9/de/f19 [0,4194304] 0 2024-02-28T16:01:55.812 INFO:tasks.workunit.client.1.smithi087.stdout:4/497: fsync d2/d9/da/f3f 0 2024-02-28T16:01:55.813 INFO:tasks.workunit.client.0.smithi057.stdout:1/189: rename d1/d3/dc/l1a to d1/d21/d25/l43 0 2024-02-28T16:01:55.814 INFO:tasks.workunit.client.1.smithi087.stdout:3/425: creat d11/d33/d74/f95 x:0 0 0 2024-02-28T16:01:55.817 INFO:tasks.workunit.client.1.smithi087.stdout:3/426: truncate d11/d61/d65/f70 839419 0 2024-02-28T16:01:55.822 INFO:tasks.workunit.client.1.smithi087.stdout:9/425: dread d7/d1e/d44/f46 [0,4194304] 0 2024-02-28T16:01:55.825 INFO:tasks.workunit.client.0.smithi057.stdout:0/260: dread d6/f2f [0,4194304] 0 2024-02-28T16:01:55.826 INFO:tasks.workunit.client.0.smithi057.stdout:0/261: fdatasync d6/f19 0 2024-02-28T16:01:55.828 INFO:tasks.workunit.client.1.smithi087.stdout:5/506: unlink d3/d9/d9b/dba/d69/fab 0 2024-02-28T16:01:55.835 INFO:tasks.workunit.client.1.smithi087.stdout:0/459: dwrite d4/d6/d3e/d7c/f98 [0,4194304] 0 2024-02-28T16:01:55.839 INFO:tasks.workunit.client.1.smithi087.stdout:0/460: write d4/dd/d37/d39/f70 [3704490,33391] 0 2024-02-28T16:01:55.841 INFO:tasks.workunit.client.0.smithi057.stdout:5/165: dread d2/d8/fb [0,4194304] 0 2024-02-28T16:01:55.847 INFO:tasks.workunit.client.1.smithi087.stdout:6/487: truncate d4/d12/d45/f5a 2496223 0 2024-02-28T16:01:55.848 INFO:tasks.workunit.client.0.smithi057.stdout:5/166: mkdir d2/d12/d3d 0 2024-02-28T16:01:55.849 INFO:tasks.workunit.client.1.smithi087.stdout:9/426: mknod d7/dd/d15/d39/d2e/c72 0 2024-02-28T16:01:55.849 INFO:tasks.workunit.client.1.smithi087.stdout:6/488: readlink d4/dc/d61/l65 0 2024-02-28T16:01:55.850 INFO:tasks.workunit.client.1.smithi087.stdout:5/507: unlink d3/d9/d9b/dba/cc 0 2024-02-28T16:01:55.852 INFO:tasks.workunit.client.0.smithi057.stdout:5/167: chown d2/d8/c2d 9184519 1 2024-02-28T16:01:55.852 INFO:tasks.workunit.client.0.smithi057.stdout:0/262: dwrite d6/d12/d45/d55/f50 [0,4194304] 0 2024-02-28T16:01:55.853 INFO:tasks.workunit.client.0.smithi057.stdout:1/190: dread d1/d3/f11 [0,4194304] 0 2024-02-28T16:01:55.857 INFO:tasks.workunit.client.0.smithi057.stdout:1/191: write d1/d3/dc/d15/f3c [802535,20658] 0 2024-02-28T16:01:55.858 INFO:tasks.workunit.client.1.smithi087.stdout:4/498: symlink d2/df/d2e/dad/lb5 0 2024-02-28T16:01:55.861 INFO:tasks.workunit.client.1.smithi087.stdout:1/426: link d0/d1b/d43/c5b d0/d1d/d24/c8a 0 2024-02-28T16:01:55.865 INFO:tasks.workunit.client.1.smithi087.stdout:5/508: unlink d3/d64/d81/c3f 0 2024-02-28T16:01:55.868 INFO:tasks.workunit.client.1.smithi087.stdout:7/429: getdents d14/d27/d5d/d6a 0 2024-02-28T16:01:55.870 INFO:tasks.workunit.client.1.smithi087.stdout:4/499: mkdir d2/d9/de/db6 0 2024-02-28T16:01:55.871 INFO:tasks.workunit.client.1.smithi087.stdout:2/450: dwrite d2/d99/f1e [0,4194304] 0 2024-02-28T16:01:55.872 INFO:tasks.workunit.client.1.smithi087.stdout:1/427: write d0/d1b/f79 [957402,32065] 0 2024-02-28T16:01:55.875 INFO:tasks.workunit.client.1.smithi087.stdout:6/489: dread d4/dc/d10/f19 [0,4194304] 0 2024-02-28T16:01:55.875 INFO:tasks.workunit.client.1.smithi087.stdout:8/463: dread d2/f30 [0,4194304] 0 2024-02-28T16:01:55.875 INFO:tasks.workunit.client.1.smithi087.stdout:7/430: read d14/d46/f74 [3963070,122759] 0 2024-02-28T16:01:55.876 INFO:tasks.workunit.client.0.smithi057.stdout:0/263: dwrite d6/d12/d38/f52 [0,4194304] 0 2024-02-28T16:01:55.877 INFO:tasks.workunit.client.1.smithi087.stdout:9/427: creat d7/d1e/d60/d64/f73 x:0 0 0 2024-02-28T16:01:55.880 INFO:tasks.workunit.client.1.smithi087.stdout:3/427: dread d11/d44/f87 [0,4194304] 0 2024-02-28T16:01:55.881 INFO:tasks.workunit.client.0.smithi057.stdout:1/192: dread d1/d3/dc/d15/f16 [0,4194304] 0 2024-02-28T16:01:55.882 INFO:tasks.workunit.client.1.smithi087.stdout:2/451: chown d2/d99/d28/l80 57199934 1 2024-02-28T16:01:55.882 INFO:tasks.workunit.client.1.smithi087.stdout:7/431: unlink d14/d27/f6d 0 2024-02-28T16:01:55.883 INFO:tasks.workunit.client.0.smithi057.stdout:0/264: creat d6/d12/d45/d55/f56 x:0 0 0 2024-02-28T16:01:55.883 INFO:tasks.workunit.client.1.smithi087.stdout:9/428: stat d7/dd/d15/d39 0 2024-02-28T16:01:55.884 INFO:tasks.workunit.client.0.smithi057.stdout:1/193: mkdir d1/d21/d25/d26/d44 0 2024-02-28T16:01:55.886 INFO:tasks.workunit.client.1.smithi087.stdout:8/464: fdatasync d2/d9/d10/d24/d53/d6f/f74 0 2024-02-28T16:01:55.886 INFO:tasks.workunit.client.1.smithi087.stdout:1/428: mknod d0/d1b/c8b 0 2024-02-28T16:01:55.887 INFO:tasks.workunit.client.0.smithi057.stdout:0/265: rename d6/lb to d6/d12/d17/d34/l57 0 2024-02-28T16:01:55.888 INFO:tasks.workunit.client.1.smithi087.stdout:9/429: chown d7/d1e/f51 364 1 2024-02-28T16:01:55.888 INFO:tasks.workunit.client.0.smithi057.stdout:1/194: creat d1/f45 x:0 0 0 2024-02-28T16:01:55.889 INFO:tasks.workunit.client.1.smithi087.stdout:4/500: dread d2/df/d65/d8d/fa4 [0,4194304] 0 2024-02-28T16:01:55.889 INFO:tasks.workunit.client.1.smithi087.stdout:6/490: truncate d4/d12/d45/d57/f6a 26634 0 2024-02-28T16:01:55.890 INFO:tasks.workunit.client.1.smithi087.stdout:7/432: write d14/d2e/d2b/f50 [2102717,58269] 0 2024-02-28T16:01:55.890 INFO:tasks.workunit.client.0.smithi057.stdout:0/266: readlink d6/d12/l23 0 2024-02-28T16:01:55.893 INFO:tasks.workunit.client.1.smithi087.stdout:6/491: chown d4/d12/l41 0 1 2024-02-28T16:01:55.893 INFO:tasks.workunit.client.0.smithi057.stdout:0/267: write d6/f19 [3023677,93768] 0 2024-02-28T16:01:55.894 INFO:tasks.workunit.client.1.smithi087.stdout:2/452: mknod d2/d7/d17/d97/ca4 0 2024-02-28T16:01:55.895 INFO:tasks.workunit.client.0.smithi057.stdout:1/195: symlink d1/d3/dc/d40/l46 0 2024-02-28T16:01:55.896 INFO:tasks.workunit.client.1.smithi087.stdout:6/492: chown d4/d12/c54 1784 1 2024-02-28T16:01:55.897 INFO:tasks.workunit.client.0.smithi057.stdout:1/196: chown d1/d3/dc/l24 1815 1 2024-02-28T16:01:55.898 INFO:tasks.workunit.client.0.smithi057.stdout:0/268: write d6/d12/d45/f4f [773841,127802] 0 2024-02-28T16:01:55.899 INFO:tasks.workunit.client.1.smithi087.stdout:1/429: rmdir d0/d14/d3f 39 2024-02-28T16:01:55.901 INFO:tasks.workunit.client.1.smithi087.stdout:5/509: rename d3/d9/d9b/dba/d30/d36/d4f/l7f to d3/d9/d9b/lbd 0 2024-02-28T16:01:55.902 INFO:tasks.workunit.client.0.smithi057.stdout:1/197: creat d1/d3/f47 x:0 0 0 2024-02-28T16:01:55.903 INFO:tasks.workunit.client.0.smithi057.stdout:1/198: readlink d1/d3/dc/d40/l46 0 2024-02-28T16:01:55.904 INFO:tasks.workunit.client.1.smithi087.stdout:4/501: unlink d2/df/d65/c7b 0 2024-02-28T16:01:55.906 INFO:tasks.workunit.client.1.smithi087.stdout:7/433: mknod d14/d21/d4f/c7e 0 2024-02-28T16:01:55.907 INFO:tasks.workunit.client.0.smithi057.stdout:1/199: read d1/d21/d25/f3d [611591,59517] 0 2024-02-28T16:01:55.907 INFO:tasks.workunit.client.0.smithi057.stdout:0/269: getdents d6/d12/d45 0 2024-02-28T16:01:55.908 INFO:tasks.workunit.client.0.smithi057.stdout:0/270: chown d6/le 6 1 2024-02-28T16:01:55.909 INFO:tasks.workunit.client.1.smithi087.stdout:1/430: chown d0/d14/d3f 12233288 1 2024-02-28T16:01:55.910 INFO:tasks.workunit.client.0.smithi057.stdout:0/271: write d6/d12/d38/f52 [5240777,61431] 0 2024-02-28T16:01:55.911 INFO:tasks.workunit.client.1.smithi087.stdout:3/428: rename d11/d45/c4e to d11/d61/d7c/c96 0 2024-02-28T16:01:55.911 INFO:tasks.workunit.client.1.smithi087.stdout:8/465: dread d2/d9/d10/d24/d53/f8c [0,4194304] 0 2024-02-28T16:01:55.913 INFO:tasks.workunit.client.0.smithi057.stdout:0/272: chown d6/d12/d17 26169 1 2024-02-28T16:01:55.913 INFO:tasks.workunit.client.1.smithi087.stdout:5/510: mknod d3/d9/d4a/cbe 0 2024-02-28T16:01:55.915 INFO:tasks.workunit.client.0.smithi057.stdout:0/273: chown d6/d12/d45/d55/f54 31846647 1 2024-02-28T16:01:55.915 INFO:tasks.workunit.client.1.smithi087.stdout:4/502: creat d2/fb7 x:0 0 0 2024-02-28T16:01:55.916 INFO:tasks.workunit.client.0.smithi057.stdout:1/200: mknod d1/d21/c48 0 2024-02-28T16:01:55.916 INFO:tasks.workunit.client.1.smithi087.stdout:2/453: dread d2/d99/f13 [0,4194304] 0 2024-02-28T16:01:55.917 INFO:tasks.workunit.client.0.smithi057.stdout:0/274: mkdir d6/d12/d17/d58 0 2024-02-28T16:01:55.917 INFO:tasks.workunit.client.1.smithi087.stdout:5/511: chown d3/d9/d9b/dba/d30/d36/d4f/d82 86 1 2024-02-28T16:01:55.920 INFO:tasks.workunit.client.1.smithi087.stdout:6/493: link d4/d30/d13/d38/d69/d99/fa0 d4/d30/d13/d38/fa2 0 2024-02-28T16:01:55.921 INFO:tasks.workunit.client.0.smithi057.stdout:0/275: creat d6/d12/d17/f59 x:0 0 0 2024-02-28T16:01:55.922 INFO:tasks.workunit.client.1.smithi087.stdout:9/430: link d7/f32 d7/d1e/d60/d64/f74 0 2024-02-28T16:01:55.923 INFO:tasks.workunit.client.1.smithi087.stdout:3/429: creat d11/d7b/f97 x:0 0 0 2024-02-28T16:01:55.923 INFO:tasks.workunit.client.1.smithi087.stdout:1/431: symlink d0/d1d/l8c 0 2024-02-28T16:01:55.923 INFO:tasks.workunit.client.0.smithi057.stdout:1/201: getdents d1/d3/dc 0 2024-02-28T16:01:55.924 INFO:tasks.workunit.client.1.smithi087.stdout:3/430: stat fa 0 2024-02-28T16:01:55.924 INFO:tasks.workunit.client.0.smithi057.stdout:0/276: mknod d6/d12/d17/c5a 0 2024-02-28T16:01:55.925 INFO:tasks.workunit.client.1.smithi087.stdout:2/454: symlink d2/d7/d17/d34/d88/la5 0 2024-02-28T16:01:55.927 INFO:tasks.workunit.client.0.smithi057.stdout:0/277: write d6/d12/d17/f59 [463565,35474] 0 2024-02-28T16:01:55.928 INFO:tasks.workunit.client.0.smithi057.stdout:1/202: truncate d1/d21/d25/f3d 927623 0 2024-02-28T16:01:55.930 INFO:tasks.workunit.client.0.smithi057.stdout:0/278: write d6/d12/d45/d55/f50 [823941,11438] 0 2024-02-28T16:01:55.930 INFO:tasks.workunit.client.1.smithi087.stdout:5/512: creat d3/d9/d9b/dba/d30/d53/d5b/fbf x:0 0 0 2024-02-28T16:01:55.930 INFO:tasks.workunit.client.0.smithi057.stdout:1/203: chown d1/d3/dc/d40 10655825 1 2024-02-28T16:01:55.932 INFO:tasks.workunit.client.1.smithi087.stdout:8/466: dwrite d2/d63/f97 [0,4194304] 0 2024-02-28T16:01:55.932 INFO:tasks.workunit.client.0.smithi057.stdout:0/279: truncate d6/f41 759675 0 2024-02-28T16:01:55.932 INFO:tasks.workunit.client.0.smithi057.stdout:1/204: write d1/d3/f3b [229221,52162] 0 2024-02-28T16:01:55.936 INFO:tasks.workunit.client.1.smithi087.stdout:9/431: rmdir d7/d1e/d60 39 2024-02-28T16:01:55.936 INFO:tasks.workunit.client.0.smithi057.stdout:0/280: fdatasync d6/d12/d17/f37 0 2024-02-28T16:01:55.939 INFO:tasks.workunit.client.1.smithi087.stdout:9/432: fsync d7/f58 0 2024-02-28T16:01:55.939 INFO:tasks.workunit.client.1.smithi087.stdout:3/431: mkdir d11/d33/d67/d98 0 2024-02-28T16:01:55.940 INFO:tasks.workunit.client.1.smithi087.stdout:8/467: stat d2/d18/l55 0 2024-02-28T16:01:55.940 INFO:tasks.workunit.client.1.smithi087.stdout:1/432: chown d0/d1a/c68 2 1 2024-02-28T16:01:55.944 INFO:tasks.workunit.client.1.smithi087.stdout:4/503: write d2/d9/f24 [350562,7502] 0 2024-02-28T16:01:55.946 INFO:tasks.workunit.client.1.smithi087.stdout:6/494: creat d4/d30/fa3 x:0 0 0 2024-02-28T16:01:55.946 INFO:tasks.workunit.client.1.smithi087.stdout:7/434: dwrite d14/d21/f32 [0,4194304] 0 2024-02-28T16:01:55.946 INFO:tasks.workunit.client.1.smithi087.stdout:1/433: write d0/d1a/f7d [213859,81311] 0 2024-02-28T16:01:55.948 INFO:tasks.workunit.client.1.smithi087.stdout:8/468: write d2/d18/d42/f6d [137459,23823] 0 2024-02-28T16:01:55.952 INFO:tasks.workunit.client.1.smithi087.stdout:8/469: stat d2/d18/d42/d7b/l99 0 2024-02-28T16:01:55.957 INFO:tasks.workunit.client.1.smithi087.stdout:2/455: dwrite d2/d7/f2d [8388608,4194304] 0 2024-02-28T16:01:55.960 INFO:tasks.workunit.client.0.smithi057.stdout:0/281: dwrite d6/d12/d17/d4b/f36 [0,4194304] 0 2024-02-28T16:01:55.964 INFO:tasks.workunit.client.0.smithi057.stdout:1/205: truncate d1/d3/f3b 220909 0 2024-02-28T16:01:55.964 INFO:tasks.workunit.client.0.smithi057.stdout:0/282: read - d6/d12/d45/d55/f54 zero size 2024-02-28T16:01:55.964 INFO:tasks.workunit.client.1.smithi087.stdout:7/435: rmdir d14/d2e 39 2024-02-28T16:01:55.966 INFO:tasks.workunit.client.1.smithi087.stdout:4/504: dread - d2/d9/da/d1a/d26/d69/f74 zero size 2024-02-28T16:01:55.966 INFO:tasks.workunit.client.1.smithi087.stdout:8/470: mkdir d2/d9/d10/d24/d9d 0 2024-02-28T16:01:55.967 INFO:tasks.workunit.client.0.smithi057.stdout:0/283: mknod d6/d12/d45/c5b 0 2024-02-28T16:01:55.967 INFO:tasks.workunit.client.1.smithi087.stdout:2/456: dread d2/d99/f3f [0,4194304] 0 2024-02-28T16:01:55.971 INFO:tasks.workunit.client.0.smithi057.stdout:1/206: fsync d1/d3/dc/f10 0 2024-02-28T16:01:55.971 INFO:tasks.workunit.client.0.smithi057.stdout:0/284: fdatasync d6/d12/d45/d55/f54 0 2024-02-28T16:01:55.971 INFO:tasks.workunit.client.1.smithi087.stdout:3/432: link d11/f46 d11/d45/d73/f99 0 2024-02-28T16:01:55.971 INFO:tasks.workunit.client.1.smithi087.stdout:1/434: write d0/d1b/d1f/d71/f81 [901555,55884] 0 2024-02-28T16:01:55.971 INFO:tasks.workunit.client.1.smithi087.stdout:9/433: dwrite d7/dd/d36/f4f [0,4194304] 0 2024-02-28T16:01:55.972 INFO:tasks.workunit.client.1.smithi087.stdout:7/436: fdatasync f12 0 2024-02-28T16:01:55.972 INFO:tasks.workunit.client.1.smithi087.stdout:4/505: rmdir d2/d9/de 39 2024-02-28T16:01:55.973 INFO:tasks.workunit.client.0.smithi057.stdout:0/285: chown d6/d12/d17/d34 14896 1 2024-02-28T16:01:55.975 INFO:tasks.workunit.client.1.smithi087.stdout:6/495: getdents d4/dc/d61/d89 0 2024-02-28T16:01:55.978 INFO:tasks.workunit.client.1.smithi087.stdout:8/471: symlink d2/d18/d25/l9e 0 2024-02-28T16:01:55.980 INFO:tasks.workunit.client.0.smithi057.stdout:1/207: rename d1/d21/d25/l43 to d1/d21/l49 0 2024-02-28T16:01:55.982 INFO:tasks.workunit.client.0.smithi057.stdout:1/208: write d1/d3/f3a [882576,79830] 0 2024-02-28T16:01:55.984 INFO:tasks.workunit.client.1.smithi087.stdout:8/472: chown d2/d9/d10/d24 53593593 1 2024-02-28T16:01:55.985 INFO:tasks.workunit.client.1.smithi087.stdout:1/435: creat d0/d1a/d28/f8d x:0 0 0 2024-02-28T16:01:55.986 INFO:tasks.workunit.client.1.smithi087.stdout:2/457: mkdir d2/d99/d28/d54/da6 0 2024-02-28T16:01:55.987 INFO:tasks.workunit.client.1.smithi087.stdout:6/496: mkdir d4/dc/d7e/da4 0 2024-02-28T16:01:55.988 INFO:tasks.workunit.client.1.smithi087.stdout:4/506: rename d2/df/d65/cb2 to d2/d9/d10/d22/d5b/d5c/d91/cb8 0 2024-02-28T16:01:55.990 INFO:tasks.workunit.client.1.smithi087.stdout:9/434: symlink d7/d1e/l75 0 2024-02-28T16:01:55.991 INFO:tasks.workunit.client.0.smithi057.stdout:0/286: dwrite d6/d12/d17/f51 [0,4194304] 0 2024-02-28T16:01:55.997 INFO:tasks.workunit.client.1.smithi087.stdout:2/458: mknod d2/d7/d17/d34/d88/ca7 0 2024-02-28T16:01:55.999 INFO:tasks.workunit.client.1.smithi087.stdout:3/433: rename d11/d45/d73/d7a/c7e to d11/d61/c9a 0 2024-02-28T16:01:56.001 INFO:tasks.workunit.client.1.smithi087.stdout:4/507: creat d2/d9/d10/d11/fb9 x:0 0 0 2024-02-28T16:01:56.002 INFO:tasks.workunit.client.1.smithi087.stdout:8/473: mkdir d2/d9/d5e/d9c/d9f 0 2024-02-28T16:01:56.002 INFO:tasks.workunit.client.1.smithi087.stdout:4/508: chown d2/d9/da/d1a 1043713 1 2024-02-28T16:01:56.003 INFO:tasks.workunit.client.0.smithi057.stdout:1/209: read d1/d21/d25/f3d [368974,10304] 0 2024-02-28T16:01:56.004 INFO:tasks.workunit.client.1.smithi087.stdout:0/461: sync 2024-02-28T16:01:56.004 INFO:tasks.workunit.client.1.smithi087.stdout:5/513: dread d3/d9/f1e [0,4194304] 0 2024-02-28T16:01:56.004 INFO:tasks.workunit.client.1.smithi087.stdout:8/474: dread - d2/d9/d1a/f48 zero size 2024-02-28T16:01:56.005 INFO:tasks.workunit.client.1.smithi087.stdout:4/509: readlink d2/df/d62/la5 0 2024-02-28T16:01:56.005 INFO:tasks.workunit.client.0.smithi057.stdout:1/210: readlink d1/d21/d25/d26/l2b 0 2024-02-28T16:01:56.007 INFO:tasks.workunit.client.1.smithi087.stdout:1/436: truncate d0/d1a/f34 2290165 0 2024-02-28T16:01:56.009 INFO:tasks.workunit.client.1.smithi087.stdout:6/497: mkdir d4/da5 0 2024-02-28T16:01:56.016 INFO:tasks.workunit.client.1.smithi087.stdout:2/459: symlink d2/d7d/la8 0 2024-02-28T16:01:56.016 INFO:tasks.workunit.client.1.smithi087.stdout:7/437: getdents d14/d2e/d2b/d4e 0 2024-02-28T16:01:56.016 INFO:tasks.workunit.client.1.smithi087.stdout:3/434: stat d11/f46 0 2024-02-28T16:01:56.016 INFO:tasks.workunit.client.1.smithi087.stdout:6/498: chown d4/d12/l41 267746581 1 2024-02-28T16:01:56.017 INFO:tasks.workunit.client.0.smithi057.stdout:1/211: write d1/d21/d25/f3d [1763633,47921] 0 2024-02-28T16:01:56.019 INFO:tasks.workunit.client.1.smithi087.stdout:3/435: chown d11/d44/d5b/f78 58265 1 2024-02-28T16:01:56.019 INFO:tasks.workunit.client.1.smithi087.stdout:4/510: chown d2/d9/de/f86 216 1 2024-02-28T16:01:56.024 INFO:tasks.workunit.client.1.smithi087.stdout:1/437: dread d0/d1a/d28/f29 [0,4194304] 0 2024-02-28T16:01:56.024 INFO:tasks.workunit.client.1.smithi087.stdout:5/514: mknod d3/d9/d9b/dba/cc0 0 2024-02-28T16:01:56.025 INFO:tasks.workunit.client.1.smithi087.stdout:9/435: dwrite d7/d1e/f5c [0,4194304] 0 2024-02-28T16:01:56.029 INFO:tasks.workunit.client.1.smithi087.stdout:3/436: rmdir d11/d33/d58/d8c 39 2024-02-28T16:01:56.031 INFO:tasks.workunit.client.1.smithi087.stdout:5/515: chown d3/d9/d9b/dba/d30/l41 0 1 2024-02-28T16:01:56.036 INFO:tasks.workunit.client.1.smithi087.stdout:9/436: rename d7/d6b to d7/d1e/d44/d76 0 2024-02-28T16:01:56.038 INFO:tasks.workunit.client.1.smithi087.stdout:0/462: dwrite d4/d6/f2a [0,4194304] 0 2024-02-28T16:01:56.039 INFO:tasks.workunit.client.0.smithi057.stdout:1/212: dwrite d1/f8 [0,4194304] 0 2024-02-28T16:01:56.040 INFO:tasks.workunit.client.1.smithi087.stdout:5/516: rmdir d3/d64 39 2024-02-28T16:01:56.042 INFO:tasks.workunit.client.1.smithi087.stdout:6/499: getdents d4/d12 0 2024-02-28T16:01:56.045 INFO:tasks.workunit.client.0.smithi057.stdout:1/213: link d1/d3/dc/c35 d1/d3/c4a 0 2024-02-28T16:01:56.046 INFO:tasks.workunit.client.1.smithi087.stdout:8/475: dread d2/d18/d25/f21 [0,4194304] 0 2024-02-28T16:01:56.047 INFO:tasks.workunit.client.0.smithi057.stdout:1/214: readlink d1/d21/d25/d26/l2b 0 2024-02-28T16:01:56.050 INFO:tasks.workunit.client.1.smithi087.stdout:9/437: mknod d7/dd/d15/d3f/d6d/c77 0 2024-02-28T16:01:56.052 INFO:tasks.workunit.client.0.smithi057.stdout:1/215: rename d1/l5 to d1/d21/d25/d26/d44/l4b 0 2024-02-28T16:01:56.055 INFO:tasks.workunit.client.0.smithi057.stdout:1/216: mkdir d1/d21/d25/d26/d44/d4c 0 2024-02-28T16:01:56.056 INFO:tasks.workunit.client.1.smithi087.stdout:9/438: fsync d7/dd/d3c/f6f 0 2024-02-28T16:01:56.058 INFO:tasks.workunit.client.1.smithi087.stdout:5/517: mknod d3/d9/d9b/dba/cc1 0 2024-02-28T16:01:56.060 INFO:tasks.workunit.client.0.smithi057.stdout:1/217: chown d1/d3/dc/d15/c41 7947 1 2024-02-28T16:01:56.062 INFO:tasks.workunit.client.0.smithi057.stdout:1/218: truncate d1/d3/dc/f12 2674262 0 2024-02-28T16:01:56.066 INFO:tasks.workunit.client.1.smithi087.stdout:3/437: dread d11/d44/d5b/f5a [0,4194304] 0 2024-02-28T16:01:56.067 INFO:tasks.workunit.client.0.smithi057.stdout:1/219: mknod d1/d21/d25/d26/d44/c4d 0 2024-02-28T16:01:56.067 INFO:tasks.workunit.client.1.smithi087.stdout:8/476: mkdir d2/d9/d10/da0 0 2024-02-28T16:01:56.068 INFO:tasks.workunit.client.1.smithi087.stdout:4/511: write d2/df/f39 [258963,94571] 0 2024-02-28T16:01:56.069 INFO:tasks.workunit.client.1.smithi087.stdout:9/439: creat d7/dd/d3c/f78 x:0 0 0 2024-02-28T16:01:56.071 INFO:tasks.workunit.client.1.smithi087.stdout:9/440: readlink d7/dc/l25 0 2024-02-28T16:01:56.071 INFO:tasks.workunit.client.1.smithi087.stdout:6/500: link d4/d30/d13/d67/c9f d4/dc/d7e/da4/ca6 0 2024-02-28T16:01:56.073 INFO:tasks.workunit.client.1.smithi087.stdout:5/518: read - d3/d64/d81/f78 zero size 2024-02-28T16:01:56.073 INFO:tasks.workunit.client.0.smithi057.stdout:1/220: unlink d1/d3/dc/f10 0 2024-02-28T16:01:56.073 INFO:tasks.workunit.client.1.smithi087.stdout:3/438: rmdir d11/d44/d5b 39 2024-02-28T16:01:56.074 INFO:tasks.workunit.client.1.smithi087.stdout:9/441: chown d7/d1e/d44/f62 1748081 1 2024-02-28T16:01:56.075 INFO:tasks.workunit.client.1.smithi087.stdout:0/463: mkdir d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a 0 2024-02-28T16:01:56.076 INFO:tasks.workunit.client.1.smithi087.stdout:4/512: dread - d2/d9/da/d1a/d26/d69/f74 zero size 2024-02-28T16:01:56.078 INFO:tasks.workunit.client.1.smithi087.stdout:1/438: dread d0/d1d/f72 [0,4194304] 0 2024-02-28T16:01:56.078 INFO:tasks.workunit.client.1.smithi087.stdout:3/439: read - d11/d33/f93 zero size 2024-02-28T16:01:56.079 INFO:tasks.workunit.client.1.smithi087.stdout:6/501: mknod d4/dc/d61/d89/ca7 0 2024-02-28T16:01:56.081 INFO:tasks.workunit.client.1.smithi087.stdout:9/442: read - d7/dd/f2d zero size 2024-02-28T16:01:56.081 INFO:tasks.workunit.client.1.smithi087.stdout:8/477: read d2/d18/d42/f70 [1138102,7183] 0 2024-02-28T16:01:56.082 INFO:tasks.workunit.client.0.smithi057.stdout:1/221: mkdir d1/d3/dc/d15/d4e 0 2024-02-28T16:01:56.084 INFO:tasks.workunit.client.0.smithi057.stdout:1/222: write d1/d21/f39 [3376563,114800] 0 2024-02-28T16:01:56.084 INFO:tasks.workunit.client.1.smithi087.stdout:5/519: creat d3/d9/d9b/dba/d30/d8f/dac/fc2 x:0 0 0 2024-02-28T16:01:56.089 INFO:tasks.workunit.client.1.smithi087.stdout:8/478: mknod d2/d63/ca1 0 2024-02-28T16:01:56.090 INFO:tasks.workunit.client.1.smithi087.stdout:5/520: creat d3/d9/d4a/d5e/da1/fc3 x:0 0 0 2024-02-28T16:01:56.092 INFO:tasks.workunit.client.1.smithi087.stdout:1/439: creat d0/d1d/d24/d78/f8e x:0 0 0 2024-02-28T16:01:56.093 INFO:tasks.workunit.client.1.smithi087.stdout:6/502: mknod d4/da5/ca8 0 2024-02-28T16:01:56.099 INFO:tasks.workunit.client.1.smithi087.stdout:6/503: stat d4/d30/d13/d67 0 2024-02-28T16:01:56.100 INFO:tasks.workunit.client.1.smithi087.stdout:1/440: mknod d0/c8f 0 2024-02-28T16:01:56.103 INFO:tasks.workunit.client.1.smithi087.stdout:0/464: dwrite d4/dd/d37/d39/d3a/f87 [0,4194304] 0 2024-02-28T16:01:56.108 INFO:tasks.workunit.client.1.smithi087.stdout:8/479: rename d2/d9/d10/d24/d53/d89 to d2/da2 0 2024-02-28T16:01:56.110 INFO:tasks.workunit.client.1.smithi087.stdout:3/440: dwrite d11/d44/f57 [0,4194304] 0 2024-02-28T16:01:56.111 INFO:tasks.workunit.client.1.smithi087.stdout:4/513: dwrite d2/d9/da/f36 [0,4194304] 0 2024-02-28T16:01:56.113 INFO:tasks.workunit.client.1.smithi087.stdout:8/480: read d2/d9/d1a/f45 [3691353,68452] 0 2024-02-28T16:01:56.113 INFO:tasks.workunit.client.1.smithi087.stdout:1/441: creat d0/f90 x:0 0 0 2024-02-28T16:01:56.116 INFO:tasks.workunit.client.1.smithi087.stdout:4/514: truncate d2/d9/f48 3830060 0 2024-02-28T16:01:56.118 INFO:tasks.workunit.client.1.smithi087.stdout:8/481: chown d2/d9/d5e/d9c/d9f 113 1 2024-02-28T16:01:56.119 INFO:tasks.workunit.client.1.smithi087.stdout:5/521: rename d3/d9/d9b/dba/d30/l41 to d3/d9/d4a/d5e/da1/lc4 0 2024-02-28T16:01:56.125 INFO:tasks.workunit.client.1.smithi087.stdout:6/504: dwrite d4/dc/f8e [0,4194304] 0 2024-02-28T16:01:56.131 INFO:tasks.workunit.client.1.smithi087.stdout:4/515: creat d2/d9/d9e/fba x:0 0 0 2024-02-28T16:01:56.132 INFO:tasks.workunit.client.1.smithi087.stdout:5/522: mkdir d3/d64/d67/d7c/dc5 0 2024-02-28T16:01:56.134 INFO:tasks.workunit.client.1.smithi087.stdout:8/482: chown d2/l7 260950215 1 2024-02-28T16:01:56.139 INFO:tasks.workunit.client.1.smithi087.stdout:8/483: chown d2/d9/l39 40 1 2024-02-28T16:01:56.141 INFO:tasks.workunit.client.1.smithi087.stdout:8/484: fsync d2/d18/d25/f21 0 2024-02-28T16:01:56.144 INFO:tasks.workunit.client.1.smithi087.stdout:9/443: dwrite d7/d1e/d60/d64/f74 [0,4194304] 0 2024-02-28T16:01:56.154 INFO:tasks.workunit.client.1.smithi087.stdout:6/505: dwrite d4/d96/f98 [0,4194304] 0 2024-02-28T16:01:56.157 INFO:tasks.workunit.client.1.smithi087.stdout:4/516: mkdir d2/d9/de/dbb 0 2024-02-28T16:01:56.157 INFO:tasks.workunit.client.1.smithi087.stdout:3/441: write d11/f36 [3349527,81082] 0 2024-02-28T16:01:56.159 INFO:tasks.workunit.client.1.smithi087.stdout:5/523: unlink d3/d9/d9b/dba/d30/f97 0 2024-02-28T16:01:56.162 INFO:tasks.workunit.client.1.smithi087.stdout:9/444: rename d7/dd/d15/d39 to d7/dd/d15/d79 0 2024-02-28T16:01:56.164 INFO:tasks.workunit.client.1.smithi087.stdout:6/506: rename d4/d30/fa3 to d4/d30/d83/fa9 0 2024-02-28T16:01:56.171 INFO:tasks.workunit.client.1.smithi087.stdout:8/485: mknod d2/ca3 0 2024-02-28T16:01:56.171 INFO:tasks.workunit.client.1.smithi087.stdout:4/517: creat d2/d9/da/d1a/d26/d69/fbc x:0 0 0 2024-02-28T16:01:56.172 INFO:tasks.workunit.client.1.smithi087.stdout:3/442: truncate d11/f35 2771145 0 2024-02-28T16:01:56.172 INFO:tasks.workunit.client.1.smithi087.stdout:5/524: creat d3/d9/fc6 x:0 0 0 2024-02-28T16:01:56.181 INFO:tasks.workunit.client.1.smithi087.stdout:6/507: rename d4/d30/c7a to d4/d30/d13/caa 0 2024-02-28T16:01:56.182 INFO:tasks.workunit.client.1.smithi087.stdout:6/508: stat d4/d12/d45/f8a 0 2024-02-28T16:01:56.182 INFO:tasks.workunit.client.1.smithi087.stdout:3/443: mkdir d11/d33/d67/d98/d9b 0 2024-02-28T16:01:56.185 INFO:tasks.workunit.client.1.smithi087.stdout:1/442: dread d0/d1a/f34 [0,4194304] 0 2024-02-28T16:01:56.186 INFO:tasks.workunit.client.1.smithi087.stdout:5/525: creat d3/d9/d9b/dba/d30/d53/d5b/fc7 x:0 0 0 2024-02-28T16:01:56.187 INFO:tasks.workunit.client.1.smithi087.stdout:8/486: link d2/ca3 d2/d18/d42/d62/ca4 0 2024-02-28T16:01:56.188 INFO:tasks.workunit.client.1.smithi087.stdout:6/509: creat d4/dc/d7e/fab x:0 0 0 2024-02-28T16:01:56.189 INFO:tasks.workunit.client.1.smithi087.stdout:3/444: rmdir d11/d33/d67/d98 39 2024-02-28T16:01:56.196 INFO:tasks.workunit.client.1.smithi087.stdout:1/443: fsync d0/d14/f18 0 2024-02-28T16:01:56.198 INFO:tasks.workunit.client.1.smithi087.stdout:5/526: dread d3/d9/f68 [0,4194304] 0 2024-02-28T16:01:56.199 INFO:tasks.workunit.client.1.smithi087.stdout:4/518: getdents d2/d9/da/d1a/d26/da7 0 2024-02-28T16:01:56.201 INFO:tasks.workunit.client.1.smithi087.stdout:4/519: chown d2/c3 328152532 1 2024-02-28T16:01:56.201 INFO:tasks.workunit.client.1.smithi087.stdout:9/445: dread d7/dc/f18 [0,4194304] 0 2024-02-28T16:01:56.201 INFO:tasks.workunit.client.1.smithi087.stdout:6/510: rename d4/d30/d13/l7f to d4/d12/d45/d74/d9a/lac 0 2024-02-28T16:01:56.203 INFO:tasks.workunit.client.1.smithi087.stdout:8/487: chown d2/d33/f35 265856 1 2024-02-28T16:01:56.204 INFO:tasks.workunit.client.1.smithi087.stdout:3/445: mkdir d11/d33/d67/d9c 0 2024-02-28T16:01:56.205 INFO:tasks.workunit.client.1.smithi087.stdout:8/488: chown d2/d9/f17 20634938 1 2024-02-28T16:01:56.206 INFO:tasks.workunit.client.1.smithi087.stdout:5/527: mknod d3/d9/d9b/dba/d30/d53/d5b/cc8 0 2024-02-28T16:01:56.210 INFO:tasks.workunit.client.1.smithi087.stdout:6/511: write d4/d30/d42/f81 [3763804,50148] 0 2024-02-28T16:01:56.215 INFO:tasks.workunit.client.1.smithi087.stdout:5/528: chown d3/d9/d9b/dba/d30/d53/d5b/la5 7876591 1 2024-02-28T16:01:56.220 INFO:tasks.workunit.client.1.smithi087.stdout:9/446: creat d7/dd/d15/f7a x:0 0 0 2024-02-28T16:01:56.220 INFO:tasks.workunit.client.1.smithi087.stdout:1/444: dwrite d0/d1a/f3a [4194304,4194304] 0 2024-02-28T16:01:56.223 INFO:tasks.workunit.client.1.smithi087.stdout:8/489: getdents d2/d18/d42 0 2024-02-28T16:01:56.225 INFO:tasks.workunit.client.1.smithi087.stdout:9/447: fsync d7/f12 0 2024-02-28T16:01:56.227 INFO:tasks.workunit.client.1.smithi087.stdout:3/446: write d11/f46 [21471,66636] 0 2024-02-28T16:01:56.233 INFO:tasks.workunit.client.1.smithi087.stdout:5/529: getdents d3/d9/d9b/dba/d30/d53/d5b 0 2024-02-28T16:01:56.233 INFO:tasks.workunit.client.1.smithi087.stdout:9/448: creat d7/d1e/d60/d64/f7b x:0 0 0 2024-02-28T16:01:56.236 INFO:tasks.workunit.client.1.smithi087.stdout:8/490: fdatasync d2/d9/d10/d24/f34 0 2024-02-28T16:01:56.238 INFO:tasks.workunit.client.1.smithi087.stdout:3/447: rename d11/d44/f56 to d11/d33/d67/d98/d9b/f9d 0 2024-02-28T16:01:56.238 INFO:tasks.workunit.client.1.smithi087.stdout:4/520: dread d2/f2f [0,4194304] 0 2024-02-28T16:01:56.238 INFO:tasks.workunit.client.1.smithi087.stdout:9/449: write d7/d1e/d60/f63 [226937,86128] 0 2024-02-28T16:01:56.240 INFO:tasks.workunit.client.1.smithi087.stdout:5/530: fsync d3/d9/d9b/dba/f26 0 2024-02-28T16:01:56.242 INFO:tasks.workunit.client.1.smithi087.stdout:4/521: chown d2/fb7 2508 1 2024-02-28T16:01:56.248 INFO:tasks.workunit.client.1.smithi087.stdout:1/445: truncate d0/d14/f54 1059785 0 2024-02-28T16:01:56.250 INFO:tasks.workunit.client.1.smithi087.stdout:4/522: symlink d2/d9/d10/lbd 0 2024-02-28T16:01:56.252 INFO:tasks.workunit.client.1.smithi087.stdout:1/446: creat d0/d1d/d24/d78/f91 x:0 0 0 2024-02-28T16:01:56.255 INFO:tasks.workunit.client.1.smithi087.stdout:1/447: dread - d0/d1a/d28/f8d zero size 2024-02-28T16:01:56.255 INFO:tasks.workunit.client.1.smithi087.stdout:4/523: fsync d2/d9/da/d1a/d26/f29 0 2024-02-28T16:01:56.258 INFO:tasks.workunit.client.1.smithi087.stdout:9/450: dread d7/dd/f1a [0,4194304] 0 2024-02-28T16:01:56.259 INFO:tasks.workunit.client.1.smithi087.stdout:8/491: dread d2/d9/d10/d24/d53/f8c [0,4194304] 0 2024-02-28T16:01:56.262 INFO:tasks.workunit.client.1.smithi087.stdout:8/492: unlink d2/d63/f41 0 2024-02-28T16:01:56.263 INFO:tasks.workunit.client.1.smithi087.stdout:5/531: dwrite d3/fb2 [0,4194304] 0 2024-02-28T16:01:56.267 INFO:tasks.workunit.client.1.smithi087.stdout:5/532: read d3/d64/d67/f76 [4127286,24078] 0 2024-02-28T16:01:56.269 INFO:tasks.workunit.client.1.smithi087.stdout:4/524: rename d2/d9/d10/d22/l71 to d2/df/lbe 0 2024-02-28T16:01:56.270 INFO:tasks.workunit.client.1.smithi087.stdout:9/451: symlink d7/l7c 0 2024-02-28T16:01:56.270 INFO:tasks.workunit.client.1.smithi087.stdout:3/448: dwrite d11/f17 [0,4194304] 0 2024-02-28T16:01:56.274 INFO:tasks.workunit.client.1.smithi087.stdout:5/533: truncate d3/d64/d67/f80 1058843 0 2024-02-28T16:01:56.283 INFO:tasks.workunit.client.1.smithi087.stdout:7/438: sync 2024-02-28T16:01:56.283 INFO:tasks.workunit.client.1.smithi087.stdout:2/460: sync 2024-02-28T16:01:56.283 INFO:tasks.workunit.client.1.smithi087.stdout:1/448: dwrite d0/d1b/f79 [0,4194304] 0 2024-02-28T16:01:56.289 INFO:tasks.workunit.client.1.smithi087.stdout:8/493: dwrite d2/d9/f5c [0,4194304] 0 2024-02-28T16:01:56.290 INFO:tasks.workunit.client.1.smithi087.stdout:2/461: creat d2/d99/fa9 x:0 0 0 2024-02-28T16:01:56.291 INFO:tasks.workunit.client.1.smithi087.stdout:4/525: rename d2/d9/de to d2/d9/d10/dbf 0 2024-02-28T16:01:56.297 INFO:tasks.workunit.client.1.smithi087.stdout:2/462: fsync d2/d99/d28/d79/f96 0 2024-02-28T16:01:56.297 INFO:tasks.workunit.client.1.smithi087.stdout:9/452: getdents d7/dd/d3c 0 2024-02-28T16:01:56.297 INFO:tasks.workunit.client.1.smithi087.stdout:8/494: unlink d2/d9/d5e/f87 0 2024-02-28T16:01:56.299 INFO:tasks.workunit.client.1.smithi087.stdout:1/449: symlink d0/d1d/d24/d78/l92 0 2024-02-28T16:01:56.303 INFO:tasks.workunit.client.1.smithi087.stdout:4/526: mknod d2/d9/da/d1a/cc0 0 2024-02-28T16:01:56.303 INFO:tasks.workunit.client.1.smithi087.stdout:9/453: write d7/dd/d3c/f41 [221694,2223] 0 2024-02-28T16:01:56.305 INFO:tasks.workunit.client.1.smithi087.stdout:2/463: symlink d2/d99/d28/d79/laa 0 2024-02-28T16:01:56.310 INFO:tasks.workunit.client.1.smithi087.stdout:9/454: stat d7/dd/d3c/d4c 0 2024-02-28T16:01:56.312 INFO:tasks.workunit.client.1.smithi087.stdout:8/495: mkdir d2/d9/d1a/da5 0 2024-02-28T16:01:56.315 INFO:tasks.workunit.client.1.smithi087.stdout:9/455: chown d7/f58 390875699 1 2024-02-28T16:01:56.317 INFO:tasks.workunit.client.1.smithi087.stdout:3/449: dwrite f10 [0,4194304] 0 2024-02-28T16:01:56.318 INFO:tasks.workunit.client.1.smithi087.stdout:2/464: creat d2/d7/d17/d3d/fab x:0 0 0 2024-02-28T16:01:56.322 INFO:tasks.workunit.client.1.smithi087.stdout:1/450: creat d0/d14/f93 x:0 0 0 2024-02-28T16:01:56.323 INFO:tasks.workunit.client.1.smithi087.stdout:2/465: fdatasync d2/d7/f46 0 2024-02-28T16:01:56.330 INFO:tasks.workunit.client.1.smithi087.stdout:1/451: creat d0/d1d/d24/d5c/d69/f94 x:0 0 0 2024-02-28T16:01:56.330 INFO:tasks.workunit.client.1.smithi087.stdout:2/466: mkdir d2/d7d/dac 0 2024-02-28T16:01:56.331 INFO:tasks.workunit.client.1.smithi087.stdout:5/534: dread d3/d9/f2a [0,4194304] 0 2024-02-28T16:01:56.338 INFO:tasks.workunit.client.1.smithi087.stdout:5/535: creat d3/d9/d4a/d5e/fc9 x:0 0 0 2024-02-28T16:01:56.338 INFO:tasks.workunit.client.1.smithi087.stdout:4/527: dwrite d2/d9/f4d [0,4194304] 0 2024-02-28T16:01:56.339 INFO:tasks.workunit.client.1.smithi087.stdout:7/439: dwrite f13 [0,4194304] 0 2024-02-28T16:01:56.341 INFO:tasks.workunit.client.1.smithi087.stdout:2/467: creat d2/d7/d17/d34/d88/fad x:0 0 0 2024-02-28T16:01:56.342 INFO:tasks.workunit.client.1.smithi087.stdout:9/456: dread d7/d1e/f24 [0,4194304] 0 2024-02-28T16:01:56.343 INFO:tasks.workunit.client.1.smithi087.stdout:5/536: chown d3/d9/d9b/dba/d30/d44/f85 875 1 2024-02-28T16:01:56.347 INFO:tasks.workunit.client.1.smithi087.stdout:4/528: chown d2/d9/d10/d22/c78 149776 1 2024-02-28T16:01:56.347 INFO:tasks.workunit.client.1.smithi087.stdout:5/537: chown d3/d9/d9b/dba/d30/d44/c4c 7 1 2024-02-28T16:01:56.347 INFO:tasks.workunit.client.1.smithi087.stdout:4/529: dread - d2/d9/d9e/fba zero size 2024-02-28T16:01:56.349 INFO:tasks.workunit.client.1.smithi087.stdout:7/440: unlink d14/d46/f74 0 2024-02-28T16:01:56.354 INFO:tasks.workunit.client.1.smithi087.stdout:4/530: mkdir d2/dc1 0 2024-02-28T16:01:56.354 INFO:tasks.workunit.client.1.smithi087.stdout:5/538: dread d3/d9/d9b/dba/d69/f92 [0,4194304] 0 2024-02-28T16:01:56.357 INFO:tasks.workunit.client.1.smithi087.stdout:9/457: creat d7/dc/f7d x:0 0 0 2024-02-28T16:01:56.357 INFO:tasks.workunit.client.1.smithi087.stdout:8/496: write d2/d18/d42/f70 [700256,129992] 0 2024-02-28T16:01:56.358 INFO:tasks.workunit.client.1.smithi087.stdout:1/452: read d0/d14/f54 [858944,97480] 0 2024-02-28T16:01:56.359 INFO:tasks.workunit.client.1.smithi087.stdout:7/441: symlink d14/d46/l7f 0 2024-02-28T16:01:56.362 INFO:tasks.workunit.client.1.smithi087.stdout:5/539: chown d3/d9/d9b/dba/l5c 5449324 1 2024-02-28T16:01:56.365 INFO:tasks.workunit.client.1.smithi087.stdout:2/468: dwrite d2/d99/f3f [0,4194304] 0 2024-02-28T16:01:56.369 INFO:tasks.workunit.client.1.smithi087.stdout:7/442: read - d14/d2e/f78 zero size 2024-02-28T16:01:56.370 INFO:tasks.workunit.client.0.smithi057.stdout:1/223: link d1/d21/d25/d26/d44/c4d d1/d3/c4f 0 2024-02-28T16:01:56.373 INFO:tasks.workunit.client.0.smithi057.stdout:1/224: rename d1/d3/dc to d1/d3/dc/d15/d4e/d50 22 2024-02-28T16:01:56.379 INFO:tasks.workunit.client.1.smithi087.stdout:9/458: dwrite d7/f32 [0,4194304] 0 2024-02-28T16:01:56.384 INFO:tasks.workunit.client.1.smithi087.stdout:5/540: dwrite d3/d9/d9b/dba/d30/d36/f45 [0,4194304] 0 2024-02-28T16:01:56.401 INFO:tasks.workunit.client.0.smithi057.stdout:1/225: dwrite d1/d3/dc/d15/f3c [0,4194304] 0 2024-02-28T16:01:56.409 INFO:tasks.workunit.client.0.smithi057.stdout:1/226: link d1/c1b d1/d3/c51 0 2024-02-28T16:01:56.410 INFO:tasks.workunit.client.0.smithi057.stdout:1/227: creat d1/d21/f52 x:0 0 0 2024-02-28T16:01:56.415 INFO:tasks.workunit.client.0.smithi057.stdout:1/228: unlink d1/d3/c51 0 2024-02-28T16:01:56.418 INFO:tasks.workunit.client.0.smithi057.stdout:1/229: write d1/d3/dc/f12 [908319,118650] 0 2024-02-28T16:01:56.434 INFO:tasks.workunit.client.0.smithi057.stdout:1/230: dwrite d1/d3/dc/d15/f3e [0,4194304] 0 2024-02-28T16:01:56.450 INFO:tasks.workunit.client.0.smithi057.stdout:1/231: dwrite d1/d3/dc/d15/f17 [0,4194304] 0 2024-02-28T16:01:56.451 INFO:tasks.workunit.client.1.smithi087.stdout:8/497: symlink d2/d9/d10/da0/la6 0 2024-02-28T16:01:56.451 INFO:tasks.workunit.client.1.smithi087.stdout:2/469: write d2/d7/d17/d34/f4a [1466480,99298] 0 2024-02-28T16:01:56.452 INFO:tasks.workunit.client.0.smithi057.stdout:1/232: truncate d1/d3/dc/f12 3652303 0 2024-02-28T16:01:56.453 INFO:tasks.workunit.client.1.smithi087.stdout:1/453: mknod d0/d1b/d43/d4d/c95 0 2024-02-28T16:01:56.455 INFO:tasks.workunit.client.1.smithi087.stdout:1/454: stat d0/d14/d48/c62 0 2024-02-28T16:01:56.456 INFO:tasks.workunit.client.1.smithi087.stdout:9/459: mknod d7/d1e/d60/d64/c7e 0 2024-02-28T16:01:56.456 INFO:tasks.workunit.client.0.smithi057.stdout:1/233: mkdir d1/d21/d25/d26/d53 0 2024-02-28T16:01:56.457 INFO:tasks.workunit.client.1.smithi087.stdout:9/460: readlink d7/l7c 0 2024-02-28T16:01:56.459 INFO:tasks.workunit.client.0.smithi057.stdout:1/234: truncate d1/d21/d25/f33 501435 0 2024-02-28T16:01:56.461 INFO:tasks.workunit.client.0.smithi057.stdout:1/235: write d1/f34 [755388,73953] 0 2024-02-28T16:01:56.464 INFO:tasks.workunit.client.0.smithi057.stdout:1/236: mknod d1/d21/c54 0 2024-02-28T16:01:56.466 INFO:tasks.workunit.client.1.smithi087.stdout:5/541: mkdir d3/d9/d9b/dba/dca 0 2024-02-28T16:01:56.466 INFO:tasks.workunit.client.1.smithi087.stdout:8/498: unlink d2/d33/c90 0 2024-02-28T16:01:56.467 INFO:tasks.workunit.client.0.smithi057.stdout:1/237: getdents d1/d21/d25/d26/d44/d4c 0 2024-02-28T16:01:56.468 INFO:tasks.workunit.client.1.smithi087.stdout:5/542: dread - d3/d9/d9b/f9c zero size 2024-02-28T16:01:56.469 INFO:tasks.workunit.client.0.smithi057.stdout:1/238: readlink d1/d21/d25/d26/l2b 0 2024-02-28T16:01:56.470 INFO:tasks.workunit.client.0.smithi057.stdout:1/239: read d1/d21/d25/d26/f2f [916854,80432] 0 2024-02-28T16:01:56.471 INFO:tasks.workunit.client.1.smithi087.stdout:9/461: creat d7/dd/d15/d79/f7f x:0 0 0 2024-02-28T16:01:56.472 INFO:tasks.workunit.client.1.smithi087.stdout:8/499: symlink d2/d9/la7 0 2024-02-28T16:01:56.474 INFO:tasks.workunit.client.1.smithi087.stdout:7/443: truncate d14/d2e/d2b/d4e/f52 104006 0 2024-02-28T16:01:56.474 INFO:tasks.workunit.client.1.smithi087.stdout:1/455: dwrite d0/d1a/f2e [8388608,4194304] 0 2024-02-28T16:01:56.476 INFO:tasks.workunit.client.0.smithi057.stdout:1/240: mknod d1/d3/dc/c55 0 2024-02-28T16:01:56.476 INFO:tasks.workunit.client.1.smithi087.stdout:5/543: write d3/d9/d9b/dba/d30/d53/d5b/fc7 [908984,85098] 0 2024-02-28T16:01:56.478 INFO:tasks.workunit.client.1.smithi087.stdout:7/444: write d14/f2a [2947422,41260] 0 2024-02-28T16:01:56.481 INFO:tasks.workunit.client.0.smithi057.stdout:1/241: creat d1/d3/dc/f56 x:0 0 0 2024-02-28T16:01:56.482 INFO:tasks.workunit.client.1.smithi087.stdout:5/544: write d3/d9/f1e [840763,30376] 0 2024-02-28T16:01:56.483 INFO:tasks.workunit.client.1.smithi087.stdout:1/456: rename d0/d14/d3f/d61 to d0/d1b/d1f/d96 0 2024-02-28T16:01:56.485 INFO:tasks.workunit.client.1.smithi087.stdout:7/445: rmdir d14/d2e/d2b 39 2024-02-28T16:01:56.486 INFO:tasks.workunit.client.1.smithi087.stdout:2/470: dread d2/d42/d4b/f52 [0,4194304] 0 2024-02-28T16:01:56.487 INFO:tasks.workunit.client.1.smithi087.stdout:7/446: read d14/d21/f47 [1429091,3799] 0 2024-02-28T16:01:56.487 INFO:tasks.workunit.client.1.smithi087.stdout:9/462: link d7/d1e/d60/d64/f74 d7/d1e/d60/d64/f80 0 2024-02-28T16:01:56.488 INFO:tasks.workunit.client.0.smithi057.stdout:1/242: mkdir d1/d3/dc/d15/d4e/d57 0 2024-02-28T16:01:56.489 INFO:tasks.workunit.client.1.smithi087.stdout:8/500: truncate d2/d18/d25/f21 2064426 0 2024-02-28T16:01:56.493 INFO:tasks.workunit.client.1.smithi087.stdout:0/465: sync 2024-02-28T16:01:56.494 INFO:tasks.workunit.client.1.smithi087.stdout:0/466: fdatasync d4/dd/f1b 0 2024-02-28T16:01:56.495 INFO:tasks.workunit.client.1.smithi087.stdout:0/467: stat d4/d6/f12 0 2024-02-28T16:01:56.495 INFO:tasks.workunit.client.1.smithi087.stdout:2/471: symlink d2/d7/d17/d3d/d81/lae 0 2024-02-28T16:01:56.499 INFO:tasks.workunit.client.1.smithi087.stdout:5/545: creat d3/d9/d9b/dba/dca/fcb x:0 0 0 2024-02-28T16:01:56.499 INFO:tasks.workunit.client.1.smithi087.stdout:1/457: mknod d0/d1d/c97 0 2024-02-28T16:01:56.501 INFO:tasks.workunit.client.1.smithi087.stdout:2/472: write d2/d7/d17/d34/f51 [2832852,55514] 0 2024-02-28T16:01:56.503 INFO:tasks.workunit.client.1.smithi087.stdout:0/468: dread d4/dd/d21/d52/f6e [0,4194304] 0 2024-02-28T16:01:56.503 INFO:tasks.workunit.client.1.smithi087.stdout:2/473: dread - d2/d99/fa9 zero size 2024-02-28T16:01:56.505 INFO:tasks.workunit.client.1.smithi087.stdout:7/447: mkdir d14/d46/d80 0 2024-02-28T16:01:56.505 INFO:tasks.workunit.client.1.smithi087.stdout:5/546: truncate d3/d9/d9b/dba/f70 195688 0 2024-02-28T16:01:56.505 INFO:tasks.workunit.client.0.smithi057.stdout:1/243: write d1/d3/f3b [986359,90308] 0 2024-02-28T16:01:56.507 INFO:tasks.workunit.client.1.smithi087.stdout:7/448: write d14/d21/f26 [472176,80202] 0 2024-02-28T16:01:56.509 INFO:tasks.workunit.client.1.smithi087.stdout:8/501: getdents d2/d9/d1a/da5 0 2024-02-28T16:01:56.510 INFO:tasks.workunit.client.1.smithi087.stdout:7/449: write d14/d46/d68/f7a [4932287,95832] 0 2024-02-28T16:01:56.512 INFO:tasks.workunit.client.0.smithi057.stdout:1/244: unlink d1/d3/dc/d40/l46 0 2024-02-28T16:01:56.516 INFO:tasks.workunit.client.1.smithi087.stdout:2/474: mkdir d2/d7/d17/d34/daf 0 2024-02-28T16:01:56.518 INFO:tasks.workunit.client.1.smithi087.stdout:0/469: unlink d4/d6/f2a 0 2024-02-28T16:01:56.520 INFO:tasks.workunit.client.1.smithi087.stdout:0/470: dread - d4/dd/d21/f71 zero size 2024-02-28T16:01:56.521 INFO:tasks.workunit.client.1.smithi087.stdout:9/463: link d7/dd/d15/d79/d2e/c33 d7/d1e/d44/d76/c81 0 2024-02-28T16:01:56.525 INFO:tasks.workunit.client.1.smithi087.stdout:0/471: chown d4/dd/d37/c83 450 1 2024-02-28T16:01:56.526 INFO:tasks.workunit.client.1.smithi087.stdout:5/547: fsync d3/d9/d9b/dba/f2e 0 2024-02-28T16:01:56.529 INFO:tasks.workunit.client.1.smithi087.stdout:8/502: dwrite d2/d9/d8e/f98 [0,4194304] 0 2024-02-28T16:01:56.530 INFO:tasks.workunit.client.1.smithi087.stdout:0/472: fdatasync d4/dd/d37/d39/d3a/d57/d74/d1f/d60/f8c 0 2024-02-28T16:01:56.531 INFO:tasks.workunit.client.1.smithi087.stdout:2/475: symlink d2/lb0 0 2024-02-28T16:01:56.533 INFO:tasks.workunit.client.1.smithi087.stdout:8/503: write d2/d9/d1a/f46 [73156,108260] 0 2024-02-28T16:01:56.535 INFO:tasks.workunit.client.1.smithi087.stdout:5/548: fsync d3/f1c 0 2024-02-28T16:01:56.536 INFO:tasks.workunit.client.1.smithi087.stdout:9/464: creat d7/d1e/d60/d69/f82 x:0 0 0 2024-02-28T16:01:56.540 INFO:tasks.workunit.client.1.smithi087.stdout:0/473: rename d4/d6/d3e to d4/dd/d21/d9b 0 2024-02-28T16:01:56.543 INFO:tasks.workunit.client.1.smithi087.stdout:9/465: mkdir d7/d1e/d44/d83 0 2024-02-28T16:01:56.543 INFO:tasks.workunit.client.1.smithi087.stdout:8/504: getdents d2/d63/d9b 0 2024-02-28T16:01:56.545 INFO:tasks.workunit.client.1.smithi087.stdout:5/549: truncate d3/d9/d9b/dba/d30/d53/d5b/fbf 59641 0 2024-02-28T16:01:56.546 INFO:tasks.workunit.client.1.smithi087.stdout:1/458: dread d0/d14/f25 [0,4194304] 0 2024-02-28T16:01:56.546 INFO:tasks.workunit.client.1.smithi087.stdout:2/476: link d2/d42/d4b/c68 d2/d99/d28/d79/da3/cb1 0 2024-02-28T16:01:56.548 INFO:tasks.workunit.client.1.smithi087.stdout:9/466: readlink d7/dd/d15/d79/d2e/l5e 0 2024-02-28T16:01:56.550 INFO:tasks.workunit.client.1.smithi087.stdout:0/474: dread d4/dd/d37/d39/d3a/d57/d74/f85 [0,4194304] 0 2024-02-28T16:01:56.551 INFO:tasks.workunit.client.1.smithi087.stdout:7/450: truncate d14/f18 1082028 0 2024-02-28T16:01:56.553 INFO:tasks.workunit.client.1.smithi087.stdout:1/459: write d0/d1d/d24/d78/f91 [985756,79350] 0 2024-02-28T16:01:56.554 INFO:tasks.workunit.client.1.smithi087.stdout:9/467: symlink d7/d1e/d44/d76/l84 0 2024-02-28T16:01:56.556 INFO:tasks.workunit.client.1.smithi087.stdout:1/460: chown d0/d14/d3f/c84 2 1 2024-02-28T16:01:56.557 INFO:tasks.workunit.client.1.smithi087.stdout:1/461: stat d0/d1b 0 2024-02-28T16:01:56.560 INFO:tasks.workunit.client.1.smithi087.stdout:2/477: creat d2/d99/d28/d54/da6/fb2 x:0 0 0 2024-02-28T16:01:56.561 INFO:tasks.workunit.client.1.smithi087.stdout:8/505: dread d2/d9/d10/d24/d53/d6f/f7a [0,4194304] 0 2024-02-28T16:01:56.562 INFO:tasks.workunit.client.1.smithi087.stdout:0/475: mkdir d4/d6/d9c 0 2024-02-28T16:01:56.566 INFO:tasks.workunit.client.1.smithi087.stdout:7/451: creat d14/d46/f81 x:0 0 0 2024-02-28T16:01:56.568 INFO:tasks.workunit.client.1.smithi087.stdout:1/462: creat d0/d1b/d1f/d96/d63/f98 x:0 0 0 2024-02-28T16:01:56.569 INFO:tasks.workunit.client.1.smithi087.stdout:2/478: creat d2/d99/fb3 x:0 0 0 2024-02-28T16:01:56.572 INFO:tasks.workunit.client.1.smithi087.stdout:5/550: truncate d3/d9/f79 1703020 0 2024-02-28T16:01:56.575 INFO:tasks.workunit.client.1.smithi087.stdout:1/463: mknod d0/d1a/c99 0 2024-02-28T16:01:56.577 INFO:tasks.workunit.client.1.smithi087.stdout:1/464: chown d0/d1a/d28/f6b 71769843 1 2024-02-28T16:01:56.579 INFO:tasks.workunit.client.1.smithi087.stdout:9/468: write d7/dd/d15/d79/f16 [340744,64367] 0 2024-02-28T16:01:56.582 INFO:tasks.workunit.client.1.smithi087.stdout:5/551: creat d3/d9/d9b/dba/d30/d36/d4f/d82/fcc x:0 0 0 2024-02-28T16:01:56.584 INFO:tasks.workunit.client.1.smithi087.stdout:2/479: rmdir d2/d7d/d94 0 2024-02-28T16:01:56.585 INFO:tasks.workunit.client.1.smithi087.stdout:9/469: dread - d7/dd/d15/f7a zero size 2024-02-28T16:01:56.585 INFO:tasks.workunit.client.1.smithi087.stdout:8/506: dwrite d2/d18/d42/f84 [0,4194304] 0 2024-02-28T16:01:56.587 INFO:tasks.workunit.client.1.smithi087.stdout:6/512: sync 2024-02-28T16:01:56.587 INFO:tasks.workunit.client.1.smithi087.stdout:4/531: sync 2024-02-28T16:01:56.588 INFO:tasks.workunit.client.1.smithi087.stdout:3/450: sync 2024-02-28T16:01:56.592 INFO:tasks.workunit.client.1.smithi087.stdout:7/452: dwrite d14/d21/f41 [0,4194304] 0 2024-02-28T16:01:56.593 INFO:tasks.workunit.client.1.smithi087.stdout:3/451: write d11/f36 [692445,93258] 0 2024-02-28T16:01:56.596 INFO:tasks.workunit.client.1.smithi087.stdout:6/513: truncate d4/dc/d7e/f9c 423271 0 2024-02-28T16:01:56.599 INFO:tasks.workunit.client.1.smithi087.stdout:9/470: truncate d7/d1e/d44/f62 169080 0 2024-02-28T16:01:56.600 INFO:tasks.workunit.client.1.smithi087.stdout:9/471: readlink d7/dc/l4d 0 2024-02-28T16:01:56.602 INFO:tasks.workunit.client.1.smithi087.stdout:0/476: truncate d4/dd/d21/d32/f7a 2795927 0 2024-02-28T16:01:56.604 INFO:tasks.workunit.client.1.smithi087.stdout:8/507: fsync d2/d33/f3e 0 2024-02-28T16:01:56.605 INFO:tasks.workunit.client.1.smithi087.stdout:2/480: write d2/d99/f5d [6074003,2305] 0 2024-02-28T16:01:56.620 INFO:tasks.workunit.client.1.smithi087.stdout:6/514: fdatasync d4/d30/d83/fa9 0 2024-02-28T16:01:56.623 INFO:tasks.workunit.client.1.smithi087.stdout:7/453: creat d14/d46/d80/f82 x:0 0 0 2024-02-28T16:01:56.623 INFO:tasks.workunit.client.1.smithi087.stdout:0/477: read d4/dd/d21/f81 [1526460,117577] 0 2024-02-28T16:01:56.624 INFO:tasks.workunit.client.1.smithi087.stdout:2/481: mkdir d2/d7d/db4 0 2024-02-28T16:01:56.625 INFO:tasks.workunit.client.1.smithi087.stdout:8/508: symlink d2/d9/d5e/d9c/d9f/la8 0 2024-02-28T16:01:56.626 INFO:tasks.workunit.client.1.smithi087.stdout:5/552: link d3/d9/d9b/dba/d30/d36/l42 d3/d9/d9b/dba/d30/d44/db9/lcd 0 2024-02-28T16:01:56.628 INFO:tasks.workunit.client.1.smithi087.stdout:2/482: readlink d2/d7/l3b 0 2024-02-28T16:01:56.630 INFO:tasks.workunit.client.1.smithi087.stdout:3/452: dwrite d11/f17 [0,4194304] 0 2024-02-28T16:01:56.631 INFO:tasks.workunit.client.1.smithi087.stdout:1/465: dread d0/d1a/d28/f65 [0,4194304] 0 2024-02-28T16:01:56.634 INFO:tasks.workunit.client.1.smithi087.stdout:3/453: write d11/d44/f5e [5057699,90424] 0 2024-02-28T16:01:56.634 INFO:tasks.workunit.client.1.smithi087.stdout:6/515: rmdir d4/dc/d7e/da4 39 2024-02-28T16:01:56.634 INFO:tasks.workunit.client.1.smithi087.stdout:7/454: unlink d14/d46/d68/c6b 0 2024-02-28T16:01:56.635 INFO:tasks.workunit.client.1.smithi087.stdout:0/478: mknod d4/d1c/c9d 0 2024-02-28T16:01:56.637 INFO:tasks.workunit.client.1.smithi087.stdout:9/472: creat d7/dc/f85 x:0 0 0 2024-02-28T16:01:56.639 INFO:tasks.workunit.client.1.smithi087.stdout:0/479: stat d4/dd/d37/d39/d3a 0 2024-02-28T16:01:56.640 INFO:tasks.workunit.client.1.smithi087.stdout:2/483: mknod d2/d7/d17/d97/cb5 0 2024-02-28T16:01:56.643 INFO:tasks.workunit.client.1.smithi087.stdout:9/473: chown d7/dd/d15/d79/d2e/f34 4816960 1 2024-02-28T16:01:56.643 INFO:tasks.workunit.client.1.smithi087.stdout:6/516: dread d4/d12/d45/d57/f6a [0,4194304] 0 2024-02-28T16:01:56.643 INFO:tasks.workunit.client.1.smithi087.stdout:1/466: unlink d0/f7a 0 2024-02-28T16:01:56.647 INFO:tasks.workunit.client.1.smithi087.stdout:9/474: chown d7/dd/d36/f4f 3 1 2024-02-28T16:01:56.651 INFO:tasks.workunit.client.1.smithi087.stdout:2/484: symlink d2/d7/d17/d97/lb6 0 2024-02-28T16:01:56.654 INFO:tasks.workunit.client.1.smithi087.stdout:8/509: creat d2/fa9 x:0 0 0 2024-02-28T16:01:56.654 INFO:tasks.workunit.client.1.smithi087.stdout:5/553: dwrite d3/d9/fc6 [0,4194304] 0 2024-02-28T16:01:56.654 INFO:tasks.workunit.client.1.smithi087.stdout:7/455: rename d14/d46/d68 to d14/d27/d5d/d6a/d83 0 2024-02-28T16:01:56.660 INFO:tasks.workunit.client.1.smithi087.stdout:6/517: creat d4/d30/d13/d38/d69/fad x:0 0 0 2024-02-28T16:01:56.662 INFO:tasks.workunit.client.1.smithi087.stdout:5/554: chown d3/d9/d9b/dba/d30/d36/d4f/d82 1426983321 1 2024-02-28T16:01:56.662 INFO:tasks.workunit.client.1.smithi087.stdout:9/475: symlink d7/dd/d15/d79/d2e/l86 0 2024-02-28T16:01:56.665 INFO:tasks.workunit.client.1.smithi087.stdout:1/467: dwrite d0/d1a/d28/f7f [0,4194304] 0 2024-02-28T16:01:56.665 INFO:tasks.workunit.client.1.smithi087.stdout:2/485: unlink d2/d99/c36 0 2024-02-28T16:01:56.669 INFO:tasks.workunit.client.1.smithi087.stdout:2/486: fdatasync d2/d99/d28/d79/f93 0 2024-02-28T16:01:56.670 INFO:tasks.workunit.client.1.smithi087.stdout:6/518: fsync d4/d12/f21 0 2024-02-28T16:01:56.673 INFO:tasks.workunit.client.1.smithi087.stdout:2/487: chown d2/d99/f39 2558851 1 2024-02-28T16:01:56.673 INFO:tasks.workunit.client.1.smithi087.stdout:9/476: fdatasync d7/dd/d15/d55/f6c 0 2024-02-28T16:01:56.675 INFO:tasks.workunit.client.1.smithi087.stdout:0/480: creat d4/dd/f9e x:0 0 0 2024-02-28T16:01:56.675 INFO:tasks.workunit.client.1.smithi087.stdout:7/456: creat d14/d46/d7c/f84 x:0 0 0 2024-02-28T16:01:56.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:56 smithi057 ceph-mon[28763]: pgmap v30: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 21 MiB/s rd, 147 MiB/s wr, 264 op/s 2024-02-28T16:01:56.677 INFO:tasks.workunit.client.1.smithi087.stdout:5/555: mknod d3/d9/d9b/dba/d30/cce 0 2024-02-28T16:01:56.680 INFO:tasks.workunit.client.1.smithi087.stdout:3/454: dread fa [4194304,4194304] 0 2024-02-28T16:01:56.682 INFO:tasks.workunit.client.1.smithi087.stdout:8/510: dwrite d2/d9/d10/d24/f5a [0,4194304] 0 2024-02-28T16:01:56.687 INFO:tasks.workunit.client.1.smithi087.stdout:5/556: creat d3/d64/d81/fcf x:0 0 0 2024-02-28T16:01:56.693 INFO:tasks.workunit.client.1.smithi087.stdout:6/519: getdents d4/d30/d13/d38/d69 0 2024-02-28T16:01:56.696 INFO:tasks.workunit.client.1.smithi087.stdout:7/457: rename d14/d2e/d2b/c48 to d14/d46/d80/c85 0 2024-02-28T16:01:56.696 INFO:tasks.workunit.client.1.smithi087.stdout:8/511: creat d2/d9/d1a/da5/faa x:0 0 0 2024-02-28T16:01:56.699 INFO:tasks.workunit.client.1.smithi087.stdout:6/520: write d4/dc/f8e [1088326,39599] 0 2024-02-28T16:01:56.701 INFO:tasks.workunit.client.1.smithi087.stdout:3/455: rename d11/d33/f3d to d11/d33/f9e 0 2024-02-28T16:01:56.706 INFO:tasks.workunit.client.1.smithi087.stdout:5/557: dread d3/d9/d9b/dba/d69/f92 [0,4194304] 0 2024-02-28T16:01:56.707 INFO:tasks.workunit.client.1.smithi087.stdout:8/512: chown d2/d18/d25/l77 5 1 2024-02-28T16:01:56.707 INFO:tasks.workunit.client.1.smithi087.stdout:2/488: dwrite d2/d99/fb3 [0,4194304] 0 2024-02-28T16:01:56.708 INFO:tasks.workunit.client.1.smithi087.stdout:3/456: stat d11/d61/f6a 0 2024-02-28T16:01:56.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:56 smithi087 ceph-mon[37122]: pgmap v30: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 21 MiB/s rd, 147 MiB/s wr, 264 op/s 2024-02-28T16:01:56.716 INFO:tasks.workunit.client.1.smithi087.stdout:6/521: rmdir d4/dc/d61/d89 39 2024-02-28T16:01:56.717 INFO:tasks.workunit.client.1.smithi087.stdout:1/468: dread d0/d1b/d43/d4d/f51 [4194304,4194304] 0 2024-02-28T16:01:56.718 INFO:tasks.workunit.client.1.smithi087.stdout:3/457: chown c9 7609427 1 2024-02-28T16:01:56.724 INFO:tasks.workunit.client.1.smithi087.stdout:9/477: dwrite d7/dd/d15/d79/f4a [0,4194304] 0 2024-02-28T16:01:56.724 INFO:tasks.workunit.client.1.smithi087.stdout:3/458: fdatasync d11/f26 0 2024-02-28T16:01:56.725 INFO:tasks.workunit.client.1.smithi087.stdout:6/522: readlink d4/l7 0 2024-02-28T16:01:56.725 INFO:tasks.workunit.client.1.smithi087.stdout:2/489: rename d2/d7/d17/d34/c63 to d2/d7/d17/d3d/cb7 0 2024-02-28T16:01:56.728 INFO:tasks.workunit.client.1.smithi087.stdout:1/469: rmdir d0/d1d 39 2024-02-28T16:01:56.733 INFO:tasks.workunit.client.1.smithi087.stdout:5/558: rename d3/d9/d9b/dba/d30/d36/l42 to d3/d9/d9b/dba/d30/d36/ld0 0 2024-02-28T16:01:56.736 INFO:tasks.workunit.client.1.smithi087.stdout:3/459: read d11/d61/d7c/f84 [1471661,14808] 0 2024-02-28T16:01:56.740 INFO:tasks.workunit.client.1.smithi087.stdout:8/513: getdents d2/d9/d10/d24 0 2024-02-28T16:01:56.741 INFO:tasks.workunit.client.1.smithi087.stdout:9/478: creat d7/d1e/d60/f87 x:0 0 0 2024-02-28T16:01:56.745 INFO:tasks.workunit.client.1.smithi087.stdout:6/523: write d4/d30/d13/d38/fa1 [876573,88095] 0 2024-02-28T16:01:56.748 INFO:tasks.workunit.client.1.smithi087.stdout:1/470: mknod d0/d14/d3f/c9a 0 2024-02-28T16:01:56.748 INFO:tasks.workunit.client.1.smithi087.stdout:0/481: dwrite d4/dd/d21/d52/f6e [0,4194304] 0 2024-02-28T16:01:56.752 INFO:tasks.workunit.client.1.smithi087.stdout:2/490: dread d2/f87 [0,4194304] 0 2024-02-28T16:01:56.752 INFO:tasks.workunit.client.1.smithi087.stdout:1/471: write d0/d14/f93 [778923,85849] 0 2024-02-28T16:01:56.754 INFO:tasks.workunit.client.1.smithi087.stdout:4/532: sync 2024-02-28T16:01:56.755 INFO:tasks.workunit.client.1.smithi087.stdout:5/559: truncate d3/d9/d9b/dba/d30/d53/d5b/fb5 58583 0 2024-02-28T16:01:56.760 INFO:tasks.workunit.client.1.smithi087.stdout:7/458: dread d14/f2a [0,4194304] 0 2024-02-28T16:01:56.760 INFO:tasks.workunit.client.1.smithi087.stdout:0/482: dread - d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f8e zero size 2024-02-28T16:01:56.760 INFO:tasks.workunit.client.1.smithi087.stdout:8/514: mknod d2/d18/d42/d7b/cab 0 2024-02-28T16:01:56.761 INFO:tasks.workunit.client.1.smithi087.stdout:2/491: dread - d2/d99/d28/d54/da6/fb2 zero size 2024-02-28T16:01:56.764 INFO:tasks.workunit.client.1.smithi087.stdout:1/472: mkdir d0/d1a/d28/d9b 0 2024-02-28T16:01:56.765 INFO:tasks.workunit.client.1.smithi087.stdout:0/483: write d4/dd/f1b [1479256,102536] 0 2024-02-28T16:01:56.769 INFO:tasks.workunit.client.1.smithi087.stdout:9/479: creat d7/f88 x:0 0 0 2024-02-28T16:01:56.773 INFO:tasks.workunit.client.1.smithi087.stdout:8/515: write d2/d63/f97 [2483071,62130] 0 2024-02-28T16:01:56.784 INFO:tasks.workunit.client.1.smithi087.stdout:9/480: mkdir d7/dd/d36/d89 0 2024-02-28T16:01:56.785 INFO:tasks.workunit.client.1.smithi087.stdout:6/524: dwrite d4/dc/d61/f66 [4194304,4194304] 0 2024-02-28T16:01:56.786 INFO:tasks.workunit.client.1.smithi087.stdout:8/516: mknod d2/d7c/cac 0 2024-02-28T16:01:56.788 INFO:tasks.workunit.client.1.smithi087.stdout:7/459: truncate d14/d21/f61 398342 0 2024-02-28T16:01:56.789 INFO:tasks.workunit.client.1.smithi087.stdout:6/525: readlink d4/d12/d45/l34 0 2024-02-28T16:01:56.789 INFO:tasks.workunit.client.1.smithi087.stdout:3/460: dwrite d11/d33/d58/d8c/f90 [0,4194304] 0 2024-02-28T16:01:56.791 INFO:tasks.workunit.client.1.smithi087.stdout:1/473: rename d0/d1b/d43/f64 to d0/d1d/d24/d78/f9c 0 2024-02-28T16:01:56.797 INFO:tasks.workunit.client.1.smithi087.stdout:0/484: creat d4/d6/f9f x:0 0 0 2024-02-28T16:01:56.804 INFO:tasks.workunit.client.1.smithi087.stdout:4/533: dwrite d2/df/d2e/f9a [0,4194304] 0 2024-02-28T16:01:56.804 INFO:tasks.workunit.client.1.smithi087.stdout:8/517: creat d2/da2/fad x:0 0 0 2024-02-28T16:01:56.806 INFO:tasks.workunit.client.1.smithi087.stdout:1/474: mknod d0/d14/d86/c9d 0 2024-02-28T16:01:56.807 INFO:tasks.workunit.client.1.smithi087.stdout:6/526: symlink d4/d30/d13/d38/d69/d99/lae 0 2024-02-28T16:01:56.807 INFO:tasks.workunit.client.1.smithi087.stdout:5/560: dwrite d3/d9/d9b/dba/d30/d44/d54/f8c [0,4194304] 0 2024-02-28T16:01:56.809 INFO:tasks.workunit.client.1.smithi087.stdout:3/461: creat d11/d33/d67/d9c/f9f x:0 0 0 2024-02-28T16:01:56.810 INFO:tasks.workunit.client.1.smithi087.stdout:2/492: dwrite d2/d7/d17/d34/f51 [0,4194304] 0 2024-02-28T16:01:56.813 INFO:tasks.workunit.client.1.smithi087.stdout:3/462: write d11/d7b/f97 [535358,70679] 0 2024-02-28T16:01:56.818 INFO:tasks.workunit.client.1.smithi087.stdout:7/460: symlink d14/d46/l86 0 2024-02-28T16:01:56.822 INFO:tasks.workunit.client.1.smithi087.stdout:1/475: unlink d0/d14/c6a 0 2024-02-28T16:01:56.831 INFO:tasks.workunit.client.1.smithi087.stdout:6/527: mkdir d4/d30/d13/d67/daf 0 2024-02-28T16:01:56.833 INFO:tasks.workunit.client.1.smithi087.stdout:5/561: mknod d3/d9/d9b/dba/d30/d8f/dac/cd1 0 2024-02-28T16:01:56.834 INFO:tasks.workunit.client.1.smithi087.stdout:9/481: getdents d7/dd/d15/d3f/d5f 0 2024-02-28T16:01:56.835 INFO:tasks.workunit.client.1.smithi087.stdout:4/534: dwrite d2/df/d2e/f9a [0,4194304] 0 2024-02-28T16:01:56.840 INFO:tasks.workunit.client.1.smithi087.stdout:5/562: fdatasync d3/d9/d4a/d5e/fc9 0 2024-02-28T16:01:56.840 INFO:tasks.workunit.client.1.smithi087.stdout:7/461: unlink d14/d21/f26 0 2024-02-28T16:01:56.842 INFO:tasks.workunit.client.1.smithi087.stdout:8/518: mkdir d2/d63/d9b/dae 0 2024-02-28T16:01:56.843 INFO:tasks.workunit.client.1.smithi087.stdout:2/493: link d2/d99/f13 d2/d7/d17/d3d/fb8 0 2024-02-28T16:01:56.844 INFO:tasks.workunit.client.1.smithi087.stdout:6/528: fsync d4/d12/f16 0 2024-02-28T16:01:56.846 INFO:tasks.workunit.client.1.smithi087.stdout:4/535: unlink d2/f32 0 2024-02-28T16:01:56.846 INFO:tasks.workunit.client.1.smithi087.stdout:1/476: mknod d0/d1b/c9e 0 2024-02-28T16:01:56.850 INFO:tasks.workunit.client.1.smithi087.stdout:5/563: read d3/d9/d9b/dba/d30/f32 [3521471,114833] 0 2024-02-28T16:01:56.851 INFO:tasks.workunit.client.1.smithi087.stdout:3/463: creat d11/d33/fa0 x:0 0 0 2024-02-28T16:01:56.854 INFO:tasks.workunit.client.1.smithi087.stdout:3/464: read d11/f1b [3356094,106758] 0 2024-02-28T16:01:56.854 INFO:tasks.workunit.client.0.smithi057.stdout:6/118: sync 2024-02-28T16:01:56.855 INFO:tasks.workunit.client.0.smithi057.stdout:4/153: sync 2024-02-28T16:01:56.855 INFO:tasks.workunit.client.0.smithi057.stdout:3/99: sync 2024-02-28T16:01:56.855 INFO:tasks.workunit.client.1.smithi087.stdout:8/519: creat d2/d9/d8e/faf x:0 0 0 2024-02-28T16:01:56.856 INFO:tasks.workunit.client.0.smithi057.stdout:3/100: stat c2 0 2024-02-28T16:01:56.857 INFO:tasks.workunit.client.1.smithi087.stdout:3/465: dread - d11/d3a/d3c/f40 zero size 2024-02-28T16:01:56.858 INFO:tasks.workunit.client.1.smithi087.stdout:1/477: creat d0/d1a/d28/f9f x:0 0 0 2024-02-28T16:01:56.859 INFO:tasks.workunit.client.0.smithi057.stdout:6/119: mknod df/d10/c27 0 2024-02-28T16:01:56.860 INFO:tasks.workunit.client.1.smithi087.stdout:3/466: truncate d11/d61/f6a 76887 0 2024-02-28T16:01:56.860 INFO:tasks.workunit.client.1.smithi087.stdout:2/494: creat d2/d99/d28/d54/da6/fb9 x:0 0 0 2024-02-28T16:01:56.860 INFO:tasks.workunit.client.1.smithi087.stdout:3/467: chown d11/d3a 37 1 2024-02-28T16:01:56.862 INFO:tasks.workunit.client.0.smithi057.stdout:6/120: chown ld 2979410 1 2024-02-28T16:01:56.863 INFO:tasks.workunit.client.1.smithi087.stdout:2/495: read d2/d42/f76 [3909139,47257] 0 2024-02-28T16:01:56.863 INFO:tasks.workunit.client.1.smithi087.stdout:1/478: read d0/d14/f42 [2800890,24882] 0 2024-02-28T16:01:56.867 INFO:tasks.workunit.client.1.smithi087.stdout:1/479: chown d0/fa 712429 1 2024-02-28T16:01:56.867 INFO:tasks.workunit.client.1.smithi087.stdout:5/564: creat d3/d64/d67/fd2 x:0 0 0 2024-02-28T16:01:56.869 INFO:tasks.workunit.client.0.smithi057.stdout:6/121: dread df/d10/d13/f1e [0,4194304] 0 2024-02-28T16:01:56.872 INFO:tasks.workunit.client.0.smithi057.stdout:4/154: write d1/d1f/f2f [369925,48395] 0 2024-02-28T16:01:56.872 INFO:tasks.workunit.client.1.smithi087.stdout:7/462: creat d14/d2e/f87 x:0 0 0 2024-02-28T16:01:56.873 INFO:tasks.workunit.client.0.smithi057.stdout:6/122: write df/d14/d15/f25 [870011,96272] 0 2024-02-28T16:01:56.876 INFO:tasks.workunit.client.1.smithi087.stdout:5/565: dread d3/d64/d67/fa6 [0,4194304] 0 2024-02-28T16:01:56.877 INFO:tasks.workunit.client.0.smithi057.stdout:4/155: mknod d1/d1f/c3c 0 2024-02-28T16:01:56.877 INFO:tasks.workunit.client.1.smithi087.stdout:7/463: fsync d14/d2e/d2b/d4e/f56 0 2024-02-28T16:01:56.880 INFO:tasks.workunit.client.0.smithi057.stdout:4/156: read - d1/d10/d12/d15/f2e zero size 2024-02-28T16:01:56.881 INFO:tasks.workunit.client.0.smithi057.stdout:4/157: read - d1/d10/f27 zero size 2024-02-28T16:01:56.881 INFO:tasks.workunit.client.1.smithi087.stdout:6/529: dread d4/d12/d45/d92/f94 [0,4194304] 0 2024-02-28T16:01:56.881 INFO:tasks.workunit.client.1.smithi087.stdout:3/468: rename d11/d45/d73/d7a to d11/d33/d67/d9c/da1 0 2024-02-28T16:01:56.883 INFO:tasks.workunit.client.1.smithi087.stdout:3/469: readlink d11/d45/l83 0 2024-02-28T16:01:56.883 INFO:tasks.workunit.client.0.smithi057.stdout:4/158: write d1/d14/f23 [1067354,2627] 0 2024-02-28T16:01:56.886 INFO:tasks.workunit.client.1.smithi087.stdout:6/530: write d4/d12/f6d [5718286,122720] 0 2024-02-28T16:01:56.888 INFO:tasks.workunit.client.0.smithi057.stdout:4/159: mknod d1/d10/d12/d39/c3d 0 2024-02-28T16:01:56.889 INFO:tasks.workunit.client.0.smithi057.stdout:3/101: dread d8/dd/d14/f1b [0,4194304] 0 2024-02-28T16:01:56.893 INFO:tasks.workunit.client.1.smithi087.stdout:5/566: rename d3/d64/d81/f78 to d3/d64/fd3 0 2024-02-28T16:01:56.894 INFO:tasks.workunit.client.0.smithi057.stdout:4/160: getdents d1/d22 0 2024-02-28T16:01:56.895 INFO:tasks.workunit.client.1.smithi087.stdout:4/536: getdents d2/d9/d10/d11 0 2024-02-28T16:01:56.896 INFO:tasks.workunit.client.1.smithi087.stdout:5/567: chown d3/d64/cb4 1041925 1 2024-02-28T16:01:56.896 INFO:tasks.workunit.client.1.smithi087.stdout:3/470: write d11/f1b [3964445,16146] 0 2024-02-28T16:01:56.897 INFO:tasks.workunit.client.1.smithi087.stdout:7/464: mknod d14/d7d/c88 0 2024-02-28T16:01:56.897 INFO:tasks.workunit.client.1.smithi087.stdout:2/496: dwrite d2/d7/d17/f33 [0,4194304] 0 2024-02-28T16:01:56.898 INFO:tasks.workunit.client.1.smithi087.stdout:8/520: link d2/d33/c86 d2/d9/d5e/d9c/d9f/cb0 0 2024-02-28T16:01:56.901 INFO:tasks.workunit.client.1.smithi087.stdout:7/465: stat d14/d2e/f22 0 2024-02-28T16:01:56.905 INFO:tasks.workunit.client.1.smithi087.stdout:1/480: dwrite d0/d1a/f73 [0,4194304] 0 2024-02-28T16:01:56.907 INFO:tasks.workunit.client.1.smithi087.stdout:3/471: write d11/d45/d73/f99 [733667,39417] 0 2024-02-28T16:01:56.908 INFO:tasks.workunit.client.1.smithi087.stdout:5/568: write d3/d9/d9b/dba/d30/d44/f9e [909172,55802] 0 2024-02-28T16:01:56.911 INFO:tasks.workunit.client.0.smithi057.stdout:3/102: dread d8/dd/d14/f1b [0,4194304] 0 2024-02-28T16:01:56.911 INFO:tasks.workunit.client.1.smithi087.stdout:6/531: dread d4/dc/d10/f6e [0,4194304] 0 2024-02-28T16:01:56.912 INFO:tasks.workunit.client.1.smithi087.stdout:1/481: dread - d0/d14/d86/f89 zero size 2024-02-28T16:01:56.914 INFO:tasks.workunit.client.1.smithi087.stdout:1/482: chown d0/d1a/d28 131 1 2024-02-28T16:01:56.915 INFO:tasks.workunit.client.1.smithi087.stdout:6/532: readlink d4/d12/d45/l34 0 2024-02-28T16:01:56.917 INFO:tasks.workunit.client.1.smithi087.stdout:6/533: chown d4/d30/d13/d38/fa1 5393 1 2024-02-28T16:01:56.921 INFO:tasks.workunit.client.1.smithi087.stdout:1/483: stat d0/d1a/f73 0 2024-02-28T16:01:56.923 INFO:tasks.workunit.client.1.smithi087.stdout:3/472: stat d11/d44/d5b/f52 0 2024-02-28T16:01:56.924 INFO:tasks.workunit.client.1.smithi087.stdout:8/521: mkdir d2/d63/d9b/dae/db1 0 2024-02-28T16:01:56.927 INFO:tasks.workunit.client.0.smithi057.stdout:6/123: dread fc [0,4194304] 0 2024-02-28T16:01:56.928 INFO:tasks.workunit.client.1.smithi087.stdout:5/569: creat d3/d9/d9b/dba/d30/d53/fd4 x:0 0 0 2024-02-28T16:01:56.930 INFO:tasks.workunit.client.1.smithi087.stdout:4/537: link d2/d9/l50 d2/dc1/lc2 0 2024-02-28T16:01:56.930 INFO:tasks.workunit.client.0.smithi057.stdout:7/136: sync 2024-02-28T16:01:56.931 INFO:tasks.workunit.client.1.smithi087.stdout:4/538: chown d2/l7 114747 1 2024-02-28T16:01:56.931 INFO:tasks.workunit.client.1.smithi087.stdout:6/534: mkdir d4/d30/d13/d38/d69/db0 0 2024-02-28T16:01:56.933 INFO:tasks.workunit.client.1.smithi087.stdout:4/539: read - d2/fb7 zero size 2024-02-28T16:01:56.936 INFO:tasks.workunit.client.1.smithi087.stdout:4/540: mknod d2/df/d2e/dad/cc3 0 2024-02-28T16:01:56.938 INFO:tasks.workunit.client.0.smithi057.stdout:3/103: dwrite d8/fa [0,4194304] 0 2024-02-28T16:01:56.938 INFO:tasks.workunit.client.1.smithi087.stdout:4/541: stat d2/d9/d10/d11/f94 0 2024-02-28T16:01:56.938 INFO:tasks.workunit.client.1.smithi087.stdout:1/484: mknod d0/d1b/ca0 0 2024-02-28T16:01:56.940 INFO:tasks.workunit.client.1.smithi087.stdout:2/497: write d2/d7/d17/d3d/d60/f67 [1173892,103052] 0 2024-02-28T16:01:56.940 INFO:tasks.workunit.client.0.smithi057.stdout:3/104: write d8/fa [184155,96693] 0 2024-02-28T16:01:56.943 INFO:tasks.workunit.client.1.smithi087.stdout:2/498: chown d2/d99/d28/d54/f91 3221 1 2024-02-28T16:01:56.943 INFO:tasks.workunit.client.0.smithi057.stdout:3/105: write d8/fa [2365699,123698] 0 2024-02-28T16:01:56.943 INFO:tasks.workunit.client.0.smithi057.stdout:4/161: dread d1/f6 [0,4194304] 0 2024-02-28T16:01:56.945 INFO:tasks.workunit.client.1.smithi087.stdout:8/522: dread d2/f30 [4194304,4194304] 0 2024-02-28T16:01:56.946 INFO:tasks.workunit.client.0.smithi057.stdout:4/162: write d1/f28 [334062,53189] 0 2024-02-28T16:01:56.950 INFO:tasks.workunit.client.0.smithi057.stdout:4/163: write d1/d10/d12/d15/d19/f2b [1014756,57281] 0 2024-02-28T16:01:56.952 INFO:tasks.workunit.client.1.smithi087.stdout:2/499: creat d2/d7/d17/d3d/d60/fba x:0 0 0 2024-02-28T16:01:56.952 INFO:tasks.workunit.client.1.smithi087.stdout:1/485: mkdir d0/d14/d86/da1 0 2024-02-28T16:01:56.953 INFO:tasks.workunit.client.1.smithi087.stdout:8/523: write d2/d18/d42/d7b/f95 [717402,52489] 0 2024-02-28T16:01:56.956 INFO:tasks.workunit.client.1.smithi087.stdout:4/542: creat d2/d9/d10/d22/d5b/d5c/d68/fc4 x:0 0 0 2024-02-28T16:01:56.956 INFO:tasks.workunit.client.0.smithi057.stdout:3/106: mkdir d8/dd/d19/d25 0 2024-02-28T16:01:56.957 INFO:tasks.workunit.client.0.smithi057.stdout:7/137: link d6/dc/d12/d1a/c1d d6/dc/c33 0 2024-02-28T16:01:56.959 INFO:tasks.workunit.client.0.smithi057.stdout:4/164: creat d1/d10/d12/d39/f3e x:0 0 0 2024-02-28T16:01:56.961 INFO:tasks.workunit.client.0.smithi057.stdout:7/138: dread - d6/f28 zero size 2024-02-28T16:01:56.961 INFO:tasks.workunit.client.1.smithi087.stdout:5/570: dwrite d3/d9/d4a/d5e/da1/fc3 [0,4194304] 0 2024-02-28T16:01:56.964 INFO:tasks.workunit.client.0.smithi057.stdout:7/139: chown d6/d26 13 1 2024-02-28T16:01:56.964 INFO:tasks.workunit.client.1.smithi087.stdout:7/466: dread d14/d21/f3e [0,4194304] 0 2024-02-28T16:01:56.964 INFO:tasks.workunit.client.1.smithi087.stdout:2/500: creat d2/d99/d28/d54/da6/fbb x:0 0 0 2024-02-28T16:01:56.964 INFO:tasks.workunit.client.1.smithi087.stdout:1/486: dread d0/d14/f18 [0,4194304] 0 2024-02-28T16:01:56.966 INFO:tasks.workunit.client.1.smithi087.stdout:3/473: dwrite d11/d61/f63 [0,4194304] 0 2024-02-28T16:01:56.966 INFO:tasks.workunit.client.0.smithi057.stdout:4/165: unlink d1/fe 0 2024-02-28T16:01:56.967 INFO:tasks.workunit.client.0.smithi057.stdout:6/124: dwrite df/d10/d13/f1e [0,4194304] 0 2024-02-28T16:01:56.968 INFO:tasks.workunit.client.1.smithi087.stdout:5/571: creat d3/d9/d4a/fd5 x:0 0 0 2024-02-28T16:01:56.970 INFO:tasks.workunit.client.1.smithi087.stdout:2/501: mknod d2/d42/cbc 0 2024-02-28T16:01:56.973 INFO:tasks.workunit.client.0.smithi057.stdout:6/125: symlink df/d10/d13/l28 0 2024-02-28T16:01:56.974 INFO:tasks.workunit.client.0.smithi057.stdout:7/140: creat d6/dc/f34 x:0 0 0 2024-02-28T16:01:56.977 INFO:tasks.workunit.client.0.smithi057.stdout:7/141: write d6/fb [100392,88922] 0 2024-02-28T16:01:56.978 INFO:tasks.workunit.client.1.smithi087.stdout:4/543: getdents d2/dc1 0 2024-02-28T16:01:56.979 INFO:tasks.workunit.client.1.smithi087.stdout:5/572: rename d3/d9/f9f to d3/d9/d9b/dba/dca/fd6 0 2024-02-28T16:01:56.979 INFO:tasks.workunit.client.0.smithi057.stdout:3/107: rmdir d8 39 2024-02-28T16:01:56.980 INFO:tasks.workunit.client.1.smithi087.stdout:4/544: stat d2/df/d62/l5a 0 2024-02-28T16:01:56.981 INFO:tasks.workunit.client.0.smithi057.stdout:7/142: write f4 [2126859,16066] 0 2024-02-28T16:01:56.987 INFO:tasks.workunit.client.1.smithi087.stdout:4/545: fdatasync d2/d9/d10/d22/f8b 0 2024-02-28T16:01:56.990 INFO:tasks.workunit.client.1.smithi087.stdout:4/546: fsync d2/df/f39 0 2024-02-28T16:01:56.995 INFO:tasks.workunit.client.0.smithi057.stdout:7/143: mkdir d6/dc/d35 0 2024-02-28T16:01:56.995 INFO:tasks.workunit.client.0.smithi057.stdout:4/166: write d1/f4 [9113647,129335] 0 2024-02-28T16:01:57.000 INFO:tasks.workunit.client.1.smithi087.stdout:7/467: dwrite d14/d46/f4c [0,4194304] 0 2024-02-28T16:01:57.000 INFO:tasks.workunit.client.0.smithi057.stdout:7/144: write d6/fb [1360598,117470] 0 2024-02-28T16:01:57.004 INFO:tasks.workunit.client.1.smithi087.stdout:6/535: dread d4/d30/d13/f3b [0,4194304] 0 2024-02-28T16:01:57.004 INFO:tasks.workunit.client.1.smithi087.stdout:3/474: dwrite d11/f15 [0,4194304] 0 2024-02-28T16:01:57.005 INFO:tasks.workunit.client.0.smithi057.stdout:8/212: sync 2024-02-28T16:01:57.005 INFO:tasks.workunit.client.0.smithi057.stdout:1/245: sync 2024-02-28T16:01:57.005 INFO:tasks.workunit.client.0.smithi057.stdout:5/168: sync 2024-02-28T16:01:57.005 INFO:tasks.workunit.client.0.smithi057.stdout:9/251: sync 2024-02-28T16:01:57.005 INFO:tasks.workunit.client.0.smithi057.stdout:0/287: sync 2024-02-28T16:01:57.005 INFO:tasks.workunit.client.0.smithi057.stdout:2/133: sync 2024-02-28T16:01:57.007 INFO:tasks.workunit.client.1.smithi087.stdout:8/524: write d2/d9/d10/d24/f34 [304036,81590] 0 2024-02-28T16:01:57.011 INFO:tasks.workunit.client.1.smithi087.stdout:7/468: mkdir d14/d2e/d89 0 2024-02-28T16:01:57.012 INFO:tasks.workunit.client.1.smithi087.stdout:6/536: unlink d4/d12/d45/f5a 0 2024-02-28T16:01:57.014 INFO:tasks.workunit.client.1.smithi087.stdout:8/525: mknod d2/d9/d10/d24/cb2 0 2024-02-28T16:01:57.015 INFO:tasks.workunit.client.0.smithi057.stdout:6/126: dwrite df/f1f [0,4194304] 0 2024-02-28T16:01:57.019 INFO:tasks.workunit.client.0.smithi057.stdout:0/288: write d6/f2f [387640,64410] 0 2024-02-28T16:01:57.019 INFO:tasks.workunit.client.0.smithi057.stdout:9/252: dread d2/d5/f30 [0,4194304] 0 2024-02-28T16:01:57.019 INFO:tasks.workunit.client.0.smithi057.stdout:2/134: write d19/f1e [3957480,121179] 0 2024-02-28T16:01:57.019 INFO:tasks.workunit.client.1.smithi087.stdout:1/487: write d0/fa [1986798,33045] 0 2024-02-28T16:01:57.020 INFO:tasks.workunit.client.1.smithi087.stdout:8/526: truncate d2/d33/f5f 1441452 0 2024-02-28T16:01:57.023 INFO:tasks.workunit.client.0.smithi057.stdout:7/145: fdatasync d6/dc/fd 0 2024-02-28T16:01:57.027 INFO:tasks.workunit.client.1.smithi087.stdout:4/547: dwrite d2/f7c [0,4194304] 0 2024-02-28T16:01:57.031 INFO:tasks.workunit.client.1.smithi087.stdout:1/488: creat d0/fa2 x:0 0 0 2024-02-28T16:01:57.033 INFO:tasks.workunit.client.0.smithi057.stdout:3/108: dwrite d8/f12 [0,4194304] 0 2024-02-28T16:01:57.035 INFO:tasks.workunit.client.1.smithi087.stdout:5/573: truncate d3/d9/d9b/dba/d30/d44/d54/f6e 1280049 0 2024-02-28T16:01:57.038 INFO:tasks.workunit.client.1.smithi087.stdout:4/548: mkdir d2/d9/d10/d22/d5b/d5c/d68/dc5 0 2024-02-28T16:01:57.038 INFO:tasks.workunit.client.1.smithi087.stdout:8/527: getdents d2/d9/d8e 0 2024-02-28T16:01:57.041 INFO:tasks.workunit.client.0.smithi057.stdout:5/169: mkdir d2/d3e 0 2024-02-28T16:01:57.044 INFO:tasks.workunit.client.1.smithi087.stdout:1/489: creat d0/d1b/d43/fa3 x:0 0 0 2024-02-28T16:01:57.045 INFO:tasks.workunit.client.0.smithi057.stdout:4/167: truncate d1/f4 5478150 0 2024-02-28T16:01:57.045 INFO:tasks.workunit.client.0.smithi057.stdout:8/213: truncate d5/de/f10 1070750 0 2024-02-28T16:01:57.045 INFO:tasks.workunit.client.1.smithi087.stdout:8/528: mknod d2/d9/d1a/d67/cb3 0 2024-02-28T16:01:57.046 INFO:tasks.workunit.client.0.smithi057.stdout:6/127: unlink df/d14/f23 0 2024-02-28T16:01:57.047 INFO:tasks.workunit.client.1.smithi087.stdout:4/549: chown d2/dc1/lc2 39869359 1 2024-02-28T16:01:57.047 INFO:tasks.workunit.client.0.smithi057.stdout:7/146: creat d6/d26/f36 x:0 0 0 2024-02-28T16:01:57.048 INFO:tasks.workunit.client.1.smithi087.stdout:4/550: stat d2/f8f 0 2024-02-28T16:01:57.048 INFO:tasks.workunit.client.1.smithi087.stdout:8/529: rmdir d2/d18/d42 39 2024-02-28T16:01:57.050 INFO:tasks.workunit.client.0.smithi057.stdout:3/109: write d8/dd/d14/f20 [429872,41528] 0 2024-02-28T16:01:57.050 INFO:tasks.workunit.client.0.smithi057.stdout:1/246: creat d1/d21/d25/d26/d44/f58 x:0 0 0 2024-02-28T16:01:57.051 INFO:tasks.workunit.client.1.smithi087.stdout:4/551: chown d2/d9/da/d1a/l61 2 1 2024-02-28T16:01:57.052 INFO:tasks.workunit.client.1.smithi087.stdout:1/490: link d0/d1d/d24/f58 d0/d1b/d1f/d96/fa4 0 2024-02-28T16:01:57.053 INFO:tasks.workunit.client.0.smithi057.stdout:9/253: mkdir d2/d5/d9/d57 0 2024-02-28T16:01:57.053 INFO:tasks.workunit.client.1.smithi087.stdout:8/530: mkdir d2/d9/db4 0 2024-02-28T16:01:57.054 INFO:tasks.workunit.client.1.smithi087.stdout:4/552: mknod d2/d9/da/d1a/d26/d69/cc6 0 2024-02-28T16:01:57.054 INFO:tasks.workunit.client.0.smithi057.stdout:1/247: chown d1/d21/d25/d26/f2f 1159517 1 2024-02-28T16:01:57.057 INFO:tasks.workunit.client.0.smithi057.stdout:4/168: mkdir d1/d3f 0 2024-02-28T16:01:57.058 INFO:tasks.workunit.client.1.smithi087.stdout:4/553: write d2/df/d2e/f43 [3590364,62325] 0 2024-02-28T16:01:57.058 INFO:tasks.workunit.client.0.smithi057.stdout:1/248: write d1/f8 [2122813,33430] 0 2024-02-28T16:01:57.058 INFO:tasks.workunit.client.0.smithi057.stdout:8/214: mkdir d5/de/d1b/d4b 0 2024-02-28T16:01:57.060 INFO:tasks.workunit.client.0.smithi057.stdout:1/249: dread - d1/f45 zero size 2024-02-28T16:01:57.062 INFO:tasks.workunit.client.0.smithi057.stdout:8/215: stat d5/d6/c3c 0 2024-02-28T16:01:57.062 INFO:tasks.workunit.client.0.smithi057.stdout:6/128: symlink df/d14/d15/l29 0 2024-02-28T16:01:57.065 INFO:tasks.workunit.client.0.smithi057.stdout:6/129: readlink ld 0 2024-02-28T16:01:57.065 INFO:tasks.workunit.client.0.smithi057.stdout:1/250: dread - d1/d3/f47 zero size 2024-02-28T16:01:57.065 INFO:tasks.workunit.client.0.smithi057.stdout:7/147: stat d6/dc/d12/l13 0 2024-02-28T16:01:57.067 INFO:tasks.workunit.client.0.smithi057.stdout:4/169: write d1/d22/f24 [5033662,123132] 0 2024-02-28T16:01:57.069 INFO:tasks.workunit.client.1.smithi087.stdout:4/554: rmdir d2/d9/d10/d22/d5b/d5c 39 2024-02-28T16:01:57.070 INFO:tasks.workunit.client.1.smithi087.stdout:0/485: sync 2024-02-28T16:01:57.070 INFO:tasks.workunit.client.1.smithi087.stdout:9/482: sync 2024-02-28T16:01:57.071 INFO:tasks.workunit.client.0.smithi057.stdout:3/110: mkdir d8/d26 0 2024-02-28T16:01:57.071 INFO:tasks.workunit.client.1.smithi087.stdout:3/475: dwrite ff [0,4194304] 0 2024-02-28T16:01:57.072 INFO:tasks.workunit.client.0.smithi057.stdout:8/216: rename d5/de/d1b/d4b to d5/de/d1b/d4b/d4c 22 2024-02-28T16:01:57.074 INFO:tasks.workunit.client.0.smithi057.stdout:5/170: creat d2/d12/d3d/f3f x:0 0 0 2024-02-28T16:01:57.075 INFO:tasks.workunit.client.1.smithi087.stdout:0/486: dread - d4/dd/f82 zero size 2024-02-28T16:01:57.078 INFO:tasks.workunit.client.1.smithi087.stdout:7/469: dwrite d14/d2e/f1b [0,4194304] 0 2024-02-28T16:01:57.080 INFO:tasks.workunit.client.0.smithi057.stdout:9/254: mkdir d2/d5/d58 0 2024-02-28T16:01:57.080 INFO:tasks.workunit.client.0.smithi057.stdout:5/171: stat d2/c21 0 2024-02-28T16:01:57.080 INFO:tasks.workunit.client.1.smithi087.stdout:9/483: mknod d7/d1e/d44/c8a 0 2024-02-28T16:01:57.083 INFO:tasks.workunit.client.1.smithi087.stdout:4/555: truncate d2/d9/f2c 542105 0 2024-02-28T16:01:57.083 INFO:tasks.workunit.client.1.smithi087.stdout:4/556: dread - d2/d9/d10/d11/f98 zero size 2024-02-28T16:01:57.084 INFO:tasks.workunit.client.1.smithi087.stdout:3/476: write d11/f31 [1310368,75842] 0 2024-02-28T16:01:57.086 INFO:tasks.workunit.client.1.smithi087.stdout:0/487: creat d4/dd/d37/d39/d3a/d57/d74/fa0 x:0 0 0 2024-02-28T16:01:57.087 INFO:tasks.workunit.client.1.smithi087.stdout:7/470: rename d14/d2e/d2b/f69 to d14/d27/d5d/d6a/d83/f8a 0 2024-02-28T16:01:57.088 INFO:tasks.workunit.client.0.smithi057.stdout:3/111: rename d8/dd/d19/d1c/c1d to d8/dd/d19/c27 0 2024-02-28T16:01:57.088 INFO:tasks.workunit.client.0.smithi057.stdout:3/112: dread - d8/dd/f1f zero size 2024-02-28T16:01:57.094 INFO:tasks.workunit.client.0.smithi057.stdout:8/217: link f1 d5/de/f4d 0 2024-02-28T16:01:57.095 INFO:tasks.workunit.client.1.smithi087.stdout:9/484: read d7/dd/d15/d79/f1c [3796658,31350] 0 2024-02-28T16:01:57.095 INFO:tasks.workunit.client.0.smithi057.stdout:5/172: rmdir d2 39 2024-02-28T16:01:57.096 INFO:tasks.workunit.client.1.smithi087.stdout:3/477: rename d11/d33/d58/d8c/c94 to d11/d33/d67/d9c/ca2 0 2024-02-28T16:01:57.099 INFO:tasks.workunit.client.1.smithi087.stdout:0/488: write d4/dd/f9e [349425,103302] 0 2024-02-28T16:01:57.099 INFO:tasks.workunit.client.1.smithi087.stdout:9/485: chown d7/d1e/d44/c8a 4072801 1 2024-02-28T16:01:57.099 INFO:tasks.workunit.client.1.smithi087.stdout:3/478: fdatasync d11/f46 0 2024-02-28T16:01:57.101 INFO:tasks.workunit.client.1.smithi087.stdout:5/574: dread d3/d9/d9b/dba/d30/d44/d54/f6e [0,4194304] 0 2024-02-28T16:01:57.101 INFO:tasks.workunit.client.1.smithi087.stdout:3/479: write d11/d33/d67/d9c/f9f [787658,53117] 0 2024-02-28T16:01:57.102 INFO:tasks.workunit.client.0.smithi057.stdout:2/135: dread d19/f1e [0,4194304] 0 2024-02-28T16:01:57.102 INFO:tasks.workunit.client.1.smithi087.stdout:3/480: chown d11/d7b 32002592 1 2024-02-28T16:01:57.103 INFO:tasks.workunit.client.1.smithi087.stdout:4/557: link d2/df/d2e/f43 d2/d9/da/d1a/d26/fc7 0 2024-02-28T16:01:57.105 INFO:tasks.workunit.client.0.smithi057.stdout:4/170: link d1/d10/d12/d15/d19/f32 d1/d10/d12/f40 0 2024-02-28T16:01:57.107 INFO:tasks.workunit.client.1.smithi087.stdout:4/558: truncate d2/d9/d10/f92 54768 0 2024-02-28T16:01:57.111 INFO:tasks.workunit.client.1.smithi087.stdout:8/531: dread d2/d9/d1a/f44 [0,4194304] 0 2024-02-28T16:01:57.112 INFO:tasks.workunit.client.1.smithi087.stdout:9/486: rename d7/dd/d15/d79/f4a to d7/dd/d15/d79/d2e/f8b 0 2024-02-28T16:01:57.114 INFO:tasks.workunit.client.0.smithi057.stdout:8/218: creat d5/de/d1b/d45/f4e x:0 0 0 2024-02-28T16:01:57.114 INFO:tasks.workunit.client.0.smithi057.stdout:4/171: read d1/d14/f23 [136126,32583] 0 2024-02-28T16:01:57.115 INFO:tasks.workunit.client.1.smithi087.stdout:9/487: chown d7/d1e/d60/d69 205 1 2024-02-28T16:01:57.116 INFO:tasks.workunit.client.1.smithi087.stdout:3/481: creat d11/d61/d7c/fa3 x:0 0 0 2024-02-28T16:01:57.117 INFO:tasks.workunit.client.0.smithi057.stdout:8/219: dread - d5/f31 zero size 2024-02-28T16:01:57.118 INFO:tasks.workunit.client.0.smithi057.stdout:4/172: chown d1/d3f 763584262 1 2024-02-28T16:01:57.118 INFO:tasks.workunit.client.1.smithi087.stdout:7/471: link d14/d30/c5a d14/d21/d4f/c8b 0 2024-02-28T16:01:57.119 INFO:tasks.workunit.client.1.smithi087.stdout:1/491: dread d0/d1b/d43/f4b [0,4194304] 0 2024-02-28T16:01:57.122 INFO:tasks.workunit.client.0.smithi057.stdout:2/136: mknod d19/d1d/d26/c2d 0 2024-02-28T16:01:57.123 INFO:tasks.workunit.client.1.smithi087.stdout:4/559: rename d2/df/d62/l9c to d2/df/d2e/lc8 0 2024-02-28T16:01:57.123 INFO:tasks.workunit.client.1.smithi087.stdout:1/492: fdatasync d0/d14/f93 0 2024-02-28T16:01:57.124 INFO:tasks.workunit.client.0.smithi057.stdout:1/251: dread d1/d21/d25/d26/f2f [0,4194304] 0 2024-02-28T16:01:57.125 INFO:tasks.workunit.client.0.smithi057.stdout:0/289: truncate d6/d12/d38/f52 4604926 0 2024-02-28T16:01:57.125 INFO:tasks.workunit.client.0.smithi057.stdout:2/137: fdatasync d19/f29 0 2024-02-28T16:01:57.126 INFO:tasks.workunit.client.1.smithi087.stdout:0/489: dwrite d4/d6/dc/d45/f6a [0,4194304] 0 2024-02-28T16:01:57.127 INFO:tasks.workunit.client.0.smithi057.stdout:3/113: dwrite d8/f12 [4194304,4194304] 0 2024-02-28T16:01:57.135 INFO:tasks.workunit.client.0.smithi057.stdout:6/130: write f6 [799342,82878] 0 2024-02-28T16:01:57.136 INFO:tasks.workunit.client.0.smithi057.stdout:0/290: fsync f0 0 2024-02-28T16:01:57.137 INFO:tasks.workunit.client.0.smithi057.stdout:2/138: dread f12 [0,4194304] 0 2024-02-28T16:01:57.138 INFO:tasks.workunit.client.1.smithi087.stdout:1/493: symlink d0/d1d/d24/la5 0 2024-02-28T16:01:57.139 INFO:tasks.workunit.client.1.smithi087.stdout:5/575: write d3/f22 [551401,108237] 0 2024-02-28T16:01:57.140 INFO:tasks.workunit.client.0.smithi057.stdout:1/252: creat d1/d3/f59 x:0 0 0 2024-02-28T16:01:57.141 INFO:tasks.workunit.client.1.smithi087.stdout:0/490: write d4/dd/d21/d9b/d7c/f98 [2728581,2707] 0 2024-02-28T16:01:57.142 INFO:tasks.workunit.client.0.smithi057.stdout:3/114: dread d8/dd/d14/f20 [0,4194304] 0 2024-02-28T16:01:57.143 INFO:tasks.workunit.client.0.smithi057.stdout:2/139: dread - d19/f2b zero size 2024-02-28T16:01:57.144 INFO:tasks.workunit.client.1.smithi087.stdout:1/494: chown d0/d14/d86/c9d 2 1 2024-02-28T16:01:57.145 INFO:tasks.workunit.client.0.smithi057.stdout:6/131: truncate df/d10/d13/f1e 4669484 0 2024-02-28T16:01:57.145 INFO:tasks.workunit.client.1.smithi087.stdout:2/502: sync 2024-02-28T16:01:57.147 INFO:tasks.workunit.client.1.smithi087.stdout:3/482: creat d11/d33/d58/fa4 x:0 0 0 2024-02-28T16:01:57.149 INFO:tasks.workunit.client.0.smithi057.stdout:0/291: creat d6/d12/d38/f5c x:0 0 0 2024-02-28T16:01:57.150 INFO:tasks.workunit.client.1.smithi087.stdout:0/491: creat d4/dd/d37/d39/fa1 x:0 0 0 2024-02-28T16:01:57.151 INFO:tasks.workunit.client.0.smithi057.stdout:2/140: truncate f12 1817924 0 2024-02-28T16:01:57.153 INFO:tasks.workunit.client.1.smithi087.stdout:5/576: rmdir d3/d9/d9b/dba 39 2024-02-28T16:01:57.153 INFO:tasks.workunit.client.1.smithi087.stdout:8/532: dwrite d2/d9/d1a/f5b [4194304,4194304] 0 2024-02-28T16:01:57.156 INFO:tasks.workunit.client.1.smithi087.stdout:1/495: creat d0/d14/d48/fa6 x:0 0 0 2024-02-28T16:01:57.157 INFO:tasks.workunit.client.1.smithi087.stdout:4/560: dwrite d2/d9/f4d [4194304,4194304] 0 2024-02-28T16:01:57.157 INFO:tasks.workunit.client.1.smithi087.stdout:8/533: chown d2/d9 6724314 1 2024-02-28T16:01:57.158 INFO:tasks.workunit.client.1.smithi087.stdout:9/488: dwrite d7/d1e/d44/f46 [0,4194304] 0 2024-02-28T16:01:57.158 INFO:tasks.workunit.client.0.smithi057.stdout:0/292: chown d6/d12/d17/d34 2 1 2024-02-28T16:01:57.160 INFO:tasks.workunit.client.1.smithi087.stdout:5/577: creat d3/d9/fd7 x:0 0 0 2024-02-28T16:01:57.164 INFO:tasks.workunit.client.1.smithi087.stdout:2/503: creat d2/d99/d28/d79/da3/fbd x:0 0 0 2024-02-28T16:01:57.166 INFO:tasks.workunit.client.1.smithi087.stdout:0/492: rename d4/l5d to d4/d1c/la2 0 2024-02-28T16:01:57.166 INFO:tasks.workunit.client.0.smithi057.stdout:0/293: chown d6/d12/d17/d34/f3f 1020 1 2024-02-28T16:01:57.167 INFO:tasks.workunit.client.0.smithi057.stdout:5/173: write d2/d15/f1f [2090879,84285] 0 2024-02-28T16:01:57.167 INFO:tasks.workunit.client.1.smithi087.stdout:9/489: truncate d7/d1e/d60/d64/f7b 732089 0 2024-02-28T16:01:57.169 INFO:tasks.workunit.client.0.smithi057.stdout:8/220: getdents d5/de/d1b/d45 0 2024-02-28T16:01:57.171 INFO:tasks.workunit.client.1.smithi087.stdout:1/496: mkdir d0/d14/d48/da7 0 2024-02-28T16:01:57.172 INFO:tasks.workunit.client.1.smithi087.stdout:1/497: fsync d0/ff 0 2024-02-28T16:01:57.173 INFO:tasks.workunit.client.0.smithi057.stdout:4/173: dwrite d1/d1f/f2f [0,4194304] 0 2024-02-28T16:01:57.174 INFO:tasks.workunit.client.1.smithi087.stdout:0/493: truncate d4/dd/d21/f96 408902 0 2024-02-28T16:01:57.174 INFO:tasks.workunit.client.0.smithi057.stdout:2/141: readlink d19/d1d/d22/l24 0 2024-02-28T16:01:57.176 INFO:tasks.workunit.client.1.smithi087.stdout:8/534: mkdir d2/d9/d5e/d9c/db5 0 2024-02-28T16:01:57.178 INFO:tasks.workunit.client.1.smithi087.stdout:5/578: symlink d3/d64/d67/d7c/ld8 0 2024-02-28T16:01:57.180 INFO:tasks.workunit.client.0.smithi057.stdout:9/255: dwrite d2/d24/ff [0,4194304] 0 2024-02-28T16:01:57.182 INFO:tasks.workunit.client.1.smithi087.stdout:0/494: write d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f8e [932481,8816] 0 2024-02-28T16:01:57.182 INFO:tasks.workunit.client.0.smithi057.stdout:8/221: chown d5/de/d1b/f2e 12234191 1 2024-02-28T16:01:57.183 INFO:tasks.workunit.client.1.smithi087.stdout:5/579: truncate d3/d9/d9b/f9c 340742 0 2024-02-28T16:01:57.185 INFO:tasks.workunit.client.0.smithi057.stdout:4/174: dread - d1/d10/d12/d15/d19/f32 zero size 2024-02-28T16:01:57.188 INFO:tasks.workunit.client.1.smithi087.stdout:6/537: sync 2024-02-28T16:01:57.195 INFO:tasks.workunit.client.0.smithi057.stdout:0/294: fdatasync d6/d12/d17/f37 0 2024-02-28T16:01:57.198 INFO:tasks.workunit.client.0.smithi057.stdout:0/295: read d6/d12/d45/f4f [797928,23165] 0 2024-02-28T16:01:57.200 INFO:tasks.workunit.client.0.smithi057.stdout:3/115: getdents d8/dd/d19 0 2024-02-28T16:01:57.203 INFO:tasks.workunit.client.0.smithi057.stdout:3/116: dread - d8/f13 zero size 2024-02-28T16:01:57.204 INFO:tasks.workunit.client.1.smithi087.stdout:7/472: dread d14/d21/f45 [0,4194304] 0 2024-02-28T16:01:57.214 INFO:tasks.workunit.client.1.smithi087.stdout:9/490: rename d7/f32 to d7/dd/d3c/d4c/f8c 0 2024-02-28T16:01:57.214 INFO:tasks.workunit.client.0.smithi057.stdout:6/132: truncate df/d10/d13/f1e 4447815 0 2024-02-28T16:01:57.215 INFO:tasks.workunit.client.1.smithi087.stdout:9/491: stat d7/d1e/d60/d64/f73 0 2024-02-28T16:01:57.217 INFO:tasks.workunit.client.1.smithi087.stdout:9/492: stat d7/dd/f2d 0 2024-02-28T16:01:57.221 INFO:tasks.workunit.client.0.smithi057.stdout:4/175: mknod d1/d10/d12/d15/d19/c41 0 2024-02-28T16:01:57.225 INFO:tasks.workunit.client.0.smithi057.stdout:0/296: mkdir d6/d12/d5d 0 2024-02-28T16:01:57.227 INFO:tasks.workunit.client.0.smithi057.stdout:5/174: symlink d2/d3e/l40 0 2024-02-28T16:01:57.227 INFO:tasks.workunit.client.0.smithi057.stdout:8/222: symlink d5/d20/d39/d49/l4f 0 2024-02-28T16:01:57.230 INFO:tasks.workunit.client.0.smithi057.stdout:6/133: mknod df/d14/d15/c2a 0 2024-02-28T16:01:57.237 INFO:tasks.workunit.client.0.smithi057.stdout:3/117: dwrite d8/dd/d14/f17 [0,4194304] 0 2024-02-28T16:01:57.239 INFO:tasks.workunit.client.1.smithi087.stdout:1/498: creat d0/d1b/d43/d4d/fa8 x:0 0 0 2024-02-28T16:01:57.241 INFO:tasks.workunit.client.1.smithi087.stdout:1/499: chown d0/d14/d86/c9d 34594 1 2024-02-28T16:01:57.242 INFO:tasks.workunit.client.0.smithi057.stdout:4/176: creat d1/d10/d12/d2c/d37/f42 x:0 0 0 2024-02-28T16:01:57.243 INFO:tasks.workunit.client.1.smithi087.stdout:8/535: truncate d2/d33/f71 741586 0 2024-02-28T16:01:57.245 INFO:tasks.workunit.client.1.smithi087.stdout:8/536: read - d2/d9/d8e/faf zero size 2024-02-28T16:01:57.245 INFO:tasks.workunit.client.0.smithi057.stdout:0/297: rename d6/d12/d3d to d6/d12/d38/d5e 0 2024-02-28T16:01:57.248 INFO:tasks.workunit.client.0.smithi057.stdout:9/256: link d2/d24/l2b d2/d5/d9/l59 0 2024-02-28T16:01:57.250 INFO:tasks.workunit.client.1.smithi087.stdout:7/473: mknod d14/d21/d4f/c8c 0 2024-02-28T16:01:57.251 INFO:tasks.workunit.client.0.smithi057.stdout:9/257: write d2/f3a [189027,19219] 0 2024-02-28T16:01:57.252 INFO:tasks.workunit.client.1.smithi087.stdout:3/483: getdents d11/d33/d67/d98 0 2024-02-28T16:01:57.253 INFO:tasks.workunit.client.0.smithi057.stdout:6/134: dread df/d14/d15/f25 [0,4194304] 0 2024-02-28T16:01:57.254 INFO:tasks.workunit.client.0.smithi057.stdout:9/258: dread - d2/d5/d9/f4b zero size 2024-02-28T16:01:57.258 INFO:tasks.workunit.client.1.smithi087.stdout:0/495: mknod d4/dd/ca3 0 2024-02-28T16:01:57.262 INFO:tasks.workunit.client.0.smithi057.stdout:2/142: dread f10 [0,4194304] 0 2024-02-28T16:01:57.265 INFO:tasks.workunit.client.0.smithi057.stdout:6/135: mknod df/d14/d15/c2b 0 2024-02-28T16:01:57.265 INFO:tasks.workunit.client.1.smithi087.stdout:7/474: creat d14/d7d/f8d x:0 0 0 2024-02-28T16:01:57.265 INFO:tasks.workunit.client.1.smithi087.stdout:6/538: dwrite d4/dc/d10/f2b [0,4194304] 0 2024-02-28T16:01:57.268 INFO:tasks.workunit.client.1.smithi087.stdout:3/484: mknod d11/d33/d67/d9c/da1/ca5 0 2024-02-28T16:01:57.270 INFO:tasks.workunit.client.1.smithi087.stdout:3/485: fdatasync d11/d44/d5b/f78 0 2024-02-28T16:01:57.270 INFO:tasks.workunit.client.1.smithi087.stdout:0/496: rmdir d4/dd/d37/d39/d3a 39 2024-02-28T16:01:57.271 INFO:tasks.workunit.client.0.smithi057.stdout:3/118: symlink d8/dd/d19/d25/l28 0 2024-02-28T16:01:57.273 INFO:tasks.workunit.client.1.smithi087.stdout:8/537: truncate d2/d18/d25/f21 3066179 0 2024-02-28T16:01:57.273 INFO:tasks.workunit.client.0.smithi057.stdout:4/177: truncate d1/d22/f35 1221082 0 2024-02-28T16:01:57.274 INFO:tasks.workunit.client.1.smithi087.stdout:1/500: dwrite d0/d1a/f2e [4194304,4194304] 0 2024-02-28T16:01:57.278 INFO:tasks.workunit.client.0.smithi057.stdout:2/143: unlink l18 0 2024-02-28T16:01:57.278 INFO:tasks.workunit.client.0.smithi057.stdout:4/178: stat d1/d10/d12/c2d 0 2024-02-28T16:01:57.289 INFO:tasks.workunit.client.1.smithi087.stdout:8/538: chown d2/d33/c86 2095119046 1 2024-02-28T16:01:57.289 INFO:tasks.workunit.client.1.smithi087.stdout:6/539: dwrite d4/d96/f98 [0,4194304] 0 2024-02-28T16:01:57.290 INFO:tasks.workunit.client.1.smithi087.stdout:1/501: unlink d0/f2 0 2024-02-28T16:01:57.293 INFO:tasks.workunit.client.0.smithi057.stdout:5/175: dwrite d2/f13 [0,4194304] 0 2024-02-28T16:01:57.295 INFO:tasks.workunit.client.1.smithi087.stdout:3/486: mknod d11/d33/ca6 0 2024-02-28T16:01:57.295 INFO:tasks.workunit.client.0.smithi057.stdout:2/144: chown c16 13876019 1 2024-02-28T16:01:57.296 INFO:tasks.workunit.client.1.smithi087.stdout:7/475: creat d14/d27/d55/f8e x:0 0 0 2024-02-28T16:01:57.296 INFO:tasks.workunit.client.1.smithi087.stdout:0/497: dread d4/f48 [0,4194304] 0 2024-02-28T16:01:57.297 INFO:tasks.workunit.client.1.smithi087.stdout:3/487: write d11/f36 [2193892,31438] 0 2024-02-28T16:01:57.300 INFO:tasks.workunit.client.1.smithi087.stdout:6/540: symlink d4/dc/d10/lb1 0 2024-02-28T16:01:57.301 INFO:tasks.workunit.client.0.smithi057.stdout:4/179: creat d1/d10/f43 x:0 0 0 2024-02-28T16:01:57.304 INFO:tasks.workunit.client.1.smithi087.stdout:1/502: unlink d0/d1b/d1f/l60 0 2024-02-28T16:01:57.309 INFO:tasks.workunit.client.1.smithi087.stdout:0/498: symlink d4/d6/dc/la4 0 2024-02-28T16:01:57.311 INFO:tasks.workunit.client.1.smithi087.stdout:0/499: fdatasync d4/dd/d21/d52/f6e 0 2024-02-28T16:01:57.312 INFO:tasks.workunit.client.1.smithi087.stdout:8/539: dwrite d2/d9/f5c [0,4194304] 0 2024-02-28T16:01:57.315 INFO:tasks.workunit.client.1.smithi087.stdout:7/476: mknod d14/d2e/d89/c8f 0 2024-02-28T16:01:57.315 INFO:tasks.workunit.client.1.smithi087.stdout:3/488: rename d11/f1d to d11/d33/d67/d98/fa7 0 2024-02-28T16:01:57.318 INFO:tasks.workunit.client.1.smithi087.stdout:1/503: truncate d0/d14/f42 2130359 0 2024-02-28T16:01:57.318 INFO:tasks.workunit.client.1.smithi087.stdout:3/489: chown d11/d33/f93 14519293 1 2024-02-28T16:01:57.321 INFO:tasks.workunit.client.0.smithi057.stdout:3/119: getdents d8/dd/d19/d1c 0 2024-02-28T16:01:57.321 INFO:tasks.workunit.client.0.smithi057.stdout:8/223: dwrite d5/d6/fd [0,4194304] 0 2024-02-28T16:01:57.324 INFO:tasks.workunit.client.0.smithi057.stdout:9/259: dwrite d2/d5/f30 [0,4194304] 0 2024-02-28T16:01:57.327 INFO:tasks.workunit.client.0.smithi057.stdout:6/136: dwrite df/f12 [0,4194304] 0 2024-02-28T16:01:57.328 INFO:tasks.workunit.client.1.smithi087.stdout:6/541: rename d4/d30/d13/f3f to d4/d12/d45/d74/d9a/fb2 0 2024-02-28T16:01:57.328 INFO:tasks.workunit.client.0.smithi057.stdout:0/298: dwrite d6/d12/d45/f4f [0,4194304] 0 2024-02-28T16:01:57.329 INFO:tasks.workunit.client.1.smithi087.stdout:8/540: write d2/d9/d1a/f45 [3688470,10288] 0 2024-02-28T16:01:57.331 INFO:tasks.workunit.client.0.smithi057.stdout:3/120: truncate d8/f18 1271825 0 2024-02-28T16:01:57.331 INFO:tasks.workunit.client.1.smithi087.stdout:8/541: dread - d2/d9/d5e/f91 zero size 2024-02-28T16:01:57.335 INFO:tasks.workunit.client.0.smithi057.stdout:9/260: chown d2/d5/f8 271093 1 2024-02-28T16:01:57.336 INFO:tasks.workunit.client.0.smithi057.stdout:3/121: chown d8/dd/d14 82588 1 2024-02-28T16:01:57.338 INFO:tasks.workunit.client.0.smithi057.stdout:5/176: getdents d2/d12 0 2024-02-28T16:01:57.338 INFO:tasks.workunit.client.0.smithi057.stdout:6/137: mknod df/d14/c2c 0 2024-02-28T16:01:57.339 INFO:tasks.workunit.client.1.smithi087.stdout:3/490: symlink d11/d61/la8 0 2024-02-28T16:01:57.339 INFO:tasks.workunit.client.1.smithi087.stdout:1/504: creat d0/d1b/d1f/fa9 x:0 0 0 2024-02-28T16:01:57.339 INFO:tasks.workunit.client.1.smithi087.stdout:4/561: write d2/d9/fb0 [319616,98601] 0 2024-02-28T16:01:57.341 INFO:tasks.workunit.client.0.smithi057.stdout:3/122: truncate d8/dd/f1f 201197 0 2024-02-28T16:01:57.342 INFO:tasks.workunit.client.1.smithi087.stdout:6/542: rmdir d4/dc/d61 39 2024-02-28T16:01:57.343 INFO:tasks.workunit.client.0.smithi057.stdout:2/145: getdents d19 0 2024-02-28T16:01:57.344 INFO:tasks.workunit.client.1.smithi087.stdout:4/562: stat d2/d9/d10/d22/db3 0 2024-02-28T16:01:57.344 INFO:tasks.workunit.client.1.smithi087.stdout:2/504: truncate d2/f21 4187870 0 2024-02-28T16:01:57.345 INFO:tasks.workunit.client.0.smithi057.stdout:6/138: readlink le 0 2024-02-28T16:01:57.345 INFO:tasks.workunit.client.0.smithi057.stdout:5/177: dread - d2/d12/f24 zero size 2024-02-28T16:01:57.345 INFO:tasks.workunit.client.1.smithi087.stdout:4/563: fdatasync d2/f8f 0 2024-02-28T16:01:57.345 INFO:tasks.workunit.client.1.smithi087.stdout:8/542: creat d2/d7c/fb6 x:0 0 0 2024-02-28T16:01:57.349 INFO:tasks.workunit.client.0.smithi057.stdout:2/146: read f10 [2623692,107766] 0 2024-02-28T16:01:57.349 INFO:tasks.workunit.client.0.smithi057.stdout:0/299: mknod d6/d12/d45/d55/c5f 0 2024-02-28T16:01:57.350 INFO:tasks.workunit.client.1.smithi087.stdout:4/564: readlink d2/d9/d10/lbd 0 2024-02-28T16:01:57.351 INFO:tasks.workunit.client.0.smithi057.stdout:8/224: mknod d5/de/d47/c50 0 2024-02-28T16:01:57.351 INFO:tasks.workunit.client.1.smithi087.stdout:3/491: mkdir d11/d61/d65/da9 0 2024-02-28T16:01:57.351 INFO:tasks.workunit.client.1.smithi087.stdout:7/477: dread d14/d21/f61 [0,4194304] 0 2024-02-28T16:01:57.360 INFO:tasks.workunit.client.0.smithi057.stdout:6/139: readlink df/d10/l1a 0 2024-02-28T16:01:57.361 INFO:tasks.workunit.client.1.smithi087.stdout:8/543: fdatasync d2/f27 0 2024-02-28T16:01:57.363 INFO:tasks.workunit.client.1.smithi087.stdout:9/493: sync 2024-02-28T16:01:57.371 INFO:tasks.workunit.client.1.smithi087.stdout:4/565: dread - d2/d9/d10/f6c zero size 2024-02-28T16:01:57.372 INFO:tasks.workunit.client.0.smithi057.stdout:0/300: mkdir d6/d12/d17/d4b/d60 0 2024-02-28T16:01:57.373 INFO:tasks.workunit.client.0.smithi057.stdout:8/225: creat d5/de/d47/f51 x:0 0 0 2024-02-28T16:01:57.375 INFO:tasks.workunit.client.1.smithi087.stdout:2/505: dwrite d2/d7/d17/d34/f53 [0,4194304] 0 2024-02-28T16:01:57.375 INFO:tasks.workunit.client.0.smithi057.stdout:6/140: creat df/d14/f2d x:0 0 0 2024-02-28T16:01:57.377 INFO:tasks.workunit.client.0.smithi057.stdout:6/141: readlink df/d10/l1d 0 2024-02-28T16:01:57.378 INFO:tasks.workunit.client.0.smithi057.stdout:9/261: dread d2/f20 [0,4194304] 0 2024-02-28T16:01:57.380 INFO:tasks.workunit.client.1.smithi087.stdout:7/478: dwrite d14/d46/f4c [0,4194304] 0 2024-02-28T16:01:57.380 INFO:tasks.workunit.client.1.smithi087.stdout:5/580: symlink d3/d9/d9b/dba/ld9 0 2024-02-28T16:01:57.382 INFO:tasks.workunit.client.0.smithi057.stdout:8/226: write d5/de/f2b [1432164,88310] 0 2024-02-28T16:01:57.385 INFO:tasks.workunit.client.1.smithi087.stdout:7/479: write d14/f18 [4878624,53044] 0 2024-02-28T16:01:57.386 INFO:tasks.workunit.client.1.smithi087.stdout:0/500: dread d4/dd/d21/f81 [0,4194304] 0 2024-02-28T16:01:57.386 INFO:tasks.workunit.client.1.smithi087.stdout:8/544: dwrite d2/d18/f56 [0,4194304] 0 2024-02-28T16:01:57.386 INFO:tasks.workunit.client.0.smithi057.stdout:2/147: dwrite d19/f1a [0,4194304] 0 2024-02-28T16:01:57.388 INFO:tasks.workunit.client.1.smithi087.stdout:5/581: fsync d3/d9/d9b/dba/d30/d36/f48 0 2024-02-28T16:01:57.389 INFO:tasks.workunit.client.0.smithi057.stdout:6/142: rename df/d10/f22 to df/d10/d13/f2e 0 2024-02-28T16:01:57.391 INFO:tasks.workunit.client.1.smithi087.stdout:3/492: dwrite fa [0,4194304] 0 2024-02-28T16:01:57.392 INFO:tasks.workunit.client.1.smithi087.stdout:3/493: fsync d11/f24 0 2024-02-28T16:01:57.395 INFO:tasks.workunit.client.0.smithi057.stdout:2/148: unlink d19/f1e 0 2024-02-28T16:01:57.395 INFO:tasks.workunit.client.1.smithi087.stdout:2/506: symlink d2/d99/d28/d79/da3/lbe 0 2024-02-28T16:01:57.396 INFO:tasks.workunit.client.0.smithi057.stdout:8/227: mknod d5/c52 0 2024-02-28T16:01:57.397 INFO:tasks.workunit.client.1.smithi087.stdout:3/494: write d11/f82 [1610863,76897] 0 2024-02-28T16:01:57.399 INFO:tasks.workunit.client.1.smithi087.stdout:4/566: creat d2/d9/da/d1a/fc9 x:0 0 0 2024-02-28T16:01:57.399 INFO:tasks.workunit.client.1.smithi087.stdout:4/567: dread - d2/fb7 zero size 2024-02-28T16:01:57.408 INFO:tasks.workunit.client.0.smithi057.stdout:2/149: mkdir d19/d1d/d2e 0 2024-02-28T16:01:57.408 INFO:tasks.workunit.client.1.smithi087.stdout:8/545: rmdir d2/d33 39 2024-02-28T16:01:57.413 INFO:tasks.workunit.client.0.smithi057.stdout:8/228: mkdir d5/d53 0 2024-02-28T16:01:57.415 INFO:tasks.workunit.client.1.smithi087.stdout:0/501: unlink d4/dd/f2d 0 2024-02-28T16:01:57.415 INFO:tasks.workunit.client.0.smithi057.stdout:9/262: dread d2/d5/d1b/f49 [0,4194304] 0 2024-02-28T16:01:57.419 INFO:tasks.workunit.client.0.smithi057.stdout:0/301: dwrite d6/d12/d17/d34/f3f [0,4194304] 0 2024-02-28T16:01:57.421 INFO:tasks.workunit.client.1.smithi087.stdout:3/495: fdatasync d11/d61/d7c/f84 0 2024-02-28T16:01:57.423 INFO:tasks.workunit.client.1.smithi087.stdout:9/494: creat d7/dd/d15/d79/f8d x:0 0 0 2024-02-28T16:01:57.424 INFO:tasks.workunit.client.1.smithi087.stdout:3/496: stat d11/l39 0 2024-02-28T16:01:57.424 INFO:tasks.workunit.client.0.smithi057.stdout:9/263: creat d2/d5/d1b/d2e/d4c/f5a x:0 0 0 2024-02-28T16:01:57.424 INFO:tasks.workunit.client.0.smithi057.stdout:0/302: chown d6/d12/d45/d55/f56 177 1 2024-02-28T16:01:57.426 INFO:tasks.workunit.client.1.smithi087.stdout:2/507: rename d2/d7/d17/d34/d88/la5 to d2/d7/d17/d97/lbf 0 2024-02-28T16:01:57.427 INFO:tasks.workunit.client.0.smithi057.stdout:8/229: truncate d5/d6/f2d 5570563 0 2024-02-28T16:01:57.428 INFO:tasks.workunit.client.1.smithi087.stdout:9/495: write d7/dd/d3c/f53 [3848451,49582] 0 2024-02-28T16:01:57.430 INFO:tasks.workunit.client.1.smithi087.stdout:9/496: readlink d7/d1e/l2b 0 2024-02-28T16:01:57.431 INFO:tasks.workunit.client.1.smithi087.stdout:4/568: unlink d2/d9/d10/dbf/f86 0 2024-02-28T16:01:57.433 INFO:tasks.workunit.client.1.smithi087.stdout:7/480: dwrite d14/d21/f3e [4194304,4194304] 0 2024-02-28T16:01:57.437 INFO:tasks.workunit.client.1.smithi087.stdout:5/582: getdents d3/d64/d67/d7c/dc5 0 2024-02-28T16:01:57.440 INFO:tasks.workunit.client.1.smithi087.stdout:3/497: symlink d11/d33/d67/d9c/da1/laa 0 2024-02-28T16:01:57.440 INFO:tasks.workunit.client.1.smithi087.stdout:0/502: fdatasync d4/dd/d37/d39/d3a/d57/d74/d1f/d60/f8b 0 2024-02-28T16:01:57.441 INFO:tasks.workunit.client.0.smithi057.stdout:3/123: truncate f4 257128 0 2024-02-28T16:01:57.441 INFO:tasks.workunit.client.1.smithi087.stdout:3/498: fdatasync d11/f2a 0 2024-02-28T16:01:57.442 INFO:tasks.workunit.client.0.smithi057.stdout:9/264: truncate d2/d5/d9/f1c 865859 0 2024-02-28T16:01:57.443 INFO:tasks.workunit.client.1.smithi087.stdout:7/481: truncate d14/d7d/f8d 216675 0 2024-02-28T16:01:57.444 INFO:tasks.workunit.client.1.smithi087.stdout:2/508: mkdir d2/d7/dc0 0 2024-02-28T16:01:57.447 INFO:tasks.workunit.client.0.smithi057.stdout:2/150: dwrite fe [0,4194304] 0 2024-02-28T16:01:57.448 INFO:tasks.workunit.client.0.smithi057.stdout:9/265: readlink d2/d24/d1d/l26 0 2024-02-28T16:01:57.448 INFO:tasks.workunit.client.1.smithi087.stdout:4/569: dread - d2/d9/d10/d22/d5b/d5c/d68/fc4 zero size 2024-02-28T16:01:57.448 INFO:tasks.workunit.client.1.smithi087.stdout:9/497: mkdir d7/d1e/d44/d83/d8e 0 2024-02-28T16:01:57.449 INFO:tasks.workunit.client.1.smithi087.stdout:3/499: fdatasync d11/f37 0 2024-02-28T16:01:57.450 INFO:tasks.workunit.client.1.smithi087.stdout:5/583: mknod d3/cda 0 2024-02-28T16:01:57.454 INFO:tasks.workunit.client.1.smithi087.stdout:2/509: chown d2/d99/d28/f43 24477 1 2024-02-28T16:01:57.456 INFO:tasks.workunit.client.0.smithi057.stdout:3/124: creat d8/dd/d19/f29 x:0 0 0 2024-02-28T16:01:57.459 INFO:tasks.workunit.client.1.smithi087.stdout:7/482: readlink d14/d2e/d2b/l5f 0 2024-02-28T16:01:57.461 INFO:tasks.workunit.client.0.smithi057.stdout:3/125: dread - d8/dd/d19/f29 zero size 2024-02-28T16:01:57.461 INFO:tasks.workunit.client.1.smithi087.stdout:6/543: dwrite d4/dc/d61/f71 [0,4194304] 0 2024-02-28T16:01:57.466 INFO:tasks.workunit.client.1.smithi087.stdout:3/500: mkdir d11/d7b/dab 0 2024-02-28T16:01:57.466 INFO:tasks.workunit.client.1.smithi087.stdout:0/503: rmdir d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e 39 2024-02-28T16:01:57.467 INFO:tasks.workunit.client.0.smithi057.stdout:2/151: mknod d19/d2c/c2f 0 2024-02-28T16:01:57.473 INFO:tasks.workunit.client.0.smithi057.stdout:4/180: dwrite d1/d14/f23 [0,4194304] 0 2024-02-28T16:01:57.477 INFO:tasks.workunit.client.0.smithi057.stdout:2/152: chown f10 4454 1 2024-02-28T16:01:57.481 INFO:tasks.workunit.client.1.smithi087.stdout:1/505: dwrite d0/d14/f42 [0,4194304] 0 2024-02-28T16:01:57.484 INFO:tasks.workunit.client.1.smithi087.stdout:3/501: write d11/d33/f9e [2012017,46730] 0 2024-02-28T16:01:57.488 INFO:tasks.workunit.client.0.smithi057.stdout:8/230: dwrite d5/f33 [0,4194304] 0 2024-02-28T16:01:57.489 INFO:tasks.workunit.client.1.smithi087.stdout:1/506: truncate d0/d1a/d28/f8d 15579 0 2024-02-28T16:01:57.490 INFO:tasks.workunit.client.0.smithi057.stdout:4/181: write d1/f7 [3434136,124823] 0 2024-02-28T16:01:57.492 INFO:tasks.workunit.client.1.smithi087.stdout:5/584: mkdir d3/d9/d9b/dba/d30/ddb 0 2024-02-28T16:01:57.493 INFO:tasks.workunit.client.1.smithi087.stdout:7/483: rename d14/d46/d80/c85 to d14/d27/c90 0 2024-02-28T16:01:57.493 INFO:tasks.workunit.client.1.smithi087.stdout:3/502: rmdir d11/d33/d58 39 2024-02-28T16:01:57.497 INFO:tasks.workunit.client.1.smithi087.stdout:1/507: write d0/d14/f42 [1627788,10050] 0 2024-02-28T16:01:57.498 INFO:tasks.workunit.client.1.smithi087.stdout:7/484: write d14/d27/f3f [627491,51445] 0 2024-02-28T16:01:57.500 INFO:tasks.workunit.client.1.smithi087.stdout:3/503: truncate d11/d44/d5b/f4f 841335 0 2024-02-28T16:01:57.500 INFO:tasks.workunit.client.1.smithi087.stdout:4/570: getdents d2/d9/d10/d22 0 2024-02-28T16:01:57.500 INFO:tasks.workunit.client.1.smithi087.stdout:0/504: dwrite d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/f51 [0,4194304] 0 2024-02-28T16:01:57.501 INFO:tasks.workunit.client.0.smithi057.stdout:0/303: dwrite d6/d12/d38/f5c [0,4194304] 0 2024-02-28T16:01:57.502 INFO:tasks.workunit.client.1.smithi087.stdout:8/546: dread d2/f59 [0,4194304] 0 2024-02-28T16:01:57.505 INFO:tasks.workunit.client.1.smithi087.stdout:7/485: chown d14/d27/d5d/f5e 923182649 1 2024-02-28T16:01:57.509 INFO:tasks.workunit.client.1.smithi087.stdout:1/508: symlink d0/d1b/d43/laa 0 2024-02-28T16:01:57.510 INFO:tasks.workunit.client.1.smithi087.stdout:3/504: dread - d11/f2b zero size 2024-02-28T16:01:57.512 INFO:tasks.workunit.client.1.smithi087.stdout:3/505: chown d11/d61/d65/f70 8153489 1 2024-02-28T16:01:57.513 INFO:tasks.workunit.client.0.smithi057.stdout:0/304: symlink d6/d12/l61 0 2024-02-28T16:01:57.515 INFO:tasks.workunit.client.1.smithi087.stdout:3/506: write d11/d45/d73/f99 [713901,66455] 0 2024-02-28T16:01:57.517 INFO:tasks.workunit.client.0.smithi057.stdout:0/305: dread d6/d4e/f33 [0,4194304] 0 2024-02-28T16:01:57.517 INFO:tasks.workunit.client.0.smithi057.stdout:2/153: dread d19/f1a [0,4194304] 0 2024-02-28T16:01:57.523 INFO:tasks.workunit.client.1.smithi087.stdout:0/505: fsync d4/dd/d26/f2b 0 2024-02-28T16:01:57.523 INFO:tasks.workunit.client.1.smithi087.stdout:3/507: fdatasync d11/d61/d65/f70 0 2024-02-28T16:01:57.523 INFO:tasks.workunit.client.1.smithi087.stdout:7/486: rmdir d14/d7d 39 2024-02-28T16:01:57.525 INFO:tasks.workunit.client.1.smithi087.stdout:0/506: chown d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d76 1685 1 2024-02-28T16:01:57.526 INFO:tasks.workunit.client.0.smithi057.stdout:2/154: stat d19/d1d/d26/c2d 0 2024-02-28T16:01:57.526 INFO:tasks.workunit.client.1.smithi087.stdout:3/508: dread - d11/d33/d74/f95 zero size 2024-02-28T16:01:57.527 INFO:tasks.workunit.client.1.smithi087.stdout:0/507: readlink d4/dd/l30 0 2024-02-28T16:01:57.530 INFO:tasks.workunit.client.1.smithi087.stdout:0/508: dread - d4/dd/d21/f71 zero size 2024-02-28T16:01:57.531 INFO:tasks.workunit.client.1.smithi087.stdout:3/509: chown d11/d33/d67/d9c/da1/laa 447927 1 2024-02-28T16:01:57.534 INFO:tasks.workunit.client.1.smithi087.stdout:6/544: rename d4/dc/d61/f66 to d4/dc/d7e/fb3 0 2024-02-28T16:01:57.534 INFO:tasks.workunit.client.1.smithi087.stdout:0/509: truncate d4/dd/d37/f59 622254 0 2024-02-28T16:01:57.537 INFO:tasks.workunit.client.1.smithi087.stdout:6/545: truncate d4/d12/f6d 6725040 0 2024-02-28T16:01:57.538 INFO:tasks.workunit.client.0.smithi057.stdout:2/155: chown d19/d1d/d26/c2d 173 1 2024-02-28T16:01:57.538 INFO:tasks.workunit.client.1.smithi087.stdout:3/510: read d11/f2f [1823793,98375] 0 2024-02-28T16:01:57.539 INFO:tasks.workunit.client.1.smithi087.stdout:7/487: rmdir d14/d27/d5d 39 2024-02-28T16:01:57.540 INFO:tasks.workunit.client.0.smithi057.stdout:3/126: truncate d8/dd/d14/f17 3335086 0 2024-02-28T16:01:57.542 INFO:tasks.workunit.client.1.smithi087.stdout:7/488: truncate d14/d27/f76 628259 0 2024-02-28T16:01:57.549 INFO:tasks.workunit.client.1.smithi087.stdout:1/509: symlink d0/d14/lab 0 2024-02-28T16:01:57.553 INFO:tasks.workunit.client.1.smithi087.stdout:0/510: unlink d4/dd/d21/f81 0 2024-02-28T16:01:57.554 INFO:tasks.workunit.client.1.smithi087.stdout:1/510: read d0/d1a/d28/f29 [228699,55758] 0 2024-02-28T16:01:57.555 INFO:tasks.workunit.client.0.smithi057.stdout:2/156: creat d19/d2c/f30 x:0 0 0 2024-02-28T16:01:57.556 INFO:tasks.workunit.client.0.smithi057.stdout:4/182: dread d1/d14/f1b [0,4194304] 0 2024-02-28T16:01:57.557 INFO:tasks.workunit.client.1.smithi087.stdout:1/511: fsync d0/d1a/d28/f8d 0 2024-02-28T16:01:57.558 INFO:tasks.workunit.client.1.smithi087.stdout:6/546: write d4/dc/d61/d89/f9d [810615,81262] 0 2024-02-28T16:01:57.563 INFO:tasks.workunit.client.1.smithi087.stdout:3/511: dwrite d11/f15 [0,4194304] 0 2024-02-28T16:01:57.563 INFO:tasks.workunit.client.1.smithi087.stdout:3/512: chown d11/d33/d74 280058761 1 2024-02-28T16:01:57.568 INFO:tasks.workunit.client.0.smithi057.stdout:0/306: dwrite d6/d12/d17/d34/f3f [4194304,4194304] 0 2024-02-28T16:01:57.571 INFO:tasks.workunit.client.1.smithi087.stdout:6/547: dread d4/dc/f56 [0,4194304] 0 2024-02-28T16:01:57.573 INFO:tasks.workunit.client.1.smithi087.stdout:7/489: mknod d14/d27/d5d/d6a/c91 0 2024-02-28T16:01:57.577 INFO:tasks.workunit.client.1.smithi087.stdout:6/548: read d4/d30/d13/f2a [1497112,45040] 0 2024-02-28T16:01:57.579 INFO:tasks.workunit.client.1.smithi087.stdout:9/498: truncate d7/dd/d15/d79/f16 751373 0 2024-02-28T16:01:57.581 INFO:tasks.workunit.client.0.smithi057.stdout:6/143: dread df/d10/d13/f2e [0,4194304] 0 2024-02-28T16:01:57.585 INFO:tasks.workunit.client.0.smithi057.stdout:9/266: dwrite d2/d5/d1b/d2e/d44/f48 [0,4194304] 0 2024-02-28T16:01:57.586 INFO:tasks.workunit.client.1.smithi087.stdout:2/510: dwrite d2/d7/d17/d34/f4c [0,4194304] 0 2024-02-28T16:01:57.588 INFO:tasks.workunit.client.1.smithi087.stdout:5/585: rename d3/d9/cb6 to d3/d9/d9b/dba/cdc 0 2024-02-28T16:01:57.590 INFO:tasks.workunit.client.1.smithi087.stdout:6/549: getdents d4/d7d 0 2024-02-28T16:01:57.590 INFO:tasks.workunit.client.1.smithi087.stdout:0/511: getdents d4/d1c 0 2024-02-28T16:01:57.592 INFO:tasks.workunit.client.1.smithi087.stdout:7/490: read d14/d2e/d2b/d4e/f52 [5665,122183] 0 2024-02-28T16:01:57.593 INFO:tasks.workunit.client.0.smithi057.stdout:0/307: dread d6/d12/d45/f4f [0,4194304] 0 2024-02-28T16:01:57.593 INFO:tasks.workunit.client.0.smithi057.stdout:6/144: link f6 df/d14/f2f 0 2024-02-28T16:01:57.594 INFO:tasks.workunit.client.1.smithi087.stdout:3/513: rename d11/d33/f93 to d11/d33/d58/fac 0 2024-02-28T16:01:57.594 INFO:tasks.workunit.client.0.smithi057.stdout:2/157: dread d19/f23 [0,4194304] 0 2024-02-28T16:01:57.595 INFO:tasks.workunit.client.0.smithi057.stdout:0/308: readlink d6/l2c 0 2024-02-28T16:01:57.596 INFO:tasks.workunit.client.1.smithi087.stdout:4/571: dread d2/f4 [0,4194304] 0 2024-02-28T16:01:57.596 INFO:tasks.workunit.client.0.smithi057.stdout:2/158: read fe [3397974,94576] 0 2024-02-28T16:01:57.601 INFO:tasks.workunit.client.0.smithi057.stdout:6/145: creat df/d14/f30 x:0 0 0 2024-02-28T16:01:57.604 INFO:tasks.workunit.client.0.smithi057.stdout:6/146: chown l1 187 1 2024-02-28T16:01:57.604 INFO:tasks.workunit.client.0.smithi057.stdout:0/309: write d6/d12/d17/d34/f3f [2780253,74023] 0 2024-02-28T16:01:57.605 INFO:tasks.workunit.client.0.smithi057.stdout:2/159: unlink d19/c1c 0 2024-02-28T16:01:57.609 INFO:tasks.workunit.client.0.smithi057.stdout:9/267: creat d2/d5/d1b/f5b x:0 0 0 2024-02-28T16:01:57.611 INFO:tasks.workunit.client.0.smithi057.stdout:4/183: dwrite d1/d14/f33 [0,4194304] 0 2024-02-28T16:01:57.618 INFO:tasks.workunit.client.0.smithi057.stdout:9/268: write d2/d5/d1b/f5b [301036,72823] 0 2024-02-28T16:01:57.619 INFO:tasks.workunit.client.0.smithi057.stdout:6/147: write f6 [943270,108719] 0 2024-02-28T16:01:57.621 INFO:tasks.workunit.client.0.smithi057.stdout:9/269: write d2/d5/d1b/f5b [759679,40966] 0 2024-02-28T16:01:57.621 INFO:tasks.workunit.client.0.smithi057.stdout:2/160: rmdir d19/d1d/d26 39 2024-02-28T16:01:57.622 INFO:tasks.workunit.client.1.smithi087.stdout:0/512: mknod d4/dd/d21/ca5 0 2024-02-28T16:01:57.623 INFO:tasks.workunit.client.0.smithi057.stdout:0/310: rename d6/d12/l23 to d6/d12/d17/d58/l62 0 2024-02-28T16:01:57.624 INFO:tasks.workunit.client.1.smithi087.stdout:9/499: rename d7/dd/d15/d79/f1c to d7/dd/d15/d3f/d5f/f8f 0 2024-02-28T16:01:57.627 INFO:tasks.workunit.client.1.smithi087.stdout:3/514: mknod d11/d61/d7c/cad 0 2024-02-28T16:01:57.627 INFO:tasks.workunit.client.1.smithi087.stdout:8/547: dwrite d2/d18/f3c [0,4194304] 0 2024-02-28T16:01:57.630 INFO:tasks.workunit.client.1.smithi087.stdout:3/515: readlink d11/d44/d5b/l8a 0 2024-02-28T16:01:57.631 INFO:tasks.workunit.client.0.smithi057.stdout:8/231: dread f1 [0,4194304] 0 2024-02-28T16:01:57.632 INFO:tasks.workunit.client.1.smithi087.stdout:3/516: dread - d11/d33/fa0 zero size 2024-02-28T16:01:57.633 INFO:tasks.workunit.client.0.smithi057.stdout:6/148: creat df/d14/d15/d16/f31 x:0 0 0 2024-02-28T16:01:57.633 INFO:tasks.workunit.client.1.smithi087.stdout:9/500: mkdir d7/dd/d15/d3f/d5f/d90 0 2024-02-28T16:01:57.635 INFO:tasks.workunit.client.1.smithi087.stdout:4/572: truncate d2/d9/d10/d22/f6a 3892755 0 2024-02-28T16:01:57.637 INFO:tasks.workunit.client.1.smithi087.stdout:0/513: rename d4/dd/d37/d39/d3a/d57/d74/f85 to d4/dd/d37/d39/d3a/d57/d74/d1f/d60/fa6 0 2024-02-28T16:01:57.642 INFO:tasks.workunit.client.1.smithi087.stdout:3/517: dread d11/d33/d67/d98/d9b/f9d [0,4194304] 0 2024-02-28T16:01:57.646 INFO:tasks.workunit.client.0.smithi057.stdout:4/184: dread d1/d14/f33 [0,4194304] 0 2024-02-28T16:01:57.651 INFO:tasks.workunit.client.0.smithi057.stdout:9/270: creat d2/d5/d1b/d2e/f5c x:0 0 0 2024-02-28T16:01:57.656 INFO:tasks.workunit.client.1.smithi087.stdout:3/518: dread d11/d44/d5b/f5f [8388608,4194304] 0 2024-02-28T16:01:57.656 INFO:tasks.workunit.client.1.smithi087.stdout:0/514: creat d4/d6/d9c/fa7 x:0 0 0 2024-02-28T16:01:57.659 INFO:tasks.workunit.client.0.smithi057.stdout:0/311: dwrite d6/d12/d17/f51 [0,4194304] 0 2024-02-28T16:01:57.659 INFO:tasks.workunit.client.1.smithi087.stdout:4/573: dwrite d2/d9/da/f3f [0,4194304] 0 2024-02-28T16:01:57.662 INFO:tasks.workunit.client.0.smithi057.stdout:0/312: dread - d6/d12/d17/d34/f4d zero size 2024-02-28T16:01:57.664 INFO:tasks.workunit.client.1.smithi087.stdout:9/501: write d7/dd/d36/f3d [269675,96302] 0 2024-02-28T16:01:57.667 INFO:tasks.workunit.client.1.smithi087.stdout:0/515: rename d4/dd/d37/d39/d3a/d57/l94 to d4/d1c/la8 0 2024-02-28T16:01:57.668 INFO:tasks.workunit.client.0.smithi057.stdout:6/149: dwrite df/f1f [0,4194304] 0 2024-02-28T16:01:57.672 INFO:tasks.workunit.client.1.smithi087.stdout:4/574: truncate d2/d9/d9e/fba 661106 0 2024-02-28T16:01:57.674 INFO:tasks.workunit.client.1.smithi087.stdout:6/550: dwrite d4/d12/f21 [0,4194304] 0 2024-02-28T16:01:57.674 INFO:tasks.workunit.client.1.smithi087.stdout:3/519: link d11/d33/d67/f80 d11/d33/d67/d9c/da1/fae 0 2024-02-28T16:01:57.681 INFO:tasks.workunit.client.1.smithi087.stdout:8/548: dwrite d2/d33/f8f [8388608,4194304] 0 2024-02-28T16:01:57.685 INFO:tasks.workunit.client.0.smithi057.stdout:0/313: write d6/fa [1309336,25316] 0 2024-02-28T16:01:57.690 INFO:tasks.workunit.client.1.smithi087.stdout:6/551: creat d4/d12/d45/d5e/fb4 x:0 0 0 2024-02-28T16:01:57.691 INFO:tasks.workunit.client.1.smithi087.stdout:4/575: write d2/d9/d10/d22/fa1 [7414037,46484] 0 2024-02-28T16:01:57.693 INFO:tasks.workunit.client.1.smithi087.stdout:4/576: readlink d2/df/l42 0 2024-02-28T16:01:57.694 INFO:tasks.workunit.client.1.smithi087.stdout:7/491: dread d14/d21/f32 [0,4194304] 0 2024-02-28T16:01:57.694 INFO:tasks.workunit.client.0.smithi057.stdout:2/161: dwrite fe [4194304,4194304] 0 2024-02-28T16:01:57.695 INFO:tasks.workunit.client.0.smithi057.stdout:0/314: write d6/f29 [3707077,14602] 0 2024-02-28T16:01:57.700 INFO:tasks.workunit.client.1.smithi087.stdout:3/520: mkdir d11/d33/d67/d98/daf 0 2024-02-28T16:01:57.702 INFO:tasks.workunit.client.1.smithi087.stdout:8/549: creat d2/d9/d5e/d9c/d9f/fb7 x:0 0 0 2024-02-28T16:01:57.713 INFO:tasks.workunit.client.1.smithi087.stdout:0/516: dwrite d4/dd/d37/d39/d3a/d57/d74/d1f/d34/f35 [4194304,4194304] 0 2024-02-28T16:01:57.713 INFO:tasks.workunit.client.1.smithi087.stdout:3/521: unlink d11/d61/d7c/fa3 0 2024-02-28T16:01:57.713 INFO:tasks.workunit.client.1.smithi087.stdout:4/577: creat d2/d9/d10/d22/d5b/d5c/d91/da9/fca x:0 0 0 2024-02-28T16:01:57.713 INFO:tasks.workunit.client.0.smithi057.stdout:2/162: dread - d19/d2c/f30 zero size 2024-02-28T16:01:57.715 INFO:tasks.workunit.client.0.smithi057.stdout:3/127: dwrite d8/dd/d14/f1b [0,4194304] 0 2024-02-28T16:01:57.716 INFO:tasks.workunit.client.1.smithi087.stdout:3/522: truncate d11/d45/f8e 1221549 0 2024-02-28T16:01:57.718 INFO:tasks.workunit.client.1.smithi087.stdout:0/517: truncate d4/dd/d21/f71 69819 0 2024-02-28T16:01:57.719 INFO:tasks.workunit.client.1.smithi087.stdout:3/523: write d11/f17 [5295700,958] 0 2024-02-28T16:01:57.721 INFO:tasks.workunit.client.0.smithi057.stdout:9/271: dwrite d2/d5/f1a [0,4194304] 0 2024-02-28T16:01:57.723 INFO:tasks.workunit.client.0.smithi057.stdout:6/150: dread df/d10/d13/f2e [0,4194304] 0 2024-02-28T16:01:57.727 INFO:tasks.workunit.client.0.smithi057.stdout:3/128: mkdir d8/dd/d19/d2a 0 2024-02-28T16:01:57.732 INFO:tasks.workunit.client.1.smithi087.stdout:0/518: rename d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/f51 to d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/fa9 0 2024-02-28T16:01:57.733 INFO:tasks.workunit.client.0.smithi057.stdout:2/163: chown d19/d1d/d2e 12058936 1 2024-02-28T16:01:57.735 INFO:tasks.workunit.client.0.smithi057.stdout:0/315: getdents d6/d12/d45 0 2024-02-28T16:01:57.735 INFO:tasks.workunit.client.0.smithi057.stdout:8/232: dread d5/d6/f19 [0,4194304] 0 2024-02-28T16:01:57.737 INFO:tasks.workunit.client.0.smithi057.stdout:3/129: write d8/f13 [998321,31370] 0 2024-02-28T16:01:57.738 INFO:tasks.workunit.client.0.smithi057.stdout:2/164: readlink d19/d1d/l21 0 2024-02-28T16:01:57.739 INFO:tasks.workunit.client.1.smithi087.stdout:0/519: mknod d4/dd/d37/d39/d3a/caa 0 2024-02-28T16:01:57.740 INFO:tasks.workunit.client.0.smithi057.stdout:8/233: write d5/d6/f36 [912107,115144] 0 2024-02-28T16:01:57.743 INFO:tasks.workunit.client.0.smithi057.stdout:3/130: creat d8/dd/d19/d25/f2b x:0 0 0 2024-02-28T16:01:57.744 INFO:tasks.workunit.client.1.smithi087.stdout:4/578: dwrite d2/d9/d10/d22/fa1 [0,4194304] 0 2024-02-28T16:01:57.745 INFO:tasks.workunit.client.1.smithi087.stdout:3/524: dwrite d11/d33/f66 [0,4194304] 0 2024-02-28T16:01:57.747 INFO:tasks.workunit.client.0.smithi057.stdout:4/185: dread d1/f4 [0,4194304] 0 2024-02-28T16:01:57.755 INFO:tasks.workunit.client.0.smithi057.stdout:3/131: rmdir d8 39 2024-02-28T16:01:57.759 INFO:tasks.workunit.client.1.smithi087.stdout:8/550: rmdir d2/d9/d5e/d9c/d9f 39 2024-02-28T16:01:57.760 INFO:tasks.workunit.client.1.smithi087.stdout:3/525: rename d11/f28 to d11/fb0 0 2024-02-28T16:01:57.764 INFO:tasks.workunit.client.0.smithi057.stdout:8/234: creat d5/d20/d39/d49/f54 x:0 0 0 2024-02-28T16:01:57.766 INFO:tasks.workunit.client.1.smithi087.stdout:6/552: dread d4/d30/d13/f2a [0,4194304] 0 2024-02-28T16:01:57.766 INFO:tasks.workunit.client.1.smithi087.stdout:4/579: dread d2/d9/d10/d22/d5b/d5c/d91/f97 [0,4194304] 0 2024-02-28T16:01:57.767 INFO:tasks.workunit.client.1.smithi087.stdout:3/526: creat d11/d33/d67/d9c/fb1 x:0 0 0 2024-02-28T16:01:57.767 INFO:tasks.workunit.client.1.smithi087.stdout:7/492: dread d14/d2e/f22 [0,4194304] 0 2024-02-28T16:01:57.770 INFO:tasks.workunit.client.1.smithi087.stdout:8/551: read d2/f27 [3335499,58204] 0 2024-02-28T16:01:57.774 INFO:tasks.workunit.client.0.smithi057.stdout:6/151: dwrite df/d14/d15/f25 [0,4194304] 0 2024-02-28T16:01:57.776 INFO:tasks.workunit.client.1.smithi087.stdout:3/527: dread d11/d7b/f97 [0,4194304] 0 2024-02-28T16:01:57.776 INFO:tasks.workunit.client.1.smithi087.stdout:9/502: dread d7/dd/d15/d3f/d5f/f8f [4194304,4194304] 0 2024-02-28T16:01:57.777 INFO:tasks.workunit.client.1.smithi087.stdout:4/580: creat d2/d9/d10/dbf/db6/fcb x:0 0 0 2024-02-28T16:01:57.778 INFO:tasks.workunit.client.0.smithi057.stdout:0/316: dwrite d6/d12/d45/d55/f54 [0,4194304] 0 2024-02-28T16:01:57.779 INFO:tasks.workunit.client.1.smithi087.stdout:4/581: dread - d2/d9/da/d1a/d26/d69/fbc zero size 2024-02-28T16:01:57.781 INFO:tasks.workunit.client.1.smithi087.stdout:6/553: rename d4/fa to d4/dc/d7e/fb5 0 2024-02-28T16:01:57.783 INFO:tasks.workunit.client.1.smithi087.stdout:6/554: dread - d4/dc/d7e/fab zero size 2024-02-28T16:01:57.790 INFO:tasks.workunit.client.0.smithi057.stdout:0/317: write d6/d12/d17/d4b/f31 [2733305,3696] 0 2024-02-28T16:01:57.791 INFO:tasks.workunit.client.0.smithi057.stdout:3/132: dread f3 [0,4194304] 0 2024-02-28T16:01:57.792 INFO:tasks.workunit.client.1.smithi087.stdout:8/552: getdents d2/d9/d1a/d67 0 2024-02-28T16:01:57.798 INFO:tasks.workunit.client.1.smithi087.stdout:3/528: dwrite d11/f15 [0,4194304] 0 2024-02-28T16:01:57.799 INFO:tasks.workunit.client.1.smithi087.stdout:9/503: dread d7/dd/d15/f5a [0,4194304] 0 2024-02-28T16:01:57.800 INFO:tasks.workunit.client.1.smithi087.stdout:9/504: readlink d7/d1e/l2b 0 2024-02-28T16:01:57.800 INFO:tasks.workunit.client.1.smithi087.stdout:3/529: chown d11/d44/d5b/f4f 9268564 1 2024-02-28T16:01:57.803 INFO:tasks.workunit.client.1.smithi087.stdout:9/505: write f4 [2047439,8204] 0 2024-02-28T16:01:57.804 INFO:tasks.workunit.client.0.smithi057.stdout:2/165: dwrite d19/f23 [0,4194304] 0 2024-02-28T16:01:57.806 INFO:tasks.workunit.client.1.smithi087.stdout:0/520: dread d4/dd/d21/d9b/d7c/f98 [0,4194304] 0 2024-02-28T16:01:57.808 INFO:tasks.workunit.client.0.smithi057.stdout:0/318: creat d6/d12/d17/d34/f63 x:0 0 0 2024-02-28T16:01:57.813 INFO:tasks.workunit.client.1.smithi087.stdout:2/511: sync 2024-02-28T16:01:57.814 INFO:tasks.workunit.client.1.smithi087.stdout:5/586: sync 2024-02-28T16:01:57.814 INFO:tasks.workunit.client.1.smithi087.stdout:1/512: sync 2024-02-28T16:01:57.815 INFO:tasks.workunit.client.0.smithi057.stdout:8/235: truncate d5/de/f4d 2333055 0 2024-02-28T16:01:57.815 INFO:tasks.workunit.client.0.smithi057.stdout:3/133: mkdir d8/dd/d14/d2c 0 2024-02-28T16:01:57.817 INFO:tasks.workunit.client.0.smithi057.stdout:4/186: dwrite d1/d22/f35 [0,4194304] 0 2024-02-28T16:01:57.818 INFO:tasks.workunit.client.1.smithi087.stdout:3/530: unlink d11/d61/d7c/f7f 0 2024-02-28T16:01:57.819 INFO:tasks.workunit.client.0.smithi057.stdout:2/166: mkdir d19/d1d/d2e/d31 0 2024-02-28T16:01:57.824 INFO:tasks.workunit.client.0.smithi057.stdout:9/272: dread f0 [0,4194304] 0 2024-02-28T16:01:57.824 INFO:tasks.workunit.client.0.smithi057.stdout:8/236: creat d5/de/d1b/d45/f55 x:0 0 0 2024-02-28T16:01:57.826 INFO:tasks.workunit.client.0.smithi057.stdout:4/187: rmdir d1/d10/d12/d2c 39 2024-02-28T16:01:57.826 INFO:tasks.workunit.client.1.smithi087.stdout:5/587: mknod d3/d9/d4a/d5e/cdd 0 2024-02-28T16:01:57.827 INFO:tasks.workunit.client.0.smithi057.stdout:3/134: write f3 [1606244,112851] 0 2024-02-28T16:01:57.829 INFO:tasks.workunit.client.0.smithi057.stdout:6/152: dread df/d10/d13/f2e [0,4194304] 0 2024-02-28T16:01:57.832 INFO:tasks.workunit.client.0.smithi057.stdout:3/135: fdatasync d8/f18 0 2024-02-28T16:01:57.833 INFO:tasks.workunit.client.0.smithi057.stdout:2/167: symlink d19/d1d/l32 0 2024-02-28T16:01:57.836 INFO:tasks.workunit.client.1.smithi087.stdout:2/512: rename d2/d99/l5e to d2/d7/d17/d34/daf/lc1 0 2024-02-28T16:01:57.836 INFO:tasks.workunit.client.0.smithi057.stdout:4/188: rename d1/d10/d12/d15/d19/c41 to d1/d22/c44 0 2024-02-28T16:01:57.839 INFO:tasks.workunit.client.1.smithi087.stdout:6/555: getdents d4/da5 0 2024-02-28T16:01:57.840 INFO:tasks.workunit.client.0.smithi057.stdout:6/153: write df/d14/d15/f25 [4139922,65788] 0 2024-02-28T16:01:57.842 INFO:tasks.workunit.client.1.smithi087.stdout:2/513: dread - d2/d7/d17/f7e zero size 2024-02-28T16:01:57.845 INFO:tasks.workunit.client.1.smithi087.stdout:0/521: creat d4/dd/d26/d93/fab x:0 0 0 2024-02-28T16:01:57.847 INFO:tasks.workunit.client.0.smithi057.stdout:4/189: read d1/d10/d12/d15/d19/f2b [132640,117128] 0 2024-02-28T16:01:57.849 INFO:tasks.workunit.client.1.smithi087.stdout:7/493: write d14/d2e/d2b/f51 [1121926,94284] 0 2024-02-28T16:01:57.849 INFO:tasks.workunit.client.0.smithi057.stdout:3/136: link d8/dd/d14/f20 d8/dd/d19/f2d 0 2024-02-28T16:01:57.850 INFO:tasks.workunit.client.1.smithi087.stdout:3/531: rename d11/d33/d58/fac to d11/d33/d67/d9c/fb2 0 2024-02-28T16:01:57.851 INFO:tasks.workunit.client.1.smithi087.stdout:1/513: dwrite d0/d1a/d28/f29 [0,4194304] 0 2024-02-28T16:01:57.854 INFO:tasks.workunit.client.0.smithi057.stdout:6/154: dread - df/d14/f2d zero size 2024-02-28T16:01:57.855 INFO:tasks.workunit.client.1.smithi087.stdout:9/506: link d7/d1e/d44/d76/l84 d7/d1e/d44/d83/l91 0 2024-02-28T16:01:57.855 INFO:tasks.workunit.client.1.smithi087.stdout:4/582: write d2/d9/d10/d22/d5b/d5c/d68/f89 [50301,62213] 0 2024-02-28T16:01:57.856 INFO:tasks.workunit.client.0.smithi057.stdout:4/190: mknod d1/d14/c45 0 2024-02-28T16:01:57.857 INFO:tasks.workunit.client.0.smithi057.stdout:6/155: chown lb 30937 1 2024-02-28T16:01:57.859 INFO:tasks.workunit.client.0.smithi057.stdout:3/137: mkdir d8/dd/d14/d2e 0 2024-02-28T16:01:57.861 INFO:tasks.workunit.client.1.smithi087.stdout:2/514: read d2/d99/d28/f2e [3932832,100893] 0 2024-02-28T16:01:57.864 INFO:tasks.workunit.client.1.smithi087.stdout:8/553: dread d2/d9/f16 [4194304,4194304] 0 2024-02-28T16:01:57.864 INFO:tasks.workunit.client.0.smithi057.stdout:9/273: dwrite d2/f47 [0,4194304] 0 2024-02-28T16:01:57.864 INFO:tasks.workunit.client.0.smithi057.stdout:2/168: link ld d19/d1d/d26/l33 0 2024-02-28T16:01:57.865 INFO:tasks.workunit.client.1.smithi087.stdout:6/556: mkdir d4/d12/d45/d74/d9a/db6 0 2024-02-28T16:01:57.865 INFO:tasks.workunit.client.0.smithi057.stdout:6/156: readlink df/d10/d13/l28 0 2024-02-28T16:01:57.867 INFO:tasks.workunit.client.0.smithi057.stdout:3/138: read d8/dd/d14/f17 [1251899,23467] 0 2024-02-28T16:01:57.868 INFO:tasks.workunit.client.0.smithi057.stdout:2/169: readlink d19/d1d/d26/l33 0 2024-02-28T16:01:57.869 INFO:tasks.workunit.client.0.smithi057.stdout:3/139: fdatasync f3 0 2024-02-28T16:01:57.869 INFO:tasks.workunit.client.1.smithi087.stdout:9/507: stat d7/dd/f20 0 2024-02-28T16:01:57.870 INFO:tasks.workunit.client.1.smithi087.stdout:0/522: dwrite d4/d6/f14 [4194304,4194304] 0 2024-02-28T16:01:57.871 INFO:tasks.workunit.client.1.smithi087.stdout:1/514: write d0/d1b/f5d [1370137,47857] 0 2024-02-28T16:01:57.871 INFO:tasks.workunit.client.0.smithi057.stdout:2/170: readlink d19/d1d/l21 0 2024-02-28T16:01:57.876 INFO:tasks.workunit.client.0.smithi057.stdout:3/140: dread - d8/dd/d19/d25/f2b zero size 2024-02-28T16:01:57.878 INFO:tasks.workunit.client.0.smithi057.stdout:0/319: dread d6/f29 [0,4194304] 0 2024-02-28T16:01:57.879 INFO:tasks.workunit.client.1.smithi087.stdout:2/515: creat d2/d99/d28/d54/da6/fc2 x:0 0 0 2024-02-28T16:01:57.882 INFO:tasks.workunit.client.1.smithi087.stdout:4/583: creat d2/d9/d10/d22/d5b/d5c/d91/da9/fcc x:0 0 0 2024-02-28T16:01:57.882 INFO:tasks.workunit.client.1.smithi087.stdout:1/515: mkdir d0/d14/d86/dac 0 2024-02-28T16:01:57.882 INFO:tasks.workunit.client.1.smithi087.stdout:8/554: chown d2/d18/d42/d7b/l99 65 1 2024-02-28T16:01:57.884 INFO:tasks.workunit.client.1.smithi087.stdout:6/557: getdents d4/d30/d13/d67/daf 0 2024-02-28T16:01:57.886 INFO:tasks.workunit.client.0.smithi057.stdout:2/171: write f12 [146764,96238] 0 2024-02-28T16:01:57.888 INFO:tasks.workunit.client.0.smithi057.stdout:6/157: truncate df/d10/d13/f1e 4601354 0 2024-02-28T16:01:57.888 INFO:tasks.workunit.client.1.smithi087.stdout:3/532: getdents d11/d3a/d3c 0 2024-02-28T16:01:57.889 INFO:tasks.workunit.client.1.smithi087.stdout:7/494: dwrite d14/d2e/d2b/d4e/f56 [0,4194304] 0 2024-02-28T16:01:57.891 INFO:tasks.workunit.client.1.smithi087.stdout:2/516: symlink d2/d99/d28/d79/da3/lc3 0 2024-02-28T16:01:57.891 INFO:tasks.workunit.client.0.smithi057.stdout:3/141: truncate d8/dd/d14/f17 864177 0 2024-02-28T16:01:57.894 INFO:tasks.workunit.client.0.smithi057.stdout:4/191: getdents d1/d10/d12/d39 0 2024-02-28T16:01:57.895 INFO:tasks.workunit.client.0.smithi057.stdout:0/320: dread d6/d12/d45/d55/f50 [0,4194304] 0 2024-02-28T16:01:57.895 INFO:tasks.workunit.client.0.smithi057.stdout:3/142: chown d8/dd/d19/c22 7785 1 2024-02-28T16:01:57.896 INFO:tasks.workunit.client.1.smithi087.stdout:3/533: write d11/f15 [3013294,29900] 0 2024-02-28T16:01:57.896 INFO:tasks.workunit.client.1.smithi087.stdout:0/523: dwrite d4/dd/d21/f96 [0,4194304] 0 2024-02-28T16:01:57.896 INFO:tasks.workunit.client.1.smithi087.stdout:8/555: chown d2/d18/c8d 7 1 2024-02-28T16:01:57.898 INFO:tasks.workunit.client.0.smithi057.stdout:2/172: mkdir d19/d34 0 2024-02-28T16:01:57.898 INFO:tasks.workunit.client.0.smithi057.stdout:6/158: symlink df/d14/d15/l32 0 2024-02-28T16:01:57.899 INFO:tasks.workunit.client.0.smithi057.stdout:8/237: dread d5/de/d1b/f25 [0,4194304] 0 2024-02-28T16:01:57.905 INFO:tasks.workunit.client.0.smithi057.stdout:0/321: creat d6/d12/d17/d58/f64 x:0 0 0 2024-02-28T16:01:57.906 INFO:tasks.workunit.client.1.smithi087.stdout:5/588: truncate d3/d9/d9b/dba/f20 1300498 0 2024-02-28T16:01:57.909 INFO:tasks.workunit.client.0.smithi057.stdout:2/173: write d19/d1d/f20 [2780945,80542] 0 2024-02-28T16:01:57.909 INFO:tasks.workunit.client.1.smithi087.stdout:8/556: rmdir d2/d63 39 2024-02-28T16:01:57.913 INFO:tasks.workunit.client.1.smithi087.stdout:1/516: mkdir d0/d1b/d1f/d71/dad 0 2024-02-28T16:01:57.915 INFO:tasks.workunit.client.0.smithi057.stdout:8/238: dread d5/d6/f19 [0,4194304] 0 2024-02-28T16:01:57.915 INFO:tasks.workunit.client.0.smithi057.stdout:6/159: unlink fc 0 2024-02-28T16:01:57.916 INFO:tasks.workunit.client.1.smithi087.stdout:1/517: chown d0/d1a/l30 26 1 2024-02-28T16:01:57.916 INFO:tasks.workunit.client.1.smithi087.stdout:7/495: dread d14/d2e/d2b/d4e/f56 [0,4194304] 0 2024-02-28T16:01:57.918 INFO:tasks.workunit.client.0.smithi057.stdout:6/160: fdatasync df/d14/f2d 0 2024-02-28T16:01:57.919 INFO:tasks.workunit.client.0.smithi057.stdout:9/274: truncate f0 2834471 0 2024-02-28T16:01:57.919 INFO:tasks.workunit.client.0.smithi057.stdout:0/322: creat d6/f65 x:0 0 0 2024-02-28T16:01:57.919 INFO:tasks.workunit.client.1.smithi087.stdout:0/524: stat d4/dd/d37/d39/d3a/d57/d74/c5c 0 2024-02-28T16:01:57.919 INFO:tasks.workunit.client.1.smithi087.stdout:6/558: rename d4/d30/d83 to d4/d30/db7 0 2024-02-28T16:01:57.919 INFO:tasks.workunit.client.1.smithi087.stdout:2/517: dread d2/d7/d17/d34/f53 [0,4194304] 0 2024-02-28T16:01:57.920 INFO:tasks.workunit.client.1.smithi087.stdout:5/589: link d3/d64/d81/f47 d3/d64/d81/fde 0 2024-02-28T16:01:57.920 INFO:tasks.workunit.client.0.smithi057.stdout:4/192: mkdir d1/d10/d12/d2c/d37/d46 0 2024-02-28T16:01:57.921 INFO:tasks.workunit.client.1.smithi087.stdout:1/518: chown d0/d1b/d43/l6d 987177 1 2024-02-28T16:01:57.922 INFO:tasks.workunit.client.1.smithi087.stdout:5/590: fdatasync d3/f59 0 2024-02-28T16:01:57.923 INFO:tasks.workunit.client.1.smithi087.stdout:7/496: rename d14/d27/f76 to d14/d2e/d89/f92 0 2024-02-28T16:01:57.923 INFO:tasks.workunit.client.0.smithi057.stdout:4/193: write d1/d10/d12/d39/f3e [376291,115198] 0 2024-02-28T16:01:57.924 INFO:tasks.workunit.client.0.smithi057.stdout:3/143: mkdir d8/dd/d14/d2e/d2f 0 2024-02-28T16:01:57.926 INFO:tasks.workunit.client.0.smithi057.stdout:5/178: sync 2024-02-28T16:01:57.926 INFO:tasks.workunit.client.0.smithi057.stdout:7/148: sync 2024-02-28T16:01:57.926 INFO:tasks.workunit.client.0.smithi057.stdout:1/253: sync 2024-02-28T16:01:57.927 INFO:tasks.workunit.client.1.smithi087.stdout:7/497: read f7 [1152405,8939] 0 2024-02-28T16:01:57.927 INFO:tasks.workunit.client.1.smithi087.stdout:0/525: truncate d4/dd/d21/d5f/f72 1279636 0 2024-02-28T16:01:57.929 INFO:tasks.workunit.client.1.smithi087.stdout:5/591: rmdir d3/d9/d9b/dba 39 2024-02-28T16:01:57.929 INFO:tasks.workunit.client.0.smithi057.stdout:6/161: creat df/d14/d15/d16/f33 x:0 0 0 2024-02-28T16:01:57.929 INFO:tasks.workunit.client.0.smithi057.stdout:9/275: write d2/d5/f37 [703236,46388] 0 2024-02-28T16:01:57.930 INFO:tasks.workunit.client.1.smithi087.stdout:7/498: write d14/d2e/d2b/f50 [1184308,37884] 0 2024-02-28T16:01:57.932 INFO:tasks.workunit.client.0.smithi057.stdout:2/174: unlink c6 0 2024-02-28T16:01:57.933 INFO:tasks.workunit.client.0.smithi057.stdout:1/254: stat d1/c1b 0 2024-02-28T16:01:57.935 INFO:tasks.workunit.client.0.smithi057.stdout:2/175: dread - d19/d2c/f30 zero size 2024-02-28T16:01:57.937 INFO:tasks.workunit.client.1.smithi087.stdout:0/526: write d4/dd/d21/d9b/f42 [1954941,21224] 0 2024-02-28T16:01:57.937 INFO:tasks.workunit.client.0.smithi057.stdout:0/323: mknod d6/d12/d5d/c66 0 2024-02-28T16:01:57.938 INFO:tasks.workunit.client.0.smithi057.stdout:5/179: symlink d2/d3e/l41 0 2024-02-28T16:01:57.939 INFO:tasks.workunit.client.0.smithi057.stdout:7/149: dread d6/f14 [0,4194304] 0 2024-02-28T16:01:57.940 INFO:tasks.workunit.client.0.smithi057.stdout:9/276: mkdir d2/d5/d9/d5d 0 2024-02-28T16:01:57.944 INFO:tasks.workunit.client.0.smithi057.stdout:6/162: rename df/d14/d15/l21 to df/d14/d15/d16/l34 0 2024-02-28T16:01:57.946 INFO:tasks.workunit.client.0.smithi057.stdout:9/277: chown d2/d24/d1d/l26 504 1 2024-02-28T16:01:57.948 INFO:tasks.workunit.client.1.smithi087.stdout:7/499: creat d14/d2e/d2b/d4e/f93 x:0 0 0 2024-02-28T16:01:57.948 INFO:tasks.workunit.client.0.smithi057.stdout:0/324: creat d6/f67 x:0 0 0 2024-02-28T16:01:57.949 INFO:tasks.workunit.client.1.smithi087.stdout:2/518: link d2/d7/d17/d97/cb5 d2/d7/d17/d34/d88/cc4 0 2024-02-28T16:01:57.952 INFO:tasks.workunit.client.0.smithi057.stdout:3/144: dwrite d8/f12 [0,4194304] 0 2024-02-28T16:01:57.954 INFO:tasks.workunit.client.1.smithi087.stdout:4/584: dwrite d2/df/d2e/f43 [4194304,4194304] 0 2024-02-28T16:01:57.954 INFO:tasks.workunit.client.1.smithi087.stdout:5/592: link d3/d64/d81/f55 d3/d9/d4a/fdf 0 2024-02-28T16:01:57.956 INFO:tasks.workunit.client.1.smithi087.stdout:3/534: dread d11/f31 [0,4194304] 0 2024-02-28T16:01:57.956 INFO:tasks.workunit.client.0.smithi057.stdout:7/150: rmdir d6/dc 39 2024-02-28T16:01:57.957 INFO:tasks.workunit.client.1.smithi087.stdout:0/527: symlink d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/lac 0 2024-02-28T16:01:57.959 INFO:tasks.workunit.client.0.smithi057.stdout:5/180: mknod d2/d12/d3d/c42 0 2024-02-28T16:01:57.961 INFO:tasks.workunit.client.0.smithi057.stdout:5/181: readlink d2/l6 0 2024-02-28T16:01:57.962 INFO:tasks.workunit.client.1.smithi087.stdout:2/519: rmdir d2/d42 39 2024-02-28T16:01:57.963 INFO:tasks.workunit.client.0.smithi057.stdout:5/182: fsync d2/d15/f17 0 2024-02-28T16:01:57.964 INFO:tasks.workunit.client.0.smithi057.stdout:5/183: stat d2/d8/f16 0 2024-02-28T16:01:57.964 INFO:tasks.workunit.client.0.smithi057.stdout:2/176: rename d19/d1d/d26/c2d to d19/d2c/c35 0 2024-02-28T16:01:57.965 INFO:tasks.workunit.client.1.smithi087.stdout:6/559: dread d4/d12/d45/f5d [0,4194304] 0 2024-02-28T16:01:57.966 INFO:tasks.workunit.client.0.smithi057.stdout:2/177: dread - d19/f2b zero size 2024-02-28T16:01:57.970 INFO:tasks.workunit.client.0.smithi057.stdout:2/178: dread - d19/f2b zero size 2024-02-28T16:01:57.970 INFO:tasks.workunit.client.0.smithi057.stdout:8/239: dread d5/d6/fa [4194304,4194304] 0 2024-02-28T16:01:57.972 INFO:tasks.workunit.client.1.smithi087.stdout:5/593: symlink d3/d9/le0 0 2024-02-28T16:01:57.973 INFO:tasks.workunit.client.0.smithi057.stdout:4/194: link d1/d10/d12/d15/d19/f32 d1/d10/d31/d36/f47 0 2024-02-28T16:01:57.977 INFO:tasks.workunit.client.1.smithi087.stdout:3/535: creat d11/d7b/dab/fb3 x:0 0 0 2024-02-28T16:01:57.978 INFO:tasks.workunit.client.0.smithi057.stdout:3/145: mkdir d8/dd/d14/d2e/d30 0 2024-02-28T16:01:57.979 INFO:tasks.workunit.client.1.smithi087.stdout:2/520: rmdir d2/d7d/db4 0 2024-02-28T16:01:57.983 INFO:tasks.workunit.client.1.smithi087.stdout:6/560: dread d4/dc/d10/f19 [0,4194304] 0 2024-02-28T16:01:57.984 INFO:tasks.workunit.client.0.smithi057.stdout:5/184: truncate d2/d8/f16 5693973 0 2024-02-28T16:01:57.984 INFO:tasks.workunit.client.0.smithi057.stdout:0/325: dwrite d6/d12/d17/d34/f63 [0,4194304] 0 2024-02-28T16:01:57.985 INFO:tasks.workunit.client.1.smithi087.stdout:4/585: dwrite d2/d9/d10/d22/fa1 [4194304,4194304] 0 2024-02-28T16:01:57.987 INFO:tasks.workunit.client.1.smithi087.stdout:0/528: rename d4/dd/d21/d9b/f42 to d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/fad 0 2024-02-28T16:01:57.987 INFO:tasks.workunit.client.0.smithi057.stdout:5/185: chown d2/d8/c23 3048977 1 2024-02-28T16:01:57.987 INFO:tasks.workunit.client.0.smithi057.stdout:5/186: stat d2/d12/f30 0 2024-02-28T16:01:57.988 INFO:tasks.workunit.client.0.smithi057.stdout:9/278: mkdir d2/d5e 0 2024-02-28T16:01:57.990 INFO:tasks.workunit.client.1.smithi087.stdout:3/536: mknod d11/d44/d5b/cb4 0 2024-02-28T16:01:57.992 INFO:tasks.workunit.client.0.smithi057.stdout:9/279: truncate d2/d5/d9/f32 4491332 0 2024-02-28T16:01:57.994 INFO:tasks.workunit.client.1.smithi087.stdout:1/519: dread d0/f12 [0,4194304] 0 2024-02-28T16:01:57.994 INFO:tasks.workunit.client.1.smithi087.stdout:6/561: read d4/d30/d13/d67/f87 [2850378,11374] 0 2024-02-28T16:01:57.995 INFO:tasks.workunit.client.1.smithi087.stdout:7/500: dwrite d14/d2e/d89/f92 [0,4194304] 0 2024-02-28T16:01:57.996 INFO:tasks.workunit.client.0.smithi057.stdout:9/280: dread - d2/d5/d1b/d2e/f5c zero size 2024-02-28T16:01:57.998 INFO:tasks.workunit.client.0.smithi057.stdout:3/146: unlink d8/f13 0 2024-02-28T16:01:58.000 INFO:tasks.workunit.client.0.smithi057.stdout:0/326: dread d6/d12/d45/d55/f54 [0,4194304] 0 2024-02-28T16:01:58.000 INFO:tasks.workunit.client.1.smithi087.stdout:5/594: rename d3/d9/d9b/dba/f26 to d3/d9/d9b/dba/d30/d36/d4f/fe1 0 2024-02-28T16:01:58.005 INFO:tasks.workunit.client.1.smithi087.stdout:4/586: creat d2/df/d2e/fcd x:0 0 0 2024-02-28T16:01:58.007 INFO:tasks.workunit.client.0.smithi057.stdout:7/151: creat d6/dc/d12/d1a/f37 x:0 0 0 2024-02-28T16:01:58.009 INFO:tasks.workunit.client.0.smithi057.stdout:7/152: chown d6/dc 1741972 1 2024-02-28T16:01:58.010 INFO:tasks.workunit.client.0.smithi057.stdout:7/153: readlink d6/dc/d12/l32 0 2024-02-28T16:01:58.013 INFO:tasks.workunit.client.1.smithi087.stdout:7/501: mkdir d14/d27/d5d/d6a/d94 0 2024-02-28T16:01:58.014 INFO:tasks.workunit.client.1.smithi087.stdout:3/537: dread d11/d33/f66 [0,4194304] 0 2024-02-28T16:01:58.015 INFO:tasks.workunit.client.1.smithi087.stdout:1/520: mkdir d0/d1d/dae 0 2024-02-28T16:01:58.017 INFO:tasks.workunit.client.1.smithi087.stdout:2/521: truncate d2/d7/d17/d3d/f55 7968206 0 2024-02-28T16:01:58.018 INFO:tasks.workunit.client.0.smithi057.stdout:2/179: rename lc to d19/d2c/l36 0 2024-02-28T16:01:58.019 INFO:tasks.workunit.client.1.smithi087.stdout:6/562: dwrite d4/dc/d61/d89/f9d [0,4194304] 0 2024-02-28T16:01:58.021 INFO:tasks.workunit.client.1.smithi087.stdout:1/521: write d0/d1b/d43/d4d/f74 [1329155,110427] 0 2024-02-28T16:01:58.023 INFO:tasks.workunit.client.1.smithi087.stdout:4/587: unlink d2/d9/l77 0 2024-02-28T16:01:58.026 INFO:tasks.workunit.client.1.smithi087.stdout:3/538: mknod d11/d7b/dab/cb5 0 2024-02-28T16:01:58.026 INFO:tasks.workunit.client.1.smithi087.stdout:4/588: readlink d2/d9/l40 0 2024-02-28T16:01:58.026 INFO:tasks.workunit.client.1.smithi087.stdout:7/502: fsync d14/d27/d5d/d6a/d83/f8a 0 2024-02-28T16:01:58.027 INFO:tasks.workunit.client.1.smithi087.stdout:2/522: stat d2/d99/d28/d79/da3/cb1 0 2024-02-28T16:01:58.027 INFO:tasks.workunit.client.0.smithi057.stdout:1/255: truncate d1/d21/f39 488315 0 2024-02-28T16:01:58.028 INFO:tasks.workunit.client.0.smithi057.stdout:9/281: stat d2/l3e 0 2024-02-28T16:01:58.030 INFO:tasks.workunit.client.1.smithi087.stdout:0/529: getdents d4/dd/d37/d39/d3a/d57/d74/d1f 0 2024-02-28T16:01:58.032 INFO:tasks.workunit.client.1.smithi087.stdout:7/503: truncate d14/f2a 5918807 0 2024-02-28T16:01:58.032 INFO:tasks.workunit.client.1.smithi087.stdout:3/539: write d11/d33/d67/d9c/f9f [1047596,39158] 0 2024-02-28T16:01:58.032 INFO:tasks.workunit.client.0.smithi057.stdout:0/327: fdatasync d6/d12/d45/f4f 0 2024-02-28T16:01:58.032 INFO:tasks.workunit.client.0.smithi057.stdout:1/256: dread - d1/d21/d25/d26/d44/f58 zero size 2024-02-28T16:01:58.033 INFO:tasks.workunit.client.1.smithi087.stdout:1/522: rename d0/fd to d0/d1a/d28/d9b/faf 0 2024-02-28T16:01:58.035 INFO:tasks.workunit.client.0.smithi057.stdout:4/195: dread - d1/d10/d12/d15/d19/f32 zero size 2024-02-28T16:01:58.037 INFO:tasks.workunit.client.1.smithi087.stdout:4/589: rename d2/c3 to d2/d9/d10/d22/db3/cce 0 2024-02-28T16:01:58.038 INFO:tasks.workunit.client.0.smithi057.stdout:4/196: chown d1/d14/f34 3767 1 2024-02-28T16:01:58.039 INFO:tasks.workunit.client.1.smithi087.stdout:7/504: fsync d14/d2e/d2b/d4e/f93 0 2024-02-28T16:01:58.039 INFO:tasks.workunit.client.1.smithi087.stdout:1/523: fsync d0/d1d/f72 0 2024-02-28T16:01:58.047 INFO:tasks.workunit.client.0.smithi057.stdout:2/180: fdatasync f12 0 2024-02-28T16:01:58.048 INFO:tasks.workunit.client.0.smithi057.stdout:8/240: rename d5/de/d47 to d5/d20/d39/d49/d56 0 2024-02-28T16:01:58.048 INFO:tasks.workunit.client.1.smithi087.stdout:6/563: write d4/d30/d13/f2a [3739435,70814] 0 2024-02-28T16:01:58.049 INFO:tasks.workunit.client.0.smithi057.stdout:2/181: read f10 [3741659,45564] 0 2024-02-28T16:01:58.050 INFO:tasks.workunit.client.0.smithi057.stdout:8/241: read - d5/f2f zero size 2024-02-28T16:01:58.051 INFO:tasks.workunit.client.1.smithi087.stdout:5/595: dread d3/d9/fd [0,4194304] 0 2024-02-28T16:01:58.053 INFO:tasks.workunit.client.0.smithi057.stdout:6/163: link ld df/d10/l35 0 2024-02-28T16:01:58.054 INFO:tasks.workunit.client.1.smithi087.stdout:2/523: write d2/f3e [99185,96154] 0 2024-02-28T16:01:58.054 INFO:tasks.workunit.client.1.smithi087.stdout:7/505: getdents d14/d27/d5d/d6a/d94 0 2024-02-28T16:01:58.054 INFO:tasks.workunit.client.1.smithi087.stdout:1/524: link d0/f70 d0/d14/d86/fb0 0 2024-02-28T16:01:58.055 INFO:tasks.workunit.client.0.smithi057.stdout:6/164: chown l4 132 1 2024-02-28T16:01:58.056 INFO:tasks.workunit.client.1.smithi087.stdout:5/596: read d3/d9/fc6 [3496866,80699] 0 2024-02-28T16:01:58.056 INFO:tasks.workunit.client.1.smithi087.stdout:8/557: sync 2024-02-28T16:01:58.056 INFO:tasks.workunit.client.1.smithi087.stdout:9/508: sync 2024-02-28T16:01:58.057 INFO:tasks.workunit.client.0.smithi057.stdout:0/328: symlink d6/l68 0 2024-02-28T16:01:58.057 INFO:tasks.workunit.client.1.smithi087.stdout:6/564: unlink d4/dc/c59 0 2024-02-28T16:01:58.058 INFO:tasks.workunit.client.0.smithi057.stdout:6/165: stat df/d10/d13/l28 0 2024-02-28T16:01:58.059 INFO:tasks.workunit.client.1.smithi087.stdout:4/590: creat d2/d9/d10/d22/d5b/fcf x:0 0 0 2024-02-28T16:01:58.060 INFO:tasks.workunit.client.0.smithi057.stdout:4/197: symlink d1/d10/d12/d15/l48 0 2024-02-28T16:01:58.061 INFO:tasks.workunit.client.1.smithi087.stdout:7/506: write d14/d2e/d2b/d4e/f93 [821071,127605] 0 2024-02-28T16:01:58.061 INFO:tasks.workunit.client.1.smithi087.stdout:0/530: truncate d4/d6/f14 5184457 0 2024-02-28T16:01:58.063 INFO:tasks.workunit.client.0.smithi057.stdout:7/154: mkdir d6/d38 0 2024-02-28T16:01:58.065 INFO:tasks.workunit.client.1.smithi087.stdout:7/507: write f12 [3419278,28470] 0 2024-02-28T16:01:58.067 INFO:tasks.workunit.client.1.smithi087.stdout:0/531: dread - d4/dd/d21/f69 zero size 2024-02-28T16:01:58.069 INFO:tasks.workunit.client.1.smithi087.stdout:6/565: write d4/dc/d10/f19 [131297,33821] 0 2024-02-28T16:01:58.071 INFO:tasks.workunit.client.1.smithi087.stdout:1/525: truncate d0/d14/f20 1286501 0 2024-02-28T16:01:58.071 INFO:tasks.workunit.client.0.smithi057.stdout:8/242: mkdir d5/de/d1b/d57 0 2024-02-28T16:01:58.072 INFO:tasks.workunit.client.1.smithi087.stdout:4/591: rmdir d2/d49 39 2024-02-28T16:01:58.075 INFO:tasks.workunit.client.1.smithi087.stdout:3/540: dread d11/d44/d5b/f5a [0,4194304] 0 2024-02-28T16:01:58.076 INFO:tasks.workunit.client.1.smithi087.stdout:7/508: symlink d14/d21/d4f/l95 0 2024-02-28T16:01:58.076 INFO:tasks.workunit.client.0.smithi057.stdout:0/329: symlink d6/l69 0 2024-02-28T16:01:58.079 INFO:tasks.workunit.client.1.smithi087.stdout:8/558: creat d2/d63/fb8 x:0 0 0 2024-02-28T16:01:58.081 INFO:tasks.workunit.client.1.smithi087.stdout:5/597: symlink d3/d9/d9b/dba/le2 0 2024-02-28T16:01:58.084 INFO:tasks.workunit.client.0.smithi057.stdout:2/182: rename d19/f27 to d19/f37 0 2024-02-28T16:01:58.084 INFO:tasks.workunit.client.0.smithi057.stdout:5/187: dwrite d2/d8/f16 [0,4194304] 0 2024-02-28T16:01:58.084 INFO:tasks.workunit.client.0.smithi057.stdout:8/243: fdatasync d5/d6/fa 0 2024-02-28T16:01:58.088 INFO:tasks.workunit.client.1.smithi087.stdout:4/592: rename d2/df/d65/d8d/faf to d2/df/d62/fd0 0 2024-02-28T16:01:58.089 INFO:tasks.workunit.client.1.smithi087.stdout:5/598: chown d3/d64/c77 900746 1 2024-02-28T16:01:58.089 INFO:tasks.workunit.client.1.smithi087.stdout:0/532: dwrite d4/dd/d21/d52/f6e [0,4194304] 0 2024-02-28T16:01:58.089 INFO:tasks.workunit.client.0.smithi057.stdout:2/183: write d19/d2c/f30 [426218,101217] 0 2024-02-28T16:01:58.089 INFO:tasks.workunit.client.0.smithi057.stdout:7/155: unlink d6/dc/d12/c15 0 2024-02-28T16:01:58.089 INFO:tasks.workunit.client.0.smithi057.stdout:5/188: chown d2/d12/f24 1851813 1 2024-02-28T16:01:58.091 INFO:tasks.workunit.client.0.smithi057.stdout:3/147: dread d8/fa [0,4194304] 0 2024-02-28T16:01:58.091 INFO:tasks.workunit.client.0.smithi057.stdout:9/282: rename d2/f47 to d2/d5/d1b/f5f 0 2024-02-28T16:01:58.093 INFO:tasks.workunit.client.1.smithi087.stdout:2/524: dwrite d2/f87 [0,4194304] 0 2024-02-28T16:01:58.093 INFO:tasks.workunit.client.0.smithi057.stdout:5/189: fdatasync d2/f10 0 2024-02-28T16:01:58.095 INFO:tasks.workunit.client.0.smithi057.stdout:1/257: getdents d1/d3/dc/d40 0 2024-02-28T16:01:58.096 INFO:tasks.workunit.client.0.smithi057.stdout:9/283: readlink d2/d33/l12 0 2024-02-28T16:01:58.097 INFO:tasks.workunit.client.1.smithi087.stdout:8/559: creat d2/d7c/fb9 x:0 0 0 2024-02-28T16:01:58.098 INFO:tasks.workunit.client.0.smithi057.stdout:6/166: creat df/d10/f36 x:0 0 0 2024-02-28T16:01:58.101 INFO:tasks.workunit.client.0.smithi057.stdout:8/244: mknod d5/d20/d39/d49/c58 0 2024-02-28T16:01:58.101 INFO:tasks.workunit.client.0.smithi057.stdout:7/156: read d6/dc/f2f [2767792,121056] 0 2024-02-28T16:01:58.103 INFO:tasks.workunit.client.0.smithi057.stdout:8/245: chown d5/d20/f38 529 1 2024-02-28T16:01:58.105 INFO:tasks.workunit.client.1.smithi087.stdout:4/593: truncate d2/d9/da/d1a/d26/d69/fa6 248012 0 2024-02-28T16:01:58.108 INFO:tasks.workunit.client.0.smithi057.stdout:0/330: rename c1 to d6/d12/d38/d5e/c6a 0 2024-02-28T16:01:58.110 INFO:tasks.workunit.client.0.smithi057.stdout:9/284: creat d2/d24/d1d/f60 x:0 0 0 2024-02-28T16:01:58.110 INFO:tasks.workunit.client.0.smithi057.stdout:4/198: getdents d1/d10/d12/d2c 0 2024-02-28T16:01:58.111 INFO:tasks.workunit.client.1.smithi087.stdout:6/566: write d4/d12/d45/f39 [1903261,10999] 0 2024-02-28T16:01:58.111 INFO:tasks.workunit.client.1.smithi087.stdout:2/525: creat d2/d9a/fc5 x:0 0 0 2024-02-28T16:01:58.115 INFO:tasks.workunit.client.1.smithi087.stdout:0/533: truncate d4/dd/d37/d39/d3a/d57/d74/f44 4483877 0 2024-02-28T16:01:58.115 INFO:tasks.workunit.client.0.smithi057.stdout:5/190: rename d2/d12/f24 to d2/d15/f43 0 2024-02-28T16:01:58.116 INFO:tasks.workunit.client.0.smithi057.stdout:0/331: truncate d6/d12/d17/f59 600629 0 2024-02-28T16:01:58.117 INFO:tasks.workunit.client.0.smithi057.stdout:1/258: creat d1/d21/d42/f5a x:0 0 0 2024-02-28T16:01:58.120 INFO:tasks.workunit.client.0.smithi057.stdout:8/246: fsync f1 0 2024-02-28T16:01:58.120 INFO:tasks.workunit.client.1.smithi087.stdout:9/509: dwrite d7/f12 [4194304,4194304] 0 2024-02-28T16:01:58.120 INFO:tasks.workunit.client.0.smithi057.stdout:3/148: link d8/dd/d19/c22 d8/dd/d14/c31 0 2024-02-28T16:01:58.123 INFO:tasks.workunit.client.0.smithi057.stdout:9/285: mknod d2/d46/c61 0 2024-02-28T16:01:58.124 INFO:tasks.workunit.client.1.smithi087.stdout:7/509: dwrite d14/d2e/d2b/f51 [0,4194304] 0 2024-02-28T16:01:58.124 INFO:tasks.workunit.client.1.smithi087.stdout:6/567: mkdir d4/d30/d13/d67/db8 0 2024-02-28T16:01:58.127 INFO:tasks.workunit.client.0.smithi057.stdout:3/149: truncate d8/dd/d19/d25/f2b 288332 0 2024-02-28T16:01:58.127 INFO:tasks.workunit.client.0.smithi057.stdout:4/199: chown d1/d22/c44 74 1 2024-02-28T16:01:58.127 INFO:tasks.workunit.client.1.smithi087.stdout:0/534: symlink d4/dd/lae 0 2024-02-28T16:01:58.127 INFO:tasks.workunit.client.1.smithi087.stdout:3/541: dwrite d11/f30 [0,4194304] 0 2024-02-28T16:01:58.130 INFO:tasks.workunit.client.0.smithi057.stdout:6/167: rename df/d14/f2f to df/d14/d15/f37 0 2024-02-28T16:01:58.130 INFO:tasks.workunit.client.0.smithi057.stdout:4/200: read d1/d14/f23 [2975244,13786] 0 2024-02-28T16:01:58.132 INFO:tasks.workunit.client.0.smithi057.stdout:6/168: stat df/d10/f36 0 2024-02-28T16:01:58.133 INFO:tasks.workunit.client.0.smithi057.stdout:2/184: link d19/d2c/c35 d19/d34/c38 0 2024-02-28T16:01:58.133 INFO:tasks.workunit.client.0.smithi057.stdout:1/259: readlink d1/d21/l49 0 2024-02-28T16:01:58.133 INFO:tasks.workunit.client.1.smithi087.stdout:7/510: stat d14/d27/d5d/d6a/l77 0 2024-02-28T16:01:58.135 INFO:tasks.workunit.client.1.smithi087.stdout:6/568: truncate d4/dc/d7e/f9c 1102465 0 2024-02-28T16:01:58.138 INFO:tasks.workunit.client.1.smithi087.stdout:2/526: getdents d2/d42 0 2024-02-28T16:01:58.140 INFO:tasks.workunit.client.0.smithi057.stdout:3/150: mknod d8/c32 0 2024-02-28T16:01:58.140 INFO:tasks.workunit.client.0.smithi057.stdout:0/332: truncate d6/d12/d45/d55/f54 1357265 0 2024-02-28T16:01:58.142 INFO:tasks.workunit.client.0.smithi057.stdout:4/201: mknod d1/d1f/c49 0 2024-02-28T16:01:58.142 INFO:tasks.workunit.client.0.smithi057.stdout:7/157: link d6/dc/f18 d6/dc/d35/f39 0 2024-02-28T16:01:58.142 INFO:tasks.workunit.client.0.smithi057.stdout:9/286: dread d2/d5/d1b/f5f [0,4194304] 0 2024-02-28T16:01:58.144 INFO:tasks.workunit.client.1.smithi087.stdout:6/569: chown d4/dc/c6c 221344232 1 2024-02-28T16:01:58.145 INFO:tasks.workunit.client.0.smithi057.stdout:4/202: chown d1/d14/f23 106 1 2024-02-28T16:01:58.145 INFO:tasks.workunit.client.1.smithi087.stdout:2/527: stat d2/d99/d28/d79/c86 0 2024-02-28T16:01:58.145 INFO:tasks.workunit.client.1.smithi087.stdout:5/599: truncate d3/d64/d67/fa4 1320570 0 2024-02-28T16:01:58.145 INFO:tasks.workunit.client.1.smithi087.stdout:4/594: dread d2/df/d2e/f43 [4194304,4194304] 0 2024-02-28T16:01:58.146 INFO:tasks.workunit.client.0.smithi057.stdout:2/185: mknod d19/d1d/d26/c39 0 2024-02-28T16:01:58.147 INFO:tasks.workunit.client.0.smithi057.stdout:4/203: chown d1/d10/f43 3 1 2024-02-28T16:01:58.148 INFO:tasks.workunit.client.0.smithi057.stdout:7/158: write d6/f23 [4839666,53317] 0 2024-02-28T16:01:58.151 INFO:tasks.workunit.client.0.smithi057.stdout:7/159: chown d6/l9 2626523 1 2024-02-28T16:01:58.156 INFO:tasks.workunit.client.1.smithi087.stdout:0/535: symlink d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/laf 0 2024-02-28T16:01:58.158 INFO:tasks.workunit.client.1.smithi087.stdout:7/511: mkdir d14/d27/d5d/d6a/d83/d96 0 2024-02-28T16:01:58.160 INFO:tasks.workunit.client.0.smithi057.stdout:2/186: mkdir d19/d3a 0 2024-02-28T16:01:58.161 INFO:tasks.workunit.client.1.smithi087.stdout:5/600: rmdir d3/d9/d9b/dba/d30/d44/db9 39 2024-02-28T16:01:58.161 INFO:tasks.workunit.client.1.smithi087.stdout:4/595: creat d2/df/d65/d8d/fd1 x:0 0 0 2024-02-28T16:01:58.162 INFO:tasks.workunit.client.0.smithi057.stdout:2/187: fsync d19/d1d/f20 0 2024-02-28T16:01:58.162 INFO:tasks.workunit.client.0.smithi057.stdout:1/260: fsync d1/d21/d42/f5a 0 2024-02-28T16:01:58.164 INFO:tasks.workunit.client.0.smithi057.stdout:8/247: rmdir d5/d53 0 2024-02-28T16:01:58.165 INFO:tasks.workunit.client.0.smithi057.stdout:4/204: unlink d1/d1f/f2f 0 2024-02-28T16:01:58.166 INFO:tasks.workunit.client.1.smithi087.stdout:9/510: dwrite d7/dd/d3c/d4c/f8c [4194304,4194304] 0 2024-02-28T16:01:58.169 INFO:tasks.workunit.client.0.smithi057.stdout:4/205: chown d1/d1f/c49 3 1 2024-02-28T16:01:58.172 INFO:tasks.workunit.client.1.smithi087.stdout:4/596: truncate d2/d9/da/d1a/d26/d69/f74 617180 0 2024-02-28T16:01:58.173 INFO:tasks.workunit.client.1.smithi087.stdout:9/511: fsync d7/dd/d15/d79/d2e/f8b 0 2024-02-28T16:01:58.174 INFO:tasks.workunit.client.1.smithi087.stdout:2/528: rename d2/d99/d28/d54/da6/fc2 to d2/d99/d28/fc6 0 2024-02-28T16:01:58.176 INFO:tasks.workunit.client.1.smithi087.stdout:3/542: getdents d11/d33/d67/d9c/da1 0 2024-02-28T16:01:58.179 INFO:tasks.workunit.client.0.smithi057.stdout:8/248: mkdir d5/d20/d39/d59 0 2024-02-28T16:01:58.180 INFO:tasks.workunit.client.1.smithi087.stdout:8/560: dread d2/d9/f17 [0,4194304] 0 2024-02-28T16:01:58.181 INFO:tasks.workunit.client.0.smithi057.stdout:0/333: dwrite d6/f29 [4194304,4194304] 0 2024-02-28T16:01:58.181 INFO:tasks.workunit.client.1.smithi087.stdout:3/543: write d11/f46 [1289555,70017] 0 2024-02-28T16:01:58.184 INFO:tasks.workunit.client.1.smithi087.stdout:4/597: chown d2/d9/da/d1a/d26/d69/l6b 243 1 2024-02-28T16:01:58.186 INFO:tasks.workunit.client.0.smithi057.stdout:7/160: symlink d6/d38/l3a 0 2024-02-28T16:01:58.188 INFO:tasks.workunit.client.0.smithi057.stdout:6/169: getdents df/d14/d15 0 2024-02-28T16:01:58.189 INFO:tasks.workunit.client.1.smithi087.stdout:0/536: dwrite d4/dd/d37/d39/d3a/f7d [4194304,4194304] 0 2024-02-28T16:01:58.189 INFO:tasks.workunit.client.1.smithi087.stdout:7/512: rename d14/d2e/d89/f92 to d14/f97 0 2024-02-28T16:01:58.191 INFO:tasks.workunit.client.0.smithi057.stdout:6/170: fdatasync df/d10/f36 0 2024-02-28T16:01:58.193 INFO:tasks.workunit.client.1.smithi087.stdout:7/513: truncate d14/d27/d5d/f5e 446328 0 2024-02-28T16:01:58.196 INFO:tasks.workunit.client.0.smithi057.stdout:6/171: read df/d14/d15/f37 [165582,41148] 0 2024-02-28T16:01:58.196 INFO:tasks.workunit.client.1.smithi087.stdout:3/544: readlink d11/d3a/l51 0 2024-02-28T16:01:58.198 INFO:tasks.workunit.client.1.smithi087.stdout:6/570: truncate d4/f20 2090733 0 2024-02-28T16:01:58.200 INFO:tasks.workunit.client.1.smithi087.stdout:0/537: dread d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/fa9 [4194304,4194304] 0 2024-02-28T16:01:58.202 INFO:tasks.workunit.client.1.smithi087.stdout:5/601: dread d3/d9/d9b/dba/d30/d36/d4f/fe1 [0,4194304] 0 2024-02-28T16:01:58.203 INFO:tasks.workunit.client.1.smithi087.stdout:0/538: chown d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/fad 0 1 2024-02-28T16:01:58.204 INFO:tasks.workunit.client.1.smithi087.stdout:9/512: truncate d7/dd/d15/d79/f16 790955 0 2024-02-28T16:01:58.205 INFO:tasks.workunit.client.1.smithi087.stdout:5/602: fdatasync d3/d9/d9b/dba/d30/d8f/fa2 0 2024-02-28T16:01:58.206 INFO:tasks.workunit.client.1.smithi087.stdout:7/514: fdatasync d14/f97 0 2024-02-28T16:01:58.207 INFO:tasks.workunit.client.1.smithi087.stdout:8/561: creat d2/d9/d5e/d9c/d9f/fba x:0 0 0 2024-02-28T16:01:58.210 INFO:tasks.workunit.client.1.smithi087.stdout:6/571: symlink d4/d12/d45/d5e/lb9 0 2024-02-28T16:01:58.214 INFO:tasks.workunit.client.1.smithi087.stdout:9/513: creat d7/d1e/d44/f92 x:0 0 0 2024-02-28T16:01:58.214 INFO:tasks.workunit.client.0.smithi057.stdout:4/206: rename d1/d10/d12/d15/d19/f32 to d1/d10/d12/d15/f4a 0 2024-02-28T16:01:58.215 INFO:tasks.workunit.client.0.smithi057.stdout:4/207: stat d1/d3f 0 2024-02-28T16:01:58.216 INFO:tasks.workunit.client.1.smithi087.stdout:4/598: creat d2/d9/d10/d22/d5b/fd2 x:0 0 0 2024-02-28T16:01:58.217 INFO:tasks.workunit.client.1.smithi087.stdout:8/562: mkdir d2/d18/d42/dbb 0 2024-02-28T16:01:58.219 INFO:tasks.workunit.client.1.smithi087.stdout:7/515: creat d14/d2e/d2b/d4e/f98 x:0 0 0 2024-02-28T16:01:58.221 INFO:tasks.workunit.client.1.smithi087.stdout:4/599: chown d2/d9/d10/c4e 20321961 1 2024-02-28T16:01:58.223 INFO:tasks.workunit.client.1.smithi087.stdout:7/516: write d14/d27/d5d/f75 [828937,40519] 0 2024-02-28T16:01:58.224 INFO:tasks.workunit.client.0.smithi057.stdout:7/161: dread d6/dc/fd [0,4194304] 0 2024-02-28T16:01:58.226 INFO:tasks.workunit.client.1.smithi087.stdout:3/545: getdents d11/d45 0 2024-02-28T16:01:58.229 INFO:tasks.workunit.client.1.smithi087.stdout:0/539: dwrite d4/dd/d37/f3d [0,4194304] 0 2024-02-28T16:01:58.229 INFO:tasks.workunit.client.1.smithi087.stdout:7/517: chown d14/d2e/d2b/f2c 1 1 2024-02-28T16:01:58.230 INFO:tasks.workunit.client.1.smithi087.stdout:3/546: fdatasync d11/f82 0 2024-02-28T16:01:58.230 INFO:tasks.workunit.client.1.smithi087.stdout:4/600: dread - d2/d9/d10/d11/f98 zero size 2024-02-28T16:01:58.233 INFO:tasks.workunit.client.0.smithi057.stdout:2/188: creat d19/d1d/d2e/d31/f3b x:0 0 0 2024-02-28T16:01:58.235 INFO:tasks.workunit.client.0.smithi057.stdout:2/189: write d19/d1d/d2e/d31/f3b [870188,122930] 0 2024-02-28T16:01:58.236 INFO:tasks.workunit.client.0.smithi057.stdout:3/151: write d8/fa [636783,83091] 0 2024-02-28T16:01:58.239 INFO:tasks.workunit.client.1.smithi087.stdout:5/603: write d3/d9/f79 [1058443,26018] 0 2024-02-28T16:01:58.242 INFO:tasks.workunit.client.1.smithi087.stdout:6/572: truncate d4/dc/f8e 1020447 0 2024-02-28T16:01:58.246 INFO:tasks.workunit.client.1.smithi087.stdout:7/518: write d14/d7d/f8d [1200811,58284] 0 2024-02-28T16:01:58.250 INFO:tasks.workunit.client.1.smithi087.stdout:9/514: dwrite d7/dd/d15/f5a [0,4194304] 0 2024-02-28T16:01:58.251 INFO:tasks.workunit.client.0.smithi057.stdout:9/287: write d2/d24/f14 [197503,7532] 0 2024-02-28T16:01:58.253 INFO:tasks.workunit.client.1.smithi087.stdout:2/529: dread d2/d7/d17/d3d/f55 [0,4194304] 0 2024-02-28T16:01:58.254 INFO:tasks.workunit.client.0.smithi057.stdout:9/288: readlink d2/d24/d1d/l26 0 2024-02-28T16:01:58.254 INFO:tasks.workunit.client.0.smithi057.stdout:6/172: creat df/d10/d13/f38 x:0 0 0 2024-02-28T16:01:58.255 INFO:tasks.workunit.client.1.smithi087.stdout:6/573: creat d4/d12/fba x:0 0 0 2024-02-28T16:01:58.256 INFO:tasks.workunit.client.1.smithi087.stdout:4/601: read d2/d9/d10/d22/f27 [2593686,50841] 0 2024-02-28T16:01:58.259 INFO:tasks.workunit.client.0.smithi057.stdout:4/208: chown d1/d10/d12/c21 0 1 2024-02-28T16:01:58.260 INFO:tasks.workunit.client.0.smithi057.stdout:5/191: write d2/d15/f43 [640783,55551] 0 2024-02-28T16:01:58.262 INFO:tasks.workunit.client.0.smithi057.stdout:5/192: stat d2/c18 0 2024-02-28T16:01:58.262 INFO:tasks.workunit.client.1.smithi087.stdout:0/540: creat d4/dd/fb0 x:0 0 0 2024-02-28T16:01:58.263 INFO:tasks.workunit.client.1.smithi087.stdout:3/547: dwrite d11/d44/f57 [0,4194304] 0 2024-02-28T16:01:58.264 INFO:tasks.workunit.client.1.smithi087.stdout:2/530: mkdir d2/d99/dc7 0 2024-02-28T16:01:58.268 INFO:tasks.workunit.client.0.smithi057.stdout:2/190: write f10 [1673205,52555] 0 2024-02-28T16:01:58.268 INFO:tasks.workunit.client.1.smithi087.stdout:9/515: write d7/dd/d3c/d4c/f8c [8188112,90696] 0 2024-02-28T16:01:58.269 INFO:tasks.workunit.client.1.smithi087.stdout:6/574: write d4/d12/d45/f91 [1071641,127692] 0 2024-02-28T16:01:58.269 INFO:tasks.workunit.client.1.smithi087.stdout:8/563: dread d2/d18/d42/d62/f7e [0,4194304] 0 2024-02-28T16:01:58.276 INFO:tasks.workunit.client.1.smithi087.stdout:4/602: readlink d2/df/lbe 0 2024-02-28T16:01:58.277 INFO:tasks.workunit.client.1.smithi087.stdout:6/575: read d4/d30/f6b [958518,88118] 0 2024-02-28T16:01:58.278 INFO:tasks.workunit.client.0.smithi057.stdout:8/249: truncate d5/de/d1b/f25 3465925 0 2024-02-28T16:01:58.279 INFO:tasks.workunit.client.0.smithi057.stdout:0/334: mkdir d6/d12/d17/d4b/d60/d6b 0 2024-02-28T16:01:58.280 INFO:tasks.workunit.client.1.smithi087.stdout:1/526: sync 2024-02-28T16:01:58.282 INFO:tasks.workunit.client.0.smithi057.stdout:6/173: write f9 [190217,29597] 0 2024-02-28T16:01:58.283 INFO:tasks.workunit.client.1.smithi087.stdout:4/603: truncate d2/df/d62/fd0 969725 0 2024-02-28T16:01:58.284 INFO:tasks.workunit.client.0.smithi057.stdout:0/335: write d6/d12/d38/f5c [2344271,114591] 0 2024-02-28T16:01:58.284 INFO:tasks.workunit.client.1.smithi087.stdout:0/541: mknod d4/dd/d37/d39/d3a/d57/d74/cb1 0 2024-02-28T16:01:58.285 INFO:tasks.workunit.client.0.smithi057.stdout:6/174: chown df/d14/c2c 53673 1 2024-02-28T16:01:58.289 INFO:tasks.workunit.client.1.smithi087.stdout:7/519: dwrite d14/d27/d55/f8e [0,4194304] 0 2024-02-28T16:01:58.290 INFO:tasks.workunit.client.1.smithi087.stdout:1/527: symlink d0/d1b/d43/d4d/lb1 0 2024-02-28T16:01:58.292 INFO:tasks.workunit.client.0.smithi057.stdout:4/209: symlink d1/d14/l4b 0 2024-02-28T16:01:58.296 INFO:tasks.workunit.client.0.smithi057.stdout:3/152: creat d8/dd/d14/d2c/f33 x:0 0 0 2024-02-28T16:01:58.298 INFO:tasks.workunit.client.0.smithi057.stdout:7/162: mkdir d6/dc/d12/d3b 0 2024-02-28T16:01:58.300 INFO:tasks.workunit.client.0.smithi057.stdout:3/153: truncate d8/f18 1966978 0 2024-02-28T16:01:58.300 INFO:tasks.workunit.client.1.smithi087.stdout:9/516: creat d7/dd/d15/f93 x:0 0 0 2024-02-28T16:01:58.304 INFO:tasks.workunit.client.1.smithi087.stdout:1/528: rename d0/d1d to d0/d1b/d1f/d71/db2 0 2024-02-28T16:01:58.312 INFO:tasks.workunit.client.0.smithi057.stdout:0/336: truncate d6/d4e/f33 1049065 0 2024-02-28T16:01:58.313 INFO:tasks.workunit.client.1.smithi087.stdout:6/576: truncate d4/dc/d10/f6e 942456 0 2024-02-28T16:01:58.314 INFO:tasks.workunit.client.0.smithi057.stdout:6/175: mkdir df/d14/d15/d16/d39 0 2024-02-28T16:01:58.314 INFO:tasks.workunit.client.0.smithi057.stdout:0/337: stat d6/d12/d45/d55 0 2024-02-28T16:01:58.315 INFO:tasks.workunit.client.1.smithi087.stdout:7/520: dread d14/d2e/d2b/f67 [4194304,4194304] 0 2024-02-28T16:01:58.315 INFO:tasks.workunit.client.1.smithi087.stdout:2/531: getdents d2/d99/d28/d79 0 2024-02-28T16:01:58.316 INFO:tasks.workunit.client.0.smithi057.stdout:6/176: chown l1 12240 1 2024-02-28T16:01:58.317 INFO:tasks.workunit.client.0.smithi057.stdout:0/338: dread - d6/f67 zero size 2024-02-28T16:01:58.317 INFO:tasks.workunit.client.1.smithi087.stdout:1/529: rmdir d0/d14 39 2024-02-28T16:01:58.320 INFO:tasks.workunit.client.1.smithi087.stdout:8/564: truncate d2/d9/d1a/f5b 1088995 0 2024-02-28T16:01:58.324 INFO:tasks.workunit.client.1.smithi087.stdout:5/604: dread d3/d64/d81/fde [0,4194304] 0 2024-02-28T16:01:58.325 INFO:tasks.workunit.client.0.smithi057.stdout:8/250: mknod d5/de/d1b/d57/c5a 0 2024-02-28T16:01:58.329 INFO:tasks.workunit.client.1.smithi087.stdout:1/530: write d0/d1b/f5d [768322,5943] 0 2024-02-28T16:01:58.329 INFO:tasks.workunit.client.1.smithi087.stdout:7/521: creat d14/d27/d5d/f99 x:0 0 0 2024-02-28T16:01:58.330 INFO:tasks.workunit.client.0.smithi057.stdout:7/163: dwrite d6/dc/d12/d1a/f37 [0,4194304] 0 2024-02-28T16:01:58.332 INFO:tasks.workunit.client.1.smithi087.stdout:9/517: dwrite d7/dd/d15/f7a [0,4194304] 0 2024-02-28T16:01:58.334 INFO:tasks.workunit.client.1.smithi087.stdout:7/522: fdatasync d14/d2e/d2b/d4e/f98 0 2024-02-28T16:01:58.337 INFO:tasks.workunit.client.1.smithi087.stdout:9/518: fdatasync d7/dd/d36/f3d 0 2024-02-28T16:01:58.339 INFO:tasks.workunit.client.1.smithi087.stdout:4/604: dread d2/d9/da/d1a/d26/f3d [0,4194304] 0 2024-02-28T16:01:58.339 INFO:tasks.workunit.client.1.smithi087.stdout:8/565: fdatasync d2/d9/d10/d24/d53/d6f/f7a 0 2024-02-28T16:01:58.342 INFO:tasks.workunit.client.1.smithi087.stdout:5/605: truncate d3/f61 494851 0 2024-02-28T16:01:58.343 INFO:tasks.workunit.client.0.smithi057.stdout:0/339: mknod d6/d4e/c6c 0 2024-02-28T16:01:58.346 INFO:tasks.workunit.client.0.smithi057.stdout:6/177: rename df/d14/d15/f37 to df/d10/d13/f3a 0 2024-02-28T16:01:58.347 INFO:tasks.workunit.client.1.smithi087.stdout:8/566: fsync d2/d9/d1a/f48 0 2024-02-28T16:01:58.349 INFO:tasks.workunit.client.1.smithi087.stdout:1/531: mkdir d0/d1b/d1f/d71/db2/db3 0 2024-02-28T16:01:58.351 INFO:tasks.workunit.client.0.smithi057.stdout:1/261: creat d1/d21/f5b x:0 0 0 2024-02-28T16:01:58.351 INFO:tasks.workunit.client.1.smithi087.stdout:3/548: dread d11/d44/d5b/f5f [0,4194304] 0 2024-02-28T16:01:58.355 INFO:tasks.workunit.client.1.smithi087.stdout:1/532: write d0/d1a/f3a [6641660,70145] 0 2024-02-28T16:01:58.356 INFO:tasks.workunit.client.1.smithi087.stdout:7/523: rename d14/d2e/f1b to d14/d27/d5d/d6a/d83/d96/f9a 0 2024-02-28T16:01:58.357 INFO:tasks.workunit.client.1.smithi087.stdout:9/519: creat d7/dd/d15/d3f/d5f/f94 x:0 0 0 2024-02-28T16:01:58.358 INFO:tasks.workunit.client.0.smithi057.stdout:2/191: getdents d19/d1d/d2e/d31 0 2024-02-28T16:01:58.358 INFO:tasks.workunit.client.1.smithi087.stdout:1/533: stat d0/d1b/f79 0 2024-02-28T16:01:58.359 INFO:tasks.workunit.client.1.smithi087.stdout:9/520: read - d7/f88 zero size 2024-02-28T16:01:58.361 INFO:tasks.workunit.client.1.smithi087.stdout:5/606: fsync d3/d9/d4a/fdf 0 2024-02-28T16:01:58.362 INFO:tasks.workunit.client.1.smithi087.stdout:8/567: mkdir d2/d9/d5e/dbc 0 2024-02-28T16:01:58.364 INFO:tasks.workunit.client.1.smithi087.stdout:9/521: write d7/f88 [964626,63073] 0 2024-02-28T16:01:58.368 INFO:tasks.workunit.client.1.smithi087.stdout:2/532: dread d2/d42/d4b/f52 [0,4194304] 0 2024-02-28T16:01:58.369 INFO:tasks.workunit.client.0.smithi057.stdout:0/340: creat d6/d12/d45/d55/f6d x:0 0 0 2024-02-28T16:01:58.374 INFO:tasks.workunit.client.1.smithi087.stdout:1/534: fdatasync d0/d1b/f47 0 2024-02-28T16:01:58.375 INFO:tasks.workunit.client.0.smithi057.stdout:1/262: dread d1/d3/dc/d15/f17 [0,4194304] 0 2024-02-28T16:01:58.378 INFO:tasks.workunit.client.0.smithi057.stdout:9/289: write f0 [1119906,37486] 0 2024-02-28T16:01:58.379 INFO:tasks.workunit.client.1.smithi087.stdout:6/577: dwrite d4/dc/d10/f36 [0,4194304] 0 2024-02-28T16:01:58.380 INFO:tasks.workunit.client.0.smithi057.stdout:2/192: mkdir d19/d1d/d2e/d3c 0 2024-02-28T16:01:58.381 INFO:tasks.workunit.client.1.smithi087.stdout:6/578: readlink d4/dc/d10/l51 0 2024-02-28T16:01:58.385 INFO:tasks.workunit.client.0.smithi057.stdout:0/341: creat d6/d12/d17/d58/f6e x:0 0 0 2024-02-28T16:01:58.390 INFO:tasks.workunit.client.0.smithi057.stdout:5/193: write d2/d15/d3b/f3a [26329,112404] 0 2024-02-28T16:01:58.391 INFO:tasks.workunit.client.0.smithi057.stdout:7/164: rmdir d6/dc/d12/d3b 0 2024-02-28T16:01:58.391 INFO:tasks.workunit.client.1.smithi087.stdout:5/607: fdatasync d3/d9/d9b/dba/f20 0 2024-02-28T16:01:58.394 INFO:tasks.workunit.client.1.smithi087.stdout:3/549: link d11/d3a/d3c/l41 d11/d33/d67/d98/d9b/lb6 0 2024-02-28T16:01:58.394 INFO:tasks.workunit.client.0.smithi057.stdout:1/263: creat d1/d21/d42/f5c x:0 0 0 2024-02-28T16:01:58.394 INFO:tasks.workunit.client.0.smithi057.stdout:3/154: write d8/dd/d19/f2d [1219194,17230] 0 2024-02-28T16:01:58.395 INFO:tasks.workunit.client.0.smithi057.stdout:2/193: write d19/d2c/f30 [1336983,126136] 0 2024-02-28T16:01:58.396 INFO:tasks.workunit.client.0.smithi057.stdout:6/178: dwrite df/d10/f36 [0,4194304] 0 2024-02-28T16:01:58.397 INFO:tasks.workunit.client.0.smithi057.stdout:0/342: write d6/d12/d17/d34/f4d [218413,69375] 0 2024-02-28T16:01:58.398 INFO:tasks.workunit.client.0.smithi057.stdout:7/165: dread - d6/dc/d12/f21 zero size 2024-02-28T16:01:58.399 INFO:tasks.workunit.client.1.smithi087.stdout:7/524: rename d14/d46/l86 to d14/d2e/l9b 0 2024-02-28T16:01:58.402 INFO:tasks.workunit.client.0.smithi057.stdout:1/264: chown d1/d3/f3a 1354667 1 2024-02-28T16:01:58.404 INFO:tasks.workunit.client.1.smithi087.stdout:4/605: truncate d2/d9/d9e/f58 1397851 0 2024-02-28T16:01:58.407 INFO:tasks.workunit.client.0.smithi057.stdout:5/194: mkdir d2/d3e/d44 0 2024-02-28T16:01:58.407 INFO:tasks.workunit.client.0.smithi057.stdout:6/179: write df/f12 [349717,75490] 0 2024-02-28T16:01:58.411 INFO:tasks.workunit.client.0.smithi057.stdout:1/265: fdatasync d1/d21/f52 0 2024-02-28T16:01:58.411 INFO:tasks.workunit.client.1.smithi087.stdout:3/550: mkdir d11/d61/d7c/db7 0 2024-02-28T16:01:58.411 INFO:tasks.workunit.client.0.smithi057.stdout:7/166: mknod d6/d26/c3c 0 2024-02-28T16:01:58.412 INFO:tasks.workunit.client.0.smithi057.stdout:3/155: write d8/f18 [1850646,18478] 0 2024-02-28T16:01:58.412 INFO:tasks.workunit.client.0.smithi057.stdout:8/251: dread d5/d6/fa [0,4194304] 0 2024-02-28T16:01:58.414 INFO:tasks.workunit.client.1.smithi087.stdout:5/608: dwrite d3/d64/d67/f80 [0,4194304] 0 2024-02-28T16:01:58.416 INFO:tasks.workunit.client.0.smithi057.stdout:6/180: mkdir df/d14/d3b 0 2024-02-28T16:01:58.418 INFO:tasks.workunit.client.1.smithi087.stdout:5/609: write d3/d9/d9b/dba/d30/d8f/fa2 [822754,55431] 0 2024-02-28T16:01:58.419 INFO:tasks.workunit.client.1.smithi087.stdout:6/579: truncate d4/dc/d7e/fb5 3782705 0 2024-02-28T16:01:58.419 INFO:tasks.workunit.client.0.smithi057.stdout:5/195: symlink d2/d12/d3d/l45 0 2024-02-28T16:01:58.420 INFO:tasks.workunit.client.1.smithi087.stdout:7/525: mknod d14/d30/c9c 0 2024-02-28T16:01:58.421 INFO:tasks.workunit.client.0.smithi057.stdout:3/156: stat c2 0 2024-02-28T16:01:58.421 INFO:tasks.workunit.client.1.smithi087.stdout:8/568: getdents d2/d9/d10/d24/d53/d6f 0 2024-02-28T16:01:58.423 INFO:tasks.workunit.client.1.smithi087.stdout:6/580: readlink d4/d12/l41 0 2024-02-28T16:01:58.423 INFO:tasks.workunit.client.1.smithi087.stdout:8/569: chown d2/d9/l39 5 1 2024-02-28T16:01:58.424 INFO:tasks.workunit.client.1.smithi087.stdout:9/522: link d7/dd/d15/d79/d2e/l86 d7/dd/l95 0 2024-02-28T16:01:58.425 INFO:tasks.workunit.client.0.smithi057.stdout:0/343: link d6/l3c d6/d4e/l6f 0 2024-02-28T16:01:58.426 INFO:tasks.workunit.client.1.smithi087.stdout:2/533: truncate d2/d99/d28/d79/f90 3388773 0 2024-02-28T16:01:58.426 INFO:tasks.workunit.client.1.smithi087.stdout:3/551: symlink d11/d33/d67/d9c/lb8 0 2024-02-28T16:01:58.430 INFO:tasks.workunit.client.1.smithi087.stdout:3/552: write d11/f37 [968593,113911] 0 2024-02-28T16:01:58.430 INFO:tasks.workunit.client.1.smithi087.stdout:6/581: creat d4/d12/d45/d57/fbb x:0 0 0 2024-02-28T16:01:58.431 INFO:tasks.workunit.client.1.smithi087.stdout:1/535: getdents d0/d14/d3f 0 2024-02-28T16:01:58.431 INFO:tasks.workunit.client.0.smithi057.stdout:1/266: mkdir d1/d3/dc/d40/d5d 0 2024-02-28T16:01:58.431 INFO:tasks.workunit.client.0.smithi057.stdout:6/181: write df/d14/d15/f25 [1194532,72459] 0 2024-02-28T16:01:58.432 INFO:tasks.workunit.client.0.smithi057.stdout:8/252: rename d5/d20/d39/d59 to d5/d20/d39/d59/d5b 22 2024-02-28T16:01:58.434 INFO:tasks.workunit.client.0.smithi057.stdout:5/196: chown d2/d12/d3d/l45 27 1 2024-02-28T16:01:58.437 INFO:tasks.workunit.client.1.smithi087.stdout:6/582: dread - d4/d30/d13/d38/d69/f79 zero size 2024-02-28T16:01:58.438 INFO:tasks.workunit.client.1.smithi087.stdout:2/534: truncate d2/d99/d28/d54/da6/fb2 575136 0 2024-02-28T16:01:58.439 INFO:tasks.workunit.client.0.smithi057.stdout:4/210: dwrite d1/d10/d12/d15/f4a [0,4194304] 0 2024-02-28T16:01:58.440 INFO:tasks.workunit.client.1.smithi087.stdout:9/523: link d7/dc/l25 d7/dd/l96 0 2024-02-28T16:01:58.441 INFO:tasks.workunit.client.1.smithi087.stdout:6/583: readlink d4/d12/d45/l34 0 2024-02-28T16:01:58.443 INFO:tasks.workunit.client.1.smithi087.stdout:3/553: rename d11/d3a/c75 to d11/d45/d88/d91/cb9 0 2024-02-28T16:01:58.444 INFO:tasks.workunit.client.1.smithi087.stdout:7/526: dwrite d14/d2e/d2b/f51 [0,4194304] 0 2024-02-28T16:01:58.444 INFO:tasks.workunit.client.1.smithi087.stdout:2/535: creat d2/d7/d17/d34/d88/fc8 x:0 0 0 2024-02-28T16:01:58.445 INFO:tasks.workunit.client.1.smithi087.stdout:6/584: write d4/d12/d45/f39 [1249403,54618] 0 2024-02-28T16:01:58.446 INFO:tasks.workunit.client.1.smithi087.stdout:7/527: readlink d14/d21/d4f/l95 0 2024-02-28T16:01:58.448 INFO:tasks.workunit.client.1.smithi087.stdout:3/554: write d11/fb0 [5023622,16546] 0 2024-02-28T16:01:58.450 INFO:tasks.workunit.client.1.smithi087.stdout:1/536: rename d0/d1b/f5d to d0/d1b/d1f/d71/db2/d24/d78/fb4 0 2024-02-28T16:01:58.450 INFO:tasks.workunit.client.1.smithi087.stdout:3/555: fsync d11/d7b/dab/fb3 0 2024-02-28T16:01:58.452 INFO:tasks.workunit.client.1.smithi087.stdout:0/542: sync 2024-02-28T16:01:58.453 INFO:tasks.workunit.client.0.smithi057.stdout:5/197: unlink d2/d12/f32 0 2024-02-28T16:01:58.454 INFO:tasks.workunit.client.1.smithi087.stdout:2/536: creat d2/d7/d17/d3d/d60/fc9 x:0 0 0 2024-02-28T16:01:58.455 INFO:tasks.workunit.client.1.smithi087.stdout:9/524: creat d7/dd/d15/d79/f97 x:0 0 0 2024-02-28T16:01:58.456 INFO:tasks.workunit.client.0.smithi057.stdout:6/182: creat df/d14/d15/f3c x:0 0 0 2024-02-28T16:01:58.457 INFO:tasks.workunit.client.1.smithi087.stdout:7/528: symlink d14/d2e/l9d 0 2024-02-28T16:01:58.461 INFO:tasks.workunit.client.1.smithi087.stdout:7/529: fdatasync f13 0 2024-02-28T16:01:58.462 INFO:tasks.workunit.client.0.smithi057.stdout:2/194: dwrite f12 [0,4194304] 0 2024-02-28T16:01:58.462 INFO:tasks.workunit.client.0.smithi057.stdout:8/253: write d5/de/d1b/d45/f4e [666529,63311] 0 2024-02-28T16:01:58.462 INFO:tasks.workunit.client.1.smithi087.stdout:1/537: creat d0/d1b/d1f/fb5 x:0 0 0 2024-02-28T16:01:58.462 INFO:tasks.workunit.client.1.smithi087.stdout:6/585: dread d4/d12/d45/f8a [0,4194304] 0 2024-02-28T16:01:58.463 INFO:tasks.workunit.client.1.smithi087.stdout:9/525: symlink d7/dd/d36/l98 0 2024-02-28T16:01:58.463 INFO:tasks.workunit.client.1.smithi087.stdout:3/556: chown d11/d3a/d3c/l41 109563756 1 2024-02-28T16:01:58.464 INFO:tasks.workunit.client.1.smithi087.stdout:7/530: fsync d14/d46/f4c 0 2024-02-28T16:01:58.468 INFO:tasks.workunit.client.1.smithi087.stdout:7/531: chown d14/d27/d5d/f70 13677 1 2024-02-28T16:01:58.469 INFO:tasks.workunit.client.1.smithi087.stdout:0/543: link d4/dd/d37/d39/l65 d4/dd/d26/lb2 0 2024-02-28T16:01:58.470 INFO:tasks.workunit.client.1.smithi087.stdout:7/532: chown f12 795366773 1 2024-02-28T16:01:58.471 INFO:tasks.workunit.client.0.smithi057.stdout:3/157: dread d8/dd/d19/f2d [0,4194304] 0 2024-02-28T16:01:58.476 INFO:tasks.workunit.client.1.smithi087.stdout:9/526: mkdir d7/dd/d99 0 2024-02-28T16:01:58.477 INFO:tasks.workunit.client.0.smithi057.stdout:7/167: dwrite d6/d26/f36 [0,4194304] 0 2024-02-28T16:01:58.479 INFO:tasks.workunit.client.0.smithi057.stdout:6/183: rmdir df/d14/d3b 0 2024-02-28T16:01:58.480 INFO:tasks.workunit.client.0.smithi057.stdout:5/198: truncate d2/d15/f3c 1009859 0 2024-02-28T16:01:58.485 INFO:tasks.workunit.client.0.smithi057.stdout:4/211: mknod d1/d10/d12/d2c/d37/c4c 0 2024-02-28T16:01:58.486 INFO:tasks.workunit.client.1.smithi087.stdout:7/533: write d14/d2e/d2b/d4e/f56 [1279004,112674] 0 2024-02-28T16:01:58.486 INFO:tasks.workunit.client.1.smithi087.stdout:2/537: dwrite d2/d99/fa9 [0,4194304] 0 2024-02-28T16:01:58.489 INFO:tasks.workunit.client.1.smithi087.stdout:9/527: unlink d7/d1e/f30 0 2024-02-28T16:01:58.490 INFO:tasks.workunit.client.1.smithi087.stdout:0/544: dread d4/dd/d37/d39/d3a/d57/d74/d1f/d60/fa6 [0,4194304] 0 2024-02-28T16:01:58.491 INFO:tasks.workunit.client.1.smithi087.stdout:4/606: truncate d2/d9/d10/d22/d5b/d5c/f7d 224902 0 2024-02-28T16:01:58.495 INFO:tasks.workunit.client.0.smithi057.stdout:3/158: dread d8/dd/f1f [0,4194304] 0 2024-02-28T16:01:58.495 INFO:tasks.workunit.client.0.smithi057.stdout:9/290: dread d2/d5/d1b/d2e/f2f [0,4194304] 0 2024-02-28T16:01:58.496 INFO:tasks.workunit.client.1.smithi087.stdout:7/534: symlink d14/d2e/d2b/d4e/l9e 0 2024-02-28T16:01:58.497 INFO:tasks.workunit.client.1.smithi087.stdout:1/538: dread d0/d1a/f34 [0,4194304] 0 2024-02-28T16:01:58.503 INFO:tasks.workunit.client.1.smithi087.stdout:7/535: write d14/d2e/f5c [1493937,116132] 0 2024-02-28T16:01:58.503 INFO:tasks.workunit.client.1.smithi087.stdout:9/528: unlink d7/dd/d15/d79/f97 0 2024-02-28T16:01:58.504 INFO:tasks.workunit.client.1.smithi087.stdout:7/536: read - d14/d21/d4f/f53 zero size 2024-02-28T16:01:58.505 INFO:tasks.workunit.client.0.smithi057.stdout:1/267: dwrite d1/d21/f52 [0,4194304] 0 2024-02-28T16:01:58.505 INFO:tasks.workunit.client.0.smithi057.stdout:6/184: write df/d14/d15/d16/f31 [392933,105513] 0 2024-02-28T16:01:58.505 INFO:tasks.workunit.client.1.smithi087.stdout:9/529: stat d7/d1e/d60 0 2024-02-28T16:01:58.506 INFO:tasks.workunit.client.0.smithi057.stdout:2/195: creat d19/d1d/d2e/d3c/f3d x:0 0 0 2024-02-28T16:01:58.508 INFO:tasks.workunit.client.0.smithi057.stdout:9/291: chown d2/d5/d1b/d2e/d4c/f5a 6 1 2024-02-28T16:01:58.508 INFO:tasks.workunit.client.0.smithi057.stdout:0/344: dwrite d6/f2f [0,4194304] 0 2024-02-28T16:01:58.513 INFO:tasks.workunit.client.1.smithi087.stdout:0/545: dread d4/d6/dc/d45/f7b [0,4194304] 0 2024-02-28T16:01:58.513 INFO:tasks.workunit.client.1.smithi087.stdout:5/610: dwrite d3/d9/d9b/dba/d30/f65 [0,4194304] 0 2024-02-28T16:01:58.515 INFO:tasks.workunit.client.0.smithi057.stdout:5/199: dread d2/d15/f3c [0,4194304] 0 2024-02-28T16:01:58.515 INFO:tasks.workunit.client.0.smithi057.stdout:6/185: chown df/d10/d13/c18 0 1 2024-02-28T16:01:58.515 INFO:tasks.workunit.client.0.smithi057.stdout:7/168: getdents d6 0 2024-02-28T16:01:58.515 INFO:tasks.workunit.client.0.smithi057.stdout:1/268: write d1/d21/f52 [3485447,43462] 0 2024-02-28T16:01:58.516 INFO:tasks.workunit.client.1.smithi087.stdout:2/538: getdents d2/d99/d28 0 2024-02-28T16:01:58.523 INFO:tasks.workunit.client.1.smithi087.stdout:9/530: link d7/d1e/d60/d64/f73 d7/d1e/d44/f9a 0 2024-02-28T16:01:58.523 INFO:tasks.workunit.client.0.smithi057.stdout:9/292: write d2/d24/f14 [1647821,77152] 0 2024-02-28T16:01:58.523 INFO:tasks.workunit.client.0.smithi057.stdout:2/196: stat d19/d2c/f30 0 2024-02-28T16:01:58.527 INFO:tasks.workunit.client.1.smithi087.stdout:3/557: write d11/f32 [605074,114636] 0 2024-02-28T16:01:58.527 INFO:tasks.workunit.client.1.smithi087.stdout:2/539: symlink d2/d42/d4b/lca 0 2024-02-28T16:01:58.528 INFO:tasks.workunit.client.1.smithi087.stdout:4/607: dread d2/d9/da/d1a/d26/f35 [0,4194304] 0 2024-02-28T16:01:58.532 INFO:tasks.workunit.client.0.smithi057.stdout:3/159: rename d8/dd/d14/l16 to d8/dd/d19/d1c/l34 0 2024-02-28T16:01:58.533 INFO:tasks.workunit.client.1.smithi087.stdout:1/539: link d0/d1a/d28/c44 d0/d14/d48/da7/cb6 0 2024-02-28T16:01:58.534 INFO:tasks.workunit.client.1.smithi087.stdout:8/570: write d2/d18/d42/f81 [2114301,130675] 0 2024-02-28T16:01:58.536 INFO:tasks.workunit.client.0.smithi057.stdout:8/254: dwrite d5/d6/f19 [0,4194304] 0 2024-02-28T16:01:58.542 INFO:tasks.workunit.client.1.smithi087.stdout:6/586: dwrite d4/d12/d45/d57/f62 [0,4194304] 0 2024-02-28T16:01:58.543 INFO:tasks.workunit.client.0.smithi057.stdout:0/345: rename d6/d12/d17/c5a to d6/d12/d17/c70 0 2024-02-28T16:01:58.545 INFO:tasks.workunit.client.0.smithi057.stdout:4/212: getdents d1/d10/d12/d2c 0 2024-02-28T16:01:58.546 INFO:tasks.workunit.client.1.smithi087.stdout:4/608: mknod d2/d9/d10/d22/d5b/d5c/d68/cd3 0 2024-02-28T16:01:58.549 INFO:tasks.workunit.client.1.smithi087.stdout:1/540: creat d0/d1b/d1f/d71/db2/d24/fb7 x:0 0 0 2024-02-28T16:01:58.551 INFO:tasks.workunit.client.1.smithi087.stdout:3/558: symlink d11/d33/d67/d98/daf/lba 0 2024-02-28T16:01:58.551 INFO:tasks.workunit.client.0.smithi057.stdout:1/269: creat d1/d21/d25/d26/d44/d4c/f5e x:0 0 0 2024-02-28T16:01:58.558 INFO:tasks.workunit.client.1.smithi087.stdout:1/541: creat d0/d1b/fb8 x:0 0 0 2024-02-28T16:01:58.559 INFO:tasks.workunit.client.1.smithi087.stdout:6/587: getdents d4 0 2024-02-28T16:01:58.561 INFO:tasks.workunit.client.0.smithi057.stdout:8/255: mkdir d5/de/d1b/d5c 0 2024-02-28T16:01:58.561 INFO:tasks.workunit.client.0.smithi057.stdout:0/346: read d6/d12/d17/f3b [2147755,40405] 0 2024-02-28T16:01:58.566 INFO:tasks.workunit.client.1.smithi087.stdout:4/609: read d2/df/d65/d8d/fa4 [85761,130087] 0 2024-02-28T16:01:58.567 INFO:tasks.workunit.client.0.smithi057.stdout:4/213: fdatasync d1/f4 0 2024-02-28T16:01:58.568 INFO:tasks.workunit.client.0.smithi057.stdout:0/347: chown d6/d12/d5d 1083585 1 2024-02-28T16:01:58.569 INFO:tasks.workunit.client.0.smithi057.stdout:3/160: link d8/dd/d19/f2d d8/dd/d14/d2e/d2f/f35 0 2024-02-28T16:01:58.569 INFO:tasks.workunit.client.0.smithi057.stdout:5/200: getdents d2 0 2024-02-28T16:01:58.571 INFO:tasks.workunit.client.1.smithi087.stdout:2/540: dwrite d2/d99/d28/d54/f91 [0,4194304] 0 2024-02-28T16:01:58.571 INFO:tasks.workunit.client.0.smithi057.stdout:1/270: write d1/d21/d25/d26/d44/f58 [64384,43911] 0 2024-02-28T16:01:58.575 INFO:tasks.workunit.client.0.smithi057.stdout:4/214: creat d1/d10/f4d x:0 0 0 2024-02-28T16:01:58.575 INFO:tasks.workunit.client.0.smithi057.stdout:8/256: creat d5/de/d1b/d4b/f5d x:0 0 0 2024-02-28T16:01:58.580 INFO:tasks.workunit.client.0.smithi057.stdout:1/271: mkdir d1/d3/dc/d15/d4e/d5f 0 2024-02-28T16:01:58.583 INFO:tasks.workunit.client.0.smithi057.stdout:2/197: dread fe [4194304,4194304] 0 2024-02-28T16:01:58.585 INFO:tasks.workunit.client.0.smithi057.stdout:5/201: write d2/d8/f9 [1388220,56287] 0 2024-02-28T16:01:58.586 INFO:tasks.workunit.client.1.smithi087.stdout:1/542: rename d0/d1b/d43/d4d/c87 to d0/d14/cb9 0 2024-02-28T16:01:58.591 INFO:tasks.workunit.client.0.smithi057.stdout:1/272: truncate d1/d3/f47 740554 0 2024-02-28T16:01:58.591 INFO:tasks.workunit.client.0.smithi057.stdout:2/198: chown d19/d1d/d26/c39 31712040 1 2024-02-28T16:01:58.594 INFO:tasks.workunit.client.1.smithi087.stdout:3/559: dwrite fa [0,4194304] 0 2024-02-28T16:01:58.595 INFO:tasks.workunit.client.1.smithi087.stdout:4/610: creat d2/d9/d10/d22/d5b/d5c/d68/dc5/fd4 x:0 0 0 2024-02-28T16:01:58.597 INFO:tasks.workunit.client.0.smithi057.stdout:0/348: getdents d6/d12/d17/d4b/d60 0 2024-02-28T16:01:58.597 INFO:tasks.workunit.client.0.smithi057.stdout:2/199: chown d19/d3a 17 1 2024-02-28T16:01:58.597 INFO:tasks.workunit.client.1.smithi087.stdout:4/611: fsync d2/d9/f4d 0 2024-02-28T16:01:58.598 INFO:tasks.workunit.client.0.smithi057.stdout:2/200: read fe [7184541,37883] 0 2024-02-28T16:01:58.604 INFO:tasks.workunit.client.0.smithi057.stdout:8/257: truncate d5/de/f10 77333 0 2024-02-28T16:01:58.605 INFO:tasks.workunit.client.0.smithi057.stdout:1/273: mknod d1/d21/d25/d26/d44/c60 0 2024-02-28T16:01:58.605 INFO:tasks.workunit.client.1.smithi087.stdout:6/588: dwrite d4/d30/d13/f3b [0,4194304] 0 2024-02-28T16:01:58.606 INFO:tasks.workunit.client.0.smithi057.stdout:8/258: readlink d5/de/l34 0 2024-02-28T16:01:58.614 INFO:tasks.workunit.client.0.smithi057.stdout:8/259: creat d5/de/d1b/d57/f5e x:0 0 0 2024-02-28T16:01:58.614 INFO:tasks.workunit.client.1.smithi087.stdout:6/589: unlink d4/c3e 0 2024-02-28T16:01:58.614 INFO:tasks.workunit.client.1.smithi087.stdout:5/611: dwrite d3/d64/d81/f40 [0,4194304] 0 2024-02-28T16:01:58.614 INFO:tasks.workunit.client.0.smithi057.stdout:3/161: dwrite d8/dd/d14/f17 [0,4194304] 0 2024-02-28T16:01:58.616 INFO:tasks.workunit.client.0.smithi057.stdout:1/274: unlink d1/d3/dc/d15/f16 0 2024-02-28T16:01:58.620 INFO:tasks.workunit.client.1.smithi087.stdout:9/531: dread d7/dd/d3c/f43 [0,4194304] 0 2024-02-28T16:01:58.621 INFO:tasks.workunit.client.0.smithi057.stdout:8/260: chown d5/d20/d39 61146944 1 2024-02-28T16:01:58.621 INFO:tasks.workunit.client.0.smithi057.stdout:5/202: fdatasync d2/d8/f9 0 2024-02-28T16:01:58.622 INFO:tasks.workunit.client.1.smithi087.stdout:4/612: creat d2/d49/fd5 x:0 0 0 2024-02-28T16:01:58.622 INFO:tasks.workunit.client.0.smithi057.stdout:3/162: truncate d8/f15 1008932 0 2024-02-28T16:01:58.626 INFO:tasks.workunit.client.1.smithi087.stdout:7/537: dread d14/f64 [0,4194304] 0 2024-02-28T16:01:58.626 INFO:tasks.workunit.client.1.smithi087.stdout:0/546: dread d4/dd/d37/d39/d3a/d57/d74/f44 [0,4194304] 0 2024-02-28T16:01:58.627 INFO:tasks.workunit.client.1.smithi087.stdout:1/543: dwrite d0/d14/f85 [0,4194304] 0 2024-02-28T16:01:58.629 INFO:tasks.workunit.client.0.smithi057.stdout:2/201: dread d19/d1d/d2e/d31/f3b [0,4194304] 0 2024-02-28T16:01:58.629 INFO:tasks.workunit.client.1.smithi087.stdout:4/613: readlink d2/d9/d10/d22/d5b/d5c/la8 0 2024-02-28T16:01:58.631 INFO:tasks.workunit.client.1.smithi087.stdout:5/612: mknod d3/d9/d9b/ce3 0 2024-02-28T16:01:58.632 INFO:tasks.workunit.client.1.smithi087.stdout:1/544: fsync d0/fa2 0 2024-02-28T16:01:58.632 INFO:tasks.workunit.client.1.smithi087.stdout:9/532: chown d7/d1e/d60/d69/f82 19792343 1 2024-02-28T16:01:58.632 INFO:tasks.workunit.client.1.smithi087.stdout:3/560: dwrite d11/d33/f9e [0,4194304] 0 2024-02-28T16:01:58.635 INFO:tasks.workunit.client.0.smithi057.stdout:5/203: creat d2/d8/f46 x:0 0 0 2024-02-28T16:01:58.638 INFO:tasks.workunit.client.1.smithi087.stdout:3/561: stat d11/d33/d67/d9c/fb1 0 2024-02-28T16:01:58.638 INFO:tasks.workunit.client.1.smithi087.stdout:1/545: dread - d0/d1b/d1f/f7e zero size 2024-02-28T16:01:58.640 INFO:tasks.workunit.client.1.smithi087.stdout:3/562: truncate d11/f26 980523 0 2024-02-28T16:01:58.641 INFO:tasks.workunit.client.1.smithi087.stdout:8/571: dread d2/d18/d42/f6d [0,4194304] 0 2024-02-28T16:01:58.642 INFO:tasks.workunit.client.1.smithi087.stdout:7/538: creat d14/d27/d5d/d6a/d94/f9f x:0 0 0 2024-02-28T16:01:58.646 INFO:tasks.workunit.client.0.smithi057.stdout:0/349: dwrite d6/d12/d38/d5e/f4a [0,4194304] 0 2024-02-28T16:01:58.650 INFO:tasks.workunit.client.0.smithi057.stdout:8/261: symlink d5/d20/d39/d49/d56/l5f 0 2024-02-28T16:01:58.651 INFO:tasks.workunit.client.1.smithi087.stdout:7/539: write d14/d27/d5d/f99 [708230,97167] 0 2024-02-28T16:01:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:1/275: dread d1/d3/f3b [0,4194304] 0 2024-02-28T16:01:58.656 INFO:tasks.workunit.client.0.smithi057.stdout:4/215: dwrite d1/d22/f2a [0,4194304] 0 2024-02-28T16:01:58.659 INFO:tasks.workunit.client.1.smithi087.stdout:3/563: unlink d11/d3a/d3c/l41 0 2024-02-28T16:01:58.659 INFO:tasks.workunit.client.1.smithi087.stdout:3/564: chown d11/l39 6150207 1 2024-02-28T16:01:58.664 INFO:tasks.workunit.client.0.smithi057.stdout:5/204: symlink d2/d19/d1c/l47 0 2024-02-28T16:01:58.665 INFO:tasks.workunit.client.1.smithi087.stdout:9/533: truncate d7/dd/f28 1350816 0 2024-02-28T16:01:58.666 INFO:tasks.workunit.client.0.smithi057.stdout:3/163: mknod d8/dd/d14/d2e/d2f/c36 0 2024-02-28T16:01:58.666 INFO:tasks.workunit.client.0.smithi057.stdout:5/205: stat d2/d15/f1f 0 2024-02-28T16:01:58.667 INFO:tasks.workunit.client.1.smithi087.stdout:4/614: getdents d2/d9/d10/d22/d5b/d5c/d91/da9 0 2024-02-28T16:01:58.669 INFO:tasks.workunit.client.0.smithi057.stdout:5/206: dread - d2/d8/f46 zero size 2024-02-28T16:01:58.669 INFO:tasks.workunit.client.1.smithi087.stdout:8/572: rmdir d2/d9/d5e/d9c/db5 0 2024-02-28T16:01:58.670 INFO:tasks.workunit.client.0.smithi057.stdout:1/276: creat d1/d21/d42/f61 x:0 0 0 2024-02-28T16:01:58.670 INFO:tasks.workunit.client.1.smithi087.stdout:9/534: write d7/dd/d3c/f53 [3661835,109933] 0 2024-02-28T16:01:58.671 INFO:tasks.workunit.client.1.smithi087.stdout:7/540: truncate d14/f5b 2602206 0 2024-02-28T16:01:58.672 INFO:tasks.workunit.client.0.smithi057.stdout:8/262: mkdir d5/d20/d60 0 2024-02-28T16:01:58.673 INFO:tasks.workunit.client.1.smithi087.stdout:4/615: chown d2/d9/da/d1a/d26/d69/l6b 455 1 2024-02-28T16:01:58.675 INFO:tasks.workunit.client.1.smithi087.stdout:4/616: readlink d2/df/l4c 0 2024-02-28T16:01:58.675 INFO:tasks.workunit.client.1.smithi087.stdout:1/546: dwrite d0/d1b/d1f/d71/db2/d24/d78/fb4 [0,4194304] 0 2024-02-28T16:01:58.677 INFO:tasks.workunit.client.1.smithi087.stdout:1/547: readlink d0/d1b/d1f/l4c 0 2024-02-28T16:01:58.677 INFO:tasks.workunit.client.1.smithi087.stdout:4/617: write d2/fb7 [80299,116814] 0 2024-02-28T16:01:58.678 INFO:tasks.workunit.client.0.smithi057.stdout:8/263: write d5/de/f4a [581601,53915] 0 2024-02-28T16:01:58.678 INFO:tasks.workunit.client.1.smithi087.stdout:7/541: write f7 [357016,987] 0 2024-02-28T16:01:58.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:01:58 smithi057 ceph-mon[28763]: pgmap v31: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 44 MiB/s rd, 223 MiB/s wr, 398 op/s 2024-02-28T16:01:58.679 INFO:tasks.workunit.client.0.smithi057.stdout:4/216: rmdir d1/d10/d31/d36 39 2024-02-28T16:01:58.679 INFO:tasks.workunit.client.1.smithi087.stdout:9/535: creat d7/f9b x:0 0 0 2024-02-28T16:01:58.683 INFO:tasks.workunit.client.1.smithi087.stdout:1/548: write d0/d1b/d1f/d71/db2/f72 [1537109,2999] 0 2024-02-28T16:01:58.684 INFO:tasks.workunit.client.1.smithi087.stdout:7/542: mknod d14/d2e/d89/ca0 0 2024-02-28T16:01:58.685 INFO:tasks.workunit.client.1.smithi087.stdout:1/549: write d0/d1b/d1f/fa9 [113872,69237] 0 2024-02-28T16:01:58.686 INFO:tasks.workunit.client.1.smithi087.stdout:4/618: dread d2/df/d62/fd0 [0,4194304] 0 2024-02-28T16:01:58.687 INFO:tasks.workunit.client.1.smithi087.stdout:4/619: chown d2/d9/d10/d22/d5b/d5c/d91 30416929 1 2024-02-28T16:01:58.688 INFO:tasks.workunit.client.0.smithi057.stdout:2/202: link d19/d1d/l2a d19/d3a/l3e 0 2024-02-28T16:01:58.689 INFO:tasks.workunit.client.1.smithi087.stdout:4/620: dread - d2/d9/d10/d22/d5b/d5c/d91/da9/fcc zero size 2024-02-28T16:01:58.691 INFO:tasks.workunit.client.1.smithi087.stdout:0/547: read d4/dd/f9e [445546,48038] 0 2024-02-28T16:01:58.691 INFO:tasks.workunit.client.1.smithi087.stdout:4/621: chown d2/d9/d10/d22/d5b/d5c/d91 845 1 2024-02-28T16:01:58.692 INFO:tasks.workunit.client.0.smithi057.stdout:2/203: write d19/f2b [332731,19876] 0 2024-02-28T16:01:58.692 INFO:tasks.workunit.client.0.smithi057.stdout:3/164: creat d8/d26/f37 x:0 0 0 2024-02-28T16:01:58.695 INFO:tasks.workunit.client.0.smithi057.stdout:3/165: readlink d8/dd/d19/d25/l28 0 2024-02-28T16:01:58.696 INFO:tasks.workunit.client.0.smithi057.stdout:1/277: mkdir d1/d21/d25/d26/d53/d62 0 2024-02-28T16:01:58.697 INFO:tasks.workunit.client.0.smithi057.stdout:4/217: creat d1/d10/d12/d2c/d37/f4e x:0 0 0 2024-02-28T16:01:58.698 INFO:tasks.workunit.client.1.smithi087.stdout:4/622: mknod d2/d9/d10/d22/d5b/d5c/d91/da9/cd6 0 2024-02-28T16:01:58.699 INFO:tasks.workunit.client.0.smithi057.stdout:5/207: link d2/l5 d2/d15/d3b/l48 0 2024-02-28T16:01:58.702 INFO:tasks.workunit.client.1.smithi087.stdout:0/548: mknod d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/cb3 0 2024-02-28T16:01:58.705 INFO:tasks.workunit.client.0.smithi057.stdout:2/204: creat d19/d1d/f3f x:0 0 0 2024-02-28T16:01:58.705 INFO:tasks.workunit.client.0.smithi057.stdout:5/208: creat d2/d8/f49 x:0 0 0 2024-02-28T16:01:58.706 INFO:tasks.workunit.client.1.smithi087.stdout:4/623: write d2/df/d62/fd0 [1465395,72559] 0 2024-02-28T16:01:58.709 INFO:tasks.workunit.client.1.smithi087.stdout:7/543: dwrite d14/d2e/d2b/d4e/f98 [0,4194304] 0 2024-02-28T16:01:58.709 INFO:tasks.workunit.client.0.smithi057.stdout:1/278: creat d1/d21/f63 x:0 0 0 2024-02-28T16:01:58.710 INFO:tasks.workunit.client.0.smithi057.stdout:5/209: unlink d2/d12/f30 0 2024-02-28T16:01:58.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:01:58 smithi087 ceph-mon[37122]: pgmap v31: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 44 MiB/s rd, 223 MiB/s wr, 398 op/s 2024-02-28T16:01:58.716 INFO:tasks.workunit.client.1.smithi087.stdout:1/550: dwrite d0/d1b/fb8 [0,4194304] 0 2024-02-28T16:01:58.716 INFO:tasks.workunit.client.1.smithi087.stdout:7/544: mknod d14/d21/d4f/ca1 0 2024-02-28T16:01:58.716 INFO:tasks.workunit.client.1.smithi087.stdout:4/624: mknod d2/d9/d10/d22/d5b/d5c/d91/da9/cd7 0 2024-02-28T16:01:58.721 INFO:tasks.workunit.client.1.smithi087.stdout:4/625: rename d2/d9/da/d1a/d26/d69/fbc to d2/dc1/fd8 0 2024-02-28T16:01:58.722 INFO:tasks.workunit.client.0.smithi057.stdout:4/218: link d1/d1f/c49 d1/d10/c4f 0 2024-02-28T16:01:58.723 INFO:tasks.workunit.client.1.smithi087.stdout:4/626: chown d2/df/d2e/f8e 50600841 1 2024-02-28T16:01:58.724 INFO:tasks.workunit.client.1.smithi087.stdout:1/551: link d0/d14/d86/fb0 d0/d1b/d1f/d71/db2/d24/d5c/fba 0 2024-02-28T16:01:58.725 INFO:tasks.workunit.client.0.smithi057.stdout:5/210: fsync d2/d15/d3b/f2f 0 2024-02-28T16:01:58.726 INFO:tasks.workunit.client.1.smithi087.stdout:9/536: dread d7/f88 [0,4194304] 0 2024-02-28T16:01:58.728 INFO:tasks.workunit.client.1.smithi087.stdout:4/627: creat d2/df/fd9 x:0 0 0 2024-02-28T16:01:58.728 INFO:tasks.workunit.client.1.smithi087.stdout:9/537: write d7/dd/d3c/d4c/f8c [2274631,507] 0 2024-02-28T16:01:58.730 INFO:tasks.workunit.client.0.smithi057.stdout:4/219: write d1/d10/f4d [585688,1904] 0 2024-02-28T16:01:58.731 INFO:tasks.workunit.client.0.smithi057.stdout:5/211: chown d2/d19/f29 151145 1 2024-02-28T16:01:58.734 INFO:tasks.workunit.client.1.smithi087.stdout:4/628: creat d2/d9/d10/dbf/db6/fda x:0 0 0 2024-02-28T16:01:58.734 INFO:tasks.workunit.client.1.smithi087.stdout:4/629: chown d2/d9/d10/d22/f27 251498 1 2024-02-28T16:01:58.734 INFO:tasks.workunit.client.0.smithi057.stdout:4/220: fsync d1/d14/f34 0 2024-02-28T16:01:58.735 INFO:tasks.workunit.client.1.smithi087.stdout:4/630: stat d2/d9/d10/c4e 0 2024-02-28T16:01:58.740 INFO:tasks.workunit.client.1.smithi087.stdout:7/545: dread d14/d27/f3f [0,4194304] 0 2024-02-28T16:01:58.741 INFO:tasks.workunit.client.0.smithi057.stdout:5/212: write d2/d15/d3b/f3a [715345,2683] 0 2024-02-28T16:01:58.742 INFO:tasks.workunit.client.1.smithi087.stdout:6/590: chown d4/d12/d45/d92/f94 5100 1 2024-02-28T16:01:58.742 INFO:tasks.workunit.client.1.smithi087.stdout:4/631: write d2/d9/d10/dbf/db6/fda [772728,48834] 0 2024-02-28T16:01:58.743 INFO:tasks.workunit.client.0.smithi057.stdout:2/205: dwrite d19/f1a [4194304,4194304] 0 2024-02-28T16:01:58.743 INFO:tasks.workunit.client.1.smithi087.stdout:1/552: dwrite d0/d14/f42 [0,4194304] 0 2024-02-28T16:01:58.748 INFO:tasks.workunit.client.1.smithi087.stdout:9/538: dwrite d7/d1e/f5c [0,4194304] 0 2024-02-28T16:01:58.750 INFO:tasks.workunit.client.0.smithi057.stdout:8/264: dread d5/de/d1b/f35 [0,4194304] 0 2024-02-28T16:01:58.750 INFO:tasks.workunit.client.0.smithi057.stdout:5/213: write d2/d19/d1c/f36 [37593,125211] 0 2024-02-28T16:01:58.750 INFO:tasks.workunit.client.0.smithi057.stdout:8/265: read - d5/d20/f38 zero size 2024-02-28T16:01:58.756 INFO:tasks.workunit.client.0.smithi057.stdout:1/279: dwrite d1/d3/dc/d15/f17 [0,4194304] 0 2024-02-28T16:01:58.775 INFO:tasks.workunit.client.1.smithi087.stdout:8/573: rmdir d2/d9 39 2024-02-28T16:01:58.777 INFO:tasks.workunit.client.0.smithi057.stdout:1/280: dread d1/d3/f47 [0,4194304] 0 2024-02-28T16:01:58.778 INFO:tasks.workunit.client.1.smithi087.stdout:3/565: truncate d11/f13 865413 0 2024-02-28T16:01:58.781 INFO:tasks.workunit.client.1.smithi087.stdout:3/566: fdatasync d11/d33/d67/d9c/fb1 0 2024-02-28T16:01:58.784 INFO:tasks.workunit.client.1.smithi087.stdout:9/539: dwrite d7/dd/d3c/f6f [0,4194304] 0 2024-02-28T16:01:58.787 INFO:tasks.workunit.client.1.smithi087.stdout:5/613: dwrite d3/d9/d9b/dba/d69/f92 [0,4194304] 0 2024-02-28T16:01:58.791 INFO:tasks.workunit.client.1.smithi087.stdout:6/591: read d4/d96/f98 [3440984,49471] 0 2024-02-28T16:01:58.793 INFO:tasks.workunit.client.0.smithi057.stdout:0/350: fsync d6/d12/d38/d5e/f4a 0 2024-02-28T16:01:58.796 INFO:tasks.workunit.client.1.smithi087.stdout:3/567: rename d11/d61/f6a to d11/d33/d67/d98/fbb 0 2024-02-28T16:01:58.799 INFO:tasks.workunit.client.0.smithi057.stdout:0/351: mkdir d6/d12/d5d/d71 0 2024-02-28T16:01:58.804 INFO:tasks.workunit.client.0.smithi057.stdout:0/352: mknod d6/c72 0 2024-02-28T16:01:58.807 INFO:tasks.workunit.client.1.smithi087.stdout:0/549: write d4/f48 [82117,101630] 0 2024-02-28T16:01:58.809 INFO:tasks.workunit.client.1.smithi087.stdout:6/592: write d4/d30/d13/f3b [4116504,124462] 0 2024-02-28T16:01:58.810 INFO:tasks.workunit.client.1.smithi087.stdout:9/540: link d7/l27 d7/dd/d36/d89/l9c 0 2024-02-28T16:01:58.811 INFO:tasks.workunit.client.0.smithi057.stdout:3/166: write d8/dd/d19/f2d [1287194,74319] 0 2024-02-28T16:01:58.811 INFO:tasks.workunit.client.0.smithi057.stdout:0/353: readlink d6/d12/d45/d55/l53 0 2024-02-28T16:01:58.811 INFO:tasks.workunit.client.0.smithi057.stdout:3/167: dread - d8/d26/f37 zero size 2024-02-28T16:01:58.814 INFO:tasks.workunit.client.1.smithi087.stdout:3/568: symlink d11/d44/lbc 0 2024-02-28T16:01:58.817 INFO:tasks.workunit.client.1.smithi087.stdout:6/593: readlink d4/l25 0 2024-02-28T16:01:58.819 INFO:tasks.workunit.client.0.smithi057.stdout:4/221: rename d1/d1f to d1/d10/d12/d2c/d50 0 2024-02-28T16:01:58.821 INFO:tasks.workunit.client.0.smithi057.stdout:4/222: stat d1/l30 0 2024-02-28T16:01:58.821 INFO:tasks.workunit.client.1.smithi087.stdout:9/541: mkdir d7/dd/d15/d3f/d9d 0 2024-02-28T16:01:58.821 INFO:tasks.workunit.client.1.smithi087.stdout:3/569: dread d11/d61/d65/f70 [0,4194304] 0 2024-02-28T16:01:58.823 INFO:tasks.workunit.client.0.smithi057.stdout:3/168: mknod d8/dd/d19/d2a/c38 0 2024-02-28T16:01:58.825 INFO:tasks.workunit.client.1.smithi087.stdout:6/594: chown d4/c22 57 1 2024-02-28T16:01:58.825 INFO:tasks.workunit.client.0.smithi057.stdout:8/266: write d5/de/f4d [3349314,58111] 0 2024-02-28T16:01:58.826 INFO:tasks.workunit.client.0.smithi057.stdout:5/214: truncate d2/f1b 3758200 0 2024-02-28T16:01:58.827 INFO:tasks.workunit.client.0.smithi057.stdout:3/169: chown d8/f15 145266335 1 2024-02-28T16:01:58.827 INFO:tasks.workunit.client.1.smithi087.stdout:3/570: read d11/f36 [1784640,10880] 0 2024-02-28T16:01:58.827 INFO:tasks.workunit.client.1.smithi087.stdout:0/550: truncate d4/d6/f14 2460624 0 2024-02-28T16:01:58.834 INFO:tasks.workunit.client.1.smithi087.stdout:1/553: truncate d0/d1a/d28/f29 2940529 0 2024-02-28T16:01:58.834 INFO:tasks.workunit.client.1.smithi087.stdout:5/614: dread d3/d9/d9b/dba/f20 [0,4194304] 0 2024-02-28T16:01:58.834 INFO:tasks.workunit.client.0.smithi057.stdout:5/215: creat d2/f4a x:0 0 0 2024-02-28T16:01:58.835 INFO:tasks.workunit.client.0.smithi057.stdout:3/170: creat d8/dd/d19/d2a/f39 x:0 0 0 2024-02-28T16:01:58.835 INFO:tasks.workunit.client.1.smithi087.stdout:6/595: creat d4/d12/fbc x:0 0 0 2024-02-28T16:01:58.835 INFO:tasks.workunit.client.0.smithi057.stdout:8/267: fdatasync d5/d6/f2d 0 2024-02-28T16:01:58.836 INFO:tasks.workunit.client.0.smithi057.stdout:1/281: dread d1/d3/f11 [0,4194304] 0 2024-02-28T16:01:58.838 INFO:tasks.workunit.client.0.smithi057.stdout:3/171: chown d8/dd/d19/c1e 2007021146 1 2024-02-28T16:01:58.838 INFO:tasks.workunit.client.0.smithi057.stdout:1/282: fsync d1/f8 0 2024-02-28T16:01:58.840 INFO:tasks.workunit.client.1.smithi087.stdout:7/546: dread f13 [0,4194304] 0 2024-02-28T16:01:58.841 INFO:tasks.workunit.client.0.smithi057.stdout:0/354: dread d6/d12/d38/d5e/f4a [0,4194304] 0 2024-02-28T16:01:58.842 INFO:tasks.workunit.client.0.smithi057.stdout:1/283: read - d1/d3/dc/f56 zero size 2024-02-28T16:01:58.842 INFO:tasks.workunit.client.1.smithi087.stdout:7/547: chown d14/d2e/l9d 0 1 2024-02-28T16:01:58.842 INFO:tasks.workunit.client.1.smithi087.stdout:9/542: mknod d7/dd/c9e 0 2024-02-28T16:01:58.844 INFO:tasks.workunit.client.1.smithi087.stdout:6/596: mkdir d4/d12/d45/d92/dbd 0 2024-02-28T16:01:58.846 INFO:tasks.workunit.client.0.smithi057.stdout:8/268: truncate d5/de/d1b/d4b/f5d 1013004 0 2024-02-28T16:01:58.848 INFO:tasks.workunit.client.1.smithi087.stdout:1/554: write d0/d1b/d1f/d71/db2/d24/d78/f9c [645071,130337] 0 2024-02-28T16:01:58.849 INFO:tasks.workunit.client.1.smithi087.stdout:5/615: creat d3/d9/d9b/dba/d30/d36/d4f/d82/fe4 x:0 0 0 2024-02-28T16:01:58.850 INFO:tasks.workunit.client.0.smithi057.stdout:0/355: dread d6/f41 [0,4194304] 0 2024-02-28T16:01:58.852 INFO:tasks.workunit.client.1.smithi087.stdout:1/555: rename d0/d1b/d43 to d0/d1b/d43/dbb 22 2024-02-28T16:01:58.856 INFO:tasks.workunit.client.0.smithi057.stdout:4/223: dwrite d1/d14/f34 [4194304,4194304] 0 2024-02-28T16:01:58.856 INFO:tasks.workunit.client.0.smithi057.stdout:8/269: mknod d5/de/d1b/c61 0 2024-02-28T16:01:58.857 INFO:tasks.workunit.client.1.smithi087.stdout:2/541: sync 2024-02-28T16:01:58.860 INFO:tasks.workunit.client.1.smithi087.stdout:5/616: symlink d3/d9/le5 0 2024-02-28T16:01:58.860 INFO:tasks.workunit.client.1.smithi087.stdout:8/574: dwrite d2/d9/d10/f12 [4194304,4194304] 0 2024-02-28T16:01:58.860 INFO:tasks.workunit.client.1.smithi087.stdout:2/542: stat d2/d42/d4b/f56 0 2024-02-28T16:01:58.860 INFO:tasks.workunit.client.1.smithi087.stdout:6/597: write d4/dc/d7e/f9c [34684,16039] 0 2024-02-28T16:01:58.865 INFO:tasks.workunit.client.1.smithi087.stdout:1/556: mknod d0/d1b/d1f/d71/db2/dae/cbc 0 2024-02-28T16:01:58.865 INFO:tasks.workunit.client.1.smithi087.stdout:7/548: dread d14/d2e/d2b/f51 [0,4194304] 0 2024-02-28T16:01:58.867 INFO:tasks.workunit.client.0.smithi057.stdout:4/224: rename d1/d10/l20 to d1/d22/l51 0 2024-02-28T16:01:58.870 INFO:tasks.workunit.client.1.smithi087.stdout:0/551: dwrite d4/dd/d21/d52/f7e [0,4194304] 0 2024-02-28T16:01:58.870 INFO:tasks.workunit.client.1.smithi087.stdout:0/552: dread - d4/dd/fb0 zero size 2024-02-28T16:01:58.872 INFO:tasks.workunit.client.1.smithi087.stdout:7/549: fsync d14/d46/d7c/f84 0 2024-02-28T16:01:58.873 INFO:tasks.workunit.client.1.smithi087.stdout:2/543: unlink d2/d99/c1f 0 2024-02-28T16:01:58.875 INFO:tasks.workunit.client.1.smithi087.stdout:6/598: symlink d4/d12/d45/d92/lbe 0 2024-02-28T16:01:58.884 INFO:tasks.workunit.client.1.smithi087.stdout:3/571: truncate d11/f17 4593707 0 2024-02-28T16:01:58.884 INFO:tasks.workunit.client.1.smithi087.stdout:1/557: unlink d0/d1b/d43/d4d/lb1 0 2024-02-28T16:01:58.884 INFO:tasks.workunit.client.1.smithi087.stdout:2/544: chown d2/d99/d28/f83 66507010 1 2024-02-28T16:01:58.884 INFO:tasks.workunit.client.1.smithi087.stdout:0/553: mkdir d4/d6/dc/d45/db4 0 2024-02-28T16:01:58.884 INFO:tasks.workunit.client.1.smithi087.stdout:6/599: mknod d4/d30/d13/d67/cbf 0 2024-02-28T16:01:58.886 INFO:tasks.workunit.client.0.smithi057.stdout:5/216: dwrite d2/f4a [0,4194304] 0 2024-02-28T16:01:58.886 INFO:tasks.workunit.client.0.smithi057.stdout:4/225: write d1/d10/d12/d2c/d37/f42 [961390,83923] 0 2024-02-28T16:01:58.890 INFO:tasks.workunit.client.1.smithi087.stdout:6/600: stat d4/d12/d45/f91 0 2024-02-28T16:01:58.891 INFO:tasks.workunit.client.0.smithi057.stdout:4/226: write d1/d10/f4d [328843,54237] 0 2024-02-28T16:01:58.892 INFO:tasks.workunit.client.1.smithi087.stdout:0/554: write d4/dd/d21/f71 [938625,94299] 0 2024-02-28T16:01:58.893 INFO:tasks.workunit.client.1.smithi087.stdout:1/558: dread d0/d14/f18 [0,4194304] 0 2024-02-28T16:01:58.893 INFO:tasks.workunit.client.1.smithi087.stdout:2/545: rename d2/d99/f39 to d2/d7d/fcb 0 2024-02-28T16:01:58.894 INFO:tasks.workunit.client.1.smithi087.stdout:0/555: chown d4/d1c 22697783 1 2024-02-28T16:01:58.896 INFO:tasks.workunit.client.0.smithi057.stdout:4/227: write d1/d22/f24 [3966568,75332] 0 2024-02-28T16:01:58.896 INFO:tasks.workunit.client.0.smithi057.stdout:0/356: dwrite d6/d4e/f32 [0,4194304] 0 2024-02-28T16:01:58.899 INFO:tasks.workunit.client.1.smithi087.stdout:8/575: dwrite d2/fa9 [0,4194304] 0 2024-02-28T16:01:58.908 INFO:tasks.workunit.client.0.smithi057.stdout:4/228: rename d1/d10/d12 to d1/d10/d12/d52 22 2024-02-28T16:01:58.908 INFO:tasks.workunit.client.1.smithi087.stdout:5/617: dwrite d3/d9/f15 [0,4194304] 0 2024-02-28T16:01:58.909 INFO:tasks.workunit.client.1.smithi087.stdout:1/559: readlink d0/d1b/d1f/d71/db2/d24/la5 0 2024-02-28T16:01:58.916 INFO:tasks.workunit.client.0.smithi057.stdout:5/217: link d2/d15/f1f d2/d12/d3d/f4b 0 2024-02-28T16:01:58.922 INFO:tasks.workunit.client.0.smithi057.stdout:5/218: mknod d2/d19/c4c 0 2024-02-28T16:01:58.922 INFO:tasks.workunit.client.1.smithi087.stdout:7/550: dwrite f13 [0,4194304] 0 2024-02-28T16:01:58.929 INFO:tasks.workunit.client.0.smithi057.stdout:5/219: write d2/d19/d1c/f2c [2664232,4754] 0 2024-02-28T16:01:58.930 INFO:tasks.workunit.client.1.smithi087.stdout:1/560: getdents d0/d14/d86/da1 0 2024-02-28T16:01:58.931 INFO:tasks.workunit.client.0.smithi057.stdout:8/270: dwrite d5/de/d1b/f25 [0,4194304] 0 2024-02-28T16:01:58.935 INFO:tasks.workunit.client.1.smithi087.stdout:3/572: dwrite d11/d61/d65/f70 [0,4194304] 0 2024-02-28T16:01:58.936 INFO:tasks.workunit.client.0.smithi057.stdout:0/357: dwrite d6/d12/d45/f4f [0,4194304] 0 2024-02-28T16:01:58.938 INFO:tasks.workunit.client.1.smithi087.stdout:7/551: symlink d14/d2e/d2b/d4e/la2 0 2024-02-28T16:01:58.941 INFO:tasks.workunit.client.1.smithi087.stdout:8/576: mkdir d2/d9/d10/d24/d9d/dbd 0 2024-02-28T16:01:58.941 INFO:tasks.workunit.client.1.smithi087.stdout:3/573: write d11/f32 [932586,53742] 0 2024-02-28T16:01:58.943 INFO:tasks.workunit.client.1.smithi087.stdout:0/556: dread d4/dd/d37/d39/d3a/d57/d74/d1f/f47 [0,4194304] 0 2024-02-28T16:01:58.944 INFO:tasks.workunit.client.0.smithi057.stdout:4/229: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:01:58.946 INFO:tasks.workunit.client.1.smithi087.stdout:3/574: chown d11/d44/f87 11529 1 2024-02-28T16:01:58.950 INFO:tasks.workunit.client.1.smithi087.stdout:7/552: chown d14/d21/l58 2970726 1 2024-02-28T16:01:58.952 INFO:tasks.workunit.client.1.smithi087.stdout:8/577: symlink d2/d63/d9b/dae/lbe 0 2024-02-28T16:01:58.952 INFO:tasks.workunit.client.1.smithi087.stdout:5/618: dwrite d3/d64/d67/d7c/fbb [0,4194304] 0 2024-02-28T16:01:58.952 INFO:tasks.workunit.client.0.smithi057.stdout:0/358: rmdir d6/d4e 39 2024-02-28T16:01:58.954 INFO:tasks.workunit.client.0.smithi057.stdout:8/271: rmdir d5/de/d1b/d5c 0 2024-02-28T16:01:58.957 INFO:tasks.workunit.client.1.smithi087.stdout:0/557: unlink d4/dd/d37/d39/d3a/d57/d74/c5c 0 2024-02-28T16:01:58.964 INFO:tasks.workunit.client.1.smithi087.stdout:6/601: write d4/d30/d13/f58 [1865070,35217] 0 2024-02-28T16:01:58.966 INFO:tasks.workunit.client.1.smithi087.stdout:8/578: mknod d2/d9/d5e/dbc/cbf 0 2024-02-28T16:01:58.968 INFO:tasks.workunit.client.1.smithi087.stdout:7/553: fsync d14/f5b 0 2024-02-28T16:01:58.970 INFO:tasks.workunit.client.0.smithi057.stdout:4/230: creat d1/d3f/f53 x:0 0 0 2024-02-28T16:01:58.970 INFO:tasks.workunit.client.0.smithi057.stdout:5/220: dwrite d2/d8/f9 [0,4194304] 0 2024-02-28T16:01:58.971 INFO:tasks.workunit.client.1.smithi087.stdout:7/554: readlink d14/d21/l58 0 2024-02-28T16:01:58.974 INFO:tasks.workunit.client.0.smithi057.stdout:5/221: chown d2/d8/f9 239931081 1 2024-02-28T16:01:58.975 INFO:tasks.workunit.client.0.smithi057.stdout:0/359: rename d6/f29 to d6/d12/d17/d4b/d60/f73 0 2024-02-28T16:01:58.979 INFO:tasks.workunit.client.1.smithi087.stdout:7/555: symlink d14/d46/d80/la3 0 2024-02-28T16:01:58.983 INFO:tasks.workunit.client.0.smithi057.stdout:5/222: creat d2/d19/d1c/f4d x:0 0 0 2024-02-28T16:01:58.984 INFO:tasks.workunit.client.1.smithi087.stdout:4/632: sync 2024-02-28T16:01:58.984 INFO:tasks.workunit.client.1.smithi087.stdout:1/561: write d0/d1b/f47 [1514545,11928] 0 2024-02-28T16:01:58.990 INFO:tasks.workunit.client.0.smithi057.stdout:0/360: unlink d6/d12/d17/d34/f3f 0 2024-02-28T16:01:58.990 INFO:tasks.workunit.client.1.smithi087.stdout:5/619: getdents d3/d9/d9b/dba/d30/d8f/dac 0 2024-02-28T16:01:58.990 INFO:tasks.workunit.client.1.smithi087.stdout:2/546: dread d2/d7/d17/d34/f6e [4194304,4194304] 0 2024-02-28T16:01:58.990 INFO:tasks.workunit.client.0.smithi057.stdout:4/231: mknod d1/d10/d31/c54 0 2024-02-28T16:01:58.992 INFO:tasks.workunit.client.1.smithi087.stdout:5/620: chown d3/d9/d9b/dba/f9d 0 1 2024-02-28T16:01:58.994 INFO:tasks.workunit.client.1.smithi087.stdout:3/575: write d11/f29 [1824833,28534] 0 2024-02-28T16:01:58.995 INFO:tasks.workunit.client.1.smithi087.stdout:2/547: write d2/d42/f44 [924962,35878] 0 2024-02-28T16:01:58.998 INFO:tasks.workunit.client.0.smithi057.stdout:0/361: mknod d6/d12/d45/c74 0 2024-02-28T16:01:58.998 INFO:tasks.workunit.client.0.smithi057.stdout:0/362: readlink d6/l30 0 2024-02-28T16:01:59.000 INFO:tasks.workunit.client.1.smithi087.stdout:6/602: getdents d4/d12/d45/d92 0 2024-02-28T16:01:59.001 INFO:tasks.workunit.client.1.smithi087.stdout:7/556: mknod d14/d46/ca4 0 2024-02-28T16:01:59.003 INFO:tasks.workunit.client.1.smithi087.stdout:7/557: stat d14/d46/d80/la3 0 2024-02-28T16:01:59.003 INFO:tasks.workunit.client.1.smithi087.stdout:3/576: fsync d11/f2f 0 2024-02-28T16:01:59.004 INFO:tasks.workunit.client.1.smithi087.stdout:2/548: rmdir d2/d7/d17/d97 39 2024-02-28T16:01:59.006 INFO:tasks.workunit.client.1.smithi087.stdout:2/549: stat d2/d7/d17/l77 0 2024-02-28T16:01:59.007 INFO:tasks.workunit.client.1.smithi087.stdout:0/558: truncate d4/dd/d37/d39/d3a/d57/d74/f1d 3433912 0 2024-02-28T16:01:59.009 INFO:tasks.workunit.client.0.smithi057.stdout:0/363: dread d6/d12/d17/d34/f63 [0,4194304] 0 2024-02-28T16:01:59.010 INFO:tasks.workunit.client.1.smithi087.stdout:6/603: symlink d4/d30/d9b/lc0 0 2024-02-28T16:01:59.010 INFO:tasks.workunit.client.0.smithi057.stdout:4/232: mknod d1/d10/d12/d2c/d37/d46/c55 0 2024-02-28T16:01:59.011 INFO:tasks.workunit.client.0.smithi057.stdout:5/223: getdents d2/d15 0 2024-02-28T16:01:59.013 INFO:tasks.workunit.client.1.smithi087.stdout:4/633: dwrite d2/d9/d10/d22/fa1 [0,4194304] 0 2024-02-28T16:01:59.014 INFO:tasks.workunit.client.0.smithi057.stdout:4/233: write d1/d14/f34 [1952707,66732] 0 2024-02-28T16:01:59.014 INFO:tasks.workunit.client.1.smithi087.stdout:3/577: creat d11/fbd x:0 0 0 2024-02-28T16:01:59.015 INFO:tasks.workunit.client.0.smithi057.stdout:4/234: stat d1/d10/d12/d2c/d50 0 2024-02-28T16:01:59.017 INFO:tasks.workunit.client.0.smithi057.stdout:0/364: mknod d6/d12/d17/d34/c75 0 2024-02-28T16:01:59.019 INFO:tasks.workunit.client.1.smithi087.stdout:2/550: creat d2/d7d/fcc x:0 0 0 2024-02-28T16:01:59.019 INFO:tasks.workunit.client.0.smithi057.stdout:4/235: fsync d1/d10/d12/d39/f3e 0 2024-02-28T16:01:59.021 INFO:tasks.workunit.client.1.smithi087.stdout:1/562: getdents d0/d1b/d1f/d71/db2 0 2024-02-28T16:01:59.023 INFO:tasks.workunit.client.1.smithi087.stdout:5/621: link d3/d9/d9b/dba/d30/d53/d5b/la3 d3/le6 0 2024-02-28T16:01:59.025 INFO:tasks.workunit.client.1.smithi087.stdout:3/578: symlink d11/d33/d67/d98/lbe 0 2024-02-28T16:01:59.025 INFO:tasks.workunit.client.1.smithi087.stdout:1/563: fsync d0/d14/d48/fa6 0 2024-02-28T16:01:59.028 INFO:tasks.workunit.client.1.smithi087.stdout:8/579: dread d2/d9/d8e/f98 [0,4194304] 0 2024-02-28T16:01:59.028 INFO:tasks.workunit.client.0.smithi057.stdout:4/236: truncate d1/d10/d12/d2c/d37/f42 2007455 0 2024-02-28T16:01:59.033 INFO:tasks.workunit.client.1.smithi087.stdout:5/622: symlink d3/d9/d9b/dba/d30/d8f/dac/le7 0 2024-02-28T16:01:59.035 INFO:tasks.workunit.client.1.smithi087.stdout:0/559: dwrite d4/dd/d21/d52/f6e [0,4194304] 0 2024-02-28T16:01:59.035 INFO:tasks.workunit.client.1.smithi087.stdout:8/580: mknod d2/d18/d25/cc0 0 2024-02-28T16:01:59.036 INFO:tasks.workunit.client.0.smithi057.stdout:8/272: dwrite d5/de/f10 [0,4194304] 0 2024-02-28T16:01:59.036 INFO:tasks.workunit.client.0.smithi057.stdout:0/365: rename d6/d12/d38/d5e/f4a to d6/d12/d17/d34/f76 0 2024-02-28T16:01:59.039 INFO:tasks.workunit.client.0.smithi057.stdout:5/224: link d2/d19/d1c/f26 d2/d15/d3b/f4e 0 2024-02-28T16:01:59.039 INFO:tasks.workunit.client.0.smithi057.stdout:8/273: dread - d5/f29 zero size 2024-02-28T16:01:59.044 INFO:tasks.workunit.client.1.smithi087.stdout:1/564: rename d0/d1b/fb8 to d0/d1b/fbd 0 2024-02-28T16:01:59.044 INFO:tasks.workunit.client.0.smithi057.stdout:5/225: symlink d2/d12/l4f 0 2024-02-28T16:01:59.045 INFO:tasks.workunit.client.1.smithi087.stdout:5/623: mknod d3/d9/d4a/d5e/ce8 0 2024-02-28T16:01:59.047 INFO:tasks.workunit.client.1.smithi087.stdout:3/579: truncate d11/d33/d58/f81 698430 0 2024-02-28T16:01:59.050 INFO:tasks.workunit.client.1.smithi087.stdout:5/624: read - d3/d64/d81/fcf zero size 2024-02-28T16:01:59.050 INFO:tasks.workunit.client.0.smithi057.stdout:5/226: stat d2/d19/d1c/c20 0 2024-02-28T16:01:59.052 INFO:tasks.workunit.client.1.smithi087.stdout:4/634: dwrite d2/df/d2e/f43 [8388608,4194304] 0 2024-02-28T16:01:59.053 INFO:tasks.workunit.client.0.smithi057.stdout:0/366: rename d6/d12/d17/d58/f64 to d6/d4e/f77 0 2024-02-28T16:01:59.053 INFO:tasks.workunit.client.1.smithi087.stdout:5/625: chown d3/d9/fd7 0 1 2024-02-28T16:01:59.054 INFO:tasks.workunit.client.0.smithi057.stdout:4/237: dwrite d1/d10/f27 [0,4194304] 0 2024-02-28T16:01:59.055 INFO:tasks.workunit.client.0.smithi057.stdout:8/274: mkdir d5/d62 0 2024-02-28T16:01:59.055 INFO:tasks.workunit.client.1.smithi087.stdout:6/604: dread d4/d12/f16 [0,4194304] 0 2024-02-28T16:01:59.061 INFO:tasks.workunit.client.1.smithi087.stdout:7/558: dread d14/d27/d5d/d6a/d83/f8a [0,4194304] 0 2024-02-28T16:01:59.062 INFO:tasks.workunit.client.0.smithi057.stdout:4/238: mknod d1/d10/d12/d15/d19/c56 0 2024-02-28T16:01:59.065 INFO:tasks.workunit.client.0.smithi057.stdout:5/227: mkdir d2/d3e/d44/d50 0 2024-02-28T16:01:59.068 INFO:tasks.workunit.client.1.smithi087.stdout:5/626: mkdir d3/d9/d9b/de9 0 2024-02-28T16:01:59.070 INFO:tasks.workunit.client.0.smithi057.stdout:4/239: creat d1/d10/d12/d2c/f57 x:0 0 0 2024-02-28T16:01:59.072 INFO:tasks.workunit.client.1.smithi087.stdout:1/565: dwrite d0/d1a/f7d [0,4194304] 0 2024-02-28T16:01:59.076 INFO:tasks.workunit.client.1.smithi087.stdout:1/566: fdatasync d0/d14/d86/f89 0 2024-02-28T16:01:59.076 INFO:tasks.workunit.client.1.smithi087.stdout:0/560: dread d4/d6/f14 [0,4194304] 0 2024-02-28T16:01:59.079 INFO:tasks.workunit.client.1.smithi087.stdout:4/635: rmdir d2/d9/d10/d22/d5b/d5c/d90/d96 0 2024-02-28T16:01:59.080 INFO:tasks.workunit.client.0.smithi057.stdout:4/240: dread d1/d10/f4d [0,4194304] 0 2024-02-28T16:01:59.082 INFO:tasks.workunit.client.1.smithi087.stdout:7/559: read d14/d2e/d2b/d4e/f56 [2955846,28870] 0 2024-02-28T16:01:59.082 INFO:tasks.workunit.client.1.smithi087.stdout:5/627: write d3/d9/f1e [3098338,117400] 0 2024-02-28T16:01:59.083 INFO:tasks.workunit.client.1.smithi087.stdout:6/605: dread d4/d12/f16 [0,4194304] 0 2024-02-28T16:01:59.083 INFO:tasks.workunit.client.1.smithi087.stdout:3/580: getdents d11/d61/d7c 0 2024-02-28T16:01:59.084 INFO:tasks.workunit.client.1.smithi087.stdout:0/561: rmdir d4/dd/d37 39 2024-02-28T16:01:59.088 INFO:tasks.workunit.client.0.smithi057.stdout:4/241: chown d1/d14/f34 15176697 1 2024-02-28T16:01:59.088 INFO:tasks.workunit.client.1.smithi087.stdout:4/636: readlink d2/d9/d10/d22/d5b/d5c/lab 0 2024-02-28T16:01:59.088 INFO:tasks.workunit.client.1.smithi087.stdout:6/606: truncate d4/d12/f4f 4125615 0 2024-02-28T16:01:59.089 INFO:tasks.workunit.client.0.smithi057.stdout:8/275: truncate d5/f7 3359704 0 2024-02-28T16:01:59.090 INFO:tasks.workunit.client.1.smithi087.stdout:3/581: dread d11/d33/d67/d98/fbb [0,4194304] 0 2024-02-28T16:01:59.090 INFO:tasks.workunit.client.1.smithi087.stdout:7/560: dread d14/d27/d5d/f99 [0,4194304] 0 2024-02-28T16:01:59.090 INFO:tasks.workunit.client.1.smithi087.stdout:6/607: read - d4/d12/fbc zero size 2024-02-28T16:01:59.091 INFO:tasks.workunit.client.1.smithi087.stdout:5/628: rename d3/d64/fd3 to d3/d9/d9b/dba/d30/d36/d4f/d82/fea 0 2024-02-28T16:01:59.095 INFO:tasks.workunit.client.1.smithi087.stdout:3/582: mknod d11/d61/cbf 0 2024-02-28T16:01:59.096 INFO:tasks.workunit.client.1.smithi087.stdout:5/629: creat d3/d9/d4a/feb x:0 0 0 2024-02-28T16:01:59.096 INFO:tasks.workunit.client.1.smithi087.stdout:3/583: readlink d11/d61/d65/l69 0 2024-02-28T16:01:59.097 INFO:tasks.workunit.client.1.smithi087.stdout:7/561: creat d14/fa5 x:0 0 0 2024-02-28T16:01:59.099 INFO:tasks.workunit.client.1.smithi087.stdout:5/630: chown d3/d64/d81/f49 4 1 2024-02-28T16:01:59.099 INFO:tasks.workunit.client.1.smithi087.stdout:3/584: rmdir d11/d45 39 2024-02-28T16:01:59.100 INFO:tasks.workunit.client.1.smithi087.stdout:7/562: write f7 [1547889,71636] 0 2024-02-28T16:01:59.101 INFO:tasks.workunit.client.1.smithi087.stdout:0/562: truncate d4/dd/d37/d39/d3a/d57/d74/d1f/d60/f8b 777698 0 2024-02-28T16:01:59.102 INFO:tasks.workunit.client.1.smithi087.stdout:0/563: stat d4 0 2024-02-28T16:01:59.105 INFO:tasks.workunit.client.1.smithi087.stdout:5/631: mknod d3/d9/d9b/dba/d30/d44/d54/cec 0 2024-02-28T16:01:59.108 INFO:tasks.workunit.client.1.smithi087.stdout:6/608: dread d4/d30/d13/f3b [0,4194304] 0 2024-02-28T16:01:59.109 INFO:tasks.workunit.client.1.smithi087.stdout:3/585: creat d11/d33/d67/fc0 x:0 0 0 2024-02-28T16:01:59.110 INFO:tasks.workunit.client.0.smithi057.stdout:8/276: dwrite d5/de/f10 [0,4194304] 0 2024-02-28T16:01:59.116 INFO:tasks.workunit.client.1.smithi087.stdout:6/609: mkdir d4/d12/d45/d92/dc1 0 2024-02-28T16:01:59.117 INFO:tasks.workunit.client.1.smithi087.stdout:3/586: symlink d11/d61/d65/da9/lc1 0 2024-02-28T16:01:59.118 INFO:tasks.workunit.client.0.smithi057.stdout:5/228: dread d2/f10 [0,4194304] 0 2024-02-28T16:01:59.119 INFO:tasks.workunit.client.0.smithi057.stdout:8/277: mkdir d5/de/d63 0 2024-02-28T16:01:59.122 INFO:tasks.workunit.client.1.smithi087.stdout:6/610: creat d4/d30/d13/d38/d69/fc2 x:0 0 0 2024-02-28T16:01:59.122 INFO:tasks.workunit.client.1.smithi087.stdout:3/587: readlink d11/d61/d65/da9/lc1 0 2024-02-28T16:01:59.127 INFO:tasks.workunit.client.1.smithi087.stdout:0/564: dread d4/dd/d37/d39/d3a/d57/d74/f44 [0,4194304] 0 2024-02-28T16:01:59.130 INFO:tasks.workunit.client.1.smithi087.stdout:4/637: dwrite d2/d9/d10/d22/d5b/d5c/f7d [0,4194304] 0 2024-02-28T16:01:59.130 INFO:tasks.workunit.client.1.smithi087.stdout:3/588: fdatasync d11/d33/d67/d9c/fb2 0 2024-02-28T16:01:59.131 INFO:tasks.workunit.client.1.smithi087.stdout:0/565: creat d4/d6/d9c/fb5 x:0 0 0 2024-02-28T16:01:59.137 INFO:tasks.workunit.client.0.smithi057.stdout:8/278: dwrite d5/d6/f22 [0,4194304] 0 2024-02-28T16:01:59.138 INFO:tasks.workunit.client.1.smithi087.stdout:0/566: dread - d4/dd/f82 zero size 2024-02-28T16:01:59.150 INFO:tasks.workunit.client.1.smithi087.stdout:6/611: write d4/f20 [1721914,24897] 0 2024-02-28T16:01:59.151 INFO:tasks.workunit.client.0.smithi057.stdout:8/279: write d5/f12 [1053905,45592] 0 2024-02-28T16:01:59.155 INFO:tasks.workunit.client.0.smithi057.stdout:5/229: dread d2/f35 [0,4194304] 0 2024-02-28T16:01:59.158 INFO:tasks.workunit.client.0.smithi057.stdout:5/230: creat d2/d19/f51 x:0 0 0 2024-02-28T16:01:59.159 INFO:tasks.workunit.client.1.smithi087.stdout:7/563: dread d14/d27/d5d/d6a/d83/d96/f9a [0,4194304] 0 2024-02-28T16:01:59.160 INFO:tasks.workunit.client.0.smithi057.stdout:5/231: dread - d2/d12/d3d/f3f zero size 2024-02-28T16:01:59.161 INFO:tasks.workunit.client.1.smithi087.stdout:5/632: dread d3/fb2 [0,4194304] 0 2024-02-28T16:01:59.163 INFO:tasks.workunit.client.1.smithi087.stdout:9/543: sync 2024-02-28T16:01:59.163 INFO:tasks.workunit.client.0.smithi057.stdout:5/232: rmdir d2/d3e/d44 39 2024-02-28T16:01:59.164 INFO:tasks.workunit.client.1.smithi087.stdout:0/567: write d4/dd/d37/d39/d3a/d57/d74/f44 [2446487,62288] 0 2024-02-28T16:01:59.164 INFO:tasks.workunit.client.1.smithi087.stdout:4/638: unlink d2/d9/d10/d22/d5b/d5c/lab 0 2024-02-28T16:01:59.165 INFO:tasks.workunit.client.1.smithi087.stdout:6/612: mkdir d4/d30/d13/d38/dc3 0 2024-02-28T16:01:59.166 INFO:tasks.workunit.client.1.smithi087.stdout:3/589: dwrite fa [8388608,4194304] 0 2024-02-28T16:01:59.166 INFO:tasks.workunit.client.0.smithi057.stdout:5/233: unlink d2/d15/f17 0 2024-02-28T16:01:59.173 INFO:tasks.workunit.client.1.smithi087.stdout:7/564: symlink d14/d46/la6 0 2024-02-28T16:01:59.173 INFO:tasks.workunit.client.1.smithi087.stdout:9/544: mkdir d7/dd/d15/d3f/d6d/d9f 0 2024-02-28T16:01:59.174 INFO:tasks.workunit.client.1.smithi087.stdout:7/565: fdatasync fc 0 2024-02-28T16:01:59.177 INFO:tasks.workunit.client.1.smithi087.stdout:6/613: creat d4/d30/d13/d38/d69/d99/fc4 x:0 0 0 2024-02-28T16:01:59.180 INFO:tasks.workunit.client.0.smithi057.stdout:5/234: dwrite d2/d8/f9 [0,4194304] 0 2024-02-28T16:01:59.182 INFO:tasks.workunit.client.1.smithi087.stdout:3/590: link d11/f31 d11/d3a/d3c/fc2 0 2024-02-28T16:01:59.182 INFO:tasks.workunit.client.0.smithi057.stdout:5/235: write d2/d8/f46 [477077,11022] 0 2024-02-28T16:01:59.192 INFO:tasks.workunit.client.1.smithi087.stdout:4/639: dwrite d2/d9/da/f3f [4194304,4194304] 0 2024-02-28T16:01:59.192 INFO:tasks.workunit.client.1.smithi087.stdout:9/545: getdents d7/dd/d15 0 2024-02-28T16:01:59.192 INFO:tasks.workunit.client.1.smithi087.stdout:3/591: chown d11/d33/d67/d9c/da1/ca5 52 1 2024-02-28T16:01:59.195 INFO:tasks.workunit.client.1.smithi087.stdout:4/640: stat d2/l41 0 2024-02-28T16:01:59.197 INFO:tasks.workunit.client.1.smithi087.stdout:5/633: dwrite d3/d64/d67/f76 [0,4194304] 0 2024-02-28T16:01:59.203 INFO:tasks.workunit.client.0.smithi057.stdout:5/236: dwrite d2/d19/f51 [0,4194304] 0 2024-02-28T16:01:59.204 INFO:tasks.workunit.client.1.smithi087.stdout:4/641: rmdir d2/df 39 2024-02-28T16:01:59.205 INFO:tasks.workunit.client.0.smithi057.stdout:5/237: write d2/d8/f49 [530515,8215] 0 2024-02-28T16:01:59.205 INFO:tasks.workunit.client.1.smithi087.stdout:3/592: read d11/d33/d67/d98/fa7 [491028,18671] 0 2024-02-28T16:01:59.210 INFO:tasks.workunit.client.1.smithi087.stdout:4/642: readlink d2/d9/da/d1a/d26/lb1 0 2024-02-28T16:01:59.211 INFO:tasks.workunit.client.1.smithi087.stdout:7/566: dwrite d14/d21/f42 [0,4194304] 0 2024-02-28T16:01:59.212 INFO:tasks.workunit.client.1.smithi087.stdout:5/634: rename d3/d64/d81/f49 to d3/d9/d9b/dba/d30/d36/d4f/fed 0 2024-02-28T16:01:59.218 INFO:tasks.workunit.client.1.smithi087.stdout:5/635: write d3/d64/d81/f4b [77901,60115] 0 2024-02-28T16:01:59.220 INFO:tasks.workunit.client.0.smithi057.stdout:5/238: symlink d2/d3e/d44/d50/l52 0 2024-02-28T16:01:59.223 INFO:tasks.workunit.client.1.smithi087.stdout:3/593: mknod d11/cc3 0 2024-02-28T16:01:59.228 INFO:tasks.workunit.client.1.smithi087.stdout:3/594: chown d11/d7b/dab/fb3 19077194 1 2024-02-28T16:01:59.228 INFO:tasks.workunit.client.1.smithi087.stdout:9/546: dwrite d7/dd/d15/f22 [0,4194304] 0 2024-02-28T16:01:59.231 INFO:tasks.workunit.client.1.smithi087.stdout:6/614: truncate d4/d30/d13/f3b 2697287 0 2024-02-28T16:01:59.233 INFO:tasks.workunit.client.1.smithi087.stdout:0/568: dread d4/dd/f1b [4194304,4194304] 0 2024-02-28T16:01:59.233 INFO:tasks.workunit.client.1.smithi087.stdout:5/636: rename d3/d9/d9b/dba/le2 to d3/d9/d4a/d5e/lee 0 2024-02-28T16:01:59.239 INFO:tasks.workunit.client.1.smithi087.stdout:5/637: readlink d3/d9/d9b/lbd 0 2024-02-28T16:01:59.242 INFO:tasks.workunit.client.1.smithi087.stdout:0/569: mkdir d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/db6 0 2024-02-28T16:01:59.244 INFO:tasks.workunit.client.1.smithi087.stdout:0/570: write d4/dd/fb0 [621578,23637] 0 2024-02-28T16:01:59.249 INFO:tasks.workunit.client.0.smithi057.stdout:5/239: rename d2/d19/d1c/c20 to d2/d8/c53 0 2024-02-28T16:01:59.250 INFO:tasks.workunit.client.1.smithi087.stdout:5/638: rename d3/d9/d4a/d5e/c83 to d3/d9/d9b/dba/d30/d36/d4f/cef 0 2024-02-28T16:01:59.253 INFO:tasks.workunit.client.0.smithi057.stdout:5/240: mknod d2/c54 0 2024-02-28T16:01:59.254 INFO:tasks.workunit.client.1.smithi087.stdout:9/547: dwrite d7/dc/f85 [0,4194304] 0 2024-02-28T16:01:59.254 INFO:tasks.workunit.client.1.smithi087.stdout:5/639: symlink d3/d9/d9b/dba/d30/ddb/lf0 0 2024-02-28T16:01:59.256 INFO:tasks.workunit.client.1.smithi087.stdout:5/640: chown d3/d9/d9b/dba/d30/d44 7279 1 2024-02-28T16:01:59.266 INFO:tasks.workunit.client.1.smithi087.stdout:3/595: dread d11/f1b [0,4194304] 0 2024-02-28T16:01:59.270 INFO:tasks.workunit.client.1.smithi087.stdout:9/548: dread d7/dd/d15/f22 [0,4194304] 0 2024-02-28T16:01:59.277 INFO:tasks.workunit.client.1.smithi087.stdout:9/549: dread - d7/dd/d15/d79/d2e/f6a zero size 2024-02-28T16:01:59.277 INFO:tasks.workunit.client.1.smithi087.stdout:5/641: dwrite d3/d9/d9b/dba/d30/d8f/dac/fc2 [0,4194304] 0 2024-02-28T16:01:59.278 INFO:tasks.workunit.client.0.smithi057.stdout:5/241: write d2/d19/d1c/f34 [1287806,43475] 0 2024-02-28T16:01:59.280 INFO:tasks.workunit.client.1.smithi087.stdout:5/642: truncate d3/d9/d9b/f9c 476746 0 2024-02-28T16:01:59.284 INFO:tasks.workunit.client.1.smithi087.stdout:6/615: dread d4/d12/d45/f53 [0,4194304] 0 2024-02-28T16:01:59.288 INFO:tasks.workunit.client.1.smithi087.stdout:6/616: fsync d4/d30/d13/d38/f3a 0 2024-02-28T16:01:59.289 INFO:tasks.workunit.client.1.smithi087.stdout:6/617: readlink d4/dc/d61/l65 0 2024-02-28T16:01:59.297 INFO:tasks.workunit.client.1.smithi087.stdout:6/618: link d4/d12/d45/d57/f62 d4/d30/d13/d67/db8/fc5 0 2024-02-28T16:01:59.301 INFO:tasks.workunit.client.1.smithi087.stdout:5/643: dwrite d3/d9/d9b/dba/d30/d44/d54/f8c [0,4194304] 0 2024-02-28T16:01:59.302 INFO:tasks.workunit.client.1.smithi087.stdout:3/596: dread d11/f29 [0,4194304] 0 2024-02-28T16:01:59.304 INFO:tasks.workunit.client.0.smithi057.stdout:5/242: dwrite d2/d8/f49 [0,4194304] 0 2024-02-28T16:01:59.307 INFO:tasks.workunit.client.1.smithi087.stdout:6/619: creat d4/d12/d45/d92/dbd/fc6 x:0 0 0 2024-02-28T16:01:59.307 INFO:tasks.workunit.client.1.smithi087.stdout:3/597: symlink d11/d3a/d3c/lc4 0 2024-02-28T16:01:59.308 INFO:tasks.workunit.client.1.smithi087.stdout:5/644: creat d3/d9/d4a/d5e/ff1 x:0 0 0 2024-02-28T16:01:59.311 INFO:tasks.workunit.client.0.smithi057.stdout:5/243: unlink d2/d19/d1c/f26 0 2024-02-28T16:01:59.312 INFO:tasks.workunit.client.1.smithi087.stdout:5/645: stat d3/d9/d9b/dba/d30/d44/c4c 0 2024-02-28T16:01:59.313 INFO:tasks.workunit.client.1.smithi087.stdout:6/620: mkdir d4/d12/d45/d92/dc1/dc7 0 2024-02-28T16:01:59.313 INFO:tasks.workunit.client.1.smithi087.stdout:3/598: write d11/d45/d73/f99 [636119,6818] 0 2024-02-28T16:01:59.314 INFO:tasks.workunit.client.1.smithi087.stdout:9/550: dread d7/d1e/d44/f46 [0,4194304] 0 2024-02-28T16:01:59.314 INFO:tasks.workunit.client.1.smithi087.stdout:3/599: chown d11/d33/d74 254520 1 2024-02-28T16:01:59.315 INFO:tasks.workunit.client.0.smithi057.stdout:5/244: chown d2/d19/l38 4946944 1 2024-02-28T16:01:59.318 INFO:tasks.workunit.client.1.smithi087.stdout:6/621: mknod d4/d12/d45/d92/dc1/cc8 0 2024-02-28T16:01:59.323 INFO:tasks.workunit.client.1.smithi087.stdout:9/551: creat d7/d1e/d44/d83/fa0 x:0 0 0 2024-02-28T16:01:59.325 INFO:tasks.workunit.client.1.smithi087.stdout:9/552: chown d7/d1e/d60 431859 1 2024-02-28T16:01:59.325 INFO:tasks.workunit.client.0.smithi057.stdout:5/245: link d2/l5 d2/l55 0 2024-02-28T16:01:59.326 INFO:tasks.workunit.client.1.smithi087.stdout:3/600: read d11/f13 [106302,88692] 0 2024-02-28T16:01:59.333 INFO:tasks.workunit.client.1.smithi087.stdout:6/622: creat d4/dc/d7e/fc9 x:0 0 0 2024-02-28T16:01:59.334 INFO:tasks.workunit.client.0.smithi057.stdout:5/246: read d2/f22 [218526,63636] 0 2024-02-28T16:01:59.334 INFO:tasks.workunit.client.1.smithi087.stdout:5/646: dwrite d3/d9/d9b/dba/d69/f7d [0,4194304] 0 2024-02-28T16:01:59.334 INFO:tasks.workunit.client.1.smithi087.stdout:3/601: dread d11/d44/d5b/f78 [0,4194304] 0 2024-02-28T16:01:59.336 INFO:tasks.workunit.client.0.smithi057.stdout:5/247: symlink d2/l56 0 2024-02-28T16:01:59.337 INFO:tasks.workunit.client.1.smithi087.stdout:6/623: creat d4/d12/d45/d92/dbd/fca x:0 0 0 2024-02-28T16:01:59.339 INFO:tasks.workunit.client.1.smithi087.stdout:3/602: creat d11/d3a/d3c/fc5 x:0 0 0 2024-02-28T16:01:59.341 INFO:tasks.workunit.client.0.smithi057.stdout:5/248: creat d2/d8/f57 x:0 0 0 2024-02-28T16:01:59.342 INFO:tasks.workunit.client.1.smithi087.stdout:5/647: creat d3/d9/d9b/dba/d30/ddb/ff2 x:0 0 0 2024-02-28T16:01:59.343 INFO:tasks.workunit.client.0.smithi057.stdout:5/249: dread - d2/d8/f57 zero size 2024-02-28T16:01:59.344 INFO:tasks.workunit.client.1.smithi087.stdout:5/648: readlink d3/d9/d4a/d5e/la0 0 2024-02-28T16:01:59.353 INFO:tasks.workunit.client.1.smithi087.stdout:9/553: truncate d7/f14 3229285 0 2024-02-28T16:01:59.356 INFO:tasks.workunit.client.1.smithi087.stdout:9/554: readlink d7/d1e/d44/d83/l91 0 2024-02-28T16:01:59.356 INFO:tasks.workunit.client.1.smithi087.stdout:6/624: dwrite d4/dc/d7e/fc9 [0,4194304] 0 2024-02-28T16:01:59.359 INFO:tasks.workunit.client.1.smithi087.stdout:6/625: dread - d4/d30/d13/d38/d69/fc2 zero size 2024-02-28T16:01:59.364 INFO:tasks.workunit.client.1.smithi087.stdout:9/555: rename d7/d1e/d60/d64 to d7/dd/d3c/d4c/da1 0 2024-02-28T16:01:59.367 INFO:tasks.workunit.client.1.smithi087.stdout:9/556: read - d7/dd/d3c/d4c/da1/f73 zero size 2024-02-28T16:01:59.372 INFO:tasks.workunit.client.1.smithi087.stdout:6/626: dread d4/d30/d13/d38/fa1 [0,4194304] 0 2024-02-28T16:01:59.373 INFO:tasks.workunit.client.1.smithi087.stdout:6/627: readlink d4/d30/d13/d67/l8f 0 2024-02-28T16:01:59.375 INFO:tasks.workunit.client.1.smithi087.stdout:3/603: dread d11/f30 [0,4194304] 0 2024-02-28T16:01:59.376 INFO:tasks.workunit.client.1.smithi087.stdout:9/557: truncate d7/d1e/f24 69805 0 2024-02-28T16:01:59.382 INFO:tasks.workunit.client.1.smithi087.stdout:6/628: mknod d4/d12/d45/d74/ccb 0 2024-02-28T16:01:59.383 INFO:tasks.workunit.client.1.smithi087.stdout:6/629: chown d4/d30 56322 1 2024-02-28T16:01:59.383 INFO:tasks.workunit.client.1.smithi087.stdout:3/604: write d11/f31 [109123,104676] 0 2024-02-28T16:01:59.384 INFO:tasks.workunit.client.1.smithi087.stdout:2/551: sync 2024-02-28T16:01:59.389 INFO:tasks.workunit.client.1.smithi087.stdout:6/630: rename d4/d12/d45/d57/f6a to d4/d96/fcc 0 2024-02-28T16:01:59.390 INFO:tasks.workunit.client.1.smithi087.stdout:3/605: rmdir d11/d33/d67/d98/d9b 39 2024-02-28T16:01:59.390 INFO:tasks.workunit.client.1.smithi087.stdout:5/649: dread d3/d9/d9b/dba/f23 [0,4194304] 0 2024-02-28T16:01:59.392 INFO:tasks.workunit.client.1.smithi087.stdout:2/552: creat d2/d7/d17/fcd x:0 0 0 2024-02-28T16:01:59.394 INFO:tasks.workunit.client.1.smithi087.stdout:5/650: fsync d3/d64/d81/f55 0 2024-02-28T16:01:59.395 INFO:tasks.workunit.client.1.smithi087.stdout:2/553: rmdir d2/d7/d17/d34/daf 39 2024-02-28T16:01:59.395 INFO:tasks.workunit.client.1.smithi087.stdout:6/631: write d4/d12/d45/d74/d9a/fb2 [1132469,7478] 0 2024-02-28T16:01:59.401 INFO:tasks.workunit.client.1.smithi087.stdout:5/651: mkdir d3/d9/d9b/dba/d69/d87/df3 0 2024-02-28T16:01:59.403 INFO:tasks.workunit.client.1.smithi087.stdout:5/652: dread - d3/d9/d9b/dba/d30/d36/d4f/d82/fe4 zero size 2024-02-28T16:01:59.409 INFO:tasks.workunit.client.1.smithi087.stdout:3/606: truncate d11/d44/d5b/f5f 7881796 0 2024-02-28T16:01:59.409 INFO:tasks.workunit.client.1.smithi087.stdout:2/554: link d2/d99/d28/d54/f7b d2/d7/d17/d34/d88/fce 0 2024-02-28T16:01:59.410 INFO:tasks.workunit.client.1.smithi087.stdout:6/632: link d4/l6 d4/d12/d45/d92/lcd 0 2024-02-28T16:01:59.411 INFO:tasks.workunit.client.1.smithi087.stdout:2/555: dread - d2/d9a/fc5 zero size 2024-02-28T16:01:59.416 INFO:tasks.workunit.client.1.smithi087.stdout:9/558: dread d7/d1e/f51 [0,4194304] 0 2024-02-28T16:01:59.417 INFO:tasks.workunit.client.1.smithi087.stdout:6/633: symlink d4/d12/d45/d5e/lce 0 2024-02-28T16:01:59.418 INFO:tasks.workunit.client.1.smithi087.stdout:2/556: dread d2/d99/d28/d54/f7b [0,4194304] 0 2024-02-28T16:01:59.420 INFO:tasks.workunit.client.1.smithi087.stdout:6/634: unlink d4/dc/c6c 0 2024-02-28T16:01:59.423 INFO:tasks.workunit.client.1.smithi087.stdout:2/557: creat d2/d99/d28/d54/da6/fcf x:0 0 0 2024-02-28T16:01:59.431 INFO:tasks.workunit.client.1.smithi087.stdout:2/558: symlink d2/d7/d17/d34/ld0 0 2024-02-28T16:01:59.431 INFO:tasks.workunit.client.1.smithi087.stdout:5/653: dread d3/d64/f8d [0,4194304] 0 2024-02-28T16:01:59.431 INFO:tasks.workunit.client.1.smithi087.stdout:3/607: dwrite d11/d3a/d3c/f40 [0,4194304] 0 2024-02-28T16:01:59.438 INFO:tasks.workunit.client.1.smithi087.stdout:3/608: truncate d11/f35 3203816 0 2024-02-28T16:01:59.439 INFO:tasks.workunit.client.1.smithi087.stdout:3/609: readlink d11/d3a/d3c/lc4 0 2024-02-28T16:01:59.441 INFO:tasks.workunit.client.1.smithi087.stdout:2/559: rename d2/d7/d17/c27 to d2/d99/d28/d79/da3/cd1 0 2024-02-28T16:01:59.443 INFO:tasks.workunit.client.1.smithi087.stdout:6/635: dwrite d4/dc/f1f [4194304,4194304] 0 2024-02-28T16:01:59.446 INFO:tasks.workunit.client.1.smithi087.stdout:6/636: rmdir d4/d30/d13/d38 39 2024-02-28T16:01:59.449 INFO:tasks.workunit.client.1.smithi087.stdout:2/560: rename d2/d7/l3b to d2/d7/d17/d34/d88/ld2 0 2024-02-28T16:01:59.451 INFO:tasks.workunit.client.1.smithi087.stdout:2/561: fdatasync d2/d9a/fc5 0 2024-02-28T16:01:59.452 INFO:tasks.workunit.client.1.smithi087.stdout:3/610: link d11/d33/ca6 d11/d7b/dab/cc6 0 2024-02-28T16:01:59.453 INFO:tasks.workunit.client.1.smithi087.stdout:6/637: mkdir d4/d12/d45/d92/dc1/dcf 0 2024-02-28T16:01:59.454 INFO:tasks.workunit.client.1.smithi087.stdout:3/611: write d11/d3a/d3c/fc5 [556891,2408] 0 2024-02-28T16:01:59.455 INFO:tasks.workunit.client.1.smithi087.stdout:2/562: mkdir d2/d9a/dd3 0 2024-02-28T16:01:59.457 INFO:tasks.workunit.client.1.smithi087.stdout:3/612: stat d11/d44/d5b/f52 0 2024-02-28T16:01:59.461 INFO:tasks.workunit.client.1.smithi087.stdout:5/654: dwrite d3/d9/d9b/dba/d30/d36/f7a [0,4194304] 0 2024-02-28T16:01:59.471 INFO:tasks.workunit.client.1.smithi087.stdout:3/613: mknod d11/d33/d58/cc7 0 2024-02-28T16:01:59.479 INFO:tasks.workunit.client.1.smithi087.stdout:6/638: dwrite d4/dc/d10/f36 [0,4194304] 0 2024-02-28T16:01:59.479 INFO:tasks.workunit.client.1.smithi087.stdout:3/614: getdents d11/d44/d5b 0 2024-02-28T16:01:59.483 INFO:tasks.workunit.client.1.smithi087.stdout:5/655: dread d3/d9/d9b/dba/f2b [0,4194304] 0 2024-02-28T16:01:59.487 INFO:tasks.workunit.client.1.smithi087.stdout:5/656: chown d3/d9/l2c 20770366 1 2024-02-28T16:01:59.489 INFO:tasks.workunit.client.1.smithi087.stdout:6/639: symlink d4/ld0 0 2024-02-28T16:01:59.495 INFO:tasks.workunit.client.1.smithi087.stdout:5/657: creat d3/d9/d9b/dba/d30/d36/d4f/d82/ff4 x:0 0 0 2024-02-28T16:01:59.503 INFO:tasks.workunit.client.1.smithi087.stdout:2/563: dread d2/d99/fb3 [0,4194304] 0 2024-02-28T16:01:59.505 INFO:tasks.workunit.client.1.smithi087.stdout:5/658: truncate d3/d9/f68 1866648 0 2024-02-28T16:01:59.506 INFO:tasks.workunit.client.1.smithi087.stdout:2/564: creat d2/d7/dc0/fd4 x:0 0 0 2024-02-28T16:01:59.509 INFO:tasks.workunit.client.1.smithi087.stdout:5/659: creat d3/d9/d9b/dba/d30/d53/ff5 x:0 0 0 2024-02-28T16:01:59.511 INFO:tasks.workunit.client.1.smithi087.stdout:2/565: creat d2/d9a/dd3/fd5 x:0 0 0 2024-02-28T16:01:59.511 INFO:tasks.workunit.client.1.smithi087.stdout:5/660: mkdir d3/d9/df6 0 2024-02-28T16:01:59.514 INFO:tasks.workunit.client.1.smithi087.stdout:5/661: read d3/d9/d9b/dba/f9d [233862,68142] 0 2024-02-28T16:01:59.515 INFO:tasks.workunit.client.1.smithi087.stdout:2/566: getdents d2/d7/d17/d3d/d81 0 2024-02-28T16:01:59.517 INFO:tasks.workunit.client.1.smithi087.stdout:2/567: readlink d2/d7/d17/d3d/l70 0 2024-02-28T16:01:59.519 INFO:tasks.workunit.client.1.smithi087.stdout:3/615: dread d11/d61/f63 [0,4194304] 0 2024-02-28T16:01:59.521 INFO:tasks.workunit.client.1.smithi087.stdout:2/568: creat d2/fd6 x:0 0 0 2024-02-28T16:01:59.522 INFO:tasks.workunit.client.1.smithi087.stdout:2/569: dread - d2/d7/d17/d34/f98 zero size 2024-02-28T16:01:59.524 INFO:tasks.workunit.client.1.smithi087.stdout:5/662: rename d3/d9/d9b/dba/d30/d36/d4f/cef to d3/d9/df6/cf7 0 2024-02-28T16:01:59.524 INFO:tasks.workunit.client.1.smithi087.stdout:3/616: symlink d11/d33/d74/lc8 0 2024-02-28T16:01:59.526 INFO:tasks.workunit.client.1.smithi087.stdout:5/663: truncate d3/d64/d67/fd2 14076 0 2024-02-28T16:01:59.526 INFO:tasks.workunit.client.1.smithi087.stdout:3/617: rmdir d11/d61/d7c 39 2024-02-28T16:01:59.530 INFO:tasks.workunit.client.1.smithi087.stdout:5/664: mknod d3/d9/d9b/cf8 0 2024-02-28T16:01:59.531 INFO:tasks.workunit.client.1.smithi087.stdout:6/640: dread d4/dc/d10/f2b [0,4194304] 0 2024-02-28T16:01:59.535 INFO:tasks.workunit.client.1.smithi087.stdout:5/665: creat d3/d9/d9b/dba/ff9 x:0 0 0 2024-02-28T16:01:59.540 INFO:tasks.workunit.client.1.smithi087.stdout:5/666: creat d3/d9/d9b/dba/d30/d53/d5b/ffa x:0 0 0 2024-02-28T16:01:59.541 INFO:tasks.workunit.client.1.smithi087.stdout:3/618: truncate d11/d44/f5e 2715510 0 2024-02-28T16:01:59.542 INFO:tasks.workunit.client.1.smithi087.stdout:2/570: dread d2/d99/d28/f43 [0,4194304] 0 2024-02-28T16:01:59.543 INFO:tasks.workunit.client.1.smithi087.stdout:5/667: write d3/fb2 [663722,77678] 0 2024-02-28T16:01:59.543 INFO:tasks.workunit.client.1.smithi087.stdout:3/619: chown d11/d33/f9e 11 1 2024-02-28T16:01:59.545 INFO:tasks.workunit.client.1.smithi087.stdout:2/571: dread - d2/d7/f7f zero size 2024-02-28T16:01:59.581 INFO:tasks.workunit.client.1.smithi087.stdout:1/567: sync 2024-02-28T16:01:59.581 INFO:tasks.workunit.client.1.smithi087.stdout:8/581: sync 2024-02-28T16:01:59.611 INFO:tasks.workunit.client.1.smithi087.stdout:5/668: fsync d3/d9/d9b/dba/d30/d36/d4f/d82/fe4 0 2024-02-28T16:01:59.611 INFO:tasks.workunit.client.1.smithi087.stdout:2/572: stat d2/d7/d17/d3d/d60/f67 0 2024-02-28T16:01:59.612 INFO:tasks.workunit.client.1.smithi087.stdout:3/620: truncate d11/d45/d73/f99 1864378 0 2024-02-28T16:01:59.612 INFO:tasks.workunit.client.1.smithi087.stdout:1/568: write d0/ff [20657,64897] 0 2024-02-28T16:01:59.612 INFO:tasks.workunit.client.1.smithi087.stdout:8/582: readlink d2/d18/d42/d62/l93 0 2024-02-28T16:01:59.617 INFO:tasks.workunit.client.1.smithi087.stdout:3/621: symlink d11/d45/d88/lc9 0 2024-02-28T16:01:59.619 INFO:tasks.workunit.client.1.smithi087.stdout:5/669: write d3/d9/d9b/dba/d30/d36/d4f/d82/fea [45372,83491] 0 2024-02-28T16:01:59.622 INFO:tasks.workunit.client.1.smithi087.stdout:2/573: mkdir d2/d99/d28/d54/da6/dd7 0 2024-02-28T16:01:59.622 INFO:tasks.workunit.client.1.smithi087.stdout:5/670: write d3/d9/d9b/dba/d30/d36/f48 [897298,15480] 0 2024-02-28T16:01:59.623 INFO:tasks.workunit.client.1.smithi087.stdout:3/622: mkdir d11/d33/d58/d8c/dca 0 2024-02-28T16:01:59.627 INFO:tasks.workunit.client.1.smithi087.stdout:5/671: read - d3/d64/d67/d7c/fbc zero size 2024-02-28T16:01:59.627 INFO:tasks.workunit.client.1.smithi087.stdout:3/623: write d11/d44/d5b/f78 [218167,127238] 0 2024-02-28T16:01:59.630 INFO:tasks.workunit.client.1.smithi087.stdout:8/583: truncate d2/d9/d1a/f5b 2056534 0 2024-02-28T16:01:59.632 INFO:tasks.workunit.client.1.smithi087.stdout:5/672: write d3/d64/d81/f4b [2856076,107991] 0 2024-02-28T16:01:59.635 INFO:tasks.workunit.client.1.smithi087.stdout:8/584: mknod d2/d9/d5e/dbc/cc1 0 2024-02-28T16:01:59.636 INFO:tasks.workunit.client.1.smithi087.stdout:1/569: dwrite d0/d1a/f3a [0,4194304] 0 2024-02-28T16:01:59.641 INFO:tasks.workunit.client.1.smithi087.stdout:1/570: mknod d0/d14/d48/cbe 0 2024-02-28T16:01:59.641 INFO:tasks.workunit.client.1.smithi087.stdout:5/673: fsync d3/d64/d67/f76 0 2024-02-28T16:01:59.645 INFO:tasks.workunit.client.1.smithi087.stdout:5/674: chown d3/d9/d9b/dba/l6f 12064 1 2024-02-28T16:01:59.648 INFO:tasks.workunit.client.1.smithi087.stdout:8/585: getdents d2/d18 0 2024-02-28T16:01:59.649 INFO:tasks.workunit.client.1.smithi087.stdout:1/571: truncate d0/d14/f18 124828 0 2024-02-28T16:01:59.650 INFO:tasks.workunit.client.1.smithi087.stdout:2/574: dwrite d2/f85 [0,4194304] 0 2024-02-28T16:01:59.650 INFO:tasks.workunit.client.1.smithi087.stdout:5/675: symlink d3/d9/d9b/dba/d69/d87/lfb 0 2024-02-28T16:01:59.651 INFO:tasks.workunit.client.1.smithi087.stdout:8/586: fsync d2/f6 0 2024-02-28T16:01:59.655 INFO:tasks.workunit.client.1.smithi087.stdout:8/587: dread - d2/d9/d10/d24/d53/d6f/f74 zero size 2024-02-28T16:01:59.668 INFO:tasks.workunit.client.1.smithi087.stdout:1/572: rename d0/d1b/d1f/d71/db2/d24/c2a to d0/d1b/cbf 0 2024-02-28T16:01:59.671 INFO:tasks.workunit.client.1.smithi087.stdout:1/573: chown d0/d1b/d1f/f41 357467 1 2024-02-28T16:01:59.672 INFO:tasks.workunit.client.1.smithi087.stdout:3/624: dread d11/f2a [0,4194304] 0 2024-02-28T16:01:59.675 INFO:tasks.workunit.client.1.smithi087.stdout:2/575: write d2/d7/d17/f33 [4236465,115304] 0 2024-02-28T16:01:59.679 INFO:tasks.workunit.client.1.smithi087.stdout:3/625: mknod d11/d33/d67/d98/ccb 0 2024-02-28T16:01:59.683 INFO:tasks.workunit.client.1.smithi087.stdout:3/626: symlink d11/d61/d65/lcc 0 2024-02-28T16:01:59.684 INFO:tasks.workunit.client.1.smithi087.stdout:2/576: mknod d2/d7/d17/d97/cd8 0 2024-02-28T16:01:59.685 INFO:tasks.workunit.client.1.smithi087.stdout:5/676: dwrite d3/d64/d67/fa6 [0,4194304] 0 2024-02-28T16:01:59.686 INFO:tasks.workunit.client.1.smithi087.stdout:2/577: chown d2/d42/f76 63 1 2024-02-28T16:01:59.689 INFO:tasks.workunit.client.1.smithi087.stdout:3/627: chown d11/d7b/dab/cc6 0 1 2024-02-28T16:01:59.689 INFO:tasks.workunit.client.1.smithi087.stdout:2/578: readlink d2/d99/d28/d79/laa 0 2024-02-28T16:01:59.689 INFO:tasks.workunit.client.1.smithi087.stdout:3/628: write d11/d45/d73/f99 [2875512,37061] 0 2024-02-28T16:01:59.691 INFO:tasks.workunit.client.1.smithi087.stdout:2/579: readlink d2/d99/d28/l41 0 2024-02-28T16:01:59.693 INFO:tasks.workunit.client.1.smithi087.stdout:3/629: fsync d11/d44/f57 0 2024-02-28T16:01:59.698 INFO:tasks.workunit.client.1.smithi087.stdout:3/630: read d11/d44/d5b/f52 [3453869,20019] 0 2024-02-28T16:01:59.699 INFO:tasks.workunit.client.1.smithi087.stdout:5/677: write d3/d9/d9b/dba/f2b [19491,16619] 0 2024-02-28T16:01:59.704 INFO:tasks.workunit.client.1.smithi087.stdout:2/580: creat d2/d99/dc7/fd9 x:0 0 0 2024-02-28T16:01:59.704 INFO:tasks.workunit.client.1.smithi087.stdout:1/574: dwrite d0/d1b/d1f/d71/f81 [0,4194304] 0 2024-02-28T16:01:59.704 INFO:tasks.workunit.client.1.smithi087.stdout:5/678: stat d3/d9/d4a/d5e/fc9 0 2024-02-28T16:01:59.707 INFO:tasks.workunit.client.1.smithi087.stdout:2/581: fsync d2/fc 0 2024-02-28T16:01:59.710 INFO:tasks.workunit.client.1.smithi087.stdout:1/575: write d0/d1b/d43/f4b [3902450,6583] 0 2024-02-28T16:01:59.718 INFO:tasks.workunit.client.1.smithi087.stdout:8/588: dread d2/d18/d42/f84 [0,4194304] 0 2024-02-28T16:01:59.720 INFO:tasks.workunit.client.1.smithi087.stdout:3/631: dread d11/f2a [0,4194304] 0 2024-02-28T16:01:59.723 INFO:tasks.workunit.client.1.smithi087.stdout:5/679: dread d3/fb2 [0,4194304] 0 2024-02-28T16:01:59.723 INFO:tasks.workunit.client.1.smithi087.stdout:3/632: truncate d11/d7b/f97 706418 0 2024-02-28T16:01:59.727 INFO:tasks.workunit.client.1.smithi087.stdout:3/633: symlink d11/d45/d88/d91/lcd 0 2024-02-28T16:01:59.729 INFO:tasks.workunit.client.1.smithi087.stdout:5/680: unlink d3/d9/d9b/dba/d30/d36/l73 0 2024-02-28T16:01:59.731 INFO:tasks.workunit.client.1.smithi087.stdout:2/582: dwrite d2/d7/f7f [0,4194304] 0 2024-02-28T16:01:59.743 INFO:tasks.workunit.client.1.smithi087.stdout:5/681: truncate d3/d9/d4a/d5e/da1/fc3 4054390 0 2024-02-28T16:01:59.744 INFO:tasks.workunit.client.1.smithi087.stdout:5/682: readlink d3/d9/d9b/dba/ld9 0 2024-02-28T16:01:59.748 INFO:tasks.workunit.client.1.smithi087.stdout:5/683: mknod d3/d9/d9b/dba/d69/d87/df3/cfc 0 2024-02-28T16:01:59.748 INFO:tasks.workunit.client.1.smithi087.stdout:2/583: dwrite d2/f87 [0,4194304] 0 2024-02-28T16:01:59.750 INFO:tasks.workunit.client.1.smithi087.stdout:2/584: chown d2/f21 30434303 1 2024-02-28T16:01:59.750 INFO:tasks.workunit.client.1.smithi087.stdout:5/684: mknod d3/d64/d67/cfd 0 2024-02-28T16:01:59.751 INFO:tasks.workunit.client.1.smithi087.stdout:5/685: dread - d3/d64/d81/fcf zero size 2024-02-28T16:01:59.756 INFO:tasks.workunit.client.1.smithi087.stdout:4/643: sync 2024-02-28T16:01:59.758 INFO:tasks.workunit.client.1.smithi087.stdout:8/589: dread d2/d9/f16 [0,4194304] 0 2024-02-28T16:01:59.762 INFO:tasks.workunit.client.1.smithi087.stdout:4/644: creat d2/df/d62/fdb x:0 0 0 2024-02-28T16:01:59.763 INFO:tasks.workunit.client.1.smithi087.stdout:5/686: getdents d3/d9/d9b/dba/d30 0 2024-02-28T16:01:59.765 INFO:tasks.workunit.client.1.smithi087.stdout:8/590: truncate d2/f27 1607865 0 2024-02-28T16:01:59.768 INFO:tasks.workunit.client.1.smithi087.stdout:5/687: truncate d3/f59 3155366 0 2024-02-28T16:01:59.768 INFO:tasks.workunit.client.1.smithi087.stdout:3/634: dread d11/d44/d5b/f5f [4194304,4194304] 0 2024-02-28T16:01:59.771 INFO:tasks.workunit.client.1.smithi087.stdout:3/635: readlink d11/d61/d65/l68 0 2024-02-28T16:01:59.773 INFO:tasks.workunit.client.1.smithi087.stdout:5/688: creat d3/d9/d9b/dba/d69/ffe x:0 0 0 2024-02-28T16:01:59.777 INFO:tasks.workunit.client.1.smithi087.stdout:3/636: unlink d11/d45/d88/d91/cb9 0 2024-02-28T16:01:59.781 INFO:tasks.workunit.client.1.smithi087.stdout:5/689: symlink d3/d9/d9b/dba/d30/d8f/dac/lff 0 2024-02-28T16:01:59.782 INFO:tasks.workunit.client.1.smithi087.stdout:4/645: dwrite d2/d9/f48 [0,4194304] 0 2024-02-28T16:01:59.783 INFO:tasks.workunit.client.1.smithi087.stdout:3/637: symlink d11/d61/d65/lce 0 2024-02-28T16:01:59.785 INFO:tasks.workunit.client.1.smithi087.stdout:5/690: chown d3/d64/c77 68991779 1 2024-02-28T16:01:59.789 INFO:tasks.workunit.client.1.smithi087.stdout:8/591: dwrite d2/d18/d42/d7b/f95 [0,4194304] 0 2024-02-28T16:01:59.793 INFO:tasks.workunit.client.1.smithi087.stdout:8/592: readlink d2/l7 0 2024-02-28T16:01:59.799 INFO:tasks.workunit.client.1.smithi087.stdout:3/638: dread d11/d44/f87 [4194304,4194304] 0 2024-02-28T16:01:59.799 INFO:tasks.workunit.client.1.smithi087.stdout:4/646: link d2/d9/f4d d2/df/d65/fdc 0 2024-02-28T16:01:59.805 INFO:tasks.workunit.client.1.smithi087.stdout:5/691: creat d3/f100 x:0 0 0 2024-02-28T16:01:59.806 INFO:tasks.workunit.client.1.smithi087.stdout:5/692: readlink d3/d9/le5 0 2024-02-28T16:01:59.809 INFO:tasks.workunit.client.1.smithi087.stdout:5/693: dread - d3/d9/d9b/dba/d69/ffe zero size 2024-02-28T16:01:59.813 INFO:tasks.workunit.client.1.smithi087.stdout:8/593: dwrite d2/d9/d1a/d67/f94 [0,4194304] 0 2024-02-28T16:01:59.818 INFO:tasks.workunit.client.1.smithi087.stdout:5/694: read d3/d9/d9b/dba/d30/d53/d5b/f6c [986462,50418] 0 2024-02-28T16:01:59.819 INFO:tasks.workunit.client.1.smithi087.stdout:8/594: symlink d2/d9/db4/lc2 0 2024-02-28T16:01:59.821 INFO:tasks.workunit.client.1.smithi087.stdout:4/647: dwrite d2/d9/da/f2d [0,4194304] 0 2024-02-28T16:01:59.829 INFO:tasks.workunit.client.1.smithi087.stdout:8/595: write d2/d18/f61 [97150,128687] 0 2024-02-28T16:01:59.831 INFO:tasks.workunit.client.1.smithi087.stdout:3/639: dwrite d11/d33/d67/d9c/da1/fae [0,4194304] 0 2024-02-28T16:01:59.832 INFO:tasks.workunit.client.1.smithi087.stdout:4/648: truncate d2/d9/d10/d22/d5b/fd2 635373 0 2024-02-28T16:01:59.835 INFO:tasks.workunit.client.1.smithi087.stdout:4/649: mknod d2/d9/d10/d22/cdd 0 2024-02-28T16:01:59.836 INFO:tasks.workunit.client.1.smithi087.stdout:3/640: fsync d11/d33/d67/d98/fa7 0 2024-02-28T16:01:59.839 INFO:tasks.workunit.client.1.smithi087.stdout:8/596: dread d2/d9/d10/d24/d53/d6f/f7a [0,4194304] 0 2024-02-28T16:01:59.840 INFO:tasks.workunit.client.1.smithi087.stdout:4/650: mknod d2/d9/da/d1a/cde 0 2024-02-28T16:01:59.844 INFO:tasks.workunit.client.1.smithi087.stdout:4/651: fsync d2/d9/d10/d11/fb9 0 2024-02-28T16:01:59.844 INFO:tasks.workunit.client.1.smithi087.stdout:3/641: dread d11/d44/d5b/f78 [0,4194304] 0 2024-02-28T16:01:59.845 INFO:tasks.workunit.client.1.smithi087.stdout:3/642: dread - d11/fbd zero size 2024-02-28T16:01:59.845 INFO:tasks.workunit.client.1.smithi087.stdout:4/652: chown d2/df/d65/d8d 21393385 1 2024-02-28T16:01:59.846 INFO:tasks.workunit.client.1.smithi087.stdout:8/597: dread d2/d33/f71 [0,4194304] 0 2024-02-28T16:01:59.848 INFO:tasks.workunit.client.1.smithi087.stdout:8/598: dread - d2/d18/f79 zero size 2024-02-28T16:01:59.849 INFO:tasks.workunit.client.1.smithi087.stdout:5/695: write d3/d9/d9b/dba/d30/d36/d4f/f91 [566400,7480] 0 2024-02-28T16:01:59.854 INFO:tasks.workunit.client.1.smithi087.stdout:3/643: mknod d11/d61/d7c/db7/ccf 0 2024-02-28T16:01:59.857 INFO:tasks.workunit.client.1.smithi087.stdout:5/696: rename d3/d9/d9b/f9c to d3/d64/d67/d7c/dc5/f101 0 2024-02-28T16:01:59.861 INFO:tasks.workunit.client.1.smithi087.stdout:3/644: rename d11/c38 to d11/d61/d65/da9/cd0 0 2024-02-28T16:01:59.863 INFO:tasks.workunit.client.1.smithi087.stdout:5/697: read - d3/d9/d9b/dba/d30/d36/d4f/d82/fcc zero size 2024-02-28T16:01:59.865 INFO:tasks.workunit.client.1.smithi087.stdout:5/698: stat d3/d64/d67/d7c/fbb 0 2024-02-28T16:01:59.867 INFO:tasks.workunit.client.1.smithi087.stdout:8/599: dwrite d2/d18/d25/f6c [0,4194304] 0 2024-02-28T16:01:59.874 INFO:tasks.workunit.client.1.smithi087.stdout:8/600: unlink d2/d9/d1a/f45 0 2024-02-28T16:01:59.881 INFO:tasks.workunit.client.1.smithi087.stdout:8/601: creat d2/d63/d9b/fc3 x:0 0 0 2024-02-28T16:01:59.884 INFO:tasks.workunit.client.1.smithi087.stdout:5/699: dwrite d3/d64/fb7 [0,4194304] 0 2024-02-28T16:01:59.885 INFO:tasks.workunit.client.1.smithi087.stdout:3/645: dwrite d11/d33/d58/fa4 [0,4194304] 0 2024-02-28T16:01:59.887 INFO:tasks.workunit.client.1.smithi087.stdout:8/602: creat d2/d9/d5e/d9c/d9f/fc4 x:0 0 0 2024-02-28T16:01:59.890 INFO:tasks.workunit.client.1.smithi087.stdout:3/646: unlink d11/d61/d65/f70 0 2024-02-28T16:01:59.892 INFO:tasks.workunit.client.1.smithi087.stdout:5/700: mkdir d3/d102 0 2024-02-28T16:01:59.892 INFO:tasks.workunit.client.1.smithi087.stdout:4/653: dread d2/df/d2e/f9a [0,4194304] 0 2024-02-28T16:01:59.893 INFO:tasks.workunit.client.1.smithi087.stdout:8/603: unlink d2/da2/f92 0 2024-02-28T16:01:59.895 INFO:tasks.workunit.client.1.smithi087.stdout:3/647: write d11/d44/f87 [2996107,25640] 0 2024-02-28T16:01:59.898 INFO:tasks.workunit.client.1.smithi087.stdout:4/654: creat d2/d9/d10/d11/fdf x:0 0 0 2024-02-28T16:01:59.898 INFO:tasks.workunit.client.1.smithi087.stdout:3/648: dread - d11/d33/d67/d9c/fb2 zero size 2024-02-28T16:01:59.898 INFO:tasks.workunit.client.1.smithi087.stdout:5/701: rmdir d3/d9/d9b/dba/d30/d53/d5b 39 2024-02-28T16:01:59.901 INFO:tasks.workunit.client.1.smithi087.stdout:8/604: creat d2/d18/d42/d62/fc5 x:0 0 0 2024-02-28T16:01:59.903 INFO:tasks.workunit.client.1.smithi087.stdout:3/649: mkdir d11/d3a/dd1 0 2024-02-28T16:01:59.906 INFO:tasks.workunit.client.1.smithi087.stdout:6/641: sync 2024-02-28T16:01:59.906 INFO:tasks.workunit.client.1.smithi087.stdout:7/567: sync 2024-02-28T16:01:59.906 INFO:tasks.workunit.client.1.smithi087.stdout:0/571: sync 2024-02-28T16:01:59.907 INFO:tasks.workunit.client.1.smithi087.stdout:5/702: unlink d3/d9/d4a/d5e/fc9 0 2024-02-28T16:01:59.911 INFO:tasks.workunit.client.1.smithi087.stdout:9/559: sync 2024-02-28T16:01:59.911 INFO:tasks.workunit.client.1.smithi087.stdout:0/572: creat d4/dd/d21/d5f/fb7 x:0 0 0 2024-02-28T16:01:59.912 INFO:tasks.workunit.client.1.smithi087.stdout:6/642: readlink d4/d12/d45/l48 0 2024-02-28T16:01:59.913 INFO:tasks.workunit.client.1.smithi087.stdout:3/650: creat d11/d33/d58/d8c/dca/fd2 x:0 0 0 2024-02-28T16:01:59.914 INFO:tasks.workunit.client.1.smithi087.stdout:5/703: chown d3/d9/d9b/dba/d30/d53/c7e 1 1 2024-02-28T16:01:59.915 INFO:tasks.workunit.client.1.smithi087.stdout:3/651: stat d11/d7b/f97 0 2024-02-28T16:01:59.918 INFO:tasks.workunit.client.1.smithi087.stdout:5/704: fsync d3/d9/d9b/dba/d30/d53/ff5 0 2024-02-28T16:01:59.921 INFO:tasks.workunit.client.1.smithi087.stdout:9/560: symlink d7/dd/d36/d89/la2 0 2024-02-28T16:01:59.923 INFO:tasks.workunit.client.1.smithi087.stdout:0/573: creat d4/d6/dc/d45/fb8 x:0 0 0 2024-02-28T16:01:59.924 INFO:tasks.workunit.client.1.smithi087.stdout:8/605: dwrite d2/d18/f61 [0,4194304] 0 2024-02-28T16:01:59.925 INFO:tasks.workunit.client.1.smithi087.stdout:0/574: readlink d4/dd/l50 0 2024-02-28T16:01:59.925 INFO:tasks.workunit.client.1.smithi087.stdout:3/652: mkdir d11/d61/d7c/db7/dd3 0 2024-02-28T16:01:59.932 INFO:tasks.workunit.client.1.smithi087.stdout:9/561: write d7/dc/f59 [411433,128559] 0 2024-02-28T16:01:59.932 INFO:tasks.workunit.client.1.smithi087.stdout:7/568: truncate d14/d21/f42 1182673 0 2024-02-28T16:01:59.940 INFO:tasks.workunit.client.1.smithi087.stdout:4/655: dwrite d2/d9/d10/d22/f27 [0,4194304] 0 2024-02-28T16:01:59.940 INFO:tasks.workunit.client.1.smithi087.stdout:0/575: creat d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/db6/fb9 x:0 0 0 2024-02-28T16:01:59.940 INFO:tasks.workunit.client.1.smithi087.stdout:9/562: rmdir d7/d1e 39 2024-02-28T16:01:59.944 INFO:tasks.workunit.client.1.smithi087.stdout:5/705: dwrite d3/d64/d81/fcf [0,4194304] 0 2024-02-28T16:01:59.944 INFO:tasks.workunit.client.1.smithi087.stdout:8/606: dread d2/d18/d42/d7b/f95 [0,4194304] 0 2024-02-28T16:01:59.947 INFO:tasks.workunit.client.1.smithi087.stdout:8/607: chown d2/d9/d10/l50 1 1 2024-02-28T16:01:59.953 INFO:tasks.workunit.client.1.smithi087.stdout:9/563: mkdir d7/dd/d99/da3 0 2024-02-28T16:01:59.964 INFO:tasks.workunit.client.1.smithi087.stdout:3/653: dwrite d11/f30 [0,4194304] 0 2024-02-28T16:01:59.964 INFO:tasks.workunit.client.1.smithi087.stdout:8/608: creat d2/d18/d25/fc6 x:0 0 0 2024-02-28T16:01:59.972 INFO:tasks.workunit.client.1.smithi087.stdout:3/654: rmdir d11/d33/d67/d98/daf 39 2024-02-28T16:01:59.973 INFO:tasks.workunit.client.1.smithi087.stdout:6/643: dwrite d4/d30/d13/d38/f3a [0,4194304] 0 2024-02-28T16:01:59.974 INFO:tasks.workunit.client.1.smithi087.stdout:8/609: creat d2/d9/d5e/dbc/fc7 x:0 0 0 2024-02-28T16:01:59.974 INFO:tasks.workunit.client.1.smithi087.stdout:3/655: rmdir d11/d33/d67/d9c 39 2024-02-28T16:01:59.979 INFO:tasks.workunit.client.1.smithi087.stdout:3/656: creat d11/fd4 x:0 0 0 2024-02-28T16:01:59.980 INFO:tasks.workunit.client.1.smithi087.stdout:8/610: symlink d2/d9/d10/d24/d53/d6f/lc8 0 2024-02-28T16:01:59.982 INFO:tasks.workunit.client.1.smithi087.stdout:8/611: readlink d2/d9/l39 0 2024-02-28T16:01:59.987 INFO:tasks.workunit.client.1.smithi087.stdout:3/657: creat d11/d33/d67/d98/daf/fd5 x:0 0 0 2024-02-28T16:01:59.991 INFO:tasks.workunit.client.1.smithi087.stdout:3/658: mkdir d11/d61/d65/dd6 0 2024-02-28T16:01:59.992 INFO:tasks.workunit.client.1.smithi087.stdout:8/612: dread d2/d9/d10/d24/d53/d6f/f7a [0,4194304] 0 2024-02-28T16:01:59.999 INFO:tasks.workunit.client.1.smithi087.stdout:0/576: write d4/dd/d37/d39/d3a/d57/d74/f1d [3035799,58359] 0 2024-02-28T16:02:00.004 INFO:tasks.workunit.client.1.smithi087.stdout:3/659: symlink d11/d7b/ld7 0 2024-02-28T16:02:00.019 INFO:tasks.workunit.client.1.smithi087.stdout:6/644: dwrite d4/d30/d13/d67/f87 [0,4194304] 0 2024-02-28T16:02:00.020 INFO:tasks.workunit.client.1.smithi087.stdout:3/660: rename d11/f1b to d11/d61/d65/fd8 0 2024-02-28T16:02:00.020 INFO:tasks.workunit.client.1.smithi087.stdout:5/706: dwrite d3/d9/d9b/dba/d30/d36/d4f/fe1 [0,4194304] 0 2024-02-28T16:02:00.022 INFO:tasks.workunit.client.1.smithi087.stdout:7/569: dwrite d14/d21/f47 [0,4194304] 0 2024-02-28T16:02:00.023 INFO:tasks.workunit.client.1.smithi087.stdout:4/656: dwrite d2/d9/d10/d22/f6a [4194304,4194304] 0 2024-02-28T16:02:00.024 INFO:tasks.workunit.client.1.smithi087.stdout:6/645: fdatasync d4/d12/d45/d74/d9a/fb2 0 2024-02-28T16:02:00.029 INFO:tasks.workunit.client.1.smithi087.stdout:3/661: truncate d11/d7b/f97 1384924 0 2024-02-28T16:02:00.034 INFO:tasks.workunit.client.1.smithi087.stdout:7/570: rmdir d14/d2e 39 2024-02-28T16:02:00.034 INFO:tasks.workunit.client.1.smithi087.stdout:8/613: dwrite d2/d9/f5c [0,4194304] 0 2024-02-28T16:02:00.035 INFO:tasks.workunit.client.1.smithi087.stdout:5/707: creat d3/d64/d67/f103 x:0 0 0 2024-02-28T16:02:00.037 INFO:tasks.workunit.client.1.smithi087.stdout:6/646: rename d4/d30/d13/f58 to d4/d30/d13/d38/dc3/fd1 0 2024-02-28T16:02:00.040 INFO:tasks.workunit.client.1.smithi087.stdout:3/662: truncate d11/f13 368197 0 2024-02-28T16:02:00.042 INFO:tasks.workunit.client.1.smithi087.stdout:7/571: rmdir d14/d7d 39 2024-02-28T16:02:00.048 INFO:tasks.workunit.client.1.smithi087.stdout:0/577: truncate d4/dd/d37/d39/d3a/d57/d74/f44 954098 0 2024-02-28T16:02:00.050 INFO:tasks.workunit.client.1.smithi087.stdout:5/708: symlink d3/d9/d9b/dba/d30/d8f/l104 0 2024-02-28T16:02:00.054 INFO:tasks.workunit.client.1.smithi087.stdout:7/572: rmdir d14/d21 39 2024-02-28T16:02:00.055 INFO:tasks.workunit.client.1.smithi087.stdout:3/663: fsync d11/d33/d67/d9c/f9f 0 2024-02-28T16:02:00.056 INFO:tasks.workunit.client.1.smithi087.stdout:8/614: fsync d2/d9/d1a/f5b 0 2024-02-28T16:02:00.058 INFO:tasks.workunit.client.1.smithi087.stdout:4/657: link d2/df/d65/caa d2/d9/d10/d22/d5b/d5c/d68/ce0 0 2024-02-28T16:02:00.058 INFO:tasks.workunit.client.1.smithi087.stdout:8/615: stat d2/d9/c68 0 2024-02-28T16:02:00.060 INFO:tasks.workunit.client.1.smithi087.stdout:5/709: stat d3/f61 0 2024-02-28T16:02:00.062 INFO:tasks.workunit.client.1.smithi087.stdout:4/658: chown d2/d9/da/d1a/d26/c31 167077 1 2024-02-28T16:02:00.067 INFO:tasks.workunit.client.1.smithi087.stdout:6/647: getdents d4/dc 0 2024-02-28T16:02:00.069 INFO:tasks.workunit.client.1.smithi087.stdout:7/573: stat d14/d2e/d2b/d4e/l9e 0 2024-02-28T16:02:00.071 INFO:tasks.workunit.client.1.smithi087.stdout:6/648: fsync d4/dc/d7e/f9c 0 2024-02-28T16:02:00.072 INFO:tasks.workunit.client.1.smithi087.stdout:8/616: symlink d2/d9/d10/d24/d9d/lc9 0 2024-02-28T16:02:00.074 INFO:tasks.workunit.client.1.smithi087.stdout:3/664: rename d11/d33/d67/d98/fbb to d11/d61/fd9 0 2024-02-28T16:02:00.076 INFO:tasks.workunit.client.1.smithi087.stdout:5/710: creat d3/d9/d9b/dba/d69/f105 x:0 0 0 2024-02-28T16:02:00.079 INFO:tasks.workunit.client.1.smithi087.stdout:8/617: chown d2/d33/f3e 259366117 1 2024-02-28T16:02:00.079 INFO:tasks.workunit.client.1.smithi087.stdout:3/665: truncate d11/f2f 4949563 0 2024-02-28T16:02:00.080 INFO:tasks.workunit.client.1.smithi087.stdout:5/711: stat d3/d9/d4a/fd5 0 2024-02-28T16:02:00.081 INFO:tasks.workunit.client.1.smithi087.stdout:0/578: dwrite d4/f48 [0,4194304] 0 2024-02-28T16:02:00.082 INFO:tasks.workunit.client.1.smithi087.stdout:6/649: write d4/d30/d13/d38/d69/d99/fc4 [855346,84444] 0 2024-02-28T16:02:00.085 INFO:tasks.workunit.client.1.smithi087.stdout:1/576: sync 2024-02-28T16:02:00.087 INFO:tasks.workunit.client.1.smithi087.stdout:3/666: creat d11/d3a/fda x:0 0 0 2024-02-28T16:02:00.091 INFO:tasks.workunit.client.1.smithi087.stdout:7/574: getdents d14 0 2024-02-28T16:02:00.092 INFO:tasks.workunit.client.1.smithi087.stdout:4/659: dread d2/df/d2e/f9a [0,4194304] 0 2024-02-28T16:02:00.092 INFO:tasks.workunit.client.1.smithi087.stdout:5/712: creat d3/d64/d67/d7c/f106 x:0 0 0 2024-02-28T16:02:00.092 INFO:tasks.workunit.client.1.smithi087.stdout:8/618: unlink d2/d18/d42/l76 0 2024-02-28T16:02:00.094 INFO:tasks.workunit.client.1.smithi087.stdout:5/713: dread - d3/d9/d9b/dba/d30/d44/f85 zero size 2024-02-28T16:02:00.094 INFO:tasks.workunit.client.1.smithi087.stdout:4/660: dread - d2/d9/d10/d22/d5b/d5c/fac zero size 2024-02-28T16:02:00.099 INFO:tasks.workunit.client.1.smithi087.stdout:4/661: write d2/d9/d10/d22/fa1 [6086955,45542] 0 2024-02-28T16:02:00.101 INFO:tasks.workunit.client.1.smithi087.stdout:1/577: chown d0/c5f 7 1 2024-02-28T16:02:00.103 INFO:tasks.workunit.client.1.smithi087.stdout:3/667: creat d11/d3a/dd1/fdb x:0 0 0 2024-02-28T16:02:00.104 INFO:tasks.workunit.client.1.smithi087.stdout:0/579: rename d4/dd/f9e to d4/dd/fba 0 2024-02-28T16:02:00.105 INFO:tasks.workunit.client.1.smithi087.stdout:5/714: mknod d3/d9/d9b/dba/d30/d36/d4f/c107 0 2024-02-28T16:02:00.106 INFO:tasks.workunit.client.1.smithi087.stdout:7/575: rename d14/d21/f61 to d14/d2e/fa7 0 2024-02-28T16:02:00.111 INFO:tasks.workunit.client.1.smithi087.stdout:4/662: symlink d2/d9/d10/d22/le1 0 2024-02-28T16:02:00.112 INFO:tasks.workunit.client.1.smithi087.stdout:6/650: dwrite d4/d12/d45/f97 [0,4194304] 0 2024-02-28T16:02:00.113 INFO:tasks.workunit.client.1.smithi087.stdout:3/668: chown d11/d33/d67/l62 143 1 2024-02-28T16:02:00.114 INFO:tasks.workunit.client.1.smithi087.stdout:4/663: readlink d2/d9/da/d1a/l2b 0 2024-02-28T16:02:00.116 INFO:tasks.workunit.client.1.smithi087.stdout:0/580: mknod d4/dd/d21/d5f/cbb 0 2024-02-28T16:02:00.118 INFO:tasks.workunit.client.1.smithi087.stdout:8/619: dwrite d2/d18/d25/fc6 [0,4194304] 0 2024-02-28T16:02:00.120 INFO:tasks.workunit.client.1.smithi087.stdout:7/576: symlink d14/d27/la8 0 2024-02-28T16:02:00.125 INFO:tasks.workunit.client.1.smithi087.stdout:0/581: chown d4/f89 2166 1 2024-02-28T16:02:00.126 INFO:tasks.workunit.client.1.smithi087.stdout:4/664: mknod d2/d9/da/d1a/ce2 0 2024-02-28T16:02:00.126 INFO:tasks.workunit.client.1.smithi087.stdout:6/651: unlink d4/l50 0 2024-02-28T16:02:00.134 INFO:tasks.workunit.client.1.smithi087.stdout:4/665: chown d2/d9/da/d1a/d26/f3a 1610 1 2024-02-28T16:02:00.134 INFO:tasks.workunit.client.1.smithi087.stdout:7/577: rmdir d14 39 2024-02-28T16:02:00.134 INFO:tasks.workunit.client.1.smithi087.stdout:1/578: dwrite d0/d1b/d1f/f4a [0,4194304] 0 2024-02-28T16:02:00.134 INFO:tasks.workunit.client.1.smithi087.stdout:5/715: rename d3/d9/d9b/dba/d30/d44/d54/f8c to d3/d9/d9b/dba/d30/d53/d5b/f108 0 2024-02-28T16:02:00.137 INFO:tasks.workunit.client.1.smithi087.stdout:6/652: symlink d4/dc/d61/d89/ld2 0 2024-02-28T16:02:00.140 INFO:tasks.workunit.client.1.smithi087.stdout:6/653: stat d4/d12/d45/d57 0 2024-02-28T16:02:00.141 INFO:tasks.workunit.client.1.smithi087.stdout:3/669: creat d11/d33/fdc x:0 0 0 2024-02-28T16:02:00.143 INFO:tasks.workunit.client.1.smithi087.stdout:8/620: dwrite d2/f30 [4194304,4194304] 0 2024-02-28T16:02:00.148 INFO:tasks.workunit.client.1.smithi087.stdout:4/666: truncate d2/d9/d10/dbf/db6/fcb 963883 0 2024-02-28T16:02:00.156 INFO:tasks.workunit.client.1.smithi087.stdout:3/670: symlink d11/d45/d73/ldd 0 2024-02-28T16:02:00.159 INFO:tasks.workunit.client.1.smithi087.stdout:2/585: sync 2024-02-28T16:02:00.159 INFO:tasks.workunit.client.1.smithi087.stdout:9/564: sync 2024-02-28T16:02:00.159 INFO:tasks.workunit.client.1.smithi087.stdout:3/671: chown d11/f36 124 1 2024-02-28T16:02:00.161 INFO:tasks.workunit.client.1.smithi087.stdout:3/672: readlink d11/d61/d65/l68 0 2024-02-28T16:02:00.166 INFO:tasks.workunit.client.1.smithi087.stdout:1/579: dread d0/d1b/d1f/d71/db2/d24/d78/f91 [0,4194304] 0 2024-02-28T16:02:00.167 INFO:tasks.workunit.client.1.smithi087.stdout:5/716: write d3/d9/f68 [22322,76944] 0 2024-02-28T16:02:00.174 INFO:tasks.workunit.client.1.smithi087.stdout:7/578: truncate d14/d21/f45 2673857 0 2024-02-28T16:02:00.175 INFO:tasks.workunit.client.1.smithi087.stdout:4/667: dwrite d2/f8f [0,4194304] 0 2024-02-28T16:02:00.175 INFO:tasks.workunit.client.1.smithi087.stdout:5/717: write d3/d9/d9b/dba/d30/d36/d4f/d82/ff4 [952326,14655] 0 2024-02-28T16:02:00.179 INFO:tasks.workunit.client.1.smithi087.stdout:5/718: chown d3/f21 1805 1 2024-02-28T16:02:00.181 INFO:tasks.workunit.client.1.smithi087.stdout:0/582: dwrite d4/dd/d37/d39/d3a/d57/d74/f44 [0,4194304] 0 2024-02-28T16:02:00.185 INFO:tasks.workunit.client.1.smithi087.stdout:6/654: rename d4/dc/d7e/fc9 to d4/d30/d13/fd3 0 2024-02-28T16:02:00.190 INFO:tasks.workunit.client.1.smithi087.stdout:2/586: rmdir d2/d7/d17 39 2024-02-28T16:02:00.191 INFO:tasks.workunit.client.1.smithi087.stdout:9/565: write d7/d1e/d60/f63 [460014,73803] 0 2024-02-28T16:02:00.194 INFO:tasks.workunit.client.1.smithi087.stdout:1/580: mknod d0/d1b/d1f/d71/db2/cc0 0 2024-02-28T16:02:00.197 INFO:tasks.workunit.client.1.smithi087.stdout:0/583: creat d4/dd/d26/d93/fbc x:0 0 0 2024-02-28T16:02:00.200 INFO:tasks.workunit.client.1.smithi087.stdout:8/621: getdents d2/d9/d1a 0 2024-02-28T16:02:00.201 INFO:tasks.workunit.client.1.smithi087.stdout:8/622: write d2/d9/d10/f3a [3145172,107239] 0 2024-02-28T16:02:00.203 INFO:tasks.workunit.client.1.smithi087.stdout:4/668: rename d2/d9/d10/d22/d73 to d2/d9/da/d1a/d26/d69/de3 0 2024-02-28T16:02:00.206 INFO:tasks.workunit.client.1.smithi087.stdout:3/673: symlink d11/d33/d67/d98/d9b/lde 0 2024-02-28T16:02:00.207 INFO:tasks.workunit.client.1.smithi087.stdout:4/669: fsync d2/d9/d10/d22/d5b/d5c/d68/dc5/fd4 0 2024-02-28T16:02:00.208 INFO:tasks.workunit.client.1.smithi087.stdout:9/566: creat d7/d1e/d60/fa4 x:0 0 0 2024-02-28T16:02:00.212 INFO:tasks.workunit.client.1.smithi087.stdout:4/670: dread d2/d9/d10/f92 [0,4194304] 0 2024-02-28T16:02:00.218 INFO:tasks.workunit.client.1.smithi087.stdout:8/623: rename d2/d9/d10/d24/d53 to d2/d63/d9b/dae/dca 0 2024-02-28T16:02:00.218 INFO:tasks.workunit.client.1.smithi087.stdout:7/579: creat d14/d27/fa9 x:0 0 0 2024-02-28T16:02:00.219 INFO:tasks.workunit.client.1.smithi087.stdout:3/674: creat d11/d3a/d3c/fdf x:0 0 0 2024-02-28T16:02:00.221 INFO:tasks.workunit.client.1.smithi087.stdout:6/655: mknod d4/d7d/cd4 0 2024-02-28T16:02:00.223 INFO:tasks.workunit.client.1.smithi087.stdout:2/587: dwrite d2/d7/d17/d34/f4a [0,4194304] 0 2024-02-28T16:02:00.227 INFO:tasks.workunit.client.1.smithi087.stdout:8/624: fdatasync d2/f64 0 2024-02-28T16:02:00.228 INFO:tasks.workunit.client.1.smithi087.stdout:6/656: chown d4/d12/d45/f53 4409 1 2024-02-28T16:02:00.230 INFO:tasks.workunit.client.1.smithi087.stdout:8/625: fsync d2/d9/d5e/f91 0 2024-02-28T16:02:00.231 INFO:tasks.workunit.client.1.smithi087.stdout:9/567: link d7/dd/d15/d79/d2e/f6a d7/dd/d99/fa5 0 2024-02-28T16:02:00.232 INFO:tasks.workunit.client.1.smithi087.stdout:4/671: dwrite d2/df/f39 [0,4194304] 0 2024-02-28T16:02:00.235 INFO:tasks.workunit.client.1.smithi087.stdout:0/584: link d4/d6/dc/la4 d4/dd/d37/d39/d3a/d57/lbd 0 2024-02-28T16:02:00.235 INFO:tasks.workunit.client.1.smithi087.stdout:7/580: fsync d14/d27/d5d/d6a/d83/d96/f9a 0 2024-02-28T16:02:00.245 INFO:tasks.workunit.client.1.smithi087.stdout:6/657: mknod d4/d12/d45/d92/dc1/cd5 0 2024-02-28T16:02:00.246 INFO:tasks.workunit.client.1.smithi087.stdout:8/626: chown d2/d33/l66 9797 1 2024-02-28T16:02:00.246 INFO:tasks.workunit.client.1.smithi087.stdout:5/719: write d3/d9/d9b/dba/d30/d36/f4e [5235715,72283] 0 2024-02-28T16:02:00.246 INFO:tasks.workunit.client.1.smithi087.stdout:3/675: truncate d11/f17 2306693 0 2024-02-28T16:02:00.247 INFO:tasks.workunit.client.1.smithi087.stdout:9/568: fsync d7/dd/d15/f22 0 2024-02-28T16:02:00.251 INFO:tasks.workunit.client.1.smithi087.stdout:9/569: chown d7/dc/f18 1377587 1 2024-02-28T16:02:00.252 INFO:tasks.workunit.client.1.smithi087.stdout:0/585: creat d4/dd/d21/d9b/fbe x:0 0 0 2024-02-28T16:02:00.256 INFO:tasks.workunit.client.1.smithi087.stdout:0/586: chown d4/d6/dc/c10 124886 1 2024-02-28T16:02:00.258 INFO:tasks.workunit.client.1.smithi087.stdout:3/676: mknod d11/d44/d5b/ce0 0 2024-02-28T16:02:00.259 INFO:tasks.workunit.client.1.smithi087.stdout:4/672: dwrite d2/df/d2e/f43 [4194304,4194304] 0 2024-02-28T16:02:00.260 INFO:tasks.workunit.client.1.smithi087.stdout:6/658: mknod d4/dc/d7e/cd6 0 2024-02-28T16:02:00.263 INFO:tasks.workunit.client.1.smithi087.stdout:1/581: rename d0/d1a/c99 to d0/d1b/d1f/d71/db2/cc1 0 2024-02-28T16:02:00.266 INFO:tasks.workunit.client.1.smithi087.stdout:1/582: chown d0/d1b/fbd 233 1 2024-02-28T16:02:00.266 INFO:tasks.workunit.client.1.smithi087.stdout:0/587: symlink d4/d6/dc/d45/lbf 0 2024-02-28T16:02:00.267 INFO:tasks.workunit.client.0.smithi057.stdout:1/284: sync 2024-02-28T16:02:00.267 INFO:tasks.workunit.client.0.smithi057.stdout:9/293: sync 2024-02-28T16:02:00.267 INFO:tasks.workunit.client.0.smithi057.stdout:2/206: sync 2024-02-28T16:02:00.267 INFO:tasks.workunit.client.0.smithi057.stdout:7/169: sync 2024-02-28T16:02:00.267 INFO:tasks.workunit.client.0.smithi057.stdout:3/172: sync 2024-02-28T16:02:00.267 INFO:tasks.workunit.client.0.smithi057.stdout:5/250: sync 2024-02-28T16:02:00.267 INFO:tasks.workunit.client.0.smithi057.stdout:8/280: sync 2024-02-28T16:02:00.267 INFO:tasks.workunit.client.0.smithi057.stdout:4/242: sync 2024-02-28T16:02:00.267 INFO:tasks.workunit.client.0.smithi057.stdout:6/186: sync 2024-02-28T16:02:00.268 INFO:tasks.workunit.client.1.smithi087.stdout:3/677: rmdir d11/d3a/dd1 39 2024-02-28T16:02:00.268 INFO:tasks.workunit.client.0.smithi057.stdout:0/367: sync 2024-02-28T16:02:00.269 INFO:tasks.workunit.client.1.smithi087.stdout:0/588: write d4/dd/d21/f96 [4248585,91641] 0 2024-02-28T16:02:00.270 INFO:tasks.workunit.client.1.smithi087.stdout:9/570: truncate d7/dd/d15/d79/f26 4360260 0 2024-02-28T16:02:00.270 INFO:tasks.workunit.client.1.smithi087.stdout:1/583: write d0/d1a/f73 [4504796,26091] 0 2024-02-28T16:02:00.272 INFO:tasks.workunit.client.1.smithi087.stdout:6/659: fsync d4/d12/d45/f86 0 2024-02-28T16:02:00.274 INFO:tasks.workunit.client.0.smithi057.stdout:1/285: stat d1/d21/d25/d26/d44/f58 0 2024-02-28T16:02:00.276 INFO:tasks.workunit.client.1.smithi087.stdout:2/588: write d2/fc [2161209,74201] 0 2024-02-28T16:02:00.276 INFO:tasks.workunit.client.1.smithi087.stdout:7/581: dwrite d14/d27/d5d/f70 [0,4194304] 0 2024-02-28T16:02:00.276 INFO:tasks.workunit.client.1.smithi087.stdout:0/589: read - d4/d6/d9c/fa7 zero size 2024-02-28T16:02:00.276 INFO:tasks.workunit.client.1.smithi087.stdout:1/584: chown d0/d14/d86/c9d 257 1 2024-02-28T16:02:00.278 INFO:tasks.workunit.client.1.smithi087.stdout:6/660: chown d4/d30/d13/l4d 96 1 2024-02-28T16:02:00.279 INFO:tasks.workunit.client.0.smithi057.stdout:0/368: mkdir d6/d12/d45/d78 0 2024-02-28T16:02:00.283 INFO:tasks.workunit.client.1.smithi087.stdout:3/678: symlink d11/d45/d73/le1 0 2024-02-28T16:02:00.285 INFO:tasks.workunit.client.1.smithi087.stdout:4/673: dwrite d2/d9/f48 [0,4194304] 0 2024-02-28T16:02:00.285 INFO:tasks.workunit.client.0.smithi057.stdout:1/286: write d1/d21/f63 [485342,38703] 0 2024-02-28T16:02:00.285 INFO:tasks.workunit.client.0.smithi057.stdout:6/187: write df/d14/d15/d16/f33 [346447,39776] 0 2024-02-28T16:02:00.288 INFO:tasks.workunit.client.0.smithi057.stdout:4/243: read d1/d14/f33 [4165549,46489] 0 2024-02-28T16:02:00.288 INFO:tasks.workunit.client.1.smithi087.stdout:8/627: rename d2/f8 to d2/d9/d10/fcb 0 2024-02-28T16:02:00.288 INFO:tasks.workunit.client.1.smithi087.stdout:1/585: symlink d0/d1b/d1f/d96/d63/lc2 0 2024-02-28T16:02:00.289 INFO:tasks.workunit.client.0.smithi057.stdout:9/294: write d2/d5/d9/f35 [266273,37729] 0 2024-02-28T16:02:00.294 INFO:tasks.workunit.client.1.smithi087.stdout:6/661: readlink d4/l25 0 2024-02-28T16:02:00.295 INFO:tasks.workunit.client.1.smithi087.stdout:2/589: dread - d2/d7/d17/d97/fa1 zero size 2024-02-28T16:02:00.297 INFO:tasks.workunit.client.1.smithi087.stdout:2/590: stat d2/d99/f3c 0 2024-02-28T16:02:00.298 INFO:tasks.workunit.client.0.smithi057.stdout:2/207: link d19/f29 d19/d1d/d2e/d31/f40 0 2024-02-28T16:02:00.299 INFO:tasks.workunit.client.1.smithi087.stdout:3/679: symlink d11/d33/d67/d98/d9b/le2 0 2024-02-28T16:02:00.301 INFO:tasks.workunit.client.1.smithi087.stdout:3/680: dread - d11/f2b zero size 2024-02-28T16:02:00.303 INFO:tasks.workunit.client.1.smithi087.stdout:5/720: rename d3/d9/d9b/dba/d30/d44 to d3/d9/d9b/dba/d30/d8f/dac/d109 0 2024-02-28T16:02:00.305 INFO:tasks.workunit.client.0.smithi057.stdout:6/188: mkdir df/d14/d15/d3d 0 2024-02-28T16:02:00.306 INFO:tasks.workunit.client.1.smithi087.stdout:7/582: symlink d14/d2e/d2b/laa 0 2024-02-28T16:02:00.307 INFO:tasks.workunit.client.0.smithi057.stdout:3/173: link d8/l21 d8/dd/l3a 0 2024-02-28T16:02:00.309 INFO:tasks.workunit.client.1.smithi087.stdout:8/628: stat d2/d18/d42/d62/l93 0 2024-02-28T16:02:00.312 INFO:tasks.workunit.client.1.smithi087.stdout:1/586: creat d0/d1b/d1f/d96/d63/fc3 x:0 0 0 2024-02-28T16:02:00.316 INFO:tasks.workunit.client.1.smithi087.stdout:2/591: write d2/d99/f4d [2676577,74183] 0 2024-02-28T16:02:00.320 INFO:tasks.workunit.client.1.smithi087.stdout:9/571: rename d7/dd/d99/fa5 to d7/dd/d99/da3/fa6 0 2024-02-28T16:02:00.320 INFO:tasks.workunit.client.1.smithi087.stdout:9/572: stat d7/d1e/d60/fa4 0 2024-02-28T16:02:00.320 INFO:tasks.workunit.client.1.smithi087.stdout:4/674: mknod d2/d9/d10/dbf/dbb/ce4 0 2024-02-28T16:02:00.321 INFO:tasks.workunit.client.0.smithi057.stdout:5/251: dwrite d2/d19/f51 [4194304,4194304] 0 2024-02-28T16:02:00.321 INFO:tasks.workunit.client.0.smithi057.stdout:8/281: dwrite d5/d6/f22 [0,4194304] 0 2024-02-28T16:02:00.321 INFO:tasks.workunit.client.0.smithi057.stdout:0/369: dread d6/d4e/f32 [0,4194304] 0 2024-02-28T16:02:00.321 INFO:tasks.workunit.client.0.smithi057.stdout:4/244: truncate d1/ff 1125494 0 2024-02-28T16:02:00.332 INFO:tasks.workunit.client.1.smithi087.stdout:2/592: unlink d2/d99/f3c 0 2024-02-28T16:02:00.333 INFO:tasks.workunit.client.0.smithi057.stdout:8/282: write d5/f17 [2165129,53150] 0 2024-02-28T16:02:00.333 INFO:tasks.workunit.client.0.smithi057.stdout:7/170: dwrite d6/dc/d12/f21 [0,4194304] 0 2024-02-28T16:02:00.338 INFO:tasks.workunit.client.1.smithi087.stdout:5/721: mkdir d3/d9/d9b/de9/d10a 0 2024-02-28T16:02:00.338 INFO:tasks.workunit.client.0.smithi057.stdout:2/208: dwrite f10 [0,4194304] 0 2024-02-28T16:02:00.340 INFO:tasks.workunit.client.1.smithi087.stdout:7/583: mkdir d14/d2e/dab 0 2024-02-28T16:02:00.340 INFO:tasks.workunit.client.0.smithi057.stdout:1/287: link d1/d3/f3a d1/d21/d25/f64 0 2024-02-28T16:02:00.343 INFO:tasks.workunit.client.0.smithi057.stdout:8/283: write d5/d6/fa [6002344,24506] 0 2024-02-28T16:02:00.344 INFO:tasks.workunit.client.1.smithi087.stdout:8/629: creat d2/d18/d42/dbb/fcc x:0 0 0 2024-02-28T16:02:00.346 INFO:tasks.workunit.client.0.smithi057.stdout:9/295: mkdir d2/d62 0 2024-02-28T16:02:00.346 INFO:tasks.workunit.client.1.smithi087.stdout:4/675: symlink d2/df/d2e/dad/le5 0 2024-02-28T16:02:00.347 INFO:tasks.workunit.client.1.smithi087.stdout:1/587: mknod d0/d1b/d1f/d71/db2/d24/d78/cc4 0 2024-02-28T16:02:00.349 INFO:tasks.workunit.client.0.smithi057.stdout:6/189: dread df/d14/d15/f25 [0,4194304] 0 2024-02-28T16:02:00.351 INFO:tasks.workunit.client.1.smithi087.stdout:9/573: dwrite d7/dd/fe [8388608,4194304] 0 2024-02-28T16:02:00.354 INFO:tasks.workunit.client.0.smithi057.stdout:4/245: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:02:00.354 INFO:tasks.workunit.client.0.smithi057.stdout:6/190: fsync f9 0 2024-02-28T16:02:00.357 INFO:tasks.workunit.client.1.smithi087.stdout:0/590: rename d4/d6/f12 to d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/fc0 0 2024-02-28T16:02:00.358 INFO:tasks.workunit.client.1.smithi087.stdout:9/574: chown d7/dc 2226 1 2024-02-28T16:02:00.358 INFO:tasks.workunit.client.0.smithi057.stdout:6/191: fdatasync df/d14/f30 0 2024-02-28T16:02:00.363 INFO:tasks.workunit.client.1.smithi087.stdout:0/591: read d4/dd/d21/f71 [508476,103321] 0 2024-02-28T16:02:00.364 INFO:tasks.workunit.client.1.smithi087.stdout:3/681: rename d11/d61/d65/dd6 to d11/d45/d88/d91/de3 0 2024-02-28T16:02:00.365 INFO:tasks.workunit.client.1.smithi087.stdout:7/584: dwrite d14/d27/d5d/f75 [0,4194304] 0 2024-02-28T16:02:00.365 INFO:tasks.workunit.client.0.smithi057.stdout:8/284: rmdir d5/d6 39 2024-02-28T16:02:00.368 INFO:tasks.workunit.client.1.smithi087.stdout:8/630: rmdir d2/d9/d10/d24/d9d/dbd 0 2024-02-28T16:02:00.377 INFO:tasks.workunit.client.1.smithi087.stdout:3/682: unlink d11/d45/l83 0 2024-02-28T16:02:00.377 INFO:tasks.workunit.client.0.smithi057.stdout:4/246: read d1/d22/f35 [3104255,122667] 0 2024-02-28T16:02:00.381 INFO:tasks.workunit.client.0.smithi057.stdout:6/192: symlink df/l3e 0 2024-02-28T16:02:00.381 INFO:tasks.workunit.client.1.smithi087.stdout:3/683: fdatasync d11/d33/d58/fa4 0 2024-02-28T16:02:00.383 INFO:tasks.workunit.client.1.smithi087.stdout:8/631: rename d2/d9/d10/fcb to d2/d9/d5e/fcd 0 2024-02-28T16:02:00.383 INFO:tasks.workunit.client.1.smithi087.stdout:6/662: dwrite d4/dc/f8e [0,4194304] 0 2024-02-28T16:02:00.385 INFO:tasks.workunit.client.0.smithi057.stdout:7/171: link d6/dc/l19 d6/l3d 0 2024-02-28T16:02:00.386 INFO:tasks.workunit.client.0.smithi057.stdout:2/209: dwrite d19/f37 [0,4194304] 0 2024-02-28T16:02:00.387 INFO:tasks.workunit.client.1.smithi087.stdout:7/585: mkdir d14/d27/d5d/dac 0 2024-02-28T16:02:00.387 INFO:tasks.workunit.client.1.smithi087.stdout:3/684: read d11/d7b/f97 [55408,1000] 0 2024-02-28T16:02:00.387 INFO:tasks.workunit.client.1.smithi087.stdout:9/575: truncate d7/dd/d3c/d4c/da1/f73 362296 0 2024-02-28T16:02:00.388 INFO:tasks.workunit.client.1.smithi087.stdout:8/632: dread - d2/d9/d1a/da5/faa zero size 2024-02-28T16:02:00.388 INFO:tasks.workunit.client.0.smithi057.stdout:8/285: creat d5/de/d63/f64 x:0 0 0 2024-02-28T16:02:00.390 INFO:tasks.workunit.client.0.smithi057.stdout:6/193: readlink df/d10/l35 0 2024-02-28T16:02:00.393 INFO:tasks.workunit.client.0.smithi057.stdout:4/247: truncate d1/d10/d12/d2c/f57 240137 0 2024-02-28T16:02:00.394 INFO:tasks.workunit.client.1.smithi087.stdout:6/663: mknod d4/d12/d45/d92/dc1/dcf/cd7 0 2024-02-28T16:02:00.394 INFO:tasks.workunit.client.1.smithi087.stdout:5/722: dread d3/d9/f79 [0,4194304] 0 2024-02-28T16:02:00.394 INFO:tasks.workunit.client.1.smithi087.stdout:7/586: fdatasync d14/d2e/f5c 0 2024-02-28T16:02:00.395 INFO:tasks.workunit.client.0.smithi057.stdout:2/210: symlink d19/d1d/d2e/l41 0 2024-02-28T16:02:00.395 INFO:tasks.workunit.client.1.smithi087.stdout:8/633: write d2/d9/d5e/d9c/d9f/fb7 [258043,70686] 0 2024-02-28T16:02:00.396 INFO:tasks.workunit.client.0.smithi057.stdout:3/174: dread d8/f12 [4194304,4194304] 0 2024-02-28T16:02:00.397 INFO:tasks.workunit.client.1.smithi087.stdout:3/685: creat d11/d61/d65/da9/fe4 x:0 0 0 2024-02-28T16:02:00.400 INFO:tasks.workunit.client.0.smithi057.stdout:8/286: mknod d5/d20/d39/d49/c65 0 2024-02-28T16:02:00.403 INFO:tasks.workunit.client.1.smithi087.stdout:9/576: readlink d7/dd/l95 0 2024-02-28T16:02:00.404 INFO:tasks.workunit.client.1.smithi087.stdout:7/587: creat d14/d7d/fad x:0 0 0 2024-02-28T16:02:00.407 INFO:tasks.workunit.client.1.smithi087.stdout:5/723: rename d3/d9/d4a/fdf to d3/d9/df6/f10b 0 2024-02-28T16:02:00.408 INFO:tasks.workunit.client.0.smithi057.stdout:2/211: fdatasync d19/d1d/d2e/d31/f40 0 2024-02-28T16:02:00.408 INFO:tasks.workunit.client.1.smithi087.stdout:8/634: read d2/d9/f17 [846046,118481] 0 2024-02-28T16:02:00.411 INFO:tasks.workunit.client.1.smithi087.stdout:9/577: chown d7/d1e/d44/c68 187 1 2024-02-28T16:02:00.411 INFO:tasks.workunit.client.1.smithi087.stdout:1/588: dread d0/d1b/d43/f4b [0,4194304] 0 2024-02-28T16:02:00.413 INFO:tasks.workunit.client.1.smithi087.stdout:7/588: rmdir d14/d2e 39 2024-02-28T16:02:00.414 INFO:tasks.workunit.client.0.smithi057.stdout:6/194: truncate df/d14/f24 711948 0 2024-02-28T16:02:00.414 INFO:tasks.workunit.client.0.smithi057.stdout:2/212: write d19/f37 [4045802,95193] 0 2024-02-28T16:02:00.415 INFO:tasks.workunit.client.0.smithi057.stdout:6/195: readlink df/d10/l35 0 2024-02-28T16:02:00.419 INFO:tasks.workunit.client.0.smithi057.stdout:0/370: write d6/f8 [975101,71460] 0 2024-02-28T16:02:00.422 INFO:tasks.workunit.client.0.smithi057.stdout:2/213: unlink f10 0 2024-02-28T16:02:00.427 INFO:tasks.workunit.client.0.smithi057.stdout:6/196: mknod df/d10/c3f 0 2024-02-28T16:02:00.427 INFO:tasks.workunit.client.0.smithi057.stdout:3/175: dread f3 [0,4194304] 0 2024-02-28T16:02:00.427 INFO:tasks.workunit.client.1.smithi087.stdout:4/676: write d2/d9/d10/d11/f94 [735275,117511] 0 2024-02-28T16:02:00.428 INFO:tasks.workunit.client.1.smithi087.stdout:8/635: mkdir d2/d63/d9b/dae/dca/d6f/dce 0 2024-02-28T16:02:00.432 INFO:tasks.workunit.client.1.smithi087.stdout:8/636: chown d2/d9/l26 140 1 2024-02-28T16:02:00.433 INFO:tasks.workunit.client.0.smithi057.stdout:3/176: chown d8/dd/d19/f29 309 1 2024-02-28T16:02:00.433 INFO:tasks.workunit.client.1.smithi087.stdout:6/664: dwrite d4/d12/d45/f91 [4194304,4194304] 0 2024-02-28T16:02:00.434 INFO:tasks.workunit.client.0.smithi057.stdout:2/214: mknod d19/d3a/c42 0 2024-02-28T16:02:00.434 INFO:tasks.workunit.client.0.smithi057.stdout:8/287: dwrite d5/de/f2b [0,4194304] 0 2024-02-28T16:02:00.435 INFO:tasks.workunit.client.0.smithi057.stdout:4/248: dwrite d1/d14/f1b [0,4194304] 0 2024-02-28T16:02:00.437 INFO:tasks.workunit.client.0.smithi057.stdout:9/296: dread d2/d5/d9/f32 [0,4194304] 0 2024-02-28T16:02:00.438 INFO:tasks.workunit.client.1.smithi087.stdout:5/724: write d3/d9/d9b/dba/d30/d36/f7a [1925589,26411] 0 2024-02-28T16:02:00.438 INFO:tasks.workunit.client.1.smithi087.stdout:4/677: write d2/d9/d10/d22/d5b/fcf [27137,61507] 0 2024-02-28T16:02:00.441 INFO:tasks.workunit.client.1.smithi087.stdout:8/637: write d2/d63/d9b/fc3 [725920,12662] 0 2024-02-28T16:02:00.442 INFO:tasks.workunit.client.1.smithi087.stdout:9/578: dwrite d7/dd/d15/f7a [0,4194304] 0 2024-02-28T16:02:00.443 INFO:tasks.workunit.client.0.smithi057.stdout:3/177: stat d8/dd/d19/c1e 0 2024-02-28T16:02:00.444 INFO:tasks.workunit.client.0.smithi057.stdout:6/197: fdatasync df/d10/d13/f1e 0 2024-02-28T16:02:00.445 INFO:tasks.workunit.client.1.smithi087.stdout:6/665: chown d4/d30/d13/d38/dc3/fd1 0 1 2024-02-28T16:02:00.448 INFO:tasks.workunit.client.0.smithi057.stdout:8/288: symlink d5/de/d1b/d57/l66 0 2024-02-28T16:02:00.451 INFO:tasks.workunit.client.1.smithi087.stdout:4/678: creat d2/d9/d10/d22/d5b/d5c/fe6 x:0 0 0 2024-02-28T16:02:00.451 INFO:tasks.workunit.client.0.smithi057.stdout:3/178: mkdir d8/dd/d14/d2e/d3b 0 2024-02-28T16:02:00.453 INFO:tasks.workunit.client.1.smithi087.stdout:3/686: write d11/d45/f8e [1468472,111193] 0 2024-02-28T16:02:00.453 INFO:tasks.workunit.client.1.smithi087.stdout:8/638: creat d2/d63/d9b/fcf x:0 0 0 2024-02-28T16:02:00.456 INFO:tasks.workunit.client.1.smithi087.stdout:9/579: symlink d7/d1e/d44/la7 0 2024-02-28T16:02:00.457 INFO:tasks.workunit.client.0.smithi057.stdout:5/252: dwrite d2/d8/f49 [4194304,4194304] 0 2024-02-28T16:02:00.459 INFO:tasks.workunit.client.0.smithi057.stdout:6/198: mkdir df/d40 0 2024-02-28T16:02:00.459 INFO:tasks.workunit.client.1.smithi087.stdout:4/679: symlink d2/d9/d10/dbf/db6/le7 0 2024-02-28T16:02:00.465 INFO:tasks.workunit.client.1.smithi087.stdout:0/592: dwrite d4/d6/dc/f84 [0,4194304] 0 2024-02-28T16:02:00.466 INFO:tasks.workunit.client.1.smithi087.stdout:6/666: creat d4/d30/fd8 x:0 0 0 2024-02-28T16:02:00.466 INFO:tasks.workunit.client.0.smithi057.stdout:6/199: chown lb 64031 1 2024-02-28T16:02:00.468 INFO:tasks.workunit.client.0.smithi057.stdout:3/179: rename d8/dd/d14 to d8/dd/d14/d2e/d3c 22 2024-02-28T16:02:00.468 INFO:tasks.workunit.client.1.smithi087.stdout:8/639: creat d2/d9/d5e/fd0 x:0 0 0 2024-02-28T16:02:00.470 INFO:tasks.workunit.client.0.smithi057.stdout:5/253: stat d2/l33 0 2024-02-28T16:02:00.470 INFO:tasks.workunit.client.0.smithi057.stdout:3/180: readlink d8/dd/d19/d25/l28 0 2024-02-28T16:02:00.471 INFO:tasks.workunit.client.1.smithi087.stdout:7/589: dwrite d14/d2e/d2b/d4e/f56 [0,4194304] 0 2024-02-28T16:02:00.472 INFO:tasks.workunit.client.0.smithi057.stdout:9/297: dread d2/d24/f14 [0,4194304] 0 2024-02-28T16:02:00.474 INFO:tasks.workunit.client.0.smithi057.stdout:5/254: symlink d2/d8/l58 0 2024-02-28T16:02:00.475 INFO:tasks.workunit.client.0.smithi057.stdout:3/181: stat d8/dd/d19/f29 0 2024-02-28T16:02:00.478 INFO:tasks.workunit.client.0.smithi057.stdout:6/200: getdents df/d14/d15/d16/d39 0 2024-02-28T16:02:00.479 INFO:tasks.workunit.client.1.smithi087.stdout:4/680: link d2/d9/l40 d2/d9/da/d1a/d26/d69/de3/le8 0 2024-02-28T16:02:00.480 INFO:tasks.workunit.client.1.smithi087.stdout:4/681: fsync d2/d9/d10/d22/d5b/d5c/fac 0 2024-02-28T16:02:00.481 INFO:tasks.workunit.client.1.smithi087.stdout:9/580: dwrite d7/f58 [0,4194304] 0 2024-02-28T16:02:00.483 INFO:tasks.workunit.client.1.smithi087.stdout:8/640: read d2/d63/d9b/dae/dca/f8c [1561451,104939] 0 2024-02-28T16:02:00.487 INFO:tasks.workunit.client.1.smithi087.stdout:7/590: mkdir d14/d27/d55/dae 0 2024-02-28T16:02:00.487 INFO:tasks.workunit.client.1.smithi087.stdout:1/589: dread d0/d1b/d1f/d71/db2/d24/d78/f9c [4194304,4194304] 0 2024-02-28T16:02:00.488 INFO:tasks.workunit.client.1.smithi087.stdout:9/581: write d7/dd/d15/f7a [4212514,19969] 0 2024-02-28T16:02:00.489 INFO:tasks.workunit.client.1.smithi087.stdout:4/682: read d2/d9/f48 [301536,50440] 0 2024-02-28T16:02:00.492 INFO:tasks.workunit.client.0.smithi057.stdout:2/215: dwrite f12 [4194304,4194304] 0 2024-02-28T16:02:00.492 INFO:tasks.workunit.client.0.smithi057.stdout:6/201: creat df/d10/d13/f41 x:0 0 0 2024-02-28T16:02:00.493 INFO:tasks.workunit.client.0.smithi057.stdout:7/172: dread d6/fb [0,4194304] 0 2024-02-28T16:02:00.498 INFO:tasks.workunit.client.1.smithi087.stdout:4/683: creat d2/d9/d10/d22/d5b/d5c/d91/da9/fe9 x:0 0 0 2024-02-28T16:02:00.499 INFO:tasks.workunit.client.1.smithi087.stdout:6/667: dread d4/d30/d13/d38/d69/f6f [0,4194304] 0 2024-02-28T16:02:00.499 INFO:tasks.workunit.client.1.smithi087.stdout:8/641: getdents d2/d9/d5e/dbc 0 2024-02-28T16:02:00.503 INFO:tasks.workunit.client.0.smithi057.stdout:5/255: dread - d2/d15/d3b/f4e zero size 2024-02-28T16:02:00.503 INFO:tasks.workunit.client.0.smithi057.stdout:3/182: dread d8/dd/d19/f2d [0,4194304] 0 2024-02-28T16:02:00.507 INFO:tasks.workunit.client.1.smithi087.stdout:8/642: write d2/d18/d42/dbb/fcc [742707,81575] 0 2024-02-28T16:02:00.508 INFO:tasks.workunit.client.0.smithi057.stdout:8/289: dwrite d5/de/d1b/d4b/f5d [0,4194304] 0 2024-02-28T16:02:00.511 INFO:tasks.workunit.client.1.smithi087.stdout:8/643: chown d2/d18/d25/c47 244806209 1 2024-02-28T16:02:00.514 INFO:tasks.workunit.client.0.smithi057.stdout:3/183: mknod d8/dd/d14/d2e/c3d 0 2024-02-28T16:02:00.515 INFO:tasks.workunit.client.1.smithi087.stdout:6/668: rename d4/d30/d13/d67/c9f to d4/dc/d61/cd9 0 2024-02-28T16:02:00.517 INFO:tasks.workunit.client.0.smithi057.stdout:7/173: creat d6/dc/d12/d29/f3e x:0 0 0 2024-02-28T16:02:00.519 INFO:tasks.workunit.client.1.smithi087.stdout:7/591: dwrite d14/d27/fa9 [0,4194304] 0 2024-02-28T16:02:00.519 INFO:tasks.workunit.client.0.smithi057.stdout:9/298: link d2/d5/d9/ld d2/d24/l63 0 2024-02-28T16:02:00.519 INFO:tasks.workunit.client.1.smithi087.stdout:1/590: dwrite d0/d1b/d1f/fa9 [0,4194304] 0 2024-02-28T16:02:00.523 INFO:tasks.workunit.client.1.smithi087.stdout:8/644: mkdir d2/d33/dd1 0 2024-02-28T16:02:00.529 INFO:tasks.workunit.client.0.smithi057.stdout:9/299: dread - d2/d5/d9/f4b zero size 2024-02-28T16:02:00.529 INFO:tasks.workunit.client.0.smithi057.stdout:6/202: creat df/f42 x:0 0 0 2024-02-28T16:02:00.529 INFO:tasks.workunit.client.0.smithi057.stdout:7/174: readlink d6/dc/d12/l16 0 2024-02-28T16:02:00.529 INFO:tasks.workunit.client.1.smithi087.stdout:6/669: rename d4/d30/fd8 to d4/d30/d13/d38/d69/fda 0 2024-02-28T16:02:00.529 INFO:tasks.workunit.client.1.smithi087.stdout:1/591: write d0/d1b/d43/f4b [2237539,12402] 0 2024-02-28T16:02:00.530 INFO:tasks.workunit.client.0.smithi057.stdout:9/300: chown d2/d24/l31 109 1 2024-02-28T16:02:00.531 INFO:tasks.workunit.client.1.smithi087.stdout:7/592: write d14/d21/f3e [8094763,95467] 0 2024-02-28T16:02:00.532 INFO:tasks.workunit.client.0.smithi057.stdout:3/184: truncate f3 223221 0 2024-02-28T16:02:00.535 INFO:tasks.workunit.client.0.smithi057.stdout:7/175: symlink d6/dc/d12/d29/l3f 0 2024-02-28T16:02:00.536 INFO:tasks.workunit.client.0.smithi057.stdout:8/290: dread d5/de/d1b/d4b/f5d [0,4194304] 0 2024-02-28T16:02:00.536 INFO:tasks.workunit.client.1.smithi087.stdout:8/645: creat d2/d33/dd1/fd2 x:0 0 0 2024-02-28T16:02:00.537 INFO:tasks.workunit.client.1.smithi087.stdout:1/592: truncate d0/d1b/d1f/d71/db2/d24/fb7 595799 0 2024-02-28T16:02:00.537 INFO:tasks.workunit.client.1.smithi087.stdout:7/593: symlink d14/d27/d55/laf 0 2024-02-28T16:02:00.538 INFO:tasks.workunit.client.0.smithi057.stdout:7/176: chown d6/dc/l25 6 1 2024-02-28T16:02:00.539 INFO:tasks.workunit.client.0.smithi057.stdout:7/177: chown d6 741 1 2024-02-28T16:02:00.540 INFO:tasks.workunit.client.1.smithi087.stdout:0/593: write d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/fc0 [1857160,32160] 0 2024-02-28T16:02:00.541 INFO:tasks.workunit.client.0.smithi057.stdout:9/301: dread d2/d5/f37 [0,4194304] 0 2024-02-28T16:02:00.543 INFO:tasks.workunit.client.1.smithi087.stdout:1/593: symlink d0/d1b/lc5 0 2024-02-28T16:02:00.544 INFO:tasks.workunit.client.1.smithi087.stdout:0/594: write d4/dd/d21/d52/f7e [1034465,31241] 0 2024-02-28T16:02:00.545 INFO:tasks.workunit.client.0.smithi057.stdout:3/185: creat d8/dd/d14/d2e/d3b/f3e x:0 0 0 2024-02-28T16:02:00.547 INFO:tasks.workunit.client.1.smithi087.stdout:8/646: link d2/d9/d10/c4c d2/d18/cd3 0 2024-02-28T16:02:00.548 INFO:tasks.workunit.client.1.smithi087.stdout:7/594: mknod d14/d2e/d2b/d57/cb0 0 2024-02-28T16:02:00.548 INFO:tasks.workunit.client.0.smithi057.stdout:8/291: mkdir d5/d20/d39/d59/d67 0 2024-02-28T16:02:00.551 INFO:tasks.workunit.client.1.smithi087.stdout:0/595: write d4/dd/d21/d9b/d7c/f98 [3779367,33871] 0 2024-02-28T16:02:00.552 INFO:tasks.workunit.client.0.smithi057.stdout:8/292: fdatasync d5/de/d1b/f2e 0 2024-02-28T16:02:00.553 INFO:tasks.workunit.client.0.smithi057.stdout:3/186: truncate d8/dd/d19/d2a/f39 16746 0 2024-02-28T16:02:00.554 INFO:tasks.workunit.client.0.smithi057.stdout:7/178: rename d6/dc/d12/c2c to d6/dc/c40 0 2024-02-28T16:02:00.556 INFO:tasks.workunit.client.1.smithi087.stdout:9/582: dwrite d7/dd/f1a [0,4194304] 0 2024-02-28T16:02:00.556 INFO:tasks.workunit.client.1.smithi087.stdout:7/595: write d14/d27/d5d/f5e [1312903,75985] 0 2024-02-28T16:02:00.561 INFO:tasks.workunit.client.0.smithi057.stdout:3/187: creat d8/dd/d14/d2e/d30/f3f x:0 0 0 2024-02-28T16:02:00.565 INFO:tasks.workunit.client.1.smithi087.stdout:0/596: rename d4/dd/d37/d39/d3a/d57/d74/d1f/d34 to d4/dd/d37/d39/d3a/dc1 0 2024-02-28T16:02:00.567 INFO:tasks.workunit.client.1.smithi087.stdout:9/583: symlink d7/d1e/d44/d83/d8e/la8 0 2024-02-28T16:02:00.570 INFO:tasks.workunit.client.0.smithi057.stdout:3/188: readlink d8/l21 0 2024-02-28T16:02:00.576 INFO:tasks.workunit.client.0.smithi057.stdout:9/302: dwrite d2/d5/d9/f4b [0,4194304] 0 2024-02-28T16:02:00.576 INFO:tasks.workunit.client.1.smithi087.stdout:8/647: dwrite d2/d9/f5c [0,4194304] 0 2024-02-28T16:02:00.576 INFO:tasks.workunit.client.1.smithi087.stdout:9/584: rename d7/d1e/d44/f62 to d7/dd/d15/d79/d2e/fa9 0 2024-02-28T16:02:00.585 INFO:tasks.workunit.client.0.smithi057.stdout:8/293: dwrite d5/d20/f38 [0,4194304] 0 2024-02-28T16:02:00.588 INFO:tasks.workunit.client.1.smithi087.stdout:1/594: read d0/d14/f25 [3140116,22460] 0 2024-02-28T16:02:00.593 INFO:tasks.workunit.client.0.smithi057.stdout:3/189: dread d8/dd/d14/f17 [0,4194304] 0 2024-02-28T16:02:00.595 INFO:tasks.workunit.client.1.smithi087.stdout:8/648: rmdir d2/d63/d9b/dae/dca/d6f/dce 0 2024-02-28T16:02:00.598 INFO:tasks.workunit.client.1.smithi087.stdout:0/597: dwrite d4/d6/dc/d45/f6a [4194304,4194304] 0 2024-02-28T16:02:00.598 INFO:tasks.workunit.client.1.smithi087.stdout:6/670: write d4/d30/f24 [3304167,120436] 0 2024-02-28T16:02:00.602 INFO:tasks.workunit.client.1.smithi087.stdout:2/593: sync 2024-02-28T16:02:00.606 INFO:tasks.workunit.client.1.smithi087.stdout:3/687: dread d11/d61/d7c/f84 [0,4194304] 0 2024-02-28T16:02:00.607 INFO:tasks.workunit.client.1.smithi087.stdout:2/594: fsync d2/d99/d28/d79/f93 0 2024-02-28T16:02:00.611 INFO:tasks.workunit.client.1.smithi087.stdout:6/671: chown d4/dc/d61/cd9 282 1 2024-02-28T16:02:00.611 INFO:tasks.workunit.client.0.smithi057.stdout:2/216: write d19/f29 [49482,32267] 0 2024-02-28T16:02:00.612 INFO:tasks.workunit.client.1.smithi087.stdout:5/725: dread d3/d9/d9b/dba/d30/f32 [0,4194304] 0 2024-02-28T16:02:00.614 INFO:tasks.workunit.client.1.smithi087.stdout:5/726: chown d3/f100 884 1 2024-02-28T16:02:00.614 INFO:tasks.workunit.client.1.smithi087.stdout:1/595: link d0/d1b/d43/d4d/fa8 d0/d1a/d28/d9b/fc6 0 2024-02-28T16:02:00.615 INFO:tasks.workunit.client.0.smithi057.stdout:2/217: write d19/d1d/f3f [322584,89317] 0 2024-02-28T16:02:00.618 INFO:tasks.workunit.client.0.smithi057.stdout:2/218: write d19/d1d/f3f [426167,16356] 0 2024-02-28T16:02:00.619 INFO:tasks.workunit.client.0.smithi057.stdout:9/303: mkdir d2/d5/d9/d64 0 2024-02-28T16:02:00.620 INFO:tasks.workunit.client.1.smithi087.stdout:2/595: unlink d2/c8b 0 2024-02-28T16:02:00.621 INFO:tasks.workunit.client.0.smithi057.stdout:8/294: symlink d5/d20/d39/d59/l68 0 2024-02-28T16:02:00.625 INFO:tasks.workunit.client.0.smithi057.stdout:8/295: write d5/d20/d39/d49/f54 [384234,58261] 0 2024-02-28T16:02:00.626 INFO:tasks.workunit.client.1.smithi087.stdout:1/596: mknod d0/d1b/d1f/d71/cc7 0 2024-02-28T16:02:00.626 INFO:tasks.workunit.client.0.smithi057.stdout:5/256: write d2/d15/d3b/f2f [535116,23061] 0 2024-02-28T16:02:00.628 INFO:tasks.workunit.client.0.smithi057.stdout:8/296: readlink d5/de/d1b/d57/l66 0 2024-02-28T16:02:00.628 INFO:tasks.workunit.client.1.smithi087.stdout:3/688: mkdir d11/d45/d88/d91/de3/de5 0 2024-02-28T16:02:00.629 INFO:tasks.workunit.client.1.smithi087.stdout:5/727: creat d3/d9/d9b/dba/d30/d8f/dac/d109/d54/f10c x:0 0 0 2024-02-28T16:02:00.630 INFO:tasks.workunit.client.1.smithi087.stdout:4/684: dread d2/d9/f4d [0,4194304] 0 2024-02-28T16:02:00.631 INFO:tasks.workunit.client.0.smithi057.stdout:2/219: write d19/d1d/d2e/d31/f3b [1404464,46623] 0 2024-02-28T16:02:00.632 INFO:tasks.workunit.client.0.smithi057.stdout:9/304: unlink d2/d5/d1b/l55 0 2024-02-28T16:02:00.632 INFO:tasks.workunit.client.1.smithi087.stdout:2/596: rename d2/d7/d17/d97/ca4 to d2/d7/dc0/cda 0 2024-02-28T16:02:00.633 INFO:tasks.workunit.client.0.smithi057.stdout:7/179: rmdir d6/dc/d12/d29 39 2024-02-28T16:02:00.635 INFO:tasks.workunit.client.0.smithi057.stdout:2/220: write d19/f1a [7835531,54165] 0 2024-02-28T16:02:00.636 INFO:tasks.workunit.client.1.smithi087.stdout:1/597: unlink d0/d1b/d43/d4d/l52 0 2024-02-28T16:02:00.637 INFO:tasks.workunit.client.1.smithi087.stdout:5/728: write d3/d9/d9b/dba/d30/d36/f7a [3281454,31388] 0 2024-02-28T16:02:00.639 INFO:tasks.workunit.client.0.smithi057.stdout:3/190: unlink d8/dd/d14/f17 0 2024-02-28T16:02:00.642 INFO:tasks.workunit.client.0.smithi057.stdout:5/257: readlink d2/l6 0 2024-02-28T16:02:00.643 INFO:tasks.workunit.client.0.smithi057.stdout:8/297: unlink d5/de/d1b/d57/l66 0 2024-02-28T16:02:00.643 INFO:tasks.workunit.client.1.smithi087.stdout:6/672: dwrite d4/d12/d45/f8a [0,4194304] 0 2024-02-28T16:02:00.643 INFO:tasks.workunit.client.1.smithi087.stdout:4/685: fsync d2/d9/f4d 0 2024-02-28T16:02:00.644 INFO:tasks.workunit.client.0.smithi057.stdout:3/191: chown d8/dd/d14/d2e/d2f/f35 27662 1 2024-02-28T16:02:00.645 INFO:tasks.workunit.client.1.smithi087.stdout:6/673: fdatasync d4/dc/f56 0 2024-02-28T16:02:00.645 INFO:tasks.workunit.client.1.smithi087.stdout:3/689: read d11/d3a/d3c/f40 [993203,88687] 0 2024-02-28T16:02:00.648 INFO:tasks.workunit.client.0.smithi057.stdout:3/192: read - d8/d26/f37 zero size 2024-02-28T16:02:00.649 INFO:tasks.workunit.client.1.smithi087.stdout:6/674: write d4/d12/d45/f97 [1936255,88969] 0 2024-02-28T16:02:00.651 INFO:tasks.workunit.client.1.smithi087.stdout:6/675: read - d4/d30/d13/d38/d69/fc2 zero size 2024-02-28T16:02:00.652 INFO:tasks.workunit.client.0.smithi057.stdout:8/298: symlink d5/d20/l69 0 2024-02-28T16:02:00.653 INFO:tasks.workunit.client.0.smithi057.stdout:1/288: sync 2024-02-28T16:02:00.653 INFO:tasks.workunit.client.1.smithi087.stdout:0/598: fsync d4/d6/dc/d45/f6a 0 2024-02-28T16:02:00.654 INFO:tasks.workunit.client.1.smithi087.stdout:7/596: write d14/d21/f45 [1400351,45482] 0 2024-02-28T16:02:00.655 INFO:tasks.workunit.client.1.smithi087.stdout:9/585: write d7/d1e/f51 [4258393,38294] 0 2024-02-28T16:02:00.658 INFO:tasks.workunit.client.0.smithi057.stdout:9/305: unlink d2/d24/c2d 0 2024-02-28T16:02:00.658 INFO:tasks.workunit.client.0.smithi057.stdout:8/299: read - d5/de/d1b/d45/f55 zero size 2024-02-28T16:02:00.658 INFO:tasks.workunit.client.1.smithi087.stdout:5/729: unlink d3/d64/d67/d7c/f106 0 2024-02-28T16:02:00.659 INFO:tasks.workunit.client.0.smithi057.stdout:7/180: mknod d6/dc/d35/c41 0 2024-02-28T16:02:00.661 INFO:tasks.workunit.client.1.smithi087.stdout:8/649: write d2/d33/f35 [2631871,58362] 0 2024-02-28T16:02:00.661 INFO:tasks.workunit.client.1.smithi087.stdout:1/598: rename d0/c1 to d0/d1b/d1f/d71/dad/cc8 0 2024-02-28T16:02:00.662 INFO:tasks.workunit.client.0.smithi057.stdout:2/221: dwrite d19/f37 [0,4194304] 0 2024-02-28T16:02:00.663 INFO:tasks.workunit.client.0.smithi057.stdout:3/193: write d8/dd/d19/f2d [1943956,17059] 0 2024-02-28T16:02:00.664 INFO:tasks.workunit.client.1.smithi087.stdout:4/686: dwrite d2/d9/f4d [4194304,4194304] 0 2024-02-28T16:02:00.668 INFO:tasks.workunit.client.1.smithi087.stdout:8/650: stat d2/d9/d5e/dbc/cbf 0 2024-02-28T16:02:00.670 INFO:tasks.workunit.client.1.smithi087.stdout:6/676: mknod d4/d12/d45/d92/dc1/cdb 0 2024-02-28T16:02:00.670 INFO:tasks.workunit.client.0.smithi057.stdout:2/222: write d19/f37 [97129,45571] 0 2024-02-28T16:02:00.671 INFO:tasks.workunit.client.0.smithi057.stdout:2/223: fdatasync d19/f2b 0 2024-02-28T16:02:00.671 INFO:tasks.workunit.client.0.smithi057.stdout:1/289: rename d1/d21/d42 to d1/d3/dc/d40/d5d/d65 0 2024-02-28T16:02:00.671 INFO:tasks.workunit.client.0.smithi057.stdout:5/258: dwrite d2/d19/d1c/f34 [0,4194304] 0 2024-02-28T16:02:00.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:00 smithi057 ceph-mon[28763]: pgmap v32: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 48 MiB/s rd, 182 MiB/s wr, 328 op/s 2024-02-28T16:02:00.678 INFO:tasks.workunit.client.0.smithi057.stdout:7/181: truncate d6/dc/f10 2564426 0 2024-02-28T16:02:00.678 INFO:tasks.workunit.client.0.smithi057.stdout:3/194: creat d8/dd/d14/d2e/d30/f40 x:0 0 0 2024-02-28T16:02:00.680 INFO:tasks.workunit.client.1.smithi087.stdout:7/597: creat d14/d2e/d2b/d4e/fb1 x:0 0 0 2024-02-28T16:02:00.681 INFO:tasks.workunit.client.1.smithi087.stdout:9/586: mkdir d7/dd/d15/d3f/daa 0 2024-02-28T16:02:00.681 INFO:tasks.workunit.client.0.smithi057.stdout:3/195: dread - d8/dd/d14/d2c/f33 zero size 2024-02-28T16:02:00.681 INFO:tasks.workunit.client.0.smithi057.stdout:9/306: rename d2/d33 to d2/d5e/d65 0 2024-02-28T16:02:00.683 INFO:tasks.workunit.client.0.smithi057.stdout:3/196: read - d8/dd/d19/f29 zero size 2024-02-28T16:02:00.685 INFO:tasks.workunit.client.0.smithi057.stdout:8/300: symlink d5/d20/d39/d59/d67/l6a 0 2024-02-28T16:02:00.685 INFO:tasks.workunit.client.0.smithi057.stdout:1/290: readlink d1/d21/l22 0 2024-02-28T16:02:00.686 INFO:tasks.workunit.client.1.smithi087.stdout:7/598: chown d14/d27/d55/dae 5 1 2024-02-28T16:02:00.689 INFO:tasks.workunit.client.0.smithi057.stdout:2/224: rmdir d19/d1d/d2e/d3c 39 2024-02-28T16:02:00.690 INFO:tasks.workunit.client.1.smithi087.stdout:8/651: creat d2/d9/d5e/dbc/fd4 x:0 0 0 2024-02-28T16:02:00.691 INFO:tasks.workunit.client.1.smithi087.stdout:0/599: dwrite d4/dd/d21/f69 [0,4194304] 0 2024-02-28T16:02:00.692 INFO:tasks.workunit.client.1.smithi087.stdout:3/690: dwrite d11/d61/d65/fd8 [0,4194304] 0 2024-02-28T16:02:00.694 INFO:tasks.workunit.client.1.smithi087.stdout:6/677: rmdir d4/d12/d45/d92 39 2024-02-28T16:02:00.695 INFO:tasks.workunit.client.0.smithi057.stdout:2/225: write d19/d2c/f30 [1880337,89624] 0 2024-02-28T16:02:00.695 INFO:tasks.workunit.client.1.smithi087.stdout:2/597: link d2/d7/d17/d3d/f9b d2/d7/fdb 0 2024-02-28T16:02:00.696 INFO:tasks.workunit.client.0.smithi057.stdout:2/226: chown f12 371475670 1 2024-02-28T16:02:00.698 INFO:tasks.workunit.client.0.smithi057.stdout:8/301: symlink d5/d20/d39/d49/d56/l6b 0 2024-02-28T16:02:00.700 INFO:tasks.workunit.client.1.smithi087.stdout:8/652: chown d2/d7c 9200 1 2024-02-28T16:02:00.701 INFO:tasks.workunit.client.0.smithi057.stdout:2/227: mkdir d19/d43 0 2024-02-28T16:02:00.704 INFO:tasks.workunit.client.1.smithi087.stdout:5/730: chown d3/d9/d9b/dba/d30/l56 8104555 1 2024-02-28T16:02:00.704 INFO:tasks.workunit.client.1.smithi087.stdout:3/691: symlink d11/d61/d65/le6 0 2024-02-28T16:02:00.705 INFO:tasks.workunit.client.0.smithi057.stdout:9/307: getdents d2/d5/d1b/d2e 0 2024-02-28T16:02:00.705 INFO:tasks.workunit.client.1.smithi087.stdout:1/599: dwrite d0/d1b/d1f/f4a [0,4194304] 0 2024-02-28T16:02:00.706 INFO:tasks.workunit.client.0.smithi057.stdout:8/302: read - d5/d6/f3f zero size 2024-02-28T16:02:00.707 INFO:tasks.workunit.client.0.smithi057.stdout:8/303: chown d5/d62 483860129 1 2024-02-28T16:02:00.707 INFO:tasks.workunit.client.0.smithi057.stdout:9/308: dread - d2/d5/d9/f36 zero size 2024-02-28T16:02:00.708 INFO:tasks.workunit.client.1.smithi087.stdout:7/599: write d14/d2e/f87 [880048,20744] 0 2024-02-28T16:02:00.708 INFO:tasks.workunit.client.1.smithi087.stdout:2/598: symlink d2/d9a/ldc 0 2024-02-28T16:02:00.709 INFO:tasks.workunit.client.1.smithi087.stdout:0/600: chown d4/dd/d21/d32/f7a 100 1 2024-02-28T16:02:00.710 INFO:tasks.workunit.client.0.smithi057.stdout:8/304: write d5/d6/f22 [3617442,96919] 0 2024-02-28T16:02:00.712 INFO:tasks.workunit.client.0.smithi057.stdout:9/309: chown d2/d24/l63 5415 1 2024-02-28T16:02:00.714 INFO:tasks.workunit.client.1.smithi087.stdout:5/731: chown d3/d9/d9b/dba/d30/d36/f7a 171 1 2024-02-28T16:02:00.714 INFO:tasks.workunit.client.1.smithi087.stdout:2/599: stat d2/d7/d17/d34 0 2024-02-28T16:02:00.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:00 smithi087 ceph-mon[37122]: pgmap v32: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 48 MiB/s rd, 182 MiB/s wr, 328 op/s 2024-02-28T16:02:00.722 INFO:tasks.workunit.client.1.smithi087.stdout:9/587: dwrite d7/dd/d36/f4f [4194304,4194304] 0 2024-02-28T16:02:00.725 INFO:tasks.workunit.client.1.smithi087.stdout:3/692: mkdir d11/d7b/dab/de7 0 2024-02-28T16:02:00.725 INFO:tasks.workunit.client.1.smithi087.stdout:2/600: mkdir d2/d42/ddd 0 2024-02-28T16:02:00.727 INFO:tasks.workunit.client.1.smithi087.stdout:1/600: truncate d0/d1a/d28/d9b/faf 3497369 0 2024-02-28T16:02:00.729 INFO:tasks.workunit.client.0.smithi057.stdout:8/305: link d5/de/d1b/l32 d5/d20/d39/d59/l6c 0 2024-02-28T16:02:00.730 INFO:tasks.workunit.client.0.smithi057.stdout:8/306: dread - d5/de/d63/f64 zero size 2024-02-28T16:02:00.744 INFO:tasks.workunit.client.1.smithi087.stdout:9/588: creat d7/d1e/d44/d76/fab x:0 0 0 2024-02-28T16:02:00.744 INFO:tasks.workunit.client.1.smithi087.stdout:1/601: creat d0/d14/d48/fc9 x:0 0 0 2024-02-28T16:02:00.744 INFO:tasks.workunit.client.0.smithi057.stdout:8/307: getdents d5/de/d63 0 2024-02-28T16:02:00.746 INFO:tasks.workunit.client.1.smithi087.stdout:4/687: write d2/d9/d10/d22/f72 [801173,59069] 0 2024-02-28T16:02:00.747 INFO:tasks.workunit.client.0.smithi057.stdout:5/259: dread d2/f22 [0,4194304] 0 2024-02-28T16:02:00.748 INFO:tasks.workunit.client.0.smithi057.stdout:5/260: readlink d2/d19/l38 0 2024-02-28T16:02:00.750 INFO:tasks.workunit.client.1.smithi087.stdout:6/678: dwrite d4/d12/d45/d92/dbd/fca [0,4194304] 0 2024-02-28T16:02:00.750 INFO:tasks.workunit.client.0.smithi057.stdout:3/197: write d8/dd/f1f [1144060,78346] 0 2024-02-28T16:02:00.752 INFO:tasks.workunit.client.0.smithi057.stdout:2/228: dread d19/d2c/f30 [0,4194304] 0 2024-02-28T16:02:00.753 INFO:tasks.workunit.client.0.smithi057.stdout:3/198: dread - d8/dd/d14/d2e/d30/f3f zero size 2024-02-28T16:02:00.758 INFO:tasks.workunit.client.0.smithi057.stdout:5/261: getdents d2/d8 0 2024-02-28T16:02:00.762 INFO:tasks.workunit.client.1.smithi087.stdout:5/732: dwrite d3/d9/d9b/dba/dca/fcb [0,4194304] 0 2024-02-28T16:02:00.764 INFO:tasks.workunit.client.1.smithi087.stdout:1/602: chown d0/d1b/d1f/d71/db2/d24/c8a 5829694 1 2024-02-28T16:02:00.765 INFO:tasks.workunit.client.1.smithi087.stdout:4/688: creat d2/d9/d10/d22/d5b/d5c/fea x:0 0 0 2024-02-28T16:02:00.766 INFO:tasks.workunit.client.0.smithi057.stdout:8/308: dread d5/de/f4a [0,4194304] 0 2024-02-28T16:02:00.770 INFO:tasks.workunit.client.1.smithi087.stdout:9/589: rename d7/d1e/d60/d69/f82 to d7/dd/d15/d3f/d6d/fac 0 2024-02-28T16:02:00.770 INFO:tasks.workunit.client.0.smithi057.stdout:5/262: creat d2/d15/d3b/f59 x:0 0 0 2024-02-28T16:02:00.770 INFO:tasks.workunit.client.0.smithi057.stdout:2/229: dread fe [4194304,4194304] 0 2024-02-28T16:02:00.772 INFO:tasks.workunit.client.1.smithi087.stdout:6/679: write d4/d30/d13/d38/d69/fad [479596,6470] 0 2024-02-28T16:02:00.775 INFO:tasks.workunit.client.0.smithi057.stdout:2/230: chown d19/f2b 1835719936 1 2024-02-28T16:02:00.776 INFO:tasks.workunit.client.0.smithi057.stdout:8/309: chown d5/d20/d39/d49/d56/c50 21422 1 2024-02-28T16:02:00.776 INFO:tasks.workunit.client.0.smithi057.stdout:5/263: dread - d2/d12/d3d/f3f zero size 2024-02-28T16:02:00.779 INFO:tasks.workunit.client.0.smithi057.stdout:5/264: chown d2 82165335 1 2024-02-28T16:02:00.779 INFO:tasks.workunit.client.0.smithi057.stdout:7/182: dwrite d6/dc/f10 [0,4194304] 0 2024-02-28T16:02:00.782 INFO:tasks.workunit.client.0.smithi057.stdout:2/231: rmdir d19/d1d/d22 39 2024-02-28T16:02:00.783 INFO:tasks.workunit.client.0.smithi057.stdout:3/199: dwrite d8/dd/d14/d2e/d2f/f35 [0,4194304] 0 2024-02-28T16:02:00.783 INFO:tasks.workunit.client.1.smithi087.stdout:6/680: dread - d4/d30/f84 zero size 2024-02-28T16:02:00.784 INFO:tasks.workunit.client.1.smithi087.stdout:0/601: dwrite d4/d6/f14 [0,4194304] 0 2024-02-28T16:02:00.784 INFO:tasks.workunit.client.1.smithi087.stdout:0/602: readlink d4/dd/d21/d9b/l73 0 2024-02-28T16:02:00.784 INFO:tasks.workunit.client.0.smithi057.stdout:8/310: stat d5/d20/d39/d59/l6c 0 2024-02-28T16:02:00.785 INFO:tasks.workunit.client.1.smithi087.stdout:2/601: dread d2/f85 [0,4194304] 0 2024-02-28T16:02:00.786 INFO:tasks.workunit.client.0.smithi057.stdout:8/311: stat d5/de/d1b/d4b/f5d 0 2024-02-28T16:02:00.788 INFO:tasks.workunit.client.0.smithi057.stdout:2/232: chown d19/d34 14211210 1 2024-02-28T16:02:00.788 INFO:tasks.workunit.client.0.smithi057.stdout:7/183: read - d6/dc/f34 zero size 2024-02-28T16:02:00.791 INFO:tasks.workunit.client.0.smithi057.stdout:3/200: creat d8/dd/f41 x:0 0 0 2024-02-28T16:02:00.793 INFO:tasks.workunit.client.0.smithi057.stdout:8/312: truncate d5/d6/f3f 812275 0 2024-02-28T16:02:00.793 INFO:tasks.workunit.client.1.smithi087.stdout:4/689: truncate d2/d9/d9e/f58 1749863 0 2024-02-28T16:02:00.795 INFO:tasks.workunit.client.1.smithi087.stdout:6/681: creat d4/dc/d61/d89/fdc x:0 0 0 2024-02-28T16:02:00.795 INFO:tasks.workunit.client.1.smithi087.stdout:7/600: dread d14/d27/d5d/d6a/d83/d96/f9a [0,4194304] 0 2024-02-28T16:02:00.797 INFO:tasks.workunit.client.0.smithi057.stdout:3/201: read - d8/dd/d19/f29 zero size 2024-02-28T16:02:00.798 INFO:tasks.workunit.client.1.smithi087.stdout:0/603: creat d4/d6/dc/d45/fc2 x:0 0 0 2024-02-28T16:02:00.802 INFO:tasks.workunit.client.1.smithi087.stdout:2/602: fsync d2/d42/f71 0 2024-02-28T16:02:00.804 INFO:tasks.workunit.client.0.smithi057.stdout:3/202: write d8/f12 [113349,86185] 0 2024-02-28T16:02:00.807 INFO:tasks.workunit.client.0.smithi057.stdout:8/313: mknod d5/d62/c6d 0 2024-02-28T16:02:00.807 INFO:tasks.workunit.client.0.smithi057.stdout:2/233: getdents d19/d2c 0 2024-02-28T16:02:00.807 INFO:tasks.workunit.client.1.smithi087.stdout:2/603: dread - d2/fd6 zero size 2024-02-28T16:02:00.808 INFO:tasks.workunit.client.1.smithi087.stdout:5/733: rename d3/d9/d9b/dba/d30/f65 to d3/f10d 0 2024-02-28T16:02:00.808 INFO:tasks.workunit.client.1.smithi087.stdout:6/682: fdatasync d4/d30/d13/d38/fa1 0 2024-02-28T16:02:00.808 INFO:tasks.workunit.client.1.smithi087.stdout:3/693: dread d11/d3a/d3c/f40 [0,4194304] 0 2024-02-28T16:02:00.810 INFO:tasks.workunit.client.0.smithi057.stdout:0/371: sync 2024-02-28T16:02:00.813 INFO:tasks.workunit.client.0.smithi057.stdout:3/203: creat d8/dd/d14/d2e/d2f/f42 x:0 0 0 2024-02-28T16:02:00.816 INFO:tasks.workunit.client.0.smithi057.stdout:8/314: mkdir d5/d20/d39/d6e 0 2024-02-28T16:02:00.817 INFO:tasks.workunit.client.1.smithi087.stdout:2/604: write d2/d7/d17/f59 [6041118,4399] 0 2024-02-28T16:02:00.818 INFO:tasks.workunit.client.1.smithi087.stdout:6/683: fdatasync d4/dc/d10/f3d 0 2024-02-28T16:02:00.818 INFO:tasks.workunit.client.1.smithi087.stdout:3/694: rename d11/f29 to d11/d45/d88/fe8 0 2024-02-28T16:02:00.819 INFO:tasks.workunit.client.0.smithi057.stdout:0/372: fdatasync d6/fa 0 2024-02-28T16:02:00.822 INFO:tasks.workunit.client.1.smithi087.stdout:4/690: write d2/d9/d10/d22/d5b/f9b [388052,37214] 0 2024-02-28T16:02:00.822 INFO:tasks.workunit.client.1.smithi087.stdout:9/590: dwrite d7/dd/d15/d79/d2e/f6a [0,4194304] 0 2024-02-28T16:02:00.827 INFO:tasks.workunit.client.1.smithi087.stdout:6/684: mknod d4/d30/d13/d38/d69/cdd 0 2024-02-28T16:02:00.828 INFO:tasks.workunit.client.0.smithi057.stdout:0/373: symlink d6/l79 0 2024-02-28T16:02:00.829 INFO:tasks.workunit.client.1.smithi087.stdout:4/691: dread - d2/df/d65/d8d/fd1 zero size 2024-02-28T16:02:00.829 INFO:tasks.workunit.client.1.smithi087.stdout:9/591: chown d7/d1e/d44/c68 17 1 2024-02-28T16:02:00.831 INFO:tasks.workunit.client.1.smithi087.stdout:3/695: write d11/d33/d67/d9c/fb1 [819185,85561] 0 2024-02-28T16:02:00.832 INFO:tasks.workunit.client.1.smithi087.stdout:7/601: dwrite d14/d2e/d2b/f50 [0,4194304] 0 2024-02-28T16:02:00.833 INFO:tasks.workunit.client.0.smithi057.stdout:7/184: dwrite d6/dc/d12/d29/f3e [0,4194304] 0 2024-02-28T16:02:00.834 INFO:tasks.workunit.client.1.smithi087.stdout:0/604: write d4/dd/d37/f3d [4484998,117503] 0 2024-02-28T16:02:00.836 INFO:tasks.workunit.client.0.smithi057.stdout:5/265: dread d2/d8/f16 [0,4194304] 0 2024-02-28T16:02:00.837 INFO:tasks.workunit.client.1.smithi087.stdout:4/692: write d2/d9/d9e/fba [463606,13476] 0 2024-02-28T16:02:00.839 INFO:tasks.workunit.client.0.smithi057.stdout:0/374: creat d6/d12/f7a x:0 0 0 2024-02-28T16:02:00.842 INFO:tasks.workunit.client.1.smithi087.stdout:4/693: stat d2/d9/da/d1a/d26/c31 0 2024-02-28T16:02:00.844 INFO:tasks.workunit.client.0.smithi057.stdout:5/266: readlink d2/d3e/d44/d50/l52 0 2024-02-28T16:02:00.845 INFO:tasks.workunit.client.1.smithi087.stdout:0/605: link d4/dd/d26/f2b d4/dd/d26/fc3 0 2024-02-28T16:02:00.845 INFO:tasks.workunit.client.1.smithi087.stdout:6/685: getdents d4/dc/d7e 0 2024-02-28T16:02:00.846 INFO:tasks.workunit.client.0.smithi057.stdout:2/234: dwrite d19/d1d/d2e/d31/f40 [0,4194304] 0 2024-02-28T16:02:00.850 INFO:tasks.workunit.client.0.smithi057.stdout:0/375: rename d6/l79 to d6/d12/d45/l7b 0 2024-02-28T16:02:00.850 INFO:tasks.workunit.client.0.smithi057.stdout:5/267: chown d2/d15/f43 68 1 2024-02-28T16:02:00.852 INFO:tasks.workunit.client.1.smithi087.stdout:1/603: dread d0/d1b/d1f/f77 [4194304,4194304] 0 2024-02-28T16:02:00.853 INFO:tasks.workunit.client.1.smithi087.stdout:5/734: dread d3/d64/d67/f76 [0,4194304] 0 2024-02-28T16:02:00.853 INFO:tasks.workunit.client.0.smithi057.stdout:2/235: rmdir d19/d1d/d22 39 2024-02-28T16:02:00.857 INFO:tasks.workunit.client.0.smithi057.stdout:8/315: write d5/d20/d39/f42 [569628,84640] 0 2024-02-28T16:02:00.857 INFO:tasks.workunit.client.0.smithi057.stdout:5/268: rename d2/d8/c2d to d2/d3e/d44/d50/c5a 0 2024-02-28T16:02:00.858 INFO:tasks.workunit.client.0.smithi057.stdout:8/316: readlink l2 0 2024-02-28T16:02:00.860 INFO:tasks.workunit.client.1.smithi087.stdout:0/606: rename d4/d6/c28 to d4/dd/d37/d39/d3a/d57/d74/d1f/cc4 0 2024-02-28T16:02:00.861 INFO:tasks.workunit.client.1.smithi087.stdout:2/605: dwrite d2/d7/d17/d34/d88/fad [0,4194304] 0 2024-02-28T16:02:00.862 INFO:tasks.workunit.client.0.smithi057.stdout:5/269: write d2/d15/d3b/f2f [620241,28106] 0 2024-02-28T16:02:00.866 INFO:tasks.workunit.client.0.smithi057.stdout:8/317: unlink d5/f12 0 2024-02-28T16:02:00.866 INFO:tasks.workunit.client.1.smithi087.stdout:5/735: mknod d3/d64/c10e 0 2024-02-28T16:02:00.867 INFO:tasks.workunit.client.1.smithi087.stdout:1/604: symlink d0/d1b/d1f/d71/db2/d24/d5c/d69/lca 0 2024-02-28T16:02:00.867 INFO:tasks.workunit.client.1.smithi087.stdout:7/602: dread d14/d2e/d2b/d4e/f56 [0,4194304] 0 2024-02-28T16:02:00.868 INFO:tasks.workunit.client.0.smithi057.stdout:5/270: unlink d2/d15/l37 0 2024-02-28T16:02:00.873 INFO:tasks.workunit.client.1.smithi087.stdout:4/694: dread d2/d9/d10/d22/f6a [4194304,4194304] 0 2024-02-28T16:02:00.873 INFO:tasks.workunit.client.0.smithi057.stdout:3/204: truncate d8/dd/d14/d2e/d2f/f35 87310 0 2024-02-28T16:02:00.875 INFO:tasks.workunit.client.0.smithi057.stdout:2/236: rename d19/f2b to d19/d1d/f44 0 2024-02-28T16:02:00.878 INFO:tasks.workunit.client.0.smithi057.stdout:5/271: mkdir d2/d3e/d5b 0 2024-02-28T16:02:00.879 INFO:tasks.workunit.client.0.smithi057.stdout:0/376: write d6/d12/d45/d55/f1e [5225932,115216] 0 2024-02-28T16:02:00.880 INFO:tasks.workunit.client.1.smithi087.stdout:5/736: rmdir d3/d9/d9b/dba/d30/d8f/dac/d109/d54 39 2024-02-28T16:02:00.881 INFO:tasks.workunit.client.0.smithi057.stdout:2/237: mknod d19/d1d/d26/c45 0 2024-02-28T16:02:00.882 INFO:tasks.workunit.client.1.smithi087.stdout:6/686: truncate d4/d12/d45/f8a 4040644 0 2024-02-28T16:02:00.883 INFO:tasks.workunit.client.0.smithi057.stdout:0/377: write d6/d12/d45/d55/f1e [3832020,14798] 0 2024-02-28T16:02:00.884 INFO:tasks.workunit.client.0.smithi057.stdout:5/272: mknod d2/d15/d3b/c5c 0 2024-02-28T16:02:00.886 INFO:tasks.workunit.client.0.smithi057.stdout:2/238: creat d19/d3a/f46 x:0 0 0 2024-02-28T16:02:00.888 INFO:tasks.workunit.client.1.smithi087.stdout:2/606: write d2/d7/d17/d3d/f5f [748289,98980] 0 2024-02-28T16:02:00.890 INFO:tasks.workunit.client.1.smithi087.stdout:7/603: write d14/d2e/fa7 [220974,39136] 0 2024-02-28T16:02:00.891 INFO:tasks.workunit.client.0.smithi057.stdout:2/239: chown d19/d1d/l2a 262602945 1 2024-02-28T16:02:00.896 INFO:tasks.workunit.client.0.smithi057.stdout:3/205: write d8/dd/d14/f20 [592492,104335] 0 2024-02-28T16:02:00.896 INFO:tasks.workunit.client.0.smithi057.stdout:8/318: write d5/f7 [3133638,66437] 0 2024-02-28T16:02:00.896 INFO:tasks.workunit.client.0.smithi057.stdout:5/273: dread d2/d15/d3b/f2f [0,4194304] 0 2024-02-28T16:02:00.898 INFO:tasks.workunit.client.0.smithi057.stdout:8/319: chown d5/de/d1b/d57 1588966221 1 2024-02-28T16:02:00.899 INFO:tasks.workunit.client.1.smithi087.stdout:5/737: mkdir d3/d9/d9b/dba/d30/d10f 0 2024-02-28T16:02:00.901 INFO:tasks.workunit.client.0.smithi057.stdout:5/274: symlink d2/d15/l5d 0 2024-02-28T16:02:00.902 INFO:tasks.workunit.client.0.smithi057.stdout:3/206: mknod d8/dd/d14/c43 0 2024-02-28T16:02:00.902 INFO:tasks.workunit.client.0.smithi057.stdout:3/207: chown f4 1565456 1 2024-02-28T16:02:00.903 INFO:tasks.workunit.client.0.smithi057.stdout:5/275: mkdir d2/d15/d5e 0 2024-02-28T16:02:00.904 INFO:tasks.workunit.client.0.smithi057.stdout:0/378: dread d6/d12/d45/d55/f1e [4194304,4194304] 0 2024-02-28T16:02:00.904 INFO:tasks.workunit.client.1.smithi087.stdout:2/607: rename d2/d7/f6a to d2/d9a/fde 0 2024-02-28T16:02:00.906 INFO:tasks.workunit.client.0.smithi057.stdout:3/208: chown d8/dd/d14/d2c/f33 30551 1 2024-02-28T16:02:00.907 INFO:tasks.workunit.client.1.smithi087.stdout:7/604: symlink d14/d2e/d2b/lb2 0 2024-02-28T16:02:00.907 INFO:tasks.workunit.client.0.smithi057.stdout:5/276: readlink d2/l5 0 2024-02-28T16:02:00.908 INFO:tasks.workunit.client.0.smithi057.stdout:0/379: mknod d6/d12/d5d/c7c 0 2024-02-28T16:02:00.908 INFO:tasks.workunit.client.0.smithi057.stdout:3/209: stat d8/dd/c11 0 2024-02-28T16:02:00.908 INFO:tasks.workunit.client.1.smithi087.stdout:3/696: dread d11/d44/f87 [0,4194304] 0 2024-02-28T16:02:00.909 INFO:tasks.workunit.client.1.smithi087.stdout:4/695: dwrite d2/d9/d10/d22/d5b/d5c/d91/da9/fca [0,4194304] 0 2024-02-28T16:02:00.909 INFO:tasks.workunit.client.1.smithi087.stdout:5/738: write d3/d9/d4a/f50 [4647127,90803] 0 2024-02-28T16:02:00.912 INFO:tasks.workunit.client.0.smithi057.stdout:3/210: write d8/dd/f41 [447005,110735] 0 2024-02-28T16:02:00.915 INFO:tasks.workunit.client.1.smithi087.stdout:6/687: dwrite d4/dc/d7e/fb3 [4194304,4194304] 0 2024-02-28T16:02:00.917 INFO:tasks.workunit.client.0.smithi057.stdout:3/211: chown d8/dd/lf 3473718 1 2024-02-28T16:02:00.917 INFO:tasks.workunit.client.0.smithi057.stdout:0/380: creat d6/d12/d17/d4b/f7d x:0 0 0 2024-02-28T16:02:00.919 INFO:tasks.workunit.client.1.smithi087.stdout:7/605: fdatasync d14/d46/d7c/f84 0 2024-02-28T16:02:00.920 INFO:tasks.workunit.client.1.smithi087.stdout:1/605: dwrite d0/d1b/d1f/d71/db2/f6e [0,4194304] 0 2024-02-28T16:02:00.920 INFO:tasks.workunit.client.1.smithi087.stdout:3/697: dread d11/f26 [0,4194304] 0 2024-02-28T16:02:00.921 INFO:tasks.workunit.client.1.smithi087.stdout:5/739: write d3/d9/d9b/dba/d69/f7d [9758,89414] 0 2024-02-28T16:02:00.922 INFO:tasks.workunit.client.0.smithi057.stdout:2/240: dwrite f12 [4194304,4194304] 0 2024-02-28T16:02:00.923 INFO:tasks.workunit.client.1.smithi087.stdout:6/688: write d4/d12/d45/f91 [2452369,17114] 0 2024-02-28T16:02:00.924 INFO:tasks.workunit.client.0.smithi057.stdout:3/212: truncate d8/dd/d14/d2c/f33 41600 0 2024-02-28T16:02:00.924 INFO:tasks.workunit.client.1.smithi087.stdout:2/608: fdatasync d2/d7/d17/d97/fa0 0 2024-02-28T16:02:00.928 INFO:tasks.workunit.client.1.smithi087.stdout:6/689: write d4/d30/d13/d38/d69/fc2 [377297,53518] 0 2024-02-28T16:02:00.931 INFO:tasks.workunit.client.1.smithi087.stdout:7/606: creat d14/d27/d5d/d6a/d83/fb3 x:0 0 0 2024-02-28T16:02:00.936 INFO:tasks.workunit.client.1.smithi087.stdout:3/698: symlink d11/d45/d88/le9 0 2024-02-28T16:02:00.936 INFO:tasks.workunit.client.0.smithi057.stdout:0/381: symlink d6/d12/d17/d4b/d60/d6b/l7e 0 2024-02-28T16:02:00.936 INFO:tasks.workunit.client.0.smithi057.stdout:3/213: mknod d8/dd/d19/d25/c44 0 2024-02-28T16:02:00.936 INFO:tasks.workunit.client.0.smithi057.stdout:5/277: write d2/f1b [2275731,41917] 0 2024-02-28T16:02:00.938 INFO:tasks.workunit.client.1.smithi087.stdout:2/609: symlink d2/d7/d17/d97/ldf 0 2024-02-28T16:02:00.938 INFO:tasks.workunit.client.1.smithi087.stdout:4/696: dread d2/d9/da/d1a/d26/f35 [0,4194304] 0 2024-02-28T16:02:00.940 INFO:tasks.workunit.client.0.smithi057.stdout:5/278: mkdir d2/d12/d5f 0 2024-02-28T16:02:00.941 INFO:tasks.workunit.client.0.smithi057.stdout:0/382: mkdir d6/d12/d5d/d7f 0 2024-02-28T16:02:00.944 INFO:tasks.workunit.client.1.smithi087.stdout:3/699: mkdir d11/d61/d7c/db7/dea 0 2024-02-28T16:02:00.946 INFO:tasks.workunit.client.0.smithi057.stdout:5/279: write d2/d19/d1c/f34 [3890159,125879] 0 2024-02-28T16:02:00.946 INFO:tasks.workunit.client.1.smithi087.stdout:8/653: sync 2024-02-28T16:02:00.946 INFO:tasks.workunit.client.1.smithi087.stdout:5/740: symlink d3/d9/d9b/dba/d30/d10f/l110 0 2024-02-28T16:02:00.951 INFO:tasks.workunit.client.1.smithi087.stdout:1/606: creat d0/d1b/d1f/d71/db2/db3/fcb x:0 0 0 2024-02-28T16:02:00.953 INFO:tasks.workunit.client.0.smithi057.stdout:2/241: dwrite d19/f37 [0,4194304] 0 2024-02-28T16:02:00.955 INFO:tasks.workunit.client.1.smithi087.stdout:7/607: rename d14/d2e/d2b/d4e/f56 to d14/d7d/fb4 0 2024-02-28T16:02:00.958 INFO:tasks.workunit.client.1.smithi087.stdout:2/610: link d2/d99/f5d d2/d99/d28/d79/da3/fe0 0 2024-02-28T16:02:00.959 INFO:tasks.workunit.client.0.smithi057.stdout:3/214: dwrite d8/dd/d19/d2a/f39 [0,4194304] 0 2024-02-28T16:02:00.960 INFO:tasks.workunit.client.1.smithi087.stdout:8/654: truncate d2/f27 2323612 0 2024-02-28T16:02:00.961 INFO:tasks.workunit.client.1.smithi087.stdout:5/741: creat d3/d9/d9b/dba/d69/d87/df3/f111 x:0 0 0 2024-02-28T16:02:00.963 INFO:tasks.workunit.client.1.smithi087.stdout:8/655: readlink d2/d63/l82 0 2024-02-28T16:02:00.963 INFO:tasks.workunit.client.1.smithi087.stdout:3/700: mkdir d11/d61/d7c/db7/dea/deb 0 2024-02-28T16:02:00.964 INFO:tasks.workunit.client.0.smithi057.stdout:3/215: read - d8/dd/d14/d2e/d30/f40 zero size 2024-02-28T16:02:00.969 INFO:tasks.workunit.client.1.smithi087.stdout:8/656: chown d2/d63/d9b/dae/dca/d6f 9214 1 2024-02-28T16:02:00.969 INFO:tasks.workunit.client.0.smithi057.stdout:3/216: write d8/dd/f41 [1058500,41636] 0 2024-02-28T16:02:00.970 INFO:tasks.workunit.client.1.smithi087.stdout:4/697: dwrite d2/f4 [0,4194304] 0 2024-02-28T16:02:00.970 INFO:tasks.workunit.client.1.smithi087.stdout:5/742: read - d3/d9/d9b/dba/ff9 zero size 2024-02-28T16:02:00.971 INFO:tasks.workunit.client.0.smithi057.stdout:2/242: dread d19/d1d/f3f [0,4194304] 0 2024-02-28T16:02:00.973 INFO:tasks.workunit.client.1.smithi087.stdout:2/611: getdents d2/d99/d28/d79/d9f 0 2024-02-28T16:02:00.974 INFO:tasks.workunit.client.0.smithi057.stdout:5/280: dwrite d2/d12/d3d/f3f [0,4194304] 0 2024-02-28T16:02:00.975 INFO:tasks.workunit.client.0.smithi057.stdout:3/217: creat d8/dd/d14/d2e/d2f/f45 x:0 0 0 2024-02-28T16:02:00.977 INFO:tasks.workunit.client.1.smithi087.stdout:4/698: write d2/df/d2e/f9a [694169,29814] 0 2024-02-28T16:02:00.978 INFO:tasks.workunit.client.0.smithi057.stdout:0/383: dread d6/d12/d45/d55/f54 [0,4194304] 0 2024-02-28T16:02:00.979 INFO:tasks.workunit.client.0.smithi057.stdout:3/218: truncate d8/d26/f37 947585 0 2024-02-28T16:02:00.979 INFO:tasks.workunit.client.1.smithi087.stdout:3/701: truncate d11/d33/d67/f6e 1042865 0 2024-02-28T16:02:00.981 INFO:tasks.workunit.client.0.smithi057.stdout:3/219: fdatasync d8/f12 0 2024-02-28T16:02:00.986 INFO:tasks.workunit.client.1.smithi087.stdout:5/743: mkdir d3/d9/d9b/dba/d30/d36/d112 0 2024-02-28T16:02:00.986 INFO:tasks.workunit.client.1.smithi087.stdout:8/657: getdents d2/da2 0 2024-02-28T16:02:00.987 INFO:tasks.workunit.client.1.smithi087.stdout:8/658: stat d2/d7c/cac 0 2024-02-28T16:02:00.987 INFO:tasks.workunit.client.0.smithi057.stdout:0/384: mknod d6/d12/d5d/d7f/c80 0 2024-02-28T16:02:00.988 INFO:tasks.workunit.client.1.smithi087.stdout:2/612: mkdir d2/d99/d28/d79/d9f/de1 0 2024-02-28T16:02:00.988 INFO:tasks.workunit.client.1.smithi087.stdout:3/702: mknod d11/d45/d88/d91/de3/cec 0 2024-02-28T16:02:00.989 INFO:tasks.workunit.client.0.smithi057.stdout:3/220: mknod d8/dd/d19/c46 0 2024-02-28T16:02:00.989 INFO:tasks.workunit.client.1.smithi087.stdout:5/744: fsync d3/fb2 0 2024-02-28T16:02:00.993 INFO:tasks.workunit.client.1.smithi087.stdout:6/690: dread d4/d30/d13/d38/dc3/fd1 [0,4194304] 0 2024-02-28T16:02:00.994 INFO:tasks.workunit.client.1.smithi087.stdout:8/659: mkdir d2/d63/d9b/dd5 0 2024-02-28T16:02:00.994 INFO:tasks.workunit.client.1.smithi087.stdout:3/703: dread - d11/d33/d67/fc0 zero size 2024-02-28T16:02:00.994 INFO:tasks.workunit.client.1.smithi087.stdout:7/608: dwrite d14/d2e/d2b/f51 [0,4194304] 0 2024-02-28T16:02:00.996 INFO:tasks.workunit.client.0.smithi057.stdout:0/385: creat d6/d12/d45/d78/f81 x:0 0 0 2024-02-28T16:02:00.998 INFO:tasks.workunit.client.1.smithi087.stdout:5/745: write d3/d9/f2a [1600833,92937] 0 2024-02-28T16:02:00.998 INFO:tasks.workunit.client.0.smithi057.stdout:6/203: sync 2024-02-28T16:02:00.998 INFO:tasks.workunit.client.0.smithi057.stdout:4/249: sync 2024-02-28T16:02:01.000 INFO:tasks.workunit.client.1.smithi087.stdout:2/613: mkdir d2/d99/dc7/de2 0 2024-02-28T16:02:01.002 INFO:tasks.workunit.client.0.smithi057.stdout:3/221: link d8/dd/d19/c46 d8/dd/d14/d2e/c47 0 2024-02-28T16:02:01.002 INFO:tasks.workunit.client.0.smithi057.stdout:4/250: stat d1/ff 0 2024-02-28T16:02:01.006 INFO:tasks.workunit.client.1.smithi087.stdout:7/609: read d14/d27/d5d/f5e [340320,58903] 0 2024-02-28T16:02:01.007 INFO:tasks.workunit.client.1.smithi087.stdout:5/746: stat d3/d9/d9b/dba/d30/d8f/dac/d109/f85 0 2024-02-28T16:02:01.007 INFO:tasks.workunit.client.1.smithi087.stdout:6/691: symlink d4/d30/d42/lde 0 2024-02-28T16:02:01.007 INFO:tasks.workunit.client.0.smithi057.stdout:6/204: creat df/d14/f43 x:0 0 0 2024-02-28T16:02:01.008 INFO:tasks.workunit.client.1.smithi087.stdout:4/699: dwrite d2/d9/d10/d11/fdf [0,4194304] 0 2024-02-28T16:02:01.008 INFO:tasks.workunit.client.0.smithi057.stdout:5/281: dwrite d2/d19/d1c/f2c [0,4194304] 0 2024-02-28T16:02:01.008 INFO:tasks.workunit.client.0.smithi057.stdout:3/222: chown d8/dd/c11 11878489 1 2024-02-28T16:02:01.011 INFO:tasks.workunit.client.1.smithi087.stdout:5/747: readlink d3/d9/le0 0 2024-02-28T16:02:01.017 INFO:tasks.workunit.client.0.smithi057.stdout:3/223: rmdir d8/dd/d14/d2c 39 2024-02-28T16:02:01.021 INFO:tasks.workunit.client.0.smithi057.stdout:6/205: read df/d10/d13/f3a [172194,93026] 0 2024-02-28T16:02:01.021 INFO:tasks.workunit.client.0.smithi057.stdout:5/282: rename d2/d8/lf to d2/d12/d3d/l60 0 2024-02-28T16:02:01.025 INFO:tasks.workunit.client.0.smithi057.stdout:3/224: write d8/dd/d14/d2e/d3b/f3e [108282,5798] 0 2024-02-28T16:02:01.025 INFO:tasks.workunit.client.1.smithi087.stdout:8/660: symlink d2/d9/d10/d24/d9d/ld6 0 2024-02-28T16:02:01.025 INFO:tasks.workunit.client.0.smithi057.stdout:0/386: link d6/d12/d17/d34/l3e d6/d4e/l82 0 2024-02-28T16:02:01.026 INFO:tasks.workunit.client.1.smithi087.stdout:3/704: mkdir d11/d45/ded 0 2024-02-28T16:02:01.030 INFO:tasks.workunit.client.0.smithi057.stdout:3/225: stat d8/dd/d14/d2e/d30 0 2024-02-28T16:02:01.031 INFO:tasks.workunit.client.1.smithi087.stdout:7/610: rename d14/d27/d5d/d6a/d83/d96/f9a to d14/d7d/fb5 0 2024-02-28T16:02:01.034 INFO:tasks.workunit.client.0.smithi057.stdout:0/387: creat d6/d12/d17/d4b/f83 x:0 0 0 2024-02-28T16:02:01.035 INFO:tasks.workunit.client.1.smithi087.stdout:9/592: sync 2024-02-28T16:02:01.035 INFO:tasks.workunit.client.0.smithi057.stdout:3/226: mknod d8/c48 0 2024-02-28T16:02:01.036 INFO:tasks.workunit.client.1.smithi087.stdout:7/611: stat d14/d2e/d2b/c6e 0 2024-02-28T16:02:01.038 INFO:tasks.workunit.client.1.smithi087.stdout:3/705: chown d11/d45/f8e 26 1 2024-02-28T16:02:01.039 INFO:tasks.workunit.client.0.smithi057.stdout:2/243: dread f12 [0,4194304] 0 2024-02-28T16:02:01.040 INFO:tasks.workunit.client.0.smithi057.stdout:0/388: creat d6/d12/d17/d58/f84 x:0 0 0 2024-02-28T16:02:01.041 INFO:tasks.workunit.client.1.smithi087.stdout:4/700: rename d2/d9/d10/c93 to d2/dc1/ceb 0 2024-02-28T16:02:01.042 INFO:tasks.workunit.client.1.smithi087.stdout:3/706: write d11/f15 [945665,78503] 0 2024-02-28T16:02:01.044 INFO:tasks.workunit.client.1.smithi087.stdout:6/692: dwrite d4/dc/d61/d89/f9d [0,4194304] 0 2024-02-28T16:02:01.044 INFO:tasks.workunit.client.0.smithi057.stdout:2/244: dread - d19/d1d/d2e/d3c/f3d zero size 2024-02-28T16:02:01.045 INFO:tasks.workunit.client.0.smithi057.stdout:4/251: dread d1/d10/d12/f40 [0,4194304] 0 2024-02-28T16:02:01.046 INFO:tasks.workunit.client.1.smithi087.stdout:5/748: creat d3/d9/d9b/f113 x:0 0 0 2024-02-28T16:02:01.046 INFO:tasks.workunit.client.1.smithi087.stdout:1/607: dread d0/d1b/d43/d4d/f51 [0,4194304] 0 2024-02-28T16:02:01.048 INFO:tasks.workunit.client.0.smithi057.stdout:0/389: read d6/d12/d17/d4b/f36 [3041833,44003] 0 2024-02-28T16:02:01.050 INFO:tasks.workunit.client.0.smithi057.stdout:3/227: dread d8/dd/d14/f20 [0,4194304] 0 2024-02-28T16:02:01.053 INFO:tasks.workunit.client.0.smithi057.stdout:3/228: fdatasync d8/dd/d14/d2e/d30/f3f 0 2024-02-28T16:02:01.053 INFO:tasks.workunit.client.0.smithi057.stdout:6/206: dwrite df/d14/d15/d16/f33 [0,4194304] 0 2024-02-28T16:02:01.054 INFO:tasks.workunit.client.0.smithi057.stdout:4/252: mknod d1/d22/c58 0 2024-02-28T16:02:01.057 INFO:tasks.workunit.client.0.smithi057.stdout:2/245: creat d19/f47 x:0 0 0 2024-02-28T16:02:01.058 INFO:tasks.workunit.client.0.smithi057.stdout:5/283: truncate d2/d8/f49 429113 0 2024-02-28T16:02:01.061 INFO:tasks.workunit.client.1.smithi087.stdout:2/614: dread d2/d7/d17/d34/f4c [0,4194304] 0 2024-02-28T16:02:01.061 INFO:tasks.workunit.client.1.smithi087.stdout:8/661: link d2/d9/d5e/d9c/d9f/cb0 d2/d63/d9b/dae/dca/d6f/cd7 0 2024-02-28T16:02:01.061 INFO:tasks.workunit.client.1.smithi087.stdout:4/701: fsync d2/d9/d10/f92 0 2024-02-28T16:02:01.062 INFO:tasks.workunit.client.0.smithi057.stdout:4/253: creat d1/d10/d31/d36/f59 x:0 0 0 2024-02-28T16:02:01.064 INFO:tasks.workunit.client.0.smithi057.stdout:0/390: creat d6/f85 x:0 0 0 2024-02-28T16:02:01.065 INFO:tasks.workunit.client.0.smithi057.stdout:0/391: stat d6/fd 0 2024-02-28T16:02:01.066 INFO:tasks.workunit.client.0.smithi057.stdout:0/392: chown d6/c15 0 1 2024-02-28T16:02:01.069 INFO:tasks.workunit.client.0.smithi057.stdout:0/393: write d6/d12/d17/f59 [1188378,31643] 0 2024-02-28T16:02:01.071 INFO:tasks.workunit.client.0.smithi057.stdout:3/229: mkdir d8/dd/d14/d2e/d30/d49 0 2024-02-28T16:02:01.073 INFO:tasks.workunit.client.0.smithi057.stdout:4/254: mknod d1/d10/d12/d15/d19/c5a 0 2024-02-28T16:02:01.074 INFO:tasks.workunit.client.0.smithi057.stdout:5/284: dread d2/d8/f16 [0,4194304] 0 2024-02-28T16:02:01.074 INFO:tasks.workunit.client.0.smithi057.stdout:6/207: getdents df/d14/d15/d3d 0 2024-02-28T16:02:01.077 INFO:tasks.workunit.client.0.smithi057.stdout:4/255: creat d1/d10/d12/d15/f5b x:0 0 0 2024-02-28T16:02:01.079 INFO:tasks.workunit.client.0.smithi057.stdout:3/230: creat d8/dd/d14/d2e/d3b/f4a x:0 0 0 2024-02-28T16:02:01.084 INFO:tasks.workunit.client.0.smithi057.stdout:6/208: rmdir df/d40 0 2024-02-28T16:02:01.085 INFO:tasks.workunit.client.0.smithi057.stdout:9/310: sync 2024-02-28T16:02:01.085 INFO:tasks.workunit.client.0.smithi057.stdout:1/291: sync 2024-02-28T16:02:01.089 INFO:tasks.workunit.client.0.smithi057.stdout:5/285: link d2/f1b d2/d12/d3d/f61 0 2024-02-28T16:02:01.090 INFO:tasks.workunit.client.0.smithi057.stdout:1/292: write d1/d3/dc/d15/f17 [3401856,127102] 0 2024-02-28T16:02:01.093 INFO:tasks.workunit.client.0.smithi057.stdout:9/311: creat d2/d46/f66 x:0 0 0 2024-02-28T16:02:01.093 INFO:tasks.workunit.client.0.smithi057.stdout:3/231: truncate f3 935377 0 2024-02-28T16:02:01.094 INFO:tasks.workunit.client.0.smithi057.stdout:5/286: dread - d2/d15/d3b/f59 zero size 2024-02-28T16:02:01.094 INFO:tasks.workunit.client.0.smithi057.stdout:2/246: truncate d19/d2c/f30 1754765 0 2024-02-28T16:02:01.098 INFO:tasks.workunit.client.0.smithi057.stdout:0/394: dwrite d6/d12/d17/d34/f63 [4194304,4194304] 0 2024-02-28T16:02:01.140 INFO:tasks.workunit.client.1.smithi087.stdout:6/693: creat d4/d12/d45/d92/dc1/dcf/fdf x:0 0 0 2024-02-28T16:02:01.140 INFO:tasks.workunit.client.1.smithi087.stdout:1/608: creat d0/d1b/d1f/d96/fcc x:0 0 0 2024-02-28T16:02:01.142 INFO:tasks.workunit.client.1.smithi087.stdout:6/694: chown d4/dc/d7e/da4/ca6 0 1 2024-02-28T16:02:01.143 INFO:tasks.workunit.client.1.smithi087.stdout:4/702: creat d2/df/d65/d8d/fec x:0 0 0 2024-02-28T16:02:01.144 INFO:tasks.workunit.client.1.smithi087.stdout:5/749: mknod d3/d9/d9b/dba/d30/d53/d5b/c114 0 2024-02-28T16:02:01.145 INFO:tasks.workunit.client.1.smithi087.stdout:6/695: chown d4/d30/d13/d38/d69 28667 1 2024-02-28T16:02:01.148 INFO:tasks.workunit.client.1.smithi087.stdout:1/609: mkdir d0/d1b/d1f/d71/db2/dae/dcd 0 2024-02-28T16:02:01.149 INFO:tasks.workunit.client.1.smithi087.stdout:5/750: write d3/d9/d9b/dba/d30/d36/f4e [845024,67241] 0 2024-02-28T16:02:01.150 INFO:tasks.workunit.client.1.smithi087.stdout:4/703: symlink d2/d9/da/d1a/d26/led 0 2024-02-28T16:02:01.150 INFO:tasks.workunit.client.1.smithi087.stdout:9/593: dread d7/d1e/f5c [0,4194304] 0 2024-02-28T16:02:01.153 INFO:tasks.workunit.client.1.smithi087.stdout:6/696: creat d4/dc/d61/fe0 x:0 0 0 2024-02-28T16:02:01.154 INFO:tasks.workunit.client.1.smithi087.stdout:5/751: write d3/d64/d81/f4b [836918,127788] 0 2024-02-28T16:02:01.165 INFO:tasks.workunit.client.1.smithi087.stdout:5/752: chown d3/d9/d9b/dba/d30/d8f/cae 3 1 2024-02-28T16:02:01.165 INFO:tasks.workunit.client.1.smithi087.stdout:8/662: dwrite d2/da2/fad [0,4194304] 0 2024-02-28T16:02:01.168 INFO:tasks.workunit.client.1.smithi087.stdout:5/753: read d3/d9/d9b/dba/d30/d36/f4e [4148791,31656] 0 2024-02-28T16:02:01.173 INFO:tasks.workunit.client.1.smithi087.stdout:4/704: mknod d2/d9/d10/d22/cee 0 2024-02-28T16:02:01.174 INFO:tasks.workunit.client.0.smithi057.stdout:9/312: mkdir d2/d46/d67 0 2024-02-28T16:02:01.174 INFO:tasks.workunit.client.1.smithi087.stdout:6/697: mknod d4/d12/d45/d92/ce1 0 2024-02-28T16:02:01.176 INFO:tasks.workunit.client.1.smithi087.stdout:8/663: creat d2/d33/dd1/fd8 x:0 0 0 2024-02-28T16:02:01.177 INFO:tasks.workunit.client.0.smithi057.stdout:3/232: mkdir d8/d4b 0 2024-02-28T16:02:01.177 INFO:tasks.workunit.client.0.smithi057.stdout:5/287: mkdir d2/d3e/d44/d62 0 2024-02-28T16:02:01.184 INFO:tasks.workunit.client.0.smithi057.stdout:2/247: mkdir d19/d2c/d48 0 2024-02-28T16:02:01.186 INFO:tasks.workunit.client.1.smithi087.stdout:5/754: mkdir d3/d9/d9b/d115 0 2024-02-28T16:02:01.186 INFO:tasks.workunit.client.1.smithi087.stdout:1/610: link d0/d1b/d1f/d71/db2/d24/l83 d0/d1b/d1f/d71/db2/d24/d78/lce 0 2024-02-28T16:02:01.186 INFO:tasks.workunit.client.1.smithi087.stdout:9/594: creat d7/d1e/fad x:0 0 0 2024-02-28T16:02:01.187 INFO:tasks.workunit.client.0.smithi057.stdout:2/248: dread - d19/d3a/f46 zero size 2024-02-28T16:02:01.190 INFO:tasks.workunit.client.1.smithi087.stdout:6/698: rename d4/d12/f4f to d4/d30/d13/d67/fe2 0 2024-02-28T16:02:01.190 INFO:tasks.workunit.client.1.smithi087.stdout:4/705: link d2/d9/d10/f92 d2/d9/d10/d22/fef 0 2024-02-28T16:02:01.191 INFO:tasks.workunit.client.0.smithi057.stdout:0/395: fsync d6/f41 0 2024-02-28T16:02:01.192 INFO:tasks.workunit.client.1.smithi087.stdout:8/664: fsync d2/d18/f79 0 2024-02-28T16:02:01.194 INFO:tasks.workunit.client.1.smithi087.stdout:8/665: readlink d2/d9/l26 0 2024-02-28T16:02:01.195 INFO:tasks.workunit.client.0.smithi057.stdout:1/293: rename d1/d21/d25/d26 to d1/d21/d66 0 2024-02-28T16:02:01.196 INFO:tasks.workunit.client.1.smithi087.stdout:8/666: readlink d2/d63/l82 0 2024-02-28T16:02:01.196 INFO:tasks.workunit.client.0.smithi057.stdout:2/249: read d19/f1a [4351380,41327] 0 2024-02-28T16:02:01.197 INFO:tasks.workunit.client.0.smithi057.stdout:4/256: dread d1/d22/f24 [0,4194304] 0 2024-02-28T16:02:01.200 INFO:tasks.workunit.client.1.smithi087.stdout:4/706: dread d2/fb7 [0,4194304] 0 2024-02-28T16:02:01.200 INFO:tasks.workunit.client.1.smithi087.stdout:6/699: rename d4/d12/f21 to d4/d30/fe3 0 2024-02-28T16:02:01.203 INFO:tasks.workunit.client.1.smithi087.stdout:8/667: read d2/d9/f5d [759098,98634] 0 2024-02-28T16:02:01.206 INFO:tasks.workunit.client.1.smithi087.stdout:9/595: dread d7/f8 [0,4194304] 0 2024-02-28T16:02:01.206 INFO:tasks.workunit.client.1.smithi087.stdout:4/707: chown d2/d9/d10/d22/d5b/d5c/d91/da9 4006 1 2024-02-28T16:02:01.206 INFO:tasks.workunit.client.1.smithi087.stdout:8/668: dread - d2/d9/d5e/f91 zero size 2024-02-28T16:02:01.207 INFO:tasks.workunit.client.0.smithi057.stdout:9/313: dwrite d2/d5/d1b/f5b [0,4194304] 0 2024-02-28T16:02:01.208 INFO:tasks.workunit.client.0.smithi057.stdout:1/294: dread - d1/d3/dc/d40/d5d/d65/f61 zero size 2024-02-28T16:02:01.210 INFO:tasks.workunit.client.1.smithi087.stdout:5/755: dwrite d3/d9/d9b/dba/d30/d36/f45 [0,4194304] 0 2024-02-28T16:02:01.211 INFO:tasks.workunit.client.1.smithi087.stdout:0/607: sync 2024-02-28T16:02:01.213 INFO:tasks.workunit.client.1.smithi087.stdout:0/608: chown d4/dd/d37/d39/d3a/f46 20160 1 2024-02-28T16:02:01.214 INFO:tasks.workunit.client.0.smithi057.stdout:9/314: rmdir d2/d24/d1d 39 2024-02-28T16:02:01.214 INFO:tasks.workunit.client.1.smithi087.stdout:8/669: mkdir d2/d63/d9b/dd5/dd9 0 2024-02-28T16:02:01.216 INFO:tasks.workunit.client.1.smithi087.stdout:4/708: rename d2/df/f13 to d2/d9/d10/d22/d5b/d5c/ff0 0 2024-02-28T16:02:01.218 INFO:tasks.workunit.client.0.smithi057.stdout:5/288: dwrite d2/d8/f16 [0,4194304] 0 2024-02-28T16:02:01.219 INFO:tasks.workunit.client.1.smithi087.stdout:8/670: rmdir d2/d9/d5e/d9c 39 2024-02-28T16:02:01.220 INFO:tasks.workunit.client.0.smithi057.stdout:3/233: dread f4 [0,4194304] 0 2024-02-28T16:02:01.221 INFO:tasks.workunit.client.0.smithi057.stdout:0/396: dwrite d6/d12/d17/f51 [4194304,4194304] 0 2024-02-28T16:02:01.222 INFO:tasks.workunit.client.1.smithi087.stdout:4/709: write d2/d9/d10/dbf/db6/fda [387056,289] 0 2024-02-28T16:02:01.222 INFO:tasks.workunit.client.1.smithi087.stdout:0/609: creat d4/dd/d37/d39/d3a/fc5 x:0 0 0 2024-02-28T16:02:01.224 INFO:tasks.workunit.client.1.smithi087.stdout:8/671: readlink d2/d9/db4/lc2 0 2024-02-28T16:02:01.224 INFO:tasks.workunit.client.0.smithi057.stdout:9/315: read - d2/d5/d1b/d2e/d44/f4f zero size 2024-02-28T16:02:01.224 INFO:tasks.workunit.client.1.smithi087.stdout:4/710: write d2/d49/f51 [7379061,40890] 0 2024-02-28T16:02:01.226 INFO:tasks.workunit.client.0.smithi057.stdout:0/397: mknod d6/d12/d45/c86 0 2024-02-28T16:02:01.227 INFO:tasks.workunit.client.1.smithi087.stdout:0/610: rename d4/dd/d21/d9b to d4/dd/d21/d9b/d7c/dc6 22 2024-02-28T16:02:01.228 INFO:tasks.workunit.client.1.smithi087.stdout:9/596: getdents d7/d1e/d44/d83/d8e 0 2024-02-28T16:02:01.229 INFO:tasks.workunit.client.1.smithi087.stdout:4/711: stat d2/d9/da/f2d 0 2024-02-28T16:02:01.231 INFO:tasks.workunit.client.1.smithi087.stdout:4/712: write d2/f2f [2208401,115443] 0 2024-02-28T16:02:01.233 INFO:tasks.workunit.client.1.smithi087.stdout:5/756: getdents d3/d9/d4a 0 2024-02-28T16:02:01.233 INFO:tasks.workunit.client.1.smithi087.stdout:8/672: mkdir d2/d9/d8e/dda 0 2024-02-28T16:02:01.236 INFO:tasks.workunit.client.1.smithi087.stdout:9/597: read d7/dd/fe [2199943,42667] 0 2024-02-28T16:02:01.245 INFO:tasks.workunit.client.1.smithi087.stdout:5/757: read d3/d9/d9b/dba/f2b [143805,28368] 0 2024-02-28T16:02:01.249 INFO:tasks.workunit.client.1.smithi087.stdout:1/611: dread d0/d1b/d1f/f41 [0,4194304] 0 2024-02-28T16:02:01.249 INFO:tasks.workunit.client.0.smithi057.stdout:3/234: write f3 [1394141,56304] 0 2024-02-28T16:02:01.252 INFO:tasks.workunit.client.0.smithi057.stdout:0/398: dwrite d6/f19 [0,4194304] 0 2024-02-28T16:02:01.253 INFO:tasks.workunit.client.1.smithi087.stdout:4/713: truncate d2/d9/f24 1766877 0 2024-02-28T16:02:01.253 INFO:tasks.workunit.client.1.smithi087.stdout:0/611: write d4/dd/d37/d39/d3a/f87 [5104766,61778] 0 2024-02-28T16:02:01.256 INFO:tasks.workunit.client.1.smithi087.stdout:1/612: mknod d0/d1b/d1f/ccf 0 2024-02-28T16:02:01.257 INFO:tasks.workunit.client.0.smithi057.stdout:8/320: sync 2024-02-28T16:02:01.257 INFO:tasks.workunit.client.0.smithi057.stdout:7/185: sync 2024-02-28T16:02:01.257 INFO:tasks.workunit.client.0.smithi057.stdout:0/399: mknod d6/d12/d5d/c87 0 2024-02-28T16:02:01.259 INFO:tasks.workunit.client.0.smithi057.stdout:4/257: dread d1/d10/d12/d15/f25 [0,4194304] 0 2024-02-28T16:02:01.260 INFO:tasks.workunit.client.1.smithi087.stdout:9/598: rename d7/dd/d15/d79/d2e/c33 to d7/dd/d36/cae 0 2024-02-28T16:02:01.261 INFO:tasks.workunit.client.0.smithi057.stdout:9/316: dwrite d2/d5/d1b/f49 [0,4194304] 0 2024-02-28T16:02:01.261 INFO:tasks.workunit.client.0.smithi057.stdout:7/186: write f4 [1435574,100095] 0 2024-02-28T16:02:01.263 INFO:tasks.workunit.client.0.smithi057.stdout:8/321: stat d5/d20/d39/d49/d56/c50 0 2024-02-28T16:02:01.265 INFO:tasks.workunit.client.0.smithi057.stdout:2/250: dread d19/d1d/f20 [0,4194304] 0 2024-02-28T16:02:01.265 INFO:tasks.workunit.client.0.smithi057.stdout:4/258: fsync d1/d22/f24 0 2024-02-28T16:02:01.268 INFO:tasks.workunit.client.1.smithi087.stdout:4/714: mkdir d2/d9/d10/d22/d5b/d5c/d68/dc5/df1 0 2024-02-28T16:02:01.268 INFO:tasks.workunit.client.1.smithi087.stdout:6/700: dread d4/dc/d10/f40 [0,4194304] 0 2024-02-28T16:02:01.268 INFO:tasks.workunit.client.0.smithi057.stdout:9/317: write d2/f3a [873854,22222] 0 2024-02-28T16:02:01.270 INFO:tasks.workunit.client.1.smithi087.stdout:5/758: creat d3/d9/d9b/dba/f116 x:0 0 0 2024-02-28T16:02:01.272 INFO:tasks.workunit.client.0.smithi057.stdout:9/318: write d2/d46/f66 [578120,34052] 0 2024-02-28T16:02:01.272 INFO:tasks.workunit.client.1.smithi087.stdout:9/599: mknod d7/dd/d15/d79/d56/caf 0 2024-02-28T16:02:01.272 INFO:tasks.workunit.client.1.smithi087.stdout:4/715: chown d2/d9/d10/d11 185957 1 2024-02-28T16:02:01.273 INFO:tasks.workunit.client.0.smithi057.stdout:7/187: mknod d6/dc/d12/d1a/c42 0 2024-02-28T16:02:01.274 INFO:tasks.workunit.client.0.smithi057.stdout:3/235: dwrite f3 [0,4194304] 0 2024-02-28T16:02:01.276 INFO:tasks.workunit.client.0.smithi057.stdout:4/259: creat d1/d22/f5c x:0 0 0 2024-02-28T16:02:01.279 INFO:tasks.workunit.client.0.smithi057.stdout:0/400: link d6/d12/d5d/d7f/c80 d6/d12/c88 0 2024-02-28T16:02:01.280 INFO:tasks.workunit.client.0.smithi057.stdout:4/260: creat d1/d3f/f5d x:0 0 0 2024-02-28T16:02:01.281 INFO:tasks.workunit.client.1.smithi087.stdout:6/701: rename d4/d12/d45/d92/lbe to d4/d12/d45/d74/le4 0 2024-02-28T16:02:01.282 INFO:tasks.workunit.client.1.smithi087.stdout:9/600: mkdir d7/d1e/d44/d83/db0 0 2024-02-28T16:02:01.284 INFO:tasks.workunit.client.0.smithi057.stdout:3/236: fdatasync d8/fa 0 2024-02-28T16:02:01.285 INFO:tasks.workunit.client.0.smithi057.stdout:7/188: creat d6/dc/f43 x:0 0 0 2024-02-28T16:02:01.287 INFO:tasks.workunit.client.1.smithi087.stdout:8/673: dwrite d2/d9/f19 [0,4194304] 0 2024-02-28T16:02:01.289 INFO:tasks.workunit.client.1.smithi087.stdout:5/759: mkdir d3/d9/d9b/dba/d69/d87/df3/d117 0 2024-02-28T16:02:01.289 INFO:tasks.workunit.client.1.smithi087.stdout:9/601: rmdir d7/d1e/d44/d83/d8e 39 2024-02-28T16:02:01.291 INFO:tasks.workunit.client.1.smithi087.stdout:1/613: dwrite d0/d1a/d28/f7f [0,4194304] 0 2024-02-28T16:02:01.293 INFO:tasks.workunit.client.1.smithi087.stdout:8/674: dread - d2/d33/dd1/fd2 zero size 2024-02-28T16:02:01.296 INFO:tasks.workunit.client.1.smithi087.stdout:5/760: mknod d3/d9/c118 0 2024-02-28T16:02:01.300 INFO:tasks.workunit.client.1.smithi087.stdout:9/602: creat d7/dd/d15/d3f/d5f/fb1 x:0 0 0 2024-02-28T16:02:01.301 INFO:tasks.workunit.client.1.smithi087.stdout:5/761: chown d3/d64/d67/f7b 2 1 2024-02-28T16:02:01.303 INFO:tasks.workunit.client.1.smithi087.stdout:8/675: read d2/d9/d10/f3a [1673104,61521] 0 2024-02-28T16:02:01.306 INFO:tasks.workunit.client.1.smithi087.stdout:9/603: creat d7/d1e/d44/fb2 x:0 0 0 2024-02-28T16:02:01.308 INFO:tasks.workunit.client.0.smithi057.stdout:2/251: dwrite d19/d1d/f3f [0,4194304] 0 2024-02-28T16:02:01.308 INFO:tasks.workunit.client.1.smithi087.stdout:4/716: link d2/d9/da/d1a/d26/d69/de3/l7a d2/d9/d10/d22/d5b/lf2 0 2024-02-28T16:02:01.310 INFO:tasks.workunit.client.1.smithi087.stdout:8/676: fdatasync d2/f64 0 2024-02-28T16:02:01.312 INFO:tasks.workunit.client.1.smithi087.stdout:9/604: truncate d7/d1e/fad 474616 0 2024-02-28T16:02:01.313 INFO:tasks.workunit.client.1.smithi087.stdout:4/717: symlink d2/d9/d10/dbf/lf3 0 2024-02-28T16:02:01.313 INFO:tasks.workunit.client.1.smithi087.stdout:8/677: dread - d2/d7c/fb9 zero size 2024-02-28T16:02:01.315 INFO:tasks.workunit.client.1.smithi087.stdout:6/702: dread d4/d30/d13/d38/dc3/fd1 [0,4194304] 0 2024-02-28T16:02:01.316 INFO:tasks.workunit.client.1.smithi087.stdout:5/762: link d3/f1c d3/d9/d4a/f119 0 2024-02-28T16:02:01.316 INFO:tasks.workunit.client.0.smithi057.stdout:7/189: link d6/dc/d35/f39 d6/d38/f44 0 2024-02-28T16:02:01.317 INFO:tasks.workunit.client.0.smithi057.stdout:4/261: write d1/d22/f35 [1798949,45665] 0 2024-02-28T16:02:01.318 INFO:tasks.workunit.client.0.smithi057.stdout:0/401: dwrite d6/d12/d45/d55/f1e [0,4194304] 0 2024-02-28T16:02:01.318 INFO:tasks.workunit.client.0.smithi057.stdout:3/237: truncate f3 2571463 0 2024-02-28T16:02:01.319 INFO:tasks.workunit.client.1.smithi087.stdout:0/612: write d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/f64 [841935,37579] 0 2024-02-28T16:02:01.322 INFO:tasks.workunit.client.0.smithi057.stdout:4/262: fsync d1/d10/d12/d15/f5b 0 2024-02-28T16:02:01.327 INFO:tasks.workunit.client.0.smithi057.stdout:0/402: creat d6/d12/d38/f89 x:0 0 0 2024-02-28T16:02:01.328 INFO:tasks.workunit.client.0.smithi057.stdout:4/263: rmdir d1/d10/d12/d39 39 2024-02-28T16:02:01.329 INFO:tasks.workunit.client.0.smithi057.stdout:7/190: symlink d6/d26/l45 0 2024-02-28T16:02:01.329 INFO:tasks.workunit.client.0.smithi057.stdout:0/403: write d6/f19 [3850150,32899] 0 2024-02-28T16:02:01.329 INFO:tasks.workunit.client.1.smithi087.stdout:5/763: symlink d3/d64/l11a 0 2024-02-28T16:02:01.333 INFO:tasks.workunit.client.0.smithi057.stdout:4/264: fsync d1/d10/d12/d15/f2e 0 2024-02-28T16:02:01.333 INFO:tasks.workunit.client.0.smithi057.stdout:7/191: creat d6/dc/d35/f46 x:0 0 0 2024-02-28T16:02:01.334 INFO:tasks.workunit.client.1.smithi087.stdout:9/605: fdatasync d7/f14 0 2024-02-28T16:02:01.337 INFO:tasks.workunit.client.1.smithi087.stdout:8/678: mknod d2/d9/d5e/d9c/d9f/cdb 0 2024-02-28T16:02:01.341 INFO:tasks.workunit.client.1.smithi087.stdout:9/606: chown d7/d1e/d44/c68 15 1 2024-02-28T16:02:01.343 INFO:tasks.workunit.client.1.smithi087.stdout:8/679: rmdir d2/d9 39 2024-02-28T16:02:01.347 INFO:tasks.workunit.client.0.smithi057.stdout:4/265: unlink d1/f4 0 2024-02-28T16:02:01.347 INFO:tasks.workunit.client.1.smithi087.stdout:9/607: rmdir d7/dd/d15/d79/d2e 39 2024-02-28T16:02:01.347 INFO:tasks.workunit.client.1.smithi087.stdout:5/764: link d3/d9/d4a/f50 d3/d64/d67/f11b 0 2024-02-28T16:02:01.348 INFO:tasks.workunit.client.1.smithi087.stdout:9/608: chown d7/dc/f18 50119 1 2024-02-28T16:02:01.351 INFO:tasks.workunit.client.1.smithi087.stdout:0/613: dwrite d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/f64 [0,4194304] 0 2024-02-28T16:02:01.352 INFO:tasks.workunit.client.1.smithi087.stdout:9/609: write d7/d1e/fad [430152,36871] 0 2024-02-28T16:02:01.357 INFO:tasks.workunit.client.0.smithi057.stdout:7/192: link d6/fb d6/dc/d12/f47 0 2024-02-28T16:02:01.357 INFO:tasks.workunit.client.0.smithi057.stdout:4/266: mkdir d1/d10/d12/d15/d19/d5e 0 2024-02-28T16:02:01.358 INFO:tasks.workunit.client.0.smithi057.stdout:0/404: dwrite d6/d12/d17/d34/f63 [0,4194304] 0 2024-02-28T16:02:01.358 INFO:tasks.workunit.client.1.smithi087.stdout:8/680: write d2/d18/d42/f81 [64070,124638] 0 2024-02-28T16:02:01.360 INFO:tasks.workunit.client.1.smithi087.stdout:0/614: truncate d4/dd/d37/d39/d3a/f97 1042047 0 2024-02-28T16:02:01.362 INFO:tasks.workunit.client.1.smithi087.stdout:8/681: symlink d2/d9/d5e/dbc/ldc 0 2024-02-28T16:02:01.363 INFO:tasks.workunit.client.1.smithi087.stdout:0/615: chown d4/dd/f1b 2751017 1 2024-02-28T16:02:01.364 INFO:tasks.workunit.client.1.smithi087.stdout:8/682: write d2/d63/d9b/dae/dca/d6f/f7a [1585108,117248] 0 2024-02-28T16:02:01.366 INFO:tasks.workunit.client.1.smithi087.stdout:8/683: fsync d2/f30 0 2024-02-28T16:02:01.368 INFO:tasks.workunit.client.1.smithi087.stdout:0/616: creat d4/dd/d21/d9b/d7c/fc7 x:0 0 0 2024-02-28T16:02:01.368 INFO:tasks.workunit.client.0.smithi057.stdout:7/193: symlink d6/dc/d12/d1a/l48 0 2024-02-28T16:02:01.368 INFO:tasks.workunit.client.0.smithi057.stdout:0/405: truncate d6/d12/d17/d58/f84 634681 0 2024-02-28T16:02:01.370 INFO:tasks.workunit.client.0.smithi057.stdout:9/319: dread d2/d5/d1b/d2e/f2f [0,4194304] 0 2024-02-28T16:02:01.370 INFO:tasks.workunit.client.1.smithi087.stdout:8/684: write d2/d9/d8e/f98 [2242672,19032] 0 2024-02-28T16:02:01.374 INFO:tasks.workunit.client.0.smithi057.stdout:7/194: stat d6/f28 0 2024-02-28T16:02:01.376 INFO:tasks.workunit.client.0.smithi057.stdout:0/406: stat d6/d12/d17/d4b/d60/d6b 0 2024-02-28T16:02:01.378 INFO:tasks.workunit.client.0.smithi057.stdout:9/320: symlink d2/d5/d9/l68 0 2024-02-28T16:02:01.379 INFO:tasks.workunit.client.0.smithi057.stdout:7/195: read d6/dc/d12/d29/f3e [1600070,72600] 0 2024-02-28T16:02:01.381 INFO:tasks.workunit.client.0.smithi057.stdout:0/407: creat d6/d12/d17/d34/f8a x:0 0 0 2024-02-28T16:02:01.381 INFO:tasks.workunit.client.0.smithi057.stdout:9/321: chown d2/d5/d9/f32 358523240 1 2024-02-28T16:02:01.385 INFO:tasks.workunit.client.1.smithi087.stdout:8/685: dread d2/da2/fad [0,4194304] 0 2024-02-28T16:02:01.386 INFO:tasks.workunit.client.0.smithi057.stdout:4/267: dread d1/d10/d12/d15/f4a [0,4194304] 0 2024-02-28T16:02:01.386 INFO:tasks.workunit.client.1.smithi087.stdout:0/617: dwrite d4/d6/d9c/fa7 [0,4194304] 0 2024-02-28T16:02:01.387 INFO:tasks.workunit.client.0.smithi057.stdout:4/268: dread - d1/d10/d31/d36/f59 zero size 2024-02-28T16:02:01.389 INFO:tasks.workunit.client.0.smithi057.stdout:9/322: read d2/d24/ff [2725421,38299] 0 2024-02-28T16:02:01.396 INFO:tasks.workunit.client.1.smithi087.stdout:4/718: dread d2/f7c [0,4194304] 0 2024-02-28T16:02:01.397 INFO:tasks.workunit.client.0.smithi057.stdout:9/323: symlink d2/l69 0 2024-02-28T16:02:01.401 INFO:tasks.workunit.client.1.smithi087.stdout:9/610: dwrite d7/dd/f2d [0,4194304] 0 2024-02-28T16:02:01.402 INFO:tasks.workunit.client.1.smithi087.stdout:4/719: mkdir d2/d9/d9e/df4 0 2024-02-28T16:02:01.407 INFO:tasks.workunit.client.1.smithi087.stdout:9/611: readlink d7/l27 0 2024-02-28T16:02:01.409 INFO:tasks.workunit.client.0.smithi057.stdout:0/408: dwrite d6/d12/d38/d5e/f48 [0,4194304] 0 2024-02-28T16:02:01.411 INFO:tasks.workunit.client.0.smithi057.stdout:0/409: dread - d6/d4e/f77 zero size 2024-02-28T16:02:01.413 INFO:tasks.workunit.client.1.smithi087.stdout:4/720: dread d2/df/d2e/f8e [0,4194304] 0 2024-02-28T16:02:01.415 INFO:tasks.workunit.client.1.smithi087.stdout:8/686: dwrite d2/d18/d42/d62/f7e [0,4194304] 0 2024-02-28T16:02:01.417 INFO:tasks.workunit.client.1.smithi087.stdout:4/721: chown d2/d9/d10/d22/l30 1875 1 2024-02-28T16:02:01.418 INFO:tasks.workunit.client.1.smithi087.stdout:0/618: dwrite d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/fad [0,4194304] 0 2024-02-28T16:02:01.419 INFO:tasks.workunit.client.1.smithi087.stdout:8/687: write d2/d63/d9b/dae/dca/d6f/f7a [1615463,69594] 0 2024-02-28T16:02:01.420 INFO:tasks.workunit.client.0.smithi057.stdout:0/410: mknod d6/d12/d17/d4b/d60/d6b/c8b 0 2024-02-28T16:02:01.420 INFO:tasks.workunit.client.1.smithi087.stdout:4/722: dread - d2/d9/d10/d11/fb9 zero size 2024-02-28T16:02:01.422 INFO:tasks.workunit.client.1.smithi087.stdout:4/723: stat d2/d9/d10/dbf 0 2024-02-28T16:02:01.423 INFO:tasks.workunit.client.1.smithi087.stdout:8/688: stat d2/d63/d9b/dae/dca 0 2024-02-28T16:02:01.425 INFO:tasks.workunit.client.0.smithi057.stdout:7/196: dwrite d6/f14 [0,4194304] 0 2024-02-28T16:02:01.429 INFO:tasks.workunit.client.0.smithi057.stdout:4/269: dwrite d1/d10/d12/d15/f25 [0,4194304] 0 2024-02-28T16:02:01.431 INFO:tasks.workunit.client.1.smithi087.stdout:4/724: mkdir d2/d9/d10/d22/d5b/d5c/d90/df5 0 2024-02-28T16:02:01.433 INFO:tasks.workunit.client.0.smithi057.stdout:0/411: mknod d6/d12/d17/d4b/d60/d6b/c8c 0 2024-02-28T16:02:01.433 INFO:tasks.workunit.client.1.smithi087.stdout:0/619: creat d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/fc8 x:0 0 0 2024-02-28T16:02:01.434 INFO:tasks.workunit.client.1.smithi087.stdout:9/612: dwrite d7/dd/d3c/d4c/da1/f80 [4194304,4194304] 0 2024-02-28T16:02:01.435 INFO:tasks.workunit.client.0.smithi057.stdout:7/197: symlink d6/d26/l49 0 2024-02-28T16:02:01.435 INFO:tasks.workunit.client.0.smithi057.stdout:4/270: readlink d1/d10/d12/d15/l48 0 2024-02-28T16:02:01.438 INFO:tasks.workunit.client.0.smithi057.stdout:0/412: stat d6/d4e/f32 0 2024-02-28T16:02:01.439 INFO:tasks.workunit.client.0.smithi057.stdout:4/271: write d1/d14/f23 [4540989,77056] 0 2024-02-28T16:02:01.442 INFO:tasks.workunit.client.1.smithi087.stdout:4/725: write d2/d9/d10/d22/f6a [752703,112820] 0 2024-02-28T16:02:01.442 INFO:tasks.workunit.client.0.smithi057.stdout:9/324: dwrite d2/d24/f10 [4194304,4194304] 0 2024-02-28T16:02:01.445 INFO:tasks.workunit.client.0.smithi057.stdout:0/413: write d6/d12/d45/d55/f6d [29447,91012] 0 2024-02-28T16:02:01.446 INFO:tasks.workunit.client.0.smithi057.stdout:4/272: mkdir d1/d3f/d5f 0 2024-02-28T16:02:01.449 INFO:tasks.workunit.client.0.smithi057.stdout:9/325: dread - d2/d5/d1b/d2e/d44/f4f zero size 2024-02-28T16:02:01.450 INFO:tasks.workunit.client.1.smithi087.stdout:4/726: rmdir d2/d9/da/d1a/d26 39 2024-02-28T16:02:01.451 INFO:tasks.workunit.client.0.smithi057.stdout:7/198: read d6/d38/f44 [235037,121749] 0 2024-02-28T16:02:01.453 INFO:tasks.workunit.client.1.smithi087.stdout:9/613: rmdir d7/d1e/d44/d83/d8e 39 2024-02-28T16:02:01.454 INFO:tasks.workunit.client.0.smithi057.stdout:4/273: creat d1/d10/d31/f60 x:0 0 0 2024-02-28T16:02:01.456 INFO:tasks.workunit.client.0.smithi057.stdout:9/326: unlink d2/f3f 0 2024-02-28T16:02:01.456 INFO:tasks.workunit.client.0.smithi057.stdout:0/414: link d6/d12/d45/d55/c28 d6/d12/d45/d78/c8d 0 2024-02-28T16:02:01.458 INFO:tasks.workunit.client.1.smithi087.stdout:4/727: fsync d2/d9/f48 0 2024-02-28T16:02:01.459 INFO:tasks.workunit.client.1.smithi087.stdout:8/689: dwrite d2/d18/d42/f6d [0,4194304] 0 2024-02-28T16:02:01.462 INFO:tasks.workunit.client.0.smithi057.stdout:7/199: dread d6/fb [0,4194304] 0 2024-02-28T16:02:01.463 INFO:tasks.workunit.client.1.smithi087.stdout:9/614: creat d7/dd/d99/da3/fb3 x:0 0 0 2024-02-28T16:02:01.463 INFO:tasks.workunit.client.0.smithi057.stdout:0/415: rename d6/d12/d17/f51 to d6/d12/d45/f8e 0 2024-02-28T16:02:01.467 INFO:tasks.workunit.client.0.smithi057.stdout:7/200: read - d6/dc/f11 zero size 2024-02-28T16:02:01.469 INFO:tasks.workunit.client.0.smithi057.stdout:0/416: creat d6/d12/d17/d4b/f8f x:0 0 0 2024-02-28T16:02:01.471 INFO:tasks.workunit.client.0.smithi057.stdout:0/417: stat d6/l68 0 2024-02-28T16:02:01.472 INFO:tasks.workunit.client.0.smithi057.stdout:7/201: chown d6/dc/d12/d1a/f37 1 1 2024-02-28T16:02:01.472 INFO:tasks.workunit.client.1.smithi087.stdout:0/620: dwrite d4/d6/dc/f84 [4194304,4194304] 0 2024-02-28T16:02:01.476 INFO:tasks.workunit.client.0.smithi057.stdout:0/418: chown d6/d12/d17/f59 10036 1 2024-02-28T16:02:01.476 INFO:tasks.workunit.client.0.smithi057.stdout:7/202: symlink d6/d26/l4a 0 2024-02-28T16:02:01.478 INFO:tasks.workunit.client.0.smithi057.stdout:4/274: dwrite d1/d10/d12/f40 [0,4194304] 0 2024-02-28T16:02:01.481 INFO:tasks.workunit.client.0.smithi057.stdout:7/203: rename d6/dc/d12/d1a to d6/dc/d12/d1a/d4b 22 2024-02-28T16:02:01.482 INFO:tasks.workunit.client.1.smithi087.stdout:9/615: mkdir d7/dd/d15/d3f/d9d/db4 0 2024-02-28T16:02:01.483 INFO:tasks.workunit.client.1.smithi087.stdout:9/616: fdatasync d7/f12 0 2024-02-28T16:02:01.484 INFO:tasks.workunit.client.0.smithi057.stdout:4/275: creat d1/d10/d31/d36/f61 x:0 0 0 2024-02-28T16:02:01.486 INFO:tasks.workunit.client.0.smithi057.stdout:7/204: fdatasync d6/dc/d12/d29/f3e 0 2024-02-28T16:02:01.487 INFO:tasks.workunit.client.1.smithi087.stdout:0/621: rename d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/fad to d4/d6/dc/fc9 0 2024-02-28T16:02:01.487 INFO:tasks.workunit.client.0.smithi057.stdout:4/276: write d1/f7 [4982632,71612] 0 2024-02-28T16:02:01.488 INFO:tasks.workunit.client.1.smithi087.stdout:9/617: chown d7/f12 143931 1 2024-02-28T16:02:01.495 INFO:tasks.workunit.client.1.smithi087.stdout:9/618: creat d7/dd/d36/d89/fb5 x:0 0 0 2024-02-28T16:02:01.495 INFO:tasks.workunit.client.1.smithi087.stdout:8/690: link d2/d63/l8b d2/d9/d5e/dbc/ldd 0 2024-02-28T16:02:01.498 INFO:tasks.workunit.client.0.smithi057.stdout:7/205: dread d6/dc/d12/f47 [0,4194304] 0 2024-02-28T16:02:01.500 INFO:tasks.workunit.client.1.smithi087.stdout:0/622: creat d4/dd/d37/d39/fca x:0 0 0 2024-02-28T16:02:01.502 INFO:tasks.workunit.client.0.smithi057.stdout:0/419: dwrite d6/d12/d45/d55/f1e [0,4194304] 0 2024-02-28T16:02:01.502 INFO:tasks.workunit.client.0.smithi057.stdout:4/277: rename d1/d10/d12/d15/f2e to d1/d10/d31/f62 0 2024-02-28T16:02:01.504 INFO:tasks.workunit.client.1.smithi087.stdout:9/619: getdents d7/dd/d15/d3f/d6d 0 2024-02-28T16:02:01.506 INFO:tasks.workunit.client.1.smithi087.stdout:9/620: stat d7/dd/d15/d3f/d6d/d9f 0 2024-02-28T16:02:01.509 INFO:tasks.workunit.client.1.smithi087.stdout:8/691: dread d2/d18/f22 [0,4194304] 0 2024-02-28T16:02:01.512 INFO:tasks.workunit.client.1.smithi087.stdout:9/621: rename d7/dd/d3c/f41 to d7/dd/d15/d3f/fb6 0 2024-02-28T16:02:01.514 INFO:tasks.workunit.client.0.smithi057.stdout:9/327: write d2/d5e/d65/f15 [1341130,93437] 0 2024-02-28T16:02:01.515 INFO:tasks.workunit.client.1.smithi087.stdout:8/692: write d2/d9/d10/d24/f5a [3984389,123054] 0 2024-02-28T16:02:01.520 INFO:tasks.workunit.client.0.smithi057.stdout:9/328: link d2/d5/d1b/d2e/d44/f4f d2/d5/d9/f6a 0 2024-02-28T16:02:01.524 INFO:tasks.workunit.client.0.smithi057.stdout:9/329: rename d2/d5/d1b/f5f to d2/d46/f6b 0 2024-02-28T16:02:01.525 INFO:tasks.workunit.client.1.smithi087.stdout:4/728: write d2/d9/da/d1a/d26/f3d [1899026,113945] 0 2024-02-28T16:02:01.525 INFO:tasks.workunit.client.0.smithi057.stdout:0/420: rmdir d6/d12/d17 39 2024-02-28T16:02:01.528 INFO:tasks.workunit.client.0.smithi057.stdout:9/330: mknod d2/d46/c6c 0 2024-02-28T16:02:01.530 INFO:tasks.workunit.client.1.smithi087.stdout:4/729: rmdir d2/d9/d10/d22/d5b/d5c 39 2024-02-28T16:02:01.530 INFO:tasks.workunit.client.0.smithi057.stdout:4/278: rmdir d1/d10/d31 39 2024-02-28T16:02:01.531 INFO:tasks.workunit.client.0.smithi057.stdout:7/206: write d6/d38/f44 [1117112,116052] 0 2024-02-28T16:02:01.532 INFO:tasks.workunit.client.1.smithi087.stdout:9/622: dwrite d7/dc/f59 [0,4194304] 0 2024-02-28T16:02:01.535 INFO:tasks.workunit.client.0.smithi057.stdout:0/421: link d6/d12/d45/f4f d6/d12/d45/d78/f90 0 2024-02-28T16:02:01.536 INFO:tasks.workunit.client.0.smithi057.stdout:4/279: dread d1/f28 [0,4194304] 0 2024-02-28T16:02:01.537 INFO:tasks.workunit.client.1.smithi087.stdout:4/730: rmdir d2/d9/d10/d22/d5b/d5c/d91/da9 39 2024-02-28T16:02:01.537 INFO:tasks.workunit.client.1.smithi087.stdout:8/693: write d2/d9/d10/f12 [8859870,76773] 0 2024-02-28T16:02:01.537 INFO:tasks.workunit.client.0.smithi057.stdout:9/331: link d2/d5/f30 d2/d5/d58/f6d 0 2024-02-28T16:02:01.539 INFO:tasks.workunit.client.0.smithi057.stdout:9/332: chown d2/d5/d9/d5d 5293793 1 2024-02-28T16:02:01.539 INFO:tasks.workunit.client.1.smithi087.stdout:4/731: stat d2/d9/da/d1a/cc0 0 2024-02-28T16:02:01.542 INFO:tasks.workunit.client.0.smithi057.stdout:4/280: rmdir d1 39 2024-02-28T16:02:01.544 INFO:tasks.workunit.client.1.smithi087.stdout:8/694: creat d2/d9/d5e/d9c/d9f/fde x:0 0 0 2024-02-28T16:02:01.545 INFO:tasks.workunit.client.0.smithi057.stdout:9/333: rmdir d2/d5/d1b/d2e 39 2024-02-28T16:02:01.546 INFO:tasks.workunit.client.1.smithi087.stdout:0/623: dwrite d4/dd/d37/d39/d3a/f46 [0,4194304] 0 2024-02-28T16:02:01.547 INFO:tasks.workunit.client.0.smithi057.stdout:4/281: write d1/d22/f24 [3668888,89197] 0 2024-02-28T16:02:01.549 INFO:tasks.workunit.client.0.smithi057.stdout:1/295: sync 2024-02-28T16:02:01.549 INFO:tasks.workunit.client.0.smithi057.stdout:6/209: sync 2024-02-28T16:02:01.553 INFO:tasks.workunit.client.0.smithi057.stdout:7/207: dwrite d6/d38/f44 [4194304,4194304] 0 2024-02-28T16:02:01.554 INFO:tasks.workunit.client.1.smithi087.stdout:8/695: write d2/d63/d9b/dae/dca/d6f/f7a [2588554,88544] 0 2024-02-28T16:02:01.554 INFO:tasks.workunit.client.0.smithi057.stdout:1/296: read d1/f8 [1302649,6726] 0 2024-02-28T16:02:01.556 INFO:tasks.workunit.client.1.smithi087.stdout:9/623: dwrite d7/d1e/d44/f92 [0,4194304] 0 2024-02-28T16:02:01.556 INFO:tasks.workunit.client.0.smithi057.stdout:6/210: mkdir df/d10/d13/d44 0 2024-02-28T16:02:01.558 INFO:tasks.workunit.client.1.smithi087.stdout:9/624: chown d7/d1e/d60/d69 18 1 2024-02-28T16:02:01.558 INFO:tasks.workunit.client.0.smithi057.stdout:6/211: readlink l7 0 2024-02-28T16:02:01.563 INFO:tasks.workunit.client.0.smithi057.stdout:6/212: symlink df/l45 0 2024-02-28T16:02:01.568 INFO:tasks.workunit.client.0.smithi057.stdout:1/297: mkdir d1/d3/dc/d40/d5d/d67 0 2024-02-28T16:02:01.568 INFO:tasks.workunit.client.0.smithi057.stdout:4/282: link d1/d10/d12/d15/l38 d1/d3f/l63 0 2024-02-28T16:02:01.573 INFO:tasks.workunit.client.0.smithi057.stdout:6/213: write df/d14/d15/f3c [837307,55743] 0 2024-02-28T16:02:01.573 INFO:tasks.workunit.client.0.smithi057.stdout:9/334: truncate d2/d46/f6b 1422020 0 2024-02-28T16:02:01.578 INFO:tasks.workunit.client.1.smithi087.stdout:9/625: unlink d7/dd/d15/d79/d2e/c72 0 2024-02-28T16:02:01.578 INFO:tasks.workunit.client.1.smithi087.stdout:4/732: dwrite d2/d9/d10/d22/d5b/fcf [0,4194304] 0 2024-02-28T16:02:01.579 INFO:tasks.workunit.client.0.smithi057.stdout:4/283: unlink d1/ff 0 2024-02-28T16:02:01.584 INFO:tasks.workunit.client.1.smithi087.stdout:8/696: dwrite d2/d9/d10/f3a [4194304,4194304] 0 2024-02-28T16:02:01.585 INFO:tasks.workunit.client.0.smithi057.stdout:4/284: mkdir d1/d22/d64 0 2024-02-28T16:02:01.585 INFO:tasks.workunit.client.0.smithi057.stdout:0/422: dread d6/d12/d17/d34/f76 [0,4194304] 0 2024-02-28T16:02:01.586 INFO:tasks.workunit.client.0.smithi057.stdout:7/208: dread d6/d38/f44 [4194304,4194304] 0 2024-02-28T16:02:01.589 INFO:tasks.workunit.client.0.smithi057.stdout:7/209: stat d6/dc/d12/d29/f3e 0 2024-02-28T16:02:01.589 INFO:tasks.workunit.client.0.smithi057.stdout:0/423: creat d6/d12/d17/d4b/d60/f91 x:0 0 0 2024-02-28T16:02:01.594 INFO:tasks.workunit.client.0.smithi057.stdout:0/424: mkdir d6/d12/d17/d92 0 2024-02-28T16:02:01.595 INFO:tasks.workunit.client.0.smithi057.stdout:8/322: sync 2024-02-28T16:02:01.596 INFO:tasks.workunit.client.0.smithi057.stdout:2/252: sync 2024-02-28T16:02:01.596 INFO:tasks.workunit.client.0.smithi057.stdout:3/238: sync 2024-02-28T16:02:01.596 INFO:tasks.workunit.client.0.smithi057.stdout:5/289: sync 2024-02-28T16:02:01.601 INFO:tasks.workunit.client.0.smithi057.stdout:4/285: getdents d1/d10/d31 0 2024-02-28T16:02:01.602 INFO:tasks.workunit.client.1.smithi087.stdout:9/626: write d7/d1e/f24 [174809,92378] 0 2024-02-28T16:02:01.603 INFO:tasks.workunit.client.1.smithi087.stdout:4/733: dwrite d2/d9/d10/d22/d5b/fcf [0,4194304] 0 2024-02-28T16:02:01.606 INFO:tasks.workunit.client.1.smithi087.stdout:4/734: readlink d2/df/l4c 0 2024-02-28T16:02:01.607 INFO:tasks.workunit.client.1.smithi087.stdout:8/697: dwrite d2/d9/f5c [4194304,4194304] 0 2024-02-28T16:02:01.608 INFO:tasks.workunit.client.0.smithi057.stdout:8/323: creat d5/de/d1b/f6f x:0 0 0 2024-02-28T16:02:01.613 INFO:tasks.workunit.client.1.smithi087.stdout:9/627: rename d7/d1e/f5c to d7/dd/d3c/d4c/da1/fb7 0 2024-02-28T16:02:01.613 INFO:tasks.workunit.client.0.smithi057.stdout:9/335: dwrite d2/d24/f14 [0,4194304] 0 2024-02-28T16:02:01.616 INFO:tasks.workunit.client.0.smithi057.stdout:4/286: unlink d1/d10/f27 0 2024-02-28T16:02:01.616 INFO:tasks.workunit.client.0.smithi057.stdout:1/298: dread d1/d3/dc/d15/f17 [0,4194304] 0 2024-02-28T16:02:01.617 INFO:tasks.workunit.client.1.smithi087.stdout:4/735: dread d2/d9/d9e/fba [0,4194304] 0 2024-02-28T16:02:01.619 INFO:tasks.workunit.client.0.smithi057.stdout:8/324: chown d5/de/d1b/f30 11578339 1 2024-02-28T16:02:01.620 INFO:tasks.workunit.client.0.smithi057.stdout:2/253: symlink d19/d43/l49 0 2024-02-28T16:02:01.621 INFO:tasks.workunit.client.1.smithi087.stdout:4/736: mkdir d2/df/d2e/dad/df6 0 2024-02-28T16:02:01.622 INFO:tasks.workunit.client.0.smithi057.stdout:0/425: link d6/d12/d45/d55/f1e d6/d12/d38/f93 0 2024-02-28T16:02:01.623 INFO:tasks.workunit.client.0.smithi057.stdout:4/287: write d1/d10/d12/d2c/f57 [95037,73988] 0 2024-02-28T16:02:01.624 INFO:tasks.workunit.client.0.smithi057.stdout:2/254: chown d19/f1a 0 1 2024-02-28T16:02:01.626 INFO:tasks.workunit.client.1.smithi087.stdout:4/737: write d2/df/d65/fdc [7385443,4274] 0 2024-02-28T16:02:01.626 INFO:tasks.workunit.client.0.smithi057.stdout:0/426: write d6/f19 [2292381,77605] 0 2024-02-28T16:02:01.629 INFO:tasks.workunit.client.1.smithi087.stdout:4/738: chown d2/d9/da/d1a/d26/d69/fa6 368941 1 2024-02-28T16:02:01.631 INFO:tasks.workunit.client.0.smithi057.stdout:3/239: dwrite d8/dd/d14/d2e/d3b/f3e [0,4194304] 0 2024-02-28T16:02:01.632 INFO:tasks.workunit.client.0.smithi057.stdout:3/240: dread - d8/dd/d19/f29 zero size 2024-02-28T16:02:01.632 INFO:tasks.workunit.client.0.smithi057.stdout:1/299: fsync d1/d3/f2a 0 2024-02-28T16:02:01.633 INFO:tasks.workunit.client.1.smithi087.stdout:4/739: mkdir d2/d9/d10/d22/d5b/d5c/df7 0 2024-02-28T16:02:01.638 INFO:tasks.workunit.client.1.smithi087.stdout:4/740: creat d2/d9/da/d1a/ff8 x:0 0 0 2024-02-28T16:02:01.640 INFO:tasks.workunit.client.0.smithi057.stdout:8/325: mkdir d5/de/d63/d70 0 2024-02-28T16:02:01.640 INFO:tasks.workunit.client.1.smithi087.stdout:4/741: creat d2/d9/d10/dbf/dbb/ff9 x:0 0 0 2024-02-28T16:02:01.641 INFO:tasks.workunit.client.0.smithi057.stdout:4/288: readlink d1/d3f/l63 0 2024-02-28T16:02:01.643 INFO:tasks.workunit.client.1.smithi087.stdout:4/742: write d2/d9/da/d1a/d26/d69/de3/f9d [1141345,119965] 0 2024-02-28T16:02:01.645 INFO:tasks.workunit.client.0.smithi057.stdout:2/255: fsync f12 0 2024-02-28T16:02:01.645 INFO:tasks.workunit.client.1.smithi087.stdout:4/743: chown d2/df/d2e/f70 2667873 1 2024-02-28T16:02:01.646 INFO:tasks.workunit.client.0.smithi057.stdout:0/427: mknod d6/d12/d17/d4b/c94 0 2024-02-28T16:02:01.646 INFO:tasks.workunit.client.1.smithi087.stdout:4/744: fsync d2/d9/d10/d22/f72 0 2024-02-28T16:02:01.648 INFO:tasks.workunit.client.1.smithi087.stdout:4/745: dread - d2/d9/d10/d22/d5b/d5c/d68/fc4 zero size 2024-02-28T16:02:01.649 INFO:tasks.workunit.client.0.smithi057.stdout:9/336: unlink d2/d5/d1b/d2e/f5c 0 2024-02-28T16:02:01.649 INFO:tasks.workunit.client.0.smithi057.stdout:6/214: dread df/d10/f36 [0,4194304] 0 2024-02-28T16:02:01.650 INFO:tasks.workunit.client.1.smithi087.stdout:4/746: fdatasync d2/d9/d10/d22/d5b/d5c/fea 0 2024-02-28T16:02:01.653 INFO:tasks.workunit.client.1.smithi087.stdout:4/747: write d2/d9/da/d1a/d26/d69/de3/f9d [837849,71402] 0 2024-02-28T16:02:01.653 INFO:tasks.workunit.client.0.smithi057.stdout:8/326: truncate d5/f43 751133 0 2024-02-28T16:02:01.657 INFO:tasks.workunit.client.1.smithi087.stdout:3/707: sync 2024-02-28T16:02:01.657 INFO:tasks.workunit.client.1.smithi087.stdout:7/612: sync 2024-02-28T16:02:01.657 INFO:tasks.workunit.client.1.smithi087.stdout:2/615: sync 2024-02-28T16:02:01.658 INFO:tasks.workunit.client.0.smithi057.stdout:1/300: dread d1/d3/f47 [0,4194304] 0 2024-02-28T16:02:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:9/337: mkdir d2/d5e/d65/d6e 0 2024-02-28T16:02:01.661 INFO:tasks.workunit.client.1.smithi087.stdout:8/698: dread d2/d9/d10/f12 [4194304,4194304] 0 2024-02-28T16:02:01.661 INFO:tasks.workunit.client.1.smithi087.stdout:7/613: write d14/d2e/d2b/f51 [3319356,58123] 0 2024-02-28T16:02:01.662 INFO:tasks.workunit.client.0.smithi057.stdout:2/256: fsync d19/d2c/f30 0 2024-02-28T16:02:01.664 INFO:tasks.workunit.client.0.smithi057.stdout:2/257: chown d19/d1d 18 1 2024-02-28T16:02:01.667 INFO:tasks.workunit.client.1.smithi087.stdout:2/616: chown d2/d7/la 14808 1 2024-02-28T16:02:01.668 INFO:tasks.workunit.client.0.smithi057.stdout:7/210: dwrite d6/dc/f11 [0,4194304] 0 2024-02-28T16:02:01.669 INFO:tasks.workunit.client.1.smithi087.stdout:3/708: dread d11/d3a/d3c/fc5 [0,4194304] 0 2024-02-28T16:02:01.671 INFO:tasks.workunit.client.0.smithi057.stdout:4/289: getdents d1/d10/d12/d15/d19/d5e 0 2024-02-28T16:02:01.671 INFO:tasks.workunit.client.0.smithi057.stdout:3/241: link d8/dd/d14/d2e/d2f/f35 d8/dd/d14/d2c/f4c 0 2024-02-28T16:02:01.671 INFO:tasks.workunit.client.1.smithi087.stdout:3/709: chown d11/d61/d65/le6 235983 1 2024-02-28T16:02:01.672 INFO:tasks.workunit.client.0.smithi057.stdout:4/290: readlink d1/d14/l4b 0 2024-02-28T16:02:01.673 INFO:tasks.workunit.client.1.smithi087.stdout:7/614: symlink d14/lb6 0 2024-02-28T16:02:01.675 INFO:tasks.workunit.client.1.smithi087.stdout:2/617: fdatasync d2/d99/f5d 0 2024-02-28T16:02:01.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:02:01.677 INFO:tasks.workunit.client.0.smithi057.stdout:6/215: rename df/d14/f24 to df/d14/d15/d16/f46 0 2024-02-28T16:02:01.677 INFO:tasks.workunit.client.1.smithi087.stdout:7/615: chown d14/d2e/d2b/d4e/f93 3139 1 2024-02-28T16:02:01.678 INFO:tasks.workunit.client.0.smithi057.stdout:1/301: rename d1/d3/dc to d1/d3/dc/d40/d68 22 2024-02-28T16:02:01.679 INFO:tasks.workunit.client.0.smithi057.stdout:7/211: chown d6/l9 1588 1 2024-02-28T16:02:01.679 INFO:tasks.workunit.client.0.smithi057.stdout:6/216: chown l1 8401183 1 2024-02-28T16:02:01.680 INFO:tasks.workunit.client.1.smithi087.stdout:8/699: dread d2/d18/d42/dbb/fcc [0,4194304] 0 2024-02-28T16:02:01.680 INFO:tasks.workunit.client.0.smithi057.stdout:9/338: mknod d2/d5/d58/c6f 0 2024-02-28T16:02:01.684 INFO:tasks.workunit.client.1.smithi087.stdout:3/710: rename d11/d45/ded to d11/d33/d58/dee 0 2024-02-28T16:02:01.687 INFO:tasks.workunit.client.1.smithi087.stdout:7/616: mknod d14/d46/d80/cb7 0 2024-02-28T16:02:01.687 INFO:tasks.workunit.client.0.smithi057.stdout:4/291: rename d1/d10/d12/d2c/d37/c4c to d1/d10/d31/d36/c65 0 2024-02-28T16:02:01.688 INFO:tasks.workunit.client.0.smithi057.stdout:0/428: write f0 [2614408,34086] 0 2024-02-28T16:02:01.688 INFO:tasks.workunit.client.1.smithi087.stdout:2/618: symlink d2/d7/d17/le3 0 2024-02-28T16:02:01.691 INFO:tasks.workunit.client.1.smithi087.stdout:8/700: mknod d2/d9/d10/d24/d9d/cdf 0 2024-02-28T16:02:01.691 INFO:tasks.workunit.client.1.smithi087.stdout:2/619: chown d2/d7/d17/d3d/c9e 399215 1 2024-02-28T16:02:01.692 INFO:tasks.workunit.client.0.smithi057.stdout:9/339: dread - d2/d5/d9/f54 zero size 2024-02-28T16:02:01.692 INFO:tasks.workunit.client.1.smithi087.stdout:3/711: symlink d11/d61/d65/lef 0 2024-02-28T16:02:01.693 INFO:tasks.workunit.client.0.smithi057.stdout:7/212: mkdir d6/dc/d12/d1a/d4c 0 2024-02-28T16:02:01.693 INFO:tasks.workunit.client.1.smithi087.stdout:7/617: symlink d14/d27/d55/lb8 0 2024-02-28T16:02:01.693 INFO:tasks.workunit.client.1.smithi087.stdout:4/748: dread d2/d9/fb0 [0,4194304] 0 2024-02-28T16:02:01.694 INFO:tasks.workunit.client.0.smithi057.stdout:8/327: write d5/f41 [60115,9491] 0 2024-02-28T16:02:01.694 INFO:tasks.workunit.client.0.smithi057.stdout:4/292: rmdir d1/d14 39 2024-02-28T16:02:01.695 INFO:tasks.workunit.client.1.smithi087.stdout:7/618: fsync d14/d21/f3e 0 2024-02-28T16:02:01.696 INFO:tasks.workunit.client.1.smithi087.stdout:3/712: mkdir d11/d33/d74/df0 0 2024-02-28T16:02:01.697 INFO:tasks.workunit.client.0.smithi057.stdout:8/328: chown d5/d20/d39/d49/d56/l6b 0 1 2024-02-28T16:02:01.698 INFO:tasks.workunit.client.1.smithi087.stdout:8/701: creat d2/d9/d5e/d9c/fe0 x:0 0 0 2024-02-28T16:02:01.699 INFO:tasks.workunit.client.0.smithi057.stdout:4/293: write d1/d22/f5c [1025066,66214] 0 2024-02-28T16:02:01.699 INFO:tasks.workunit.client.0.smithi057.stdout:0/429: mkdir d6/d12/d17/d58/d95 0 2024-02-28T16:02:01.700 INFO:tasks.workunit.client.1.smithi087.stdout:7/619: dread d14/d2e/d2b/d4e/f52 [0,4194304] 0 2024-02-28T16:02:01.701 INFO:tasks.workunit.client.0.smithi057.stdout:9/340: fdatasync d2/d5/d9/f32 0 2024-02-28T16:02:01.702 INFO:tasks.workunit.client.1.smithi087.stdout:2/620: getdents d2/d7/d17/d97 0 2024-02-28T16:02:01.702 INFO:tasks.workunit.client.0.smithi057.stdout:4/294: chown d1/d22/c58 1415 1 2024-02-28T16:02:01.702 INFO:tasks.workunit.client.1.smithi087.stdout:4/749: getdents d2/df/d65 0 2024-02-28T16:02:01.704 INFO:tasks.workunit.client.1.smithi087.stdout:8/702: symlink d2/d63/d9b/dae/dca/le1 0 2024-02-28T16:02:01.704 INFO:tasks.workunit.client.0.smithi057.stdout:3/242: getdents d8/dd/d19/d2a 0 2024-02-28T16:02:01.705 INFO:tasks.workunit.client.0.smithi057.stdout:7/213: mkdir d6/dc/d12/d1a/d4d 0 2024-02-28T16:02:01.707 INFO:tasks.workunit.client.1.smithi087.stdout:4/750: write d2/d9/d10/d11/fb9 [383537,86067] 0 2024-02-28T16:02:01.710 INFO:tasks.workunit.client.0.smithi057.stdout:6/217: link df/l3e df/d14/d15/d16/d39/l47 0 2024-02-28T16:02:01.711 INFO:tasks.workunit.client.0.smithi057.stdout:8/329: symlink d5/de/d1b/d4b/l71 0 2024-02-28T16:02:01.711 INFO:tasks.workunit.client.0.smithi057.stdout:1/302: creat d1/d3/dc/f69 x:0 0 0 2024-02-28T16:02:01.712 INFO:tasks.workunit.client.1.smithi087.stdout:4/751: chown d2/d9/d10/d22/f8b 62852 1 2024-02-28T16:02:01.713 INFO:tasks.workunit.client.0.smithi057.stdout:1/303: stat d1/d3/f47 0 2024-02-28T16:02:01.715 INFO:tasks.workunit.client.0.smithi057.stdout:3/243: dread d8/dd/d19/d25/f2b [0,4194304] 0 2024-02-28T16:02:01.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:02:01.715 INFO:tasks.workunit.client.1.smithi087.stdout:3/713: dwrite d11/d61/d7c/f84 [0,4194304] 0 2024-02-28T16:02:01.716 INFO:tasks.workunit.client.1.smithi087.stdout:2/621: write d2/d7/fdb [598989,24256] 0 2024-02-28T16:02:01.717 INFO:tasks.workunit.client.1.smithi087.stdout:4/752: creat d2/d9/d10/dbf/dbb/ffa x:0 0 0 2024-02-28T16:02:01.720 INFO:tasks.workunit.client.0.smithi057.stdout:8/330: mkdir d5/d20/d72 0 2024-02-28T16:02:01.720 INFO:tasks.workunit.client.1.smithi087.stdout:7/620: dread d14/d27/d5d/f5e [0,4194304] 0 2024-02-28T16:02:01.720 INFO:tasks.workunit.client.1.smithi087.stdout:3/714: mkdir d11/d44/df1 0 2024-02-28T16:02:01.724 INFO:tasks.workunit.client.1.smithi087.stdout:7/621: mkdir d14/d46/d7c/db9 0 2024-02-28T16:02:01.725 INFO:tasks.workunit.client.0.smithi057.stdout:2/258: dread d19/f1a [0,4194304] 0 2024-02-28T16:02:01.725 INFO:tasks.workunit.client.0.smithi057.stdout:0/430: write d6/d12/d45/d55/f1e [5370495,130275] 0 2024-02-28T16:02:01.726 INFO:tasks.workunit.client.0.smithi057.stdout:3/244: stat d8/dd/d14/d2e/c47 0 2024-02-28T16:02:01.726 INFO:tasks.workunit.client.0.smithi057.stdout:9/341: mkdir d2/d5/d9/d5d/d70 0 2024-02-28T16:02:01.727 INFO:tasks.workunit.client.1.smithi087.stdout:8/703: dwrite d2/d9/d5e/d9c/d9f/fb7 [0,4194304] 0 2024-02-28T16:02:01.728 INFO:tasks.workunit.client.0.smithi057.stdout:8/331: creat d5/de/d1b/d4b/f73 x:0 0 0 2024-02-28T16:02:01.728 INFO:tasks.workunit.client.1.smithi087.stdout:6/703: sync 2024-02-28T16:02:01.728 INFO:tasks.workunit.client.1.smithi087.stdout:1/614: sync 2024-02-28T16:02:01.729 INFO:tasks.workunit.client.1.smithi087.stdout:7/622: fsync d14/d27/d5d/d6a/d94/f9f 0 2024-02-28T16:02:01.734 INFO:tasks.workunit.client.1.smithi087.stdout:6/704: fdatasync d4/d30/d13/d38/fa1 0 2024-02-28T16:02:01.735 INFO:tasks.workunit.client.1.smithi087.stdout:8/704: creat d2/d7c/fe2 x:0 0 0 2024-02-28T16:02:01.736 INFO:tasks.workunit.client.0.smithi057.stdout:1/304: dwrite d1/d21/f63 [0,4194304] 0 2024-02-28T16:02:01.738 INFO:tasks.workunit.client.0.smithi057.stdout:4/295: link d1/d10/d12/c21 d1/d10/d12/d2c/c66 0 2024-02-28T16:02:01.738 INFO:tasks.workunit.client.0.smithi057.stdout:2/259: mknod d19/c4a 0 2024-02-28T16:02:01.738 INFO:tasks.workunit.client.1.smithi087.stdout:1/615: chown d0/d1b/d1f/d71/db2/cc1 33277 1 2024-02-28T16:02:01.739 INFO:tasks.workunit.client.0.smithi057.stdout:6/218: creat df/f48 x:0 0 0 2024-02-28T16:02:01.740 INFO:tasks.workunit.client.0.smithi057.stdout:9/342: creat d2/d5e/d65/f71 x:0 0 0 2024-02-28T16:02:01.742 INFO:tasks.workunit.client.1.smithi087.stdout:8/705: rename d2/f59 to d2/d18/d42/d62/fe3 0 2024-02-28T16:02:01.742 INFO:tasks.workunit.client.1.smithi087.stdout:1/616: chown d0/d1b/d1f/d71/db2/d24/d5c/d69/f7c 932968 1 2024-02-28T16:02:01.745 INFO:tasks.workunit.client.1.smithi087.stdout:2/622: dwrite d2/d99/dc7/fd9 [0,4194304] 0 2024-02-28T16:02:01.747 INFO:tasks.workunit.client.0.smithi057.stdout:8/332: symlink d5/de/d1b/d4b/l74 0 2024-02-28T16:02:01.748 INFO:tasks.workunit.client.1.smithi087.stdout:6/705: unlink d4/d12/d45/d92/dbd/fca 0 2024-02-28T16:02:01.749 INFO:tasks.workunit.client.1.smithi087.stdout:1/617: truncate d0/d1b/d1f/f41 4320911 0 2024-02-28T16:02:01.750 INFO:tasks.workunit.client.1.smithi087.stdout:6/706: fsync d4/dc/f8e 0 2024-02-28T16:02:01.753 INFO:tasks.workunit.client.0.smithi057.stdout:9/343: mknod d2/d5/d9/d40/c72 0 2024-02-28T16:02:01.753 INFO:tasks.workunit.client.0.smithi057.stdout:1/305: creat d1/d3/dc/d40/d5d/d67/f6a x:0 0 0 2024-02-28T16:02:01.753 INFO:tasks.workunit.client.0.smithi057.stdout:4/296: mknod d1/d10/d12/d15/d19/d5e/c67 0 2024-02-28T16:02:01.754 INFO:tasks.workunit.client.1.smithi087.stdout:2/623: mkdir d2/d99/dc7/de2/de4 0 2024-02-28T16:02:01.754 INFO:tasks.workunit.client.0.smithi057.stdout:8/333: unlink d5/d20/d39/d49/l4f 0 2024-02-28T16:02:01.757 INFO:tasks.workunit.client.0.smithi057.stdout:9/344: rmdir d2/d24 39 2024-02-28T16:02:01.757 INFO:tasks.workunit.client.0.smithi057.stdout:4/297: write d1/d14/f34 [1738823,64963] 0 2024-02-28T16:02:01.758 INFO:tasks.workunit.client.0.smithi057.stdout:2/260: getdents d19/d1d/d2e 0 2024-02-28T16:02:01.760 INFO:tasks.workunit.client.1.smithi087.stdout:2/624: chown d2/d7/d17/d34/c45 1896557 1 2024-02-28T16:02:01.763 INFO:tasks.workunit.client.0.smithi057.stdout:8/334: mknod d5/d20/d39/d59/d67/c75 0 2024-02-28T16:02:01.766 INFO:tasks.workunit.client.0.smithi057.stdout:8/335: chown d5/d20/l69 3 1 2024-02-28T16:02:01.766 INFO:tasks.workunit.client.1.smithi087.stdout:4/753: dwrite d2/d9/d9e/f58 [0,4194304] 0 2024-02-28T16:02:01.768 INFO:tasks.workunit.client.1.smithi087.stdout:2/625: rename d2/d7/d17/d34/f51 to d2/d99/d28/fe5 0 2024-02-28T16:02:01.770 INFO:tasks.workunit.client.1.smithi087.stdout:4/754: dread d2/df/d2e/f8e [0,4194304] 0 2024-02-28T16:02:01.771 INFO:tasks.workunit.client.1.smithi087.stdout:3/715: dwrite d11/f13 [0,4194304] 0 2024-02-28T16:02:01.775 INFO:tasks.workunit.client.0.smithi057.stdout:6/219: dwrite df/d10/d13/f3a [0,4194304] 0 2024-02-28T16:02:01.778 INFO:tasks.workunit.client.1.smithi087.stdout:4/755: dread - d2/d9/d10/d22/d5b/d5c/d68/fc4 zero size 2024-02-28T16:02:01.778 INFO:tasks.workunit.client.1.smithi087.stdout:1/618: dwrite d0/d1b/d1f/fa9 [0,4194304] 0 2024-02-28T16:02:01.778 INFO:tasks.workunit.client.0.smithi057.stdout:4/298: rename d1/d10/d12/d39/c3d to d1/d22/d64/c68 0 2024-02-28T16:02:01.780 INFO:tasks.workunit.client.0.smithi057.stdout:9/345: unlink d2/d24/d1d/l27 0 2024-02-28T16:02:01.782 INFO:tasks.workunit.client.1.smithi087.stdout:6/707: dwrite d4/dc/d61/d89/f9d [0,4194304] 0 2024-02-28T16:02:01.783 INFO:tasks.workunit.client.0.smithi057.stdout:2/261: dread f12 [4194304,4194304] 0 2024-02-28T16:02:01.785 INFO:tasks.workunit.client.0.smithi057.stdout:8/336: rename d5/f33 to d5/d62/f76 0 2024-02-28T16:02:01.785 INFO:tasks.workunit.client.1.smithi087.stdout:1/619: chown d0/d1a/d28/c44 24751 1 2024-02-28T16:02:01.788 INFO:tasks.workunit.client.0.smithi057.stdout:9/346: creat d2/d5e/d65/f73 x:0 0 0 2024-02-28T16:02:01.790 INFO:tasks.workunit.client.1.smithi087.stdout:6/708: mkdir d4/d12/d45/d92/de5 0 2024-02-28T16:02:01.790 INFO:tasks.workunit.client.0.smithi057.stdout:9/347: stat d2/d5/d9/l68 0 2024-02-28T16:02:01.793 INFO:tasks.workunit.client.0.smithi057.stdout:6/220: rename df/d14/f30 to df/d14/d15/d16/f49 0 2024-02-28T16:02:01.793 INFO:tasks.workunit.client.1.smithi087.stdout:2/626: dread d2/d42/d4b/f56 [0,4194304] 0 2024-02-28T16:02:01.795 INFO:tasks.workunit.client.0.smithi057.stdout:8/337: symlink d5/d20/d39/d49/l77 0 2024-02-28T16:02:01.795 INFO:tasks.workunit.client.1.smithi087.stdout:3/716: getdents d11/d45/d88/d91/de3 0 2024-02-28T16:02:01.796 INFO:tasks.workunit.client.0.smithi057.stdout:3/245: write d8/dd/d19/f2d [1727625,101333] 0 2024-02-28T16:02:01.798 INFO:tasks.workunit.client.0.smithi057.stdout:8/338: chown d5/d6/c3c 9769751 1 2024-02-28T16:02:01.800 INFO:tasks.workunit.client.1.smithi087.stdout:6/709: creat d4/dc/d10/fe6 x:0 0 0 2024-02-28T16:02:01.801 INFO:tasks.workunit.client.1.smithi087.stdout:8/706: dwrite d2/d18/d25/f21 [0,4194304] 0 2024-02-28T16:02:01.801 INFO:tasks.workunit.client.0.smithi057.stdout:0/431: write d6/d4e/f33 [475965,116524] 0 2024-02-28T16:02:01.801 INFO:tasks.workunit.client.1.smithi087.stdout:2/627: mknod d2/d7/d17/d3d/ce6 0 2024-02-28T16:02:01.801 INFO:tasks.workunit.client.1.smithi087.stdout:3/717: symlink d11/d33/d58/d8c/lf2 0 2024-02-28T16:02:01.803 INFO:tasks.workunit.client.0.smithi057.stdout:2/262: creat d19/d34/f4b x:0 0 0 2024-02-28T16:02:01.804 INFO:tasks.workunit.client.0.smithi057.stdout:2/263: chown f12 32605783 1 2024-02-28T16:02:01.804 INFO:tasks.workunit.client.1.smithi087.stdout:8/707: fdatasync d2/d9/d1a/d67/f94 0 2024-02-28T16:02:01.804 INFO:tasks.workunit.client.1.smithi087.stdout:1/620: rename d0/d1b/d1f/d71/db2/d24/d5c/fba to d0/d1b/d43/d4d/fd0 0 2024-02-28T16:02:01.806 INFO:tasks.workunit.client.1.smithi087.stdout:6/710: mkdir d4/d30/d42/de7 0 2024-02-28T16:02:01.810 INFO:tasks.workunit.client.1.smithi087.stdout:1/621: chown d0/d1b/d43/l6d 125878107 1 2024-02-28T16:02:01.810 INFO:tasks.workunit.client.0.smithi057.stdout:8/339: creat d5/de/d1b/d57/f78 x:0 0 0 2024-02-28T16:02:01.814 INFO:tasks.workunit.client.0.smithi057.stdout:0/432: fsync d6/d12/d45/d55/f54 0 2024-02-28T16:02:01.819 INFO:tasks.workunit.client.0.smithi057.stdout:0/433: write d6/d12/d17/d34/f8a [139611,84373] 0 2024-02-28T16:02:01.821 INFO:tasks.workunit.client.0.smithi057.stdout:3/246: unlink d8/dd/d19/c22 0 2024-02-28T16:02:01.822 INFO:tasks.workunit.client.1.smithi087.stdout:6/711: symlink d4/d30/d13/le8 0 2024-02-28T16:02:01.824 INFO:tasks.workunit.client.0.smithi057.stdout:8/340: mkdir d5/d20/d39/d49/d56/d79 0 2024-02-28T16:02:01.828 INFO:tasks.workunit.client.1.smithi087.stdout:3/718: rmdir d11/d33 39 2024-02-28T16:02:01.828 INFO:tasks.workunit.client.1.smithi087.stdout:2/628: dwrite d2/d7/d17/f33 [0,4194304] 0 2024-02-28T16:02:01.829 INFO:tasks.workunit.client.1.smithi087.stdout:8/708: dread d2/d18/d25/f21 [0,4194304] 0 2024-02-28T16:02:01.830 INFO:tasks.workunit.client.0.smithi057.stdout:3/247: dread - d8/dd/d14/d2e/d2f/f45 zero size 2024-02-28T16:02:01.831 INFO:tasks.workunit.client.1.smithi087.stdout:6/712: truncate d4/d30/d13/d38/f47 3362697 0 2024-02-28T16:02:01.832 INFO:tasks.workunit.client.1.smithi087.stdout:2/629: creat d2/d99/fe7 x:0 0 0 2024-02-28T16:02:01.833 INFO:tasks.workunit.client.0.smithi057.stdout:1/306: dwrite d1/f34 [0,4194304] 0 2024-02-28T16:02:01.834 INFO:tasks.workunit.client.1.smithi087.stdout:4/756: dwrite d2/d9/d10/d22/fef [0,4194304] 0 2024-02-28T16:02:01.837 INFO:tasks.workunit.client.0.smithi057.stdout:0/434: unlink d6/c2d 0 2024-02-28T16:02:01.837 INFO:tasks.workunit.client.0.smithi057.stdout:2/264: dread d19/d1d/d2e/d31/f40 [0,4194304] 0 2024-02-28T16:02:01.837 INFO:tasks.workunit.client.1.smithi087.stdout:4/757: write d2/d49/fd5 [675826,59490] 0 2024-02-28T16:02:01.838 INFO:tasks.workunit.client.1.smithi087.stdout:6/713: chown d4/d30/d13/d67/cbf 0 1 2024-02-28T16:02:01.840 INFO:tasks.workunit.client.1.smithi087.stdout:2/630: mknod d2/d7/d17/d3d/d81/ce8 0 2024-02-28T16:02:01.841 INFO:tasks.workunit.client.1.smithi087.stdout:8/709: creat d2/d9/d5e/d9c/fe4 x:0 0 0 2024-02-28T16:02:01.842 INFO:tasks.workunit.client.0.smithi057.stdout:9/348: link d2/d24/l18 d2/d5/d1b/l74 0 2024-02-28T16:02:01.845 INFO:tasks.workunit.client.0.smithi057.stdout:4/299: truncate d1/d14/f34 2796023 0 2024-02-28T16:02:01.847 INFO:tasks.workunit.client.1.smithi087.stdout:3/719: rename d11/d61/c9a to d11/d33/d67/d9c/cf3 0 2024-02-28T16:02:01.848 INFO:tasks.workunit.client.1.smithi087.stdout:4/758: rmdir d2/d9/da/d1a 39 2024-02-28T16:02:01.848 INFO:tasks.workunit.client.0.smithi057.stdout:0/435: symlink d6/d12/d17/d4b/d60/l96 0 2024-02-28T16:02:01.849 INFO:tasks.workunit.client.0.smithi057.stdout:2/265: symlink d19/d1d/d26/l4c 0 2024-02-28T16:02:01.849 INFO:tasks.workunit.client.0.smithi057.stdout:8/341: link d5/d62/f76 d5/de/d1b/d4b/f7a 0 2024-02-28T16:02:01.850 INFO:tasks.workunit.client.1.smithi087.stdout:6/714: mkdir d4/d12/d45/d92/dc1/de9 0 2024-02-28T16:02:01.850 INFO:tasks.workunit.client.0.smithi057.stdout:9/349: read d2/f3a [724738,95352] 0 2024-02-28T16:02:01.850 INFO:tasks.workunit.client.1.smithi087.stdout:1/622: write d0/d1b/d1f/d71/db2/d24/d5c/d69/f7c [1104065,22053] 0 2024-02-28T16:02:01.854 INFO:tasks.workunit.client.1.smithi087.stdout:1/623: write d0/d1b/d43/d4d/f51 [7171526,37756] 0 2024-02-28T16:02:01.855 INFO:tasks.workunit.client.0.smithi057.stdout:0/436: chown d6/d12/d5d/d7f 5 1 2024-02-28T16:02:01.855 INFO:tasks.workunit.client.0.smithi057.stdout:6/221: write df/d14/d15/d16/f46 [1693688,70142] 0 2024-02-28T16:02:01.855 INFO:tasks.workunit.client.0.smithi057.stdout:4/300: chown d1/d10/d12/d15/l1c 454922727 1 2024-02-28T16:02:01.859 INFO:tasks.workunit.client.0.smithi057.stdout:6/222: stat df/d14/d15/c2a 0 2024-02-28T16:02:01.859 INFO:tasks.workunit.client.0.smithi057.stdout:1/307: link d1/f8 d1/d21/d66/d44/d4c/f6b 0 2024-02-28T16:02:01.862 INFO:tasks.workunit.client.1.smithi087.stdout:3/720: write d11/d44/d5b/f78 [979980,7228] 0 2024-02-28T16:02:01.864 INFO:tasks.workunit.client.0.smithi057.stdout:4/301: write d1/d10/d31/d36/f47 [2186259,97745] 0 2024-02-28T16:02:01.864 INFO:tasks.workunit.client.1.smithi087.stdout:4/759: rmdir d2/d49 39 2024-02-28T16:02:01.865 INFO:tasks.workunit.client.0.smithi057.stdout:3/248: dwrite d8/dd/d14/d2e/d30/f40 [0,4194304] 0 2024-02-28T16:02:01.866 INFO:tasks.workunit.client.0.smithi057.stdout:3/249: truncate d8/f18 2440007 0 2024-02-28T16:02:01.870 INFO:tasks.workunit.client.1.smithi087.stdout:6/715: creat d4/d12/d45/d74/d9a/fea x:0 0 0 2024-02-28T16:02:01.872 INFO:tasks.workunit.client.0.smithi057.stdout:8/342: symlink d5/d20/l7b 0 2024-02-28T16:02:01.873 INFO:tasks.workunit.client.1.smithi087.stdout:3/721: dread d11/d33/d67/d9c/fb1 [0,4194304] 0 2024-02-28T16:02:01.873 INFO:tasks.workunit.client.1.smithi087.stdout:8/710: dwrite d2/d9/d10/f12 [4194304,4194304] 0 2024-02-28T16:02:01.874 INFO:tasks.workunit.client.1.smithi087.stdout:3/722: chown d11/d33/f66 64 1 2024-02-28T16:02:01.875 INFO:tasks.workunit.client.1.smithi087.stdout:1/624: mknod d0/d14/d48/cd1 0 2024-02-28T16:02:01.877 INFO:tasks.workunit.client.1.smithi087.stdout:4/760: mknod d2/d9/d10/d22/db3/cfb 0 2024-02-28T16:02:01.879 INFO:tasks.workunit.client.0.smithi057.stdout:8/343: dread d5/de/f4a [0,4194304] 0 2024-02-28T16:02:01.879 INFO:tasks.workunit.client.0.smithi057.stdout:1/308: write d1/d3/f11 [5227098,40220] 0 2024-02-28T16:02:01.879 INFO:tasks.workunit.client.1.smithi087.stdout:8/711: rmdir d2/da2 39 2024-02-28T16:02:01.880 INFO:tasks.workunit.client.1.smithi087.stdout:1/625: write d0/d1b/d1f/d71/db2/db3/fcb [967713,32853] 0 2024-02-28T16:02:01.881 INFO:tasks.workunit.client.1.smithi087.stdout:1/626: dread - d0/d14/d86/f89 zero size 2024-02-28T16:02:01.883 INFO:tasks.workunit.client.1.smithi087.stdout:8/712: truncate d2/d63/d9b/fcf 833433 0 2024-02-28T16:02:01.883 INFO:tasks.workunit.client.0.smithi057.stdout:6/223: creat df/d14/d15/d16/f4a x:0 0 0 2024-02-28T16:02:01.886 INFO:tasks.workunit.client.1.smithi087.stdout:9/628: sync 2024-02-28T16:02:01.886 INFO:tasks.workunit.client.1.smithi087.stdout:0/624: sync 2024-02-28T16:02:01.886 INFO:tasks.workunit.client.1.smithi087.stdout:5/765: sync 2024-02-28T16:02:01.888 INFO:tasks.workunit.client.0.smithi057.stdout:1/309: mkdir d1/d3/dc/d40/d5d/d67/d6c 0 2024-02-28T16:02:01.888 INFO:tasks.workunit.client.0.smithi057.stdout:9/350: getdents d2/d5/d58 0 2024-02-28T16:02:01.888 INFO:tasks.workunit.client.1.smithi087.stdout:8/713: write d2/d63/d9b/dae/dca/d6f/f74 [109054,19264] 0 2024-02-28T16:02:01.889 INFO:tasks.workunit.client.0.smithi057.stdout:6/224: mkdir df/d10/d13/d4b 0 2024-02-28T16:02:01.890 INFO:tasks.workunit.client.1.smithi087.stdout:4/761: unlink d2/d9/d9e/f58 0 2024-02-28T16:02:01.891 INFO:tasks.workunit.client.0.smithi057.stdout:1/310: symlink d1/d21/d66/d53/l6d 0 2024-02-28T16:02:01.894 INFO:tasks.workunit.client.1.smithi087.stdout:1/627: symlink d0/d1b/d1f/d71/db2/d24/d5c/d69/ld2 0 2024-02-28T16:02:01.896 INFO:tasks.workunit.client.0.smithi057.stdout:9/351: creat d2/f75 x:0 0 0 2024-02-28T16:02:01.896 INFO:tasks.workunit.client.0.smithi057.stdout:1/311: read d1/d21/d66/f2f [400042,106521] 0 2024-02-28T16:02:01.900 INFO:tasks.workunit.client.1.smithi087.stdout:0/625: creat d4/dd/d37/fcb x:0 0 0 2024-02-28T16:02:01.901 INFO:tasks.workunit.client.1.smithi087.stdout:2/631: dwrite d2/d7/d17/d97/fa0 [0,4194304] 0 2024-02-28T16:02:01.904 INFO:tasks.workunit.client.1.smithi087.stdout:5/766: mkdir d3/d9/d9b/de9/d11c 0 2024-02-28T16:02:01.905 INFO:tasks.workunit.client.1.smithi087.stdout:2/632: write d2/d7/d17/d97/fa0 [1380878,108012] 0 2024-02-28T16:02:01.908 INFO:tasks.workunit.client.1.smithi087.stdout:3/723: link d11/d33/d58/cc7 d11/d61/d7c/cf4 0 2024-02-28T16:02:01.908 INFO:tasks.workunit.client.1.smithi087.stdout:1/628: mknod d0/d1b/d1f/d71/db2/d24/cd3 0 2024-02-28T16:02:01.911 INFO:tasks.workunit.client.1.smithi087.stdout:1/629: write d0/d1b/f47 [1351234,49931] 0 2024-02-28T16:02:01.913 INFO:tasks.workunit.client.1.smithi087.stdout:6/716: getdents d4/dc/d10 0 2024-02-28T16:02:01.914 INFO:tasks.workunit.client.0.smithi057.stdout:2/266: truncate d19/f37 2961262 0 2024-02-28T16:02:01.915 INFO:tasks.workunit.client.1.smithi087.stdout:8/714: mkdir d2/d63/d9b/dd5/dd9/de5 0 2024-02-28T16:02:01.915 INFO:tasks.workunit.client.1.smithi087.stdout:7/623: sync 2024-02-28T16:02:01.916 INFO:tasks.workunit.client.1.smithi087.stdout:0/626: write d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/fa9 [1878833,16058] 0 2024-02-28T16:02:01.918 INFO:tasks.workunit.client.0.smithi057.stdout:2/267: write d19/d34/f4b [717971,29832] 0 2024-02-28T16:02:01.918 INFO:tasks.workunit.client.1.smithi087.stdout:4/762: creat d2/d9/da/d1a/d26/d69/ffc x:0 0 0 2024-02-28T16:02:01.920 INFO:tasks.workunit.client.1.smithi087.stdout:4/763: write d2/df/d65/fdc [4393536,35415] 0 2024-02-28T16:02:01.920 INFO:tasks.workunit.client.1.smithi087.stdout:2/633: symlink d2/d99/dc7/de2/le9 0 2024-02-28T16:02:01.922 INFO:tasks.workunit.client.1.smithi087.stdout:0/627: write d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f8e [175903,93445] 0 2024-02-28T16:02:01.922 INFO:tasks.workunit.client.1.smithi087.stdout:4/764: stat d2/d9/d10/d22/d5b/d5c/la8 0 2024-02-28T16:02:01.924 INFO:tasks.workunit.client.1.smithi087.stdout:4/765: dread - d2/df/d2e/fcd zero size 2024-02-28T16:02:01.926 INFO:tasks.workunit.client.0.smithi057.stdout:1/312: dwrite d1/f45 [0,4194304] 0 2024-02-28T16:02:01.927 INFO:tasks.workunit.client.1.smithi087.stdout:1/630: mkdir d0/d1b/d1f/dd4 0 2024-02-28T16:02:01.927 INFO:tasks.workunit.client.0.smithi057.stdout:3/250: symlink d8/dd/d14/d2e/l4d 0 2024-02-28T16:02:01.928 INFO:tasks.workunit.client.0.smithi057.stdout:6/225: dread df/d14/d15/f25 [0,4194304] 0 2024-02-28T16:02:01.931 INFO:tasks.workunit.client.0.smithi057.stdout:6/226: stat df/d10/l1d 0 2024-02-28T16:02:01.933 INFO:tasks.workunit.client.1.smithi087.stdout:8/715: dwrite d2/d9/d8e/faf [0,4194304] 0 2024-02-28T16:02:01.934 INFO:tasks.workunit.client.0.smithi057.stdout:3/251: mknod d8/dd/d14/d2e/d3b/c4e 0 2024-02-28T16:02:01.934 INFO:tasks.workunit.client.0.smithi057.stdout:6/227: chown df/d10/d13/f1e 77164 1 2024-02-28T16:02:01.934 INFO:tasks.workunit.client.0.smithi057.stdout:0/437: dwrite d6/d12/d38/f52 [4194304,4194304] 0 2024-02-28T16:02:01.935 INFO:tasks.workunit.client.0.smithi057.stdout:9/352: write d2/d5/d9/f6a [1004712,8533] 0 2024-02-28T16:02:01.935 INFO:tasks.workunit.client.0.smithi057.stdout:3/252: readlink d8/dd/l3a 0 2024-02-28T16:02:01.936 INFO:tasks.workunit.client.0.smithi057.stdout:1/313: rename d1/d3/dc/c3f to d1/d21/d66/d53/c6e 0 2024-02-28T16:02:01.937 INFO:tasks.workunit.client.0.smithi057.stdout:0/438: write d6/f2f [1470178,109928] 0 2024-02-28T16:02:01.937 INFO:tasks.workunit.client.0.smithi057.stdout:6/228: chown df/d14/d15/d16/f4a 33739861 1 2024-02-28T16:02:01.938 INFO:tasks.workunit.client.0.smithi057.stdout:3/253: mknod d8/d26/c4f 0 2024-02-28T16:02:01.939 INFO:tasks.workunit.client.0.smithi057.stdout:9/353: dread - d2/d5e/d65/f73 zero size 2024-02-28T16:02:01.940 INFO:tasks.workunit.client.1.smithi087.stdout:0/628: write d4/d6/dc/fc9 [820593,116162] 0 2024-02-28T16:02:01.941 INFO:tasks.workunit.client.0.smithi057.stdout:2/268: write d19/d2c/f30 [1336319,852] 0 2024-02-28T16:02:01.941 INFO:tasks.workunit.client.1.smithi087.stdout:4/766: symlink d2/d9/d10/dbf/dbb/lfd 0 2024-02-28T16:02:01.943 INFO:tasks.workunit.client.0.smithi057.stdout:3/254: chown d8/dd/d19/f2d 32810274 1 2024-02-28T16:02:01.943 INFO:tasks.workunit.client.0.smithi057.stdout:1/314: write d1/d3/f3b [76895,65019] 0 2024-02-28T16:02:01.943 INFO:tasks.workunit.client.0.smithi057.stdout:6/229: creat df/d14/d15/d16/f4c x:0 0 0 2024-02-28T16:02:01.945 INFO:tasks.workunit.client.1.smithi087.stdout:9/629: dwrite d7/dd/d15/d3f/d5f/f8f [0,4194304] 0 2024-02-28T16:02:01.947 INFO:tasks.workunit.client.0.smithi057.stdout:9/354: truncate d2/f20 4499513 0 2024-02-28T16:02:01.947 INFO:tasks.workunit.client.0.smithi057.stdout:3/255: write d8/dd/d14/d2e/d30/f3f [757835,101771] 0 2024-02-28T16:02:01.948 INFO:tasks.workunit.client.0.smithi057.stdout:9/355: chown d2/d24/d1d/f23 1031062808 1 2024-02-28T16:02:01.949 INFO:tasks.workunit.client.0.smithi057.stdout:2/269: symlink d19/d3a/l4d 0 2024-02-28T16:02:01.949 INFO:tasks.workunit.client.1.smithi087.stdout:7/624: symlink d14/d27/d5d/dac/lba 0 2024-02-28T16:02:01.950 INFO:tasks.workunit.client.1.smithi087.stdout:9/630: read d7/dc/f59 [1015943,80751] 0 2024-02-28T16:02:01.951 INFO:tasks.workunit.client.1.smithi087.stdout:3/724: creat d11/d33/ff5 x:0 0 0 2024-02-28T16:02:01.952 INFO:tasks.workunit.client.1.smithi087.stdout:4/767: rmdir d2/d9/da/d1a 39 2024-02-28T16:02:01.953 INFO:tasks.workunit.client.1.smithi087.stdout:0/629: creat d4/dd/d37/d39/d3a/fcc x:0 0 0 2024-02-28T16:02:01.954 INFO:tasks.workunit.client.0.smithi057.stdout:1/315: rmdir d1/d3/dc/d40/d5d/d65 39 2024-02-28T16:02:01.954 INFO:tasks.workunit.client.1.smithi087.stdout:1/631: unlink d0/d1b/d1f/d71/dad/cc8 0 2024-02-28T16:02:01.954 INFO:tasks.workunit.client.1.smithi087.stdout:9/631: dread - d7/dd/d15/f93 zero size 2024-02-28T16:02:01.957 INFO:tasks.workunit.client.1.smithi087.stdout:8/716: dwrite d2/d63/f97 [0,4194304] 0 2024-02-28T16:02:01.957 INFO:tasks.workunit.client.0.smithi057.stdout:9/356: fdatasync d2/d5/d9/f6a 0 2024-02-28T16:02:01.959 INFO:tasks.workunit.client.1.smithi087.stdout:7/625: mkdir d14/d2e/d89/dbb 0 2024-02-28T16:02:01.960 INFO:tasks.workunit.client.1.smithi087.stdout:3/725: write d11/d61/d65/fd8 [3837944,128736] 0 2024-02-28T16:02:01.960 INFO:tasks.workunit.client.1.smithi087.stdout:9/632: fdatasync d7/dd/d3c/d4c/f8c 0 2024-02-28T16:02:01.961 INFO:tasks.workunit.client.0.smithi057.stdout:2/270: unlink d19/d34/c38 0 2024-02-28T16:02:01.968 INFO:tasks.workunit.client.0.smithi057.stdout:6/230: rmdir df/d10/d13/d44 0 2024-02-28T16:02:01.968 INFO:tasks.workunit.client.0.smithi057.stdout:0/439: dwrite d6/d12/d17/f59 [0,4194304] 0 2024-02-28T16:02:01.968 INFO:tasks.workunit.client.0.smithi057.stdout:6/231: stat df/d14 0 2024-02-28T16:02:01.968 INFO:tasks.workunit.client.1.smithi087.stdout:3/726: write d11/d33/d67/d98/daf/fd5 [618404,43055] 0 2024-02-28T16:02:01.968 INFO:tasks.workunit.client.1.smithi087.stdout:6/717: creat d4/d12/d45/d5e/feb x:0 0 0 2024-02-28T16:02:01.971 INFO:tasks.workunit.client.0.smithi057.stdout:0/440: creat d6/d12/d45/d55/f97 x:0 0 0 2024-02-28T16:02:01.973 INFO:tasks.workunit.client.1.smithi087.stdout:0/630: mknod d4/dd/d21/d32/ccd 0 2024-02-28T16:02:01.974 INFO:tasks.workunit.client.0.smithi057.stdout:0/441: chown d6/d12/d17/d4b/f36 55602 1 2024-02-28T16:02:01.974 INFO:tasks.workunit.client.0.smithi057.stdout:2/271: link c16 d19/d43/c4e 0 2024-02-28T16:02:01.978 INFO:tasks.workunit.client.1.smithi087.stdout:2/634: getdents d2/d99/d28/d54/da6/dd7 0 2024-02-28T16:02:01.979 INFO:tasks.workunit.client.1.smithi087.stdout:0/631: creat d4/dd/d21/fce x:0 0 0 2024-02-28T16:02:01.980 INFO:tasks.workunit.client.0.smithi057.stdout:1/316: dwrite d1/f45 [0,4194304] 0 2024-02-28T16:02:01.980 INFO:tasks.workunit.client.0.smithi057.stdout:0/442: creat d6/d12/d17/d34/f98 x:0 0 0 2024-02-28T16:02:01.982 INFO:tasks.workunit.client.1.smithi087.stdout:8/717: truncate d2/d18/d42/f43 3579876 0 2024-02-28T16:02:01.982 INFO:tasks.workunit.client.0.smithi057.stdout:3/256: truncate d8/f15 723778 0 2024-02-28T16:02:01.983 INFO:tasks.workunit.client.1.smithi087.stdout:0/632: chown d4/dd/d37/d39/d3a/d57/d74 365 1 2024-02-28T16:02:01.984 INFO:tasks.workunit.client.1.smithi087.stdout:2/635: symlink d2/d99/dc7/lea 0 2024-02-28T16:02:01.984 INFO:tasks.workunit.client.0.smithi057.stdout:0/443: unlink d6/d12/c3a 0 2024-02-28T16:02:01.985 INFO:tasks.workunit.client.0.smithi057.stdout:3/257: stat d8/dd/d14/d2e/d2f/f42 0 2024-02-28T16:02:01.986 INFO:tasks.workunit.client.1.smithi087.stdout:7/626: dwrite d14/d46/f4c [0,4194304] 0 2024-02-28T16:02:01.989 INFO:tasks.workunit.client.1.smithi087.stdout:0/633: creat d4/d6/dc/fcf x:0 0 0 2024-02-28T16:02:01.990 INFO:tasks.workunit.client.0.smithi057.stdout:2/272: dread f12 [0,4194304] 0 2024-02-28T16:02:01.994 INFO:tasks.workunit.client.0.smithi057.stdout:1/317: mkdir d1/d21/d66/d53/d62/d6f 0 2024-02-28T16:02:01.997 INFO:tasks.workunit.client.0.smithi057.stdout:1/318: write d1/d3/f3b [139472,117597] 0 2024-02-28T16:02:02.000 INFO:tasks.workunit.client.0.smithi057.stdout:2/273: chown d19/d1d/d26/l33 127938105 1 2024-02-28T16:02:02.003 INFO:tasks.workunit.client.0.smithi057.stdout:1/319: read d1/d3/dc/d15/f17 [1597626,17525] 0 2024-02-28T16:02:02.004 INFO:tasks.workunit.client.1.smithi087.stdout:0/634: symlink d4/dd/d37/ld0 0 2024-02-28T16:02:02.006 INFO:tasks.workunit.client.0.smithi057.stdout:3/258: rename d8/d26/f37 to d8/dd/d14/f50 0 2024-02-28T16:02:02.006 INFO:tasks.workunit.client.1.smithi087.stdout:1/632: truncate d0/d1b/d1f/d71/db2/db3/fcb 130248 0 2024-02-28T16:02:02.006 INFO:tasks.workunit.client.1.smithi087.stdout:2/636: creat d2/d7/d17/d34/feb x:0 0 0 2024-02-28T16:02:02.007 INFO:tasks.workunit.client.1.smithi087.stdout:4/768: dwrite d2/df/d65/d8d/fa4 [0,4194304] 0 2024-02-28T16:02:02.009 INFO:tasks.workunit.client.0.smithi057.stdout:9/357: dwrite d2/d46/f6b [0,4194304] 0 2024-02-28T16:02:02.010 INFO:tasks.workunit.client.0.smithi057.stdout:0/444: write d6/d12/d45/f4f [4074954,66379] 0 2024-02-28T16:02:02.014 INFO:tasks.workunit.client.1.smithi087.stdout:8/718: rename d2/d9/d1a to d2/d33/de6 0 2024-02-28T16:02:02.019 INFO:tasks.workunit.client.1.smithi087.stdout:8/719: dread - d2/d7c/fb9 zero size 2024-02-28T16:02:02.019 INFO:tasks.workunit.client.1.smithi087.stdout:0/635: mkdir d4/dd/d21/d52/dd1 0 2024-02-28T16:02:02.019 INFO:tasks.workunit.client.1.smithi087.stdout:1/633: mkdir d0/d14/d3f/dd5 0 2024-02-28T16:02:02.019 INFO:tasks.workunit.client.1.smithi087.stdout:7/627: dread d14/d27/d5d/d6a/d83/f7a [4194304,4194304] 0 2024-02-28T16:02:02.020 INFO:tasks.workunit.client.0.smithi057.stdout:3/259: mkdir d8/dd/d14/d2e/d30/d49/d51 0 2024-02-28T16:02:02.021 INFO:tasks.workunit.client.0.smithi057.stdout:9/358: unlink d2/d5/d1b/l74 0 2024-02-28T16:02:02.023 INFO:tasks.workunit.client.0.smithi057.stdout:3/260: chown d8/dd/d14/d2e/d3b/f3e 63191 1 2024-02-28T16:02:02.023 INFO:tasks.workunit.client.1.smithi087.stdout:0/636: chown d4/dd/d21/f71 126 1 2024-02-28T16:02:02.024 INFO:tasks.workunit.client.1.smithi087.stdout:7/628: symlink d14/d21/lbc 0 2024-02-28T16:02:02.025 INFO:tasks.workunit.client.0.smithi057.stdout:1/320: rename d1/d21/d25/l28 to d1/d3/dc/l70 0 2024-02-28T16:02:02.028 INFO:tasks.workunit.client.1.smithi087.stdout:3/727: dread d11/f15 [0,4194304] 0 2024-02-28T16:02:02.028 INFO:tasks.workunit.client.1.smithi087.stdout:1/634: rmdir d0/d1b/d1f/d71/db2/d24/d5c/d69 39 2024-02-28T16:02:02.031 INFO:tasks.workunit.client.1.smithi087.stdout:2/637: rename d2/d7/d17/d3d/d60 to d2/d7/dec 0 2024-02-28T16:02:02.032 INFO:tasks.workunit.client.1.smithi087.stdout:0/637: unlink d4/d6/dc/l3c 0 2024-02-28T16:02:02.034 INFO:tasks.workunit.client.1.smithi087.stdout:7/629: mkdir d14/d2e/d89/dbd 0 2024-02-28T16:02:02.039 INFO:tasks.workunit.client.1.smithi087.stdout:5/767: sync 2024-02-28T16:02:02.042 INFO:tasks.workunit.client.0.smithi057.stdout:3/261: getdents d8/dd/d14/d2e/d3b 0 2024-02-28T16:02:02.043 INFO:tasks.workunit.client.1.smithi087.stdout:6/718: dread d4/d12/d45/d74/d9a/fb2 [0,4194304] 0 2024-02-28T16:02:02.044 INFO:tasks.workunit.client.1.smithi087.stdout:3/728: rmdir d11/d33/d67/d98/d9b 39 2024-02-28T16:02:02.046 INFO:tasks.workunit.client.1.smithi087.stdout:7/630: creat d14/d27/d5d/d6a/fbe x:0 0 0 2024-02-28T16:02:02.047 INFO:tasks.workunit.client.0.smithi057.stdout:3/262: mknod d8/c52 0 2024-02-28T16:02:02.049 INFO:tasks.workunit.client.1.smithi087.stdout:3/729: fsync d11/f2f 0 2024-02-28T16:02:02.049 INFO:tasks.workunit.client.0.smithi057.stdout:0/445: dwrite d6/d12/d45/d55/f6d [0,4194304] 0 2024-02-28T16:02:02.050 INFO:tasks.workunit.client.1.smithi087.stdout:8/720: dwrite d2/d18/d42/dbb/fcc [0,4194304] 0 2024-02-28T16:02:02.051 INFO:tasks.workunit.client.0.smithi057.stdout:1/321: dread d1/d3/dc/d15/f17 [0,4194304] 0 2024-02-28T16:02:02.053 INFO:tasks.workunit.client.1.smithi087.stdout:7/631: truncate d14/d27/f3f 1028855 0 2024-02-28T16:02:02.056 INFO:tasks.workunit.client.0.smithi057.stdout:1/322: symlink d1/d3/l71 0 2024-02-28T16:02:02.058 INFO:tasks.workunit.client.1.smithi087.stdout:9/633: dread d7/dd/d36/f3d [0,4194304] 0 2024-02-28T16:02:02.060 INFO:tasks.workunit.client.0.smithi057.stdout:1/323: symlink d1/d3/dc/d15/l72 0 2024-02-28T16:02:02.062 INFO:tasks.workunit.client.1.smithi087.stdout:1/635: getdents d0/d14/d48/da7 0 2024-02-28T16:02:02.063 INFO:tasks.workunit.client.0.smithi057.stdout:1/324: truncate d1/d3/dc/f69 1037899 0 2024-02-28T16:02:02.064 INFO:tasks.workunit.client.1.smithi087.stdout:0/638: rename d4/dd/d21/c2f to d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d76/cd2 0 2024-02-28T16:02:02.067 INFO:tasks.workunit.client.0.smithi057.stdout:0/446: rename d6/d12/d45/d55/f50 to d6/f99 0 2024-02-28T16:02:02.069 INFO:tasks.workunit.client.0.smithi057.stdout:0/447: chown d6/d12/d38/l4c 1 1 2024-02-28T16:02:02.071 INFO:tasks.workunit.client.1.smithi087.stdout:8/721: mknod d2/d18/d25/ce7 0 2024-02-28T16:02:02.072 INFO:tasks.workunit.client.1.smithi087.stdout:5/768: dwrite d3/d64/d67/f76 [0,4194304] 0 2024-02-28T16:02:02.073 INFO:tasks.workunit.client.0.smithi057.stdout:2/274: truncate d19/d1d/d2e/d31/f40 4133450 0 2024-02-28T16:02:02.077 INFO:tasks.workunit.client.1.smithi087.stdout:8/722: read d2/d33/de6/f2e [4052151,99474] 0 2024-02-28T16:02:02.077 INFO:tasks.workunit.client.1.smithi087.stdout:9/634: creat d7/dd/d3c/d4c/da1/fb8 x:0 0 0 2024-02-28T16:02:02.078 INFO:tasks.workunit.client.1.smithi087.stdout:1/636: creat d0/d1a/d28/d9b/fd6 x:0 0 0 2024-02-28T16:02:02.085 INFO:tasks.workunit.client.1.smithi087.stdout:7/632: dread d14/d46/f4c [0,4194304] 0 2024-02-28T16:02:02.089 INFO:tasks.workunit.client.1.smithi087.stdout:9/635: write d7/dd/fe [10307238,11753] 0 2024-02-28T16:02:02.090 INFO:tasks.workunit.client.0.smithi057.stdout:0/448: dwrite d6/d12/d45/f8e [0,4194304] 0 2024-02-28T16:02:02.093 INFO:tasks.workunit.client.1.smithi087.stdout:8/723: mkdir d2/d18/d42/d62/de8 0 2024-02-28T16:02:02.096 INFO:tasks.workunit.client.1.smithi087.stdout:9/636: fdatasync d7/d1e/d44/fb2 0 2024-02-28T16:02:02.097 INFO:tasks.workunit.client.1.smithi087.stdout:1/637: mkdir d0/d1b/dd7 0 2024-02-28T16:02:02.097 INFO:tasks.workunit.client.1.smithi087.stdout:4/769: dread d2/d9/d10/d22/d5b/d5c/d91/da9/fca [0,4194304] 0 2024-02-28T16:02:02.101 INFO:tasks.workunit.client.1.smithi087.stdout:6/719: dwrite d4/dc/d10/f2b [0,4194304] 0 2024-02-28T16:02:02.102 INFO:tasks.workunit.client.1.smithi087.stdout:8/724: readlink d2/d63/l8b 0 2024-02-28T16:02:02.102 INFO:tasks.workunit.client.1.smithi087.stdout:4/770: chown d2/dc1/lc2 2084910411 1 2024-02-28T16:02:02.107 INFO:tasks.workunit.client.1.smithi087.stdout:0/639: rename d4/dd/c4c to d4/d6/cd3 0 2024-02-28T16:02:02.107 INFO:tasks.workunit.client.1.smithi087.stdout:2/638: dread d2/d99/d28/d79/f90 [0,4194304] 0 2024-02-28T16:02:02.109 INFO:tasks.workunit.client.1.smithi087.stdout:9/637: creat d7/dd/d36/fb9 x:0 0 0 2024-02-28T16:02:02.113 INFO:tasks.workunit.client.1.smithi087.stdout:3/730: dread d11/d44/d5b/f52 [0,4194304] 0 2024-02-28T16:02:02.113 INFO:tasks.workunit.client.1.smithi087.stdout:1/638: read d0/d14/f18 [34875,65384] 0 2024-02-28T16:02:02.114 INFO:tasks.workunit.client.1.smithi087.stdout:5/769: rename d3/d9/d9b/dba/d69/d87/df3/cfc to d3/d64/d67/d7c/dc5/c11d 0 2024-02-28T16:02:02.118 INFO:tasks.workunit.client.1.smithi087.stdout:6/720: rmdir d4/d12/d45/d74 39 2024-02-28T16:02:02.120 INFO:tasks.workunit.client.1.smithi087.stdout:0/640: truncate d4/d6/f22 2354429 0 2024-02-28T16:02:02.123 INFO:tasks.workunit.client.1.smithi087.stdout:9/638: rmdir d7/dd/d15/d3f/d9d 39 2024-02-28T16:02:02.126 INFO:tasks.workunit.client.1.smithi087.stdout:3/731: creat d11/d61/d7c/ff6 x:0 0 0 2024-02-28T16:02:02.131 INFO:tasks.workunit.client.1.smithi087.stdout:6/721: read d4/d30/d13/d38/f3a [917226,107696] 0 2024-02-28T16:02:02.137 INFO:tasks.workunit.client.1.smithi087.stdout:1/639: unlink d0/d1b/d1f/l82 0 2024-02-28T16:02:02.138 INFO:tasks.workunit.client.1.smithi087.stdout:0/641: mknod d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/cd4 0 2024-02-28T16:02:02.148 INFO:tasks.workunit.client.1.smithi087.stdout:5/770: creat d3/d9/d9b/dba/d30/f11e x:0 0 0 2024-02-28T16:02:02.152 INFO:tasks.workunit.client.1.smithi087.stdout:2/639: dread d2/f87 [0,4194304] 0 2024-02-28T16:02:02.152 INFO:tasks.workunit.client.1.smithi087.stdout:0/642: rmdir d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58 39 2024-02-28T16:02:02.158 INFO:tasks.workunit.client.1.smithi087.stdout:3/732: link d11/d33/d74/c85 d11/d33/d58/d8c/dca/cf7 0 2024-02-28T16:02:02.158 INFO:tasks.workunit.client.1.smithi087.stdout:8/725: dread d2/d18/d25/fc6 [0,4194304] 0 2024-02-28T16:02:02.158 INFO:tasks.workunit.client.1.smithi087.stdout:3/733: readlink d11/d61/d65/l6c 0 2024-02-28T16:02:02.158 INFO:tasks.workunit.client.1.smithi087.stdout:0/643: creat d4/dd/d37/fd5 x:0 0 0 2024-02-28T16:02:02.160 INFO:tasks.workunit.client.1.smithi087.stdout:7/633: dread d14/f97 [0,4194304] 0 2024-02-28T16:02:02.160 INFO:tasks.workunit.client.1.smithi087.stdout:4/771: dread d2/df/d2e/f47 [0,4194304] 0 2024-02-28T16:02:02.162 INFO:tasks.workunit.client.1.smithi087.stdout:9/639: truncate d7/dd/d15/f7a 3452126 0 2024-02-28T16:02:02.171 INFO:tasks.workunit.client.1.smithi087.stdout:8/726: symlink d2/da2/le9 0 2024-02-28T16:02:02.173 INFO:tasks.workunit.client.0.smithi057.stdout:5/290: sync 2024-02-28T16:02:02.173 INFO:tasks.workunit.client.0.smithi057.stdout:7/214: sync 2024-02-28T16:02:02.174 INFO:tasks.workunit.client.0.smithi057.stdout:7/215: fdatasync f4 0 2024-02-28T16:02:02.175 INFO:tasks.workunit.client.0.smithi057.stdout:5/291: stat d2/d19/c1d 0 2024-02-28T16:02:02.177 INFO:tasks.workunit.client.1.smithi087.stdout:5/771: dwrite d3/d64/d81/fde [0,4194304] 0 2024-02-28T16:02:02.179 INFO:tasks.workunit.client.0.smithi057.stdout:7/216: rename d6/dc/d12 to d6/dc/d12/d1a/d4d/d4e 22 2024-02-28T16:02:02.179 INFO:tasks.workunit.client.0.smithi057.stdout:2/275: creat d19/d2c/f4f x:0 0 0 2024-02-28T16:02:02.179 INFO:tasks.workunit.client.1.smithi087.stdout:1/640: dwrite d0/d1a/f34 [0,4194304] 0 2024-02-28T16:02:02.181 INFO:tasks.workunit.client.0.smithi057.stdout:0/449: creat d6/d12/d45/f9a x:0 0 0 2024-02-28T16:02:02.181 INFO:tasks.workunit.client.1.smithi087.stdout:1/641: stat d0/d1b/f79 0 2024-02-28T16:02:02.186 INFO:tasks.workunit.client.0.smithi057.stdout:5/292: unlink d2/d3e/l41 0 2024-02-28T16:02:02.187 INFO:tasks.workunit.client.0.smithi057.stdout:0/450: write d6/d12/d17/d4b/f8f [631833,115125] 0 2024-02-28T16:02:02.187 INFO:tasks.workunit.client.1.smithi087.stdout:3/734: dread d11/d61/d65/fd8 [0,4194304] 0 2024-02-28T16:02:02.189 INFO:tasks.workunit.client.1.smithi087.stdout:2/640: dwrite d2/d7/d17/d3d/f5f [0,4194304] 0 2024-02-28T16:02:02.196 INFO:tasks.workunit.client.1.smithi087.stdout:3/735: truncate d11/d33/d67/d98/fa7 1367117 0 2024-02-28T16:02:02.200 INFO:tasks.workunit.client.0.smithi057.stdout:1/325: truncate d1/d3/dc/d15/f17 2573443 0 2024-02-28T16:02:02.204 INFO:tasks.workunit.client.0.smithi057.stdout:0/451: symlink d6/d12/d38/l9b 0 2024-02-28T16:02:02.205 INFO:tasks.workunit.client.1.smithi087.stdout:3/736: truncate d11/d33/fdc 152250 0 2024-02-28T16:02:02.205 INFO:tasks.workunit.client.0.smithi057.stdout:3/263: truncate d8/f15 740593 0 2024-02-28T16:02:02.209 INFO:tasks.workunit.client.0.smithi057.stdout:2/276: dread d19/f37 [0,4194304] 0 2024-02-28T16:02:02.210 INFO:tasks.workunit.client.0.smithi057.stdout:1/326: mkdir d1/d21/d66/d53/d62/d73 0 2024-02-28T16:02:02.211 INFO:tasks.workunit.client.0.smithi057.stdout:2/277: stat d19/c1b 0 2024-02-28T16:02:02.211 INFO:tasks.workunit.client.0.smithi057.stdout:0/452: mknod d6/d12/d5d/c9c 0 2024-02-28T16:02:02.215 INFO:tasks.workunit.client.0.smithi057.stdout:5/293: dread d2/d15/f3c [0,4194304] 0 2024-02-28T16:02:02.216 INFO:tasks.workunit.client.0.smithi057.stdout:0/453: write d6/d12/d17/d58/f84 [1050482,34083] 0 2024-02-28T16:02:02.220 INFO:tasks.workunit.client.0.smithi057.stdout:3/264: creat d8/dd/d14/d2c/f53 x:0 0 0 2024-02-28T16:02:02.220 INFO:tasks.workunit.client.0.smithi057.stdout:5/294: fdatasync d2/d12/d3d/f61 0 2024-02-28T16:02:02.221 INFO:tasks.workunit.client.0.smithi057.stdout:7/217: dwrite d6/f14 [0,4194304] 0 2024-02-28T16:02:02.223 INFO:tasks.workunit.client.0.smithi057.stdout:2/278: creat d19/d1d/d2e/d31/f50 x:0 0 0 2024-02-28T16:02:02.224 INFO:tasks.workunit.client.1.smithi087.stdout:3/737: dwrite d11/d33/d67/d9c/da1/fae [0,4194304] 0 2024-02-28T16:02:02.226 INFO:tasks.workunit.client.1.smithi087.stdout:3/738: fsync d11/d33/fdc 0 2024-02-28T16:02:02.227 INFO:tasks.workunit.client.0.smithi057.stdout:2/279: write d19/f23 [1468246,59207] 0 2024-02-28T16:02:02.232 INFO:tasks.workunit.client.0.smithi057.stdout:3/265: mkdir d8/dd/d14/d2e/d3b/d54 0 2024-02-28T16:02:02.233 INFO:tasks.workunit.client.0.smithi057.stdout:5/295: mkdir d2/d15/d63 0 2024-02-28T16:02:02.244 INFO:tasks.workunit.client.0.smithi057.stdout:7/218: truncate f4 1151596 0 2024-02-28T16:02:02.248 INFO:tasks.workunit.client.0.smithi057.stdout:4/302: sync 2024-02-28T16:02:02.252 INFO:tasks.workunit.client.0.smithi057.stdout:0/454: getdents d6/d12/d17 0 2024-02-28T16:02:02.255 INFO:tasks.workunit.client.0.smithi057.stdout:2/280: creat d19/d1d/f51 x:0 0 0 2024-02-28T16:02:02.255 INFO:tasks.workunit.client.0.smithi057.stdout:3/266: mknod d8/dd/d14/d2e/d30/d49/d51/c55 0 2024-02-28T16:02:02.261 INFO:tasks.workunit.client.0.smithi057.stdout:1/327: dwrite d1/d3/f2a [0,4194304] 0 2024-02-28T16:02:02.263 INFO:tasks.workunit.client.0.smithi057.stdout:0/455: creat d6/d12/d45/d78/f9d x:0 0 0 2024-02-28T16:02:02.266 INFO:tasks.workunit.client.0.smithi057.stdout:3/267: dread d8/dd/d14/f50 [0,4194304] 0 2024-02-28T16:02:02.272 INFO:tasks.workunit.client.0.smithi057.stdout:5/296: dwrite d2/f4a [0,4194304] 0 2024-02-28T16:02:02.272 INFO:tasks.workunit.client.0.smithi057.stdout:3/268: fsync d8/dd/f41 0 2024-02-28T16:02:02.275 INFO:tasks.workunit.client.0.smithi057.stdout:0/456: rename d6/l69 to d6/d12/d17/d58/l9e 0 2024-02-28T16:02:02.276 INFO:tasks.workunit.client.0.smithi057.stdout:1/328: truncate d1/f8 3423687 0 2024-02-28T16:02:02.280 INFO:tasks.workunit.client.0.smithi057.stdout:8/344: sync 2024-02-28T16:02:02.280 INFO:tasks.workunit.client.0.smithi057.stdout:3/269: write d8/dd/f1f [740093,84498] 0 2024-02-28T16:02:02.281 INFO:tasks.workunit.client.0.smithi057.stdout:6/232: sync 2024-02-28T16:02:02.281 INFO:tasks.workunit.client.0.smithi057.stdout:9/359: sync 2024-02-28T16:02:02.283 INFO:tasks.workunit.client.0.smithi057.stdout:5/297: unlink d2/d8/c53 0 2024-02-28T16:02:02.284 INFO:tasks.workunit.client.0.smithi057.stdout:4/303: truncate d1/f28 358125 0 2024-02-28T16:02:02.287 INFO:tasks.workunit.client.0.smithi057.stdout:8/345: chown d5/de/f2b 4259890 1 2024-02-28T16:02:02.288 INFO:tasks.workunit.client.0.smithi057.stdout:1/329: mkdir d1/d3/dc/d40/d5d/d67/d74 0 2024-02-28T16:02:02.289 INFO:tasks.workunit.client.1.smithi087.stdout:7/634: creat d14/d2e/d2b/d4e/fbf x:0 0 0 2024-02-28T16:02:02.289 INFO:tasks.workunit.client.0.smithi057.stdout:7/219: dwrite d6/f23 [0,4194304] 0 2024-02-28T16:02:02.290 INFO:tasks.workunit.client.0.smithi057.stdout:4/304: chown d1/l30 8161762 1 2024-02-28T16:02:02.290 INFO:tasks.workunit.client.1.smithi087.stdout:4/772: creat d2/df/d65/d8d/ffe x:0 0 0 2024-02-28T16:02:02.290 INFO:tasks.workunit.client.1.smithi087.stdout:9/640: mknod d7/dd/d99/cba 0 2024-02-28T16:02:02.290 INFO:tasks.workunit.client.0.smithi057.stdout:9/360: mknod d2/d46/c76 0 2024-02-28T16:02:02.292 INFO:tasks.workunit.client.0.smithi057.stdout:6/233: fdatasync df/d14/d15/d16/f4c 0 2024-02-28T16:02:02.297 INFO:tasks.workunit.client.0.smithi057.stdout:3/270: creat d8/dd/d14/d2e/d3b/f56 x:0 0 0 2024-02-28T16:02:02.297 INFO:tasks.workunit.client.0.smithi057.stdout:5/298: rename d2/d15/l5d to d2/d15/d5e/l64 0 2024-02-28T16:02:02.297 INFO:tasks.workunit.client.0.smithi057.stdout:8/346: write d5/d20/d39/d49/f54 [842049,122721] 0 2024-02-28T16:02:02.297 INFO:tasks.workunit.client.1.smithi087.stdout:1/642: mkdir d0/d1b/d1f/d96/dd8 0 2024-02-28T16:02:02.299 INFO:tasks.workunit.client.0.smithi057.stdout:1/330: mkdir d1/d21/d66/d44/d4c/d75 0 2024-02-28T16:02:02.299 INFO:tasks.workunit.client.1.smithi087.stdout:1/643: chown d0/d1b/d1f/l4c 5514180 1 2024-02-28T16:02:02.301 INFO:tasks.workunit.client.0.smithi057.stdout:5/299: fdatasync d2/d12/d3d/f61 0 2024-02-28T16:02:02.301 INFO:tasks.workunit.client.0.smithi057.stdout:2/281: dread d19/d1d/d2e/d31/f40 [0,4194304] 0 2024-02-28T16:02:02.305 INFO:tasks.workunit.client.0.smithi057.stdout:7/220: mknod d6/d26/c4f 0 2024-02-28T16:02:02.310 INFO:tasks.workunit.client.0.smithi057.stdout:3/271: mknod d8/dd/d19/d2a/c57 0 2024-02-28T16:02:02.312 INFO:tasks.workunit.client.1.smithi087.stdout:8/727: mknod d2/d18/d42/d7b/cea 0 2024-02-28T16:02:02.313 INFO:tasks.workunit.client.1.smithi087.stdout:5/772: mknod d3/d9/d9b/d115/c11f 0 2024-02-28T16:02:02.315 INFO:tasks.workunit.client.0.smithi057.stdout:4/305: dread d1/d10/d12/d15/d19/f2b [0,4194304] 0 2024-02-28T16:02:02.317 INFO:tasks.workunit.client.0.smithi057.stdout:9/361: getdents d2/d5e/d65/d6e 0 2024-02-28T16:02:02.318 INFO:tasks.workunit.client.0.smithi057.stdout:1/331: fdatasync d1/f7 0 2024-02-28T16:02:02.321 INFO:tasks.workunit.client.0.smithi057.stdout:4/306: dread - d1/d3f/f53 zero size 2024-02-28T16:02:02.321 INFO:tasks.workunit.client.1.smithi087.stdout:8/728: symlink d2/d18/d42/d62/leb 0 2024-02-28T16:02:02.325 INFO:tasks.workunit.client.0.smithi057.stdout:5/300: readlink d2/d19/d1c/l47 0 2024-02-28T16:02:02.327 INFO:tasks.workunit.client.0.smithi057.stdout:7/221: chown d6/dc/l19 18208 1 2024-02-28T16:02:02.327 INFO:tasks.workunit.client.1.smithi087.stdout:7/635: dread d14/d2e/d2b/f50 [0,4194304] 0 2024-02-28T16:02:02.328 INFO:tasks.workunit.client.0.smithi057.stdout:8/347: rename d5/d6/c1e to d5/de/d1b/c7c 0 2024-02-28T16:02:02.328 INFO:tasks.workunit.client.0.smithi057.stdout:9/362: write d2/f75 [286694,26849] 0 2024-02-28T16:02:02.329 INFO:tasks.workunit.client.1.smithi087.stdout:7/636: stat d14/d2e/d2b/d4e/la2 0 2024-02-28T16:02:02.330 INFO:tasks.workunit.client.0.smithi057.stdout:0/457: dwrite d6/d4e/f77 [0,4194304] 0 2024-02-28T16:02:02.331 INFO:tasks.workunit.client.0.smithi057.stdout:3/272: symlink d8/dd/d14/d2e/d30/l58 0 2024-02-28T16:02:02.334 INFO:tasks.workunit.client.0.smithi057.stdout:1/332: creat d1/d21/d66/d44/d4c/f76 x:0 0 0 2024-02-28T16:02:02.339 INFO:tasks.workunit.client.0.smithi057.stdout:8/348: stat d5/de/f10 0 2024-02-28T16:02:02.346 INFO:tasks.workunit.client.1.smithi087.stdout:7/637: getdents d14/d27/d5d/dac 0 2024-02-28T16:02:02.348 INFO:tasks.workunit.client.0.smithi057.stdout:5/301: read d2/d19/f51 [3118979,95286] 0 2024-02-28T16:02:02.352 INFO:tasks.workunit.client.1.smithi087.stdout:7/638: readlink d14/d2e/l9b 0 2024-02-28T16:02:02.354 INFO:tasks.workunit.client.0.smithi057.stdout:4/307: rename d1/d10/d12/d15/d19/c5a to d1/d14/c69 0 2024-02-28T16:02:02.354 INFO:tasks.workunit.client.1.smithi087.stdout:7/639: stat d14/d46/d80/la3 0 2024-02-28T16:02:02.355 INFO:tasks.workunit.client.0.smithi057.stdout:6/234: dread df/f1f [0,4194304] 0 2024-02-28T16:02:02.359 INFO:tasks.workunit.client.1.smithi087.stdout:7/640: mkdir d14/d2e/dc0 0 2024-02-28T16:02:02.363 INFO:tasks.workunit.client.0.smithi057.stdout:1/333: write d1/d3/dc/d40/d5d/d65/f61 [189088,90467] 0 2024-02-28T16:02:02.373 INFO:tasks.workunit.client.0.smithi057.stdout:2/282: getdents d19/d1d 0 2024-02-28T16:02:02.379 INFO:tasks.workunit.client.1.smithi087.stdout:7/641: dwrite d14/d2e/f22 [0,4194304] 0 2024-02-28T16:02:02.380 INFO:tasks.workunit.client.1.smithi087.stdout:7/642: chown d14/d2e/dab 3160361 1 2024-02-28T16:02:02.380 INFO:tasks.workunit.client.0.smithi057.stdout:8/349: rmdir d5 39 2024-02-28T16:02:02.382 INFO:tasks.workunit.client.0.smithi057.stdout:0/458: dwrite d6/d12/d17/d4b/f31 [0,4194304] 0 2024-02-28T16:02:02.387 INFO:tasks.workunit.client.0.smithi057.stdout:9/363: dread f0 [0,4194304] 0 2024-02-28T16:02:02.387 INFO:tasks.workunit.client.0.smithi057.stdout:0/459: chown d6/f99 9 1 2024-02-28T16:02:02.388 INFO:tasks.workunit.client.0.smithi057.stdout:2/283: symlink d19/d3a/l52 0 2024-02-28T16:02:02.393 INFO:tasks.workunit.client.0.smithi057.stdout:3/273: dwrite d8/dd/d14/d2e/d2f/f45 [0,4194304] 0 2024-02-28T16:02:02.395 INFO:tasks.workunit.client.1.smithi087.stdout:9/641: dread d7/dd/fe [0,4194304] 0 2024-02-28T16:02:02.398 INFO:tasks.workunit.client.0.smithi057.stdout:6/235: dread df/d10/d13/f3a [0,4194304] 0 2024-02-28T16:02:02.399 INFO:tasks.workunit.client.1.smithi087.stdout:8/729: rmdir d2/d18/d42/d62 39 2024-02-28T16:02:02.399 INFO:tasks.workunit.client.1.smithi087.stdout:9/642: write d7/dd/d15/d79/f8d [942770,94094] 0 2024-02-28T16:02:02.399 INFO:tasks.workunit.client.0.smithi057.stdout:4/308: dwrite d1/d22/f5c [0,4194304] 0 2024-02-28T16:02:02.399 INFO:tasks.workunit.client.0.smithi057.stdout:2/284: write d19/d1d/f20 [5226530,79843] 0 2024-02-28T16:02:02.400 INFO:tasks.workunit.client.1.smithi087.stdout:4/773: truncate d2/d9/d10/d22/f6a 6964854 0 2024-02-28T16:02:02.401 INFO:tasks.workunit.client.1.smithi087.stdout:1/644: truncate d0/d1b/d1f/d71/db2/f6e 1967531 0 2024-02-28T16:02:02.405 INFO:tasks.workunit.client.1.smithi087.stdout:2/641: dwrite d2/d99/f5d [0,4194304] 0 2024-02-28T16:02:02.405 INFO:tasks.workunit.client.1.smithi087.stdout:5/773: truncate d3/d9/d9b/dba/d30/d36/d4f/fe1 163625 0 2024-02-28T16:02:02.405 INFO:tasks.workunit.client.0.smithi057.stdout:1/334: creat d1/d3/dc/d15/d4e/d57/f77 x:0 0 0 2024-02-28T16:02:02.406 INFO:tasks.workunit.client.0.smithi057.stdout:9/364: rename d2/d5/d9/d40 to d2/d5/d1b/d2e/d77 0 2024-02-28T16:02:02.408 INFO:tasks.workunit.client.0.smithi057.stdout:3/274: dread - d8/dd/d19/f29 zero size 2024-02-28T16:02:02.409 INFO:tasks.workunit.client.0.smithi057.stdout:4/309: chown d1/d10/f43 1 1 2024-02-28T16:02:02.410 INFO:tasks.workunit.client.0.smithi057.stdout:8/350: chown d5/de/d1b/d4b/l71 30595911 1 2024-02-28T16:02:02.412 INFO:tasks.workunit.client.0.smithi057.stdout:3/275: read f4 [2755187,100893] 0 2024-02-28T16:02:02.413 INFO:tasks.workunit.client.1.smithi087.stdout:1/645: write d0/d1b/d43/f4b [2465172,92857] 0 2024-02-28T16:02:02.413 INFO:tasks.workunit.client.1.smithi087.stdout:6/722: sync 2024-02-28T16:02:02.414 INFO:tasks.workunit.client.0.smithi057.stdout:4/310: dread - d1/d10/d31/d36/f59 zero size 2024-02-28T16:02:02.414 INFO:tasks.workunit.client.0.smithi057.stdout:9/365: write d2/d5/d9/f6a [1848649,110995] 0 2024-02-28T16:02:02.416 INFO:tasks.workunit.client.0.smithi057.stdout:6/236: creat df/d10/f4d x:0 0 0 2024-02-28T16:02:02.418 INFO:tasks.workunit.client.1.smithi087.stdout:1/646: write d0/d1b/f47 [1581990,16026] 0 2024-02-28T16:02:02.419 INFO:tasks.workunit.client.0.smithi057.stdout:9/366: readlink d2/d5/d1b/d2e/d44/l4d 0 2024-02-28T16:02:02.421 INFO:tasks.workunit.client.1.smithi087.stdout:0/644: creat d4/d6/fd6 x:0 0 0 2024-02-28T16:02:02.424 INFO:tasks.workunit.client.0.smithi057.stdout:7/222: dwrite d6/dc/d12/d29/f3e [0,4194304] 0 2024-02-28T16:02:02.424 INFO:tasks.workunit.client.0.smithi057.stdout:6/237: write df/d14/d15/d16/f46 [1669499,57896] 0 2024-02-28T16:02:02.426 INFO:tasks.workunit.client.0.smithi057.stdout:1/335: symlink d1/d3/dc/d40/d5d/d65/l78 0 2024-02-28T16:02:02.430 INFO:tasks.workunit.client.0.smithi057.stdout:6/238: write df/d14/d15/d16/f4c [95145,42893] 0 2024-02-28T16:02:02.434 INFO:tasks.workunit.client.0.smithi057.stdout:6/239: chown df/d14/d15/l19 0 1 2024-02-28T16:02:02.435 INFO:tasks.workunit.client.1.smithi087.stdout:4/774: dread d2/d9/f2c [0,4194304] 0 2024-02-28T16:02:02.436 INFO:tasks.workunit.client.1.smithi087.stdout:5/774: unlink d3/d9/d4a/d5e/ff1 0 2024-02-28T16:02:02.436 INFO:tasks.workunit.client.0.smithi057.stdout:2/285: dwrite d19/d2c/f30 [0,4194304] 0 2024-02-28T16:02:02.437 INFO:tasks.workunit.client.0.smithi057.stdout:4/311: creat d1/d10/d12/d2c/d37/d46/f6a x:0 0 0 2024-02-28T16:02:02.438 INFO:tasks.workunit.client.1.smithi087.stdout:3/739: sync 2024-02-28T16:02:02.440 INFO:tasks.workunit.client.1.smithi087.stdout:8/730: creat d2/d9/d5e/d9c/fec x:0 0 0 2024-02-28T16:02:02.440 INFO:tasks.workunit.client.1.smithi087.stdout:1/647: unlink d0/d1a/f34 0 2024-02-28T16:02:02.445 INFO:tasks.workunit.client.0.smithi057.stdout:0/460: write d6/d12/d17/f37 [1477417,45156] 0 2024-02-28T16:02:02.445 INFO:tasks.workunit.client.0.smithi057.stdout:3/276: dread d8/dd/d14/d2e/d3b/f3e [0,4194304] 0 2024-02-28T16:02:02.447 INFO:tasks.workunit.client.1.smithi087.stdout:9/643: getdents d7/dd/d15/d79 0 2024-02-28T16:02:02.448 INFO:tasks.workunit.client.0.smithi057.stdout:4/312: write d1/d10/d12/d39/f3e [110235,46392] 0 2024-02-28T16:02:02.448 INFO:tasks.workunit.client.0.smithi057.stdout:5/302: dwrite d2/d8/f49 [0,4194304] 0 2024-02-28T16:02:02.450 INFO:tasks.workunit.client.0.smithi057.stdout:5/303: stat d2/d15/d5e 0 2024-02-28T16:02:02.451 INFO:tasks.workunit.client.1.smithi087.stdout:6/723: creat d4/d12/d45/d74/fec x:0 0 0 2024-02-28T16:02:02.451 INFO:tasks.workunit.client.0.smithi057.stdout:1/336: rename d1/d3/l9 to d1/d21/d25/l79 0 2024-02-28T16:02:02.453 INFO:tasks.workunit.client.0.smithi057.stdout:4/313: chown d1/d10/d12/d15/d19/d5e 12494 1 2024-02-28T16:02:02.454 INFO:tasks.workunit.client.1.smithi087.stdout:7/643: dwrite d14/d21/f41 [0,4194304] 0 2024-02-28T16:02:02.456 INFO:tasks.workunit.client.1.smithi087.stdout:0/645: dwrite d4/dd/d37/d39/d3a/f87 [4194304,4194304] 0 2024-02-28T16:02:02.458 INFO:tasks.workunit.client.1.smithi087.stdout:6/724: write d4/d30/d13/d38/d69/d99/fc4 [231487,122871] 0 2024-02-28T16:02:02.458 INFO:tasks.workunit.client.0.smithi057.stdout:1/337: write d1/d21/d66/d44/d4c/f76 [42205,6839] 0 2024-02-28T16:02:02.459 INFO:tasks.workunit.client.0.smithi057.stdout:9/367: mkdir d2/d5/d9/d64/d78 0 2024-02-28T16:02:02.464 INFO:tasks.workunit.client.1.smithi087.stdout:4/775: dread d2/d9/da/f2d [0,4194304] 0 2024-02-28T16:02:02.465 INFO:tasks.workunit.client.0.smithi057.stdout:3/277: dread f3 [0,4194304] 0 2024-02-28T16:02:02.467 INFO:tasks.workunit.client.0.smithi057.stdout:9/368: write d2/f75 [275869,87072] 0 2024-02-28T16:02:02.468 INFO:tasks.workunit.client.0.smithi057.stdout:0/461: symlink d6/d4e/l9f 0 2024-02-28T16:02:02.469 INFO:tasks.workunit.client.0.smithi057.stdout:0/462: dread - d6/d12/f7a zero size 2024-02-28T16:02:02.470 INFO:tasks.workunit.client.0.smithi057.stdout:6/240: mkdir df/d10/d13/d4b/d4e 0 2024-02-28T16:02:02.470 INFO:tasks.workunit.client.0.smithi057.stdout:9/369: chown d2/l69 945 1 2024-02-28T16:02:02.472 INFO:tasks.workunit.client.0.smithi057.stdout:0/463: write d6/f85 [328480,31830] 0 2024-02-28T16:02:02.473 INFO:tasks.workunit.client.0.smithi057.stdout:2/286: dwrite d19/d1d/d2e/d31/f50 [0,4194304] 0 2024-02-28T16:02:02.476 INFO:tasks.workunit.client.0.smithi057.stdout:6/241: chown df/d10/d13/f3a 55331355 1 2024-02-28T16:02:02.477 INFO:tasks.workunit.client.1.smithi087.stdout:0/646: creat d4/dd/d26/d93/fd7 x:0 0 0 2024-02-28T16:02:02.478 INFO:tasks.workunit.client.0.smithi057.stdout:3/278: chown d8/dd/d19 132540106 1 2024-02-28T16:02:02.478 INFO:tasks.workunit.client.0.smithi057.stdout:6/242: stat df/d14 0 2024-02-28T16:02:02.479 INFO:tasks.workunit.client.1.smithi087.stdout:5/775: mknod d3/d9/d9b/dba/d30/c120 0 2024-02-28T16:02:02.481 INFO:tasks.workunit.client.0.smithi057.stdout:5/304: mknod d2/d3e/d44/c65 0 2024-02-28T16:02:02.482 INFO:tasks.workunit.client.1.smithi087.stdout:7/644: truncate d14/d2e/f78 503426 0 2024-02-28T16:02:02.483 INFO:tasks.workunit.client.1.smithi087.stdout:6/725: mknod d4/d30/d13/d38/dc3/ced 0 2024-02-28T16:02:02.485 INFO:tasks.workunit.client.1.smithi087.stdout:7/645: readlink d14/d2e/d2b/d4e/l59 0 2024-02-28T16:02:02.486 INFO:tasks.workunit.client.1.smithi087.stdout:1/648: symlink d0/d1b/dd7/ld9 0 2024-02-28T16:02:02.486 INFO:tasks.workunit.client.1.smithi087.stdout:4/776: write d2/d9/da/d1a/d26/f3a [3968941,91811] 0 2024-02-28T16:02:02.487 INFO:tasks.workunit.client.1.smithi087.stdout:4/777: stat d2/d9/d9e 0 2024-02-28T16:02:02.490 INFO:tasks.workunit.client.0.smithi057.stdout:9/370: fdatasync d2/d5/d9/f32 0 2024-02-28T16:02:02.490 INFO:tasks.workunit.client.1.smithi087.stdout:5/776: fdatasync d3/d9/d9b/dba/d30/ddb/ff2 0 2024-02-28T16:02:02.491 INFO:tasks.workunit.client.1.smithi087.stdout:0/647: symlink d4/dd/d37/d39/d3a/d57/d74/d1f/d60/ld8 0 2024-02-28T16:02:02.493 INFO:tasks.workunit.client.1.smithi087.stdout:5/777: chown d3/d9/fd 4709000 1 2024-02-28T16:02:02.495 INFO:tasks.workunit.client.0.smithi057.stdout:4/314: dwrite d1/d14/f23 [0,4194304] 0 2024-02-28T16:02:02.497 INFO:tasks.workunit.client.1.smithi087.stdout:9/644: link d7/d1e/d44/d83/l91 d7/dd/d15/d55/lbb 0 2024-02-28T16:02:02.501 INFO:tasks.workunit.client.0.smithi057.stdout:8/351: dwrite d5/d62/f76 [4194304,4194304] 0 2024-02-28T16:02:02.501 INFO:tasks.workunit.client.1.smithi087.stdout:7/646: symlink d14/d27/d5d/d6a/d83/lc1 0 2024-02-28T16:02:02.504 INFO:tasks.workunit.client.1.smithi087.stdout:4/778: rename d2/d9/d10/d22/l45 to d2/d9/da/d1a/d26/da7/lff 0 2024-02-28T16:02:02.504 INFO:tasks.workunit.client.1.smithi087.stdout:5/778: readlink d3/d9/d9b/dba/d30/d53/d5b/la5 0 2024-02-28T16:02:02.506 INFO:tasks.workunit.client.0.smithi057.stdout:6/243: mkdir df/d10/d4f 0 2024-02-28T16:02:02.511 INFO:tasks.workunit.client.1.smithi087.stdout:4/779: readlink d2/d9/da/d1a/d26/l67 0 2024-02-28T16:02:02.511 INFO:tasks.workunit.client.1.smithi087.stdout:9/645: chown d7/d1e/d44/d83/d8e/la8 1439606 1 2024-02-28T16:02:02.514 INFO:tasks.workunit.client.0.smithi057.stdout:9/371: rename d2/d5/d58 to d2/d24/d1d/d79 0 2024-02-28T16:02:02.515 INFO:tasks.workunit.client.0.smithi057.stdout:0/464: dwrite f0 [0,4194304] 0 2024-02-28T16:02:02.516 INFO:tasks.workunit.client.1.smithi087.stdout:4/780: write d2/df/d2e/fcd [735951,115275] 0 2024-02-28T16:02:02.519 INFO:tasks.workunit.client.1.smithi087.stdout:2/642: dread d2/d99/d28/f2e [0,4194304] 0 2024-02-28T16:02:02.522 INFO:tasks.workunit.client.1.smithi087.stdout:5/779: creat d3/d9/d9b/de9/d11c/f121 x:0 0 0 2024-02-28T16:02:02.527 INFO:tasks.workunit.client.0.smithi057.stdout:2/287: write d19/d1d/d2e/d31/f40 [3448842,50171] 0 2024-02-28T16:02:02.529 INFO:tasks.workunit.client.1.smithi087.stdout:7/647: dread d14/d27/d5d/f99 [0,4194304] 0 2024-02-28T16:02:02.530 INFO:tasks.workunit.client.0.smithi057.stdout:8/352: creat d5/d20/d72/f7d x:0 0 0 2024-02-28T16:02:02.530 INFO:tasks.workunit.client.0.smithi057.stdout:6/244: mknod df/d10/d4f/c50 0 2024-02-28T16:02:02.531 INFO:tasks.workunit.client.0.smithi057.stdout:2/288: dread - d19/d1d/f51 zero size 2024-02-28T16:02:02.533 INFO:tasks.workunit.client.0.smithi057.stdout:3/279: dwrite d8/dd/d14/d2e/d3b/f3e [0,4194304] 0 2024-02-28T16:02:02.534 INFO:tasks.workunit.client.1.smithi087.stdout:8/731: dread d2/d9/d5e/fcd [0,4194304] 0 2024-02-28T16:02:02.534 INFO:tasks.workunit.client.0.smithi057.stdout:5/305: dwrite d2/d19/d1c/f4d [0,4194304] 0 2024-02-28T16:02:02.538 INFO:tasks.workunit.client.0.smithi057.stdout:6/245: write df/d14/d15/d16/f31 [228609,107301] 0 2024-02-28T16:02:02.538 INFO:tasks.workunit.client.0.smithi057.stdout:1/338: truncate d1/f45 1690133 0 2024-02-28T16:02:02.540 INFO:tasks.workunit.client.0.smithi057.stdout:0/465: symlink d6/d12/d17/d58/d95/la0 0 2024-02-28T16:02:02.541 INFO:tasks.workunit.client.1.smithi087.stdout:3/740: truncate d11/d61/d7c/f84 1269392 0 2024-02-28T16:02:02.544 INFO:tasks.workunit.client.0.smithi057.stdout:1/339: write d1/d21/f52 [4017236,67198] 0 2024-02-28T16:02:02.548 INFO:tasks.workunit.client.0.smithi057.stdout:1/340: readlink d1/d21/l22 0 2024-02-28T16:02:02.548 INFO:tasks.workunit.client.1.smithi087.stdout:8/732: creat d2/d33/dd1/fed x:0 0 0 2024-02-28T16:02:02.549 INFO:tasks.workunit.client.0.smithi057.stdout:2/289: creat d19/d34/f53 x:0 0 0 2024-02-28T16:02:02.553 INFO:tasks.workunit.client.0.smithi057.stdout:5/306: rename d2/d12/l4f to d2/d8/l66 0 2024-02-28T16:02:02.554 INFO:tasks.workunit.client.0.smithi057.stdout:4/315: dwrite d1/d14/f33 [4194304,4194304] 0 2024-02-28T16:02:02.554 INFO:tasks.workunit.client.0.smithi057.stdout:6/246: rmdir df/d10/d4f 39 2024-02-28T16:02:02.555 INFO:tasks.workunit.client.1.smithi087.stdout:4/781: dread d2/d9/d10/dbf/db6/fda [0,4194304] 0 2024-02-28T16:02:02.556 INFO:tasks.workunit.client.1.smithi087.stdout:7/648: symlink d14/d2e/d89/dbd/lc2 0 2024-02-28T16:02:02.558 INFO:tasks.workunit.client.1.smithi087.stdout:2/643: link d2/d99/d28/l41 d2/d99/d28/d79/da3/led 0 2024-02-28T16:02:02.559 INFO:tasks.workunit.client.0.smithi057.stdout:4/316: dread - d1/d10/d31/f62 zero size 2024-02-28T16:02:02.561 INFO:tasks.workunit.client.0.smithi057.stdout:3/280: dread f3 [0,4194304] 0 2024-02-28T16:02:02.563 INFO:tasks.workunit.client.0.smithi057.stdout:9/372: truncate f0 1870731 0 2024-02-28T16:02:02.563 INFO:tasks.workunit.client.1.smithi087.stdout:8/733: symlink d2/d63/d9b/lee 0 2024-02-28T16:02:02.564 INFO:tasks.workunit.client.0.smithi057.stdout:5/307: mkdir d2/d15/d5e/d67 0 2024-02-28T16:02:02.564 INFO:tasks.workunit.client.1.smithi087.stdout:4/782: write d2/f2f [726504,16202] 0 2024-02-28T16:02:02.569 INFO:tasks.workunit.client.0.smithi057.stdout:6/247: creat df/d10/d13/d4b/f51 x:0 0 0 2024-02-28T16:02:02.569 INFO:tasks.workunit.client.1.smithi087.stdout:3/741: dwrite d11/d33/d58/f81 [0,4194304] 0 2024-02-28T16:02:02.571 INFO:tasks.workunit.client.0.smithi057.stdout:8/353: getdents d5/de/d1b/d57 0 2024-02-28T16:02:02.573 INFO:tasks.workunit.client.0.smithi057.stdout:2/290: link d19/d2c/l36 d19/d34/l54 0 2024-02-28T16:02:02.576 INFO:tasks.workunit.client.0.smithi057.stdout:4/317: write d1/d22/f2a [3633132,19063] 0 2024-02-28T16:02:02.579 INFO:tasks.workunit.client.0.smithi057.stdout:5/308: dread d2/f22 [4194304,4194304] 0 2024-02-28T16:02:02.580 INFO:tasks.workunit.client.0.smithi057.stdout:3/281: chown d8/dd/d19/c46 41426 1 2024-02-28T16:02:02.581 INFO:tasks.workunit.client.0.smithi057.stdout:6/248: symlink df/d10/d13/l52 0 2024-02-28T16:02:02.582 INFO:tasks.workunit.client.0.smithi057.stdout:7/223: dread d6/dc/d12/d1a/f24 [0,4194304] 0 2024-02-28T16:02:02.582 INFO:tasks.workunit.client.0.smithi057.stdout:0/466: dwrite d6/f85 [0,4194304] 0 2024-02-28T16:02:02.583 INFO:tasks.workunit.client.1.smithi087.stdout:1/649: dwrite d0/d1b/d43/fa3 [0,4194304] 0 2024-02-28T16:02:02.587 INFO:tasks.workunit.client.0.smithi057.stdout:0/467: stat d6/d12/d38/d5e/f48 0 2024-02-28T16:02:02.587 INFO:tasks.workunit.client.1.smithi087.stdout:9/646: dwrite d7/dd/d15/d55/f6c [0,4194304] 0 2024-02-28T16:02:02.589 INFO:tasks.workunit.client.1.smithi087.stdout:7/649: truncate d14/d2e/f78 744006 0 2024-02-28T16:02:02.589 INFO:tasks.workunit.client.0.smithi057.stdout:6/249: write df/d14/d15/d16/f33 [2966212,51499] 0 2024-02-28T16:02:02.593 INFO:tasks.workunit.client.0.smithi057.stdout:2/291: rmdir d19/d1d/d22 39 2024-02-28T16:02:02.593 INFO:tasks.workunit.client.1.smithi087.stdout:7/650: fsync d14/d27/d5d/f75 0 2024-02-28T16:02:02.595 INFO:tasks.workunit.client.0.smithi057.stdout:4/318: rmdir d1 39 2024-02-28T16:02:02.597 INFO:tasks.workunit.client.1.smithi087.stdout:0/648: dwrite d4/dd/f13 [4194304,4194304] 0 2024-02-28T16:02:02.598 INFO:tasks.workunit.client.1.smithi087.stdout:5/780: dwrite d3/d9/d9b/dba/d69/f7d [0,4194304] 0 2024-02-28T16:02:02.598 INFO:tasks.workunit.client.1.smithi087.stdout:1/650: mkdir d0/d1b/d1f/d71/db2/db3/dda 0 2024-02-28T16:02:02.603 INFO:tasks.workunit.client.1.smithi087.stdout:3/742: rmdir d11/d33/d58/dee 0 2024-02-28T16:02:02.609 INFO:tasks.workunit.client.1.smithi087.stdout:9/647: mknod d7/dd/d3c/d4c/da1/cbc 0 2024-02-28T16:02:02.613 INFO:tasks.workunit.client.0.smithi057.stdout:8/354: link d5/f7 d5/de/f7e 0 2024-02-28T16:02:02.617 INFO:tasks.workunit.client.1.smithi087.stdout:1/651: symlink d0/d1b/d1f/d71/db2/db3/ldb 0 2024-02-28T16:02:02.618 INFO:tasks.workunit.client.1.smithi087.stdout:4/783: dread d2/d9/d10/d22/d5b/d5c/d91/da9/fca [0,4194304] 0 2024-02-28T16:02:02.618 INFO:tasks.workunit.client.0.smithi057.stdout:7/224: rename d6/dc/f2a to d6/d26/f50 0 2024-02-28T16:02:02.619 INFO:tasks.workunit.client.0.smithi057.stdout:0/468: dwrite d6/d12/d17/d34/f76 [0,4194304] 0 2024-02-28T16:02:02.621 INFO:tasks.workunit.client.0.smithi057.stdout:6/250: dwrite df/d14/d15/d16/f4c [0,4194304] 0 2024-02-28T16:02:02.623 INFO:tasks.workunit.client.1.smithi087.stdout:7/651: dwrite d14/d2e/fa7 [0,4194304] 0 2024-02-28T16:02:02.623 INFO:tasks.workunit.client.0.smithi057.stdout:0/469: chown d6/d12/l26 1 1 2024-02-28T16:02:02.628 INFO:tasks.workunit.client.1.smithi087.stdout:9/648: rename d7/dd/d15/d3f/daa to d7/dd/d15/d79/d2e/dbd 0 2024-02-28T16:02:02.631 INFO:tasks.workunit.client.1.smithi087.stdout:1/652: creat d0/d1b/d1f/d71/db2/d24/d78/fdc x:0 0 0 2024-02-28T16:02:02.631 INFO:tasks.workunit.client.0.smithi057.stdout:0/470: write d6/d12/d38/f5c [1976985,122760] 0 2024-02-28T16:02:02.631 INFO:tasks.workunit.client.0.smithi057.stdout:0/471: chown d6/fd 450957 1 2024-02-28T16:02:02.633 INFO:tasks.workunit.client.1.smithi087.stdout:2/644: truncate d2/fc 2071787 0 2024-02-28T16:02:02.635 INFO:tasks.workunit.client.1.smithi087.stdout:4/784: rmdir d2/d9/d10/d22/db3 39 2024-02-28T16:02:02.635 INFO:tasks.workunit.client.1.smithi087.stdout:2/645: dread - d2/fd6 zero size 2024-02-28T16:02:02.636 INFO:tasks.workunit.client.1.smithi087.stdout:7/652: mkdir d14/d46/d7c/dc3 0 2024-02-28T16:02:02.639 INFO:tasks.workunit.client.1.smithi087.stdout:4/785: fsync d2/f3b 0 2024-02-28T16:02:02.641 INFO:tasks.workunit.client.1.smithi087.stdout:1/653: getdents d0/d1b/d1f/d71/db2/dae/dcd 0 2024-02-28T16:02:02.645 INFO:tasks.workunit.client.1.smithi087.stdout:2/646: readlink d2/d7/d17/d34/daf/lc1 0 2024-02-28T16:02:02.648 INFO:tasks.workunit.client.1.smithi087.stdout:7/653: rename d14/d27/fa9 to d14/d46/d80/fc4 0 2024-02-28T16:02:02.652 INFO:tasks.workunit.client.1.smithi087.stdout:7/654: mkdir d14/d27/d55/dc5 0 2024-02-28T16:02:02.653 INFO:tasks.workunit.client.1.smithi087.stdout:7/655: chown d14/d2e/d2b/f67 51276 1 2024-02-28T16:02:02.653 INFO:tasks.workunit.client.1.smithi087.stdout:4/786: getdents d2/d9/d10/d22/d5b/d5c/d91/da9 0 2024-02-28T16:02:02.656 INFO:tasks.workunit.client.1.smithi087.stdout:9/649: dread d7/dc/f59 [0,4194304] 0 2024-02-28T16:02:02.657 INFO:tasks.workunit.client.1.smithi087.stdout:8/734: write d2/d18/d42/f70 [1863751,53101] 0 2024-02-28T16:02:02.660 INFO:tasks.workunit.client.1.smithi087.stdout:8/735: truncate d2/d9/d5e/d9c/fec 281551 0 2024-02-28T16:02:02.663 INFO:tasks.workunit.client.1.smithi087.stdout:4/787: unlink d2/d9/l50 0 2024-02-28T16:02:02.668 INFO:tasks.workunit.client.1.smithi087.stdout:7/656: dread d14/d2e/d2b/f50 [0,4194304] 0 2024-02-28T16:02:02.671 INFO:tasks.workunit.client.1.smithi087.stdout:5/781: dread d3/d9/f1e [0,4194304] 0 2024-02-28T16:02:02.675 INFO:tasks.workunit.client.1.smithi087.stdout:4/788: dread d2/df/d2e/fcd [0,4194304] 0 2024-02-28T16:02:02.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:02 smithi057 ceph-mon[28763]: pgmap v33: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 48 MiB/s rd, 182 MiB/s wr, 328 op/s 2024-02-28T16:02:02.680 INFO:tasks.workunit.client.1.smithi087.stdout:8/736: mknod d2/d9/d8e/dda/cef 0 2024-02-28T16:02:02.683 INFO:tasks.workunit.client.1.smithi087.stdout:5/782: symlink d3/d9/d4a/l122 0 2024-02-28T16:02:02.685 INFO:tasks.workunit.client.1.smithi087.stdout:0/649: write d4/dd/d21/d9b/f6f [732966,91473] 0 2024-02-28T16:02:02.687 INFO:tasks.workunit.client.1.smithi087.stdout:4/789: dread d2/d9/da/d1a/d26/d69/fa6 [0,4194304] 0 2024-02-28T16:02:02.687 INFO:tasks.workunit.client.1.smithi087.stdout:8/737: fsync d2/d9/d10/f12 0 2024-02-28T16:02:02.694 INFO:tasks.workunit.client.1.smithi087.stdout:9/650: dwrite d7/dd/d36/f4f [0,4194304] 0 2024-02-28T16:02:02.694 INFO:tasks.workunit.client.1.smithi087.stdout:7/657: dwrite d14/d21/f47 [0,4194304] 0 2024-02-28T16:02:02.699 INFO:tasks.workunit.client.1.smithi087.stdout:2/647: dread d2/d7/d17/d34/f4c [0,4194304] 0 2024-02-28T16:02:02.700 INFO:tasks.workunit.client.1.smithi087.stdout:9/651: write d7/d1e/d44/d76/fab [686147,83564] 0 2024-02-28T16:02:02.703 INFO:tasks.workunit.client.1.smithi087.stdout:3/743: dread d11/f36 [0,4194304] 0 2024-02-28T16:02:02.707 INFO:tasks.workunit.client.1.smithi087.stdout:8/738: symlink d2/d63/d9b/dae/lf0 0 2024-02-28T16:02:02.714 INFO:tasks.workunit.client.1.smithi087.stdout:7/658: creat d14/d2e/d89/dbb/fc6 x:0 0 0 2024-02-28T16:02:02.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:02 smithi087 ceph-mon[37122]: pgmap v33: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 48 MiB/s rd, 182 MiB/s wr, 328 op/s 2024-02-28T16:02:02.720 INFO:tasks.workunit.client.1.smithi087.stdout:9/652: dwrite d7/dd/d15/d79/d2e/f8b [0,4194304] 0 2024-02-28T16:02:02.721 INFO:tasks.workunit.client.1.smithi087.stdout:5/783: dwrite d3/d64/d67/fa6 [4194304,4194304] 0 2024-02-28T16:02:02.724 INFO:tasks.workunit.client.1.smithi087.stdout:3/744: mknod d11/d45/d88/d91/de3/de5/cf8 0 2024-02-28T16:02:02.724 INFO:tasks.workunit.client.1.smithi087.stdout:8/739: mkdir d2/d63/d9b/dd5/dd9/df1 0 2024-02-28T16:02:02.728 INFO:tasks.workunit.client.1.smithi087.stdout:7/659: truncate d14/fa5 1028149 0 2024-02-28T16:02:02.729 INFO:tasks.workunit.client.1.smithi087.stdout:0/650: rename d4/d6/dc/fc9 to d4/dd/d37/d39/d3a/d57/fd9 0 2024-02-28T16:02:02.731 INFO:tasks.workunit.client.1.smithi087.stdout:8/740: stat d2/d33/l6a 0 2024-02-28T16:02:02.737 INFO:tasks.workunit.client.1.smithi087.stdout:7/660: dread d14/d2e/d2b/d4e/f52 [0,4194304] 0 2024-02-28T16:02:02.737 INFO:tasks.workunit.client.1.smithi087.stdout:3/745: creat d11/d61/ff9 x:0 0 0 2024-02-28T16:02:02.739 INFO:tasks.workunit.client.1.smithi087.stdout:7/661: readlink d14/d30/l6c 0 2024-02-28T16:02:02.740 INFO:tasks.workunit.client.1.smithi087.stdout:3/746: creat d11/d7b/dab/ffa x:0 0 0 2024-02-28T16:02:02.741 INFO:tasks.workunit.client.1.smithi087.stdout:4/790: truncate d2/df/d65/d8d/fa4 2772106 0 2024-02-28T16:02:02.744 INFO:tasks.workunit.client.1.smithi087.stdout:7/662: rename d14/d2e/f66 to d14/d46/d7c/db9/fc7 0 2024-02-28T16:02:02.746 INFO:tasks.workunit.client.1.smithi087.stdout:3/747: truncate d11/d44/d5b/f5f 781855 0 2024-02-28T16:02:02.748 INFO:tasks.workunit.client.1.smithi087.stdout:7/663: creat d14/d2e/d2b/d4e/fc8 x:0 0 0 2024-02-28T16:02:02.751 INFO:tasks.workunit.client.1.smithi087.stdout:7/664: chown d14/d2e/d89/dbd/lc2 5667 1 2024-02-28T16:02:02.753 INFO:tasks.workunit.client.1.smithi087.stdout:3/748: rename d11/d7b/dab/ffa to d11/d45/d88/ffb 0 2024-02-28T16:02:02.761 INFO:tasks.workunit.client.1.smithi087.stdout:5/784: truncate d3/d64/f8d 4219875 0 2024-02-28T16:02:02.761 INFO:tasks.workunit.client.1.smithi087.stdout:7/665: link d14/d46/ca4 d14/d7d/cc9 0 2024-02-28T16:02:02.762 INFO:tasks.workunit.client.1.smithi087.stdout:0/651: dread d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f8f [0,4194304] 0 2024-02-28T16:02:02.762 INFO:tasks.workunit.client.1.smithi087.stdout:9/653: dread d7/dd/d15/d79/d2e/f34 [0,4194304] 0 2024-02-28T16:02:02.767 INFO:tasks.workunit.client.1.smithi087.stdout:0/652: dread - d4/d6/dc/d45/fb8 zero size 2024-02-28T16:02:02.767 INFO:tasks.workunit.client.1.smithi087.stdout:7/666: write d14/d7d/fb4 [1034143,95821] 0 2024-02-28T16:02:02.769 INFO:tasks.workunit.client.1.smithi087.stdout:0/653: dread - d4/dd/d37/fd5 zero size 2024-02-28T16:02:02.771 INFO:tasks.workunit.client.1.smithi087.stdout:9/654: rmdir d7/dd/d99/da3 39 2024-02-28T16:02:02.772 INFO:tasks.workunit.client.1.smithi087.stdout:5/785: chown d3/d64/d81/f55 767193 1 2024-02-28T16:02:02.776 INFO:tasks.workunit.client.1.smithi087.stdout:4/791: dread d2/df/d65/d8d/fa4 [0,4194304] 0 2024-02-28T16:02:02.778 INFO:tasks.workunit.client.1.smithi087.stdout:0/654: unlink d4/dd/d37/d39/d3a/fcc 0 2024-02-28T16:02:02.778 INFO:tasks.workunit.client.1.smithi087.stdout:4/792: dread - d2/df/d65/d8d/ffe zero size 2024-02-28T16:02:02.779 INFO:tasks.workunit.client.1.smithi087.stdout:7/667: symlink d14/d27/d5d/d6a/d83/d96/lca 0 2024-02-28T16:02:02.783 INFO:tasks.workunit.client.1.smithi087.stdout:5/786: mknod d3/d64/d81/c123 0 2024-02-28T16:02:02.784 INFO:tasks.workunit.client.1.smithi087.stdout:3/749: dread d11/fb0 [0,4194304] 0 2024-02-28T16:02:02.785 INFO:tasks.workunit.client.1.smithi087.stdout:9/655: symlink d7/dd/d36/d89/lbe 0 2024-02-28T16:02:02.790 INFO:tasks.workunit.client.1.smithi087.stdout:4/793: creat d2/d9/da/d1a/d26/d69/f100 x:0 0 0 2024-02-28T16:02:02.794 INFO:tasks.workunit.client.1.smithi087.stdout:3/750: mkdir d11/d33/d74/df0/dfc 0 2024-02-28T16:02:02.796 INFO:tasks.workunit.client.1.smithi087.stdout:0/655: dwrite d4/dd/d21/d9b/f6f [0,4194304] 0 2024-02-28T16:02:02.798 INFO:tasks.workunit.client.1.smithi087.stdout:9/656: rename d7/dd/d15/d3f/d9d/db4 to d7/dd/d3c/d4c/dbf 0 2024-02-28T16:02:02.799 INFO:tasks.workunit.client.1.smithi087.stdout:5/787: dread d3/d9/fd [0,4194304] 0 2024-02-28T16:02:02.803 INFO:tasks.workunit.client.1.smithi087.stdout:4/794: rename d2/d9/d10/dbf/dbb/ce4 to d2/df/d2e/dad/c101 0 2024-02-28T16:02:02.805 INFO:tasks.workunit.client.1.smithi087.stdout:9/657: mkdir d7/dd/d15/d3f/d6d/dc0 0 2024-02-28T16:02:02.807 INFO:tasks.workunit.client.1.smithi087.stdout:3/751: link d11/d45/d88/ffb d11/d33/d58/d8c/ffd 0 2024-02-28T16:02:02.810 INFO:tasks.workunit.client.1.smithi087.stdout:5/788: rename d3/d9/d9b/de9/d10a to d3/d64/d81/d124 0 2024-02-28T16:02:02.810 INFO:tasks.workunit.client.1.smithi087.stdout:4/795: unlink d2/df/d2e/c64 0 2024-02-28T16:02:02.813 INFO:tasks.workunit.client.1.smithi087.stdout:4/796: rename d2 to d2/d9/d9e/d102 22 2024-02-28T16:02:02.815 INFO:tasks.workunit.client.1.smithi087.stdout:5/789: write d3/d9/d9b/dba/d30/d36/d4f/f91 [1418279,8217] 0 2024-02-28T16:02:02.815 INFO:tasks.workunit.client.1.smithi087.stdout:7/668: dwrite d14/d2e/fa7 [4194304,4194304] 0 2024-02-28T16:02:02.820 INFO:tasks.workunit.client.1.smithi087.stdout:4/797: truncate d2/d9/d10/d22/d5b/d5c/d68/fc4 1027840 0 2024-02-28T16:02:02.822 INFO:tasks.workunit.client.1.smithi087.stdout:4/798: fdatasync d2/d9/da/f3f 0 2024-02-28T16:02:02.822 INFO:tasks.workunit.client.1.smithi087.stdout:3/752: symlink d11/d45/d88/d91/lfe 0 2024-02-28T16:02:02.825 INFO:tasks.workunit.client.1.smithi087.stdout:6/726: sync 2024-02-28T16:02:02.825 INFO:tasks.workunit.client.1.smithi087.stdout:3/753: stat d11/l20 0 2024-02-28T16:02:02.831 INFO:tasks.workunit.client.1.smithi087.stdout:4/799: unlink d2/d9/da/d1a/cc0 0 2024-02-28T16:02:02.834 INFO:tasks.workunit.client.1.smithi087.stdout:7/669: dread d14/d2e/f5c [0,4194304] 0 2024-02-28T16:02:02.835 INFO:tasks.workunit.client.1.smithi087.stdout:9/658: write d7/dd/f28 [325470,2277] 0 2024-02-28T16:02:02.840 INFO:tasks.workunit.client.1.smithi087.stdout:5/790: getdents d3/d9/d9b/dba/d30/d8f/dac/d109/d54 0 2024-02-28T16:02:02.841 INFO:tasks.workunit.client.1.smithi087.stdout:0/656: dwrite d4/d6/f9f [0,4194304] 0 2024-02-28T16:02:02.847 INFO:tasks.workunit.client.1.smithi087.stdout:9/659: write d7/dd/d3c/d4c/da1/f80 [6072634,27631] 0 2024-02-28T16:02:02.847 INFO:tasks.workunit.client.0.smithi057.stdout:4/319: read d1/d10/d12/d2c/f57 [27245,50987] 0 2024-02-28T16:02:02.848 INFO:tasks.workunit.client.0.smithi057.stdout:1/341: truncate d1/d21/f63 844916 0 2024-02-28T16:02:02.848 INFO:tasks.workunit.client.0.smithi057.stdout:0/472: write d6/d12/f7a [836503,129244] 0 2024-02-28T16:02:02.851 INFO:tasks.workunit.client.0.smithi057.stdout:0/473: chown d6/d12/d45 4948 1 2024-02-28T16:02:02.852 INFO:tasks.workunit.client.0.smithi057.stdout:4/320: stat d1/d10/d31/c54 0 2024-02-28T16:02:02.855 INFO:tasks.workunit.client.1.smithi087.stdout:9/660: creat d7/d1e/d44/fc1 x:0 0 0 2024-02-28T16:02:02.855 INFO:tasks.workunit.client.1.smithi087.stdout:6/727: dwrite d4/d12/d45/d92/dbd/fc6 [0,4194304] 0 2024-02-28T16:02:02.857 INFO:tasks.workunit.client.0.smithi057.stdout:3/282: getdents d8/dd/d19/d25 0 2024-02-28T16:02:02.860 INFO:tasks.workunit.client.1.smithi087.stdout:0/657: fdatasync d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f8f 0 2024-02-28T16:02:02.861 INFO:tasks.workunit.client.0.smithi057.stdout:2/292: mkdir d19/d1d/d2e/d55 0 2024-02-28T16:02:02.862 INFO:tasks.workunit.client.1.smithi087.stdout:5/791: getdents d3/d9/d9b/de9/d11c 0 2024-02-28T16:02:02.864 INFO:tasks.workunit.client.1.smithi087.stdout:7/670: dwrite d14/d46/d7c/f84 [0,4194304] 0 2024-02-28T16:02:02.864 INFO:tasks.workunit.client.1.smithi087.stdout:4/800: dwrite d2/d9/d10/d22/d5b/d5c/fe6 [0,4194304] 0 2024-02-28T16:02:02.864 INFO:tasks.workunit.client.0.smithi057.stdout:4/321: creat d1/d10/d31/f6b x:0 0 0 2024-02-28T16:02:02.864 INFO:tasks.workunit.client.0.smithi057.stdout:2/293: chown d19/d43/l49 21 1 2024-02-28T16:02:02.865 INFO:tasks.workunit.client.0.smithi057.stdout:6/251: creat df/f53 x:0 0 0 2024-02-28T16:02:02.865 INFO:tasks.workunit.client.0.smithi057.stdout:7/225: dread d6/ff [0,4194304] 0 2024-02-28T16:02:02.865 INFO:tasks.workunit.client.0.smithi057.stdout:0/474: rmdir d6/d12/d17/d4b/d60/d6b 39 2024-02-28T16:02:02.868 INFO:tasks.workunit.client.0.smithi057.stdout:3/283: unlink d8/dd/d14/d2e/d3b/f4a 0 2024-02-28T16:02:02.868 INFO:tasks.workunit.client.0.smithi057.stdout:2/294: read f12 [2214562,49775] 0 2024-02-28T16:02:02.869 INFO:tasks.workunit.client.1.smithi087.stdout:0/658: fdatasync d4/dd/d37/d39/d3a/d57/fd9 0 2024-02-28T16:02:02.869 INFO:tasks.workunit.client.0.smithi057.stdout:4/322: rmdir d1/d22 39 2024-02-28T16:02:02.870 INFO:tasks.workunit.client.0.smithi057.stdout:7/226: read d6/fb [378159,92007] 0 2024-02-28T16:02:02.871 INFO:tasks.workunit.client.1.smithi087.stdout:6/728: truncate d4/d30/d13/d67/db8/fc5 3249720 0 2024-02-28T16:02:02.872 INFO:tasks.workunit.client.1.smithi087.stdout:4/801: mknod d2/d9/d10/d22/d5b/d5c/c103 0 2024-02-28T16:02:02.873 INFO:tasks.workunit.client.1.smithi087.stdout:0/659: write d4/d6/f14 [4316131,106842] 0 2024-02-28T16:02:02.874 INFO:tasks.workunit.client.0.smithi057.stdout:5/309: dwrite d2/d15/d3b/f4e [0,4194304] 0 2024-02-28T16:02:02.874 INFO:tasks.workunit.client.0.smithi057.stdout:4/323: stat d1/d3f 0 2024-02-28T16:02:02.874 INFO:tasks.workunit.client.1.smithi087.stdout:6/729: fsync d4/d12/d45/d57/fbb 0 2024-02-28T16:02:02.875 INFO:tasks.workunit.client.0.smithi057.stdout:0/475: write d6/d12/d17/f37 [1848332,47855] 0 2024-02-28T16:02:02.875 INFO:tasks.workunit.client.0.smithi057.stdout:6/252: write df/d14/d15/d16/f49 [175243,7460] 0 2024-02-28T16:02:02.876 INFO:tasks.workunit.client.1.smithi087.stdout:4/802: chown d2/d9/da/f2d 446365929 1 2024-02-28T16:02:02.876 INFO:tasks.workunit.client.0.smithi057.stdout:7/227: chown d6/dc/d12/d1a/f24 1913941377 1 2024-02-28T16:02:02.877 INFO:tasks.workunit.client.0.smithi057.stdout:3/284: rmdir d8/dd/d14/d2e 39 2024-02-28T16:02:02.878 INFO:tasks.workunit.client.1.smithi087.stdout:0/660: read d4/dd/d21/d32/f7a [584524,66993] 0 2024-02-28T16:02:02.880 INFO:tasks.workunit.client.0.smithi057.stdout:6/253: rename df/d14/d15 to df/d14/d15/d16/d54 22 2024-02-28T16:02:02.883 INFO:tasks.workunit.client.0.smithi057.stdout:4/324: creat d1/d10/d12/d2c/d50/f6c x:0 0 0 2024-02-28T16:02:02.883 INFO:tasks.workunit.client.0.smithi057.stdout:6/254: chown df/d10/l35 2 1 2024-02-28T16:02:02.883 INFO:tasks.workunit.client.0.smithi057.stdout:0/476: mknod d6/d12/d5d/d7f/ca1 0 2024-02-28T16:02:02.883 INFO:tasks.workunit.client.1.smithi087.stdout:6/730: fdatasync d4/d30/d13/d38/f64 0 2024-02-28T16:02:02.883 INFO:tasks.workunit.client.1.smithi087.stdout:0/661: truncate d4/f48 4307918 0 2024-02-28T16:02:02.883 INFO:tasks.workunit.client.1.smithi087.stdout:4/803: mknod d2/d9/d10/dbf/db6/c104 0 2024-02-28T16:02:02.885 INFO:tasks.workunit.client.0.smithi057.stdout:4/325: dread - d1/d3f/f5d zero size 2024-02-28T16:02:02.887 INFO:tasks.workunit.client.1.smithi087.stdout:0/662: rmdir d4 39 2024-02-28T16:02:02.887 INFO:tasks.workunit.client.0.smithi057.stdout:5/310: creat d2/d12/d5f/f68 x:0 0 0 2024-02-28T16:02:02.888 INFO:tasks.workunit.client.1.smithi087.stdout:5/792: dread d3/d64/d67/d7c/f99 [0,4194304] 0 2024-02-28T16:02:02.891 INFO:tasks.workunit.client.0.smithi057.stdout:0/477: rename d6/l7 to d6/d12/d5d/d7f/la2 0 2024-02-28T16:02:02.893 INFO:tasks.workunit.client.1.smithi087.stdout:6/731: fsync d4/d30/d13/f3b 0 2024-02-28T16:02:02.894 INFO:tasks.workunit.client.0.smithi057.stdout:7/228: write d6/dc/f10 [2829547,72898] 0 2024-02-28T16:02:02.894 INFO:tasks.workunit.client.0.smithi057.stdout:4/326: unlink d1/c13 0 2024-02-28T16:02:02.896 INFO:tasks.workunit.client.1.smithi087.stdout:7/671: dwrite d14/d2e/d2b/d4e/fbf [0,4194304] 0 2024-02-28T16:02:02.897 INFO:tasks.workunit.client.1.smithi087.stdout:0/663: mkdir d4/dd/d21/d9b/dda 0 2024-02-28T16:02:02.900 INFO:tasks.workunit.client.0.smithi057.stdout:0/478: write d6/d12/d38/f52 [2266508,111329] 0 2024-02-28T16:02:02.900 INFO:tasks.workunit.client.0.smithi057.stdout:3/285: rmdir d8/dd/d14/d2e/d2f 39 2024-02-28T16:02:02.900 INFO:tasks.workunit.client.0.smithi057.stdout:7/229: fdatasync d6/dc/f34 0 2024-02-28T16:02:02.901 INFO:tasks.workunit.client.1.smithi087.stdout:7/672: mknod d14/d27/d5d/d6a/ccb 0 2024-02-28T16:02:02.904 INFO:tasks.workunit.client.1.smithi087.stdout:0/664: mkdir d4/d6/ddb 0 2024-02-28T16:02:02.905 INFO:tasks.workunit.client.0.smithi057.stdout:2/295: dwrite d19/d1d/f3f [0,4194304] 0 2024-02-28T16:02:02.905 INFO:tasks.workunit.client.1.smithi087.stdout:6/732: rename d4/d30/d13/caa to d4/d12/d45/d92/dc1/dcf/cee 0 2024-02-28T16:02:02.906 INFO:tasks.workunit.client.1.smithi087.stdout:9/661: write d7/dc/f7d [963978,105380] 0 2024-02-28T16:02:02.907 INFO:tasks.workunit.client.0.smithi057.stdout:3/286: read - d8/dd/d19/f29 zero size 2024-02-28T16:02:02.908 INFO:tasks.workunit.client.1.smithi087.stdout:7/673: mknod d14/d2e/d2b/d57/ccc 0 2024-02-28T16:02:02.910 INFO:tasks.workunit.client.1.smithi087.stdout:9/662: chown d7/dd/d3c/d4c/da1/fb7 5 1 2024-02-28T16:02:02.911 INFO:tasks.workunit.client.1.smithi087.stdout:7/674: dread - d14/d2e/d2b/d4e/fb1 zero size 2024-02-28T16:02:02.914 INFO:tasks.workunit.client.0.smithi057.stdout:2/296: chown d19/d1d/d26/c39 539 1 2024-02-28T16:02:02.917 INFO:tasks.workunit.client.0.smithi057.stdout:6/255: dwrite f9 [0,4194304] 0 2024-02-28T16:02:02.918 INFO:tasks.workunit.client.1.smithi087.stdout:0/665: truncate d4/d6/f22 1397554 0 2024-02-28T16:02:02.921 INFO:tasks.workunit.client.0.smithi057.stdout:0/479: rmdir d6/d12/d17/d4b/d60/d6b 39 2024-02-28T16:02:02.921 INFO:tasks.workunit.client.0.smithi057.stdout:5/311: dwrite d2/f4a [0,4194304] 0 2024-02-28T16:02:02.921 INFO:tasks.workunit.client.0.smithi057.stdout:6/256: read - df/d10/d13/d4b/f51 zero size 2024-02-28T16:02:02.927 INFO:tasks.workunit.client.0.smithi057.stdout:0/480: mkdir d6/d12/d38/da3 0 2024-02-28T16:02:02.928 INFO:tasks.workunit.client.0.smithi057.stdout:4/327: link d1/d10/d12/l16 d1/d10/d12/d2c/l6d 0 2024-02-28T16:02:02.932 INFO:tasks.workunit.client.1.smithi087.stdout:7/675: symlink d14/d2e/dc0/lcd 0 2024-02-28T16:02:02.935 INFO:tasks.workunit.client.0.smithi057.stdout:2/297: link d19/d1d/d2e/d31/f50 d19/d2c/f56 0 2024-02-28T16:02:02.936 INFO:tasks.workunit.client.1.smithi087.stdout:6/733: link d4/d30/d9b/f9e d4/d30/fef 0 2024-02-28T16:02:02.936 INFO:tasks.workunit.client.1.smithi087.stdout:6/734: readlink d4/d12/d45/l31 0 2024-02-28T16:02:02.937 INFO:tasks.workunit.client.0.smithi057.stdout:3/287: getdents d8/dd/d14/d2c 0 2024-02-28T16:02:02.937 INFO:tasks.workunit.client.0.smithi057.stdout:6/257: rename df/d14/d15/d16/d39/l47 to df/d10/d13/l55 0 2024-02-28T16:02:02.937 INFO:tasks.workunit.client.1.smithi087.stdout:5/793: dwrite d3/d9/d9b/dba/f70 [0,4194304] 0 2024-02-28T16:02:02.939 INFO:tasks.workunit.client.0.smithi057.stdout:0/481: mkdir d6/d12/da4 0 2024-02-28T16:02:02.939 INFO:tasks.workunit.client.1.smithi087.stdout:7/676: creat d14/fce x:0 0 0 2024-02-28T16:02:02.941 INFO:tasks.workunit.client.1.smithi087.stdout:6/735: mknod d4/dc/d61/cf0 0 2024-02-28T16:02:02.942 INFO:tasks.workunit.client.0.smithi057.stdout:6/258: fsync df/f48 0 2024-02-28T16:02:02.943 INFO:tasks.workunit.client.0.smithi057.stdout:5/312: getdents d2 0 2024-02-28T16:02:02.944 INFO:tasks.workunit.client.1.smithi087.stdout:7/677: write d14/d2e/d2b/d4e/fc8 [314063,83820] 0 2024-02-28T16:02:02.946 INFO:tasks.workunit.client.0.smithi057.stdout:3/288: write d8/dd/d14/f50 [1803054,59016] 0 2024-02-28T16:02:02.948 INFO:tasks.workunit.client.1.smithi087.stdout:6/736: symlink d4/d30/d13/d38/d69/db0/lf1 0 2024-02-28T16:02:02.950 INFO:tasks.workunit.client.0.smithi057.stdout:2/298: getdents d19/d2c/d48 0 2024-02-28T16:02:02.950 INFO:tasks.workunit.client.0.smithi057.stdout:0/482: unlink d6/d12/d17/d34/l57 0 2024-02-28T16:02:02.950 INFO:tasks.workunit.client.0.smithi057.stdout:5/313: creat d2/d3e/d44/f69 x:0 0 0 2024-02-28T16:02:02.953 INFO:tasks.workunit.client.1.smithi087.stdout:4/804: dread d2/d9/f4d [0,4194304] 0 2024-02-28T16:02:02.953 INFO:tasks.workunit.client.1.smithi087.stdout:6/737: mkdir d4/dc/d61/d89/df2 0 2024-02-28T16:02:02.954 INFO:tasks.workunit.client.0.smithi057.stdout:3/289: rmdir d8/d26 39 2024-02-28T16:02:02.954 INFO:tasks.workunit.client.0.smithi057.stdout:5/314: write d2/d15/f43 [414264,15482] 0 2024-02-28T16:02:02.956 INFO:tasks.workunit.client.1.smithi087.stdout:9/663: truncate d7/dd/d3c/f53 2588256 0 2024-02-28T16:02:02.965 INFO:tasks.workunit.client.1.smithi087.stdout:5/794: dwrite d3/d9/d9b/dba/dca/fcb [0,4194304] 0 2024-02-28T16:02:02.966 INFO:tasks.workunit.client.0.smithi057.stdout:5/315: write d2/d15/d3b/f2f [1631638,126000] 0 2024-02-28T16:02:02.967 INFO:tasks.workunit.client.0.smithi057.stdout:3/290: symlink d8/dd/d14/d2e/d2f/l59 0 2024-02-28T16:02:02.968 INFO:tasks.workunit.client.1.smithi087.stdout:9/664: mkdir d7/dd/d15/d3f/d6d/dc2 0 2024-02-28T16:02:02.969 INFO:tasks.workunit.client.0.smithi057.stdout:2/299: dread d19/f1a [0,4194304] 0 2024-02-28T16:02:02.969 INFO:tasks.workunit.client.0.smithi057.stdout:7/230: write d6/dc/d12/f2d [441903,117593] 0 2024-02-28T16:02:02.970 INFO:tasks.workunit.client.0.smithi057.stdout:7/231: read d6/dc/d12/f47 [555569,35522] 0 2024-02-28T16:02:02.972 INFO:tasks.workunit.client.1.smithi087.stdout:0/666: dwrite d4/dd/d37/d39/fa1 [0,4194304] 0 2024-02-28T16:02:02.974 INFO:tasks.workunit.client.0.smithi057.stdout:5/316: fsync d2/d12/d3d/f3f 0 2024-02-28T16:02:02.974 INFO:tasks.workunit.client.1.smithi087.stdout:7/678: dwrite d14/d27/d5d/d6a/d83/f8a [0,4194304] 0 2024-02-28T16:02:02.975 INFO:tasks.workunit.client.1.smithi087.stdout:6/738: rename d4/dc/c5c to d4/d12/d45/d57/cf3 0 2024-02-28T16:02:02.975 INFO:tasks.workunit.client.0.smithi057.stdout:5/317: write d2/d19/d1c/f4d [3405060,92065] 0 2024-02-28T16:02:02.979 INFO:tasks.workunit.client.0.smithi057.stdout:3/291: rename d8/dd/d14/d2e/d2f/f35 to d8/dd/d14/d2e/d2f/f5a 0 2024-02-28T16:02:02.981 INFO:tasks.workunit.client.1.smithi087.stdout:1/654: sync 2024-02-28T16:02:02.981 INFO:tasks.workunit.client.0.smithi057.stdout:3/292: chown d8/dd/d14/d2e/d3b/d54 330246046 1 2024-02-28T16:02:02.988 INFO:tasks.workunit.client.0.smithi057.stdout:6/259: write df/d10/d13/f1e [3367569,35850] 0 2024-02-28T16:02:02.989 INFO:tasks.workunit.client.1.smithi087.stdout:1/655: readlink d0/d1b/d43/laa 0 2024-02-28T16:02:02.992 INFO:tasks.workunit.client.0.smithi057.stdout:6/260: write df/d10/d13/d4b/f51 [232936,130457] 0 2024-02-28T16:02:02.993 INFO:tasks.workunit.client.1.smithi087.stdout:1/656: creat d0/d1a/d28/d9b/fdd x:0 0 0 2024-02-28T16:02:02.993 INFO:tasks.workunit.client.0.smithi057.stdout:7/232: creat d6/dc/d35/f51 x:0 0 0 2024-02-28T16:02:02.995 INFO:tasks.workunit.client.0.smithi057.stdout:4/328: dwrite d1/d14/f34 [0,4194304] 0 2024-02-28T16:02:02.996 INFO:tasks.workunit.client.1.smithi087.stdout:1/657: unlink d0/d1b/f79 0 2024-02-28T16:02:02.999 INFO:tasks.workunit.client.1.smithi087.stdout:1/658: stat d0/d1b/d1f/d96/d63/lc2 0 2024-02-28T16:02:03.003 INFO:tasks.workunit.client.1.smithi087.stdout:7/679: dwrite fc [0,4194304] 0 2024-02-28T16:02:03.005 INFO:tasks.workunit.client.0.smithi057.stdout:5/318: mkdir d2/d8/d6a 0 2024-02-28T16:02:03.009 INFO:tasks.workunit.client.0.smithi057.stdout:4/329: readlink d1/d10/d12/d2c/l6d 0 2024-02-28T16:02:03.014 INFO:tasks.workunit.client.1.smithi087.stdout:4/805: truncate d2/d9/d9e/fba 333036 0 2024-02-28T16:02:03.016 INFO:tasks.workunit.client.1.smithi087.stdout:1/659: creat d0/d1b/d1f/d71/db2/d24/d78/fde x:0 0 0 2024-02-28T16:02:03.017 INFO:tasks.workunit.client.1.smithi087.stdout:5/795: dwrite d3/d9/d9b/dba/d30/d36/d4f/d82/ff4 [0,4194304] 0 2024-02-28T16:02:03.018 INFO:tasks.workunit.client.0.smithi057.stdout:2/300: rmdir d19/d1d/d2e/d55 0 2024-02-28T16:02:03.018 INFO:tasks.workunit.client.0.smithi057.stdout:3/293: creat d8/dd/d14/d2e/d3b/d54/f5b x:0 0 0 2024-02-28T16:02:03.019 INFO:tasks.workunit.client.0.smithi057.stdout:6/261: dwrite df/d14/d15/d16/f4c [0,4194304] 0 2024-02-28T16:02:03.019 INFO:tasks.workunit.client.1.smithi087.stdout:0/667: dwrite d4/dd/fba [0,4194304] 0 2024-02-28T16:02:03.019 INFO:tasks.workunit.client.1.smithi087.stdout:1/660: stat d0/d1b/d1f/c2d 0 2024-02-28T16:02:03.020 INFO:tasks.workunit.client.0.smithi057.stdout:7/233: link d6/d38/f44 d6/dc/d12/d29/f52 0 2024-02-28T16:02:03.021 INFO:tasks.workunit.client.1.smithi087.stdout:7/680: link d14/d2e/d2b/f51 d14/d21/d4f/fcf 0 2024-02-28T16:02:03.025 INFO:tasks.workunit.client.0.smithi057.stdout:5/319: symlink d2/d15/d3b/l6b 0 2024-02-28T16:02:03.031 INFO:tasks.workunit.client.0.smithi057.stdout:2/301: mkdir d19/d57 0 2024-02-28T16:02:03.034 INFO:tasks.workunit.client.1.smithi087.stdout:6/739: dread d4/dc/d10/f3d [0,4194304] 0 2024-02-28T16:02:03.034 INFO:tasks.workunit.client.1.smithi087.stdout:4/806: symlink d2/d9/d10/d22/d5b/d5c/d90/l105 0 2024-02-28T16:02:03.035 INFO:tasks.workunit.client.0.smithi057.stdout:6/262: creat df/d14/d15/d16/f56 x:0 0 0 2024-02-28T16:02:03.036 INFO:tasks.workunit.client.1.smithi087.stdout:5/796: getdents d3/d102 0 2024-02-28T16:02:03.036 INFO:tasks.workunit.client.1.smithi087.stdout:6/740: readlink d4/ld0 0 2024-02-28T16:02:03.038 INFO:tasks.workunit.client.1.smithi087.stdout:7/681: chown d14/d21/d4f/c8b 198332564 1 2024-02-28T16:02:03.038 INFO:tasks.workunit.client.1.smithi087.stdout:1/661: creat d0/d1b/fdf x:0 0 0 2024-02-28T16:02:03.038 INFO:tasks.workunit.client.1.smithi087.stdout:4/807: fsync d2/d9/f2c 0 2024-02-28T16:02:03.042 INFO:tasks.workunit.client.1.smithi087.stdout:4/808: chown d2/d9/da/d1a/d26/c88 929200 1 2024-02-28T16:02:03.043 INFO:tasks.workunit.client.1.smithi087.stdout:5/797: creat d3/d9/d9b/dba/d69/d87/f125 x:0 0 0 2024-02-28T16:02:03.044 INFO:tasks.workunit.client.1.smithi087.stdout:0/668: getdents d4/dd/d37/d39/d3a/d57/d74/d1f/d60 0 2024-02-28T16:02:03.044 INFO:tasks.workunit.client.1.smithi087.stdout:9/665: dread d7/dd/d15/d3f/d5f/f8f [0,4194304] 0 2024-02-28T16:02:03.045 INFO:tasks.workunit.client.0.smithi057.stdout:7/234: symlink d6/dc/l53 0 2024-02-28T16:02:03.047 INFO:tasks.workunit.client.1.smithi087.stdout:1/662: creat d0/d1b/d1f/d71/db2/db3/fe0 x:0 0 0 2024-02-28T16:02:03.049 INFO:tasks.workunit.client.1.smithi087.stdout:9/666: write d7/f8 [607056,128092] 0 2024-02-28T16:02:03.050 INFO:tasks.workunit.client.1.smithi087.stdout:7/682: creat d14/d21/d4f/fd0 x:0 0 0 2024-02-28T16:02:03.051 INFO:tasks.workunit.client.1.smithi087.stdout:4/809: mkdir d2/d9/d9e/d106 0 2024-02-28T16:02:03.053 INFO:tasks.workunit.client.1.smithi087.stdout:5/798: truncate d3/d9/d9b/dba/d69/ffe 365567 0 2024-02-28T16:02:03.055 INFO:tasks.workunit.client.1.smithi087.stdout:8/741: sync 2024-02-28T16:02:03.055 INFO:tasks.workunit.client.1.smithi087.stdout:2/648: sync 2024-02-28T16:02:03.055 INFO:tasks.workunit.client.1.smithi087.stdout:3/754: sync 2024-02-28T16:02:03.055 INFO:tasks.workunit.client.0.smithi057.stdout:7/235: chown d6/d26/l45 7 1 2024-02-28T16:02:03.057 INFO:tasks.workunit.client.1.smithi087.stdout:7/683: dread d14/d27/d5d/f99 [0,4194304] 0 2024-02-28T16:02:03.061 INFO:tasks.workunit.client.1.smithi087.stdout:7/684: chown d14/fce 472 1 2024-02-28T16:02:03.062 INFO:tasks.workunit.client.1.smithi087.stdout:6/741: rmdir d4/d12/d45/d74/d9a/db6 0 2024-02-28T16:02:03.062 INFO:tasks.workunit.client.1.smithi087.stdout:0/669: write d4/dd/f1b [6189747,86759] 0 2024-02-28T16:02:03.063 INFO:tasks.workunit.client.0.smithi057.stdout:7/236: chown d6/dc/d35/c41 2014 1 2024-02-28T16:02:03.065 INFO:tasks.workunit.client.1.smithi087.stdout:7/685: write d14/d21/f41 [3457591,43231] 0 2024-02-28T16:02:03.068 INFO:tasks.workunit.client.1.smithi087.stdout:7/686: chown d14/d2e/d2b/d4e/fbf 4754836 1 2024-02-28T16:02:03.069 INFO:tasks.workunit.client.1.smithi087.stdout:9/667: dread d7/dd/d36/f4f [0,4194304] 0 2024-02-28T16:02:03.070 INFO:tasks.workunit.client.0.smithi057.stdout:7/237: mkdir d6/d26/d54 0 2024-02-28T16:02:03.072 INFO:tasks.workunit.client.0.smithi057.stdout:2/302: dwrite d19/d1d/d2e/d31/f40 [0,4194304] 0 2024-02-28T16:02:03.072 INFO:tasks.workunit.client.0.smithi057.stdout:4/330: dwrite d1/d10/d31/d36/f59 [0,4194304] 0 2024-02-28T16:02:03.074 INFO:tasks.workunit.client.0.smithi057.stdout:5/320: truncate d2/d19/d1c/f34 3306353 0 2024-02-28T16:02:03.074 INFO:tasks.workunit.client.0.smithi057.stdout:7/238: fsync d6/dc/d35/f46 0 2024-02-28T16:02:03.074 INFO:tasks.workunit.client.0.smithi057.stdout:6/263: dread df/d10/d13/f3a [0,4194304] 0 2024-02-28T16:02:03.077 INFO:tasks.workunit.client.0.smithi057.stdout:7/239: readlink d6/l9 0 2024-02-28T16:02:03.079 INFO:tasks.workunit.client.0.smithi057.stdout:3/294: dwrite f4 [0,4194304] 0 2024-02-28T16:02:03.081 INFO:tasks.workunit.client.1.smithi087.stdout:2/649: rename d2/d7/d17/ca2 to d2/d99/d28/d79/cee 0 2024-02-28T16:02:03.082 INFO:tasks.workunit.client.0.smithi057.stdout:4/331: chown d1/d14/c69 961696 1 2024-02-28T16:02:03.083 INFO:tasks.workunit.client.0.smithi057.stdout:2/303: creat d19/d2c/f58 x:0 0 0 2024-02-28T16:02:03.084 INFO:tasks.workunit.client.1.smithi087.stdout:7/687: mkdir d14/d30/dd1 0 2024-02-28T16:02:03.086 INFO:tasks.workunit.client.0.smithi057.stdout:6/264: symlink df/d14/d15/l57 0 2024-02-28T16:02:03.086 INFO:tasks.workunit.client.0.smithi057.stdout:9/373: sync 2024-02-28T16:02:03.086 INFO:tasks.workunit.client.1.smithi087.stdout:9/668: chown d7/dd/d15/d79/c66 162287 1 2024-02-28T16:02:03.086 INFO:tasks.workunit.client.1.smithi087.stdout:6/742: unlink d4/d12/d45/f8a 0 2024-02-28T16:02:03.087 INFO:tasks.workunit.client.1.smithi087.stdout:2/650: chown d2/d7/d17/d34/d88/ca7 592314799 1 2024-02-28T16:02:03.088 INFO:tasks.workunit.client.1.smithi087.stdout:4/810: getdents d2/df/d65 0 2024-02-28T16:02:03.089 INFO:tasks.workunit.client.1.smithi087.stdout:3/755: link d11/f31 d11/d61/fff 0 2024-02-28T16:02:03.090 INFO:tasks.workunit.client.0.smithi057.stdout:9/374: fsync d2/d24/ff 0 2024-02-28T16:02:03.094 INFO:tasks.workunit.client.1.smithi087.stdout:8/742: dwrite d2/d9/d5e/dbc/fd4 [0,4194304] 0 2024-02-28T16:02:03.094 INFO:tasks.workunit.client.1.smithi087.stdout:0/670: mkdir d4/dd/ddc 0 2024-02-28T16:02:03.096 INFO:tasks.workunit.client.0.smithi057.stdout:3/295: symlink d8/dd/d14/d2e/d30/d49/d51/l5c 0 2024-02-28T16:02:03.096 INFO:tasks.workunit.client.0.smithi057.stdout:7/240: dread d6/dc/d12/f2d [0,4194304] 0 2024-02-28T16:02:03.097 INFO:tasks.workunit.client.1.smithi087.stdout:6/743: unlink d4/d30/l2c 0 2024-02-28T16:02:03.099 INFO:tasks.workunit.client.0.smithi057.stdout:6/265: unlink df/d14/d15/d16/f4c 0 2024-02-28T16:02:03.099 INFO:tasks.workunit.client.1.smithi087.stdout:8/743: truncate d2/d9/d5e/d9c/fe4 958215 0 2024-02-28T16:02:03.101 INFO:tasks.workunit.client.1.smithi087.stdout:8/744: chown d2/d33/de6/d67 7673 1 2024-02-28T16:02:03.102 INFO:tasks.workunit.client.1.smithi087.stdout:9/669: truncate d7/dd/d3c/d4c/da1/f73 1226910 0 2024-02-28T16:02:03.104 INFO:tasks.workunit.client.0.smithi057.stdout:6/266: write df/d10/d13/f1e [3453742,22694] 0 2024-02-28T16:02:03.106 INFO:tasks.workunit.client.1.smithi087.stdout:6/744: write d4/d12/d45/d92/f94 [932336,90631] 0 2024-02-28T16:02:03.107 INFO:tasks.workunit.client.0.smithi057.stdout:5/321: dwrite d2/d19/d1c/f2c [0,4194304] 0 2024-02-28T16:02:03.107 INFO:tasks.workunit.client.1.smithi087.stdout:8/745: symlink d2/d63/d9b/dae/dca/lf2 0 2024-02-28T16:02:03.108 INFO:tasks.workunit.client.0.smithi057.stdout:6/267: write df/d14/f43 [481372,14272] 0 2024-02-28T16:02:03.109 INFO:tasks.workunit.client.1.smithi087.stdout:9/670: mknod d7/d1e/d44/d83/cc3 0 2024-02-28T16:02:03.111 INFO:tasks.workunit.client.1.smithi087.stdout:9/671: chown d7/d1e/d44/d76/c6e 3257 1 2024-02-28T16:02:03.111 INFO:tasks.workunit.client.1.smithi087.stdout:6/745: unlink d4/d12/d45/f39 0 2024-02-28T16:02:03.114 INFO:tasks.workunit.client.1.smithi087.stdout:9/672: fdatasync d7/d1e/f51 0 2024-02-28T16:02:03.114 INFO:tasks.workunit.client.1.smithi087.stdout:8/746: creat d2/d33/dd1/ff3 x:0 0 0 2024-02-28T16:02:03.114 INFO:tasks.workunit.client.1.smithi087.stdout:6/746: chown d4/d30/d13/d38/dc3 877 1 2024-02-28T16:02:03.119 INFO:tasks.workunit.client.0.smithi057.stdout:4/332: link d1/d10/d12/d2c/d50/c49 d1/d22/c6e 0 2024-02-28T16:02:03.119 INFO:tasks.workunit.client.0.smithi057.stdout:5/322: rmdir d2/d12/d5f 39 2024-02-28T16:02:03.120 INFO:tasks.workunit.client.1.smithi087.stdout:9/673: write d7/f8 [1253594,36630] 0 2024-02-28T16:02:03.125 INFO:tasks.workunit.client.0.smithi057.stdout:9/375: write d2/d5/d9/f1c [480154,58628] 0 2024-02-28T16:02:03.126 INFO:tasks.workunit.client.1.smithi087.stdout:8/747: fsync d2/d33/de6/f46 0 2024-02-28T16:02:03.127 INFO:tasks.workunit.client.0.smithi057.stdout:8/355: sync 2024-02-28T16:02:03.127 INFO:tasks.workunit.client.0.smithi057.stdout:1/342: sync 2024-02-28T16:02:03.128 INFO:tasks.workunit.client.0.smithi057.stdout:4/333: symlink d1/d10/d12/d39/l6f 0 2024-02-28T16:02:03.130 INFO:tasks.workunit.client.1.smithi087.stdout:1/663: dread d0/d1b/d1f/fa9 [0,4194304] 0 2024-02-28T16:02:03.131 INFO:tasks.workunit.client.0.smithi057.stdout:5/323: creat d2/d8/f6c x:0 0 0 2024-02-28T16:02:03.133 INFO:tasks.workunit.client.1.smithi087.stdout:6/747: fsync d4/d12/d45/d5e/fb4 0 2024-02-28T16:02:03.135 INFO:tasks.workunit.client.0.smithi057.stdout:6/268: fdatasync df/d10/d13/f1e 0 2024-02-28T16:02:03.136 INFO:tasks.workunit.client.1.smithi087.stdout:9/674: getdents d7/d1e/d44/d83/db0 0 2024-02-28T16:02:03.137 INFO:tasks.workunit.client.1.smithi087.stdout:6/748: chown d4/d30/d13/d38/d69/fda 7888430 1 2024-02-28T16:02:03.138 INFO:tasks.workunit.client.0.smithi057.stdout:8/356: symlink d5/de/d1b/l7f 0 2024-02-28T16:02:03.139 INFO:tasks.workunit.client.0.smithi057.stdout:2/304: dwrite d19/d1d/d2e/d31/f50 [0,4194304] 0 2024-02-28T16:02:03.139 INFO:tasks.workunit.client.0.smithi057.stdout:6/269: chown df/d10/c3f 226401 1 2024-02-28T16:02:03.140 INFO:tasks.workunit.client.1.smithi087.stdout:9/675: chown d7/dc/l4d 724811 1 2024-02-28T16:02:03.143 INFO:tasks.workunit.client.0.smithi057.stdout:4/334: mknod d1/d10/d12/d2c/c70 0 2024-02-28T16:02:03.143 INFO:tasks.workunit.client.1.smithi087.stdout:2/651: write d2/d7/f15 [8045012,70516] 0 2024-02-28T16:02:03.143 INFO:tasks.workunit.client.1.smithi087.stdout:8/748: mkdir d2/d63/d9b/dae/db1/df4 0 2024-02-28T16:02:03.144 INFO:tasks.workunit.client.1.smithi087.stdout:2/652: stat d2/d7/d17/d34/f4a 0 2024-02-28T16:02:03.145 INFO:tasks.workunit.client.1.smithi087.stdout:7/688: truncate d14/d27/d5d/f70 242764 0 2024-02-28T16:02:03.147 INFO:tasks.workunit.client.1.smithi087.stdout:2/653: dread - d2/d99/fe7 zero size 2024-02-28T16:02:03.151 INFO:tasks.workunit.client.0.smithi057.stdout:3/296: dwrite d8/dd/d14/f20 [0,4194304] 0 2024-02-28T16:02:03.151 INFO:tasks.workunit.client.0.smithi057.stdout:9/376: getdents d2/d5 0 2024-02-28T16:02:03.151 INFO:tasks.workunit.client.1.smithi087.stdout:9/676: unlink d7/dd/d15/f5a 0 2024-02-28T16:02:03.156 INFO:tasks.workunit.client.0.smithi057.stdout:7/241: dwrite d6/dc/d12/d1a/f24 [4194304,4194304] 0 2024-02-28T16:02:03.156 INFO:tasks.workunit.client.0.smithi057.stdout:6/270: mknod df/d10/d13/c58 0 2024-02-28T16:02:03.156 INFO:tasks.workunit.client.0.smithi057.stdout:5/324: rmdir d2/d8/d6a 0 2024-02-28T16:02:03.158 INFO:tasks.workunit.client.0.smithi057.stdout:4/335: rmdir d1/d10/d12/d15 39 2024-02-28T16:02:03.159 INFO:tasks.workunit.client.1.smithi087.stdout:6/749: dread d4/d30/d13/d38/f4e [0,4194304] 0 2024-02-28T16:02:03.163 INFO:tasks.workunit.client.0.smithi057.stdout:9/377: dread - d2/d5/d1b/d2e/f45 zero size 2024-02-28T16:02:03.166 INFO:tasks.workunit.client.1.smithi087.stdout:3/756: dwrite d11/d61/d7c/f84 [0,4194304] 0 2024-02-28T16:02:03.166 INFO:tasks.workunit.client.0.smithi057.stdout:8/357: rename d5/d20/d39/d49/d56/c50 to d5/d62/c80 0 2024-02-28T16:02:03.170 INFO:tasks.workunit.client.0.smithi057.stdout:6/271: stat df/d14/d15/d16/f33 0 2024-02-28T16:02:03.171 INFO:tasks.workunit.client.0.smithi057.stdout:4/336: readlink d1/d10/d12/d15/l38 0 2024-02-28T16:02:03.173 INFO:tasks.workunit.client.0.smithi057.stdout:5/325: mkdir d2/d15/d5e/d6d 0 2024-02-28T16:02:03.176 INFO:tasks.workunit.client.0.smithi057.stdout:7/242: symlink d6/d38/l55 0 2024-02-28T16:02:03.177 INFO:tasks.workunit.client.1.smithi087.stdout:8/749: truncate d2/d9/f17 958102 0 2024-02-28T16:02:03.177 INFO:tasks.workunit.client.0.smithi057.stdout:6/272: chown df/d14 1 1 2024-02-28T16:02:03.177 INFO:tasks.workunit.client.0.smithi057.stdout:8/358: chown d5/de/d1b/d57/f78 11173064 1 2024-02-28T16:02:03.178 INFO:tasks.workunit.client.0.smithi057.stdout:3/297: symlink d8/dd/d19/d25/l5d 0 2024-02-28T16:02:03.181 INFO:tasks.workunit.client.0.smithi057.stdout:2/305: dwrite d19/d3a/f46 [0,4194304] 0 2024-02-28T16:02:03.186 INFO:tasks.workunit.client.1.smithi087.stdout:1/664: dwrite d0/d1b/d43/d4d/fa8 [0,4194304] 0 2024-02-28T16:02:03.189 INFO:tasks.workunit.client.0.smithi057.stdout:5/326: creat d2/d12/d3d/f6e x:0 0 0 2024-02-28T16:02:03.191 INFO:tasks.workunit.client.0.smithi057.stdout:4/337: unlink d1/d10/d12/d15/l1c 0 2024-02-28T16:02:03.193 INFO:tasks.workunit.client.0.smithi057.stdout:3/298: creat d8/dd/d19/f5e x:0 0 0 2024-02-28T16:02:03.193 INFO:tasks.workunit.client.0.smithi057.stdout:1/343: dwrite d1/d21/d66/f2f [0,4194304] 0 2024-02-28T16:02:03.193 INFO:tasks.workunit.client.0.smithi057.stdout:8/359: write d5/de/d1b/d57/f5e [976372,121078] 0 2024-02-28T16:02:03.195 INFO:tasks.workunit.client.1.smithi087.stdout:1/665: read d0/d14/f18 [10787,65211] 0 2024-02-28T16:02:03.195 INFO:tasks.workunit.client.0.smithi057.stdout:7/243: chown d6/dc/d35/c41 914074720 1 2024-02-28T16:02:03.200 INFO:tasks.workunit.client.1.smithi087.stdout:9/677: write d7/dd/d15/d79/f16 [1125255,87161] 0 2024-02-28T16:02:03.207 INFO:tasks.workunit.client.0.smithi057.stdout:0/483: sync 2024-02-28T16:02:03.209 INFO:tasks.workunit.client.1.smithi087.stdout:7/689: dwrite d14/d2e/d2b/d4e/f52 [0,4194304] 0 2024-02-28T16:02:03.209 INFO:tasks.workunit.client.0.smithi057.stdout:6/273: creat df/d14/d15/d16/d39/f59 x:0 0 0 2024-02-28T16:02:03.226 INFO:tasks.workunit.client.0.smithi057.stdout:5/327: mknod d2/d8/c6f 0 2024-02-28T16:02:03.226 INFO:tasks.workunit.client.0.smithi057.stdout:3/299: unlink f4 0 2024-02-28T16:02:03.237 INFO:tasks.workunit.client.0.smithi057.stdout:0/484: dwrite d6/d12/d45/d78/f9d [0,4194304] 0 2024-02-28T16:02:03.238 INFO:tasks.workunit.client.0.smithi057.stdout:1/344: chown d1/d21/f39 23557 1 2024-02-28T16:02:03.241 INFO:tasks.workunit.client.0.smithi057.stdout:3/300: dread d8/dd/d19/d25/f2b [0,4194304] 0 2024-02-28T16:02:03.241 INFO:tasks.workunit.client.0.smithi057.stdout:1/345: fdatasync d1/f7 0 2024-02-28T16:02:03.243 INFO:tasks.workunit.client.0.smithi057.stdout:5/328: write d2/f13 [252344,26885] 0 2024-02-28T16:02:03.245 INFO:tasks.workunit.client.0.smithi057.stdout:1/346: write d1/d21/d66/f2f [4149463,78396] 0 2024-02-28T16:02:03.246 INFO:tasks.workunit.client.0.smithi057.stdout:0/485: read d6/d12/d17/d34/f76 [3145387,131072] 0 2024-02-28T16:02:03.247 INFO:tasks.workunit.client.0.smithi057.stdout:7/244: mkdir d6/dc/d12/d1a/d4d/d56 0 2024-02-28T16:02:03.248 INFO:tasks.workunit.client.0.smithi057.stdout:6/274: mknod df/c5a 0 2024-02-28T16:02:03.251 INFO:tasks.workunit.client.0.smithi057.stdout:7/245: write d6/dc/f43 [1045516,18276] 0 2024-02-28T16:02:03.255 INFO:tasks.workunit.client.1.smithi087.stdout:6/750: fsync d4/d12/d45/d92/f94 0 2024-02-28T16:02:03.257 INFO:tasks.workunit.client.1.smithi087.stdout:1/666: truncate d0/d14/f93 692980 0 2024-02-28T16:02:03.258 INFO:tasks.workunit.client.0.smithi057.stdout:4/338: creat d1/d10/f71 x:0 0 0 2024-02-28T16:02:03.261 INFO:tasks.workunit.client.1.smithi087.stdout:9/678: fsync d7/dd/d15/f1f 0 2024-02-28T16:02:03.262 INFO:tasks.workunit.client.0.smithi057.stdout:9/378: dwrite d2/f20 [0,4194304] 0 2024-02-28T16:02:03.264 INFO:tasks.workunit.client.1.smithi087.stdout:7/690: creat d14/d30/fd2 x:0 0 0 2024-02-28T16:02:03.265 INFO:tasks.workunit.client.0.smithi057.stdout:5/329: read d2/f13 [1245729,48141] 0 2024-02-28T16:02:03.269 INFO:tasks.workunit.client.0.smithi057.stdout:1/347: read d1/d3/dc/d15/f17 [2448815,2535] 0 2024-02-28T16:02:03.269 INFO:tasks.workunit.client.0.smithi057.stdout:0/486: write d6/d12/d17/d4b/d60/f73 [1178561,121665] 0 2024-02-28T16:02:03.270 INFO:tasks.workunit.client.0.smithi057.stdout:7/246: chown d6/dc/d35 1461293 1 2024-02-28T16:02:03.271 INFO:tasks.workunit.client.1.smithi087.stdout:1/667: rename d0/d1a/d28/f9f to d0/d14/d3f/dd5/fe1 0 2024-02-28T16:02:03.274 INFO:tasks.workunit.client.0.smithi057.stdout:6/275: mkdir df/d14/d15/d3d/d5b 0 2024-02-28T16:02:03.276 INFO:tasks.workunit.client.0.smithi057.stdout:9/379: symlink d2/d5/d9/d5d/l7a 0 2024-02-28T16:02:03.281 INFO:tasks.workunit.client.1.smithi087.stdout:1/668: symlink d0/d1b/d1f/d71/db2/dae/le2 0 2024-02-28T16:02:03.282 INFO:tasks.workunit.client.1.smithi087.stdout:3/757: getdents d11/d33/d67/d98 0 2024-02-28T16:02:03.283 INFO:tasks.workunit.client.0.smithi057.stdout:3/301: dwrite d8/dd/f1f [0,4194304] 0 2024-02-28T16:02:03.283 INFO:tasks.workunit.client.0.smithi057.stdout:4/339: rename d1/d14/f34 to d1/d3f/d5f/f72 0 2024-02-28T16:02:03.285 INFO:tasks.workunit.client.0.smithi057.stdout:3/302: chown d8/dd/d14/d2e/d2f 165428825 1 2024-02-28T16:02:03.285 INFO:tasks.workunit.client.1.smithi087.stdout:7/691: symlink d14/d27/d55/dc5/ld3 0 2024-02-28T16:02:03.287 INFO:tasks.workunit.client.1.smithi087.stdout:6/751: read d4/dc/d61/f63 [3159424,69939] 0 2024-02-28T16:02:03.289 INFO:tasks.workunit.client.1.smithi087.stdout:1/669: mkdir d0/d1b/d43/de3 0 2024-02-28T16:02:03.289 INFO:tasks.workunit.client.0.smithi057.stdout:3/303: dread - d8/dd/d19/f29 zero size 2024-02-28T16:02:03.292 INFO:tasks.workunit.client.1.smithi087.stdout:9/679: rename d7/dd/d15/d3f/d6d/dc0 to d7/d1e/dc4 0 2024-02-28T16:02:03.293 INFO:tasks.workunit.client.0.smithi057.stdout:0/487: dread d6/d12/f7a [0,4194304] 0 2024-02-28T16:02:03.294 INFO:tasks.workunit.client.1.smithi087.stdout:7/692: mkdir d14/d27/d5d/d6a/d83/d96/dd4 0 2024-02-28T16:02:03.295 INFO:tasks.workunit.client.1.smithi087.stdout:8/750: write d2/d18/f3c [1563006,71965] 0 2024-02-28T16:02:03.299 INFO:tasks.workunit.client.1.smithi087.stdout:1/670: creat d0/d1b/d1f/d71/fe4 x:0 0 0 2024-02-28T16:02:03.300 INFO:tasks.workunit.client.1.smithi087.stdout:9/680: dread - d7/d1e/d60/f87 zero size 2024-02-28T16:02:03.301 INFO:tasks.workunit.client.1.smithi087.stdout:1/671: write d0/d14/f42 [4812710,129447] 0 2024-02-28T16:02:03.302 INFO:tasks.workunit.client.0.smithi057.stdout:4/340: dwrite d1/d10/d12/d15/f5b [0,4194304] 0 2024-02-28T16:02:03.303 INFO:tasks.workunit.client.1.smithi087.stdout:6/752: mknod d4/d12/d45/d92/de5/cf4 0 2024-02-28T16:02:03.305 INFO:tasks.workunit.client.0.smithi057.stdout:4/341: fsync d1/d22/f2a 0 2024-02-28T16:02:03.306 INFO:tasks.workunit.client.1.smithi087.stdout:3/758: write d11/d3a/d3c/fc2 [2740261,109475] 0 2024-02-28T16:02:03.308 INFO:tasks.workunit.client.0.smithi057.stdout:9/380: dread d2/d5/d1b/d2e/f53 [0,4194304] 0 2024-02-28T16:02:03.308 INFO:tasks.workunit.client.1.smithi087.stdout:5/799: sync 2024-02-28T16:02:03.309 INFO:tasks.workunit.client.1.smithi087.stdout:8/751: mkdir d2/d18/df5 0 2024-02-28T16:02:03.310 INFO:tasks.workunit.client.1.smithi087.stdout:6/753: chown d4/l6 224 1 2024-02-28T16:02:03.312 INFO:tasks.workunit.client.1.smithi087.stdout:1/672: rename d0/d1a/d28/l31 to d0/d14/d48/le5 0 2024-02-28T16:02:03.312 INFO:tasks.workunit.client.1.smithi087.stdout:8/752: write d2/d18/d42/dbb/fcc [1373036,67436] 0 2024-02-28T16:02:03.313 INFO:tasks.workunit.client.0.smithi057.stdout:0/488: dwrite d6/d12/d38/f89 [0,4194304] 0 2024-02-28T16:02:03.316 INFO:tasks.workunit.client.1.smithi087.stdout:8/753: chown d2/d18/d42/d7b 53154886 1 2024-02-28T16:02:03.316 INFO:tasks.workunit.client.1.smithi087.stdout:5/800: symlink d3/d9/d9b/dba/d69/l126 0 2024-02-28T16:02:03.317 INFO:tasks.workunit.client.0.smithi057.stdout:0/489: write d6/d12/d17/d58/f6e [935757,89976] 0 2024-02-28T16:02:03.320 INFO:tasks.workunit.client.1.smithi087.stdout:6/754: dread - d4/d30/d13/d38/d69/f79 zero size 2024-02-28T16:02:03.322 INFO:tasks.workunit.client.1.smithi087.stdout:9/681: getdents d7/dc 0 2024-02-28T16:02:03.323 INFO:tasks.workunit.client.1.smithi087.stdout:6/755: readlink d4/d12/d45/d5e/lce 0 2024-02-28T16:02:03.324 INFO:tasks.workunit.client.1.smithi087.stdout:1/673: symlink d0/d14/d86/dac/le6 0 2024-02-28T16:02:03.329 INFO:tasks.workunit.client.0.smithi057.stdout:4/342: dread d1/d10/d12/f40 [0,4194304] 0 2024-02-28T16:02:03.330 INFO:tasks.workunit.client.0.smithi057.stdout:4/343: chown d1/d10/d12/d15/f25 548300 1 2024-02-28T16:02:03.331 INFO:tasks.workunit.client.1.smithi087.stdout:5/801: symlink d3/d9/d9b/dba/d30/ddb/l127 0 2024-02-28T16:02:03.332 INFO:tasks.workunit.client.1.smithi087.stdout:6/756: chown d4/d12/d45/d92/dbd 1448678731 1 2024-02-28T16:02:03.335 INFO:tasks.workunit.client.1.smithi087.stdout:3/759: dread d11/d45/d88/fe8 [0,4194304] 0 2024-02-28T16:02:03.336 INFO:tasks.workunit.client.1.smithi087.stdout:9/682: creat d7/dd/d15/d3f/d6d/dc2/fc5 x:0 0 0 2024-02-28T16:02:03.337 INFO:tasks.workunit.client.1.smithi087.stdout:6/757: creat d4/d30/d13/d67/ff5 x:0 0 0 2024-02-28T16:02:03.339 INFO:tasks.workunit.client.1.smithi087.stdout:5/802: chown d3/d9/d4a/d5e/lee 186 1 2024-02-28T16:02:03.340 INFO:tasks.workunit.client.1.smithi087.stdout:3/760: write d11/f31 [2111774,127858] 0 2024-02-28T16:02:03.343 INFO:tasks.workunit.client.1.smithi087.stdout:8/754: dwrite d2/d9/d5e/d9c/d9f/fde [0,4194304] 0 2024-02-28T16:02:03.343 INFO:tasks.workunit.client.1.smithi087.stdout:9/683: dread - d7/dd/d15/d3f/d5f/f94 zero size 2024-02-28T16:02:03.344 INFO:tasks.workunit.client.1.smithi087.stdout:5/803: chown d3/d9/d9b/dba/d30/l56 22 1 2024-02-28T16:02:03.348 INFO:tasks.workunit.client.0.smithi057.stdout:4/344: dwrite d1/d10/d12/d2c/d37/d46/f6a [0,4194304] 0 2024-02-28T16:02:03.353 INFO:tasks.workunit.client.1.smithi087.stdout:9/684: chown d7/d1e/d44/f9a 1408454 1 2024-02-28T16:02:03.354 INFO:tasks.workunit.client.1.smithi087.stdout:9/685: chown d7/d1e/fad 1 1 2024-02-28T16:02:03.357 INFO:tasks.workunit.client.1.smithi087.stdout:6/758: rename d4/d12/d45/l31 to d4/d30/d13/lf6 0 2024-02-28T16:02:03.358 INFO:tasks.workunit.client.1.smithi087.stdout:8/755: mkdir d2/d18/d42/d62/de8/df6 0 2024-02-28T16:02:03.360 INFO:tasks.workunit.client.0.smithi057.stdout:1/348: fsync d1/d3/dc/f12 0 2024-02-28T16:02:03.364 INFO:tasks.workunit.client.1.smithi087.stdout:6/759: write d4/d12/d45/d74/fec [112705,11584] 0 2024-02-28T16:02:03.365 INFO:tasks.workunit.client.0.smithi057.stdout:5/330: creat d2/d3e/f70 x:0 0 0 2024-02-28T16:02:03.365 INFO:tasks.workunit.client.1.smithi087.stdout:5/804: rename d3/d9/d9b/dba/d30/d53/d5b/fb5 to d3/d64/d81/d124/f128 0 2024-02-28T16:02:03.369 INFO:tasks.workunit.client.1.smithi087.stdout:7/693: dwrite d14/f2a [4194304,4194304] 0 2024-02-28T16:02:03.370 INFO:tasks.workunit.client.1.smithi087.stdout:9/686: fsync d7/dd/d15/f22 0 2024-02-28T16:02:03.372 INFO:tasks.workunit.client.1.smithi087.stdout:8/756: rename d2/d33/de6 to d2/d63/d9b/dae/df7 0 2024-02-28T16:02:03.374 INFO:tasks.workunit.client.0.smithi057.stdout:3/304: dread d8/f15 [0,4194304] 0 2024-02-28T16:02:03.374 INFO:tasks.workunit.client.1.smithi087.stdout:5/805: symlink d3/d9/l129 0 2024-02-28T16:02:03.375 INFO:tasks.workunit.client.1.smithi087.stdout:6/760: read d4/dc/f56 [1138804,113948] 0 2024-02-28T16:02:03.377 INFO:tasks.workunit.client.0.smithi057.stdout:3/305: readlink d8/dd/d14/d2e/l4d 0 2024-02-28T16:02:03.378 INFO:tasks.workunit.client.1.smithi087.stdout:5/806: write d3/fb2 [5180403,19833] 0 2024-02-28T16:02:03.379 INFO:tasks.workunit.client.1.smithi087.stdout:7/694: symlink d14/d27/d5d/d6a/d83/d96/ld5 0 2024-02-28T16:02:03.380 INFO:tasks.workunit.client.1.smithi087.stdout:9/687: write d7/dd/d3c/f43 [3333583,60428] 0 2024-02-28T16:02:03.383 INFO:tasks.workunit.client.0.smithi057.stdout:9/381: creat d2/d24/d1d/f7b x:0 0 0 2024-02-28T16:02:03.384 INFO:tasks.workunit.client.1.smithi087.stdout:8/757: read d2/d18/d42/f6d [1842224,98464] 0 2024-02-28T16:02:03.385 INFO:tasks.workunit.client.1.smithi087.stdout:2/654: sync 2024-02-28T16:02:03.385 INFO:tasks.workunit.client.1.smithi087.stdout:0/671: sync 2024-02-28T16:02:03.385 INFO:tasks.workunit.client.1.smithi087.stdout:4/811: sync 2024-02-28T16:02:03.386 INFO:tasks.workunit.client.0.smithi057.stdout:9/382: readlink d2/d5/l4a 0 2024-02-28T16:02:03.395 INFO:tasks.workunit.client.1.smithi087.stdout:6/761: creat d4/ff7 x:0 0 0 2024-02-28T16:02:03.396 INFO:tasks.workunit.client.0.smithi057.stdout:6/276: creat df/d10/f5c x:0 0 0 2024-02-28T16:02:03.398 INFO:tasks.workunit.client.1.smithi087.stdout:7/695: mknod d14/d27/d55/cd6 0 2024-02-28T16:02:03.398 INFO:tasks.workunit.client.0.smithi057.stdout:2/306: truncate d19/d2c/f30 1941538 0 2024-02-28T16:02:03.399 INFO:tasks.workunit.client.1.smithi087.stdout:0/672: creat d4/d6/dc/fdd x:0 0 0 2024-02-28T16:02:03.400 INFO:tasks.workunit.client.0.smithi057.stdout:3/306: dwrite d8/dd/d14/d2e/d30/f40 [4194304,4194304] 0 2024-02-28T16:02:03.401 INFO:tasks.workunit.client.1.smithi087.stdout:1/674: dwrite d0/d1a/d28/f6b [0,4194304] 0 2024-02-28T16:02:03.401 INFO:tasks.workunit.client.1.smithi087.stdout:9/688: dread - d7/dd/d99/da3/fb3 zero size 2024-02-28T16:02:03.405 INFO:tasks.workunit.client.1.smithi087.stdout:4/812: truncate d2/d9/d10/d22/d5b/d5c/d68/dc5/fd4 596711 0 2024-02-28T16:02:03.405 INFO:tasks.workunit.client.1.smithi087.stdout:2/655: dread d2/d7/d17/d34/f8d [4194304,4194304] 0 2024-02-28T16:02:03.405 INFO:tasks.workunit.client.1.smithi087.stdout:3/761: dwrite d11/f24 [0,4194304] 0 2024-02-28T16:02:03.409 INFO:tasks.workunit.client.1.smithi087.stdout:8/758: creat d2/ff8 x:0 0 0 2024-02-28T16:02:03.411 INFO:tasks.workunit.client.0.smithi057.stdout:6/277: rename df/d10/l1d to df/d14/d15/d3d/d5b/l5d 0 2024-02-28T16:02:03.413 INFO:tasks.workunit.client.1.smithi087.stdout:2/656: mkdir d2/d99/dc7/def 0 2024-02-28T16:02:03.413 INFO:tasks.workunit.client.1.smithi087.stdout:0/673: stat d4/dd/d37/d39/d3a/d57/d74/d1f/c56 0 2024-02-28T16:02:03.414 INFO:tasks.workunit.client.1.smithi087.stdout:9/689: mkdir d7/dd/d15/d3f/dc6 0 2024-02-28T16:02:03.415 INFO:tasks.workunit.client.0.smithi057.stdout:9/383: link d2/d5e/d65/f73 d2/d5e/f7c 0 2024-02-28T16:02:03.420 INFO:tasks.workunit.client.0.smithi057.stdout:2/307: dread d19/d2c/f56 [0,4194304] 0 2024-02-28T16:02:03.422 INFO:tasks.workunit.client.1.smithi087.stdout:9/690: chown d7/dd/d99/da3/fb3 38292 1 2024-02-28T16:02:03.424 INFO:tasks.workunit.client.1.smithi087.stdout:3/762: read d11/d44/d5b/f4f [131174,103761] 0 2024-02-28T16:02:03.424 INFO:tasks.workunit.client.1.smithi087.stdout:8/759: chown d2/d18/f56 15161 1 2024-02-28T16:02:03.426 INFO:tasks.workunit.client.1.smithi087.stdout:4/813: rmdir d2/d9/d9e/df4 0 2024-02-28T16:02:03.426 INFO:tasks.workunit.client.0.smithi057.stdout:0/490: link d6/d12/d5d/c9c d6/d12/d17/d4b/d60/d6b/ca5 0 2024-02-28T16:02:03.427 INFO:tasks.workunit.client.1.smithi087.stdout:3/763: fsync d11/d33/ff5 0 2024-02-28T16:02:03.427 INFO:tasks.workunit.client.1.smithi087.stdout:7/696: link f12 d14/d27/d5d/dac/fd7 0 2024-02-28T16:02:03.429 INFO:tasks.workunit.client.0.smithi057.stdout:4/345: getdents d1/d10/d12/d15/d19 0 2024-02-28T16:02:03.430 INFO:tasks.workunit.client.1.smithi087.stdout:6/762: getdents d4/d12/d45/d92/dc1/dcf 0 2024-02-28T16:02:03.431 INFO:tasks.workunit.client.1.smithi087.stdout:0/674: creat d4/d6/ddb/fde x:0 0 0 2024-02-28T16:02:03.432 INFO:tasks.workunit.client.1.smithi087.stdout:5/807: dread d3/d64/fb7 [0,4194304] 0 2024-02-28T16:02:03.432 INFO:tasks.workunit.client.1.smithi087.stdout:4/814: chown d2/d9/d10/d22/d5b/d5c/d91/da9/fe9 27 1 2024-02-28T16:02:03.433 INFO:tasks.workunit.client.0.smithi057.stdout:2/308: fsync d19/d2c/f56 0 2024-02-28T16:02:03.433 INFO:tasks.workunit.client.0.smithi057.stdout:9/384: readlink d2/d24/l18 0 2024-02-28T16:02:03.434 INFO:tasks.workunit.client.1.smithi087.stdout:9/691: creat d7/dd/d15/d3f/d6d/fc7 x:0 0 0 2024-02-28T16:02:03.434 INFO:tasks.workunit.client.1.smithi087.stdout:2/657: fdatasync d2/d99/d28/f83 0 2024-02-28T16:02:03.435 INFO:tasks.workunit.client.1.smithi087.stdout:0/675: stat d4/d6/dc/d45/db4 0 2024-02-28T16:02:03.436 INFO:tasks.workunit.client.1.smithi087.stdout:7/697: chown d14/f40 120807914 1 2024-02-28T16:02:03.438 INFO:tasks.workunit.client.0.smithi057.stdout:2/309: creat d19/d43/f59 x:0 0 0 2024-02-28T16:02:03.439 INFO:tasks.workunit.client.1.smithi087.stdout:5/808: creat d3/d9/d9b/de9/f12a x:0 0 0 2024-02-28T16:02:03.441 INFO:tasks.workunit.client.0.smithi057.stdout:9/385: mkdir d2/d46/d67/d7d 0 2024-02-28T16:02:03.441 INFO:tasks.workunit.client.0.smithi057.stdout:2/310: write d19/d1d/d2e/d31/f3b [707649,115268] 0 2024-02-28T16:02:03.444 INFO:tasks.workunit.client.0.smithi057.stdout:0/491: creat d6/fa6 x:0 0 0 2024-02-28T16:02:03.445 INFO:tasks.workunit.client.1.smithi087.stdout:6/763: mknod d4/d30/d13/cf8 0 2024-02-28T16:02:03.445 INFO:tasks.workunit.client.0.smithi057.stdout:2/311: mkdir d19/d43/d5a 0 2024-02-28T16:02:03.447 INFO:tasks.workunit.client.1.smithi087.stdout:1/675: write d0/d1b/d1f/d71/db2/d24/d78/f8e [890448,110545] 0 2024-02-28T16:02:03.447 INFO:tasks.workunit.client.0.smithi057.stdout:5/331: write d2/d8/fb [194336,43330] 0 2024-02-28T16:02:03.448 INFO:tasks.workunit.client.0.smithi057.stdout:1/349: write d1/d21/d25/f33 [828058,32330] 0 2024-02-28T16:02:03.453 INFO:tasks.workunit.client.0.smithi057.stdout:1/350: mkdir d1/d3/dc/d40/d5d/d67/d7a 0 2024-02-28T16:02:03.454 INFO:tasks.workunit.client.1.smithi087.stdout:5/809: write d3/d9/d9b/dba/d30/d53/d5b/f108 [3611108,14805] 0 2024-02-28T16:02:03.454 INFO:tasks.workunit.client.1.smithi087.stdout:3/764: rmdir d11/d61/d7c/db7/dd3 0 2024-02-28T16:02:03.455 INFO:tasks.workunit.client.0.smithi057.stdout:1/351: dread - d1/d3/dc/d40/d5d/d65/f5a zero size 2024-02-28T16:02:03.457 INFO:tasks.workunit.client.1.smithi087.stdout:4/815: dwrite d2/d9/d10/d11/f94 [0,4194304] 0 2024-02-28T16:02:03.457 INFO:tasks.workunit.client.1.smithi087.stdout:9/692: mknod d7/dd/d15/d3f/d6d/d9f/cc8 0 2024-02-28T16:02:03.459 INFO:tasks.workunit.client.1.smithi087.stdout:8/760: rename d2/d9/d10/f12 to d2/d9/d10/ff9 0 2024-02-28T16:02:03.462 INFO:tasks.workunit.client.1.smithi087.stdout:7/698: write d14/d21/f32 [4233503,49714] 0 2024-02-28T16:02:03.466 INFO:tasks.workunit.client.1.smithi087.stdout:8/761: write d2/d9/d8e/faf [319428,3482] 0 2024-02-28T16:02:03.471 INFO:tasks.workunit.client.1.smithi087.stdout:9/693: unlink d7/dd/d15/d79/d56/caf 0 2024-02-28T16:02:03.473 INFO:tasks.workunit.client.1.smithi087.stdout:0/676: rmdir d4/dd/d21/d9b/dda 0 2024-02-28T16:02:03.474 INFO:tasks.workunit.client.1.smithi087.stdout:2/658: getdents d2/d99/d28 0 2024-02-28T16:02:03.478 INFO:tasks.workunit.client.1.smithi087.stdout:7/699: creat d14/d46/d7c/db9/fd8 x:0 0 0 2024-02-28T16:02:03.478 INFO:tasks.workunit.client.1.smithi087.stdout:8/762: mknod d2/d9/d5e/dbc/cfa 0 2024-02-28T16:02:03.478 INFO:tasks.workunit.client.1.smithi087.stdout:6/764: link d4/dc/l52 d4/d30/d13/d38/lf9 0 2024-02-28T16:02:03.479 INFO:tasks.workunit.client.1.smithi087.stdout:4/816: symlink d2/d9/l107 0 2024-02-28T16:02:03.481 INFO:tasks.workunit.client.1.smithi087.stdout:3/765: dread d11/d44/d5b/f5f [0,4194304] 0 2024-02-28T16:02:03.482 INFO:tasks.workunit.client.1.smithi087.stdout:9/694: unlink d7/dd/d36/f3d 0 2024-02-28T16:02:03.485 INFO:tasks.workunit.client.1.smithi087.stdout:2/659: mkdir d2/d7/dc0/df0 0 2024-02-28T16:02:03.487 INFO:tasks.workunit.client.1.smithi087.stdout:0/677: chown d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/fc0 0 1 2024-02-28T16:02:03.489 INFO:tasks.workunit.client.1.smithi087.stdout:0/678: readlink d4/l75 0 2024-02-28T16:02:03.490 INFO:tasks.workunit.client.1.smithi087.stdout:1/676: dwrite d0/d1a/d28/f59 [0,4194304] 0 2024-02-28T16:02:03.495 INFO:tasks.workunit.client.1.smithi087.stdout:0/679: creat d4/dd/d37/d39/d3a/fdf x:0 0 0 2024-02-28T16:02:03.499 INFO:tasks.workunit.client.1.smithi087.stdout:2/660: read d2/d7/dec/f67 [669994,107595] 0 2024-02-28T16:02:03.500 INFO:tasks.workunit.client.1.smithi087.stdout:1/677: dread - d0/d1b/d1f/d71/db2/d24/d78/fdc zero size 2024-02-28T16:02:03.503 INFO:tasks.workunit.client.1.smithi087.stdout:3/766: link d11/d3a/d3c/fc2 d11/d61/d7c/db7/dea/deb/f100 0 2024-02-28T16:02:03.503 INFO:tasks.workunit.client.1.smithi087.stdout:5/810: dread d3/d9/f15 [0,4194304] 0 2024-02-28T16:02:03.504 INFO:tasks.workunit.client.1.smithi087.stdout:9/695: getdents d7/d1e/d44 0 2024-02-28T16:02:03.504 INFO:tasks.workunit.client.1.smithi087.stdout:4/817: getdents d2/d9/da/d1a/d26/da7 0 2024-02-28T16:02:03.506 INFO:tasks.workunit.client.0.smithi057.stdout:6/278: truncate f9 3555059 0 2024-02-28T16:02:03.508 INFO:tasks.workunit.client.1.smithi087.stdout:4/818: chown d2/d9/d9e 30755 1 2024-02-28T16:02:03.509 INFO:tasks.workunit.client.0.smithi057.stdout:4/346: link d1/d3f/d5f/f72 d1/d10/d12/d15/f73 0 2024-02-28T16:02:03.509 INFO:tasks.workunit.client.1.smithi087.stdout:0/680: link d4/d6/fd6 d4/dd/d21/d52/dd1/fe0 0 2024-02-28T16:02:03.510 INFO:tasks.workunit.client.0.smithi057.stdout:6/279: dread - df/d14/d15/d16/f4a zero size 2024-02-28T16:02:03.511 INFO:tasks.workunit.client.0.smithi057.stdout:1/352: truncate d1/f45 87719 0 2024-02-28T16:02:03.511 INFO:tasks.workunit.client.1.smithi087.stdout:6/765: dwrite d4/d30/d13/d67/f87 [0,4194304] 0 2024-02-28T16:02:03.513 INFO:tasks.workunit.client.1.smithi087.stdout:0/681: fdatasync d4/d6/f9f 0 2024-02-28T16:02:03.514 INFO:tasks.workunit.client.0.smithi057.stdout:3/307: mkdir d8/dd/d14/d2e/d30/d5f 0 2024-02-28T16:02:03.515 INFO:tasks.workunit.client.1.smithi087.stdout:5/811: fsync d3/d64/d81/f4b 0 2024-02-28T16:02:03.517 INFO:tasks.workunit.client.0.smithi057.stdout:4/347: rename d1/d10/d31/d36/f59 to d1/d3f/f74 0 2024-02-28T16:02:03.519 INFO:tasks.workunit.client.1.smithi087.stdout:7/700: write d14/f5b [3216812,32433] 0 2024-02-28T16:02:03.521 INFO:tasks.workunit.client.0.smithi057.stdout:0/492: truncate d6/d12/d17/f37 646037 0 2024-02-28T16:02:03.521 INFO:tasks.workunit.client.0.smithi057.stdout:3/308: truncate d8/dd/d14/d2e/d30/f3f 942663 0 2024-02-28T16:02:03.523 INFO:tasks.workunit.client.1.smithi087.stdout:8/763: dread d2/d63/d9b/dae/df7/f44 [0,4194304] 0 2024-02-28T16:02:03.523 INFO:tasks.workunit.client.1.smithi087.stdout:3/767: creat d11/d33/d67/d9c/da1/f101 x:0 0 0 2024-02-28T16:02:03.524 INFO:tasks.workunit.client.0.smithi057.stdout:1/353: dread d1/d3/dc/f69 [0,4194304] 0 2024-02-28T16:02:03.525 INFO:tasks.workunit.client.0.smithi057.stdout:6/280: rename df/d14/d15/f3c to df/d10/d13/d4b/f5e 0 2024-02-28T16:02:03.525 INFO:tasks.workunit.client.1.smithi087.stdout:6/766: rename d4/dc/c5b to d4/dc/d7e/da4/cfa 0 2024-02-28T16:02:03.525 INFO:tasks.workunit.client.1.smithi087.stdout:3/768: chown d11/f37 5515 1 2024-02-28T16:02:03.528 INFO:tasks.workunit.client.1.smithi087.stdout:4/819: truncate d2/d9/f48 1352268 0 2024-02-28T16:02:03.529 INFO:tasks.workunit.client.0.smithi057.stdout:4/348: creat d1/d22/f75 x:0 0 0 2024-02-28T16:02:03.529 INFO:tasks.workunit.client.1.smithi087.stdout:6/767: readlink d4/d12/l41 0 2024-02-28T16:02:03.530 INFO:tasks.workunit.client.0.smithi057.stdout:1/354: chown d1/d21/d66/d44/d4c/f76 201250 1 2024-02-28T16:02:03.531 INFO:tasks.workunit.client.1.smithi087.stdout:2/661: write d2/d7/d17/d34/f53 [3640169,13257] 0 2024-02-28T16:02:03.532 INFO:tasks.workunit.client.0.smithi057.stdout:6/281: truncate df/d10/d13/f41 627056 0 2024-02-28T16:02:03.532 INFO:tasks.workunit.client.1.smithi087.stdout:0/682: mknod d4/ce1 0 2024-02-28T16:02:03.534 INFO:tasks.workunit.client.1.smithi087.stdout:0/683: readlink l1 0 2024-02-28T16:02:03.534 INFO:tasks.workunit.client.1.smithi087.stdout:1/678: getdents d0/d1b/d1f/d71/db2/dae 0 2024-02-28T16:02:03.534 INFO:tasks.workunit.client.0.smithi057.stdout:5/332: truncate d2/d8/f49 1489468 0 2024-02-28T16:02:03.535 INFO:tasks.workunit.client.0.smithi057.stdout:4/349: write d1/d10/d12/d2c/d50/f6c [396919,55284] 0 2024-02-28T16:02:03.536 INFO:tasks.workunit.client.1.smithi087.stdout:8/764: symlink d2/d63/d9b/dd5/lfb 0 2024-02-28T16:02:03.538 INFO:tasks.workunit.client.1.smithi087.stdout:3/769: creat d11/d45/d88/d91/de3/f102 x:0 0 0 2024-02-28T16:02:03.542 INFO:tasks.workunit.client.0.smithi057.stdout:1/355: fdatasync d1/d3/dc/d15/f3c 0 2024-02-28T16:02:03.546 INFO:tasks.workunit.client.0.smithi057.stdout:4/350: chown d1/d10/d12/d2c/d37 18 1 2024-02-28T16:02:03.546 INFO:tasks.workunit.client.0.smithi057.stdout:5/333: rename d2/l55 to d2/d12/d3d/l71 0 2024-02-28T16:02:03.547 INFO:tasks.workunit.client.1.smithi087.stdout:7/701: link d14/d2e/d2b/laa d14/d46/d80/ld9 0 2024-02-28T16:02:03.549 INFO:tasks.workunit.client.1.smithi087.stdout:3/770: unlink c9 0 2024-02-28T16:02:03.549 INFO:tasks.workunit.client.1.smithi087.stdout:1/679: stat d0/d14/d86/fb0 0 2024-02-28T16:02:03.550 INFO:tasks.workunit.client.1.smithi087.stdout:4/820: truncate d2/d9/d10/d22/d5b/d5c/d68/dc5/fd4 1311161 0 2024-02-28T16:02:03.551 INFO:tasks.workunit.client.0.smithi057.stdout:1/356: stat d1/d3/dc/d40/d5d/d67/f6a 0 2024-02-28T16:02:03.551 INFO:tasks.workunit.client.0.smithi057.stdout:0/493: dwrite d6/f8 [0,4194304] 0 2024-02-28T16:02:03.553 INFO:tasks.workunit.client.1.smithi087.stdout:7/702: unlink d14/d27/la8 0 2024-02-28T16:02:03.553 INFO:tasks.workunit.client.1.smithi087.stdout:8/765: fdatasync d2/d33/f8f 0 2024-02-28T16:02:03.556 INFO:tasks.workunit.client.0.smithi057.stdout:3/309: dwrite d8/dd/d14/d2e/d2f/f5a [0,4194304] 0 2024-02-28T16:02:03.556 INFO:tasks.workunit.client.0.smithi057.stdout:0/494: fsync d6/d12/d38/f5c 0 2024-02-28T16:02:03.557 INFO:tasks.workunit.client.1.smithi087.stdout:1/680: chown d0/d1b/fdf 1 1 2024-02-28T16:02:03.559 INFO:tasks.workunit.client.0.smithi057.stdout:4/351: symlink d1/d3f/l76 0 2024-02-28T16:02:03.564 INFO:tasks.workunit.client.0.smithi057.stdout:6/282: dwrite df/d14/d15/d16/f49 [0,4194304] 0 2024-02-28T16:02:03.565 INFO:tasks.workunit.client.0.smithi057.stdout:3/310: fdatasync f3 0 2024-02-28T16:02:03.567 INFO:tasks.workunit.client.0.smithi057.stdout:6/283: write df/d14/d15/d16/f33 [4560186,123447] 0 2024-02-28T16:02:03.567 INFO:tasks.workunit.client.1.smithi087.stdout:5/812: dread d3/f10d [0,4194304] 0 2024-02-28T16:02:03.567 INFO:tasks.workunit.client.1.smithi087.stdout:7/703: write d14/d2e/d2b/f67 [3249070,107290] 0 2024-02-28T16:02:03.570 INFO:tasks.workunit.client.0.smithi057.stdout:0/495: truncate d6/d12/d45/d55/f54 1590992 0 2024-02-28T16:02:03.575 INFO:tasks.workunit.client.1.smithi087.stdout:0/684: write d4/dd/d37/d39/d3a/d57/d74/fa0 [836859,34489] 0 2024-02-28T16:02:03.575 INFO:tasks.workunit.client.1.smithi087.stdout:1/681: stat d0/d1b/d1f/d71/db2/d24/d78/fdc 0 2024-02-28T16:02:03.577 INFO:tasks.workunit.client.1.smithi087.stdout:9/696: dwrite d7/d1e/d44/f9a [0,4194304] 0 2024-02-28T16:02:03.581 INFO:tasks.workunit.client.1.smithi087.stdout:0/685: chown d4/dd 440858833 1 2024-02-28T16:02:03.585 INFO:tasks.workunit.client.1.smithi087.stdout:2/662: dwrite d2/d7d/fcb [0,4194304] 0 2024-02-28T16:02:03.585 INFO:tasks.workunit.client.1.smithi087.stdout:8/766: creat d2/d9/d5e/dbc/ffc x:0 0 0 2024-02-28T16:02:03.588 INFO:tasks.workunit.client.1.smithi087.stdout:0/686: creat d4/dd/d21/fe2 x:0 0 0 2024-02-28T16:02:03.589 INFO:tasks.workunit.client.0.smithi057.stdout:8/360: sync 2024-02-28T16:02:03.599 INFO:tasks.workunit.client.1.smithi087.stdout:8/767: write d2/d9/d5e/d9c/d9f/fba [219637,96235] 0 2024-02-28T16:02:03.603 INFO:tasks.workunit.client.0.smithi057.stdout:3/311: dwrite d8/dd/d14/d2e/d3b/f56 [0,4194304] 0 2024-02-28T16:02:03.603 INFO:tasks.workunit.client.1.smithi087.stdout:4/821: dwrite d2/d9/d10/d22/f27 [0,4194304] 0 2024-02-28T16:02:03.603 INFO:tasks.workunit.client.1.smithi087.stdout:1/682: mknod d0/d14/ce7 0 2024-02-28T16:02:03.604 INFO:tasks.workunit.client.0.smithi057.stdout:0/496: dread d6/d4e/f33 [0,4194304] 0 2024-02-28T16:02:03.604 INFO:tasks.workunit.client.0.smithi057.stdout:1/357: dread d1/d21/d66/d44/d4c/f6b [0,4194304] 0 2024-02-28T16:02:03.608 INFO:tasks.workunit.client.1.smithi087.stdout:6/768: dread d4/dc/d7e/fb3 [0,4194304] 0 2024-02-28T16:02:03.608 INFO:tasks.workunit.client.1.smithi087.stdout:9/697: write d7/dd/d15/d79/d2e/fa9 [764655,104957] 0 2024-02-28T16:02:03.608 INFO:tasks.workunit.client.0.smithi057.stdout:3/312: dread - d8/dd/d19/f5e zero size 2024-02-28T16:02:03.611 INFO:tasks.workunit.client.1.smithi087.stdout:8/768: dread - d2/d63/d9b/dae/dca/f72 zero size 2024-02-28T16:02:03.613 INFO:tasks.workunit.client.1.smithi087.stdout:5/813: link d3/d9/d9b/dba/d30/d36/d4f/d82/fea d3/d9/d9b/dba/d30/d8f/f12b 0 2024-02-28T16:02:03.615 INFO:tasks.workunit.client.1.smithi087.stdout:0/687: rename d4/d6/f22 to d4/dd/d21/d9b/fe3 0 2024-02-28T16:02:03.618 INFO:tasks.workunit.client.1.smithi087.stdout:1/683: dread d0/d14/f18 [0,4194304] 0 2024-02-28T16:02:03.619 INFO:tasks.workunit.client.1.smithi087.stdout:4/822: mknod d2/d9/da/d1a/d26/d69/c108 0 2024-02-28T16:02:03.621 INFO:tasks.workunit.client.0.smithi057.stdout:6/284: symlink df/l5f 0 2024-02-28T16:02:03.622 INFO:tasks.workunit.client.1.smithi087.stdout:3/771: dread d11/f15 [0,4194304] 0 2024-02-28T16:02:03.629 INFO:tasks.workunit.client.1.smithi087.stdout:6/769: fsync d4/d30/d42/f75 0 2024-02-28T16:02:03.629 INFO:tasks.workunit.client.1.smithi087.stdout:2/663: dwrite d2/d99/d28/d54/da6/fb2 [0,4194304] 0 2024-02-28T16:02:03.630 INFO:tasks.workunit.client.0.smithi057.stdout:8/361: dwrite d5/de/d1b/d4b/f7a [0,4194304] 0 2024-02-28T16:02:03.631 INFO:tasks.workunit.client.0.smithi057.stdout:3/313: chown d8/dd/d19/d1c/l34 344511 1 2024-02-28T16:02:03.636 INFO:tasks.workunit.client.0.smithi057.stdout:3/314: read d8/dd/d14/d2e/d3b/f56 [3472900,46232] 0 2024-02-28T16:02:03.637 INFO:tasks.workunit.client.1.smithi087.stdout:3/772: mknod d11/d45/d88/d91/de3/c103 0 2024-02-28T16:02:03.640 INFO:tasks.workunit.client.0.smithi057.stdout:1/358: rename d1/d3/dc/l23 to d1/d3/l7b 0 2024-02-28T16:02:03.640 INFO:tasks.workunit.client.0.smithi057.stdout:0/497: truncate d6/d12/d38/f5c 877603 0 2024-02-28T16:02:03.641 INFO:tasks.workunit.client.1.smithi087.stdout:8/769: dwrite d2/d18/d42/d62/f7e [0,4194304] 0 2024-02-28T16:02:03.641 INFO:tasks.workunit.client.0.smithi057.stdout:6/285: mknod df/d10/c60 0 2024-02-28T16:02:03.644 INFO:tasks.workunit.client.0.smithi057.stdout:3/315: unlink d8/l21 0 2024-02-28T16:02:03.644 INFO:tasks.workunit.client.1.smithi087.stdout:7/704: truncate d14/d2e/d2b/f67 7198921 0 2024-02-28T16:02:03.644 INFO:tasks.workunit.client.1.smithi087.stdout:2/664: getdents d2/d99/dc7/de2/de4 0 2024-02-28T16:02:03.647 INFO:tasks.workunit.client.1.smithi087.stdout:0/688: getdents d4/dd/d37/d39/d3a/d57/d74/d1f 0 2024-02-28T16:02:03.647 INFO:tasks.workunit.client.0.smithi057.stdout:6/286: write df/d10/d13/f1e [3871725,4728] 0 2024-02-28T16:02:03.648 INFO:tasks.workunit.client.1.smithi087.stdout:0/689: chown d4/d1c/l1e 658 1 2024-02-28T16:02:03.650 INFO:tasks.workunit.client.1.smithi087.stdout:8/770: unlink d2/d9/d5e/dbc/cbf 0 2024-02-28T16:02:03.651 INFO:tasks.workunit.client.1.smithi087.stdout:2/665: mkdir d2/d42/df1 0 2024-02-28T16:02:03.651 INFO:tasks.workunit.client.0.smithi057.stdout:1/359: symlink d1/d21/d25/l7c 0 2024-02-28T16:02:03.653 INFO:tasks.workunit.client.1.smithi087.stdout:0/690: stat d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/cb3 0 2024-02-28T16:02:03.653 INFO:tasks.workunit.client.1.smithi087.stdout:3/773: mkdir d11/d7b/dab/de7/d104 0 2024-02-28T16:02:03.656 INFO:tasks.workunit.client.0.smithi057.stdout:6/287: dread - df/d10/f4d zero size 2024-02-28T16:02:03.657 INFO:tasks.workunit.client.0.smithi057.stdout:3/316: creat d8/d4b/f60 x:0 0 0 2024-02-28T16:02:03.658 INFO:tasks.workunit.client.1.smithi087.stdout:8/771: creat d2/d9/d10/da0/ffd x:0 0 0 2024-02-28T16:02:03.660 INFO:tasks.workunit.client.1.smithi087.stdout:8/772: read - d2/d33/dd1/fd2 zero size 2024-02-28T16:02:03.660 INFO:tasks.workunit.client.0.smithi057.stdout:0/498: rename d6/d12/c88 to d6/d4e/ca7 0 2024-02-28T16:02:03.662 INFO:tasks.workunit.client.0.smithi057.stdout:8/362: dwrite d5/de/d1b/d45/f55 [0,4194304] 0 2024-02-28T16:02:03.662 INFO:tasks.workunit.client.1.smithi087.stdout:3/774: creat d11/d45/d88/f105 x:0 0 0 2024-02-28T16:02:03.663 INFO:tasks.workunit.client.1.smithi087.stdout:9/698: truncate d7/dd/d3c/d4c/f8c 10055973 0 2024-02-28T16:02:03.665 INFO:tasks.workunit.client.0.smithi057.stdout:5/334: dwrite d2/f22 [0,4194304] 0 2024-02-28T16:02:03.665 INFO:tasks.workunit.client.1.smithi087.stdout:0/691: fsync d4/dd/d21/d52/dd1/fe0 0 2024-02-28T16:02:03.670 INFO:tasks.workunit.client.1.smithi087.stdout:0/692: fdatasync d4/dd/d37/d39/d3a/d57/d74/d1f/d60/f8b 0 2024-02-28T16:02:03.670 INFO:tasks.workunit.client.1.smithi087.stdout:2/666: truncate d2/d9a/fde 353278 0 2024-02-28T16:02:03.671 INFO:tasks.workunit.client.0.smithi057.stdout:1/360: rename d1/d3/dc/d40/d5d to d1/d21/d66/d53/d7d 0 2024-02-28T16:02:03.677 INFO:tasks.workunit.client.1.smithi087.stdout:1/684: truncate d0/d1b/d43/fa3 804079 0 2024-02-28T16:02:03.679 INFO:tasks.workunit.client.1.smithi087.stdout:3/775: rename d11/d61/d7c/db7/dea/deb/f100 to d11/d61/d65/da9/f106 0 2024-02-28T16:02:03.679 INFO:tasks.workunit.client.1.smithi087.stdout:7/705: getdents d14/d21/d4f 0 2024-02-28T16:02:03.682 INFO:tasks.workunit.client.1.smithi087.stdout:9/699: creat d7/dd/d15/d3f/d6d/d9f/fc9 x:0 0 0 2024-02-28T16:02:03.690 INFO:tasks.workunit.client.1.smithi087.stdout:7/706: dread d14/d2e/d2b/d4e/fc8 [0,4194304] 0 2024-02-28T16:02:03.692 INFO:tasks.workunit.client.1.smithi087.stdout:9/700: symlink d7/d1e/d60/d69/lca 0 2024-02-28T16:02:03.693 INFO:tasks.workunit.client.1.smithi087.stdout:0/693: mknod d4/ce4 0 2024-02-28T16:02:03.694 INFO:tasks.workunit.client.1.smithi087.stdout:7/707: stat d14/d27/d5d/d6a/d83/d96/dd4 0 2024-02-28T16:02:03.695 INFO:tasks.workunit.client.1.smithi087.stdout:8/773: creat d2/ffe x:0 0 0 2024-02-28T16:02:03.700 INFO:tasks.workunit.client.1.smithi087.stdout:9/701: mknod d7/dd/d99/da3/ccb 0 2024-02-28T16:02:03.701 INFO:tasks.workunit.client.1.smithi087.stdout:3/776: rename d11/f2b to d11/d33/d58/f107 0 2024-02-28T16:02:03.708 INFO:tasks.workunit.client.1.smithi087.stdout:3/777: fsync d11/f26 0 2024-02-28T16:02:03.710 INFO:tasks.workunit.client.1.smithi087.stdout:1/685: rename d0/d14/d3f/c84 to d0/d14/d86/dac/ce8 0 2024-02-28T16:02:03.714 INFO:tasks.workunit.client.1.smithi087.stdout:2/667: truncate d2/d7/d17/f59 7304762 0 2024-02-28T16:02:03.715 INFO:tasks.workunit.client.1.smithi087.stdout:6/770: dread d4/dc/d10/f2b [0,4194304] 0 2024-02-28T16:02:03.719 INFO:tasks.workunit.client.1.smithi087.stdout:6/771: dread - d4/ff7 zero size 2024-02-28T16:02:03.720 INFO:tasks.workunit.client.1.smithi087.stdout:7/708: dread d14/d21/f42 [0,4194304] 0 2024-02-28T16:02:03.720 INFO:tasks.workunit.client.1.smithi087.stdout:2/668: dread - d2/d99/fe7 zero size 2024-02-28T16:02:03.723 INFO:tasks.workunit.client.1.smithi087.stdout:0/694: dwrite d4/dd/d21/d9b/f6f [0,4194304] 0 2024-02-28T16:02:03.726 INFO:tasks.workunit.client.1.smithi087.stdout:8/774: dwrite d2/d63/d9b/dae/dca/d6f/f7a [0,4194304] 0 2024-02-28T16:02:03.726 INFO:tasks.workunit.client.1.smithi087.stdout:1/686: rename d0/d1b/d43/d4d/fd0 to d0/d14/d86/fe9 0 2024-02-28T16:02:03.732 INFO:tasks.workunit.client.1.smithi087.stdout:7/709: mknod d14/d27/d55/dae/cda 0 2024-02-28T16:02:03.732 INFO:tasks.workunit.client.1.smithi087.stdout:6/772: dread d4/d30/d13/d38/d69/f6f [0,4194304] 0 2024-02-28T16:02:03.737 INFO:tasks.workunit.client.1.smithi087.stdout:1/687: dread d0/d1b/d1f/d71/db2/d24/fb7 [0,4194304] 0 2024-02-28T16:02:03.741 INFO:tasks.workunit.client.1.smithi087.stdout:9/702: dread d7/f12 [4194304,4194304] 0 2024-02-28T16:02:03.741 INFO:tasks.workunit.client.1.smithi087.stdout:1/688: chown d0/d1b/fbd 808374 1 2024-02-28T16:02:03.745 INFO:tasks.workunit.client.1.smithi087.stdout:0/695: unlink d4/d6/cd3 0 2024-02-28T16:02:03.747 INFO:tasks.workunit.client.1.smithi087.stdout:7/710: dread d14/d27/d5d/f5e [0,4194304] 0 2024-02-28T16:02:03.749 INFO:tasks.workunit.client.0.smithi057.stdout:0/499: symlink d6/d12/d17/d4b/la8 0 2024-02-28T16:02:03.750 INFO:tasks.workunit.client.0.smithi057.stdout:3/317: dread d8/dd/d19/f2d [0,4194304] 0 2024-02-28T16:02:03.754 INFO:tasks.workunit.client.1.smithi087.stdout:1/689: symlink d0/d1b/d1f/d71/db2/lea 0 2024-02-28T16:02:03.754 INFO:tasks.workunit.client.1.smithi087.stdout:8/775: dwrite d2/d9/d5e/d9c/d9f/fb7 [0,4194304] 0 2024-02-28T16:02:03.757 INFO:tasks.workunit.client.0.smithi057.stdout:1/361: dread d1/f8 [0,4194304] 0 2024-02-28T16:02:03.757 INFO:tasks.workunit.client.1.smithi087.stdout:7/711: getdents d14/d2e/dab 0 2024-02-28T16:02:03.757 INFO:tasks.workunit.client.0.smithi057.stdout:0/500: link l5 d6/d12/da4/la9 0 2024-02-28T16:02:03.759 INFO:tasks.workunit.client.1.smithi087.stdout:6/773: rename d4/d96/f98 to d4/da5/ffb 0 2024-02-28T16:02:03.759 INFO:tasks.workunit.client.1.smithi087.stdout:7/712: write f13 [2794576,28404] 0 2024-02-28T16:02:03.761 INFO:tasks.workunit.client.1.smithi087.stdout:6/774: fsync d4/d12/d45/d5e/feb 0 2024-02-28T16:02:03.764 INFO:tasks.workunit.client.1.smithi087.stdout:0/696: getdents d4/dd/d21/d9b/d7c 0 2024-02-28T16:02:03.765 INFO:tasks.workunit.client.0.smithi057.stdout:1/362: truncate d1/d3/dc/d15/d4e/d57/f77 570156 0 2024-02-28T16:02:03.767 INFO:tasks.workunit.client.0.smithi057.stdout:5/335: truncate d2/d8/f46 224262 0 2024-02-28T16:02:03.769 INFO:tasks.workunit.client.1.smithi087.stdout:6/775: rmdir d4/dc/d61/d89 39 2024-02-28T16:02:03.770 INFO:tasks.workunit.client.0.smithi057.stdout:8/363: dread d5/f7 [0,4194304] 0 2024-02-28T16:02:03.774 INFO:tasks.workunit.client.0.smithi057.stdout:3/318: creat d8/dd/d14/d2e/d2f/f61 x:0 0 0 2024-02-28T16:02:03.774 INFO:tasks.workunit.client.0.smithi057.stdout:0/501: write d6/d12/d45/d55/f54 [976199,31872] 0 2024-02-28T16:02:03.776 INFO:tasks.workunit.client.0.smithi057.stdout:8/364: unlink d5/d6/cc 0 2024-02-28T16:02:03.782 INFO:tasks.workunit.client.0.smithi057.stdout:8/365: mkdir d5/de/d1b/d45/d81 0 2024-02-28T16:02:03.782 INFO:tasks.workunit.client.1.smithi087.stdout:0/697: link d4/dd/d21/d32/f7a d4/dd/d37/d39/d3a/dc1/fe5 0 2024-02-28T16:02:03.785 INFO:tasks.workunit.client.0.smithi057.stdout:3/319: unlink d8/dd/d19/d25/c44 0 2024-02-28T16:02:03.785 INFO:tasks.workunit.client.1.smithi087.stdout:2/669: dread d2/d99/dc7/fd9 [0,4194304] 0 2024-02-28T16:02:03.785 INFO:tasks.workunit.client.1.smithi087.stdout:0/698: readlink d4/dd/l79 0 2024-02-28T16:02:03.790 INFO:tasks.workunit.client.1.smithi087.stdout:0/699: unlink d4/dd/d37/f59 0 2024-02-28T16:02:03.793 INFO:tasks.workunit.client.0.smithi057.stdout:1/363: dwrite d1/d21/d25/f3d [0,4194304] 0 2024-02-28T16:02:03.793 INFO:tasks.workunit.client.0.smithi057.stdout:9/386: sync 2024-02-28T16:02:03.793 INFO:tasks.workunit.client.0.smithi057.stdout:7/247: sync 2024-02-28T16:02:03.794 INFO:tasks.workunit.client.1.smithi087.stdout:7/713: dwrite d14/d27/d5d/d6a/d83/fb3 [0,4194304] 0 2024-02-28T16:02:03.795 INFO:tasks.workunit.client.1.smithi087.stdout:7/714: readlink d14/d2e/l9d 0 2024-02-28T16:02:03.796 INFO:tasks.workunit.client.0.smithi057.stdout:5/336: dwrite d2/f13 [0,4194304] 0 2024-02-28T16:02:03.797 INFO:tasks.workunit.client.1.smithi087.stdout:9/703: dread d7/f12 [0,4194304] 0 2024-02-28T16:02:03.799 INFO:tasks.workunit.client.1.smithi087.stdout:0/700: symlink d4/dd/d21/d9b/d7c/le6 0 2024-02-28T16:02:03.803 INFO:tasks.workunit.client.1.smithi087.stdout:6/776: dwrite d4/dc/d61/d89/f9d [0,4194304] 0 2024-02-28T16:02:03.804 INFO:tasks.workunit.client.1.smithi087.stdout:0/701: truncate d4/dd/d21/fce 188040 0 2024-02-28T16:02:03.804 INFO:tasks.workunit.client.0.smithi057.stdout:7/248: symlink d6/l57 0 2024-02-28T16:02:03.806 INFO:tasks.workunit.client.0.smithi057.stdout:5/337: symlink d2/d15/d5e/d67/l72 0 2024-02-28T16:02:03.809 INFO:tasks.workunit.client.1.smithi087.stdout:6/777: rmdir d4/d96 39 2024-02-28T16:02:03.812 INFO:tasks.workunit.client.0.smithi057.stdout:5/338: write d2/d8/f9 [2370153,101661] 0 2024-02-28T16:02:03.812 INFO:tasks.workunit.client.0.smithi057.stdout:7/249: unlink d6/dc/d12/c27 0 2024-02-28T16:02:03.813 INFO:tasks.workunit.client.1.smithi087.stdout:9/704: creat d7/dd/d15/d3f/d5f/d90/fcc x:0 0 0 2024-02-28T16:02:03.815 INFO:tasks.workunit.client.1.smithi087.stdout:2/670: dwrite d2/f87 [0,4194304] 0 2024-02-28T16:02:03.816 INFO:tasks.workunit.client.0.smithi057.stdout:1/364: write d1/d3/f47 [1447468,1429] 0 2024-02-28T16:02:03.816 INFO:tasks.workunit.client.0.smithi057.stdout:3/320: dwrite d8/f18 [0,4194304] 0 2024-02-28T16:02:03.817 INFO:tasks.workunit.client.0.smithi057.stdout:7/250: mkdir d6/dc/d35/d58 0 2024-02-28T16:02:03.818 INFO:tasks.workunit.client.0.smithi057.stdout:9/387: write d2/d5/d1b/d2e/f53 [1789316,45135] 0 2024-02-28T16:02:03.818 INFO:tasks.workunit.client.1.smithi087.stdout:9/705: read - d7/d1e/d44/fb2 zero size 2024-02-28T16:02:03.821 INFO:tasks.workunit.client.0.smithi057.stdout:9/388: chown d2/d5e/d65/f56 27022632 1 2024-02-28T16:02:03.822 INFO:tasks.workunit.client.0.smithi057.stdout:5/339: mkdir d2/d15/d5e/d67/d73 0 2024-02-28T16:02:03.822 INFO:tasks.workunit.client.1.smithi087.stdout:9/706: stat d7/dd/d99/da3/fa6 0 2024-02-28T16:02:03.825 INFO:tasks.workunit.client.1.smithi087.stdout:0/702: rename d4/dd/d37/d39/d3a/f97 to d4/d6/fe7 0 2024-02-28T16:02:03.825 INFO:tasks.workunit.client.1.smithi087.stdout:2/671: symlink d2/d99/d28/d54/lf2 0 2024-02-28T16:02:03.825 INFO:tasks.workunit.client.1.smithi087.stdout:1/690: dread d0/d1a/d28/f65 [0,4194304] 0 2024-02-28T16:02:03.826 INFO:tasks.workunit.client.1.smithi087.stdout:6/778: link d4/d12/l41 d4/d12/d45/d92/de5/lfc 0 2024-02-28T16:02:03.827 INFO:tasks.workunit.client.1.smithi087.stdout:1/691: stat d0/d1b/c8b 0 2024-02-28T16:02:03.829 INFO:tasks.workunit.client.1.smithi087.stdout:9/707: mkdir d7/dd/d15/d3f/d6d/dcd 0 2024-02-28T16:02:03.832 INFO:tasks.workunit.client.1.smithi087.stdout:9/708: write d7/dd/d15/d79/f8d [724479,31695] 0 2024-02-28T16:02:03.836 INFO:tasks.workunit.client.1.smithi087.stdout:6/779: unlink d4/d30/d13/d38/fa1 0 2024-02-28T16:02:03.840 INFO:tasks.workunit.client.1.smithi087.stdout:8/776: dread d2/d9/d10/d24/f5a [0,4194304] 0 2024-02-28T16:02:03.842 INFO:tasks.workunit.client.1.smithi087.stdout:9/709: rmdir d7/dd/d15/d79/d2e 39 2024-02-28T16:02:03.848 INFO:tasks.workunit.client.1.smithi087.stdout:0/703: truncate d4/dd/d21/d9b/fe3 968870 0 2024-02-28T16:02:03.849 INFO:tasks.workunit.client.1.smithi087.stdout:6/780: creat d4/d12/ffd x:0 0 0 2024-02-28T16:02:03.857 INFO:tasks.workunit.client.1.smithi087.stdout:6/781: fdatasync d4/d30/d13/d38/f68 0 2024-02-28T16:02:03.859 INFO:tasks.workunit.client.1.smithi087.stdout:8/777: dread d2/d9/d5e/d9c/d9f/fb7 [0,4194304] 0 2024-02-28T16:02:03.861 INFO:tasks.workunit.client.1.smithi087.stdout:8/778: stat d2/d9/d10/ff9 0 2024-02-28T16:02:03.863 INFO:tasks.workunit.client.1.smithi087.stdout:9/710: getdents d7/d1e/d44/d83 0 2024-02-28T16:02:03.865 INFO:tasks.workunit.client.1.smithi087.stdout:8/779: symlink d2/d63/d9b/dae/lff 0 2024-02-28T16:02:03.866 INFO:tasks.workunit.client.1.smithi087.stdout:2/672: write d2/d7/d17/d34/f3a [1358290,100467] 0 2024-02-28T16:02:03.868 INFO:tasks.workunit.client.1.smithi087.stdout:7/715: dread d14/f18 [0,4194304] 0 2024-02-28T16:02:03.869 INFO:tasks.workunit.client.1.smithi087.stdout:1/692: write d0/d14/d86/fe9 [678778,70171] 0 2024-02-28T16:02:03.869 INFO:tasks.workunit.client.1.smithi087.stdout:0/704: dwrite d4/dd/f13 [4194304,4194304] 0 2024-02-28T16:02:03.871 INFO:tasks.workunit.client.1.smithi087.stdout:9/711: truncate d7/dd/d15/d3f/fb6 1058415 0 2024-02-28T16:02:03.872 INFO:tasks.workunit.client.1.smithi087.stdout:2/673: creat d2/d42/ff3 x:0 0 0 2024-02-28T16:02:03.874 INFO:tasks.workunit.client.1.smithi087.stdout:1/693: creat d0/d1a/feb x:0 0 0 2024-02-28T16:02:03.875 INFO:tasks.workunit.client.1.smithi087.stdout:7/716: readlink d14/d2e/dc0/lcd 0 2024-02-28T16:02:03.877 INFO:tasks.workunit.client.1.smithi087.stdout:7/717: chown d14/f5b 198900 1 2024-02-28T16:02:03.877 INFO:tasks.workunit.client.1.smithi087.stdout:0/705: write d4/dd/d21/d52/f7e [3731130,85546] 0 2024-02-28T16:02:03.879 INFO:tasks.workunit.client.1.smithi087.stdout:2/674: chown d2/d99/d28/f2e 0 1 2024-02-28T16:02:03.884 INFO:tasks.workunit.client.1.smithi087.stdout:1/694: mknod d0/d14/cec 0 2024-02-28T16:02:03.884 INFO:tasks.workunit.client.1.smithi087.stdout:7/718: chown d14/d2e/l9b 24 1 2024-02-28T16:02:03.887 INFO:tasks.workunit.client.1.smithi087.stdout:8/780: write d2/d33/f3e [2037379,119522] 0 2024-02-28T16:02:03.888 INFO:tasks.workunit.client.1.smithi087.stdout:2/675: write d2/d7/d17/d97/fa0 [3629477,50494] 0 2024-02-28T16:02:03.890 INFO:tasks.workunit.client.1.smithi087.stdout:1/695: write d0/d1b/d1f/fa9 [4059876,21719] 0 2024-02-28T16:02:03.890 INFO:tasks.workunit.client.1.smithi087.stdout:9/712: link d7/dd/d36/d89/lbe d7/d1e/d60/lce 0 2024-02-28T16:02:03.891 INFO:tasks.workunit.client.1.smithi087.stdout:8/781: rmdir d2/d9/d10 39 2024-02-28T16:02:03.893 INFO:tasks.workunit.client.1.smithi087.stdout:2/676: symlink d2/d99/lf4 0 2024-02-28T16:02:03.894 INFO:tasks.workunit.client.1.smithi087.stdout:1/696: rmdir d0/d1b/d1f/d71/db2 39 2024-02-28T16:02:03.895 INFO:tasks.workunit.client.1.smithi087.stdout:6/782: dwrite d4/d30/d13/d38/dc3/fd1 [0,4194304] 0 2024-02-28T16:02:03.896 INFO:tasks.workunit.client.0.smithi057.stdout:9/389: dread d2/d24/d1d/f23 [0,4194304] 0 2024-02-28T16:02:03.902 INFO:tasks.workunit.client.1.smithi087.stdout:2/677: mknod d2/d99/d28/d79/d9f/cf5 0 2024-02-28T16:02:03.903 INFO:tasks.workunit.client.1.smithi087.stdout:6/783: chown d4/d12/ffd 1 1 2024-02-28T16:02:03.905 INFO:tasks.workunit.client.0.smithi057.stdout:3/321: rename d8/dd/d19/d2a/f39 to d8/dd/d19/f62 0 2024-02-28T16:02:03.906 INFO:tasks.workunit.client.1.smithi087.stdout:8/782: creat d2/d18/d42/d62/de8/f100 x:0 0 0 2024-02-28T16:02:03.909 INFO:tasks.workunit.client.1.smithi087.stdout:6/784: read - d4/d30/fef zero size 2024-02-28T16:02:03.910 INFO:tasks.workunit.client.1.smithi087.stdout:1/697: fsync d0/d1b/d1f/d71/db2/d24/d78/fdc 0 2024-02-28T16:02:03.911 INFO:tasks.workunit.client.0.smithi057.stdout:9/390: dwrite d2/d5/d9/f35 [0,4194304] 0 2024-02-28T16:02:03.912 INFO:tasks.workunit.client.1.smithi087.stdout:7/719: dwrite d14/d2e/d2b/f2c [0,4194304] 0 2024-02-28T16:02:03.913 INFO:tasks.workunit.client.0.smithi057.stdout:9/391: fsync d2/f75 0 2024-02-28T16:02:03.915 INFO:tasks.workunit.client.0.smithi057.stdout:7/251: link d6/d26/c4f d6/dc/d12/c59 0 2024-02-28T16:02:03.916 INFO:tasks.workunit.client.0.smithi057.stdout:3/322: chown d8/dd/c23 2015 1 2024-02-28T16:02:03.916 INFO:tasks.workunit.client.1.smithi087.stdout:0/706: dwrite d4/dd/d37/d39/d3a/fc5 [0,4194304] 0 2024-02-28T16:02:03.916 INFO:tasks.workunit.client.1.smithi087.stdout:8/783: symlink d2/d9/d10/l101 0 2024-02-28T16:02:03.917 INFO:tasks.workunit.client.0.smithi057.stdout:7/252: readlink d6/l9 0 2024-02-28T16:02:03.919 INFO:tasks.workunit.client.1.smithi087.stdout:7/720: symlink d14/d2e/d89/ldb 0 2024-02-28T16:02:03.920 INFO:tasks.workunit.client.0.smithi057.stdout:7/253: fsync d6/dc/d12/d1a/f24 0 2024-02-28T16:02:03.921 INFO:tasks.workunit.client.1.smithi087.stdout:0/707: truncate d4/f8 46773 0 2024-02-28T16:02:03.922 INFO:tasks.workunit.client.0.smithi057.stdout:1/365: dwrite d1/d21/f5b [0,4194304] 0 2024-02-28T16:02:03.922 INFO:tasks.workunit.client.0.smithi057.stdout:3/323: creat d8/dd/d14/d2e/d30/d49/f63 x:0 0 0 2024-02-28T16:02:03.926 INFO:tasks.workunit.client.1.smithi087.stdout:6/785: symlink d4/d30/d13/lfe 0 2024-02-28T16:02:03.927 INFO:tasks.workunit.client.1.smithi087.stdout:8/784: creat d2/d18/d25/f102 x:0 0 0 2024-02-28T16:02:03.930 INFO:tasks.workunit.client.0.smithi057.stdout:7/254: mkdir d6/dc/d12/d1a/d4d/d5a 0 2024-02-28T16:02:03.931 INFO:tasks.workunit.client.0.smithi057.stdout:1/366: dread d1/d21/d66/d44/d4c/f76 [0,4194304] 0 2024-02-28T16:02:03.932 INFO:tasks.workunit.client.1.smithi087.stdout:1/698: creat d0/fed x:0 0 0 2024-02-28T16:02:03.932 INFO:tasks.workunit.client.0.smithi057.stdout:7/255: chown d6/dc/d35/f51 209 1 2024-02-28T16:02:03.934 INFO:tasks.workunit.client.1.smithi087.stdout:7/721: creat d14/d46/d80/fdc x:0 0 0 2024-02-28T16:02:03.936 INFO:tasks.workunit.client.1.smithi087.stdout:8/785: fsync d2/d18/d42/dbb/fcc 0 2024-02-28T16:02:03.938 INFO:tasks.workunit.client.1.smithi087.stdout:0/708: creat d4/dd/d21/d9b/fe8 x:0 0 0 2024-02-28T16:02:03.938 INFO:tasks.workunit.client.1.smithi087.stdout:9/713: dwrite d7/dd/d15/d3f/fb6 [0,4194304] 0 2024-02-28T16:02:03.942 INFO:tasks.workunit.client.1.smithi087.stdout:6/786: symlink d4/d30/d13/d38/d69/lff 0 2024-02-28T16:02:03.943 INFO:tasks.workunit.client.0.smithi057.stdout:5/340: dwrite d2/d19/d1c/f36 [0,4194304] 0 2024-02-28T16:02:03.948 INFO:tasks.workunit.client.0.smithi057.stdout:3/324: dread d8/dd/d14/d2e/d2f/f5a [0,4194304] 0 2024-02-28T16:02:03.948 INFO:tasks.workunit.client.1.smithi087.stdout:8/786: dread - d2/d7c/fb6 zero size 2024-02-28T16:02:03.951 INFO:tasks.workunit.client.1.smithi087.stdout:7/722: mknod d14/d27/d5d/d6a/d83/cdd 0 2024-02-28T16:02:03.952 INFO:tasks.workunit.client.0.smithi057.stdout:4/352: sync 2024-02-28T16:02:03.952 INFO:tasks.workunit.client.0.smithi057.stdout:2/312: sync 2024-02-28T16:02:03.953 INFO:tasks.workunit.client.1.smithi087.stdout:2/678: write d2/d99/d28/d79/f96 [807154,58370] 0 2024-02-28T16:02:03.954 INFO:tasks.workunit.client.0.smithi057.stdout:3/325: rmdir d8/dd/d14/d2e/d3b/d54 39 2024-02-28T16:02:03.957 INFO:tasks.workunit.client.1.smithi087.stdout:2/679: dread - d2/d7/d17/d34/feb zero size 2024-02-28T16:02:03.958 INFO:tasks.workunit.client.1.smithi087.stdout:2/680: dread - d2/d99/fe7 zero size 2024-02-28T16:02:03.960 INFO:tasks.workunit.client.1.smithi087.stdout:1/699: link d0/d1b/f47 d0/d1b/d1f/d71/db2/db3/fee 0 2024-02-28T16:02:03.965 INFO:tasks.workunit.client.1.smithi087.stdout:7/723: write d14/d27/f3f [1890263,58591] 0 2024-02-28T16:02:03.967 INFO:tasks.workunit.client.0.smithi057.stdout:4/353: creat d1/d10/d12/d2c/f77 x:0 0 0 2024-02-28T16:02:03.969 INFO:tasks.workunit.client.0.smithi057.stdout:2/313: symlink d19/d2c/d48/l5b 0 2024-02-28T16:02:03.973 INFO:tasks.workunit.client.0.smithi057.stdout:1/367: dwrite d1/d21/d66/d53/d7d/d67/f6a [0,4194304] 0 2024-02-28T16:02:03.973 INFO:tasks.workunit.client.1.smithi087.stdout:8/787: symlink d2/d18/df5/l103 0 2024-02-28T16:02:03.973 INFO:tasks.workunit.client.1.smithi087.stdout:9/714: dwrite d7/dd/d15/d3f/d5f/f8f [0,4194304] 0 2024-02-28T16:02:03.976 INFO:tasks.workunit.client.1.smithi087.stdout:1/700: rename d0/c66 to d0/d1b/d1f/d71/db2/d24/d78/cef 0 2024-02-28T16:02:03.976 INFO:tasks.workunit.client.1.smithi087.stdout:9/715: stat d7/dd/d3c/d4c/da1/f7b 0 2024-02-28T16:02:03.978 INFO:tasks.workunit.client.0.smithi057.stdout:9/392: dread d2/d5/d9/fb [0,4194304] 0 2024-02-28T16:02:03.979 INFO:tasks.workunit.client.1.smithi087.stdout:7/724: creat d14/d2e/d89/fde x:0 0 0 2024-02-28T16:02:03.980 INFO:tasks.workunit.client.1.smithi087.stdout:2/681: symlink d2/d99/dc7/de2/de4/lf6 0 2024-02-28T16:02:03.980 INFO:tasks.workunit.client.0.smithi057.stdout:4/354: unlink d1/d10/d31/d36/c65 0 2024-02-28T16:02:03.981 INFO:tasks.workunit.client.1.smithi087.stdout:1/701: fsync d0/d1b/d43/d4d/fa8 0 2024-02-28T16:02:03.983 INFO:tasks.workunit.client.0.smithi057.stdout:2/314: rename d19/d2c/d48/l5b to d19/d1d/d2e/d31/l5c 0 2024-02-28T16:02:03.983 INFO:tasks.workunit.client.1.smithi087.stdout:8/788: rename d2/d63/d9b/dae/df7 to d2/d18/df5/d104 0 2024-02-28T16:02:03.984 INFO:tasks.workunit.client.0.smithi057.stdout:5/341: dwrite d2/f35 [0,4194304] 0 2024-02-28T16:02:03.985 INFO:tasks.workunit.client.1.smithi087.stdout:2/682: stat d2/d99/d28/d54/da6/fb9 0 2024-02-28T16:02:03.985 INFO:tasks.workunit.client.1.smithi087.stdout:0/709: truncate d4/dd/d37/d39/d3a/d57/d74/fa0 774906 0 2024-02-28T16:02:03.986 INFO:tasks.workunit.client.0.smithi057.stdout:9/393: readlink d2/d5/d1b/l38 0 2024-02-28T16:02:03.991 INFO:tasks.workunit.client.0.smithi057.stdout:5/342: write d2/d19/d1c/f36 [4239881,126625] 0 2024-02-28T16:02:03.991 INFO:tasks.workunit.client.0.smithi057.stdout:9/394: fdatasync d2/d5/d1b/d2e/d44/f4f 0 2024-02-28T16:02:03.991 INFO:tasks.workunit.client.0.smithi057.stdout:2/315: symlink d19/d1d/l5d 0 2024-02-28T16:02:03.995 INFO:tasks.workunit.client.0.smithi057.stdout:2/316: read d19/d1d/d2e/d31/f40 [656740,53655] 0 2024-02-28T16:02:03.995 INFO:tasks.workunit.client.1.smithi087.stdout:8/789: write d2/d63/d9b/dae/dca/f8c [3345748,6307] 0 2024-02-28T16:02:03.998 INFO:tasks.workunit.client.1.smithi087.stdout:9/716: creat d7/dd/d15/d3f/d6d/dcd/fcf x:0 0 0 2024-02-28T16:02:03.999 INFO:tasks.workunit.client.1.smithi087.stdout:2/683: dread - d2/d99/d28/d79/da3/fbd zero size 2024-02-28T16:02:03.999 INFO:tasks.workunit.client.1.smithi087.stdout:8/790: chown d2/d33/dd1 2518 1 2024-02-28T16:02:04.001 INFO:tasks.workunit.client.0.smithi057.stdout:9/395: mkdir d2/d5/d1b/d2e/d44/d7e 0 2024-02-28T16:02:04.001 INFO:tasks.workunit.client.0.smithi057.stdout:1/368: link d1/d3/dc/c32 d1/d21/d66/d53/d7d/d67/c7e 0 2024-02-28T16:02:04.007 INFO:tasks.workunit.client.0.smithi057.stdout:5/343: rename d2/d15/d5e/d67/d73 to d2/d3e/d44/d62/d74 0 2024-02-28T16:02:04.007 INFO:tasks.workunit.client.0.smithi057.stdout:4/355: dwrite d1/d10/d12/d15/f25 [0,4194304] 0 2024-02-28T16:02:04.009 INFO:tasks.workunit.client.0.smithi057.stdout:4/356: fdatasync d1/d10/d12/d2c/d37/d46/f6a 0 2024-02-28T16:02:04.010 INFO:tasks.workunit.client.0.smithi057.stdout:7/256: dread d6/dc/f2f [0,4194304] 0 2024-02-28T16:02:04.010 INFO:tasks.workunit.client.1.smithi087.stdout:6/787: dread d4/d12/d45/d92/f94 [0,4194304] 0 2024-02-28T16:02:04.010 INFO:tasks.workunit.client.1.smithi087.stdout:7/725: dwrite d14/f97 [0,4194304] 0 2024-02-28T16:02:04.010 INFO:tasks.workunit.client.1.smithi087.stdout:8/791: creat d2/d9/d10/da0/f105 x:0 0 0 2024-02-28T16:02:04.011 INFO:tasks.workunit.client.0.smithi057.stdout:2/317: symlink d19/d1d/d22/l5e 0 2024-02-28T16:02:04.011 INFO:tasks.workunit.client.1.smithi087.stdout:7/726: stat d14/lb6 0 2024-02-28T16:02:04.011 INFO:tasks.workunit.client.1.smithi087.stdout:0/710: dwrite d4/dd/f13 [4194304,4194304] 0 2024-02-28T16:02:04.013 INFO:tasks.workunit.client.1.smithi087.stdout:8/792: fdatasync d2/d9/d5e/f91 0 2024-02-28T16:02:04.013 INFO:tasks.workunit.client.1.smithi087.stdout:6/788: stat d4/d30/d13/f93 0 2024-02-28T16:02:04.013 INFO:tasks.workunit.client.0.smithi057.stdout:2/318: dread - d19/f47 zero size 2024-02-28T16:02:04.013 INFO:tasks.workunit.client.0.smithi057.stdout:9/396: rename d2/d24/d1d/l29 to d2/d5/d9/d5d/l7f 0 2024-02-28T16:02:04.015 INFO:tasks.workunit.client.0.smithi057.stdout:4/357: chown d1/d10/d12/d15/d19/c56 25838 1 2024-02-28T16:02:04.017 INFO:tasks.workunit.client.1.smithi087.stdout:1/702: write d0/d14/f54 [1821458,82687] 0 2024-02-28T16:02:04.017 INFO:tasks.workunit.client.1.smithi087.stdout:6/789: chown d4/d30/d42/de7 119258693 1 2024-02-28T16:02:04.019 INFO:tasks.workunit.client.1.smithi087.stdout:1/703: chown d0/d14/d86/dac 0 1 2024-02-28T16:02:04.021 INFO:tasks.workunit.client.0.smithi057.stdout:5/344: creat d2/d15/d5e/d6d/f75 x:0 0 0 2024-02-28T16:02:04.025 INFO:tasks.workunit.client.0.smithi057.stdout:9/397: mknod d2/d24/c80 0 2024-02-28T16:02:04.025 INFO:tasks.workunit.client.1.smithi087.stdout:1/704: chown d0/d1a/d28/f7f 35 1 2024-02-28T16:02:04.029 INFO:tasks.workunit.client.1.smithi087.stdout:6/790: mknod d4/dc/d61/d89/df2/c100 0 2024-02-28T16:02:04.030 INFO:tasks.workunit.client.1.smithi087.stdout:9/717: read d7/dd/d15/d79/d2e/f6a [2741371,15858] 0 2024-02-28T16:02:04.030 INFO:tasks.workunit.client.0.smithi057.stdout:2/319: getdents d19/d1d 0 2024-02-28T16:02:04.031 INFO:tasks.workunit.client.0.smithi057.stdout:9/398: creat d2/d5/d9/d57/f81 x:0 0 0 2024-02-28T16:02:04.032 INFO:tasks.workunit.client.0.smithi057.stdout:5/345: mkdir d2/d12/d76 0 2024-02-28T16:02:04.034 INFO:tasks.workunit.client.1.smithi087.stdout:7/727: rename d14/l2f to d14/d2e/ldf 0 2024-02-28T16:02:04.035 INFO:tasks.workunit.client.0.smithi057.stdout:2/320: symlink d19/d43/l5f 0 2024-02-28T16:02:04.035 INFO:tasks.workunit.client.0.smithi057.stdout:2/321: fsync f12 0 2024-02-28T16:02:04.039 INFO:tasks.workunit.client.1.smithi087.stdout:6/791: rmdir d4/dc 39 2024-02-28T16:02:04.039 INFO:tasks.workunit.client.1.smithi087.stdout:7/728: symlink d14/d46/d7c/le0 0 2024-02-28T16:02:04.040 INFO:tasks.workunit.client.0.smithi057.stdout:5/346: mkdir d2/d12/d5f/d77 0 2024-02-28T16:02:04.040 INFO:tasks.workunit.client.1.smithi087.stdout:1/705: getdents d0/d1b/d1f/d71/db2/db3/dda 0 2024-02-28T16:02:04.040 INFO:tasks.workunit.client.0.smithi057.stdout:2/322: mknod d19/d1d/d26/c60 0 2024-02-28T16:02:04.043 INFO:tasks.workunit.client.0.smithi057.stdout:2/323: fsync fe 0 2024-02-28T16:02:04.043 INFO:tasks.workunit.client.1.smithi087.stdout:9/718: dread d7/f12 [4194304,4194304] 0 2024-02-28T16:02:04.043 INFO:tasks.workunit.client.1.smithi087.stdout:6/792: dread d4/d12/d45/d74/fec [0,4194304] 0 2024-02-28T16:02:04.044 INFO:tasks.workunit.client.1.smithi087.stdout:9/719: fsync d7/dd/f28 0 2024-02-28T16:02:04.045 INFO:tasks.workunit.client.0.smithi057.stdout:5/347: mknod d2/d15/d3b/c78 0 2024-02-28T16:02:04.046 INFO:tasks.workunit.client.0.smithi057.stdout:2/324: creat d19/d1d/d26/f61 x:0 0 0 2024-02-28T16:02:04.047 INFO:tasks.workunit.client.1.smithi087.stdout:1/706: readlink d0/d1b/d1f/d71/db2/l8c 0 2024-02-28T16:02:04.049 INFO:tasks.workunit.client.1.smithi087.stdout:2/684: write d2/d7/d17/d3d/f55 [7575862,14282] 0 2024-02-28T16:02:04.049 INFO:tasks.workunit.client.0.smithi057.stdout:2/325: mknod d19/d1d/d22/c62 0 2024-02-28T16:02:04.051 INFO:tasks.workunit.client.0.smithi057.stdout:2/326: mknod d19/d1d/d2e/c63 0 2024-02-28T16:02:04.054 INFO:tasks.workunit.client.0.smithi057.stdout:2/327: mknod d19/d2c/d48/c64 0 2024-02-28T16:02:04.055 INFO:tasks.workunit.client.1.smithi087.stdout:2/685: write d2/d7/d17/d34/d88/fad [4507661,12849] 0 2024-02-28T16:02:04.055 INFO:tasks.workunit.client.0.smithi057.stdout:7/257: write d6/dc/d35/f39 [2417987,2261] 0 2024-02-28T16:02:04.057 INFO:tasks.workunit.client.0.smithi057.stdout:4/358: truncate d1/d22/f35 4127288 0 2024-02-28T16:02:04.059 INFO:tasks.workunit.client.1.smithi087.stdout:0/711: dread d4/dd/d37/d39/d3a/f7d [4194304,4194304] 0 2024-02-28T16:02:04.061 INFO:tasks.workunit.client.1.smithi087.stdout:9/720: mknod d7/dd/d15/d79/cd0 0 2024-02-28T16:02:04.064 INFO:tasks.workunit.client.1.smithi087.stdout:0/712: dread - d4/dd/d26/d93/fd7 zero size 2024-02-28T16:02:04.064 INFO:tasks.workunit.client.0.smithi057.stdout:4/359: write d1/d10/d12/d2c/d37/f42 [1310033,129009] 0 2024-02-28T16:02:04.065 INFO:tasks.workunit.client.0.smithi057.stdout:4/360: readlink d1/l30 0 2024-02-28T16:02:04.066 INFO:tasks.workunit.client.1.smithi087.stdout:6/793: truncate d4/d30/d13/d67/db8/fc5 1699915 0 2024-02-28T16:02:04.067 INFO:tasks.workunit.client.0.smithi057.stdout:4/361: readlink d1/d14/l4b 0 2024-02-28T16:02:04.068 INFO:tasks.workunit.client.0.smithi057.stdout:6/288: sync 2024-02-28T16:02:04.068 INFO:tasks.workunit.client.0.smithi057.stdout:0/502: sync 2024-02-28T16:02:04.068 INFO:tasks.workunit.client.1.smithi087.stdout:9/721: creat d7/d1e/dc4/fd1 x:0 0 0 2024-02-28T16:02:04.070 INFO:tasks.workunit.client.0.smithi057.stdout:7/258: link d6/d38/l55 d6/dc/d12/d1a/l5b 0 2024-02-28T16:02:04.073 INFO:tasks.workunit.client.0.smithi057.stdout:4/362: dread - d1/d10/d12/d2c/f77 zero size 2024-02-28T16:02:04.073 INFO:tasks.workunit.client.0.smithi057.stdout:6/289: mkdir df/d61 0 2024-02-28T16:02:04.074 INFO:tasks.workunit.client.1.smithi087.stdout:0/713: mkdir d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/de9 0 2024-02-28T16:02:04.074 INFO:tasks.workunit.client.0.smithi057.stdout:5/348: dwrite d2/d3e/d44/f69 [0,4194304] 0 2024-02-28T16:02:04.078 INFO:tasks.workunit.client.1.smithi087.stdout:0/714: creat d4/dd/d21/fea x:0 0 0 2024-02-28T16:02:04.079 INFO:tasks.workunit.client.0.smithi057.stdout:5/349: read d2/f22 [1699930,94366] 0 2024-02-28T16:02:04.080 INFO:tasks.workunit.client.1.smithi087.stdout:7/729: dread d14/d46/d7c/f84 [0,4194304] 0 2024-02-28T16:02:04.083 INFO:tasks.workunit.client.1.smithi087.stdout:1/707: dread d0/d1a/d28/f7f [0,4194304] 0 2024-02-28T16:02:04.083 INFO:tasks.workunit.client.1.smithi087.stdout:2/686: write d2/d99/f3f [2317916,27548] 0 2024-02-28T16:02:04.086 INFO:tasks.workunit.client.0.smithi057.stdout:9/399: dwrite d2/d24/d1d/f23 [0,4194304] 0 2024-02-28T16:02:04.087 INFO:tasks.workunit.client.1.smithi087.stdout:0/715: creat d4/d6/d9c/feb x:0 0 0 2024-02-28T16:02:04.088 INFO:tasks.workunit.client.1.smithi087.stdout:7/730: unlink d14/d7d/fb4 0 2024-02-28T16:02:04.089 INFO:tasks.workunit.client.0.smithi057.stdout:6/290: fdatasync df/d14/d15/f25 0 2024-02-28T16:02:04.089 INFO:tasks.workunit.client.1.smithi087.stdout:2/687: write d2/d99/d28/d79/f96 [796433,1461] 0 2024-02-28T16:02:04.092 INFO:tasks.workunit.client.1.smithi087.stdout:9/722: dwrite d7/dd/d3c/f6f [0,4194304] 0 2024-02-28T16:02:04.092 INFO:tasks.workunit.client.0.smithi057.stdout:0/503: mkdir d6/d12/d5d/d71/daa 0 2024-02-28T16:02:04.096 INFO:tasks.workunit.client.1.smithi087.stdout:1/708: mknod d0/d1b/d1f/d71/cf0 0 2024-02-28T16:02:04.096 INFO:tasks.workunit.client.1.smithi087.stdout:0/716: creat d4/dd/d26/fec x:0 0 0 2024-02-28T16:02:04.098 INFO:tasks.workunit.client.0.smithi057.stdout:5/350: symlink d2/d8/l79 0 2024-02-28T16:02:04.098 INFO:tasks.workunit.client.1.smithi087.stdout:2/688: rename d2/d7/d17/d3d/c5c to d2/d99/d28/d54/da6/cf7 0 2024-02-28T16:02:04.099 INFO:tasks.workunit.client.1.smithi087.stdout:1/709: chown d0/d1a/d28/f65 26139048 1 2024-02-28T16:02:04.101 INFO:tasks.workunit.client.0.smithi057.stdout:4/363: rmdir d1/d10/d12/d2c/d37 39 2024-02-28T16:02:04.102 INFO:tasks.workunit.client.0.smithi057.stdout:7/259: dwrite d6/dc/d35/f39 [4194304,4194304] 0 2024-02-28T16:02:04.103 INFO:tasks.workunit.client.1.smithi087.stdout:6/794: truncate d4/d30/f24 1508304 0 2024-02-28T16:02:04.105 INFO:tasks.workunit.client.0.smithi057.stdout:7/260: stat d6 0 2024-02-28T16:02:04.106 INFO:tasks.workunit.client.1.smithi087.stdout:1/710: truncate d0/d14/d86/fe9 1202504 0 2024-02-28T16:02:04.106 INFO:tasks.workunit.client.0.smithi057.stdout:2/328: dread d19/f23 [0,4194304] 0 2024-02-28T16:02:04.107 INFO:tasks.workunit.client.0.smithi057.stdout:6/291: creat df/d61/f62 x:0 0 0 2024-02-28T16:02:04.108 INFO:tasks.workunit.client.1.smithi087.stdout:6/795: creat d4/d30/d13/d38/f101 x:0 0 0 2024-02-28T16:02:04.108 INFO:tasks.workunit.client.0.smithi057.stdout:9/400: dread d2/d5/d9/f35 [0,4194304] 0 2024-02-28T16:02:04.110 INFO:tasks.workunit.client.0.smithi057.stdout:5/351: mkdir d2/d12/d76/d7a 0 2024-02-28T16:02:04.111 INFO:tasks.workunit.client.0.smithi057.stdout:6/292: fdatasync df/d14/d15/d16/f56 0 2024-02-28T16:02:04.113 INFO:tasks.workunit.client.1.smithi087.stdout:6/796: write d4/d12/d45/d74/d9a/fb2 [1176238,59618] 0 2024-02-28T16:02:04.113 INFO:tasks.workunit.client.0.smithi057.stdout:2/329: rmdir d19 39 2024-02-28T16:02:04.115 INFO:tasks.workunit.client.0.smithi057.stdout:6/293: chown df/d14/d15/d16/f31 0 1 2024-02-28T16:02:04.117 INFO:tasks.workunit.client.1.smithi087.stdout:1/711: mknod d0/d1b/d1f/d71/db2/db3/cf1 0 2024-02-28T16:02:04.119 INFO:tasks.workunit.client.1.smithi087.stdout:1/712: readlink d0/d1b/d43/laa 0 2024-02-28T16:02:04.121 INFO:tasks.workunit.client.0.smithi057.stdout:6/294: truncate df/d14/d15/d16/f31 1130638 0 2024-02-28T16:02:04.122 INFO:tasks.workunit.client.1.smithi087.stdout:2/689: dwrite d2/d7/d17/d34/f4a [0,4194304] 0 2024-02-28T16:02:04.123 INFO:tasks.workunit.client.0.smithi057.stdout:5/352: rename d2/d3e/d44 to d2/d12/d76/d7b 0 2024-02-28T16:02:04.124 INFO:tasks.workunit.client.0.smithi057.stdout:4/364: creat d1/d10/f78 x:0 0 0 2024-02-28T16:02:04.124 INFO:tasks.workunit.client.0.smithi057.stdout:2/330: dread - d19/d2c/f58 zero size 2024-02-28T16:02:04.125 INFO:tasks.workunit.client.1.smithi087.stdout:1/713: symlink d0/d1a/d28/lf2 0 2024-02-28T16:02:04.127 INFO:tasks.workunit.client.0.smithi057.stdout:7/261: creat d6/dc/d12/f5c x:0 0 0 2024-02-28T16:02:04.127 INFO:tasks.workunit.client.1.smithi087.stdout:2/690: chown d2/d7/d17/d34/f8d 14757 1 2024-02-28T16:02:04.130 INFO:tasks.workunit.client.0.smithi057.stdout:7/262: write d6/dc/d12/f5c [557669,39337] 0 2024-02-28T16:02:04.130 INFO:tasks.workunit.client.0.smithi057.stdout:2/331: truncate d19/d2c/f4f 176252 0 2024-02-28T16:02:04.132 INFO:tasks.workunit.client.0.smithi057.stdout:7/263: chown d6/d26/c2e 8058 1 2024-02-28T16:02:04.132 INFO:tasks.workunit.client.1.smithi087.stdout:1/714: rename d0/d1b/d1f/d96/d63/f98 to d0/d14/d86/dac/ff3 0 2024-02-28T16:02:04.134 INFO:tasks.workunit.client.1.smithi087.stdout:2/691: mknod d2/d99/dc7/cf8 0 2024-02-28T16:02:04.136 INFO:tasks.workunit.client.1.smithi087.stdout:7/731: write d14/d27/d5d/f70 [1289149,118978] 0 2024-02-28T16:02:04.139 INFO:tasks.workunit.client.1.smithi087.stdout:0/717: write d4/dd/d26/f2b [2699799,31314] 0 2024-02-28T16:02:04.140 INFO:tasks.workunit.client.1.smithi087.stdout:2/692: creat d2/d99/d28/d79/ff9 x:0 0 0 2024-02-28T16:02:04.141 INFO:tasks.workunit.client.0.smithi057.stdout:7/264: rename d6/l2b to d6/d26/l5d 0 2024-02-28T16:02:04.144 INFO:tasks.workunit.client.1.smithi087.stdout:2/693: mknod d2/d99/d28/d54/cfa 0 2024-02-28T16:02:04.146 INFO:tasks.workunit.client.0.smithi057.stdout:7/265: write d6/dc/d35/f39 [4509850,55920] 0 2024-02-28T16:02:04.147 INFO:tasks.workunit.client.1.smithi087.stdout:2/694: chown d2/d7/d17/f7e 164051266 1 2024-02-28T16:02:04.153 INFO:tasks.workunit.client.0.smithi057.stdout:6/295: dread df/d10/d13/f3a [0,4194304] 0 2024-02-28T16:02:04.153 INFO:tasks.workunit.client.0.smithi057.stdout:5/353: truncate d2/d12/d76/d7b/f69 3516519 0 2024-02-28T16:02:04.154 INFO:tasks.workunit.client.1.smithi087.stdout:2/695: mkdir d2/d99/d28/d79/dfb 0 2024-02-28T16:02:04.155 INFO:tasks.workunit.client.0.smithi057.stdout:2/332: dread d19/d1d/f3f [0,4194304] 0 2024-02-28T16:02:04.156 INFO:tasks.workunit.client.0.smithi057.stdout:7/266: write d6/d38/f44 [6592675,15036] 0 2024-02-28T16:02:04.159 INFO:tasks.workunit.client.1.smithi087.stdout:5/814: sync 2024-02-28T16:02:04.159 INFO:tasks.workunit.client.1.smithi087.stdout:3/778: sync 2024-02-28T16:02:04.160 INFO:tasks.workunit.client.0.smithi057.stdout:4/365: dwrite d1/d10/d12/d39/f3e [0,4194304] 0 2024-02-28T16:02:04.162 INFO:tasks.workunit.client.0.smithi057.stdout:6/296: creat df/d14/d15/d16/f63 x:0 0 0 2024-02-28T16:02:04.164 INFO:tasks.workunit.client.0.smithi057.stdout:7/267: chown d6/ff 1 1 2024-02-28T16:02:04.166 INFO:tasks.workunit.client.0.smithi057.stdout:9/401: dwrite d2/d5e/d65/f73 [0,4194304] 0 2024-02-28T16:02:04.167 INFO:tasks.workunit.client.1.smithi087.stdout:7/732: dwrite d14/d27/d5d/f99 [0,4194304] 0 2024-02-28T16:02:04.168 INFO:tasks.workunit.client.0.smithi057.stdout:2/333: unlink d19/d1d/d26/c45 0 2024-02-28T16:02:04.169 INFO:tasks.workunit.client.1.smithi087.stdout:6/797: dwrite d4/d30/d13/d38/d69/f79 [0,4194304] 0 2024-02-28T16:02:04.171 INFO:tasks.workunit.client.1.smithi087.stdout:6/798: stat d4 0 2024-02-28T16:02:04.174 INFO:tasks.workunit.client.1.smithi087.stdout:0/718: dwrite d4/d6/ddb/fde [0,4194304] 0 2024-02-28T16:02:04.181 INFO:tasks.workunit.client.0.smithi057.stdout:8/366: sync 2024-02-28T16:02:04.192 INFO:tasks.workunit.client.1.smithi087.stdout:1/715: dread d0/d1b/d43/f4b [0,4194304] 0 2024-02-28T16:02:04.192 INFO:tasks.workunit.client.1.smithi087.stdout:2/696: truncate d2/f85 3697931 0 2024-02-28T16:02:04.195 INFO:tasks.workunit.client.1.smithi087.stdout:1/716: write d0/d1b/d1f/d96/fcc [1022403,110643] 0 2024-02-28T16:02:04.197 INFO:tasks.workunit.client.1.smithi087.stdout:1/717: write d0/d14/d86/fe9 [2200684,118409] 0 2024-02-28T16:02:04.209 INFO:tasks.workunit.client.1.smithi087.stdout:1/718: fdatasync d0/d14/d86/fb0 0 2024-02-28T16:02:04.209 INFO:tasks.workunit.client.0.smithi057.stdout:4/366: write d1/d10/d12/d2c/d37/f4e [300746,69800] 0 2024-02-28T16:02:04.210 INFO:tasks.workunit.client.0.smithi057.stdout:9/402: stat d2/d46/c76 0 2024-02-28T16:02:04.211 INFO:tasks.workunit.client.0.smithi057.stdout:8/367: truncate d5/f41 960919 0 2024-02-28T16:02:04.211 INFO:tasks.workunit.client.1.smithi087.stdout:3/779: getdents d11/d7b/dab/de7/d104 0 2024-02-28T16:02:04.212 INFO:tasks.workunit.client.0.smithi057.stdout:6/297: write df/f12 [1752706,117350] 0 2024-02-28T16:02:04.215 INFO:tasks.workunit.client.1.smithi087.stdout:5/815: rename d3/d9/d9b/dba/d30/ddb to d3/d9/d9b/dba/d30/d10f/d12c 0 2024-02-28T16:02:04.215 INFO:tasks.workunit.client.0.smithi057.stdout:2/334: mkdir d19/d2c/d65 0 2024-02-28T16:02:04.216 INFO:tasks.workunit.client.1.smithi087.stdout:7/733: mknod d14/d2e/d2b/ce1 0 2024-02-28T16:02:04.216 INFO:tasks.workunit.client.0.smithi057.stdout:0/504: dread d6/d12/d17/d34/f63 [4194304,4194304] 0 2024-02-28T16:02:04.216 INFO:tasks.workunit.client.1.smithi087.stdout:2/697: creat d2/d7/d17/d97/ffc x:0 0 0 2024-02-28T16:02:04.217 INFO:tasks.workunit.client.0.smithi057.stdout:7/268: symlink d6/dc/d12/d1a/l5e 0 2024-02-28T16:02:04.218 INFO:tasks.workunit.client.1.smithi087.stdout:7/734: readlink d14/d27/d5d/d6a/d83/d96/lca 0 2024-02-28T16:02:04.218 INFO:tasks.workunit.client.0.smithi057.stdout:8/368: readlink d5/d20/d39/d49/d56/l6b 0 2024-02-28T16:02:04.219 INFO:tasks.workunit.client.0.smithi057.stdout:9/403: stat d2/d5/d9/l59 0 2024-02-28T16:02:04.220 INFO:tasks.workunit.client.1.smithi087.stdout:1/719: mkdir d0/d14/d48/da7/df4 0 2024-02-28T16:02:04.221 INFO:tasks.workunit.client.1.smithi087.stdout:6/799: mkdir d4/dc/d10/d102 0 2024-02-28T16:02:04.222 INFO:tasks.workunit.client.1.smithi087.stdout:3/780: creat d11/d45/d88/d91/f108 x:0 0 0 2024-02-28T16:02:04.223 INFO:tasks.workunit.client.0.smithi057.stdout:0/505: read d6/d12/d45/f4f [2669017,30813] 0 2024-02-28T16:02:04.224 INFO:tasks.workunit.client.0.smithi057.stdout:8/369: read d5/d20/d39/d49/f54 [927601,119990] 0 2024-02-28T16:02:04.225 INFO:tasks.workunit.client.0.smithi057.stdout:0/506: dread - d6/d12/d17/d4b/f7d zero size 2024-02-28T16:02:04.225 INFO:tasks.workunit.client.1.smithi087.stdout:0/719: rename d4/dd/d37/d39/d3a/f87 to d4/d6/dc/d45/fed 0 2024-02-28T16:02:04.226 INFO:tasks.workunit.client.0.smithi057.stdout:2/335: symlink d19/d2c/d65/l66 0 2024-02-28T16:02:04.231 INFO:tasks.workunit.client.0.smithi057.stdout:4/367: write d1/d3f/d5f/f72 [3233252,44350] 0 2024-02-28T16:02:04.231 INFO:tasks.workunit.client.0.smithi057.stdout:6/298: creat df/d10/f64 x:0 0 0 2024-02-28T16:02:04.232 INFO:tasks.workunit.client.0.smithi057.stdout:9/404: mkdir d2/d5/d9/d5d/d82 0 2024-02-28T16:02:04.233 INFO:tasks.workunit.client.1.smithi087.stdout:2/698: dwrite d2/d7/d17/d3d/f55 [0,4194304] 0 2024-02-28T16:02:04.235 INFO:tasks.workunit.client.0.smithi057.stdout:0/507: mkdir d6/d12/d45/dab 0 2024-02-28T16:02:04.238 INFO:tasks.workunit.client.0.smithi057.stdout:8/370: truncate d5/d20/d39/d49/d56/f51 1014852 0 2024-02-28T16:02:04.240 INFO:tasks.workunit.client.0.smithi057.stdout:7/269: rename d6/d26/c4f to d6/dc/d12/d1a/d4d/c5f 0 2024-02-28T16:02:04.240 INFO:tasks.workunit.client.1.smithi087.stdout:0/720: stat d4/dd/d26/lb2 0 2024-02-28T16:02:04.241 INFO:tasks.workunit.client.0.smithi057.stdout:4/368: symlink d1/d10/d12/d2c/d50/l79 0 2024-02-28T16:02:04.243 INFO:tasks.workunit.client.0.smithi057.stdout:6/299: fsync df/d10/d13/d4b/f5e 0 2024-02-28T16:02:04.243 INFO:tasks.workunit.client.0.smithi057.stdout:9/405: symlink d2/d5/d9/d5d/l83 0 2024-02-28T16:02:04.244 INFO:tasks.workunit.client.1.smithi087.stdout:0/721: chown d4/dd/d21/d32/c86 6 1 2024-02-28T16:02:04.244 INFO:tasks.workunit.client.1.smithi087.stdout:1/720: dwrite d0/d1b/d1f/d71/fe4 [0,4194304] 0 2024-02-28T16:02:04.246 INFO:tasks.workunit.client.0.smithi057.stdout:8/371: mknod d5/d62/c82 0 2024-02-28T16:02:04.248 INFO:tasks.workunit.client.0.smithi057.stdout:7/270: write d6/dc/f18 [4720786,69943] 0 2024-02-28T16:02:04.253 INFO:tasks.workunit.client.1.smithi087.stdout:7/735: dread d14/d21/d4f/fcf [0,4194304] 0 2024-02-28T16:02:04.255 INFO:tasks.workunit.client.0.smithi057.stdout:4/369: unlink d1/d10/d12/d39/l6f 0 2024-02-28T16:02:04.257 INFO:tasks.workunit.client.0.smithi057.stdout:6/300: mkdir df/d14/d15/d16/d65 0 2024-02-28T16:02:04.257 INFO:tasks.workunit.client.1.smithi087.stdout:7/736: chown d14/d27/d5d/d6a/d83/d96/ld5 0 1 2024-02-28T16:02:04.259 INFO:tasks.workunit.client.1.smithi087.stdout:0/722: dread - d4/f89 zero size 2024-02-28T16:02:04.260 INFO:tasks.workunit.client.0.smithi057.stdout:2/336: dwrite d19/d1d/d2e/d3c/f3d [0,4194304] 0 2024-02-28T16:02:04.260 INFO:tasks.workunit.client.1.smithi087.stdout:3/781: mkdir d11/d45/d73/d109 0 2024-02-28T16:02:04.265 INFO:tasks.workunit.client.0.smithi057.stdout:0/508: dread d6/d12/d38/f89 [0,4194304] 0 2024-02-28T16:02:04.266 INFO:tasks.workunit.client.1.smithi087.stdout:7/737: read f12 [843710,103750] 0 2024-02-28T16:02:04.267 INFO:tasks.workunit.client.0.smithi057.stdout:6/301: fdatasync f6 0 2024-02-28T16:02:04.267 INFO:tasks.workunit.client.1.smithi087.stdout:3/782: mknod d11/d33/d67/d9c/da1/c10a 0 2024-02-28T16:02:04.269 INFO:tasks.workunit.client.1.smithi087.stdout:0/723: unlink d4/d1c/la8 0 2024-02-28T16:02:04.270 INFO:tasks.workunit.client.0.smithi057.stdout:7/271: rename d6/dc/d12/l13 to d6/dc/d35/d58/l60 0 2024-02-28T16:02:04.270 INFO:tasks.workunit.client.1.smithi087.stdout:7/738: chown d14/d21/l58 235 1 2024-02-28T16:02:04.271 INFO:tasks.workunit.client.1.smithi087.stdout:3/783: dread - d11/d3a/d3c/fdf zero size 2024-02-28T16:02:04.273 INFO:tasks.workunit.client.0.smithi057.stdout:7/272: chown c2 64089 1 2024-02-28T16:02:04.273 INFO:tasks.workunit.client.0.smithi057.stdout:8/372: getdents d5/d20/d39/d59 0 2024-02-28T16:02:04.275 INFO:tasks.workunit.client.0.smithi057.stdout:9/406: creat d2/d5/d9/d5d/d70/f84 x:0 0 0 2024-02-28T16:02:04.277 INFO:tasks.workunit.client.1.smithi087.stdout:7/739: write f7 [2624906,126532] 0 2024-02-28T16:02:04.279 INFO:tasks.workunit.client.0.smithi057.stdout:0/509: mknod d6/d12/d5d/d7f/cac 0 2024-02-28T16:02:04.280 INFO:tasks.workunit.client.0.smithi057.stdout:7/273: creat d6/dc/d35/f61 x:0 0 0 2024-02-28T16:02:04.282 INFO:tasks.workunit.client.1.smithi087.stdout:0/724: mknod d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/cee 0 2024-02-28T16:02:04.285 INFO:tasks.workunit.client.0.smithi057.stdout:0/510: write d6/d12/d45/d78/f81 [232165,90321] 0 2024-02-28T16:02:04.286 INFO:tasks.workunit.client.0.smithi057.stdout:7/274: chown d6/dc/c40 7487330 1 2024-02-28T16:02:04.287 INFO:tasks.workunit.client.1.smithi087.stdout:7/740: creat d14/d2e/d2b/d4e/fe2 x:0 0 0 2024-02-28T16:02:04.287 INFO:tasks.workunit.client.0.smithi057.stdout:9/407: link d2/d5e/d65/c1e d2/d5/c85 0 2024-02-28T16:02:04.289 INFO:tasks.workunit.client.1.smithi087.stdout:3/784: link d11/f36 d11/d33/f10b 0 2024-02-28T16:02:04.289 INFO:tasks.workunit.client.1.smithi087.stdout:4/823: sync 2024-02-28T16:02:04.289 INFO:tasks.workunit.client.1.smithi087.stdout:8/793: sync 2024-02-28T16:02:04.293 INFO:tasks.workunit.client.1.smithi087.stdout:7/741: creat d14/d2e/d2b/d4e/fe3 x:0 0 0 2024-02-28T16:02:04.294 INFO:tasks.workunit.client.1.smithi087.stdout:4/824: write d2/d9/da/d1a/d26/d69/ffc [108391,65530] 0 2024-02-28T16:02:04.294 INFO:tasks.workunit.client.1.smithi087.stdout:8/794: chown d2/d9/d10/d24/c8a 1625711152 1 2024-02-28T16:02:04.296 INFO:tasks.workunit.client.1.smithi087.stdout:3/785: dread - d11/d33/d74/f95 zero size 2024-02-28T16:02:04.300 INFO:tasks.workunit.client.1.smithi087.stdout:7/742: mkdir d14/d21/de4 0 2024-02-28T16:02:04.302 INFO:tasks.workunit.client.0.smithi057.stdout:4/370: dread d1/d14/f1b [0,4194304] 0 2024-02-28T16:02:04.302 INFO:tasks.workunit.client.1.smithi087.stdout:8/795: fsync d2/d9/d10/d24/f5a 0 2024-02-28T16:02:04.303 INFO:tasks.workunit.client.0.smithi057.stdout:8/373: dwrite d5/f31 [0,4194304] 0 2024-02-28T16:02:04.307 INFO:tasks.workunit.client.0.smithi057.stdout:8/374: chown d5/d6/fd 61279920 1 2024-02-28T16:02:04.308 INFO:tasks.workunit.client.0.smithi057.stdout:0/511: dread d6/d12/d45/d78/f9d [0,4194304] 0 2024-02-28T16:02:04.310 INFO:tasks.workunit.client.1.smithi087.stdout:4/825: symlink d2/d9/d10/d22/l109 0 2024-02-28T16:02:04.312 INFO:tasks.workunit.client.0.smithi057.stdout:8/375: creat d5/d20/f83 x:0 0 0 2024-02-28T16:02:04.313 INFO:tasks.workunit.client.0.smithi057.stdout:7/275: dwrite d6/dc/d12/d1a/f37 [0,4194304] 0 2024-02-28T16:02:04.316 INFO:tasks.workunit.client.0.smithi057.stdout:0/512: symlink d6/lad 0 2024-02-28T16:02:04.319 INFO:tasks.workunit.client.0.smithi057.stdout:7/276: creat d6/dc/d12/d1a/f62 x:0 0 0 2024-02-28T16:02:04.323 INFO:tasks.workunit.client.0.smithi057.stdout:0/513: symlink d6/d12/d45/dab/lae 0 2024-02-28T16:02:04.325 INFO:tasks.workunit.client.1.smithi087.stdout:0/725: dwrite d4/dd/d37/d39/d3a/d57/d74/f1d [0,4194304] 0 2024-02-28T16:02:04.326 INFO:tasks.workunit.client.1.smithi087.stdout:4/826: dread - d2/d9/d10/dbf/dbb/ff9 zero size 2024-02-28T16:02:04.326 INFO:tasks.workunit.client.1.smithi087.stdout:5/816: dwrite d3/d9/d9b/dba/d30/d53/fd4 [0,4194304] 0 2024-02-28T16:02:04.332 INFO:tasks.workunit.client.1.smithi087.stdout:9/723: sync 2024-02-28T16:02:04.337 INFO:tasks.workunit.client.1.smithi087.stdout:8/796: rename d2/d9/d5e/dbc/cc1 to d2/d18/d42/dbb/c106 0 2024-02-28T16:02:04.342 INFO:tasks.workunit.client.1.smithi087.stdout:6/800: dwrite d4/d30/d13/f3b [0,4194304] 0 2024-02-28T16:02:04.345 INFO:tasks.workunit.client.1.smithi087.stdout:2/699: dwrite d2/f5a [0,4194304] 0 2024-02-28T16:02:04.346 INFO:tasks.workunit.client.1.smithi087.stdout:0/726: unlink d4/dd/l30 0 2024-02-28T16:02:04.353 INFO:tasks.workunit.client.1.smithi087.stdout:1/721: dwrite d0/d1a/d28/d9b/faf [4194304,4194304] 0 2024-02-28T16:02:04.354 INFO:tasks.workunit.client.1.smithi087.stdout:9/724: dread - d7/dd/d15/d3f/d5f/f94 zero size 2024-02-28T16:02:04.356 INFO:tasks.workunit.client.1.smithi087.stdout:7/743: dwrite d14/d21/f41 [0,4194304] 0 2024-02-28T16:02:04.356 INFO:tasks.workunit.client.1.smithi087.stdout:4/827: creat d2/df/d2e/f10a x:0 0 0 2024-02-28T16:02:04.358 INFO:tasks.workunit.client.1.smithi087.stdout:4/828: fsync d2/d9/f2c 0 2024-02-28T16:02:04.364 INFO:tasks.workunit.client.0.smithi057.stdout:1/369: sync 2024-02-28T16:02:04.364 INFO:tasks.workunit.client.0.smithi057.stdout:3/326: sync 2024-02-28T16:02:04.365 INFO:tasks.workunit.client.1.smithi087.stdout:1/722: chown d0/d1b/d1f/d71/db2/l8c 3391211 1 2024-02-28T16:02:04.366 INFO:tasks.workunit.client.1.smithi087.stdout:7/744: fsync d14/d46/f4c 0 2024-02-28T16:02:04.366 INFO:tasks.workunit.client.0.smithi057.stdout:7/277: mkdir d6/dc/d12/d1a/d4c/d63 0 2024-02-28T16:02:04.367 INFO:tasks.workunit.client.1.smithi087.stdout:2/700: chown d2/d99/d28/d79/laa 145231 1 2024-02-28T16:02:04.368 INFO:tasks.workunit.client.0.smithi057.stdout:9/408: dwrite d2/d5/d9/d5d/d70/f84 [0,4194304] 0 2024-02-28T16:02:04.369 INFO:tasks.workunit.client.1.smithi087.stdout:4/829: mknod d2/d9/d10/d22/d5b/d5c/d68/c10b 0 2024-02-28T16:02:04.370 INFO:tasks.workunit.client.0.smithi057.stdout:7/278: unlink d6/l57 0 2024-02-28T16:02:04.371 INFO:tasks.workunit.client.1.smithi087.stdout:2/701: write d2/d7/fdb [832796,55424] 0 2024-02-28T16:02:04.372 INFO:tasks.workunit.client.1.smithi087.stdout:3/786: dwrite d11/d33/d67/f6e [0,4194304] 0 2024-02-28T16:02:04.372 INFO:tasks.workunit.client.0.smithi057.stdout:3/327: write d8/dd/d14/d2e/d3b/d54/f5b [669132,55877] 0 2024-02-28T16:02:04.373 INFO:tasks.workunit.client.0.smithi057.stdout:1/370: symlink d1/d3/dc/d15/l7f 0 2024-02-28T16:02:04.374 INFO:tasks.workunit.client.0.smithi057.stdout:7/279: mknod d6/dc/d35/c64 0 2024-02-28T16:02:04.376 INFO:tasks.workunit.client.0.smithi057.stdout:9/409: mknod d2/d5/d1b/d2e/d77/c86 0 2024-02-28T16:02:04.376 INFO:tasks.workunit.client.1.smithi087.stdout:4/830: mknod d2/d9/da/d1a/d26/c10c 0 2024-02-28T16:02:04.377 INFO:tasks.workunit.client.0.smithi057.stdout:3/328: chown d8/dd/l10 55878 1 2024-02-28T16:02:04.377 INFO:tasks.workunit.client.0.smithi057.stdout:1/371: rmdir d1/d3/dc/d15 39 2024-02-28T16:02:04.378 INFO:tasks.workunit.client.0.smithi057.stdout:9/410: chown d2/d5/d9/d5d/l7a 1714517 1 2024-02-28T16:02:04.378 INFO:tasks.workunit.client.0.smithi057.stdout:7/280: symlink d6/dc/d12/d1a/d4c/l65 0 2024-02-28T16:02:04.379 INFO:tasks.workunit.client.1.smithi087.stdout:1/723: creat d0/d14/ff5 x:0 0 0 2024-02-28T16:02:04.381 INFO:tasks.workunit.client.1.smithi087.stdout:7/745: creat d14/d21/de4/fe5 x:0 0 0 2024-02-28T16:02:04.382 INFO:tasks.workunit.client.1.smithi087.stdout:2/702: unlink d2/d7/la 0 2024-02-28T16:02:04.383 INFO:tasks.workunit.client.0.smithi057.stdout:3/329: creat d8/dd/d14/d2e/d30/f64 x:0 0 0 2024-02-28T16:02:04.384 INFO:tasks.workunit.client.0.smithi057.stdout:1/372: symlink d1/d21/d66/l80 0 2024-02-28T16:02:04.385 INFO:tasks.workunit.client.1.smithi087.stdout:3/787: creat d11/d61/d7c/db7/f10c x:0 0 0 2024-02-28T16:02:04.388 INFO:tasks.workunit.client.0.smithi057.stdout:3/330: creat d8/dd/d14/d2e/d2f/f65 x:0 0 0 2024-02-28T16:02:04.390 INFO:tasks.workunit.client.0.smithi057.stdout:1/373: creat d1/f81 x:0 0 0 2024-02-28T16:02:04.393 INFO:tasks.workunit.client.1.smithi087.stdout:2/703: chown d2/d42/ff3 38 1 2024-02-28T16:02:04.393 INFO:tasks.workunit.client.0.smithi057.stdout:3/331: mkdir d8/dd/d14/d2e/d30/d49/d51/d66 0 2024-02-28T16:02:04.394 INFO:tasks.workunit.client.1.smithi087.stdout:7/746: mknod d14/d46/d7c/dc3/ce6 0 2024-02-28T16:02:04.398 INFO:tasks.workunit.client.0.smithi057.stdout:1/374: mkdir d1/d21/d66/d53/d7d/d67/d6c/d82 0 2024-02-28T16:02:04.399 INFO:tasks.workunit.client.1.smithi087.stdout:4/831: creat d2/d9/d10/d22/d5b/d5c/d68/dc5/df1/f10d x:0 0 0 2024-02-28T16:02:04.399 INFO:tasks.workunit.client.1.smithi087.stdout:3/788: creat d11/d61/d7c/db7/f10d x:0 0 0 2024-02-28T16:02:04.399 INFO:tasks.workunit.client.0.smithi057.stdout:7/281: dwrite d6/dc/f34 [0,4194304] 0 2024-02-28T16:02:04.402 INFO:tasks.workunit.client.1.smithi087.stdout:8/797: dwrite d2/d33/f35 [0,4194304] 0 2024-02-28T16:02:04.407 INFO:tasks.workunit.client.0.smithi057.stdout:7/282: rename d6/ff to d6/dc/d12/d1a/d4d/d5a/f66 0 2024-02-28T16:02:04.407 INFO:tasks.workunit.client.1.smithi087.stdout:7/747: write d14/d2e/d2b/d4e/fb1 [231407,107960] 0 2024-02-28T16:02:04.413 INFO:tasks.workunit.client.1.smithi087.stdout:4/832: creat d2/df/d65/f10e x:0 0 0 2024-02-28T16:02:04.413 INFO:tasks.workunit.client.1.smithi087.stdout:7/748: chown d14/d46/d7c/db9 0 1 2024-02-28T16:02:04.415 INFO:tasks.workunit.client.1.smithi087.stdout:5/817: dwrite d3/d9/d9b/dba/d30/d53/fd4 [0,4194304] 0 2024-02-28T16:02:04.417 INFO:tasks.workunit.client.0.smithi057.stdout:4/371: truncate d1/d10/d12/d15/f25 1076108 0 2024-02-28T16:02:04.419 INFO:tasks.workunit.client.0.smithi057.stdout:4/372: read - d1/d3f/f5d zero size 2024-02-28T16:02:04.419 INFO:tasks.workunit.client.1.smithi087.stdout:3/789: creat d11/d44/d5b/f10e x:0 0 0 2024-02-28T16:02:04.423 INFO:tasks.workunit.client.0.smithi057.stdout:4/373: unlink d1/d3f/f74 0 2024-02-28T16:02:04.431 INFO:tasks.workunit.client.0.smithi057.stdout:4/374: mknod d1/d10/d12/d2c/d37/c7a 0 2024-02-28T16:02:04.432 INFO:tasks.workunit.client.0.smithi057.stdout:7/283: dwrite d6/d38/f44 [4194304,4194304] 0 2024-02-28T16:02:04.433 INFO:tasks.workunit.client.1.smithi087.stdout:3/790: creat d11/d3a/f10f x:0 0 0 2024-02-28T16:02:04.439 INFO:tasks.workunit.client.1.smithi087.stdout:2/704: dwrite d2/d99/d28/d79/f93 [0,4194304] 0 2024-02-28T16:02:04.445 INFO:tasks.workunit.client.1.smithi087.stdout:4/833: rename d2/d9/d10/d22/d5b/lf2 to d2/d9/d10/dbf/db6/l10f 0 2024-02-28T16:02:04.446 INFO:tasks.workunit.client.1.smithi087.stdout:7/749: dread d14/f40 [0,4194304] 0 2024-02-28T16:02:04.447 INFO:tasks.workunit.client.1.smithi087.stdout:5/818: truncate d3/d9/d9b/dba/d30/d36/f7a 2169317 0 2024-02-28T16:02:04.448 INFO:tasks.workunit.client.0.smithi057.stdout:0/514: truncate d6/d4e/f32 150921 0 2024-02-28T16:02:04.449 INFO:tasks.workunit.client.0.smithi057.stdout:9/411: read d2/d5/d9/f4b [4061869,128415] 0 2024-02-28T16:02:04.452 INFO:tasks.workunit.client.0.smithi057.stdout:7/284: dwrite d6/dc/d12/d29/f3e [0,4194304] 0 2024-02-28T16:02:04.453 INFO:tasks.workunit.client.1.smithi087.stdout:2/705: truncate d2/d9a/dd3/fd5 932416 0 2024-02-28T16:02:04.453 INFO:tasks.workunit.client.1.smithi087.stdout:7/750: truncate d14/d7d/fad 631696 0 2024-02-28T16:02:04.454 INFO:tasks.workunit.client.0.smithi057.stdout:0/515: write d6/d12/d45/d55/f6d [2181900,116309] 0 2024-02-28T16:02:04.458 INFO:tasks.workunit.client.1.smithi087.stdout:3/791: mknod d11/d33/d67/c110 0 2024-02-28T16:02:04.461 INFO:tasks.workunit.client.0.smithi057.stdout:7/285: getdents d6/dc/d35 0 2024-02-28T16:02:04.463 INFO:tasks.workunit.client.0.smithi057.stdout:0/516: mkdir d6/d12/d17/d58/d95/daf 0 2024-02-28T16:02:04.466 INFO:tasks.workunit.client.1.smithi087.stdout:7/751: mkdir d14/d21/de4/de7 0 2024-02-28T16:02:04.470 INFO:tasks.workunit.client.1.smithi087.stdout:5/819: rename d3/d9/d4a/d5e to d3/d9/d9b/dba/d30/d36/d112/d12d 0 2024-02-28T16:02:04.471 INFO:tasks.workunit.client.0.smithi057.stdout:3/332: write d8/dd/d14/f1b [4749403,10122] 0 2024-02-28T16:02:04.475 INFO:tasks.workunit.client.1.smithi087.stdout:6/801: truncate d4/dc/f1f 2983515 0 2024-02-28T16:02:04.476 INFO:tasks.workunit.client.1.smithi087.stdout:5/820: unlink d3/d9/d9b/dba/d30/d8f/fa2 0 2024-02-28T16:02:04.478 INFO:tasks.workunit.client.0.smithi057.stdout:9/412: dwrite d2/d5/d1b/d2e/d44/f4f [0,4194304] 0 2024-02-28T16:02:04.480 INFO:tasks.workunit.client.0.smithi057.stdout:3/333: creat d8/dd/d14/d2e/f67 x:0 0 0 2024-02-28T16:02:04.481 INFO:tasks.workunit.client.1.smithi087.stdout:3/792: read d11/d44/d5b/f5a [3217611,9038] 0 2024-02-28T16:02:04.481 INFO:tasks.workunit.client.0.smithi057.stdout:9/413: truncate d2/f75 632536 0 2024-02-28T16:02:04.483 INFO:tasks.workunit.client.0.smithi057.stdout:1/375: write d1/d21/d66/d44/d4c/f5e [109984,40897] 0 2024-02-28T16:02:04.485 INFO:tasks.workunit.client.0.smithi057.stdout:7/286: dwrite d6/dc/f10 [4194304,4194304] 0 2024-02-28T16:02:04.485 INFO:tasks.workunit.client.0.smithi057.stdout:3/334: dread - d8/dd/d14/d2c/f53 zero size 2024-02-28T16:02:04.488 INFO:tasks.workunit.client.0.smithi057.stdout:9/414: fsync d2/d5e/d65/f28 0 2024-02-28T16:02:04.489 INFO:tasks.workunit.client.1.smithi087.stdout:2/706: getdents d2/d7/dec 0 2024-02-28T16:02:04.491 INFO:tasks.workunit.client.1.smithi087.stdout:0/727: dwrite d4/d6/dc/f99 [0,4194304] 0 2024-02-28T16:02:04.495 INFO:tasks.workunit.client.1.smithi087.stdout:2/707: chown d2/d99/dc7/de2/le9 2512 1 2024-02-28T16:02:04.496 INFO:tasks.workunit.client.1.smithi087.stdout:9/725: dwrite d7/dd/d15/d79/f7f [0,4194304] 0 2024-02-28T16:02:04.500 INFO:tasks.workunit.client.0.smithi057.stdout:1/376: chown d1/d3/dc/d15/c1d 0 1 2024-02-28T16:02:04.508 INFO:tasks.workunit.client.1.smithi087.stdout:1/724: dwrite d0/d1a/f7d [0,4194304] 0 2024-02-28T16:02:04.510 INFO:tasks.workunit.client.1.smithi087.stdout:5/821: symlink d3/d9/d9b/dba/d30/d8f/dac/d109/db9/l12e 0 2024-02-28T16:02:04.511 INFO:tasks.workunit.client.0.smithi057.stdout:0/517: dread d6/d12/d17/d4b/f36 [0,4194304] 0 2024-02-28T16:02:04.515 INFO:tasks.workunit.client.1.smithi087.stdout:9/726: symlink d7/dd/d15/d3f/d6d/dc2/ld2 0 2024-02-28T16:02:04.515 INFO:tasks.workunit.client.0.smithi057.stdout:3/335: mknod d8/c68 0 2024-02-28T16:02:04.516 INFO:tasks.workunit.client.0.smithi057.stdout:1/377: creat d1/d21/d66/d53/d7d/d65/f83 x:0 0 0 2024-02-28T16:02:04.517 INFO:tasks.workunit.client.0.smithi057.stdout:3/336: stat d8/dd/d14/d2e/d30/d49 0 2024-02-28T16:02:04.519 INFO:tasks.workunit.client.1.smithi087.stdout:9/727: chown d7/d1e/d44/f92 5372757 1 2024-02-28T16:02:04.519 INFO:tasks.workunit.client.0.smithi057.stdout:1/378: write d1/d21/d66/d53/d7d/d65/f5a [755402,126255] 0 2024-02-28T16:02:04.520 INFO:tasks.workunit.client.1.smithi087.stdout:6/802: dread d4/d30/f24 [0,4194304] 0 2024-02-28T16:02:04.522 INFO:tasks.workunit.client.0.smithi057.stdout:3/337: fsync d8/dd/d14/d2e/f67 0 2024-02-28T16:02:04.524 INFO:tasks.workunit.client.1.smithi087.stdout:4/834: dwrite d2/d9/da/d1a/d26/f35 [0,4194304] 0 2024-02-28T16:02:04.525 INFO:tasks.workunit.client.1.smithi087.stdout:0/728: symlink d4/dd/d37/d39/lef 0 2024-02-28T16:02:04.528 INFO:tasks.workunit.client.0.smithi057.stdout:3/338: write d8/dd/d14/f1b [4629345,97718] 0 2024-02-28T16:02:04.533 INFO:tasks.workunit.client.1.smithi087.stdout:3/793: rmdir d11/d33/d74/df0/dfc 0 2024-02-28T16:02:04.533 INFO:tasks.workunit.client.1.smithi087.stdout:1/725: fdatasync d0/d1b/d1f/d96/fa4 0 2024-02-28T16:02:04.536 INFO:tasks.workunit.client.0.smithi057.stdout:3/339: getdents d8/dd/d14/d2e 0 2024-02-28T16:02:04.537 INFO:tasks.workunit.client.1.smithi087.stdout:6/803: unlink d4/d12/d45/l48 0 2024-02-28T16:02:04.541 INFO:tasks.workunit.client.0.smithi057.stdout:5/354: sync 2024-02-28T16:02:04.544 INFO:tasks.workunit.client.0.smithi057.stdout:9/415: dwrite d2/f3a [0,4194304] 0 2024-02-28T16:02:04.544 INFO:tasks.workunit.client.1.smithi087.stdout:3/794: rename d11/d44/d5b/ce0 to d11/d7b/dab/de7/d104/c111 0 2024-02-28T16:02:04.545 INFO:tasks.workunit.client.0.smithi057.stdout:7/287: dwrite d6/fb [0,4194304] 0 2024-02-28T16:02:04.548 INFO:tasks.workunit.client.0.smithi057.stdout:5/355: write d2/d12/d3d/f3f [4194623,73698] 0 2024-02-28T16:02:04.548 INFO:tasks.workunit.client.1.smithi087.stdout:6/804: truncate d4/f20 1699385 0 2024-02-28T16:02:04.549 INFO:tasks.workunit.client.1.smithi087.stdout:3/795: creat d11/d45/d88/f112 x:0 0 0 2024-02-28T16:02:04.552 INFO:tasks.workunit.client.0.smithi057.stdout:9/416: dread - d2/d24/d1d/f60 zero size 2024-02-28T16:02:04.555 INFO:tasks.workunit.client.0.smithi057.stdout:5/356: symlink d2/d12/d76/d7b/d62/d74/l7c 0 2024-02-28T16:02:04.556 INFO:tasks.workunit.client.0.smithi057.stdout:5/357: chown d2 1283836 1 2024-02-28T16:02:04.556 INFO:tasks.workunit.client.1.smithi087.stdout:6/805: rename d4/dc/l29 to d4/d12/d45/d92/dc1/de9/l103 0 2024-02-28T16:02:04.560 INFO:tasks.workunit.client.0.smithi057.stdout:7/288: mkdir d6/dc/d67 0 2024-02-28T16:02:04.561 INFO:tasks.workunit.client.1.smithi087.stdout:3/796: rename d11/d44/d5b/f5f to d11/d33/d67/d98/d9b/f113 0 2024-02-28T16:02:04.567 INFO:tasks.workunit.client.0.smithi057.stdout:7/289: mknod d6/d38/c68 0 2024-02-28T16:02:04.572 INFO:tasks.workunit.client.0.smithi057.stdout:5/358: creat d2/d12/d76/d7a/f7d x:0 0 0 2024-02-28T16:02:04.573 INFO:tasks.workunit.client.0.smithi057.stdout:1/379: write d1/d21/d66/d44/f58 [886830,105549] 0 2024-02-28T16:02:04.574 INFO:tasks.workunit.client.1.smithi087.stdout:9/728: truncate d7/d1e/fad 469982 0 2024-02-28T16:02:04.574 INFO:tasks.workunit.client.1.smithi087.stdout:0/729: truncate d4/dd/d26/f2b 459209 0 2024-02-28T16:02:04.575 INFO:tasks.workunit.client.0.smithi057.stdout:5/359: write d2/d12/d3d/f61 [4336455,60280] 0 2024-02-28T16:02:04.575 INFO:tasks.workunit.client.0.smithi057.stdout:1/380: chown d1/d21/d66 5360 1 2024-02-28T16:02:04.577 INFO:tasks.workunit.client.0.smithi057.stdout:7/290: creat d6/dc/d12/d1a/d4d/f69 x:0 0 0 2024-02-28T16:02:04.580 INFO:tasks.workunit.client.1.smithi087.stdout:1/726: truncate d0/d14/f54 82490 0 2024-02-28T16:02:04.587 INFO:tasks.workunit.client.1.smithi087.stdout:9/729: creat d7/dd/d15/d3f/d5f/d90/fd3 x:0 0 0 2024-02-28T16:02:04.592 INFO:tasks.workunit.client.1.smithi087.stdout:6/806: dwrite d4/d12/d45/d74/fec [0,4194304] 0 2024-02-28T16:02:04.592 INFO:tasks.workunit.client.1.smithi087.stdout:2/708: dwrite d2/d7/d17/f59 [0,4194304] 0 2024-02-28T16:02:04.593 INFO:tasks.workunit.client.1.smithi087.stdout:5/822: dwrite d3/d9/fc6 [4194304,4194304] 0 2024-02-28T16:02:04.596 INFO:tasks.workunit.client.1.smithi087.stdout:9/730: write d7/dd/d15/d3f/d5f/f94 [863730,14276] 0 2024-02-28T16:02:04.605 INFO:tasks.workunit.client.1.smithi087.stdout:3/797: dread d11/f24 [0,4194304] 0 2024-02-28T16:02:04.606 INFO:tasks.workunit.client.1.smithi087.stdout:0/730: link d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/cd4 d4/d6/d9c/cf0 0 2024-02-28T16:02:04.607 INFO:tasks.workunit.client.1.smithi087.stdout:6/807: dread d4/d30/f24 [0,4194304] 0 2024-02-28T16:02:04.613 INFO:tasks.workunit.client.1.smithi087.stdout:2/709: creat d2/d99/d28/d54/da6/dd7/ffd x:0 0 0 2024-02-28T16:02:04.613 INFO:tasks.workunit.client.0.smithi057.stdout:9/417: write d2/d5/d1b/d2e/d4c/f5a [678373,13904] 0 2024-02-28T16:02:04.614 INFO:tasks.workunit.client.1.smithi087.stdout:3/798: creat d11/d61/d7c/f114 x:0 0 0 2024-02-28T16:02:04.614 INFO:tasks.workunit.client.0.smithi057.stdout:3/340: dread d8/fa [0,4194304] 0 2024-02-28T16:02:04.618 INFO:tasks.workunit.client.1.smithi087.stdout:1/727: dwrite d0/d1b/d1f/d71/db2/d24/d5c/d69/f7c [0,4194304] 0 2024-02-28T16:02:04.619 INFO:tasks.workunit.client.0.smithi057.stdout:9/418: mkdir d2/d5e/d65/d87 0 2024-02-28T16:02:04.619 INFO:tasks.workunit.client.1.smithi087.stdout:5/823: getdents d3/d9/d9b/dba/d30/d10f 0 2024-02-28T16:02:04.623 INFO:tasks.workunit.client.1.smithi087.stdout:9/731: dread d7/dd/d15/d79/f7f [0,4194304] 0 2024-02-28T16:02:04.623 INFO:tasks.workunit.client.0.smithi057.stdout:1/381: dread d1/d3/dc/d15/f3e [0,4194304] 0 2024-02-28T16:02:04.630 INFO:tasks.workunit.client.1.smithi087.stdout:0/731: creat d4/dd/d37/d39/d3a/d57/d74/d1f/ff1 x:0 0 0 2024-02-28T16:02:04.633 INFO:tasks.workunit.client.0.smithi057.stdout:1/382: symlink d1/d21/d66/d53/d7d/l84 0 2024-02-28T16:02:04.636 INFO:tasks.workunit.client.0.smithi057.stdout:5/360: dwrite d2/d12/d76/d7b/f69 [0,4194304] 0 2024-02-28T16:02:04.637 INFO:tasks.workunit.client.1.smithi087.stdout:5/824: readlink d3/d9/d9b/dba/d30/d53/d5b/la3 0 2024-02-28T16:02:04.639 INFO:tasks.workunit.client.0.smithi057.stdout:7/291: dwrite d6/d26/f36 [0,4194304] 0 2024-02-28T16:02:04.643 INFO:tasks.workunit.client.1.smithi087.stdout:3/799: dwrite d11/d33/d67/d9c/f9f [0,4194304] 0 2024-02-28T16:02:04.643 INFO:tasks.workunit.client.0.smithi057.stdout:5/361: fsync d2/d15/f43 0 2024-02-28T16:02:04.643 INFO:tasks.workunit.client.1.smithi087.stdout:1/728: fsync d0/d1b/d43/fa3 0 2024-02-28T16:02:04.646 INFO:tasks.workunit.client.0.smithi057.stdout:3/341: dwrite d8/dd/d14/d2e/d2f/f42 [0,4194304] 0 2024-02-28T16:02:04.646 INFO:tasks.workunit.client.1.smithi087.stdout:9/732: rename d7/dd/d15/d3f/d6d/d9f/cc8 to d7/dd/d99/da3/cd4 0 2024-02-28T16:02:04.648 INFO:tasks.workunit.client.1.smithi087.stdout:0/732: mkdir d4/d6/dc/d45/db4/df2 0 2024-02-28T16:02:04.649 INFO:tasks.workunit.client.0.smithi057.stdout:9/419: dwrite d2/d5/d1b/f49 [0,4194304] 0 2024-02-28T16:02:04.650 INFO:tasks.workunit.client.1.smithi087.stdout:9/733: chown d7/dd/d3c/d4c/da1/f7b 1 1 2024-02-28T16:02:04.654 INFO:tasks.workunit.client.0.smithi057.stdout:7/292: creat d6/dc/d35/f6a x:0 0 0 2024-02-28T16:02:04.654 INFO:tasks.workunit.client.1.smithi087.stdout:3/800: write d11/f2a [4241827,76437] 0 2024-02-28T16:02:04.655 INFO:tasks.workunit.client.1.smithi087.stdout:0/733: mknod d4/dd/d21/d32/cf3 0 2024-02-28T16:02:04.656 INFO:tasks.workunit.client.1.smithi087.stdout:1/729: mknod d0/cf6 0 2024-02-28T16:02:04.661 INFO:tasks.workunit.client.0.smithi057.stdout:5/362: link d2/d15/d3b/l6b d2/d12/d5f/l7e 0 2024-02-28T16:02:04.662 INFO:tasks.workunit.client.0.smithi057.stdout:7/293: creat d6/dc/d35/d58/f6b x:0 0 0 2024-02-28T16:02:04.663 INFO:tasks.workunit.client.1.smithi087.stdout:3/801: unlink d11/l21 0 2024-02-28T16:02:04.663 INFO:tasks.workunit.client.1.smithi087.stdout:1/730: chown d0/d1b/d1f/d71/db2/d24/d78/f9c 374 1 2024-02-28T16:02:04.665 INFO:tasks.workunit.client.1.smithi087.stdout:3/802: readlink d11/l22 0 2024-02-28T16:02:04.669 INFO:tasks.workunit.client.1.smithi087.stdout:1/731: symlink d0/d1b/d1f/d71/db2/d24/d5c/d69/lf7 0 2024-02-28T16:02:04.671 INFO:tasks.workunit.client.1.smithi087.stdout:0/734: read d4/dd/d21/f96 [3392983,38852] 0 2024-02-28T16:02:04.675 INFO:tasks.workunit.client.1.smithi087.stdout:0/735: write d4/dd/f13 [676720,27071] 0 2024-02-28T16:02:04.676 INFO:tasks.workunit.client.1.smithi087.stdout:0/736: chown d4/dd/d26/d93/fbc 4487807 1 2024-02-28T16:02:04.678 INFO:tasks.workunit.client.1.smithi087.stdout:6/808: dread d4/d30/fe3 [0,4194304] 0 2024-02-28T16:02:04.678 INFO:tasks.workunit.client.1.smithi087.stdout:0/737: write d4/d6/dc/fcf [440402,60139] 0 2024-02-28T16:02:04.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:04 smithi057 ceph-mon[28763]: pgmap v34: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 90 MiB/s rd, 286 MiB/s wr, 541 op/s 2024-02-28T16:02:04.680 INFO:tasks.workunit.client.1.smithi087.stdout:3/803: link d11/d44/f57 d11/d61/d65/da9/f115 0 2024-02-28T16:02:04.682 INFO:tasks.workunit.client.1.smithi087.stdout:6/809: read - d4/d12/fbc zero size 2024-02-28T16:02:04.684 INFO:tasks.workunit.client.1.smithi087.stdout:0/738: mkdir d4/d6/df4 0 2024-02-28T16:02:04.685 INFO:tasks.workunit.client.0.smithi057.stdout:7/294: dwrite d6/dc/d35/f6a [0,4194304] 0 2024-02-28T16:02:04.685 INFO:tasks.workunit.client.1.smithi087.stdout:0/739: readlink d4/l75 0 2024-02-28T16:02:04.686 INFO:tasks.workunit.client.1.smithi087.stdout:3/804: creat d11/d45/d73/f116 x:0 0 0 2024-02-28T16:02:04.687 INFO:tasks.workunit.client.1.smithi087.stdout:6/810: chown d4/d30/d13/d67/cbf 3598 1 2024-02-28T16:02:04.689 INFO:tasks.workunit.client.1.smithi087.stdout:2/710: dread d2/d7/d17/f33 [0,4194304] 0 2024-02-28T16:02:04.696 INFO:tasks.workunit.client.0.smithi057.stdout:7/295: mkdir d6/dc/d12/d1a/d4c/d6c 0 2024-02-28T16:02:04.697 INFO:tasks.workunit.client.1.smithi087.stdout:0/740: creat d4/dd/d37/d39/d3a/d57/d74/ff5 x:0 0 0 2024-02-28T16:02:04.700 INFO:tasks.workunit.client.1.smithi087.stdout:3/805: dread d11/d33/d67/d98/daf/fd5 [0,4194304] 0 2024-02-28T16:02:04.702 INFO:tasks.workunit.client.1.smithi087.stdout:0/741: truncate d4/dd/f82 629146 0 2024-02-28T16:02:04.710 INFO:tasks.workunit.client.1.smithi087.stdout:3/806: chown d11/d33/f10b 17420 1 2024-02-28T16:02:04.710 INFO:tasks.workunit.client.0.smithi057.stdout:7/296: getdents d6/dc/d12/d1a 0 2024-02-28T16:02:04.710 INFO:tasks.workunit.client.0.smithi057.stdout:5/363: dread d2/d8/fb [0,4194304] 0 2024-02-28T16:02:04.713 INFO:tasks.workunit.client.0.smithi057.stdout:1/383: dwrite d1/d3/dc/f69 [0,4194304] 0 2024-02-28T16:02:04.713 INFO:tasks.workunit.client.1.smithi087.stdout:2/711: dwrite d2/f5a [4194304,4194304] 0 2024-02-28T16:02:04.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:04 smithi087 ceph-mon[37122]: pgmap v34: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 90 MiB/s rd, 286 MiB/s wr, 541 op/s 2024-02-28T16:02:04.715 INFO:tasks.workunit.client.1.smithi087.stdout:3/807: symlink d11/d7b/l117 0 2024-02-28T16:02:04.716 INFO:tasks.workunit.client.0.smithi057.stdout:9/420: dread d2/d46/f6b [0,4194304] 0 2024-02-28T16:02:04.716 INFO:tasks.workunit.client.1.smithi087.stdout:1/732: truncate d0/d1b/d1f/f4a 3264977 0 2024-02-28T16:02:04.716 INFO:tasks.workunit.client.1.smithi087.stdout:6/811: dwrite d4/dc/d61/d89/f9d [0,4194304] 0 2024-02-28T16:02:04.718 INFO:tasks.workunit.client.1.smithi087.stdout:2/712: symlink d2/d99/dc7/lfe 0 2024-02-28T16:02:04.720 INFO:tasks.workunit.client.1.smithi087.stdout:3/808: symlink d11/d33/d67/d9c/da1/l118 0 2024-02-28T16:02:04.725 INFO:tasks.workunit.client.1.smithi087.stdout:0/742: rename d4/dd/d37/d39/d3a/d57/d74/d1f/cc4 to d4/dd/d37/d39/d3a/d57/d74/cf6 0 2024-02-28T16:02:04.725 INFO:tasks.workunit.client.1.smithi087.stdout:1/733: fsync d0/d14/f17 0 2024-02-28T16:02:04.725 INFO:tasks.workunit.client.1.smithi087.stdout:3/809: write d11/d45/d73/f116 [109177,105390] 0 2024-02-28T16:02:04.725 INFO:tasks.workunit.client.1.smithi087.stdout:9/734: dwrite d7/dc/f18 [0,4194304] 0 2024-02-28T16:02:04.733 INFO:tasks.workunit.client.1.smithi087.stdout:9/735: stat d7/d1e/d44/f46 0 2024-02-28T16:02:04.735 INFO:tasks.workunit.client.0.smithi057.stdout:5/364: dwrite d2/f4a [0,4194304] 0 2024-02-28T16:02:04.735 INFO:tasks.workunit.client.0.smithi057.stdout:1/384: creat d1/d3/dc/d15/d4e/d5f/f85 x:0 0 0 2024-02-28T16:02:04.738 INFO:tasks.workunit.client.1.smithi087.stdout:3/810: stat d11/d45/d88/d91/de3/de5/cf8 0 2024-02-28T16:02:04.740 INFO:tasks.workunit.client.1.smithi087.stdout:0/743: link d4/dd/d37/d39/d3a/f46 d4/dd/d21/ff7 0 2024-02-28T16:02:04.740 INFO:tasks.workunit.client.1.smithi087.stdout:9/736: creat d7/d1e/dc4/fd5 x:0 0 0 2024-02-28T16:02:04.740 INFO:tasks.workunit.client.0.smithi057.stdout:7/297: dread d6/d38/f44 [4194304,4194304] 0 2024-02-28T16:02:04.742 INFO:tasks.workunit.client.0.smithi057.stdout:5/365: mkdir d2/d15/d5e/d7f 0 2024-02-28T16:02:04.744 INFO:tasks.workunit.client.0.smithi057.stdout:7/298: write d6/d26/f50 [7061278,112205] 0 2024-02-28T16:02:04.744 INFO:tasks.workunit.client.1.smithi087.stdout:3/811: creat d11/d33/d67/d98/f119 x:0 0 0 2024-02-28T16:02:04.745 INFO:tasks.workunit.client.0.smithi057.stdout:7/299: stat d6/d26/l4a 0 2024-02-28T16:02:04.747 INFO:tasks.workunit.client.0.smithi057.stdout:5/366: symlink d2/d12/d5f/l80 0 2024-02-28T16:02:04.748 INFO:tasks.workunit.client.1.smithi087.stdout:2/713: dwrite d2/f87 [0,4194304] 0 2024-02-28T16:02:04.748 INFO:tasks.workunit.client.0.smithi057.stdout:7/300: getdents d6/d26/d54 0 2024-02-28T16:02:04.749 INFO:tasks.workunit.client.1.smithi087.stdout:0/744: symlink d4/dd/d37/d39/d3a/d57/d74/lf8 0 2024-02-28T16:02:04.752 INFO:tasks.workunit.client.1.smithi087.stdout:2/714: chown d2/l49 220114 1 2024-02-28T16:02:04.754 INFO:tasks.workunit.client.0.smithi057.stdout:7/301: dread - d6/dc/d35/f61 zero size 2024-02-28T16:02:04.754 INFO:tasks.workunit.client.0.smithi057.stdout:5/367: creat d2/d15/d5e/d6d/f81 x:0 0 0 2024-02-28T16:02:04.756 INFO:tasks.workunit.client.0.smithi057.stdout:7/302: fsync d6/dc/d12/d1a/f62 0 2024-02-28T16:02:04.758 INFO:tasks.workunit.client.0.smithi057.stdout:7/303: readlink d6/dc/d12/l32 0 2024-02-28T16:02:04.758 INFO:tasks.workunit.client.1.smithi087.stdout:3/812: creat d11/d33/d74/f11a x:0 0 0 2024-02-28T16:02:04.760 INFO:tasks.workunit.client.0.smithi057.stdout:1/385: dwrite d1/d21/d66/d53/d7d/d67/f6a [0,4194304] 0 2024-02-28T16:02:04.764 INFO:tasks.workunit.client.0.smithi057.stdout:7/304: mknod d6/dc/d12/d1a/d4d/d56/c6d 0 2024-02-28T16:02:04.765 INFO:tasks.workunit.client.1.smithi087.stdout:9/737: rename d7/dd/d36/l5d to d7/dd/d15/d3f/ld6 0 2024-02-28T16:02:04.767 INFO:tasks.workunit.client.1.smithi087.stdout:6/812: dwrite d4/d12/d45/f5d [0,4194304] 0 2024-02-28T16:02:04.768 INFO:tasks.workunit.client.0.smithi057.stdout:1/386: unlink d1/d21/d25/l79 0 2024-02-28T16:02:04.770 INFO:tasks.workunit.client.0.smithi057.stdout:9/421: dwrite d2/d5/f37 [0,4194304] 0 2024-02-28T16:02:04.773 INFO:tasks.workunit.client.1.smithi087.stdout:0/745: rename d4/dd/d37/d39/d3a/d57/d74/f1d to d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/ff9 0 2024-02-28T16:02:04.774 INFO:tasks.workunit.client.1.smithi087.stdout:6/813: chown d4/dc/d61/d89 809678 1 2024-02-28T16:02:04.774 INFO:tasks.workunit.client.0.smithi057.stdout:7/305: unlink d6/dc/d12/d1a/c1d 0 2024-02-28T16:02:04.779 INFO:tasks.workunit.client.1.smithi087.stdout:1/734: dwrite d0/d1a/d28/f8d [0,4194304] 0 2024-02-28T16:02:04.781 INFO:tasks.workunit.client.1.smithi087.stdout:1/735: chown d0/d14/d86/f89 682959 1 2024-02-28T16:02:04.782 INFO:tasks.workunit.client.1.smithi087.stdout:9/738: mknod d7/d1e/d60/d69/cd7 0 2024-02-28T16:02:04.782 INFO:tasks.workunit.client.0.smithi057.stdout:6/302: sync 2024-02-28T16:02:04.782 INFO:tasks.workunit.client.0.smithi057.stdout:8/376: sync 2024-02-28T16:02:04.782 INFO:tasks.workunit.client.0.smithi057.stdout:2/337: sync 2024-02-28T16:02:04.783 INFO:tasks.workunit.client.0.smithi057.stdout:1/387: rmdir d1/d3/dc/d15/d4e/d5f 39 2024-02-28T16:02:04.784 INFO:tasks.workunit.client.1.smithi087.stdout:9/739: stat d7/d1e/d44/d83/d8e 0 2024-02-28T16:02:04.785 INFO:tasks.workunit.client.0.smithi057.stdout:5/368: dwrite d2/d8/f6c [0,4194304] 0 2024-02-28T16:02:04.788 INFO:tasks.workunit.client.1.smithi087.stdout:7/752: sync 2024-02-28T16:02:04.789 INFO:tasks.workunit.client.1.smithi087.stdout:4/835: sync 2024-02-28T16:02:04.789 INFO:tasks.workunit.client.1.smithi087.stdout:8/798: sync 2024-02-28T16:02:04.792 INFO:tasks.workunit.client.1.smithi087.stdout:0/746: rename d4/dd/d37/d39/d3a/f7d to d4/dd/d21/d52/ffa 0 2024-02-28T16:02:04.796 INFO:tasks.workunit.client.1.smithi087.stdout:8/799: readlink d2/d18/d25/l11 0 2024-02-28T16:02:04.797 INFO:tasks.workunit.client.0.smithi057.stdout:6/303: mkdir df/d61/d66 0 2024-02-28T16:02:04.797 INFO:tasks.workunit.client.1.smithi087.stdout:0/747: chown d4/dd/d37/d39/d3a/d57/d74/lf8 1 1 2024-02-28T16:02:04.798 INFO:tasks.workunit.client.1.smithi087.stdout:1/736: symlink d0/d1b/d1f/d71/db2/d24/d78/lf8 0 2024-02-28T16:02:04.799 INFO:tasks.workunit.client.0.smithi057.stdout:2/338: creat d19/d57/f67 x:0 0 0 2024-02-28T16:02:04.800 INFO:tasks.workunit.client.0.smithi057.stdout:8/377: mkdir d5/d20/d39/d49/d56/d84 0 2024-02-28T16:02:04.800 INFO:tasks.workunit.client.1.smithi087.stdout:1/737: write d0/f70 [1666411,14480] 0 2024-02-28T16:02:04.802 INFO:tasks.workunit.client.1.smithi087.stdout:0/748: unlink d4/ce1 0 2024-02-28T16:02:04.803 INFO:tasks.workunit.client.0.smithi057.stdout:6/304: fsync df/d14/d15/d16/f63 0 2024-02-28T16:02:04.803 INFO:tasks.workunit.client.1.smithi087.stdout:8/800: truncate d2/fa9 630631 0 2024-02-28T16:02:04.804 INFO:tasks.workunit.client.0.smithi057.stdout:5/369: rename d2/d8/f49 to d2/d12/d3d/f82 0 2024-02-28T16:02:04.807 INFO:tasks.workunit.client.1.smithi087.stdout:0/749: chown d4/d6/dc/d45/db4/df2 3 1 2024-02-28T16:02:04.808 INFO:tasks.workunit.client.0.smithi057.stdout:2/339: mknod d19/d2c/d65/c68 0 2024-02-28T16:02:04.808 INFO:tasks.workunit.client.1.smithi087.stdout:1/738: unlink d0/d14/d3f/c9a 0 2024-02-28T16:02:04.810 INFO:tasks.workunit.client.1.smithi087.stdout:2/715: dwrite d2/d7/f2d [0,4194304] 0 2024-02-28T16:02:04.814 INFO:tasks.workunit.client.0.smithi057.stdout:2/340: truncate d19/d1d/f51 893109 0 2024-02-28T16:02:04.816 INFO:tasks.workunit.client.1.smithi087.stdout:3/813: write d11/d44/f5e [1335214,99248] 0 2024-02-28T16:02:04.819 INFO:tasks.workunit.client.0.smithi057.stdout:2/341: symlink d19/d2c/l69 0 2024-02-28T16:02:04.819 INFO:tasks.workunit.client.1.smithi087.stdout:7/753: dwrite d14/d27/d5d/d6a/d83/fb3 [0,4194304] 0 2024-02-28T16:02:04.820 INFO:tasks.workunit.client.0.smithi057.stdout:1/388: dwrite d1/f34 [0,4194304] 0 2024-02-28T16:02:04.823 INFO:tasks.workunit.client.1.smithi087.stdout:6/814: write d4/d30/d13/d38/fa2 [243727,54167] 0 2024-02-28T16:02:04.825 INFO:tasks.workunit.client.1.smithi087.stdout:1/739: rename d0/d1b/d1f/d71/db2/d24/d5c/d69/f94 to d0/d1a/ff9 0 2024-02-28T16:02:04.826 INFO:tasks.workunit.client.1.smithi087.stdout:2/716: symlink d2/d7/d17/d34/daf/lff 0 2024-02-28T16:02:04.830 INFO:tasks.workunit.client.1.smithi087.stdout:7/754: symlink d14/d2e/d89/dbb/le8 0 2024-02-28T16:02:04.830 INFO:tasks.workunit.client.1.smithi087.stdout:2/717: chown d2/d99/c73 9 1 2024-02-28T16:02:04.831 INFO:tasks.workunit.client.0.smithi057.stdout:2/342: symlink d19/d43/l6a 0 2024-02-28T16:02:04.832 INFO:tasks.workunit.client.1.smithi087.stdout:6/815: rmdir d4/d30/d13/d38 39 2024-02-28T16:02:04.832 INFO:tasks.workunit.client.1.smithi087.stdout:5/825: sync 2024-02-28T16:02:04.832 INFO:tasks.workunit.client.0.smithi057.stdout:6/305: dwrite df/d10/d13/f3a [0,4194304] 0 2024-02-28T16:02:04.835 INFO:tasks.workunit.client.1.smithi087.stdout:2/718: chown d2/d7/d17/f33 5016629 1 2024-02-28T16:02:04.835 INFO:tasks.workunit.client.0.smithi057.stdout:5/370: dwrite d2/d8/fb [0,4194304] 0 2024-02-28T16:02:04.836 INFO:tasks.workunit.client.0.smithi057.stdout:6/306: stat df/d61/f62 0 2024-02-28T16:02:04.838 INFO:tasks.workunit.client.1.smithi087.stdout:3/814: getdents d11/d7b/dab 0 2024-02-28T16:02:04.838 INFO:tasks.workunit.client.0.smithi057.stdout:1/389: mkdir d1/d21/d86 0 2024-02-28T16:02:04.840 INFO:tasks.workunit.client.1.smithi087.stdout:0/750: dwrite d4/dd/d26/d93/fbc [0,4194304] 0 2024-02-28T16:02:04.842 INFO:tasks.workunit.client.0.smithi057.stdout:6/307: write f6 [241275,80141] 0 2024-02-28T16:02:04.844 INFO:tasks.workunit.client.0.smithi057.stdout:5/371: write d2/d15/d5e/d6d/f81 [139094,17626] 0 2024-02-28T16:02:04.847 INFO:tasks.workunit.client.1.smithi087.stdout:7/755: rename d14/f40 to d14/d2e/d89/dbd/fe9 0 2024-02-28T16:02:04.850 INFO:tasks.workunit.client.0.smithi057.stdout:6/308: creat df/d14/d15/d16/d39/f67 x:0 0 0 2024-02-28T16:02:04.850 INFO:tasks.workunit.client.0.smithi057.stdout:7/306: dwrite f4 [0,4194304] 0 2024-02-28T16:02:04.851 INFO:tasks.workunit.client.1.smithi087.stdout:9/740: write d7/f14 [197585,40365] 0 2024-02-28T16:02:04.854 INFO:tasks.workunit.client.1.smithi087.stdout:4/836: write d2/df/d62/fd0 [1365256,70636] 0 2024-02-28T16:02:04.856 INFO:tasks.workunit.client.1.smithi087.stdout:2/719: write d2/f21 [3044957,94668] 0 2024-02-28T16:02:04.857 INFO:tasks.workunit.client.1.smithi087.stdout:8/801: dread d2/d9/d5e/d9c/d9f/fba [0,4194304] 0 2024-02-28T16:02:04.858 INFO:tasks.workunit.client.0.smithi057.stdout:6/309: creat df/d14/d15/d16/d65/f68 x:0 0 0 2024-02-28T16:02:04.859 INFO:tasks.workunit.client.1.smithi087.stdout:7/756: rmdir d14/d27/d5d/d6a 39 2024-02-28T16:02:04.863 INFO:tasks.workunit.client.0.smithi057.stdout:6/310: truncate f9 3331278 0 2024-02-28T16:02:04.864 INFO:tasks.workunit.client.1.smithi087.stdout:8/802: chown d2/d9/d10/d24/d9d 1430807 1 2024-02-28T16:02:04.865 INFO:tasks.workunit.client.1.smithi087.stdout:5/826: dwrite d3/d9/d9b/dba/d30/d53/d5b/f108 [4194304,4194304] 0 2024-02-28T16:02:04.865 INFO:tasks.workunit.client.1.smithi087.stdout:4/837: stat d2/d9/d10/dbf/dbb/ff9 0 2024-02-28T16:02:04.865 INFO:tasks.workunit.client.1.smithi087.stdout:6/816: mknod d4/d30/d13/d38/dc3/c104 0 2024-02-28T16:02:04.867 INFO:tasks.workunit.client.1.smithi087.stdout:2/720: truncate d2/f87 4232763 0 2024-02-28T16:02:04.870 INFO:tasks.workunit.client.0.smithi057.stdout:5/372: dread d2/d19/d1c/f36 [0,4194304] 0 2024-02-28T16:02:04.870 INFO:tasks.workunit.client.1.smithi087.stdout:8/803: truncate d2/d7c/fb9 248395 0 2024-02-28T16:02:04.870 INFO:tasks.workunit.client.1.smithi087.stdout:7/757: read - d14/d21/d4f/fd0 zero size 2024-02-28T16:02:04.870 INFO:tasks.workunit.client.1.smithi087.stdout:0/751: dread d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f8e [0,4194304] 0 2024-02-28T16:02:04.874 INFO:tasks.workunit.client.0.smithi057.stdout:5/373: chown d2/d12/d5f/d77 19679 1 2024-02-28T16:02:04.876 INFO:tasks.workunit.client.0.smithi057.stdout:5/374: fdatasync d2/d15/d5e/d6d/f75 0 2024-02-28T16:02:04.876 INFO:tasks.workunit.client.1.smithi087.stdout:9/741: creat d7/dd/d99/da3/fd8 x:0 0 0 2024-02-28T16:02:04.878 INFO:tasks.workunit.client.0.smithi057.stdout:6/311: rename df/l3e to df/d10/d13/d4b/d4e/l69 0 2024-02-28T16:02:04.880 INFO:tasks.workunit.client.1.smithi087.stdout:6/817: chown d4/d12/d45/f97 518591 1 2024-02-28T16:02:04.881 INFO:tasks.workunit.client.0.smithi057.stdout:5/375: rename d2/f35 to d2/d15/f83 0 2024-02-28T16:02:04.883 INFO:tasks.workunit.client.0.smithi057.stdout:6/312: symlink df/d14/d15/d16/d39/l6a 0 2024-02-28T16:02:04.884 INFO:tasks.workunit.client.1.smithi087.stdout:1/740: getdents d0/d1b/d1f/d71/db2/d24/d78 0 2024-02-28T16:02:04.886 INFO:tasks.workunit.client.1.smithi087.stdout:4/838: symlink d2/d9/da/l110 0 2024-02-28T16:02:04.886 INFO:tasks.workunit.client.1.smithi087.stdout:9/742: readlink d7/d1e/d60/d69/lca 0 2024-02-28T16:02:04.888 INFO:tasks.workunit.client.1.smithi087.stdout:3/815: link d11/d7b/dab/fb3 d11/d61/d7c/f11b 0 2024-02-28T16:02:04.894 INFO:tasks.workunit.client.1.smithi087.stdout:7/758: chown d14/d7d/cc9 1291644637 1 2024-02-28T16:02:04.895 INFO:tasks.workunit.client.1.smithi087.stdout:9/743: write d7/d1e/d44/fc1 [651359,111242] 0 2024-02-28T16:02:04.900 INFO:tasks.workunit.client.0.smithi057.stdout:6/313: dwrite df/d10/d13/f1e [0,4194304] 0 2024-02-28T16:02:04.900 INFO:tasks.workunit.client.0.smithi057.stdout:7/307: rename d6/dc/d35/c64 to d6/dc/d12/d1a/d4c/c6e 0 2024-02-28T16:02:04.900 INFO:tasks.workunit.client.1.smithi087.stdout:8/804: unlink d2/d33/c4d 0 2024-02-28T16:02:04.900 INFO:tasks.workunit.client.1.smithi087.stdout:5/827: dwrite d3/d9/d9b/dba/f116 [0,4194304] 0 2024-02-28T16:02:04.909 INFO:tasks.workunit.client.1.smithi087.stdout:2/721: getdents d2/d99 0 2024-02-28T16:02:04.910 INFO:tasks.workunit.client.0.smithi057.stdout:7/308: link d6/dc/d35/c41 d6/dc/c6f 0 2024-02-28T16:02:04.911 INFO:tasks.workunit.client.0.smithi057.stdout:1/390: write d1/d21/f63 [283541,21374] 0 2024-02-28T16:02:04.912 INFO:tasks.workunit.client.0.smithi057.stdout:7/309: chown d6/dc/d12/d1a/d4c/d6c 4643547 1 2024-02-28T16:02:04.914 INFO:tasks.workunit.client.0.smithi057.stdout:7/310: fdatasync d6/dc/d12/f47 0 2024-02-28T16:02:04.920 INFO:tasks.workunit.client.0.smithi057.stdout:8/378: dread d5/f17 [0,4194304] 0 2024-02-28T16:02:04.924 INFO:tasks.workunit.client.1.smithi087.stdout:7/759: mknod d14/d46/d7c/dc3/cea 0 2024-02-28T16:02:04.925 INFO:tasks.workunit.client.0.smithi057.stdout:4/375: sync 2024-02-28T16:02:04.926 INFO:tasks.workunit.client.1.smithi087.stdout:6/818: link d4/d12/d45/f5d d4/d12/d45/d92/dc1/dc7/f105 0 2024-02-28T16:02:04.927 INFO:tasks.workunit.client.0.smithi057.stdout:7/311: mknod d6/dc/d12/d1a/d4c/d6c/c70 0 2024-02-28T16:02:04.929 INFO:tasks.workunit.client.0.smithi057.stdout:5/376: chown d2/c14 1 1 2024-02-28T16:02:04.931 INFO:tasks.workunit.client.1.smithi087.stdout:9/744: link d7/dd/d15/d3f/d5f/fb1 d7/dd/d15/d3f/d6d/dcd/fd9 0 2024-02-28T16:02:04.932 INFO:tasks.workunit.client.1.smithi087.stdout:2/722: getdents d2/d42/df1 0 2024-02-28T16:02:04.934 INFO:tasks.workunit.client.0.smithi057.stdout:1/391: dwrite d1/d21/f52 [4194304,4194304] 0 2024-02-28T16:02:04.934 INFO:tasks.workunit.client.0.smithi057.stdout:5/377: write d2/d12/d5f/f68 [285708,256] 0 2024-02-28T16:02:04.935 INFO:tasks.workunit.client.1.smithi087.stdout:9/745: chown d7/dd/d15/d3f/d6d/fac 9 1 2024-02-28T16:02:04.936 INFO:tasks.workunit.client.0.smithi057.stdout:4/376: unlink d1/d10/d12/d15/f25 0 2024-02-28T16:02:04.941 INFO:tasks.workunit.client.0.smithi057.stdout:6/314: truncate df/d10/d13/d4b/f51 261914 0 2024-02-28T16:02:04.942 INFO:tasks.workunit.client.1.smithi087.stdout:2/723: mknod d2/d99/dc7/de2/de4/c100 0 2024-02-28T16:02:04.942 INFO:tasks.workunit.client.1.smithi087.stdout:6/819: creat d4/d30/d42/de7/f106 x:0 0 0 2024-02-28T16:02:04.944 INFO:tasks.workunit.client.1.smithi087.stdout:2/724: stat d2/d7/l31 0 2024-02-28T16:02:04.944 INFO:tasks.workunit.client.1.smithi087.stdout:4/839: link d2/d9/d10/d22/d5b/d5c/d90/l105 d2/d49/l111 0 2024-02-28T16:02:04.945 INFO:tasks.workunit.client.0.smithi057.stdout:1/392: mknod d1/d3/dc/d15/d4e/d5f/c87 0 2024-02-28T16:02:04.946 INFO:tasks.workunit.client.0.smithi057.stdout:4/377: truncate d1/d10/d31/f60 629691 0 2024-02-28T16:02:04.946 INFO:tasks.workunit.client.0.smithi057.stdout:7/312: truncate d6/fb 3275496 0 2024-02-28T16:02:04.949 INFO:tasks.workunit.client.1.smithi087.stdout:6/820: rmdir d4/dc 39 2024-02-28T16:02:04.950 INFO:tasks.workunit.client.0.smithi057.stdout:5/378: mknod d2/d15/d63/c84 0 2024-02-28T16:02:04.950 INFO:tasks.workunit.client.0.smithi057.stdout:8/379: dwrite d5/f7 [0,4194304] 0 2024-02-28T16:02:04.950 INFO:tasks.workunit.client.1.smithi087.stdout:5/828: link d3/d9/d9b/dba/d30/d36/d112/d12d/da1/fc3 d3/d9/d9b/dba/d30/d8f/dac/d109/db9/f12f 0 2024-02-28T16:02:04.954 INFO:tasks.workunit.client.1.smithi087.stdout:4/840: symlink d2/d9/d10/dbf/dbb/l112 0 2024-02-28T16:02:04.955 INFO:tasks.workunit.client.0.smithi057.stdout:4/378: creat d1/d10/d12/d2c/d50/f7b x:0 0 0 2024-02-28T16:02:04.955 INFO:tasks.workunit.client.1.smithi087.stdout:5/829: chown d3/d9/df6/f10b 7022 1 2024-02-28T16:02:04.962 INFO:tasks.workunit.client.1.smithi087.stdout:6/821: symlink d4/dc/l107 0 2024-02-28T16:02:04.963 INFO:tasks.workunit.client.1.smithi087.stdout:7/760: dread d14/d21/f45 [0,4194304] 0 2024-02-28T16:02:04.963 INFO:tasks.workunit.client.0.smithi057.stdout:1/393: getdents d1/d3/dc/d15/d4e/d57 0 2024-02-28T16:02:04.965 INFO:tasks.workunit.client.0.smithi057.stdout:4/379: creat d1/d3f/d5f/f7c x:0 0 0 2024-02-28T16:02:04.969 INFO:tasks.workunit.client.0.smithi057.stdout:7/313: link d6/dc/d12/d1a/d4c/l65 d6/dc/d35/d58/l71 0 2024-02-28T16:02:04.971 INFO:tasks.workunit.client.0.smithi057.stdout:1/394: creat d1/d3/dc/d40/f88 x:0 0 0 2024-02-28T16:02:04.973 INFO:tasks.workunit.client.1.smithi087.stdout:3/816: dread d11/d61/fff [0,4194304] 0 2024-02-28T16:02:04.974 INFO:tasks.workunit.client.0.smithi057.stdout:4/380: creat d1/d22/f7d x:0 0 0 2024-02-28T16:02:04.974 INFO:tasks.workunit.client.0.smithi057.stdout:8/380: getdents d5/de/d1b/d57 0 2024-02-28T16:02:04.976 INFO:tasks.workunit.client.1.smithi087.stdout:2/725: dwrite d2/d7/d17/d34/feb [0,4194304] 0 2024-02-28T16:02:04.978 INFO:tasks.workunit.client.1.smithi087.stdout:5/830: link d3/d9/d9b/ce3 d3/d9/d9b/d115/c130 0 2024-02-28T16:02:04.979 INFO:tasks.workunit.client.1.smithi087.stdout:1/741: dwrite d0/d1b/d1f/f4a [0,4194304] 0 2024-02-28T16:02:04.981 INFO:tasks.workunit.client.0.smithi057.stdout:1/395: symlink d1/d21/d66/d53/d62/d73/l89 0 2024-02-28T16:02:04.984 INFO:tasks.workunit.client.0.smithi057.stdout:0/518: sync 2024-02-28T16:02:04.985 INFO:tasks.workunit.client.1.smithi087.stdout:4/841: dwrite d2/df/d65/fdc [0,4194304] 0 2024-02-28T16:02:04.987 INFO:tasks.workunit.client.1.smithi087.stdout:6/822: dread d4/d30/d13/f3b [0,4194304] 0 2024-02-28T16:02:04.988 INFO:tasks.workunit.client.1.smithi087.stdout:2/726: creat d2/d99/d28/d79/f101 x:0 0 0 2024-02-28T16:02:04.989 INFO:tasks.workunit.client.0.smithi057.stdout:4/381: link d1/d10/f43 d1/d10/d31/f7e 0 2024-02-28T16:02:04.993 INFO:tasks.workunit.client.1.smithi087.stdout:6/823: chown d4/d12/d45/d5e/feb 6732 1 2024-02-28T16:02:04.994 INFO:tasks.workunit.client.1.smithi087.stdout:1/742: rmdir d0 39 2024-02-28T16:02:04.995 INFO:tasks.workunit.client.1.smithi087.stdout:5/831: mkdir d3/d9/d9b/dba/d30/d36/d112/d12d/da1/d131 0 2024-02-28T16:02:04.996 INFO:tasks.workunit.client.1.smithi087.stdout:9/746: dread d7/d1e/d44/f92 [0,4194304] 0 2024-02-28T16:02:04.997 INFO:tasks.workunit.client.0.smithi057.stdout:5/379: dread d2/f1b [0,4194304] 0 2024-02-28T16:02:04.998 INFO:tasks.workunit.client.0.smithi057.stdout:1/396: link d1/d3/f3b d1/f8a 0 2024-02-28T16:02:04.998 INFO:tasks.workunit.client.0.smithi057.stdout:6/315: dwrite df/d14/f2d [0,4194304] 0 2024-02-28T16:02:04.999 INFO:tasks.workunit.client.0.smithi057.stdout:0/519: getdents d6/d4e 0 2024-02-28T16:02:05.001 INFO:tasks.workunit.client.1.smithi087.stdout:6/824: truncate d4/d30/d42/de7/f106 913211 0 2024-02-28T16:02:05.003 INFO:tasks.workunit.client.1.smithi087.stdout:6/825: fsync d4/d30/d13/f2a 0 2024-02-28T16:02:05.004 INFO:tasks.workunit.client.1.smithi087.stdout:3/817: dwrite d11/d45/d88/f105 [0,4194304] 0 2024-02-28T16:02:05.004 INFO:tasks.workunit.client.0.smithi057.stdout:7/314: dwrite d6/dc/d12/f2d [0,4194304] 0 2024-02-28T16:02:05.005 INFO:tasks.workunit.client.1.smithi087.stdout:5/832: creat d3/d64/f132 x:0 0 0 2024-02-28T16:02:05.007 INFO:tasks.workunit.client.0.smithi057.stdout:6/316: write df/d14/d15/d16/f63 [939988,56035] 0 2024-02-28T16:02:05.008 INFO:tasks.workunit.client.1.smithi087.stdout:9/747: mknod d7/dd/d99/da3/cda 0 2024-02-28T16:02:05.010 INFO:tasks.workunit.client.0.smithi057.stdout:6/317: fdatasync df/d10/d13/f41 0 2024-02-28T16:02:05.010 INFO:tasks.workunit.client.1.smithi087.stdout:1/743: mkdir d0/d1b/d1f/d96/dfa 0 2024-02-28T16:02:05.011 INFO:tasks.workunit.client.0.smithi057.stdout:1/397: unlink d1/d3/f3a 0 2024-02-28T16:02:05.012 INFO:tasks.workunit.client.0.smithi057.stdout:6/318: dread - df/f42 zero size 2024-02-28T16:02:05.013 INFO:tasks.workunit.client.1.smithi087.stdout:6/826: write d4/d30/d13/f2a [3396836,48966] 0 2024-02-28T16:02:05.018 INFO:tasks.workunit.client.0.smithi057.stdout:0/520: truncate d6/d12/d45/f4f 3816629 0 2024-02-28T16:02:05.019 INFO:tasks.workunit.client.0.smithi057.stdout:7/315: mknod d6/dc/d12/d1a/d4c/d6c/c72 0 2024-02-28T16:02:05.020 INFO:tasks.workunit.client.1.smithi087.stdout:4/842: dwrite d2/d9/da/d1a/d26/fc7 [0,4194304] 0 2024-02-28T16:02:05.023 INFO:tasks.workunit.client.1.smithi087.stdout:9/748: fdatasync d7/dd/d15/d79/f26 0 2024-02-28T16:02:05.023 INFO:tasks.workunit.client.0.smithi057.stdout:4/382: rename d1/d10/d31/d36/f61 to d1/d10/d12/f7f 0 2024-02-28T16:02:05.024 INFO:tasks.workunit.client.1.smithi087.stdout:6/827: fsync d4/d30/d13/f93 0 2024-02-28T16:02:05.026 INFO:tasks.workunit.client.0.smithi057.stdout:4/383: chown d1/d10/d12/d2c/d37/f42 0 1 2024-02-28T16:02:05.029 INFO:tasks.workunit.client.0.smithi057.stdout:4/384: write d1/d3f/d5f/f72 [1243213,110475] 0 2024-02-28T16:02:05.031 INFO:tasks.workunit.client.0.smithi057.stdout:7/316: chown d6/dc/d12/d1a/d4c/l65 62 1 2024-02-28T16:02:05.035 INFO:tasks.workunit.client.1.smithi087.stdout:7/761: dread d14/d27/d5d/f5e [0,4194304] 0 2024-02-28T16:02:05.035 INFO:tasks.workunit.client.1.smithi087.stdout:4/843: rename d2/d9/da/d1a/d26/f3a to d2/d9/d10/d22/d5b/d5c/d90/df5/f113 0 2024-02-28T16:02:05.035 INFO:tasks.workunit.client.0.smithi057.stdout:1/398: rename d1/d21/d66/l2b to d1/d21/d66/d44/l8b 0 2024-02-28T16:02:05.036 INFO:tasks.workunit.client.0.smithi057.stdout:7/317: dread - d6/dc/d35/d58/f6b zero size 2024-02-28T16:02:05.036 INFO:tasks.workunit.client.0.smithi057.stdout:8/381: truncate d5/de/d1b/d57/f5e 6031 0 2024-02-28T16:02:05.036 INFO:tasks.workunit.client.1.smithi087.stdout:7/762: fsync d14/d2e/d2b/d4e/fb1 0 2024-02-28T16:02:05.036 INFO:tasks.workunit.client.1.smithi087.stdout:6/828: symlink d4/dc/d10/d102/l108 0 2024-02-28T16:02:05.037 INFO:tasks.workunit.client.0.smithi057.stdout:7/318: write d6/dc/d35/f6a [800805,21602] 0 2024-02-28T16:02:05.043 INFO:tasks.workunit.client.0.smithi057.stdout:4/385: rmdir d1/d10/d12/d2c/d37/d46 39 2024-02-28T16:02:05.044 INFO:tasks.workunit.client.0.smithi057.stdout:8/382: mkdir d5/de/d1b/d57/d85 0 2024-02-28T16:02:05.045 INFO:tasks.workunit.client.0.smithi057.stdout:4/386: fsync d1/d22/f75 0 2024-02-28T16:02:05.045 INFO:tasks.workunit.client.1.smithi087.stdout:6/829: fdatasync d4/d30/d13/f93 0 2024-02-28T16:02:05.047 INFO:tasks.workunit.client.0.smithi057.stdout:1/399: symlink d1/l8c 0 2024-02-28T16:02:05.048 INFO:tasks.workunit.client.0.smithi057.stdout:4/387: write d1/f7 [4492508,56958] 0 2024-02-28T16:02:05.048 INFO:tasks.workunit.client.1.smithi087.stdout:7/763: rename d14/d27 to d14/d2e/d89/deb 0 2024-02-28T16:02:05.051 INFO:tasks.workunit.client.1.smithi087.stdout:5/833: dread d3/fb2 [0,4194304] 0 2024-02-28T16:02:05.052 INFO:tasks.workunit.client.1.smithi087.stdout:4/844: getdents d2/df 0 2024-02-28T16:02:05.052 INFO:tasks.workunit.client.0.smithi057.stdout:4/388: read d1/d10/d12/d15/d19/f2b [454443,89428] 0 2024-02-28T16:02:05.053 INFO:tasks.workunit.client.0.smithi057.stdout:8/383: getdents d5/de/d1b 0 2024-02-28T16:02:05.055 INFO:tasks.workunit.client.0.smithi057.stdout:1/400: rename d1/d21/f39 to d1/d21/d66/d53/d7d/d67/d6c/d82/f8d 0 2024-02-28T16:02:05.056 INFO:tasks.workunit.client.1.smithi087.stdout:7/764: getdents d14/d46 0 2024-02-28T16:02:05.056 INFO:tasks.workunit.client.1.smithi087.stdout:5/834: chown d3/d9/d9b/dba/d30/d36/f4e 399413 1 2024-02-28T16:02:05.058 INFO:tasks.workunit.client.1.smithi087.stdout:3/818: write d11/d44/d5b/f5a [5587343,76491] 0 2024-02-28T16:02:05.059 INFO:tasks.workunit.client.1.smithi087.stdout:4/845: creat d2/d9/d10/d22/d5b/d5c/d68/dc5/f114 x:0 0 0 2024-02-28T16:02:05.059 INFO:tasks.workunit.client.0.smithi057.stdout:4/389: mknod d1/d10/d31/c80 0 2024-02-28T16:02:05.061 INFO:tasks.workunit.client.1.smithi087.stdout:7/765: read d14/d2e/d2b/f67 [639103,32524] 0 2024-02-28T16:02:05.063 INFO:tasks.workunit.client.1.smithi087.stdout:1/744: write d0/d1a/d28/f65 [3447337,108969] 0 2024-02-28T16:02:05.063 INFO:tasks.workunit.client.0.smithi057.stdout:1/401: creat d1/d21/d66/d53/d62/f8e x:0 0 0 2024-02-28T16:02:05.066 INFO:tasks.workunit.client.0.smithi057.stdout:1/402: chown d1/d3/dc/d15/f17 8232534 1 2024-02-28T16:02:05.067 INFO:tasks.workunit.client.1.smithi087.stdout:3/819: write d11/f31 [4501992,21481] 0 2024-02-28T16:02:05.068 INFO:tasks.workunit.client.1.smithi087.stdout:5/835: dread d3/f61 [0,4194304] 0 2024-02-28T16:02:05.070 INFO:tasks.workunit.client.1.smithi087.stdout:7/766: truncate d14/d46/f81 862624 0 2024-02-28T16:02:05.071 INFO:tasks.workunit.client.1.smithi087.stdout:4/846: read d2/d9/d10/d22/d5b/d5c/d90/df5/f113 [1920181,96880] 0 2024-02-28T16:02:05.074 INFO:tasks.workunit.client.1.smithi087.stdout:3/820: symlink d11/d44/d5b/l11c 0 2024-02-28T16:02:05.074 INFO:tasks.workunit.client.1.smithi087.stdout:1/745: fdatasync d0/d1b/d1f/d71/db2/d24/fb7 0 2024-02-28T16:02:05.074 INFO:tasks.workunit.client.1.smithi087.stdout:5/836: mkdir d3/d64/d67/d133 0 2024-02-28T16:02:05.076 INFO:tasks.workunit.client.1.smithi087.stdout:6/830: dwrite d4/d30/d13/d38/d69/d99/fc4 [0,4194304] 0 2024-02-28T16:02:05.077 INFO:tasks.workunit.client.1.smithi087.stdout:3/821: stat d11/d61/d65/l68 0 2024-02-28T16:02:05.080 INFO:tasks.workunit.client.1.smithi087.stdout:6/831: write d4/dc/d7e/fb3 [3088620,112069] 0 2024-02-28T16:02:05.081 INFO:tasks.workunit.client.1.smithi087.stdout:5/837: unlink d3/d64/f132 0 2024-02-28T16:02:05.083 INFO:tasks.workunit.client.0.smithi057.stdout:6/319: dwrite df/d10/d13/d4b/f51 [0,4194304] 0 2024-02-28T16:02:05.086 INFO:tasks.workunit.client.1.smithi087.stdout:7/767: creat d14/d2e/dab/fec x:0 0 0 2024-02-28T16:02:05.088 INFO:tasks.workunit.client.1.smithi087.stdout:3/822: creat d11/d45/d73/d109/f11d x:0 0 0 2024-02-28T16:02:05.089 INFO:tasks.workunit.client.1.smithi087.stdout:4/847: mkdir d2/d49/d115 0 2024-02-28T16:02:05.089 INFO:tasks.workunit.client.0.smithi057.stdout:4/390: dread d1/d14/f33 [4194304,4194304] 0 2024-02-28T16:02:05.094 INFO:tasks.workunit.client.1.smithi087.stdout:7/768: creat d14/d21/de4/de7/fed x:0 0 0 2024-02-28T16:02:05.095 INFO:tasks.workunit.client.0.smithi057.stdout:4/391: creat d1/d10/d12/f81 x:0 0 0 2024-02-28T16:02:05.095 INFO:tasks.workunit.client.1.smithi087.stdout:3/823: mknod d11/d61/d7c/c11e 0 2024-02-28T16:02:05.096 INFO:tasks.workunit.client.0.smithi057.stdout:4/392: dread - d1/d10/f71 zero size 2024-02-28T16:02:05.097 INFO:tasks.workunit.client.1.smithi087.stdout:4/848: mkdir d2/df/d62/d116 0 2024-02-28T16:02:05.099 INFO:tasks.workunit.client.0.smithi057.stdout:4/393: fdatasync d1/d10/d31/f62 0 2024-02-28T16:02:05.100 INFO:tasks.workunit.client.1.smithi087.stdout:6/832: write d4/d30/f6b [3645234,82992] 0 2024-02-28T16:02:05.100 INFO:tasks.workunit.client.1.smithi087.stdout:7/769: read - d14/d21/d4f/f53 zero size 2024-02-28T16:02:05.101 INFO:tasks.workunit.client.1.smithi087.stdout:3/824: mknod d11/d45/d88/c11f 0 2024-02-28T16:02:05.102 INFO:tasks.workunit.client.1.smithi087.stdout:4/849: fdatasync d2/df/d2e/f8e 0 2024-02-28T16:02:05.103 INFO:tasks.workunit.client.0.smithi057.stdout:6/320: dwrite df/d14/d15/d16/d65/f68 [0,4194304] 0 2024-02-28T16:02:05.105 INFO:tasks.workunit.client.1.smithi087.stdout:7/770: mknod d14/d21/cee 0 2024-02-28T16:02:05.106 INFO:tasks.workunit.client.1.smithi087.stdout:3/825: mknod d11/d45/d73/d109/c120 0 2024-02-28T16:02:05.107 INFO:tasks.workunit.client.0.smithi057.stdout:6/321: symlink df/d14/d15/d16/d39/l6b 0 2024-02-28T16:02:05.110 INFO:tasks.workunit.client.0.smithi057.stdout:6/322: read df/d14/d15/f25 [3116472,85152] 0 2024-02-28T16:02:05.110 INFO:tasks.workunit.client.1.smithi087.stdout:7/771: rename d14/d2e/d2b/d4e/fe2 to d14/d46/d80/fef 0 2024-02-28T16:02:05.112 INFO:tasks.workunit.client.1.smithi087.stdout:4/850: getdents d2/d9/d10/d22/d5b/d5c 0 2024-02-28T16:02:05.114 INFO:tasks.workunit.client.0.smithi057.stdout:6/323: mknod df/d14/d15/d3d/c6c 0 2024-02-28T16:02:05.116 INFO:tasks.workunit.client.0.smithi057.stdout:6/324: chown df/d14/d15/d16/d39/f67 238048197 1 2024-02-28T16:02:05.116 INFO:tasks.workunit.client.1.smithi087.stdout:7/772: creat d14/d21/d4f/ff0 x:0 0 0 2024-02-28T16:02:05.117 INFO:tasks.workunit.client.1.smithi087.stdout:6/833: link d4/d30/d13/d38/lf9 d4/dc/d10/l109 0 2024-02-28T16:02:05.119 INFO:tasks.workunit.client.1.smithi087.stdout:6/834: dread - d4/d12/d45/f86 zero size 2024-02-28T16:02:05.121 INFO:tasks.workunit.client.1.smithi087.stdout:3/826: getdents d11/d3a/d3c 0 2024-02-28T16:02:05.122 INFO:tasks.workunit.client.1.smithi087.stdout:6/835: chown d4/d30/f24 90 1 2024-02-28T16:02:05.122 INFO:tasks.workunit.client.1.smithi087.stdout:4/851: rename d2/d9/da/d1a/d26/d69/f74 to d2/d9/d9e/d106/f117 0 2024-02-28T16:02:05.124 INFO:tasks.workunit.client.1.smithi087.stdout:3/827: mknod d11/d33/d74/c121 0 2024-02-28T16:02:05.129 INFO:tasks.workunit.client.1.smithi087.stdout:6/836: dread d4/d30/d13/d38/f68 [0,4194304] 0 2024-02-28T16:02:05.131 INFO:tasks.workunit.client.0.smithi057.stdout:6/325: dwrite df/d10/d13/d4b/f5e [0,4194304] 0 2024-02-28T16:02:05.131 INFO:tasks.workunit.client.1.smithi087.stdout:6/837: chown d4/d12/d45/f5d 2 1 2024-02-28T16:02:05.133 INFO:tasks.workunit.client.1.smithi087.stdout:6/838: stat d4/d30/d13/le8 0 2024-02-28T16:02:05.134 INFO:tasks.workunit.client.1.smithi087.stdout:3/828: rename d11/d33/d67/d98/f119 to d11/d33/d67/f122 0 2024-02-28T16:02:05.136 INFO:tasks.workunit.client.0.smithi057.stdout:6/326: stat df/d14/d15/d3d/d5b/l5d 0 2024-02-28T16:02:05.137 INFO:tasks.workunit.client.1.smithi087.stdout:6/839: creat d4/dc/d7e/da4/f10a x:0 0 0 2024-02-28T16:02:05.140 INFO:tasks.workunit.client.0.smithi057.stdout:6/327: truncate f9 1332826 0 2024-02-28T16:02:05.140 INFO:tasks.workunit.client.0.smithi057.stdout:4/394: dread d1/d14/f23 [0,4194304] 0 2024-02-28T16:02:05.140 INFO:tasks.workunit.client.1.smithi087.stdout:3/829: symlink d11/d3a/l123 0 2024-02-28T16:02:05.141 INFO:tasks.workunit.client.0.smithi057.stdout:4/395: readlink d1/d3f/l63 0 2024-02-28T16:02:05.141 INFO:tasks.workunit.client.0.smithi057.stdout:6/328: dread - df/d10/f5c zero size 2024-02-28T16:02:05.143 INFO:tasks.workunit.client.0.smithi057.stdout:4/396: truncate d1/d3f/f5d 136074 0 2024-02-28T16:02:05.144 INFO:tasks.workunit.client.1.smithi087.stdout:4/852: dwrite d2/d9/d10/dbf/db6/fda [0,4194304] 0 2024-02-28T16:02:05.146 INFO:tasks.workunit.client.1.smithi087.stdout:6/840: link d4/d12/d45/d57/fbb d4/dc/f10b 0 2024-02-28T16:02:05.146 INFO:tasks.workunit.client.0.smithi057.stdout:4/397: readlink d1/ld 0 2024-02-28T16:02:05.147 INFO:tasks.workunit.client.1.smithi087.stdout:3/830: rmdir d11/d33/d74/df0 0 2024-02-28T16:02:05.151 INFO:tasks.workunit.client.0.smithi057.stdout:3/342: sync 2024-02-28T16:02:05.151 INFO:tasks.workunit.client.0.smithi057.stdout:2/343: sync 2024-02-28T16:02:05.151 INFO:tasks.workunit.client.0.smithi057.stdout:9/422: sync 2024-02-28T16:02:05.153 INFO:tasks.workunit.client.1.smithi087.stdout:6/841: creat d4/dc/d10/f10c x:0 0 0 2024-02-28T16:02:05.154 INFO:tasks.workunit.client.0.smithi057.stdout:2/344: dread - d19/f47 zero size 2024-02-28T16:02:05.154 INFO:tasks.workunit.client.0.smithi057.stdout:4/398: truncate d1/d10/f43 193246 0 2024-02-28T16:02:05.154 INFO:tasks.workunit.client.1.smithi087.stdout:4/853: truncate d2/df/d2e/f47 4238219 0 2024-02-28T16:02:05.154 INFO:tasks.workunit.client.0.smithi057.stdout:9/423: rmdir d2/d5e 39 2024-02-28T16:02:05.156 INFO:tasks.workunit.client.0.smithi057.stdout:6/329: dread df/d10/d13/d4b/f5e [0,4194304] 0 2024-02-28T16:02:05.156 INFO:tasks.workunit.client.0.smithi057.stdout:3/343: fsync d8/dd/d19/f62 0 2024-02-28T16:02:05.158 INFO:tasks.workunit.client.0.smithi057.stdout:9/424: read - d2/d5/d1b/d2e/f45 zero size 2024-02-28T16:02:05.158 INFO:tasks.workunit.client.0.smithi057.stdout:6/330: stat df/d14/d15/d16/f31 0 2024-02-28T16:02:05.159 INFO:tasks.workunit.client.1.smithi087.stdout:4/854: write d2/d9/d10/d22/d5b/d5c/d90/df5/f113 [1288772,93832] 0 2024-02-28T16:02:05.159 INFO:tasks.workunit.client.0.smithi057.stdout:2/345: creat d19/d1d/d22/f6b x:0 0 0 2024-02-28T16:02:05.160 INFO:tasks.workunit.client.1.smithi087.stdout:6/842: rename d4/d30/d13/d67/cbf to d4/dc/d61/c10d 0 2024-02-28T16:02:05.161 INFO:tasks.workunit.client.0.smithi057.stdout:9/425: chown d2/d5/d1b/f5b 42 1 2024-02-28T16:02:05.163 INFO:tasks.workunit.client.0.smithi057.stdout:6/331: chown df/d14/d15/d16/f33 70458 1 2024-02-28T16:02:05.163 INFO:tasks.workunit.client.0.smithi057.stdout:2/346: write d19/d57/f67 [17972,111875] 0 2024-02-28T16:02:05.164 INFO:tasks.workunit.client.0.smithi057.stdout:3/344: rename d8/dd/d14/d2e/d2f/f61 to d8/dd/d14/d2e/d30/f69 0 2024-02-28T16:02:05.165 INFO:tasks.workunit.client.0.smithi057.stdout:2/347: write f12 [4280453,43369] 0 2024-02-28T16:02:05.166 INFO:tasks.workunit.client.0.smithi057.stdout:4/399: link d1/d22/c44 d1/d3f/d5f/c82 0 2024-02-28T16:02:05.167 INFO:tasks.workunit.client.0.smithi057.stdout:6/332: write df/d14/d15/d16/f46 [2140279,124019] 0 2024-02-28T16:02:05.167 INFO:tasks.workunit.client.1.smithi087.stdout:3/831: dwrite d11/d33/d67/f80 [0,4194304] 0 2024-02-28T16:02:05.170 INFO:tasks.workunit.client.0.smithi057.stdout:2/348: stat d19/d2c/f30 0 2024-02-28T16:02:05.172 INFO:tasks.workunit.client.0.smithi057.stdout:3/345: mkdir d8/dd/d14/d2e/d30/d6a 0 2024-02-28T16:02:05.172 INFO:tasks.workunit.client.0.smithi057.stdout:2/349: chown d19/d3a/c42 6 1 2024-02-28T16:02:05.173 INFO:tasks.workunit.client.0.smithi057.stdout:3/346: stat d8/dd/d19/d1c 0 2024-02-28T16:02:05.174 INFO:tasks.workunit.client.0.smithi057.stdout:4/400: rename d1/f7 to d1/d3f/d5f/f83 0 2024-02-28T16:02:05.174 INFO:tasks.workunit.client.1.smithi087.stdout:4/855: write d2/d9/d9e/fba [942986,113739] 0 2024-02-28T16:02:05.179 INFO:tasks.workunit.client.0.smithi057.stdout:2/350: dread d19/d34/f4b [0,4194304] 0 2024-02-28T16:02:05.180 INFO:tasks.workunit.client.1.smithi087.stdout:4/856: rename d2/d9/da/f2d to d2/df/d2e/dad/f118 0 2024-02-28T16:02:05.181 INFO:tasks.workunit.client.0.smithi057.stdout:6/333: rename df/l5f to df/d14/d15/d3d/l6d 0 2024-02-28T16:02:05.183 INFO:tasks.workunit.client.1.smithi087.stdout:6/843: dwrite d4/d12/d45/d92/dbd/fc6 [0,4194304] 0 2024-02-28T16:02:05.183 INFO:tasks.workunit.client.0.smithi057.stdout:9/426: write d2/d5/d9/fb [4263837,11270] 0 2024-02-28T16:02:05.187 INFO:tasks.workunit.client.1.smithi087.stdout:0/752: sync 2024-02-28T16:02:05.187 INFO:tasks.workunit.client.1.smithi087.stdout:8/805: sync 2024-02-28T16:02:05.194 INFO:tasks.workunit.client.1.smithi087.stdout:4/857: write d2/fb7 [358400,84247] 0 2024-02-28T16:02:05.197 INFO:tasks.workunit.client.1.smithi087.stdout:8/806: write d2/d9/d5e/dbc/fd4 [2412942,103562] 0 2024-02-28T16:02:05.198 INFO:tasks.workunit.client.1.smithi087.stdout:3/832: dwrite d11/d61/d7c/f84 [0,4194304] 0 2024-02-28T16:02:05.201 INFO:tasks.workunit.client.1.smithi087.stdout:0/753: chown d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a 4051127 1 2024-02-28T16:02:05.215 INFO:tasks.workunit.client.1.smithi087.stdout:6/844: rename d4/d12/d45/f91 to d4/d12/d45/d92/dc1/de9/f10e 0 2024-02-28T16:02:05.219 INFO:tasks.workunit.client.1.smithi087.stdout:8/807: creat d2/d18/d42/d62/de8/df6/f107 x:0 0 0 2024-02-28T16:02:05.221 INFO:tasks.workunit.client.1.smithi087.stdout:8/808: chown d2/d9/c2d 0 1 2024-02-28T16:02:05.223 INFO:tasks.workunit.client.1.smithi087.stdout:3/833: rename d11/d45/d88/d91/f108 to d11/d33/d67/d98/d9b/f124 0 2024-02-28T16:02:05.224 INFO:tasks.workunit.client.1.smithi087.stdout:6/845: dread d4/d30/d13/d38/d69/f6f [0,4194304] 0 2024-02-28T16:02:05.225 INFO:tasks.workunit.client.1.smithi087.stdout:8/809: creat d2/da2/f108 x:0 0 0 2024-02-28T16:02:05.226 INFO:tasks.workunit.client.1.smithi087.stdout:6/846: chown d4/dc/d10/f10c 5669 1 2024-02-28T16:02:05.231 INFO:tasks.workunit.client.1.smithi087.stdout:8/810: truncate d2/d18/df5/d104/f44 1824571 0 2024-02-28T16:02:05.232 INFO:tasks.workunit.client.1.smithi087.stdout:6/847: truncate d4/dc/d10/f19 535763 0 2024-02-28T16:02:05.235 INFO:tasks.workunit.client.1.smithi087.stdout:3/834: dread d11/d33/d67/f80 [0,4194304] 0 2024-02-28T16:02:05.236 INFO:tasks.workunit.client.1.smithi087.stdout:3/835: fdatasync d11/f2a 0 2024-02-28T16:02:05.236 INFO:tasks.workunit.client.1.smithi087.stdout:6/848: creat d4/d7d/f10f x:0 0 0 2024-02-28T16:02:05.240 INFO:tasks.workunit.client.1.smithi087.stdout:3/836: chown d11/f37 201675 1 2024-02-28T16:02:05.240 INFO:tasks.workunit.client.1.smithi087.stdout:8/811: creat d2/d18/d42/f109 x:0 0 0 2024-02-28T16:02:05.240 INFO:tasks.workunit.client.1.smithi087.stdout:3/837: write d11/d33/fdc [499805,92409] 0 2024-02-28T16:02:05.241 INFO:tasks.workunit.client.1.smithi087.stdout:6/849: readlink d4/dc/l52 0 2024-02-28T16:02:05.243 INFO:tasks.workunit.client.1.smithi087.stdout:6/850: fsync d4/d30/d13/d38/d69/fad 0 2024-02-28T16:02:05.244 INFO:tasks.workunit.client.1.smithi087.stdout:6/851: chown d4/dc/d10 221693166 1 2024-02-28T16:02:05.246 INFO:tasks.workunit.client.0.smithi057.stdout:3/347: mkdir d8/dd/d14/d2e/d30/d5f/d6b 0 2024-02-28T16:02:05.247 INFO:tasks.workunit.client.1.smithi087.stdout:3/838: truncate d11/d33/d67/d98/d9b/f9d 509018 0 2024-02-28T16:02:05.248 INFO:tasks.workunit.client.0.smithi057.stdout:2/351: link d19/d34/f4b d19/d1d/d2e/f6c 0 2024-02-28T16:02:05.249 INFO:tasks.workunit.client.1.smithi087.stdout:6/852: creat d4/d12/d45/d57/f110 x:0 0 0 2024-02-28T16:02:05.251 INFO:tasks.workunit.client.0.smithi057.stdout:9/427: read f0 [1656329,102143] 0 2024-02-28T16:02:05.251 INFO:tasks.workunit.client.1.smithi087.stdout:6/853: write d4/dc/f8e [6424207,39320] 0 2024-02-28T16:02:05.252 INFO:tasks.workunit.client.0.smithi057.stdout:2/352: truncate d19/d1d/f51 1011036 0 2024-02-28T16:02:05.254 INFO:tasks.workunit.client.0.smithi057.stdout:3/348: mkdir d8/dd/d19/d1c/d6c 0 2024-02-28T16:02:05.254 INFO:tasks.workunit.client.0.smithi057.stdout:9/428: chown d2/d24/l18 0 1 2024-02-28T16:02:05.254 INFO:tasks.workunit.client.1.smithi087.stdout:6/854: readlink d4/d30/d13/d38/lf9 0 2024-02-28T16:02:05.255 INFO:tasks.workunit.client.1.smithi087.stdout:3/839: getdents d11/d3a 0 2024-02-28T16:02:05.259 INFO:tasks.workunit.client.0.smithi057.stdout:4/401: dread d1/d14/f1b [0,4194304] 0 2024-02-28T16:02:05.259 INFO:tasks.workunit.client.0.smithi057.stdout:3/349: write d8/dd/d14/d2e/d30/d49/f63 [901134,121978] 0 2024-02-28T16:02:05.259 INFO:tasks.workunit.client.0.smithi057.stdout:9/429: rmdir d2/d5/d1b/d2e 39 2024-02-28T16:02:05.260 INFO:tasks.workunit.client.1.smithi087.stdout:6/855: mkdir d4/dc/d61/d89/d111 0 2024-02-28T16:02:05.264 INFO:tasks.workunit.client.1.smithi087.stdout:8/812: dread d2/d18/d42/f6d [0,4194304] 0 2024-02-28T16:02:05.265 INFO:tasks.workunit.client.0.smithi057.stdout:9/430: creat d2/d62/f88 x:0 0 0 2024-02-28T16:02:05.265 INFO:tasks.workunit.client.0.smithi057.stdout:6/334: dread df/f1f [0,4194304] 0 2024-02-28T16:02:05.268 INFO:tasks.workunit.client.0.smithi057.stdout:3/350: link d8/c68 d8/dd/d14/d2e/d30/d49/c6d 0 2024-02-28T16:02:05.271 INFO:tasks.workunit.client.0.smithi057.stdout:6/335: mknod df/d10/d4f/c6e 0 2024-02-28T16:02:05.272 INFO:tasks.workunit.client.0.smithi057.stdout:6/336: fsync f6 0 2024-02-28T16:02:05.272 INFO:tasks.workunit.client.1.smithi087.stdout:8/813: link d2/d18/d25/ce7 d2/d63/d9b/dd5/dd9/df1/c10a 0 2024-02-28T16:02:05.277 INFO:tasks.workunit.client.0.smithi057.stdout:3/351: rename d8/c24 to d8/dd/d19/d1c/d6c/c6e 0 2024-02-28T16:02:05.278 INFO:tasks.workunit.client.1.smithi087.stdout:3/840: truncate d11/d3a/d3c/fc2 1520538 0 2024-02-28T16:02:05.279 INFO:tasks.workunit.client.1.smithi087.stdout:3/841: readlink d11/d44/lbc 0 2024-02-28T16:02:05.280 INFO:tasks.workunit.client.0.smithi057.stdout:2/353: truncate d19/f23 2809651 0 2024-02-28T16:02:05.281 INFO:tasks.workunit.client.0.smithi057.stdout:4/402: write d1/d10/f43 [1217054,90024] 0 2024-02-28T16:02:05.281 INFO:tasks.workunit.client.0.smithi057.stdout:3/352: rmdir d8/dd/d14/d2e/d3b/d54 39 2024-02-28T16:02:05.283 INFO:tasks.workunit.client.0.smithi057.stdout:2/354: chown d19/d1d/d22/l24 9575 1 2024-02-28T16:02:05.286 INFO:tasks.workunit.client.0.smithi057.stdout:3/353: mknod d8/dd/d14/d2e/d30/d49/c6f 0 2024-02-28T16:02:05.286 INFO:tasks.workunit.client.0.smithi057.stdout:6/337: dread df/d10/d13/d4b/f51 [0,4194304] 0 2024-02-28T16:02:05.287 INFO:tasks.workunit.client.1.smithi087.stdout:8/814: dwrite d2/d63/d9b/fc3 [0,4194304] 0 2024-02-28T16:02:05.288 INFO:tasks.workunit.client.1.smithi087.stdout:6/856: dread d4/dc/d61/f71 [0,4194304] 0 2024-02-28T16:02:05.289 INFO:tasks.workunit.client.0.smithi057.stdout:2/355: rename d19/d1d/c1f to d19/d43/d5a/c6d 0 2024-02-28T16:02:05.290 INFO:tasks.workunit.client.1.smithi087.stdout:8/815: write d2/d18/d42/f81 [1270621,124378] 0 2024-02-28T16:02:05.290 INFO:tasks.workunit.client.0.smithi057.stdout:6/338: symlink df/d14/d15/d3d/l6f 0 2024-02-28T16:02:05.293 INFO:tasks.workunit.client.0.smithi057.stdout:6/339: mkdir df/d10/d13/d70 0 2024-02-28T16:02:05.294 INFO:tasks.workunit.client.1.smithi087.stdout:6/857: truncate d4/dc/d10/f3d 2750450 0 2024-02-28T16:02:05.296 INFO:tasks.workunit.client.0.smithi057.stdout:6/340: write df/d10/d13/f41 [791585,75066] 0 2024-02-28T16:02:05.296 INFO:tasks.workunit.client.0.smithi057.stdout:2/356: getdents d19/d1d/d2e 0 2024-02-28T16:02:05.298 INFO:tasks.workunit.client.0.smithi057.stdout:3/354: dread d8/dd/d14/d2e/d30/f3f [0,4194304] 0 2024-02-28T16:02:05.303 INFO:tasks.workunit.client.0.smithi057.stdout:6/341: unlink l4 0 2024-02-28T16:02:05.305 INFO:tasks.workunit.client.0.smithi057.stdout:6/342: chown df/d10/d13/f41 47 1 2024-02-28T16:02:05.306 INFO:tasks.workunit.client.0.smithi057.stdout:3/355: mknod d8/dd/d14/d2e/d30/d5f/c70 0 2024-02-28T16:02:05.308 INFO:tasks.workunit.client.1.smithi087.stdout:6/858: dwrite d4/dc/d7e/da4/f10a [0,4194304] 0 2024-02-28T16:02:05.308 INFO:tasks.workunit.client.0.smithi057.stdout:4/403: dwrite d1/d10/d12/d15/d19/f2b [0,4194304] 0 2024-02-28T16:02:05.311 INFO:tasks.workunit.client.1.smithi087.stdout:6/859: fsync d4/d30/d13/d38/dc3/fd1 0 2024-02-28T16:02:05.312 INFO:tasks.workunit.client.1.smithi087.stdout:6/860: chown d4/dc/d61/d89/fdc 330420 1 2024-02-28T16:02:05.316 INFO:tasks.workunit.client.0.smithi057.stdout:6/343: creat df/d10/d4f/f71 x:0 0 0 2024-02-28T16:02:05.317 INFO:tasks.workunit.client.1.smithi087.stdout:6/861: creat d4/d30/d13/d67/daf/f112 x:0 0 0 2024-02-28T16:02:05.319 INFO:tasks.workunit.client.0.smithi057.stdout:3/356: mkdir d8/dd/d14/d2e/d3b/d71 0 2024-02-28T16:02:05.319 INFO:tasks.workunit.client.0.smithi057.stdout:2/357: dwrite d19/d3a/f46 [0,4194304] 0 2024-02-28T16:02:05.319 INFO:tasks.workunit.client.1.smithi087.stdout:6/862: symlink d4/d30/d9b/l113 0 2024-02-28T16:02:05.320 INFO:tasks.workunit.client.1.smithi087.stdout:8/816: dread d2/d18/df5/d104/f2e [0,4194304] 0 2024-02-28T16:02:05.322 INFO:tasks.workunit.client.0.smithi057.stdout:4/404: mknod d1/d10/d12/d2c/d37/d46/c84 0 2024-02-28T16:02:05.323 INFO:tasks.workunit.client.1.smithi087.stdout:6/863: symlink d4/dc/d61/d89/d111/l114 0 2024-02-28T16:02:05.324 INFO:tasks.workunit.client.1.smithi087.stdout:8/817: dread - d2/d18/df5/d104/f48 zero size 2024-02-28T16:02:05.325 INFO:tasks.workunit.client.1.smithi087.stdout:6/864: chown d4/dc/d10/f6e 436 1 2024-02-28T16:02:05.328 INFO:tasks.workunit.client.0.smithi057.stdout:3/357: unlink d8/dd/d14/c31 0 2024-02-28T16:02:05.329 INFO:tasks.workunit.client.1.smithi087.stdout:6/865: write d4/d30/d13/d38/f3a [10255,1452] 0 2024-02-28T16:02:05.332 INFO:tasks.workunit.client.0.smithi057.stdout:3/358: chown d8/dd/d14/d2e/c3d 29604 1 2024-02-28T16:02:05.333 INFO:tasks.workunit.client.0.smithi057.stdout:9/431: truncate d2/d5/d9/f6a 88367 0 2024-02-28T16:02:05.333 INFO:tasks.workunit.client.0.smithi057.stdout:2/358: link d19/d1d/f51 d19/d43/d5a/f6e 0 2024-02-28T16:02:05.334 INFO:tasks.workunit.client.0.smithi057.stdout:2/359: chown d19/d43/d5a 16702455 1 2024-02-28T16:02:05.337 INFO:tasks.workunit.client.1.smithi087.stdout:8/818: getdents d2/d63/d9b/dd5 0 2024-02-28T16:02:05.339 INFO:tasks.workunit.client.1.smithi087.stdout:6/866: mknod d4/d96/c115 0 2024-02-28T16:02:05.343 INFO:tasks.workunit.client.1.smithi087.stdout:3/842: write d11/f37 [528010,117070] 0 2024-02-28T16:02:05.343 INFO:tasks.workunit.client.0.smithi057.stdout:9/432: creat d2/d5/d9/f89 x:0 0 0 2024-02-28T16:02:05.344 INFO:tasks.workunit.client.0.smithi057.stdout:6/344: dwrite df/f12 [0,4194304] 0 2024-02-28T16:02:05.346 INFO:tasks.workunit.client.0.smithi057.stdout:2/360: mknod d19/d1d/d2e/c6f 0 2024-02-28T16:02:05.348 INFO:tasks.workunit.client.0.smithi057.stdout:4/405: rename d1/d10/d12/c3a to d1/d14/c85 0 2024-02-28T16:02:05.349 INFO:tasks.workunit.client.1.smithi087.stdout:3/843: mkdir d11/d45/d88/d125 0 2024-02-28T16:02:05.350 INFO:tasks.workunit.client.0.smithi057.stdout:3/359: mknod d8/dd/d14/d2e/d30/d6a/c72 0 2024-02-28T16:02:05.351 INFO:tasks.workunit.client.0.smithi057.stdout:6/345: symlink df/d10/d13/d4b/l72 0 2024-02-28T16:02:05.353 INFO:tasks.workunit.client.0.smithi057.stdout:4/406: rmdir d1/d14 39 2024-02-28T16:02:05.355 INFO:tasks.workunit.client.0.smithi057.stdout:6/346: chown df/f48 8117929 1 2024-02-28T16:02:05.355 INFO:tasks.workunit.client.0.smithi057.stdout:3/360: write d8/dd/d14/d2e/d2f/f45 [1596134,115827] 0 2024-02-28T16:02:05.357 INFO:tasks.workunit.client.1.smithi087.stdout:3/844: read d11/d33/d67/d98/daf/fd5 [407032,19261] 0 2024-02-28T16:02:05.360 INFO:tasks.workunit.client.0.smithi057.stdout:4/407: readlink d1/d22/l51 0 2024-02-28T16:02:05.362 INFO:tasks.workunit.client.0.smithi057.stdout:4/408: fsync d1/d22/f2a 0 2024-02-28T16:02:05.364 INFO:tasks.workunit.client.1.smithi087.stdout:3/845: creat d11/d61/f126 x:0 0 0 2024-02-28T16:02:05.366 INFO:tasks.workunit.client.0.smithi057.stdout:9/433: link d2/d5/l52 d2/d5/d9/d64/d78/l8a 0 2024-02-28T16:02:05.367 INFO:tasks.workunit.client.1.smithi087.stdout:3/846: mkdir d11/d44/d5b/d127 0 2024-02-28T16:02:05.372 INFO:tasks.workunit.client.0.smithi057.stdout:9/434: mkdir d2/d5/d9/d57/d8b 0 2024-02-28T16:02:05.372 INFO:tasks.workunit.client.1.smithi087.stdout:3/847: truncate d11/d33/d67/d9c/fb2 342826 0 2024-02-28T16:02:05.373 INFO:tasks.workunit.client.0.smithi057.stdout:6/347: dread df/d14/f2d [0,4194304] 0 2024-02-28T16:02:05.374 INFO:tasks.workunit.client.1.smithi087.stdout:3/848: fsync d11/d44/f57 0 2024-02-28T16:02:05.377 INFO:tasks.workunit.client.1.smithi087.stdout:2/727: sync 2024-02-28T16:02:05.377 INFO:tasks.workunit.client.0.smithi057.stdout:3/361: dread d8/fa [0,4194304] 0 2024-02-28T16:02:05.378 INFO:tasks.workunit.client.0.smithi057.stdout:6/348: creat df/d10/d13/f73 x:0 0 0 2024-02-28T16:02:05.382 INFO:tasks.workunit.client.1.smithi087.stdout:6/867: dwrite d4/d30/d13/d38/f68 [0,4194304] 0 2024-02-28T16:02:05.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/435: truncate d2/d24/d1d/f60 627482 0 2024-02-28T16:02:05.386 INFO:tasks.workunit.client.1.smithi087.stdout:2/728: creat d2/d9a/dd3/f102 x:0 0 0 2024-02-28T16:02:05.386 INFO:tasks.workunit.client.0.smithi057.stdout:9/436: dread - d2/d5/d9/f89 zero size 2024-02-28T16:02:05.387 INFO:tasks.workunit.client.0.smithi057.stdout:4/409: rename d1/d14 to d1/d10/d31/d86 0 2024-02-28T16:02:05.388 INFO:tasks.workunit.client.0.smithi057.stdout:3/362: unlink d8/dd/d19/c27 0 2024-02-28T16:02:05.389 INFO:tasks.workunit.client.1.smithi087.stdout:8/819: dread d2/d18/f56 [0,4194304] 0 2024-02-28T16:02:05.395 INFO:tasks.workunit.client.1.smithi087.stdout:8/820: symlink d2/d18/l10b 0 2024-02-28T16:02:05.397 INFO:tasks.workunit.client.0.smithi057.stdout:6/349: creat df/f74 x:0 0 0 2024-02-28T16:02:05.398 INFO:tasks.workunit.client.0.smithi057.stdout:3/363: write d8/dd/f1f [2878267,6158] 0 2024-02-28T16:02:05.399 INFO:tasks.workunit.client.1.smithi087.stdout:3/849: dwrite d11/d33/d67/d9c/da1/f101 [0,4194304] 0 2024-02-28T16:02:05.400 INFO:tasks.workunit.client.0.smithi057.stdout:3/364: fdatasync d8/dd/d14/d2e/d30/f64 0 2024-02-28T16:02:05.402 INFO:tasks.workunit.client.0.smithi057.stdout:9/437: getdents d2/d46/d67/d7d 0 2024-02-28T16:02:05.405 INFO:tasks.workunit.client.1.smithi087.stdout:3/850: fsync d11/f15 0 2024-02-28T16:02:05.406 INFO:tasks.workunit.client.0.smithi057.stdout:3/365: write d8/d4b/f60 [750403,119885] 0 2024-02-28T16:02:05.406 INFO:tasks.workunit.client.1.smithi087.stdout:8/821: chown d2/d9/d5e/d9c/d9f/cb0 1045 1 2024-02-28T16:02:05.408 INFO:tasks.workunit.client.1.smithi087.stdout:3/851: fsync d11/d33/d67/d9c/f9f 0 2024-02-28T16:02:05.410 INFO:tasks.workunit.client.0.smithi057.stdout:2/361: dwrite d19/f23 [0,4194304] 0 2024-02-28T16:02:05.410 INFO:tasks.workunit.client.1.smithi087.stdout:8/822: write d2/d33/f8f [5657710,126194] 0 2024-02-28T16:02:05.415 INFO:tasks.workunit.client.1.smithi087.stdout:3/852: creat d11/d3a/d3c/f128 x:0 0 0 2024-02-28T16:02:05.416 INFO:tasks.workunit.client.1.smithi087.stdout:3/853: creat d11/d61/d7c/f129 x:0 0 0 2024-02-28T16:02:05.417 INFO:tasks.workunit.client.0.smithi057.stdout:9/438: symlink d2/d5/d9/d64/d78/l8c 0 2024-02-28T16:02:05.418 INFO:tasks.workunit.client.0.smithi057.stdout:4/410: dwrite d1/d10/d31/d86/f33 [0,4194304] 0 2024-02-28T16:02:05.420 INFO:tasks.workunit.client.0.smithi057.stdout:3/366: symlink d8/l73 0 2024-02-28T16:02:05.423 INFO:tasks.workunit.client.0.smithi057.stdout:9/439: chown d2/d24/d1d/f7b 116 1 2024-02-28T16:02:05.427 INFO:tasks.workunit.client.0.smithi057.stdout:5/380: sync 2024-02-28T16:02:05.427 INFO:tasks.workunit.client.0.smithi057.stdout:6/350: dwrite df/d10/f64 [0,4194304] 0 2024-02-28T16:02:05.429 INFO:tasks.workunit.client.1.smithi087.stdout:3/854: rmdir d11/d45/d88/d125 0 2024-02-28T16:02:05.430 INFO:tasks.workunit.client.0.smithi057.stdout:9/440: chown d2/d24/d1d/c21 6831081 1 2024-02-28T16:02:05.430 INFO:tasks.workunit.client.1.smithi087.stdout:6/868: dread d4/f23 [0,4194304] 0 2024-02-28T16:02:05.430 INFO:tasks.workunit.client.1.smithi087.stdout:8/823: write d2/d9/f16 [6481049,26581] 0 2024-02-28T16:02:05.430 INFO:tasks.workunit.client.0.smithi057.stdout:6/351: readlink df/d10/d13/l28 0 2024-02-28T16:02:05.432 INFO:tasks.workunit.client.1.smithi087.stdout:8/824: chown d2/f37 11 1 2024-02-28T16:02:05.433 INFO:tasks.workunit.client.0.smithi057.stdout:4/411: mkdir d1/d10/d12/d15/d19/d87 0 2024-02-28T16:02:05.435 INFO:tasks.workunit.client.0.smithi057.stdout:6/352: truncate df/f53 479214 0 2024-02-28T16:02:05.436 INFO:tasks.workunit.client.0.smithi057.stdout:2/362: dread d19/d1d/d2e/d31/f3b [0,4194304] 0 2024-02-28T16:02:05.438 INFO:tasks.workunit.client.0.smithi057.stdout:9/441: fsync d2/d5e/d65/f15 0 2024-02-28T16:02:05.439 INFO:tasks.workunit.client.1.smithi087.stdout:2/729: dread d2/f85 [0,4194304] 0 2024-02-28T16:02:05.441 INFO:tasks.workunit.client.1.smithi087.stdout:5/838: sync 2024-02-28T16:02:05.442 INFO:tasks.workunit.client.1.smithi087.stdout:2/730: fsync d2/d99/d28/d79/da3/fe0 0 2024-02-28T16:02:05.442 INFO:tasks.workunit.client.1.smithi087.stdout:9/749: sync 2024-02-28T16:02:05.442 INFO:tasks.workunit.client.1.smithi087.stdout:4/858: sync 2024-02-28T16:02:05.442 INFO:tasks.workunit.client.1.smithi087.stdout:0/754: sync 2024-02-28T16:02:05.442 INFO:tasks.workunit.client.1.smithi087.stdout:7/773: sync 2024-02-28T16:02:05.442 INFO:tasks.workunit.client.1.smithi087.stdout:1/746: sync 2024-02-28T16:02:05.445 INFO:tasks.workunit.client.1.smithi087.stdout:3/855: link d11/d33/d67/fc0 d11/d3a/d3c/f12a 0 2024-02-28T16:02:05.447 INFO:tasks.workunit.client.1.smithi087.stdout:9/750: fdatasync d7/dd/f2d 0 2024-02-28T16:02:05.447 INFO:tasks.workunit.client.0.smithi057.stdout:3/367: dwrite d8/dd/d19/f5e [0,4194304] 0 2024-02-28T16:02:05.449 INFO:tasks.workunit.client.0.smithi057.stdout:2/363: mkdir d19/d43/d5a/d70 0 2024-02-28T16:02:05.451 INFO:tasks.workunit.client.0.smithi057.stdout:3/368: readlink d8/dd/d14/d2e/d2f/l59 0 2024-02-28T16:02:05.453 INFO:tasks.workunit.client.0.smithi057.stdout:9/442: write d2/d5/d1b/d2e/f2f [2638740,11970] 0 2024-02-28T16:02:05.454 INFO:tasks.workunit.client.1.smithi087.stdout:7/774: rmdir d14/d21 39 2024-02-28T16:02:05.455 INFO:tasks.workunit.client.0.smithi057.stdout:4/412: dread d1/d10/d31/d86/f33 [4194304,4194304] 0 2024-02-28T16:02:05.455 INFO:tasks.workunit.client.0.smithi057.stdout:1/403: sync 2024-02-28T16:02:05.455 INFO:tasks.workunit.client.0.smithi057.stdout:7/319: sync 2024-02-28T16:02:05.457 INFO:tasks.workunit.client.0.smithi057.stdout:8/384: sync 2024-02-28T16:02:05.457 INFO:tasks.workunit.client.0.smithi057.stdout:0/521: sync 2024-02-28T16:02:05.458 INFO:tasks.workunit.client.0.smithi057.stdout:5/381: truncate d2/f1b 3825182 0 2024-02-28T16:02:05.465 INFO:tasks.workunit.client.1.smithi087.stdout:0/755: symlink d4/dd/d21/d5f/lfb 0 2024-02-28T16:02:05.465 INFO:tasks.workunit.client.0.smithi057.stdout:9/443: creat d2/d5/d9/d57/d8b/f8d x:0 0 0 2024-02-28T16:02:05.466 INFO:tasks.workunit.client.0.smithi057.stdout:1/404: chown d1/d3/c27 11 1 2024-02-28T16:02:05.466 INFO:tasks.workunit.client.1.smithi087.stdout:2/731: mknod d2/d99/c103 0 2024-02-28T16:02:05.467 INFO:tasks.workunit.client.0.smithi057.stdout:5/382: write d2/d8/f9 [3299762,127700] 0 2024-02-28T16:02:05.467 INFO:tasks.workunit.client.0.smithi057.stdout:6/353: dwrite df/d14/d15/d16/d65/f68 [0,4194304] 0 2024-02-28T16:02:05.467 INFO:tasks.workunit.client.0.smithi057.stdout:7/320: creat d6/dc/d12/d1a/d4c/d6c/f73 x:0 0 0 2024-02-28T16:02:05.468 INFO:tasks.workunit.client.1.smithi087.stdout:1/747: dread d0/d1b/d43/f4b [0,4194304] 0 2024-02-28T16:02:05.468 INFO:tasks.workunit.client.1.smithi087.stdout:2/732: write d2/d42/ff3 [996163,61300] 0 2024-02-28T16:02:05.469 INFO:tasks.workunit.client.0.smithi057.stdout:0/522: mknod d6/d12/d17/cb0 0 2024-02-28T16:02:05.470 INFO:tasks.workunit.client.0.smithi057.stdout:8/385: truncate d5/de/f4d 5183505 0 2024-02-28T16:02:05.471 INFO:tasks.workunit.client.1.smithi087.stdout:3/856: symlink d11/d33/d67/d9c/l12b 0 2024-02-28T16:02:05.473 INFO:tasks.workunit.client.0.smithi057.stdout:4/413: creat d1/f88 x:0 0 0 2024-02-28T16:02:05.475 INFO:tasks.workunit.client.1.smithi087.stdout:7/775: symlink d14/d46/d80/lf1 0 2024-02-28T16:02:05.475 INFO:tasks.workunit.client.1.smithi087.stdout:1/748: stat d0/d1a/d28/d9b/fc6 0 2024-02-28T16:02:05.476 INFO:tasks.workunit.client.0.smithi057.stdout:3/369: getdents d8/dd/d14/d2e/d30 0 2024-02-28T16:02:05.476 INFO:tasks.workunit.client.1.smithi087.stdout:6/869: link d4/d30/d9b/f9e d4/d30/d42/de7/f116 0 2024-02-28T16:02:05.478 INFO:tasks.workunit.client.1.smithi087.stdout:4/859: dread d2/d9/f48 [0,4194304] 0 2024-02-28T16:02:05.478 INFO:tasks.workunit.client.1.smithi087.stdout:8/825: getdents d2/d18/df5 0 2024-02-28T16:02:05.481 INFO:tasks.workunit.client.0.smithi057.stdout:6/354: chown df/d14/d15/d16/d39/l6a 11471 1 2024-02-28T16:02:05.481 INFO:tasks.workunit.client.0.smithi057.stdout:0/523: mknod d6/d12/d5d/d71/daa/cb1 0 2024-02-28T16:02:05.482 INFO:tasks.workunit.client.0.smithi057.stdout:1/405: rmdir d1/d21/d66/d53/d7d 39 2024-02-28T16:02:05.486 INFO:tasks.workunit.client.1.smithi087.stdout:5/839: link d3/d9/d9b/dba/d30/d8f/dac/d109/d54/f10c d3/d9/d9b/dba/d30/d10f/d12c/f134 0 2024-02-28T16:02:05.486 INFO:tasks.workunit.client.0.smithi057.stdout:4/414: rename d1/f6 to d1/d3f/f89 0 2024-02-28T16:02:05.487 INFO:tasks.workunit.client.0.smithi057.stdout:7/321: creat d6/dc/d35/d58/f74 x:0 0 0 2024-02-28T16:02:05.488 INFO:tasks.workunit.client.1.smithi087.stdout:5/840: chown d3/d9/d9b/dba/d30/d10f/l110 461244 1 2024-02-28T16:02:05.489 INFO:tasks.workunit.client.1.smithi087.stdout:6/870: unlink d4/dc/d61/l65 0 2024-02-28T16:02:05.492 INFO:tasks.workunit.client.1.smithi087.stdout:1/749: mknod d0/d1b/d1f/d71/db2/d24/cfb 0 2024-02-28T16:02:05.497 INFO:tasks.workunit.client.1.smithi087.stdout:0/756: truncate d4/dd/d37/d39/d3a/dc1/fe5 2641526 0 2024-02-28T16:02:05.497 INFO:tasks.workunit.client.0.smithi057.stdout:2/364: dwrite d19/d2c/f56 [0,4194304] 0 2024-02-28T16:02:05.499 INFO:tasks.workunit.client.1.smithi087.stdout:8/826: mknod d2/d63/d9b/dae/db1/df4/c10c 0 2024-02-28T16:02:05.499 INFO:tasks.workunit.client.0.smithi057.stdout:5/383: rename d2/d15/d3b/c5c to d2/d15/d5e/d67/c85 0 2024-02-28T16:02:05.500 INFO:tasks.workunit.client.1.smithi087.stdout:0/757: dread - d4/d6/fd6 zero size 2024-02-28T16:02:05.500 INFO:tasks.workunit.client.0.smithi057.stdout:0/524: symlink d6/d12/d17/d4b/d60/d6b/lb2 0 2024-02-28T16:02:05.501 INFO:tasks.workunit.client.1.smithi087.stdout:9/751: write d7/dd/d3c/d4c/da1/f7b [1571359,59443] 0 2024-02-28T16:02:05.502 INFO:tasks.workunit.client.1.smithi087.stdout:6/871: symlink d4/d30/d13/d67/daf/l117 0 2024-02-28T16:02:05.504 INFO:tasks.workunit.client.0.smithi057.stdout:3/370: creat d8/f74 x:0 0 0 2024-02-28T16:02:05.509 INFO:tasks.workunit.client.1.smithi087.stdout:3/857: write d11/d33/d58/f7d [895501,42882] 0 2024-02-28T16:02:05.510 INFO:tasks.workunit.client.1.smithi087.stdout:9/752: creat d7/d1e/d44/d83/fdb x:0 0 0 2024-02-28T16:02:05.512 INFO:tasks.workunit.client.0.smithi057.stdout:0/525: unlink d6/d12/d17/d4b/d60/d6b/l7e 0 2024-02-28T16:02:05.512 INFO:tasks.workunit.client.0.smithi057.stdout:2/365: symlink d19/d43/d5a/l71 0 2024-02-28T16:02:05.513 INFO:tasks.workunit.client.1.smithi087.stdout:9/753: chown d7/dc 14 1 2024-02-28T16:02:05.513 INFO:tasks.workunit.client.0.smithi057.stdout:4/415: dread d1/d10/d31/d86/f33 [0,4194304] 0 2024-02-28T16:02:05.513 INFO:tasks.workunit.client.0.smithi057.stdout:6/355: dread f6 [0,4194304] 0 2024-02-28T16:02:05.514 INFO:tasks.workunit.client.0.smithi057.stdout:9/444: write d2/d24/d1d/d79/f6d [283062,127852] 0 2024-02-28T16:02:05.514 INFO:tasks.workunit.client.1.smithi087.stdout:1/750: symlink d0/d14/d48/da7/df4/lfc 0 2024-02-28T16:02:05.516 INFO:tasks.workunit.client.1.smithi087.stdout:4/860: rename d2/d9/da/d1a/d26/f29 to d2/d9/d10/d22/d5b/f119 0 2024-02-28T16:02:05.517 INFO:tasks.workunit.client.0.smithi057.stdout:5/384: mkdir d2/d86 0 2024-02-28T16:02:05.519 INFO:tasks.workunit.client.1.smithi087.stdout:3/858: truncate d11/d33/fa0 646667 0 2024-02-28T16:02:05.520 INFO:tasks.workunit.client.1.smithi087.stdout:7/776: dread d14/f18 [0,4194304] 0 2024-02-28T16:02:05.521 INFO:tasks.workunit.client.1.smithi087.stdout:1/751: dread - d0/d1a/d28/d9b/fd6 zero size 2024-02-28T16:02:05.526 INFO:tasks.workunit.client.0.smithi057.stdout:9/445: truncate f0 1025983 0 2024-02-28T16:02:05.526 INFO:tasks.workunit.client.1.smithi087.stdout:4/861: dread - d2/d9/d10/d22/d5b/d5c/d68/dc5/f114 zero size 2024-02-28T16:02:05.528 INFO:tasks.workunit.client.1.smithi087.stdout:9/754: mkdir d7/dd/d3c/d4c/da1/ddc 0 2024-02-28T16:02:05.528 INFO:tasks.workunit.client.0.smithi057.stdout:6/356: creat df/d10/d13/f75 x:0 0 0 2024-02-28T16:02:05.531 INFO:tasks.workunit.client.1.smithi087.stdout:4/862: chown d2/df/d65/d8d/fec 0 1 2024-02-28T16:02:05.532 INFO:tasks.workunit.client.0.smithi057.stdout:2/366: creat d19/d1d/d2e/d31/f72 x:0 0 0 2024-02-28T16:02:05.534 INFO:tasks.workunit.client.1.smithi087.stdout:9/755: write d7/d1e/d44/f9a [1762536,17907] 0 2024-02-28T16:02:05.535 INFO:tasks.workunit.client.0.smithi057.stdout:3/371: dwrite d8/dd/d14/d2c/f53 [0,4194304] 0 2024-02-28T16:02:05.535 INFO:tasks.workunit.client.0.smithi057.stdout:8/386: dwrite d5/d6/f36 [0,4194304] 0 2024-02-28T16:02:05.536 INFO:tasks.workunit.client.1.smithi087.stdout:4/863: read - d2/d9/d10/d22/d5b/d5c/d91/da9/fe9 zero size 2024-02-28T16:02:05.536 INFO:tasks.workunit.client.1.smithi087.stdout:7/777: mkdir d14/d46/d7c/df2 0 2024-02-28T16:02:05.536 INFO:tasks.workunit.client.1.smithi087.stdout:0/758: dwrite d4/dd/d21/d9b/fe8 [0,4194304] 0 2024-02-28T16:02:05.539 INFO:tasks.workunit.client.0.smithi057.stdout:9/446: creat d2/d5/d1b/d2e/d77/f8e x:0 0 0 2024-02-28T16:02:05.539 INFO:tasks.workunit.client.0.smithi057.stdout:4/416: creat d1/d10/d12/d2c/f8a x:0 0 0 2024-02-28T16:02:05.541 INFO:tasks.workunit.client.1.smithi087.stdout:8/827: write d2/d18/d25/f6c [4409559,39543] 0 2024-02-28T16:02:05.541 INFO:tasks.workunit.client.0.smithi057.stdout:5/385: creat d2/d12/d76/f87 x:0 0 0 2024-02-28T16:02:05.544 INFO:tasks.workunit.client.0.smithi057.stdout:4/417: chown d1/d22 287373 1 2024-02-28T16:02:05.545 INFO:tasks.workunit.client.1.smithi087.stdout:7/778: fdatasync d14/d2e/d2b/d4e/fe3 0 2024-02-28T16:02:05.545 INFO:tasks.workunit.client.1.smithi087.stdout:3/859: fsync d11/d33/d67/d9c/fb2 0 2024-02-28T16:02:05.546 INFO:tasks.workunit.client.1.smithi087.stdout:4/864: read d2/df/d2e/f43 [3891274,10665] 0 2024-02-28T16:02:05.547 INFO:tasks.workunit.client.0.smithi057.stdout:5/386: fsync d2/d12/d76/d7b/f69 0 2024-02-28T16:02:05.548 INFO:tasks.workunit.client.0.smithi057.stdout:1/406: dread d1/d3/f2a [0,4194304] 0 2024-02-28T16:02:05.549 INFO:tasks.workunit.client.1.smithi087.stdout:1/752: mknod d0/d14/d86/da1/cfd 0 2024-02-28T16:02:05.553 INFO:tasks.workunit.client.1.smithi087.stdout:6/872: dwrite d4/d30/d13/d67/f72 [0,4194304] 0 2024-02-28T16:02:05.556 INFO:tasks.workunit.client.1.smithi087.stdout:5/841: dread d3/d9/d9b/dba/d30/d36/f4e [0,4194304] 0 2024-02-28T16:02:05.556 INFO:tasks.workunit.client.0.smithi057.stdout:2/367: rename ld to d19/d1d/l73 0 2024-02-28T16:02:05.561 INFO:tasks.workunit.client.1.smithi087.stdout:9/756: dread d7/d1e/d60/f63 [0,4194304] 0 2024-02-28T16:02:05.562 INFO:tasks.workunit.client.0.smithi057.stdout:6/357: link df/d14/d15/d16/f31 df/d14/d15/d16/f76 0 2024-02-28T16:02:05.562 INFO:tasks.workunit.client.0.smithi057.stdout:9/447: symlink d2/l8f 0 2024-02-28T16:02:05.562 INFO:tasks.workunit.client.1.smithi087.stdout:8/828: creat d2/d18/df5/f10d x:0 0 0 2024-02-28T16:02:05.565 INFO:tasks.workunit.client.0.smithi057.stdout:1/407: chown d1/d21/d66/d53/d7d/d67 6 1 2024-02-28T16:02:05.565 INFO:tasks.workunit.client.1.smithi087.stdout:5/842: readlink d3/d9/d9b/dba/d30/d8f/dac/le7 0 2024-02-28T16:02:05.568 INFO:tasks.workunit.client.1.smithi087.stdout:8/829: chown d2/d63/d9b/dae 1281 1 2024-02-28T16:02:05.569 INFO:tasks.workunit.client.0.smithi057.stdout:4/418: link d1/d10/d12/d15/d19/c56 d1/d22/d64/c8b 0 2024-02-28T16:02:05.569 INFO:tasks.workunit.client.0.smithi057.stdout:1/408: chown d1/d3/l38 248903032 1 2024-02-28T16:02:05.570 INFO:tasks.workunit.client.1.smithi087.stdout:3/860: mkdir d11/d33/d67/d9c/da1/d12c 0 2024-02-28T16:02:05.572 INFO:tasks.workunit.client.0.smithi057.stdout:2/368: rename l15 to d19/d3a/l74 0 2024-02-28T16:02:05.575 INFO:tasks.workunit.client.0.smithi057.stdout:0/526: dread d6/fd [0,4194304] 0 2024-02-28T16:02:05.578 INFO:tasks.workunit.client.0.smithi057.stdout:9/448: symlink d2/d5/d1b/l90 0 2024-02-28T16:02:05.579 INFO:tasks.workunit.client.1.smithi087.stdout:4/865: dwrite d2/d9/d10/d22/f27 [4194304,4194304] 0 2024-02-28T16:02:05.579 INFO:tasks.workunit.client.0.smithi057.stdout:4/419: mkdir d1/d22/d64/d8c 0 2024-02-28T16:02:05.579 INFO:tasks.workunit.client.0.smithi057.stdout:8/387: write d5/de/d1b/f3d [3579450,33098] 0 2024-02-28T16:02:05.584 INFO:tasks.workunit.client.1.smithi087.stdout:8/830: creat d2/d9/d5e/d9c/d9f/f10e x:0 0 0 2024-02-28T16:02:05.584 INFO:tasks.workunit.client.1.smithi087.stdout:5/843: write d3/d9/d9b/dba/f2b [1790679,106391] 0 2024-02-28T16:02:05.585 INFO:tasks.workunit.client.0.smithi057.stdout:2/369: unlink d19/d1d/d2e/d31/f72 0 2024-02-28T16:02:05.592 INFO:tasks.workunit.client.1.smithi087.stdout:4/866: dread - d2/d9/d10/dbf/dbb/ff9 zero size 2024-02-28T16:02:05.593 INFO:tasks.workunit.client.1.smithi087.stdout:6/873: dwrite d4/d30/d42/de7/f106 [0,4194304] 0 2024-02-28T16:02:05.594 INFO:tasks.workunit.client.1.smithi087.stdout:1/753: dread d0/d1b/d1f/d71/db2/d24/d5c/d69/f7c [0,4194304] 0 2024-02-28T16:02:05.595 INFO:tasks.workunit.client.1.smithi087.stdout:3/861: mknod d11/d33/c12d 0 2024-02-28T16:02:05.597 INFO:tasks.workunit.client.1.smithi087.stdout:3/862: readlink d11/d61/d65/lef 0 2024-02-28T16:02:05.597 INFO:tasks.workunit.client.0.smithi057.stdout:9/449: chown d2/d5/d1b/d2e/d77/c43 1284565906 1 2024-02-28T16:02:05.598 INFO:tasks.workunit.client.1.smithi087.stdout:7/779: rmdir d14/d2e/d89/deb/d5d/d6a/d83/d96/dd4 0 2024-02-28T16:02:05.599 INFO:tasks.workunit.client.1.smithi087.stdout:3/863: stat d11/d3a/l123 0 2024-02-28T16:02:05.600 INFO:tasks.workunit.client.0.smithi057.stdout:6/358: truncate df/d14/d15/d16/f33 1850748 0 2024-02-28T16:02:05.601 INFO:tasks.workunit.client.1.smithi087.stdout:7/780: chown d14/d2e/c1a 717275 1 2024-02-28T16:02:05.602 INFO:tasks.workunit.client.0.smithi057.stdout:1/409: dwrite d1/d3/dc/d15/d4e/d57/f77 [0,4194304] 0 2024-02-28T16:02:05.602 INFO:tasks.workunit.client.0.smithi057.stdout:6/359: dread - df/d10/f5c zero size 2024-02-28T16:02:05.603 INFO:tasks.workunit.client.1.smithi087.stdout:0/759: link d4/dd/f82 d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/de9/ffc 0 2024-02-28T16:02:05.604 INFO:tasks.workunit.client.0.smithi057.stdout:1/410: read d1/d3/dc/f69 [739706,127639] 0 2024-02-28T16:02:05.605 INFO:tasks.workunit.client.1.smithi087.stdout:4/867: rmdir d2/d9/d10/d22 39 2024-02-28T16:02:05.607 INFO:tasks.workunit.client.0.smithi057.stdout:2/370: rmdir d19/d2c/d65 39 2024-02-28T16:02:05.608 INFO:tasks.workunit.client.0.smithi057.stdout:0/527: creat d6/d12/d17/d92/fb3 x:0 0 0 2024-02-28T16:02:05.609 INFO:tasks.workunit.client.0.smithi057.stdout:1/411: chown d1/d3/dc/d15/d4e/d5f/c87 266988122 1 2024-02-28T16:02:05.609 INFO:tasks.workunit.client.1.smithi087.stdout:7/781: rmdir d14/d46/d7c/db9 39 2024-02-28T16:02:05.611 INFO:tasks.workunit.client.1.smithi087.stdout:5/844: mkdir d3/d9/d9b/dba/d69/d87/df3/d117/d135 0 2024-02-28T16:02:05.611 INFO:tasks.workunit.client.0.smithi057.stdout:9/450: creat d2/d5/d1b/d2e/d4c/f91 x:0 0 0 2024-02-28T16:02:05.611 INFO:tasks.workunit.client.0.smithi057.stdout:1/412: fdatasync d1/d21/d66/d44/d4c/f6b 0 2024-02-28T16:02:05.612 INFO:tasks.workunit.client.0.smithi057.stdout:8/388: symlink d5/d20/d39/d49/d56/d84/l86 0 2024-02-28T16:02:05.613 INFO:tasks.workunit.client.1.smithi087.stdout:7/782: write d14/d2e/d89/deb/f3f [2109181,17265] 0 2024-02-28T16:02:05.614 INFO:tasks.workunit.client.1.smithi087.stdout:6/874: link d4/d30/d13/f3b d4/d30/d13/d67/daf/f118 0 2024-02-28T16:02:05.615 INFO:tasks.workunit.client.1.smithi087.stdout:1/754: mknod d0/d1b/d1f/d71/db2/db3/dda/cfe 0 2024-02-28T16:02:05.615 INFO:tasks.workunit.client.0.smithi057.stdout:4/420: rename d1/d10/d12/c21 to d1/d10/d12/d15/d19/d5e/c8d 0 2024-02-28T16:02:05.616 INFO:tasks.workunit.client.0.smithi057.stdout:5/387: link d2/d19/d1c/f34 d2/d15/d5e/d7f/f88 0 2024-02-28T16:02:05.617 INFO:tasks.workunit.client.0.smithi057.stdout:0/528: mkdir d6/d12/d38/db4 0 2024-02-28T16:02:05.618 INFO:tasks.workunit.client.0.smithi057.stdout:4/421: write d1/d10/d31/f6b [272698,30511] 0 2024-02-28T16:02:05.620 INFO:tasks.workunit.client.0.smithi057.stdout:6/360: link df/f1f df/d10/d13/f77 0 2024-02-28T16:02:05.622 INFO:tasks.workunit.client.0.smithi057.stdout:2/371: truncate fe 2491357 0 2024-02-28T16:02:05.623 INFO:tasks.workunit.client.0.smithi057.stdout:1/413: chown d1/d21/l2c 46301449 1 2024-02-28T16:02:05.625 INFO:tasks.workunit.client.1.smithi087.stdout:3/864: truncate d11/d7b/dab/fb3 1022249 0 2024-02-28T16:02:05.625 INFO:tasks.workunit.client.0.smithi057.stdout:8/389: rename d5/de/d1b/d45/f55 to d5/d20/d72/f87 0 2024-02-28T16:02:05.632 INFO:tasks.workunit.client.1.smithi087.stdout:0/760: link d4/dd/d26/fec d4/d6/df4/ffd 0 2024-02-28T16:02:05.634 INFO:tasks.workunit.client.1.smithi087.stdout:9/757: truncate d7/dd/d3c/f43 3599651 0 2024-02-28T16:02:05.636 INFO:tasks.workunit.client.0.smithi057.stdout:2/372: creat d19/d2c/d48/f75 x:0 0 0 2024-02-28T16:02:05.637 INFO:tasks.workunit.client.1.smithi087.stdout:7/783: rename d14/d2e/d2b/d4e/la2 to d14/d2e/d89/deb/d5d/d6a/d83/d96/lf3 0 2024-02-28T16:02:05.639 INFO:tasks.workunit.client.1.smithi087.stdout:1/755: dwrite d0/d14/f42 [4194304,4194304] 0 2024-02-28T16:02:05.641 INFO:tasks.workunit.client.0.smithi057.stdout:8/390: read d5/de/f10 [2712808,56215] 0 2024-02-28T16:02:05.644 INFO:tasks.workunit.client.1.smithi087.stdout:3/865: dread - d11/d3a/dd1/fdb zero size 2024-02-28T16:02:05.648 INFO:tasks.workunit.client.1.smithi087.stdout:1/756: write d0/d1b/d1f/d96/d63/fc3 [678555,78172] 0 2024-02-28T16:02:05.649 INFO:tasks.workunit.client.0.smithi057.stdout:4/422: rename d1/d10/d12/d2c/f77 to d1/d10/f8e 0 2024-02-28T16:02:05.649 INFO:tasks.workunit.client.0.smithi057.stdout:8/391: creat d5/d6/f88 x:0 0 0 2024-02-28T16:02:05.649 INFO:tasks.workunit.client.0.smithi057.stdout:2/373: mknod d19/d43/d5a/d70/c76 0 2024-02-28T16:02:05.649 INFO:tasks.workunit.client.1.smithi087.stdout:6/875: mkdir d4/d30/d13/d119 0 2024-02-28T16:02:05.651 INFO:tasks.workunit.client.1.smithi087.stdout:9/758: mkdir d7/dd/d15/d3f/d5f/d90/ddd 0 2024-02-28T16:02:05.653 INFO:tasks.workunit.client.0.smithi057.stdout:2/374: truncate d19/d1d/d22/f6b 229666 0 2024-02-28T16:02:05.654 INFO:tasks.workunit.client.1.smithi087.stdout:5/845: dread d3/d9/d9b/dba/f70 [0,4194304] 0 2024-02-28T16:02:05.655 INFO:tasks.workunit.client.0.smithi057.stdout:4/423: creat d1/d10/d12/d39/f8f x:0 0 0 2024-02-28T16:02:05.656 INFO:tasks.workunit.client.0.smithi057.stdout:1/414: fsync d1/d3/dc/d15/d4e/d57/f77 0 2024-02-28T16:02:05.656 INFO:tasks.workunit.client.1.smithi087.stdout:9/759: dread - d7/dd/d3c/d4c/da1/fb8 zero size 2024-02-28T16:02:05.657 INFO:tasks.workunit.client.0.smithi057.stdout:4/424: readlink d1/d22/l51 0 2024-02-28T16:02:05.658 INFO:tasks.workunit.client.1.smithi087.stdout:7/784: symlink d14/d2e/lf4 0 2024-02-28T16:02:05.660 INFO:tasks.workunit.client.0.smithi057.stdout:1/415: write d1/d21/f52 [6282147,115341] 0 2024-02-28T16:02:05.662 INFO:tasks.workunit.client.0.smithi057.stdout:6/361: rename df/d14/d15/d3d to df/d10/d78 0 2024-02-28T16:02:05.665 INFO:tasks.workunit.client.1.smithi087.stdout:5/846: truncate d3/d9/f15 4222668 0 2024-02-28T16:02:05.667 INFO:tasks.workunit.client.0.smithi057.stdout:6/362: write df/d14/f43 [602034,61659] 0 2024-02-28T16:02:05.668 INFO:tasks.workunit.client.1.smithi087.stdout:8/831: dwrite d2/fa9 [0,4194304] 0 2024-02-28T16:02:05.671 INFO:tasks.workunit.client.0.smithi057.stdout:6/363: fdatasync df/f53 0 2024-02-28T16:02:05.674 INFO:tasks.workunit.client.0.smithi057.stdout:8/392: dwrite d5/d6/f36 [0,4194304] 0 2024-02-28T16:02:05.675 INFO:tasks.workunit.client.0.smithi057.stdout:9/451: truncate d2/d5/d1b/d2e/f53 3992936 0 2024-02-28T16:02:05.675 INFO:tasks.workunit.client.1.smithi087.stdout:8/832: write d2/d18/d25/f6c [4876086,21397] 0 2024-02-28T16:02:05.675 INFO:tasks.workunit.client.1.smithi087.stdout:9/760: creat d7/dd/d15/fde x:0 0 0 2024-02-28T16:02:05.676 INFO:tasks.workunit.client.0.smithi057.stdout:2/375: dwrite d19/d3a/f46 [0,4194304] 0 2024-02-28T16:02:05.678 INFO:tasks.workunit.client.0.smithi057.stdout:5/388: write d2/d12/d3d/f82 [1626522,78238] 0 2024-02-28T16:02:05.679 INFO:tasks.workunit.client.1.smithi087.stdout:3/866: write d11/d33/f10b [1076721,116868] 0 2024-02-28T16:02:05.680 INFO:tasks.workunit.client.0.smithi057.stdout:3/372: dread d8/dd/f1f [0,4194304] 0 2024-02-28T16:02:05.680 INFO:tasks.workunit.client.0.smithi057.stdout:8/393: stat d5/d20/d39/d49/c58 0 2024-02-28T16:02:05.681 INFO:tasks.workunit.client.1.smithi087.stdout:4/868: dwrite d2/d9/d9e/d106/f117 [0,4194304] 0 2024-02-28T16:02:05.682 INFO:tasks.workunit.client.1.smithi087.stdout:7/785: mkdir d14/d2e/d89/deb/d5d/d6a/d83/df5 0 2024-02-28T16:02:05.683 INFO:tasks.workunit.client.0.smithi057.stdout:6/364: mknod df/d14/d15/d16/c79 0 2024-02-28T16:02:05.684 INFO:tasks.workunit.client.1.smithi087.stdout:4/869: chown d2/df/d65/d8d/ffe 7 1 2024-02-28T16:02:05.685 INFO:tasks.workunit.client.0.smithi057.stdout:4/425: rmdir d1/d10/d12/d39 39 2024-02-28T16:02:05.686 INFO:tasks.workunit.client.1.smithi087.stdout:5/847: unlink d3/d64/d67/f7b 0 2024-02-28T16:02:05.688 INFO:tasks.workunit.client.0.smithi057.stdout:1/416: truncate d1/f45 155983 0 2024-02-28T16:02:05.690 INFO:tasks.workunit.client.0.smithi057.stdout:8/394: readlink d5/d20/d39/d49/d56/d84/l86 0 2024-02-28T16:02:05.690 INFO:tasks.workunit.client.0.smithi057.stdout:2/376: mknod d19/d1d/c77 0 2024-02-28T16:02:05.691 INFO:tasks.workunit.client.0.smithi057.stdout:0/529: dread d6/f85 [0,4194304] 0 2024-02-28T16:02:05.691 INFO:tasks.workunit.client.1.smithi087.stdout:6/876: write d4/d30/d13/f2d [2764923,127874] 0 2024-02-28T16:02:05.694 INFO:tasks.workunit.client.0.smithi057.stdout:8/395: chown d5/d20/d72 77381 1 2024-02-28T16:02:05.695 INFO:tasks.workunit.client.0.smithi057.stdout:9/452: mkdir d2/d92 0 2024-02-28T16:02:05.695 INFO:tasks.workunit.client.0.smithi057.stdout:2/377: dread - d19/d2c/d48/f75 zero size 2024-02-28T16:02:05.696 INFO:tasks.workunit.client.1.smithi087.stdout:8/833: rename d2/da2 to d2/d18/d42/d7b/d10f 0 2024-02-28T16:02:05.696 INFO:tasks.workunit.client.0.smithi057.stdout:6/365: chown df/d10/d13/d4b/d4e/l69 150 1 2024-02-28T16:02:05.696 INFO:tasks.workunit.client.0.smithi057.stdout:0/530: chown d6/d12/d17/d34/f76 1 1 2024-02-28T16:02:05.697 INFO:tasks.workunit.client.0.smithi057.stdout:5/389: stat d2/d8/f16 0 2024-02-28T16:02:05.697 INFO:tasks.workunit.client.1.smithi087.stdout:3/867: mkdir d11/d61/d7c/db7/d12e 0 2024-02-28T16:02:05.700 INFO:tasks.workunit.client.0.smithi057.stdout:1/417: mkdir d1/d21/d66/d53/d7d/d67/d6c/d82/d8f 0 2024-02-28T16:02:05.701 INFO:tasks.workunit.client.0.smithi057.stdout:8/396: read d5/de/d1b/f35 [641054,129517] 0 2024-02-28T16:02:05.701 INFO:tasks.workunit.client.1.smithi087.stdout:3/868: write d11/d61/f126 [589328,63124] 0 2024-02-28T16:02:05.701 INFO:tasks.workunit.client.1.smithi087.stdout:1/757: getdents d0 0 2024-02-28T16:02:05.702 INFO:tasks.workunit.client.0.smithi057.stdout:3/373: symlink d8/dd/d14/d2e/l75 0 2024-02-28T16:02:05.703 INFO:tasks.workunit.client.1.smithi087.stdout:9/761: mkdir d7/dd/d15/d3f/d5f/d90/ddd/ddf 0 2024-02-28T16:02:05.704 INFO:tasks.workunit.client.0.smithi057.stdout:2/378: mkdir d19/d34/d78 0 2024-02-28T16:02:05.705 INFO:tasks.workunit.client.0.smithi057.stdout:0/531: creat d6/d12/d17/fb5 x:0 0 0 2024-02-28T16:02:05.705 INFO:tasks.workunit.client.1.smithi087.stdout:5/848: truncate d3/d9/d9b/dba/d30/d53/ff5 324694 0 2024-02-28T16:02:05.707 INFO:tasks.workunit.client.1.smithi087.stdout:6/877: creat d4/d30/d13/d38/d69/db0/f11a x:0 0 0 2024-02-28T16:02:05.709 INFO:tasks.workunit.client.0.smithi057.stdout:8/397: chown d5/d6/fa 6325975 1 2024-02-28T16:02:05.709 INFO:tasks.workunit.client.0.smithi057.stdout:0/532: stat d6/d4e/f32 0 2024-02-28T16:02:05.711 INFO:tasks.workunit.client.0.smithi057.stdout:4/426: rename d1/ld to d1/d10/l90 0 2024-02-28T16:02:05.712 INFO:tasks.workunit.client.1.smithi087.stdout:8/834: mknod d2/d63/d9b/dae/db1/df4/c110 0 2024-02-28T16:02:05.716 INFO:tasks.workunit.client.1.smithi087.stdout:1/758: fdatasync d0/d1b/d1f/fb5 0 2024-02-28T16:02:05.717 INFO:tasks.workunit.client.0.smithi057.stdout:3/374: mkdir d8/dd/d14/d2e/d76 0 2024-02-28T16:02:05.718 INFO:tasks.workunit.client.0.smithi057.stdout:8/398: mkdir d5/d20/d39/d49/d89 0 2024-02-28T16:02:05.720 INFO:tasks.workunit.client.1.smithi087.stdout:7/786: rename d14/d2e/d2b/d57/ccc to d14/d2e/cf6 0 2024-02-28T16:02:05.720 INFO:tasks.workunit.client.0.smithi057.stdout:7/322: sync 2024-02-28T16:02:05.721 INFO:tasks.workunit.client.0.smithi057.stdout:0/533: truncate d6/d12/d17/d34/f4d 111086 0 2024-02-28T16:02:05.721 INFO:tasks.workunit.client.1.smithi087.stdout:3/869: getdents d11/d7b/dab 0 2024-02-28T16:02:05.723 INFO:tasks.workunit.client.1.smithi087.stdout:5/849: rename d3/d9/d9b/dba/f72 to d3/d9/f136 0 2024-02-28T16:02:05.724 INFO:tasks.workunit.client.0.smithi057.stdout:4/427: mknod d1/d10/d31/c91 0 2024-02-28T16:02:05.724 INFO:tasks.workunit.client.1.smithi087.stdout:7/787: mknod d14/d46/cf7 0 2024-02-28T16:02:05.725 INFO:tasks.workunit.client.0.smithi057.stdout:9/453: dwrite d2/d24/d1d/d79/f6d [0,4194304] 0 2024-02-28T16:02:05.727 INFO:tasks.workunit.client.1.smithi087.stdout:8/835: getdents d2/d18/d25 0 2024-02-28T16:02:05.727 INFO:tasks.workunit.client.1.smithi087.stdout:3/870: chown d11/d33/d74/c8f 0 1 2024-02-28T16:02:05.727 INFO:tasks.workunit.client.0.smithi057.stdout:7/323: creat d6/dc/d12/d1a/d4c/d6c/f75 x:0 0 0 2024-02-28T16:02:05.730 INFO:tasks.workunit.client.1.smithi087.stdout:5/850: symlink d3/d9/d9b/dba/d30/d10f/l137 0 2024-02-28T16:02:05.731 INFO:tasks.workunit.client.0.smithi057.stdout:8/399: chown d5/d6/f3f 60 1 2024-02-28T16:02:05.732 INFO:tasks.workunit.client.1.smithi087.stdout:9/762: dwrite d7/dd/d15/d3f/d6d/dcd/fcf [0,4194304] 0 2024-02-28T16:02:05.733 INFO:tasks.workunit.client.1.smithi087.stdout:1/759: link d0/d1a/d28/f6b d0/d1b/d1f/d96/dfa/fff 0 2024-02-28T16:02:05.734 INFO:tasks.workunit.client.0.smithi057.stdout:1/418: rmdir d1/d21 39 2024-02-28T16:02:05.735 INFO:tasks.workunit.client.1.smithi087.stdout:3/871: symlink d11/d33/d67/l12f 0 2024-02-28T16:02:05.736 INFO:tasks.workunit.client.0.smithi057.stdout:0/534: mkdir d6/d12/d5d/d71/daa/db6 0 2024-02-28T16:02:05.737 INFO:tasks.workunit.client.1.smithi087.stdout:1/760: dread - d0/d1b/d1f/fb5 zero size 2024-02-28T16:02:05.738 INFO:tasks.workunit.client.1.smithi087.stdout:3/872: fsync d11/d3a/f10f 0 2024-02-28T16:02:05.740 INFO:tasks.workunit.client.0.smithi057.stdout:7/324: readlink d6/dc/l53 0 2024-02-28T16:02:05.740 INFO:tasks.workunit.client.0.smithi057.stdout:0/535: truncate d6/f19 4877509 0 2024-02-28T16:02:05.741 INFO:tasks.workunit.client.0.smithi057.stdout:5/390: dwrite d2/d15/f83 [0,4194304] 0 2024-02-28T16:02:05.742 INFO:tasks.workunit.client.0.smithi057.stdout:4/428: mknod d1/d10/d12/d15/c92 0 2024-02-28T16:02:05.742 INFO:tasks.workunit.client.1.smithi087.stdout:8/836: mkdir d2/d63/d9b/dd5/dd9/de5/d111 0 2024-02-28T16:02:05.747 INFO:tasks.workunit.client.1.smithi087.stdout:4/870: write d2/d9/d10/d22/fa1 [100559,120905] 0 2024-02-28T16:02:05.748 INFO:tasks.workunit.client.1.smithi087.stdout:5/851: truncate d3/d9/d9b/dba/d30/d36/d4f/d82/ff4 4684146 0 2024-02-28T16:02:05.748 INFO:tasks.workunit.client.1.smithi087.stdout:6/878: dwrite d4/d30/d13/d38/d69/fda [0,4194304] 0 2024-02-28T16:02:05.750 INFO:tasks.workunit.client.1.smithi087.stdout:4/871: write d2/d9/da/d1a/d26/f3d [1623180,127991] 0 2024-02-28T16:02:05.751 INFO:tasks.workunit.client.1.smithi087.stdout:1/761: unlink d0/d1a/d28/lf2 0 2024-02-28T16:02:05.752 INFO:tasks.workunit.client.1.smithi087.stdout:1/762: stat d0/d1a/f7d 0 2024-02-28T16:02:05.757 INFO:tasks.workunit.client.1.smithi087.stdout:2/733: sync 2024-02-28T16:02:05.759 INFO:tasks.workunit.client.1.smithi087.stdout:5/852: chown d3/d9/d9b/dba/d30/d36/d4f/fed 1346804102 1 2024-02-28T16:02:05.759 INFO:tasks.workunit.client.1.smithi087.stdout:4/872: symlink d2/d9/d10/d22/d5b/d5c/l11a 0 2024-02-28T16:02:05.760 INFO:tasks.workunit.client.0.smithi057.stdout:9/454: write d2/d46/f6b [2729388,91364] 0 2024-02-28T16:02:05.764 INFO:tasks.workunit.client.0.smithi057.stdout:8/400: creat d5/d20/d39/d49/d56/d84/f8a x:0 0 0 2024-02-28T16:02:05.764 INFO:tasks.workunit.client.0.smithi057.stdout:2/379: write d19/f1a [4513778,92162] 0 2024-02-28T16:02:05.766 INFO:tasks.workunit.client.0.smithi057.stdout:6/366: truncate df/d14/f2d 274360 0 2024-02-28T16:02:05.766 INFO:tasks.workunit.client.0.smithi057.stdout:1/419: chown d1/d21/d66/l36 793 1 2024-02-28T16:02:05.768 INFO:tasks.workunit.client.1.smithi087.stdout:3/873: dwrite d11/d33/f10b [0,4194304] 0 2024-02-28T16:02:05.768 INFO:tasks.workunit.client.1.smithi087.stdout:5/853: truncate d3/f21 1314363 0 2024-02-28T16:02:05.771 INFO:tasks.workunit.client.0.smithi057.stdout:2/380: write d19/d2c/d48/f75 [1011353,5814] 0 2024-02-28T16:02:05.771 INFO:tasks.workunit.client.0.smithi057.stdout:9/455: dread - d2/d5e/d65/f71 zero size 2024-02-28T16:02:05.774 INFO:tasks.workunit.client.0.smithi057.stdout:1/420: chown d1/d3/dc/d15/d4e 133628 1 2024-02-28T16:02:05.775 INFO:tasks.workunit.client.1.smithi087.stdout:6/879: dread d4/d30/d13/d38/d69/fc2 [0,4194304] 0 2024-02-28T16:02:05.778 INFO:tasks.workunit.client.0.smithi057.stdout:2/381: write d19/d1d/f20 [395320,112880] 0 2024-02-28T16:02:05.780 INFO:tasks.workunit.client.0.smithi057.stdout:5/391: creat d2/d12/d76/d7b/d62/d74/f89 x:0 0 0 2024-02-28T16:02:05.780 INFO:tasks.workunit.client.1.smithi087.stdout:9/763: write d7/d1e/d44/d83/fa0 [65313,77898] 0 2024-02-28T16:02:05.781 INFO:tasks.workunit.client.0.smithi057.stdout:6/367: rmdir df/d10/d78 39 2024-02-28T16:02:05.781 INFO:tasks.workunit.client.0.smithi057.stdout:7/325: rename d6/dc/d12/d1a/d4c/d6c/c70 to d6/dc/d12/d1a/d4c/c76 0 2024-02-28T16:02:05.781 INFO:tasks.workunit.client.1.smithi087.stdout:1/763: link d0/d1b/d1f/l4c d0/d1b/d1f/d71/db2/dae/dcd/l100 0 2024-02-28T16:02:05.783 INFO:tasks.workunit.client.0.smithi057.stdout:5/392: fsync d2/d12/d5f/f68 0 2024-02-28T16:02:05.785 INFO:tasks.workunit.client.1.smithi087.stdout:6/880: unlink d4/d30/d13/d38/f3a 0 2024-02-28T16:02:05.785 INFO:tasks.workunit.client.0.smithi057.stdout:7/326: write d6/d26/f50 [4917929,59406] 0 2024-02-28T16:02:05.786 INFO:tasks.workunit.client.1.smithi087.stdout:1/764: stat d0/d1b/d43/c7b 0 2024-02-28T16:02:05.787 INFO:tasks.workunit.client.1.smithi087.stdout:9/764: write d7/dd/d36/d89/fb5 [282845,78316] 0 2024-02-28T16:02:05.787 INFO:tasks.workunit.client.0.smithi057.stdout:5/393: stat d2/d15/d5e/d67 0 2024-02-28T16:02:05.787 INFO:tasks.workunit.client.0.smithi057.stdout:9/456: mknod d2/d5/d1b/d2e/d44/d7e/c93 0 2024-02-28T16:02:05.788 INFO:tasks.workunit.client.0.smithi057.stdout:6/368: unlink df/d14/c2c 0 2024-02-28T16:02:05.790 INFO:tasks.workunit.client.0.smithi057.stdout:9/457: readlink d2/d5/d9/d5d/l7a 0 2024-02-28T16:02:05.790 INFO:tasks.workunit.client.0.smithi057.stdout:7/327: write d6/dc/d12/d1a/f24 [8893123,25038] 0 2024-02-28T16:02:05.791 INFO:tasks.workunit.client.1.smithi087.stdout:8/837: dwrite d2/d9/f5d [0,4194304] 0 2024-02-28T16:02:05.793 INFO:tasks.workunit.client.0.smithi057.stdout:5/394: fdatasync d2/d15/d3b/f2f 0 2024-02-28T16:02:05.794 INFO:tasks.workunit.client.0.smithi057.stdout:2/382: rename f12 to d19/d1d/d2e/d3c/f79 0 2024-02-28T16:02:05.794 INFO:tasks.workunit.client.1.smithi087.stdout:8/838: chown d2/d18/d42/d7b/l99 5 1 2024-02-28T16:02:05.797 INFO:tasks.workunit.client.1.smithi087.stdout:9/765: creat d7/d1e/d44/d83/db0/fe0 x:0 0 0 2024-02-28T16:02:05.797 INFO:tasks.workunit.client.1.smithi087.stdout:6/881: truncate d4/dc/d7e/fab 469328 0 2024-02-28T16:02:05.799 INFO:tasks.workunit.client.1.smithi087.stdout:8/839: fsync d2/d18/d25/fc6 0 2024-02-28T16:02:05.800 INFO:tasks.workunit.client.0.smithi057.stdout:5/395: mkdir d2/d12/d3d/d8a 0 2024-02-28T16:02:05.802 INFO:tasks.workunit.client.1.smithi087.stdout:8/840: chown d2/d63/d9b/dd5/dd9/de5/d111 633486 1 2024-02-28T16:02:05.804 INFO:tasks.workunit.client.0.smithi057.stdout:9/458: creat d2/d5e/d65/d87/f94 x:0 0 0 2024-02-28T16:02:05.806 INFO:tasks.workunit.client.1.smithi087.stdout:9/766: read d7/dd/f2d [276017,130582] 0 2024-02-28T16:02:05.809 INFO:tasks.workunit.client.1.smithi087.stdout:1/765: dwrite d0/d1b/d1f/d71/fe4 [0,4194304] 0 2024-02-28T16:02:05.811 INFO:tasks.workunit.client.0.smithi057.stdout:2/383: read d19/d1d/f20 [3549606,7496] 0 2024-02-28T16:02:05.814 INFO:tasks.workunit.client.0.smithi057.stdout:5/396: rename d2/d12/d5f/l80 to d2/d15/d3b/l8b 0 2024-02-28T16:02:05.815 INFO:tasks.workunit.client.1.smithi087.stdout:9/767: creat d7/dd/d15/d79/d2e/dbd/fe1 x:0 0 0 2024-02-28T16:02:05.815 INFO:tasks.workunit.client.1.smithi087.stdout:1/766: rmdir d0/d14/d48/da7 39 2024-02-28T16:02:05.816 INFO:tasks.workunit.client.0.smithi057.stdout:9/459: creat d2/d92/f95 x:0 0 0 2024-02-28T16:02:05.816 INFO:tasks.workunit.client.0.smithi057.stdout:2/384: mknod d19/d2c/d48/c7a 0 2024-02-28T16:02:05.817 INFO:tasks.workunit.client.1.smithi087.stdout:1/767: chown d0/d1b/d1f/d71/dad 393489789 1 2024-02-28T16:02:05.817 INFO:tasks.workunit.client.1.smithi087.stdout:9/768: write d7/d1e/d44/d76/fab [1708397,35596] 0 2024-02-28T16:02:05.821 INFO:tasks.workunit.client.0.smithi057.stdout:5/397: creat d2/d12/d76/d7b/d62/d74/f8c x:0 0 0 2024-02-28T16:02:05.822 INFO:tasks.workunit.client.1.smithi087.stdout:2/734: dread d2/d99/fb3 [0,4194304] 0 2024-02-28T16:02:05.823 INFO:tasks.workunit.client.1.smithi087.stdout:5/854: write d3/d9/d9b/dba/f2e [611352,27307] 0 2024-02-28T16:02:05.824 INFO:tasks.workunit.client.0.smithi057.stdout:9/460: read d2/d5/d9/f1c [161071,109477] 0 2024-02-28T16:02:05.827 INFO:tasks.workunit.client.0.smithi057.stdout:7/328: dwrite d6/f14 [0,4194304] 0 2024-02-28T16:02:05.827 INFO:tasks.workunit.client.0.smithi057.stdout:3/375: truncate d8/dd/d14/d2e/d3b/d54/f5b 573255 0 2024-02-28T16:02:05.829 INFO:tasks.workunit.client.1.smithi087.stdout:9/769: creat d7/dd/fe2 x:0 0 0 2024-02-28T16:02:05.835 INFO:tasks.workunit.client.0.smithi057.stdout:5/398: creat d2/d12/d5f/f8d x:0 0 0 2024-02-28T16:02:05.835 INFO:tasks.workunit.client.1.smithi087.stdout:5/855: mkdir d3/d9/d9b/dba/d30/d36/d112/d12d/d138 0 2024-02-28T16:02:05.837 INFO:tasks.workunit.client.1.smithi087.stdout:3/874: dwrite d11/d33/d67/d9c/fb2 [0,4194304] 0 2024-02-28T16:02:05.839 INFO:tasks.workunit.client.1.smithi087.stdout:8/841: truncate d2/d9/d10/ff9 1958865 0 2024-02-28T16:02:05.841 INFO:tasks.workunit.client.0.smithi057.stdout:7/329: symlink d6/d26/l77 0 2024-02-28T16:02:05.844 INFO:tasks.workunit.client.1.smithi087.stdout:9/770: chown d7/d1e/d60/lce 189080665 1 2024-02-28T16:02:05.844 INFO:tasks.workunit.client.1.smithi087.stdout:2/735: link d2/d7/d17/d34/d88/fad d2/d99/dc7/f104 0 2024-02-28T16:02:05.845 INFO:tasks.workunit.client.0.smithi057.stdout:0/536: dread d6/d12/d45/f4f [0,4194304] 0 2024-02-28T16:02:05.848 INFO:tasks.workunit.client.1.smithi087.stdout:5/856: chown d3/d9/c63 1085 1 2024-02-28T16:02:05.852 INFO:tasks.workunit.client.0.smithi057.stdout:2/385: dread d19/d1d/d2e/d31/f50 [0,4194304] 0 2024-02-28T16:02:05.852 INFO:tasks.workunit.client.0.smithi057.stdout:0/537: readlink d6/d12/d17/d34/l44 0 2024-02-28T16:02:05.852 INFO:tasks.workunit.client.1.smithi087.stdout:1/768: dread d0/d14/d86/fe9 [0,4194304] 0 2024-02-28T16:02:05.853 INFO:tasks.workunit.client.1.smithi087.stdout:2/736: chown d2/d99/dc7/fd9 316 1 2024-02-28T16:02:05.855 INFO:tasks.workunit.client.0.smithi057.stdout:5/399: unlink d2/d19/f51 0 2024-02-28T16:02:05.856 INFO:tasks.workunit.client.1.smithi087.stdout:8/842: rename d2/d9/db4/lc2 to d2/d18/d42/d7b/l112 0 2024-02-28T16:02:05.856 INFO:tasks.workunit.client.1.smithi087.stdout:3/875: fdatasync d11/d33/d58/f107 0 2024-02-28T16:02:05.856 INFO:tasks.workunit.client.0.smithi057.stdout:7/330: readlink d6/d38/l55 0 2024-02-28T16:02:05.857 INFO:tasks.workunit.client.1.smithi087.stdout:6/882: dwrite d4/d30/d13/d67/daf/f118 [0,4194304] 0 2024-02-28T16:02:05.858 INFO:tasks.workunit.client.1.smithi087.stdout:5/857: truncate d3/d9/d9b/dba/d30/f11e 271401 0 2024-02-28T16:02:05.862 INFO:tasks.workunit.client.1.smithi087.stdout:1/769: chown d0/d1b/d1f/d71/db2/d24/d5c/d69/f7c 2095 1 2024-02-28T16:02:05.862 INFO:tasks.workunit.client.1.smithi087.stdout:3/876: symlink d11/d7b/dab/l130 0 2024-02-28T16:02:05.863 INFO:tasks.workunit.client.1.smithi087.stdout:6/883: chown d4/d12/d45/f77 141546 1 2024-02-28T16:02:05.867 INFO:tasks.workunit.client.0.smithi057.stdout:7/331: dread - d6/dc/d35/d58/f74 zero size 2024-02-28T16:02:05.867 INFO:tasks.workunit.client.0.smithi057.stdout:2/386: dread d19/d1d/f51 [0,4194304] 0 2024-02-28T16:02:05.867 INFO:tasks.workunit.client.1.smithi087.stdout:1/770: write d0/d1b/d43/d4d/f51 [2168980,102579] 0 2024-02-28T16:02:05.869 INFO:tasks.workunit.client.0.smithi057.stdout:6/369: truncate df/d14/d15/d16/f46 250362 0 2024-02-28T16:02:05.869 INFO:tasks.workunit.client.1.smithi087.stdout:2/737: rename d2/d42/f44 to d2/d7/d17/d34/daf/f105 0 2024-02-28T16:02:05.871 INFO:tasks.workunit.client.1.smithi087.stdout:3/877: fdatasync d11/f46 0 2024-02-28T16:02:05.876 INFO:tasks.workunit.client.1.smithi087.stdout:2/738: mknod d2/d99/d28/c106 0 2024-02-28T16:02:05.877 INFO:tasks.workunit.client.0.smithi057.stdout:1/421: dwrite d1/f8a [0,4194304] 0 2024-02-28T16:02:05.878 INFO:tasks.workunit.client.1.smithi087.stdout:1/771: truncate d0/d1b/d43/d4d/f74 2045236 0 2024-02-28T16:02:05.880 INFO:tasks.workunit.client.1.smithi087.stdout:5/858: link d3/d9/f79 d3/d9/d9b/dba/d30/d36/d112/d12d/da1/d131/f139 0 2024-02-28T16:02:05.881 INFO:tasks.workunit.client.0.smithi057.stdout:7/332: write d6/dc/f10 [8919903,127046] 0 2024-02-28T16:02:05.882 INFO:tasks.workunit.client.0.smithi057.stdout:2/387: mkdir d19/d2c/d7b 0 2024-02-28T16:02:05.882 INFO:tasks.workunit.client.1.smithi087.stdout:1/772: symlink d0/d14/d86/da1/l101 0 2024-02-28T16:02:05.885 INFO:tasks.workunit.client.0.smithi057.stdout:6/370: mkdir df/d10/d13/d70/d7a 0 2024-02-28T16:02:05.886 INFO:tasks.workunit.client.1.smithi087.stdout:2/739: link d2/d42/d4b/lca d2/d7/d17/d3d/d81/l107 0 2024-02-28T16:02:05.886 INFO:tasks.workunit.client.1.smithi087.stdout:8/843: dwrite d2/d18/d25/fc6 [4194304,4194304] 0 2024-02-28T16:02:05.889 INFO:tasks.workunit.client.0.smithi057.stdout:2/388: chown d19/f23 175742755 1 2024-02-28T16:02:05.889 INFO:tasks.workunit.client.0.smithi057.stdout:1/422: fdatasync d1/d3/f2a 0 2024-02-28T16:02:05.890 INFO:tasks.workunit.client.1.smithi087.stdout:9/771: truncate d7/d1e/d44/f92 743883 0 2024-02-28T16:02:05.891 INFO:tasks.workunit.client.0.smithi057.stdout:3/376: dwrite d8/dd/d14/f20 [4194304,4194304] 0 2024-02-28T16:02:05.892 INFO:tasks.workunit.client.1.smithi087.stdout:1/773: symlink d0/d1b/d1f/d71/dad/l102 0 2024-02-28T16:02:05.896 INFO:tasks.workunit.client.1.smithi087.stdout:2/740: read d2/d7/d17/d3d/f74 [2432157,101208] 0 2024-02-28T16:02:05.896 INFO:tasks.workunit.client.1.smithi087.stdout:8/844: rename d2/d7c/fb9 to d2/d63/d9b/dae/dca/f113 0 2024-02-28T16:02:05.898 INFO:tasks.workunit.client.1.smithi087.stdout:2/741: fsync d2/d7/d17/d34/f3a 0 2024-02-28T16:02:05.899 INFO:tasks.workunit.client.0.smithi057.stdout:2/389: fdatasync d19/d1d/f20 0 2024-02-28T16:02:05.904 INFO:tasks.workunit.client.0.smithi057.stdout:6/371: mkdir df/d10/d78/d5b/d7b 0 2024-02-28T16:02:05.904 INFO:tasks.workunit.client.0.smithi057.stdout:5/400: dwrite d2/d15/f1f [0,4194304] 0 2024-02-28T16:02:05.905 INFO:tasks.workunit.client.1.smithi087.stdout:1/774: creat d0/d1b/d1f/d71/f103 x:0 0 0 2024-02-28T16:02:05.909 INFO:tasks.workunit.client.1.smithi087.stdout:2/742: creat d2/d7/d17/f108 x:0 0 0 2024-02-28T16:02:05.910 INFO:tasks.workunit.client.1.smithi087.stdout:8/845: link d2/d18/l55 d2/d18/df5/d104/l114 0 2024-02-28T16:02:05.912 INFO:tasks.workunit.client.0.smithi057.stdout:9/461: dwrite d2/d5/d9/f32 [0,4194304] 0 2024-02-28T16:02:05.913 INFO:tasks.workunit.client.1.smithi087.stdout:8/846: write d2/d9/d10/da0/f105 [580643,81698] 0 2024-02-28T16:02:05.915 INFO:tasks.workunit.client.0.smithi057.stdout:0/538: dwrite d6/d4e/f32 [0,4194304] 0 2024-02-28T16:02:05.916 INFO:tasks.workunit.client.1.smithi087.stdout:8/847: stat d2/d9/d10/f3a 0 2024-02-28T16:02:05.917 INFO:tasks.workunit.client.1.smithi087.stdout:2/743: getdents d2/d7d 0 2024-02-28T16:02:05.918 INFO:tasks.workunit.client.0.smithi057.stdout:0/539: chown d6/d4e/l9f 77728417 1 2024-02-28T16:02:05.922 INFO:tasks.workunit.client.0.smithi057.stdout:1/423: mknod d1/d21/d66/d53/d7d/d67/d74/c90 0 2024-02-28T16:02:05.927 INFO:tasks.workunit.client.0.smithi057.stdout:3/377: creat d8/dd/d14/d2e/d3b/d71/f77 x:0 0 0 2024-02-28T16:02:05.927 INFO:tasks.workunit.client.1.smithi087.stdout:3/878: write d11/d33/d74/f95 [42258,101876] 0 2024-02-28T16:02:05.934 INFO:tasks.workunit.client.1.smithi087.stdout:3/879: getdents d11/d61/d7c/db7/d12e 0 2024-02-28T16:02:05.935 INFO:tasks.workunit.client.0.smithi057.stdout:9/462: symlink d2/d5/d9/d57/l96 0 2024-02-28T16:02:05.938 INFO:tasks.workunit.client.1.smithi087.stdout:5/859: write d3/d9/d9b/dba/d30/d8f/dac/d109/f85 [281039,74078] 0 2024-02-28T16:02:05.939 INFO:tasks.workunit.client.0.smithi057.stdout:9/463: write d2/f75 [553641,108080] 0 2024-02-28T16:02:05.941 INFO:tasks.workunit.client.0.smithi057.stdout:5/401: dread d2/d12/d3d/f4b [0,4194304] 0 2024-02-28T16:02:05.941 INFO:tasks.workunit.client.0.smithi057.stdout:0/540: mkdir d6/d12/d17/d34/db7 0 2024-02-28T16:02:05.942 INFO:tasks.workunit.client.1.smithi087.stdout:5/860: unlink d3/d9/d9b/dba/l9a 0 2024-02-28T16:02:05.945 INFO:tasks.workunit.client.1.smithi087.stdout:5/861: chown d3/d9/d9b/dba/d30/d53/c93 181 1 2024-02-28T16:02:05.946 INFO:tasks.workunit.client.0.smithi057.stdout:1/424: truncate d1/d3/dc/f56 622524 0 2024-02-28T16:02:05.947 INFO:tasks.workunit.client.1.smithi087.stdout:5/862: truncate d3/d9/d9b/dba/d69/d87/f125 192946 0 2024-02-28T16:02:05.955 INFO:tasks.workunit.client.1.smithi087.stdout:9/772: truncate d7/dd/d3c/f6f 2562590 0 2024-02-28T16:02:05.958 INFO:tasks.workunit.client.1.smithi087.stdout:5/863: dread d3/fb2 [0,4194304] 0 2024-02-28T16:02:05.958 INFO:tasks.workunit.client.1.smithi087.stdout:9/773: truncate d7/d1e/dc4/fd1 501512 0 2024-02-28T16:02:05.960 INFO:tasks.workunit.client.1.smithi087.stdout:1/775: write d0/d14/d48/fa6 [905313,30467] 0 2024-02-28T16:02:05.962 INFO:tasks.workunit.client.0.smithi057.stdout:7/333: dread d6/dc/d12/f21 [0,4194304] 0 2024-02-28T16:02:05.964 INFO:tasks.workunit.client.1.smithi087.stdout:9/774: creat d7/dd/d3c/d4c/dbf/fe3 x:0 0 0 2024-02-28T16:02:05.965 INFO:tasks.workunit.client.1.smithi087.stdout:1/776: chown d0/d1b/d1f/d71/dad/l102 6273231 1 2024-02-28T16:02:05.965 INFO:tasks.workunit.client.0.smithi057.stdout:0/541: unlink d6/d12/da4/la9 0 2024-02-28T16:02:05.967 INFO:tasks.workunit.client.0.smithi057.stdout:3/378: getdents d8/dd/d14/d2e/d30/d49/d51 0 2024-02-28T16:02:05.967 INFO:tasks.workunit.client.0.smithi057.stdout:9/464: dwrite d2/d46/f66 [0,4194304] 0 2024-02-28T16:02:05.969 INFO:tasks.workunit.client.0.smithi057.stdout:2/390: dread d19/d1d/d2e/d3c/f79 [4194304,4194304] 0 2024-02-28T16:02:05.969 INFO:tasks.workunit.client.0.smithi057.stdout:1/425: link d1/d3/dc/d15/c1d d1/d3/dc/d15/d4e/d5f/c91 0 2024-02-28T16:02:05.969 INFO:tasks.workunit.client.1.smithi087.stdout:1/777: creat d0/d14/d86/dac/f104 x:0 0 0 2024-02-28T16:02:05.971 INFO:tasks.workunit.client.1.smithi087.stdout:2/744: dwrite d2/d7/f46 [0,4194304] 0 2024-02-28T16:02:05.971 INFO:tasks.workunit.client.0.smithi057.stdout:0/542: chown d6/l9 103084 1 2024-02-28T16:02:05.972 INFO:tasks.workunit.client.1.smithi087.stdout:8/848: dwrite d2/d18/d42/f84 [0,4194304] 0 2024-02-28T16:02:05.974 INFO:tasks.workunit.client.0.smithi057.stdout:9/465: symlink d2/d5/d9/d5d/l97 0 2024-02-28T16:02:05.975 INFO:tasks.workunit.client.1.smithi087.stdout:9/775: creat d7/d1e/d44/d83/d8e/fe4 x:0 0 0 2024-02-28T16:02:05.975 INFO:tasks.workunit.client.0.smithi057.stdout:0/543: chown d6/l9 2 1 2024-02-28T16:02:05.976 INFO:tasks.workunit.client.0.smithi057.stdout:2/391: readlink d19/d43/d5a/l71 0 2024-02-28T16:02:05.977 INFO:tasks.workunit.client.1.smithi087.stdout:2/745: truncate d2/d42/ff3 1283927 0 2024-02-28T16:02:05.980 INFO:tasks.workunit.client.0.smithi057.stdout:9/466: dread - d2/d5/d9/d57/f81 zero size 2024-02-28T16:02:05.982 INFO:tasks.workunit.client.0.smithi057.stdout:9/467: chown d2/d5/d1b/d2e/d44 7382 1 2024-02-28T16:02:05.984 INFO:tasks.workunit.client.0.smithi057.stdout:9/468: dread - d2/d5e/d65/f56 zero size 2024-02-28T16:02:05.985 INFO:tasks.workunit.client.1.smithi087.stdout:9/776: chown d7/dc/f85 6742429 1 2024-02-28T16:02:05.986 INFO:tasks.workunit.client.1.smithi087.stdout:8/849: creat d2/d9/d5e/d9c/d9f/f115 x:0 0 0 2024-02-28T16:02:05.987 INFO:tasks.workunit.client.1.smithi087.stdout:1/778: dread d0/fa [0,4194304] 0 2024-02-28T16:02:05.987 INFO:tasks.workunit.client.1.smithi087.stdout:0/761: sync 2024-02-28T16:02:05.989 INFO:tasks.workunit.client.1.smithi087.stdout:2/746: mkdir d2/d9a/d109 0 2024-02-28T16:02:05.989 INFO:tasks.workunit.client.0.smithi057.stdout:0/544: mkdir d6/d12/d17/d58/db8 0 2024-02-28T16:02:05.990 INFO:tasks.workunit.client.0.smithi057.stdout:2/392: symlink d19/d2c/d48/l7c 0 2024-02-28T16:02:05.991 INFO:tasks.workunit.client.1.smithi087.stdout:1/779: chown d0/d1b/d1f/d96/dd8 362438359 1 2024-02-28T16:02:05.992 INFO:tasks.workunit.client.1.smithi087.stdout:2/747: creat d2/d9a/f10a x:0 0 0 2024-02-28T16:02:05.995 INFO:tasks.workunit.client.0.smithi057.stdout:1/426: rename d1/d21/d66/d53/d7d/d67/d74 to d1/d21/d66/d53/d7d/d67/d7a/d92 0 2024-02-28T16:02:05.996 INFO:tasks.workunit.client.1.smithi087.stdout:1/780: creat d0/d1b/d43/f105 x:0 0 0 2024-02-28T16:02:05.998 INFO:tasks.workunit.client.0.smithi057.stdout:9/469: symlink d2/d24/l98 0 2024-02-28T16:02:05.999 INFO:tasks.workunit.client.1.smithi087.stdout:8/850: read d2/d18/f3c [1622687,27630] 0 2024-02-28T16:02:05.999 INFO:tasks.workunit.client.1.smithi087.stdout:0/762: rename d4/dd/d26/fec to d4/dd/ffe 0 2024-02-28T16:02:06.001 INFO:tasks.workunit.client.1.smithi087.stdout:5/864: dwrite d3/d9/d9b/dba/d30/d36/d4f/d82/fea [0,4194304] 0 2024-02-28T16:02:06.006 INFO:tasks.workunit.client.1.smithi087.stdout:1/781: symlink d0/l106 0 2024-02-28T16:02:06.006 INFO:tasks.workunit.client.0.smithi057.stdout:2/393: getdents d19/d1d/d2e 0 2024-02-28T16:02:06.006 INFO:tasks.workunit.client.1.smithi087.stdout:9/777: rename d7/dd/d15/d3f/d6d/d9f/fc9 to d7/dd/d15/d55/fe5 0 2024-02-28T16:02:06.009 INFO:tasks.workunit.client.0.smithi057.stdout:5/402: dwrite d2/d19/d1c/f34 [0,4194304] 0 2024-02-28T16:02:06.010 INFO:tasks.workunit.client.0.smithi057.stdout:0/545: getdents d6/d12/d45/d78 0 2024-02-28T16:02:06.010 INFO:tasks.workunit.client.1.smithi087.stdout:2/748: getdents d2/d99/dc7/de2 0 2024-02-28T16:02:06.010 INFO:tasks.workunit.client.1.smithi087.stdout:3/880: dread d11/f13 [0,4194304] 0 2024-02-28T16:02:06.011 INFO:tasks.workunit.client.1.smithi087.stdout:1/782: write d0/d1a/d28/d9b/faf [5779292,126865] 0 2024-02-28T16:02:06.013 INFO:tasks.workunit.client.0.smithi057.stdout:1/427: truncate d1/d3/dc/d15/f3c 1262215 0 2024-02-28T16:02:06.014 INFO:tasks.workunit.client.1.smithi087.stdout:3/881: write d11/d33/d67/d9c/fb2 [578839,2224] 0 2024-02-28T16:02:06.015 INFO:tasks.workunit.client.0.smithi057.stdout:0/546: chown d6/d12/d38/f93 136 1 2024-02-28T16:02:06.017 INFO:tasks.workunit.client.1.smithi087.stdout:5/865: creat d3/d9/d9b/dba/dca/f13a x:0 0 0 2024-02-28T16:02:06.017 INFO:tasks.workunit.client.0.smithi057.stdout:5/403: mknod d2/d12/c8e 0 2024-02-28T16:02:06.018 INFO:tasks.workunit.client.1.smithi087.stdout:2/749: creat d2/d99/f10b x:0 0 0 2024-02-28T16:02:06.018 INFO:tasks.workunit.client.1.smithi087.stdout:7/788: sync 2024-02-28T16:02:06.018 INFO:tasks.workunit.client.1.smithi087.stdout:4/873: sync 2024-02-28T16:02:06.019 INFO:tasks.workunit.client.1.smithi087.stdout:9/778: stat d7/d1e/d44/d76/l84 0 2024-02-28T16:02:06.020 INFO:tasks.workunit.client.0.smithi057.stdout:1/428: creat d1/d21/d66/d53/d7d/d67/f93 x:0 0 0 2024-02-28T16:02:06.021 INFO:tasks.workunit.client.0.smithi057.stdout:0/547: creat d6/d12/d45/dab/fb9 x:0 0 0 2024-02-28T16:02:06.022 INFO:tasks.workunit.client.1.smithi087.stdout:3/882: write d11/d3a/d3c/fc5 [404885,19025] 0 2024-02-28T16:02:06.023 INFO:tasks.workunit.client.1.smithi087.stdout:1/783: rename d0/d1b/d1f/d71/db2/l57 to d0/d14/d86/da1/l107 0 2024-02-28T16:02:06.024 INFO:tasks.workunit.client.0.smithi057.stdout:0/548: dread - d6/d12/d17/d34/f98 zero size 2024-02-28T16:02:06.026 INFO:tasks.workunit.client.0.smithi057.stdout:0/549: readlink d6/d12/l26 0 2024-02-28T16:02:06.026 INFO:tasks.workunit.client.1.smithi087.stdout:8/851: dwrite d2/f6 [4194304,4194304] 0 2024-02-28T16:02:06.030 INFO:tasks.workunit.client.1.smithi087.stdout:2/750: creat d2/d9a/dd3/f10c x:0 0 0 2024-02-28T16:02:06.031 INFO:tasks.workunit.client.1.smithi087.stdout:1/784: fsync d0/d1b/d1f/d71/fe4 0 2024-02-28T16:02:06.031 INFO:tasks.workunit.client.1.smithi087.stdout:3/883: chown d11/d33/d67/d9c/da1 3 1 2024-02-28T16:02:06.032 INFO:tasks.workunit.client.0.smithi057.stdout:2/394: dread d19/d3a/f46 [0,4194304] 0 2024-02-28T16:02:06.032 INFO:tasks.workunit.client.1.smithi087.stdout:9/779: write d7/d1e/d44/d83/fdb [197601,39059] 0 2024-02-28T16:02:06.032 INFO:tasks.workunit.client.1.smithi087.stdout:7/789: dread - d14/d21/de4/de7/fed zero size 2024-02-28T16:02:06.034 INFO:tasks.workunit.client.0.smithi057.stdout:0/550: mknod d6/d12/d5d/cba 0 2024-02-28T16:02:06.034 INFO:tasks.workunit.client.1.smithi087.stdout:5/866: mkdir d3/d9/d9b/dba/d30/d36/d112/d12d/d13b 0 2024-02-28T16:02:06.039 INFO:tasks.workunit.client.0.smithi057.stdout:2/395: unlink d19/d1d/f20 0 2024-02-28T16:02:06.039 INFO:tasks.workunit.client.1.smithi087.stdout:3/884: write d11/f37 [473936,57710] 0 2024-02-28T16:02:06.040 INFO:tasks.workunit.client.0.smithi057.stdout:7/334: truncate d6/f23 2403699 0 2024-02-28T16:02:06.041 INFO:tasks.workunit.client.1.smithi087.stdout:1/785: chown d0/d1b/d1f/d71/db2/d24/c8a 28 1 2024-02-28T16:02:06.042 INFO:tasks.workunit.client.1.smithi087.stdout:9/780: write d7/dd/f1a [3040022,45113] 0 2024-02-28T16:02:06.046 INFO:tasks.workunit.client.0.smithi057.stdout:7/335: write d6/dc/d12/d1a/d4c/d6c/f73 [447948,38991] 0 2024-02-28T16:02:06.049 INFO:tasks.workunit.client.1.smithi087.stdout:0/763: dwrite d4/dd/d37/fcb [0,4194304] 0 2024-02-28T16:02:06.051 INFO:tasks.workunit.client.0.smithi057.stdout:1/429: rmdir d1/d21/d66/d53/d7d/d67/d7a/d92 39 2024-02-28T16:02:06.051 INFO:tasks.workunit.client.0.smithi057.stdout:0/551: creat d6/d12/d38/db4/fbb x:0 0 0 2024-02-28T16:02:06.052 INFO:tasks.workunit.client.1.smithi087.stdout:1/786: chown d0/d1b/d1f/d71/db2/d24/d5c/d69 35 1 2024-02-28T16:02:06.052 INFO:tasks.workunit.client.0.smithi057.stdout:9/470: write d2/d5/d9/f36 [18623,14533] 0 2024-02-28T16:02:06.056 INFO:tasks.workunit.client.0.smithi057.stdout:5/404: dwrite d2/d12/d3d/f4b [4194304,4194304] 0 2024-02-28T16:02:06.056 INFO:tasks.workunit.client.0.smithi057.stdout:7/336: creat d6/dc/d12/d1a/d4d/d5a/f78 x:0 0 0 2024-02-28T16:02:06.056 INFO:tasks.workunit.client.0.smithi057.stdout:0/552: stat d6/d12/d38/db4 0 2024-02-28T16:02:06.056 INFO:tasks.workunit.client.0.smithi057.stdout:1/430: readlink d1/l2e 0 2024-02-28T16:02:06.057 INFO:tasks.workunit.client.1.smithi087.stdout:5/867: mkdir d3/d9/d9b/dba/d69/d87/d13c 0 2024-02-28T16:02:06.057 INFO:tasks.workunit.client.1.smithi087.stdout:7/790: write d14/d46/f4c [1352103,31420] 0 2024-02-28T16:02:06.057 INFO:tasks.workunit.client.1.smithi087.stdout:3/885: truncate d11/d3a/d3c/f128 277579 0 2024-02-28T16:02:06.057 INFO:tasks.workunit.client.0.smithi057.stdout:9/471: readlink d2/d5/d1b/d2e/d44/l4d 0 2024-02-28T16:02:06.058 INFO:tasks.workunit.client.1.smithi087.stdout:2/751: rename d2/d7/d17/d97/fa0 to d2/d7/d17/d34/d88/f10d 0 2024-02-28T16:02:06.060 INFO:tasks.workunit.client.0.smithi057.stdout:7/337: chown d6/dc/d67 45 1 2024-02-28T16:02:06.063 INFO:tasks.workunit.client.0.smithi057.stdout:0/553: symlink d6/d12/d38/db4/lbc 0 2024-02-28T16:02:06.063 INFO:tasks.workunit.client.0.smithi057.stdout:1/431: stat d1/d21/d66/d53/d7d/d67/f6a 0 2024-02-28T16:02:06.064 INFO:tasks.workunit.client.0.smithi057.stdout:5/405: creat d2/d15/d63/f8f x:0 0 0 2024-02-28T16:02:06.067 INFO:tasks.workunit.client.0.smithi057.stdout:5/406: write d2/d15/d3b/f2f [1208399,50731] 0 2024-02-28T16:02:06.067 INFO:tasks.workunit.client.1.smithi087.stdout:3/886: symlink d11/d45/d73/d109/l131 0 2024-02-28T16:02:06.070 INFO:tasks.workunit.client.0.smithi057.stdout:9/472: symlink d2/d5/d9/d64/d78/l99 0 2024-02-28T16:02:06.070 INFO:tasks.workunit.client.0.smithi057.stdout:5/407: write d2/d8/f9 [2500161,81060] 0 2024-02-28T16:02:06.070 INFO:tasks.workunit.client.1.smithi087.stdout:8/852: rename d2/d63/d9b/dae/dca/d6f to d2/d18/df5/d104/d116 0 2024-02-28T16:02:06.074 INFO:tasks.workunit.client.0.smithi057.stdout:7/338: symlink d6/dc/d35/l79 0 2024-02-28T16:02:06.077 INFO:tasks.workunit.client.1.smithi087.stdout:4/874: dwrite d2/d9/d10/d11/f98 [0,4194304] 0 2024-02-28T16:02:06.077 INFO:tasks.workunit.client.1.smithi087.stdout:3/887: chown d11/d45/f47 45 1 2024-02-28T16:02:06.078 INFO:tasks.workunit.client.0.smithi057.stdout:7/339: write d6/dc/d35/f61 [199699,83596] 0 2024-02-28T16:02:06.078 INFO:tasks.workunit.client.0.smithi057.stdout:1/432: write d1/d3/dc/d15/f3e [3396545,95497] 0 2024-02-28T16:02:06.078 INFO:tasks.workunit.client.0.smithi057.stdout:0/554: mknod d6/d4e/cbd 0 2024-02-28T16:02:06.079 INFO:tasks.workunit.client.1.smithi087.stdout:2/752: creat d2/d42/df1/f10e x:0 0 0 2024-02-28T16:02:06.083 INFO:tasks.workunit.client.1.smithi087.stdout:5/868: dread d3/d9/d9b/dba/d30/d36/d4f/d82/fea [0,4194304] 0 2024-02-28T16:02:06.083 INFO:tasks.workunit.client.1.smithi087.stdout:3/888: mkdir d11/d61/d7c/db7/d132 0 2024-02-28T16:02:06.083 INFO:tasks.workunit.client.0.smithi057.stdout:5/408: mknod d2/d12/d76/d7b/c90 0 2024-02-28T16:02:06.085 INFO:tasks.workunit.client.1.smithi087.stdout:2/753: truncate d2/d99/d28/fe5 5130563 0 2024-02-28T16:02:06.088 INFO:tasks.workunit.client.1.smithi087.stdout:4/875: getdents d2/df/d2e/dad 0 2024-02-28T16:02:06.088 INFO:tasks.workunit.client.1.smithi087.stdout:7/791: dread d14/d2e/f5c [0,4194304] 0 2024-02-28T16:02:06.092 INFO:tasks.workunit.client.1.smithi087.stdout:0/764: write d4/dd/d21/d5f/fb7 [390594,130540] 0 2024-02-28T16:02:06.092 INFO:tasks.workunit.client.0.smithi057.stdout:2/396: dwrite d19/f29 [0,4194304] 0 2024-02-28T16:02:06.095 INFO:tasks.workunit.client.0.smithi057.stdout:9/473: dwrite d2/d24/d1d/f7b [0,4194304] 0 2024-02-28T16:02:06.097 INFO:tasks.workunit.client.0.smithi057.stdout:0/555: link d6/d4e/c47 d6/d12/d38/da3/cbe 0 2024-02-28T16:02:06.097 INFO:tasks.workunit.client.0.smithi057.stdout:2/397: creat d19/d2c/d48/f7d x:0 0 0 2024-02-28T16:02:06.098 INFO:tasks.workunit.client.1.smithi087.stdout:3/889: mkdir d11/d33/d67/d98/d133 0 2024-02-28T16:02:06.100 INFO:tasks.workunit.client.1.smithi087.stdout:7/792: truncate f12 933432 0 2024-02-28T16:02:06.102 INFO:tasks.workunit.client.0.smithi057.stdout:1/433: mkdir d1/d21/d66/d53/d7d/d67/d7a/d94 0 2024-02-28T16:02:06.103 INFO:tasks.workunit.client.1.smithi087.stdout:0/765: unlink d4/dd/d37/d39/d3a/dc1/c77 0 2024-02-28T16:02:06.104 INFO:tasks.workunit.client.0.smithi057.stdout:9/474: creat d2/d5e/f9a x:0 0 0 2024-02-28T16:02:06.105 INFO:tasks.workunit.client.0.smithi057.stdout:5/409: getdents d2/d15/d5e/d6d 0 2024-02-28T16:02:06.106 INFO:tasks.workunit.client.1.smithi087.stdout:5/869: getdents d3/d9/d9b/dba/d30/d36/d4f/d82 0 2024-02-28T16:02:06.107 INFO:tasks.workunit.client.1.smithi087.stdout:8/853: dwrite d2/d33/f8f [12582912,4194304] 0 2024-02-28T16:02:06.108 INFO:tasks.workunit.client.0.smithi057.stdout:0/556: read d6/d4e/f77 [3612428,47061] 0 2024-02-28T16:02:06.109 INFO:tasks.workunit.client.1.smithi087.stdout:3/890: symlink d11/d33/d67/d9c/da1/l134 0 2024-02-28T16:02:06.111 INFO:tasks.workunit.client.1.smithi087.stdout:0/766: truncate d4/dd/fba 5124730 0 2024-02-28T16:02:06.111 INFO:tasks.workunit.client.0.smithi057.stdout:9/475: creat d2/d5e/d65/f9b x:0 0 0 2024-02-28T16:02:06.112 INFO:tasks.workunit.client.0.smithi057.stdout:5/410: mkdir d2/d15/d3b/d91 0 2024-02-28T16:02:06.114 INFO:tasks.workunit.client.1.smithi087.stdout:4/876: truncate d2/d9/d10/d22/d5b/d5c/d91/da9/fcc 867038 0 2024-02-28T16:02:06.117 INFO:tasks.workunit.client.0.smithi057.stdout:5/411: write d2/d15/d63/f8f [922425,86951] 0 2024-02-28T16:02:06.118 INFO:tasks.workunit.client.1.smithi087.stdout:7/793: rename d14/d2e/d89/deb/d5d/d6a/d83/d96 to d14/d30/dd1/df8 0 2024-02-28T16:02:06.122 INFO:tasks.workunit.client.1.smithi087.stdout:8/854: unlink d2/d18/d42/d62/de8/df6/f107 0 2024-02-28T16:02:06.122 INFO:tasks.workunit.client.1.smithi087.stdout:0/767: mkdir d4/d1c/dff 0 2024-02-28T16:02:06.123 INFO:tasks.workunit.client.0.smithi057.stdout:9/476: mkdir d2/d24/d9c 0 2024-02-28T16:02:06.124 INFO:tasks.workunit.client.1.smithi087.stdout:4/877: write d2/f4 [1100708,3730] 0 2024-02-28T16:02:06.125 INFO:tasks.workunit.client.0.smithi057.stdout:2/398: dwrite d19/d2c/f4f [0,4194304] 0 2024-02-28T16:02:06.127 INFO:tasks.workunit.client.1.smithi087.stdout:5/870: creat d3/d9/d9b/dba/f13d x:0 0 0 2024-02-28T16:02:06.128 INFO:tasks.workunit.client.1.smithi087.stdout:8/855: chown d2/d18/d42/d7b/d10f/fad 266 1 2024-02-28T16:02:06.128 INFO:tasks.workunit.client.1.smithi087.stdout:0/768: stat d4/dd/d37/d39/d3a/d57/d74/d1f/d2e 0 2024-02-28T16:02:06.130 INFO:tasks.workunit.client.0.smithi057.stdout:9/477: creat d2/d5/d1b/d2e/f9d x:0 0 0 2024-02-28T16:02:06.131 INFO:tasks.workunit.client.0.smithi057.stdout:1/434: link d1/f45 d1/d21/d25/f95 0 2024-02-28T16:02:06.134 INFO:tasks.workunit.client.1.smithi087.stdout:7/794: creat d14/d2e/d89/deb/d5d/d6a/d83/df5/ff9 x:0 0 0 2024-02-28T16:02:06.134 INFO:tasks.workunit.client.1.smithi087.stdout:9/781: dread d7/f12 [4194304,4194304] 0 2024-02-28T16:02:06.140 INFO:tasks.workunit.client.1.smithi087.stdout:3/891: dwrite d11/d44/d5b/f5a [4194304,4194304] 0 2024-02-28T16:02:06.140 INFO:tasks.workunit.client.1.smithi087.stdout:4/878: mknod d2/d9/da/c11b 0 2024-02-28T16:02:06.141 INFO:tasks.workunit.client.0.smithi057.stdout:2/399: dread d19/d2c/f4f [0,4194304] 0 2024-02-28T16:02:06.141 INFO:tasks.workunit.client.0.smithi057.stdout:5/412: link d2/d8/c31 d2/d12/d76/d7b/d62/d74/c92 0 2024-02-28T16:02:06.142 INFO:tasks.workunit.client.0.smithi057.stdout:1/435: stat d1/d3/dc/c32 0 2024-02-28T16:02:06.143 INFO:tasks.workunit.client.0.smithi057.stdout:7/340: truncate d6/dc/d12/f5c 83298 0 2024-02-28T16:02:06.144 INFO:tasks.workunit.client.1.smithi087.stdout:8/856: mkdir d2/d63/d9b/dd5/d117 0 2024-02-28T16:02:06.148 INFO:tasks.workunit.client.1.smithi087.stdout:9/782: dread - d7/dd/d3c/f78 zero size 2024-02-28T16:02:06.148 INFO:tasks.workunit.client.1.smithi087.stdout:4/879: chown d2/d9/d10/d22/c52 316 1 2024-02-28T16:02:06.149 INFO:tasks.workunit.client.0.smithi057.stdout:0/557: write d6/f99 [3413648,41849] 0 2024-02-28T16:02:06.149 INFO:tasks.workunit.client.0.smithi057.stdout:1/436: write d1/d3/dc/d15/f3e [4547861,106720] 0 2024-02-28T16:02:06.150 INFO:tasks.workunit.client.1.smithi087.stdout:0/769: getdents d4/d6/dc/d45/db4/df2 0 2024-02-28T16:02:06.150 INFO:tasks.workunit.client.1.smithi087.stdout:2/754: dwrite d2/d42/d4b/f95 [0,4194304] 0 2024-02-28T16:02:06.154 INFO:tasks.workunit.client.0.smithi057.stdout:5/413: truncate d2/d12/d76/d7a/f7d 629324 0 2024-02-28T16:02:06.156 INFO:tasks.workunit.client.1.smithi087.stdout:4/880: creat d2/d9/d10/dbf/dbb/f11c x:0 0 0 2024-02-28T16:02:06.156 INFO:tasks.workunit.client.1.smithi087.stdout:8/857: symlink d2/d63/d9b/dd5/dd9/l118 0 2024-02-28T16:02:06.156 INFO:tasks.workunit.client.0.smithi057.stdout:9/478: dwrite d2/f3a [0,4194304] 0 2024-02-28T16:02:06.157 INFO:tasks.workunit.client.0.smithi057.stdout:7/341: symlink d6/dc/d12/d1a/d4d/l7a 0 2024-02-28T16:02:06.158 INFO:tasks.workunit.client.1.smithi087.stdout:0/770: mknod d4/dd/d26/c100 0 2024-02-28T16:02:06.160 INFO:tasks.workunit.client.1.smithi087.stdout:2/755: fsync d2/d7/d17/d3d/f74 0 2024-02-28T16:02:06.161 INFO:tasks.workunit.client.0.smithi057.stdout:0/558: creat d6/d12/d38/fbf x:0 0 0 2024-02-28T16:02:06.163 INFO:tasks.workunit.client.0.smithi057.stdout:5/414: unlink d2/d12/d5f/f68 0 2024-02-28T16:02:06.164 INFO:tasks.workunit.client.0.smithi057.stdout:9/479: creat d2/d5e/d65/d87/f9e x:0 0 0 2024-02-28T16:02:06.166 INFO:tasks.workunit.client.0.smithi057.stdout:2/400: fsync d19/d2c/f4f 0 2024-02-28T16:02:06.166 INFO:tasks.workunit.client.0.smithi057.stdout:0/559: fsync d6/f41 0 2024-02-28T16:02:06.167 INFO:tasks.workunit.client.1.smithi087.stdout:9/783: dread d7/dd/d15/f1f [0,4194304] 0 2024-02-28T16:02:06.169 INFO:tasks.workunit.client.0.smithi057.stdout:9/480: dread - d2/d5/d9/f89 zero size 2024-02-28T16:02:06.169 INFO:tasks.workunit.client.1.smithi087.stdout:0/771: dread - d4/dd/d26/d93/fab zero size 2024-02-28T16:02:06.169 INFO:tasks.workunit.client.0.smithi057.stdout:1/437: truncate d1/d3/dc/d15/d4e/d57/f77 403888 0 2024-02-28T16:02:06.173 INFO:tasks.workunit.client.0.smithi057.stdout:0/560: creat d6/d12/d5d/fc0 x:0 0 0 2024-02-28T16:02:06.173 INFO:tasks.workunit.client.0.smithi057.stdout:1/438: chown d1/d3/l38 863978 1 2024-02-28T16:02:06.175 INFO:tasks.workunit.client.0.smithi057.stdout:9/481: fsync d2/d5/d1b/f5b 0 2024-02-28T16:02:06.175 INFO:tasks.workunit.client.0.smithi057.stdout:5/415: creat d2/d12/d5f/d77/f93 x:0 0 0 2024-02-28T16:02:06.175 INFO:tasks.workunit.client.1.smithi087.stdout:6/884: sync 2024-02-28T16:02:06.175 INFO:tasks.workunit.client.1.smithi087.stdout:5/871: write d3/d9/fd7 [268605,60823] 0 2024-02-28T16:02:06.176 INFO:tasks.workunit.client.1.smithi087.stdout:3/892: dwrite d11/f36 [0,4194304] 0 2024-02-28T16:02:06.176 INFO:tasks.workunit.client.1.smithi087.stdout:2/756: creat d2/d7/dec/f10f x:0 0 0 2024-02-28T16:02:06.176 INFO:tasks.workunit.client.1.smithi087.stdout:4/881: dread d2/d9/d10/d11/fb9 [0,4194304] 0 2024-02-28T16:02:06.180 INFO:tasks.workunit.client.1.smithi087.stdout:8/858: rename d2/d9/d5e/d9c/d9f/fc4 to d2/d9/db4/f119 0 2024-02-28T16:02:06.182 INFO:tasks.workunit.client.1.smithi087.stdout:3/893: stat d11/d61/d65/da9/lc1 0 2024-02-28T16:02:06.184 INFO:tasks.workunit.client.0.smithi057.stdout:7/342: dwrite d6/d26/f36 [4194304,4194304] 0 2024-02-28T16:02:06.185 INFO:tasks.workunit.client.1.smithi087.stdout:4/882: chown d2/d9/d10/d22/f72 3 1 2024-02-28T16:02:06.186 INFO:tasks.workunit.client.1.smithi087.stdout:2/757: fsync d2/d9a/dd3/f10c 0 2024-02-28T16:02:06.186 INFO:tasks.workunit.client.0.smithi057.stdout:2/401: rename d19/c1b to d19/d2c/c7e 0 2024-02-28T16:02:06.187 INFO:tasks.workunit.client.0.smithi057.stdout:0/561: mknod d6/d12/d5d/d71/cc1 0 2024-02-28T16:02:06.188 INFO:tasks.workunit.client.0.smithi057.stdout:1/439: mknod d1/d3/dc/d15/d4e/c96 0 2024-02-28T16:02:06.188 INFO:tasks.workunit.client.1.smithi087.stdout:7/795: dwrite d14/d46/d80/fc4 [0,4194304] 0 2024-02-28T16:02:06.189 INFO:tasks.workunit.client.1.smithi087.stdout:6/885: write d4/d30/d13/f2a [5923343,67709] 0 2024-02-28T16:02:06.191 INFO:tasks.workunit.client.1.smithi087.stdout:4/883: rmdir d2/df/d62 39 2024-02-28T16:02:06.191 INFO:tasks.workunit.client.1.smithi087.stdout:5/872: fdatasync d3/d9/d9b/dba/d69/f88 0 2024-02-28T16:02:06.197 INFO:tasks.workunit.client.0.smithi057.stdout:9/482: mknod d2/d24/c9f 0 2024-02-28T16:02:06.199 INFO:tasks.workunit.client.0.smithi057.stdout:8/401: sync 2024-02-28T16:02:06.199 INFO:tasks.workunit.client.0.smithi057.stdout:3/379: sync 2024-02-28T16:02:06.199 INFO:tasks.workunit.client.0.smithi057.stdout:4/429: sync 2024-02-28T16:02:06.199 INFO:tasks.workunit.client.0.smithi057.stdout:2/402: truncate d19/d1d/f51 1526737 0 2024-02-28T16:02:06.199 INFO:tasks.workunit.client.0.smithi057.stdout:6/372: sync 2024-02-28T16:02:06.200 INFO:tasks.workunit.client.1.smithi087.stdout:7/796: creat d14/d21/ffa x:0 0 0 2024-02-28T16:02:06.203 INFO:tasks.workunit.client.1.smithi087.stdout:5/873: fsync d3/d9/d9b/dba/d69/d87/f125 0 2024-02-28T16:02:06.203 INFO:tasks.workunit.client.1.smithi087.stdout:7/797: chown d14/d46/f4c 3053077 1 2024-02-28T16:02:06.207 INFO:tasks.workunit.client.0.smithi057.stdout:3/380: chown d8/dd/d19/c46 140638228 1 2024-02-28T16:02:06.209 INFO:tasks.workunit.client.1.smithi087.stdout:8/859: dwrite d2/d9/d8e/faf [4194304,4194304] 0 2024-02-28T16:02:06.210 INFO:tasks.workunit.client.0.smithi057.stdout:3/381: stat d8/dd/d19/d25/l5d 0 2024-02-28T16:02:06.214 INFO:tasks.workunit.client.1.smithi087.stdout:8/860: chown d2/d63/d9b/dae/dca/lf2 267401 1 2024-02-28T16:02:06.214 INFO:tasks.workunit.client.0.smithi057.stdout:0/562: creat d6/d12/d17/d58/d95/daf/fc2 x:0 0 0 2024-02-28T16:02:06.217 INFO:tasks.workunit.client.0.smithi057.stdout:1/440: dwrite d1/d3/dc/d40/f88 [0,4194304] 0 2024-02-28T16:02:06.217 INFO:tasks.workunit.client.0.smithi057.stdout:0/563: chown d6/d12/d5d/d71/cc1 5091104 1 2024-02-28T16:02:06.223 INFO:tasks.workunit.client.0.smithi057.stdout:0/564: write d6/d12/d45/d55/f54 [1177327,19131] 0 2024-02-28T16:02:06.224 INFO:tasks.workunit.client.0.smithi057.stdout:5/416: rename d2/f13 to d2/d3e/d5b/f94 0 2024-02-28T16:02:06.225 INFO:tasks.workunit.client.0.smithi057.stdout:2/403: chown d19/d2c/d65 331479009 1 2024-02-28T16:02:06.226 INFO:tasks.workunit.client.1.smithi087.stdout:3/894: dwrite d11/f35 [0,4194304] 0 2024-02-28T16:02:06.227 INFO:tasks.workunit.client.0.smithi057.stdout:5/417: write d2/d12/d76/d7b/d62/d74/f89 [363272,51865] 0 2024-02-28T16:02:06.229 INFO:tasks.workunit.client.0.smithi057.stdout:7/343: link d6/d38/f44 d6/dc/d12/d1a/d4d/d5a/f7b 0 2024-02-28T16:02:06.229 INFO:tasks.workunit.client.0.smithi057.stdout:5/418: readlink d2/d19/d1c/l47 0 2024-02-28T16:02:06.231 INFO:tasks.workunit.client.0.smithi057.stdout:7/344: fsync d6/dc/d35/d58/f74 0 2024-02-28T16:02:06.232 INFO:tasks.workunit.client.0.smithi057.stdout:7/345: stat d6 0 2024-02-28T16:02:06.234 INFO:tasks.workunit.client.0.smithi057.stdout:7/346: fsync d6/dc/d12/d1a/d4c/d6c/f73 0 2024-02-28T16:02:06.238 INFO:tasks.workunit.client.0.smithi057.stdout:3/382: fsync d8/f15 0 2024-02-28T16:02:06.240 INFO:tasks.workunit.client.0.smithi057.stdout:3/383: stat d8/f15 0 2024-02-28T16:02:06.243 INFO:tasks.workunit.client.1.smithi087.stdout:9/784: getdents d7/dd/d15/d79/d2e 0 2024-02-28T16:02:06.243 INFO:tasks.workunit.client.0.smithi057.stdout:1/441: mkdir d1/d3/d97 0 2024-02-28T16:02:06.246 INFO:tasks.workunit.client.1.smithi087.stdout:2/758: mknod d2/d99/d28/d79/d9f/c110 0 2024-02-28T16:02:06.247 INFO:tasks.workunit.client.0.smithi057.stdout:0/565: mknod d6/d12/d17/d58/cc3 0 2024-02-28T16:02:06.249 INFO:tasks.workunit.client.1.smithi087.stdout:6/886: link d4/d30/d13/d38/f64 d4/d30/d13/d38/d69/db0/f11b 0 2024-02-28T16:02:06.250 INFO:tasks.workunit.client.0.smithi057.stdout:8/402: getdents d5/de/d1b/d57/d85 0 2024-02-28T16:02:06.250 INFO:tasks.workunit.client.0.smithi057.stdout:5/419: dwrite d2/d12/d3d/f4b [4194304,4194304] 0 2024-02-28T16:02:06.253 INFO:tasks.workunit.client.1.smithi087.stdout:8/861: mkdir d2/d63/d9b/dd5/dd9/de5/d111/d11a 0 2024-02-28T16:02:06.256 INFO:tasks.workunit.client.1.smithi087.stdout:0/772: getdents d4/dd/d37/d39/d3a/d57/d74/d1f/d2e 0 2024-02-28T16:02:06.259 INFO:tasks.workunit.client.0.smithi057.stdout:7/347: unlink d6/dc/d12/d1a/d4c/l65 0 2024-02-28T16:02:06.260 INFO:tasks.workunit.client.1.smithi087.stdout:9/785: unlink d7/dd/d3c/f53 0 2024-02-28T16:02:06.263 INFO:tasks.workunit.client.0.smithi057.stdout:2/404: mknod d19/d2c/d7b/c7f 0 2024-02-28T16:02:06.266 INFO:tasks.workunit.client.0.smithi057.stdout:0/566: symlink d6/d12/d38/db4/lc4 0 2024-02-28T16:02:06.268 INFO:tasks.workunit.client.1.smithi087.stdout:8/862: mkdir d2/d63/d9b/dd5/dd9/de5/d111/d11a/d11b 0 2024-02-28T16:02:06.272 INFO:tasks.workunit.client.1.smithi087.stdout:3/895: fdatasync d11/f35 0 2024-02-28T16:02:06.273 INFO:tasks.workunit.client.1.smithi087.stdout:9/786: creat d7/dd/d15/d3f/d6d/dc2/fe6 x:0 0 0 2024-02-28T16:02:06.274 INFO:tasks.workunit.client.1.smithi087.stdout:6/887: dwrite d4/dc/d61/d89/f9d [0,4194304] 0 2024-02-28T16:02:06.274 INFO:tasks.workunit.client.0.smithi057.stdout:5/420: dwrite d2/d12/d5f/f8d [0,4194304] 0 2024-02-28T16:02:06.275 INFO:tasks.workunit.client.0.smithi057.stdout:9/483: truncate d2/d5e/f7c 80897 0 2024-02-28T16:02:06.276 INFO:tasks.workunit.client.1.smithi087.stdout:2/759: dwrite d2/d99/d28/d79/da3/fe0 [0,4194304] 0 2024-02-28T16:02:06.279 INFO:tasks.workunit.client.0.smithi057.stdout:7/348: rmdir d6/d26/d54 0 2024-02-28T16:02:06.281 INFO:tasks.workunit.client.0.smithi057.stdout:0/567: mknod d6/d12/d17/d4b/d60/cc5 0 2024-02-28T16:02:06.284 INFO:tasks.workunit.client.0.smithi057.stdout:2/405: dread d19/d3a/f46 [0,4194304] 0 2024-02-28T16:02:06.285 INFO:tasks.workunit.client.1.smithi087.stdout:3/896: truncate d11/d45/d73/f116 299051 0 2024-02-28T16:02:06.289 INFO:tasks.workunit.client.0.smithi057.stdout:0/568: read d6/d12/d45/d55/f54 [1465325,80100] 0 2024-02-28T16:02:06.290 INFO:tasks.workunit.client.1.smithi087.stdout:2/760: rename d2/d7/d17 to d2/d7/dc0/d111 0 2024-02-28T16:02:06.292 INFO:tasks.workunit.client.1.smithi087.stdout:5/874: dread d3/f59 [0,4194304] 0 2024-02-28T16:02:06.293 INFO:tasks.workunit.client.1.smithi087.stdout:9/787: unlink d7/dd/d3c/d4c/da1/cbc 0 2024-02-28T16:02:06.296 INFO:tasks.workunit.client.1.smithi087.stdout:2/761: unlink d2/d7/dc0/d111/d34/c45 0 2024-02-28T16:02:06.304 INFO:tasks.workunit.client.1.smithi087.stdout:5/875: creat d3/d9/d9b/dba/d30/d36/d4f/d82/f13e x:0 0 0 2024-02-28T16:02:06.306 INFO:tasks.workunit.client.1.smithi087.stdout:3/897: dread d11/d33/d58/f81 [0,4194304] 0 2024-02-28T16:02:06.306 INFO:tasks.workunit.client.1.smithi087.stdout:9/788: creat d7/dd/d15/d79/d56/fe7 x:0 0 0 2024-02-28T16:02:06.307 INFO:tasks.workunit.client.0.smithi057.stdout:1/442: dwrite d1/d21/d25/f3d [0,4194304] 0 2024-02-28T16:02:06.307 INFO:tasks.workunit.client.1.smithi087.stdout:2/762: symlink d2/d9a/d109/l112 0 2024-02-28T16:02:06.308 INFO:tasks.workunit.client.1.smithi087.stdout:2/763: stat d2/d7d/fcb 0 2024-02-28T16:02:06.309 INFO:tasks.workunit.client.1.smithi087.stdout:5/876: dread - d3/d64/d67/d7c/fbc zero size 2024-02-28T16:02:06.310 INFO:tasks.workunit.client.1.smithi087.stdout:3/898: fdatasync d11/d44/f57 0 2024-02-28T16:02:06.318 INFO:tasks.workunit.client.1.smithi087.stdout:3/899: creat d11/d61/d65/f135 x:0 0 0 2024-02-28T16:02:06.319 INFO:tasks.workunit.client.0.smithi057.stdout:1/443: chown d1/d21/d66/d44/d4c/f76 14988046 1 2024-02-28T16:02:06.322 INFO:tasks.workunit.client.0.smithi057.stdout:9/484: dwrite d2/d5e/d65/d87/f94 [0,4194304] 0 2024-02-28T16:02:06.324 INFO:tasks.workunit.client.0.smithi057.stdout:7/349: truncate d6/dc/d35/d58/f74 622718 0 2024-02-28T16:02:06.324 INFO:tasks.workunit.client.0.smithi057.stdout:5/421: dwrite d2/d12/d3d/f6e [0,4194304] 0 2024-02-28T16:02:06.330 INFO:tasks.workunit.client.1.smithi087.stdout:8/863: write d2/d18/d42/f43 [3325890,76791] 0 2024-02-28T16:02:06.330 INFO:tasks.workunit.client.0.smithi057.stdout:3/384: dwrite d8/dd/d14/d2e/d3b/d54/f5b [0,4194304] 0 2024-02-28T16:02:06.331 INFO:tasks.workunit.client.1.smithi087.stdout:0/773: dwrite d4/dd/d37/d39/f70 [0,4194304] 0 2024-02-28T16:02:06.332 INFO:tasks.workunit.client.1.smithi087.stdout:1/787: sync 2024-02-28T16:02:06.333 INFO:tasks.workunit.client.1.smithi087.stdout:4/884: dwrite d2/df/d62/fdb [0,4194304] 0 2024-02-28T16:02:06.337 INFO:tasks.workunit.client.1.smithi087.stdout:2/764: rmdir d2/d99/d28/d79/dfb 0 2024-02-28T16:02:06.341 INFO:tasks.workunit.client.0.smithi057.stdout:1/444: creat d1/d3/dc/d15/d4e/f98 x:0 0 0 2024-02-28T16:02:06.341 INFO:tasks.workunit.client.0.smithi057.stdout:5/422: truncate d2/d15/f43 1397444 0 2024-02-28T16:02:06.349 INFO:tasks.workunit.client.1.smithi087.stdout:8/864: mknod d2/d18/d42/d62/de8/df6/c11c 0 2024-02-28T16:02:06.350 INFO:tasks.workunit.client.1.smithi087.stdout:0/774: chown d4/d6/fe7 579 1 2024-02-28T16:02:06.353 INFO:tasks.workunit.client.1.smithi087.stdout:1/788: dread d0/d1b/d1f/d71/db2/d24/fb7 [0,4194304] 0 2024-02-28T16:02:06.355 INFO:tasks.workunit.client.0.smithi057.stdout:0/569: dwrite d6/d12/d17/d4b/f36 [0,4194304] 0 2024-02-28T16:02:06.357 INFO:tasks.workunit.client.1.smithi087.stdout:9/789: dwrite d7/d1e/d44/d83/fa0 [0,4194304] 0 2024-02-28T16:02:06.361 INFO:tasks.workunit.client.0.smithi057.stdout:5/423: write d2/d12/d3d/f6e [3800968,36917] 0 2024-02-28T16:02:06.362 INFO:tasks.workunit.client.1.smithi087.stdout:9/790: chown d7/dd/d36/l98 143 1 2024-02-28T16:02:06.362 INFO:tasks.workunit.client.1.smithi087.stdout:3/900: dwrite f10 [4194304,4194304] 0 2024-02-28T16:02:06.363 INFO:tasks.workunit.client.0.smithi057.stdout:2/406: dwrite d19/d34/f4b [0,4194304] 0 2024-02-28T16:02:06.364 INFO:tasks.workunit.client.1.smithi087.stdout:2/765: rename d2/d99/d28/d79/da3/lbe to d2/d99/d28/d79/l113 0 2024-02-28T16:02:06.365 INFO:tasks.workunit.client.1.smithi087.stdout:6/888: dread d4/d30/d13/f2a [4194304,4194304] 0 2024-02-28T16:02:06.365 INFO:tasks.workunit.client.1.smithi087.stdout:7/798: sync 2024-02-28T16:02:06.367 INFO:tasks.workunit.client.1.smithi087.stdout:3/901: fsync d11/f36 0 2024-02-28T16:02:06.367 INFO:tasks.workunit.client.1.smithi087.stdout:8/865: write d2/d63/d9b/dae/dca/f8c [2082730,83391] 0 2024-02-28T16:02:06.367 INFO:tasks.workunit.client.0.smithi057.stdout:0/570: write d6/f8 [364094,67682] 0 2024-02-28T16:02:06.371 INFO:tasks.workunit.client.1.smithi087.stdout:2/766: stat d2/d7/dc0/d111/d34/f53 0 2024-02-28T16:02:06.371 INFO:tasks.workunit.client.0.smithi057.stdout:9/485: dwrite d2/d5/d1b/f5b [0,4194304] 0 2024-02-28T16:02:06.373 INFO:tasks.workunit.client.1.smithi087.stdout:0/775: creat d4/d6/dc/d45/db4/f101 x:0 0 0 2024-02-28T16:02:06.374 INFO:tasks.workunit.client.0.smithi057.stdout:9/486: chown d2/d46 3 1 2024-02-28T16:02:06.376 INFO:tasks.workunit.client.1.smithi087.stdout:4/885: unlink d2/d9/d10/d22/d5b/d5c/d68/ce0 0 2024-02-28T16:02:06.377 INFO:tasks.workunit.client.0.smithi057.stdout:2/407: mknod d19/d2c/d7b/c80 0 2024-02-28T16:02:06.378 INFO:tasks.workunit.client.1.smithi087.stdout:5/877: write d3/f1c [1020363,15714] 0 2024-02-28T16:02:06.378 INFO:tasks.workunit.client.0.smithi057.stdout:5/424: mkdir d2/d12/d76/d7a/d95 0 2024-02-28T16:02:06.378 INFO:tasks.workunit.client.0.smithi057.stdout:0/571: truncate d6/d12/d17/d4b/f7d 569528 0 2024-02-28T16:02:06.383 INFO:tasks.workunit.client.0.smithi057.stdout:5/425: readlink d2/l5 0 2024-02-28T16:02:06.383 INFO:tasks.workunit.client.0.smithi057.stdout:0/572: dread - d6/fa6 zero size 2024-02-28T16:02:06.384 INFO:tasks.workunit.client.1.smithi087.stdout:8/866: truncate d2/d9/d5e/d9c/d9f/fb7 4200446 0 2024-02-28T16:02:06.385 INFO:tasks.workunit.client.1.smithi087.stdout:9/791: creat d7/dd/d15/d3f/d5f/d90/fe8 x:0 0 0 2024-02-28T16:02:06.386 INFO:tasks.workunit.client.1.smithi087.stdout:2/767: rmdir d2/d9a/dd3 39 2024-02-28T16:02:06.387 INFO:tasks.workunit.client.0.smithi057.stdout:9/487: mkdir d2/d5/d1b/d2e/d4c/da0 0 2024-02-28T16:02:06.387 INFO:tasks.workunit.client.1.smithi087.stdout:5/878: readlink d3/d9/d9b/dba/d30/d8f/l104 0 2024-02-28T16:02:06.387 INFO:tasks.workunit.client.1.smithi087.stdout:6/889: dread d4/d96/fcc [0,4194304] 0 2024-02-28T16:02:06.389 INFO:tasks.workunit.client.0.smithi057.stdout:0/573: symlink d6/d12/d5d/d7f/lc6 0 2024-02-28T16:02:06.389 INFO:tasks.workunit.client.1.smithi087.stdout:0/776: mknod d4/d6/ddb/c102 0 2024-02-28T16:02:06.392 INFO:tasks.workunit.client.0.smithi057.stdout:5/426: creat d2/d12/d76/d7b/f96 x:0 0 0 2024-02-28T16:02:06.392 INFO:tasks.workunit.client.0.smithi057.stdout:0/574: chown d6/fd 1988652353 1 2024-02-28T16:02:06.393 INFO:tasks.workunit.client.1.smithi087.stdout:2/768: chown d2/d99/d28/d54/da6/dd7/ffd 1828 1 2024-02-28T16:02:06.394 INFO:tasks.workunit.client.1.smithi087.stdout:3/902: rename d11/d7b/l117 to d11/d3a/dd1/l136 0 2024-02-28T16:02:06.394 INFO:tasks.workunit.client.1.smithi087.stdout:6/890: truncate d4/ff7 512782 0 2024-02-28T16:02:06.394 INFO:tasks.workunit.client.1.smithi087.stdout:5/879: dread - d3/d9/d9b/de9/d11c/f121 zero size 2024-02-28T16:02:06.396 INFO:tasks.workunit.client.0.smithi057.stdout:1/445: dread d1/f45 [0,4194304] 0 2024-02-28T16:02:06.399 INFO:tasks.workunit.client.1.smithi087.stdout:8/867: unlink d2/d9/d5e/f91 0 2024-02-28T16:02:06.400 INFO:tasks.workunit.client.0.smithi057.stdout:1/446: readlink d1/d21/d66/d53/d7d/l84 0 2024-02-28T16:02:06.403 INFO:tasks.workunit.client.1.smithi087.stdout:7/799: mknod d14/d2e/d2b/cfb 0 2024-02-28T16:02:06.412 INFO:tasks.workunit.client.0.smithi057.stdout:7/350: dread d6/dc/d12/d29/f3e [0,4194304] 0 2024-02-28T16:02:06.412 INFO:tasks.workunit.client.1.smithi087.stdout:6/891: creat d4/d30/d42/f11c x:0 0 0 2024-02-28T16:02:06.415 INFO:tasks.workunit.client.1.smithi087.stdout:5/880: unlink d3/d64/d67/fa4 0 2024-02-28T16:02:06.418 INFO:tasks.workunit.client.0.smithi057.stdout:7/351: mknod d6/d26/c7c 0 2024-02-28T16:02:06.419 INFO:tasks.workunit.client.1.smithi087.stdout:8/868: symlink d2/d18/df5/d104/da5/l11d 0 2024-02-28T16:02:06.419 INFO:tasks.workunit.client.0.smithi057.stdout:7/352: chown d6/d26/f50 394343178 1 2024-02-28T16:02:06.424 INFO:tasks.workunit.client.0.smithi057.stdout:9/488: dwrite d2/d5/d9/d57/d8b/f8d [0,4194304] 0 2024-02-28T16:02:06.425 INFO:tasks.workunit.client.1.smithi087.stdout:3/903: symlink d11/d61/d7c/db7/d132/l137 0 2024-02-28T16:02:06.427 INFO:tasks.workunit.client.0.smithi057.stdout:7/353: chown d6/fb 6879810 1 2024-02-28T16:02:06.427 INFO:tasks.workunit.client.1.smithi087.stdout:6/892: rmdir d4/d30/d42/de7 39 2024-02-28T16:02:06.429 INFO:tasks.workunit.client.0.smithi057.stdout:3/385: truncate d8/dd/d14/d2e/d2f/f42 913086 0 2024-02-28T16:02:06.429 INFO:tasks.workunit.client.1.smithi087.stdout:5/881: creat d3/d9/d9b/dba/d30/d8f/f13f x:0 0 0 2024-02-28T16:02:06.431 INFO:tasks.workunit.client.0.smithi057.stdout:9/489: truncate d2/d5e/d65/f9b 133278 0 2024-02-28T16:02:06.431 INFO:tasks.workunit.client.1.smithi087.stdout:8/869: creat d2/d18/d42/d7b/f11e x:0 0 0 2024-02-28T16:02:06.433 INFO:tasks.workunit.client.1.smithi087.stdout:3/904: creat d11/d61/d65/f138 x:0 0 0 2024-02-28T16:02:06.434 INFO:tasks.workunit.client.0.smithi057.stdout:2/408: truncate d19/d1d/d22/f6b 207394 0 2024-02-28T16:02:06.434 INFO:tasks.workunit.client.0.smithi057.stdout:9/490: stat d2/d5/d9/d64/d78 0 2024-02-28T16:02:06.436 INFO:tasks.workunit.client.1.smithi087.stdout:3/905: dread - d11/d61/d7c/db7/f10d zero size 2024-02-28T16:02:06.437 INFO:tasks.workunit.client.0.smithi057.stdout:0/575: truncate d6/d12/d38/f93 4766827 0 2024-02-28T16:02:06.441 INFO:tasks.workunit.client.0.smithi057.stdout:5/427: dread d2/d12/d76/d7b/f69 [0,4194304] 0 2024-02-28T16:02:06.441 INFO:tasks.workunit.client.0.smithi057.stdout:2/409: symlink d19/d43/d5a/d70/l81 0 2024-02-28T16:02:06.442 INFO:tasks.workunit.client.1.smithi087.stdout:6/893: fdatasync d4/dc/d10/f19 0 2024-02-28T16:02:06.444 INFO:tasks.workunit.client.1.smithi087.stdout:0/777: write d4/dd/d21/ff7 [2402482,116632] 0 2024-02-28T16:02:06.445 INFO:tasks.workunit.client.1.smithi087.stdout:2/769: write d2/d7/dc0/d111/d34/d88/fad [1468073,59524] 0 2024-02-28T16:02:06.446 INFO:tasks.workunit.client.0.smithi057.stdout:9/491: rename d2/d24/d1d/l26 to d2/la1 0 2024-02-28T16:02:06.447 INFO:tasks.workunit.client.1.smithi087.stdout:1/789: dwrite d0/d1b/d1f/f77 [8388608,4194304] 0 2024-02-28T16:02:06.453 INFO:tasks.workunit.client.0.smithi057.stdout:5/428: rename d2/d12/d3d/f6e to d2/d12/d3d/f97 0 2024-02-28T16:02:06.454 INFO:tasks.workunit.client.0.smithi057.stdout:0/576: link d6/d12/d17/d34/l44 d6/d12/d5d/d7f/lc7 0 2024-02-28T16:02:06.456 INFO:tasks.workunit.client.0.smithi057.stdout:9/492: read d2/d5/d9/f36 [17333,12435] 0 2024-02-28T16:02:06.458 INFO:tasks.workunit.client.1.smithi087.stdout:0/778: chown d4/d6/dc/d45/db4 1262472 1 2024-02-28T16:02:06.458 INFO:tasks.workunit.client.1.smithi087.stdout:9/792: write d7/dd/d3c/d4c/f8c [5542857,63694] 0 2024-02-28T16:02:06.458 INFO:tasks.workunit.client.0.smithi057.stdout:1/447: dwrite d1/d3/dc/f56 [0,4194304] 0 2024-02-28T16:02:06.459 INFO:tasks.workunit.client.0.smithi057.stdout:5/429: mknod d2/d12/d76/c98 0 2024-02-28T16:02:06.459 INFO:tasks.workunit.client.1.smithi087.stdout:4/886: dwrite d2/d9/d10/f6c [0,4194304] 0 2024-02-28T16:02:06.466 INFO:tasks.workunit.client.1.smithi087.stdout:3/906: dwrite d11/d61/d7c/db7/f10c [0,4194304] 0 2024-02-28T16:02:06.467 INFO:tasks.workunit.client.1.smithi087.stdout:0/779: symlink d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/l103 0 2024-02-28T16:02:06.468 INFO:tasks.workunit.client.1.smithi087.stdout:9/793: unlink d7/f8 0 2024-02-28T16:02:06.469 INFO:tasks.workunit.client.0.smithi057.stdout:1/448: readlink d1/d21/d66/d53/d7d/l84 0 2024-02-28T16:02:06.470 INFO:tasks.workunit.client.1.smithi087.stdout:4/887: write d2/d9/da/f36 [855185,125150] 0 2024-02-28T16:02:06.478 INFO:tasks.workunit.client.0.smithi057.stdout:9/493: mknod d2/ca2 0 2024-02-28T16:02:06.478 INFO:tasks.workunit.client.0.smithi057.stdout:3/386: dwrite d8/dd/d14/f1b [0,4194304] 0 2024-02-28T16:02:06.478 INFO:tasks.workunit.client.0.smithi057.stdout:5/430: write d2/d12/d3d/f97 [2553561,8283] 0 2024-02-28T16:02:06.479 INFO:tasks.workunit.client.1.smithi087.stdout:7/800: dwrite d14/d2e/d89/deb/d5d/f5e [0,4194304] 0 2024-02-28T16:02:06.479 INFO:tasks.workunit.client.0.smithi057.stdout:2/410: dread d19/d1d/d2e/d31/f40 [0,4194304] 0 2024-02-28T16:02:06.480 INFO:tasks.workunit.client.0.smithi057.stdout:9/494: mknod d2/d5/d1b/d2e/d4c/ca3 0 2024-02-28T16:02:06.487 INFO:tasks.workunit.client.0.smithi057.stdout:2/411: mknod d19/d1d/c82 0 2024-02-28T16:02:06.489 INFO:tasks.workunit.client.1.smithi087.stdout:8/870: dwrite d2/d9/d5e/fd0 [0,4194304] 0 2024-02-28T16:02:06.496 INFO:tasks.workunit.client.0.smithi057.stdout:1/449: rmdir d1/d21/d66/d53/d7d/d67/d6c/d82/d8f 0 2024-02-28T16:02:06.497 INFO:tasks.workunit.client.1.smithi087.stdout:4/888: rename d2/df/d62/c55 to d2/df/d65/c11d 0 2024-02-28T16:02:06.500 INFO:tasks.workunit.client.0.smithi057.stdout:1/450: write d1/d21/d66/d53/d7d/d67/f93 [558451,61150] 0 2024-02-28T16:02:06.502 INFO:tasks.workunit.client.1.smithi087.stdout:6/894: link d4/l25 d4/d12/d45/d92/dc1/dc7/l11d 0 2024-02-28T16:02:06.504 INFO:tasks.workunit.client.0.smithi057.stdout:2/412: creat d19/d2c/d48/f83 x:0 0 0 2024-02-28T16:02:06.509 INFO:tasks.workunit.client.1.smithi087.stdout:5/882: dwrite d3/d9/d4a/fd5 [0,4194304] 0 2024-02-28T16:02:06.510 INFO:tasks.workunit.client.0.smithi057.stdout:2/413: mknod d19/d1d/d2e/c84 0 2024-02-28T16:02:06.514 INFO:tasks.workunit.client.1.smithi087.stdout:8/871: symlink d2/d18/df5/d104/da5/l11f 0 2024-02-28T16:02:06.515 INFO:tasks.workunit.client.1.smithi087.stdout:0/780: dwrite d4/d6/d9c/fa7 [0,4194304] 0 2024-02-28T16:02:06.522 INFO:tasks.workunit.client.0.smithi057.stdout:2/414: symlink d19/d34/d78/l85 0 2024-02-28T16:02:06.523 INFO:tasks.workunit.client.1.smithi087.stdout:2/770: dwrite d2/fc [0,4194304] 0 2024-02-28T16:02:06.523 INFO:tasks.workunit.client.1.smithi087.stdout:8/872: fsync d2/d9/d10/da0/f105 0 2024-02-28T16:02:06.523 INFO:tasks.workunit.client.1.smithi087.stdout:4/889: truncate d2/f8 507298 0 2024-02-28T16:02:06.525 INFO:tasks.workunit.client.1.smithi087.stdout:0/781: chown d4/d6/ddb/c102 854144595 1 2024-02-28T16:02:06.525 INFO:tasks.workunit.client.1.smithi087.stdout:9/794: dwrite d7/dd/d15/d3f/d6d/dc2/fe6 [0,4194304] 0 2024-02-28T16:02:06.529 INFO:tasks.workunit.client.1.smithi087.stdout:4/890: fdatasync d2/d9/da/d1a/d26/f35 0 2024-02-28T16:02:06.530 INFO:tasks.workunit.client.1.smithi087.stdout:6/895: rename d4/d30/d13/d38/c8b to d4/d12/d45/d92/c11e 0 2024-02-28T16:02:06.535 INFO:tasks.workunit.client.1.smithi087.stdout:2/771: fdatasync d2/d7/dc0/d111/d3d/fb8 0 2024-02-28T16:02:06.537 INFO:tasks.workunit.client.0.smithi057.stdout:0/577: dread d6/f8 [0,4194304] 0 2024-02-28T16:02:06.538 INFO:tasks.workunit.client.1.smithi087.stdout:9/795: dread d7/dd/d15/f1f [0,4194304] 0 2024-02-28T16:02:06.538 INFO:tasks.workunit.client.1.smithi087.stdout:7/801: dwrite d14/d2e/dab/fec [0,4194304] 0 2024-02-28T16:02:06.542 INFO:tasks.workunit.client.0.smithi057.stdout:0/578: fsync d6/d12/d45/d55/f54 0 2024-02-28T16:02:06.545 INFO:tasks.workunit.client.1.smithi087.stdout:8/873: fsync d2/d18/df5/d104/da5/faa 0 2024-02-28T16:02:06.545 INFO:tasks.workunit.client.0.smithi057.stdout:3/387: dread d8/dd/d14/d2e/d2f/f45 [0,4194304] 0 2024-02-28T16:02:06.548 INFO:tasks.workunit.client.1.smithi087.stdout:4/891: readlink d2/d9/l57 0 2024-02-28T16:02:06.548 INFO:tasks.workunit.client.1.smithi087.stdout:9/796: fdatasync d7/d1e/d60/fa4 0 2024-02-28T16:02:06.549 INFO:tasks.workunit.client.1.smithi087.stdout:6/896: write d4/d12/d45/d92/dc1/de9/f10e [4497354,13247] 0 2024-02-28T16:02:06.551 INFO:tasks.workunit.client.1.smithi087.stdout:7/802: mknod d14/d2e/d2b/d4e/cfc 0 2024-02-28T16:02:06.553 INFO:tasks.workunit.client.1.smithi087.stdout:9/797: readlink d7/dd/d15/d3f/ld6 0 2024-02-28T16:02:06.554 INFO:tasks.workunit.client.1.smithi087.stdout:9/798: chown d7/dd/d3c/d4c 841504553 1 2024-02-28T16:02:06.556 INFO:tasks.workunit.client.0.smithi057.stdout:0/579: link d6/d12/d5d/d71/cc1 d6/d12/d45/d78/cc8 0 2024-02-28T16:02:06.557 INFO:tasks.workunit.client.0.smithi057.stdout:3/388: link d8/dd/d14/d2e/l75 d8/dd/d14/d2e/l78 0 2024-02-28T16:02:06.559 INFO:tasks.workunit.client.0.smithi057.stdout:0/580: read - d6/d12/d45/dab/fb9 zero size 2024-02-28T16:02:06.559 INFO:tasks.workunit.client.0.smithi057.stdout:9/495: dread d2/d5/d1b/f34 [0,4194304] 0 2024-02-28T16:02:06.559 INFO:tasks.workunit.client.1.smithi087.stdout:6/897: unlink d4/dc/f8e 0 2024-02-28T16:02:06.562 INFO:tasks.workunit.client.0.smithi057.stdout:0/581: truncate d6/d12/d5d/fc0 440234 0 2024-02-28T16:02:06.562 INFO:tasks.workunit.client.1.smithi087.stdout:2/772: dwrite d2/d7/dc0/d111/d34/f4a [0,4194304] 0 2024-02-28T16:02:06.567 INFO:tasks.workunit.client.1.smithi087.stdout:7/803: link d14/d2e/d89/deb/d5d/f5e d14/d21/d4f/ffd 0 2024-02-28T16:02:06.569 INFO:tasks.workunit.client.1.smithi087.stdout:6/898: unlink d4/d12/d45/d5e/lce 0 2024-02-28T16:02:06.569 INFO:tasks.workunit.client.1.smithi087.stdout:7/804: write d14/d21/de4/fe5 [598486,23770] 0 2024-02-28T16:02:06.570 INFO:tasks.workunit.client.0.smithi057.stdout:5/431: dread d2/f10 [0,4194304] 0 2024-02-28T16:02:06.573 INFO:tasks.workunit.client.0.smithi057.stdout:9/496: creat d2/d46/d67/d7d/fa4 x:0 0 0 2024-02-28T16:02:06.575 INFO:tasks.workunit.client.0.smithi057.stdout:5/432: creat d2/d15/f99 x:0 0 0 2024-02-28T16:02:06.575 INFO:tasks.workunit.client.1.smithi087.stdout:7/805: truncate d14/d2e/d2b/d4e/fb1 454250 0 2024-02-28T16:02:06.579 INFO:tasks.workunit.client.1.smithi087.stdout:4/892: creat d2/d9/d10/d22/d5b/d5c/d91/f11e x:0 0 0 2024-02-28T16:02:06.580 INFO:tasks.workunit.client.0.smithi057.stdout:9/497: creat d2/d92/fa5 x:0 0 0 2024-02-28T16:02:06.581 INFO:tasks.workunit.client.1.smithi087.stdout:2/773: symlink d2/d7d/l114 0 2024-02-28T16:02:06.582 INFO:tasks.workunit.client.0.smithi057.stdout:3/389: dwrite d8/d4b/f60 [0,4194304] 0 2024-02-28T16:02:06.585 INFO:tasks.workunit.client.0.smithi057.stdout:3/390: stat d8/dd/d14/d2e/d30/d5f/d6b 0 2024-02-28T16:02:06.588 INFO:tasks.workunit.client.1.smithi087.stdout:7/806: mkdir d14/d2e/d89/deb/d5d/d6a/d83/df5/dfe 0 2024-02-28T16:02:06.588 INFO:tasks.workunit.client.1.smithi087.stdout:9/799: creat d7/dd/d99/fe9 x:0 0 0 2024-02-28T16:02:06.588 INFO:tasks.workunit.client.0.smithi057.stdout:3/391: creat d8/dd/d14/d2e/d30/d49/d51/d66/f79 x:0 0 0 2024-02-28T16:02:06.590 INFO:tasks.workunit.client.0.smithi057.stdout:3/392: fdatasync d8/dd/f1f 0 2024-02-28T16:02:06.599 INFO:tasks.workunit.client.1.smithi087.stdout:0/782: rename d4/dd/lae to d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/l104 0 2024-02-28T16:02:06.604 INFO:tasks.workunit.client.0.smithi057.stdout:3/393: rename d8/dd/d14/f1b to d8/dd/d19/d25/f7a 0 2024-02-28T16:02:06.605 INFO:tasks.workunit.client.1.smithi087.stdout:7/807: mkdir d14/d30/dd1/df8/dff 0 2024-02-28T16:02:06.606 INFO:tasks.workunit.client.1.smithi087.stdout:2/774: creat d2/d7/dc0/d111/f115 x:0 0 0 2024-02-28T16:02:06.607 INFO:tasks.workunit.client.1.smithi087.stdout:0/783: mkdir d4/dd/d21/d32/d105 0 2024-02-28T16:02:06.607 INFO:tasks.workunit.client.0.smithi057.stdout:2/415: rmdir d19/d2c 39 2024-02-28T16:02:06.607 INFO:tasks.workunit.client.0.smithi057.stdout:1/451: dread d1/f8 [0,4194304] 0 2024-02-28T16:02:06.608 INFO:tasks.workunit.client.1.smithi087.stdout:0/784: chown d4/dd/d21/c66 150 1 2024-02-28T16:02:06.608 INFO:tasks.workunit.client.0.smithi057.stdout:1/452: fdatasync d1/d21/f63 0 2024-02-28T16:02:06.610 INFO:tasks.workunit.client.0.smithi057.stdout:2/416: mkdir d19/d1d/d26/d86 0 2024-02-28T16:02:06.610 INFO:tasks.workunit.client.1.smithi087.stdout:2/775: fsync d2/d7/dc0/d111/d34/f98 0 2024-02-28T16:02:06.611 INFO:tasks.workunit.client.1.smithi087.stdout:7/808: link d14/d2e/d89/deb/d55/cd6 d14/d21/d4f/c100 0 2024-02-28T16:02:06.614 INFO:tasks.workunit.client.1.smithi087.stdout:2/776: symlink d2/d99/d28/l116 0 2024-02-28T16:02:06.616 INFO:tasks.workunit.client.0.smithi057.stdout:3/394: link d8/dd/d14/d2e/c3d d8/dd/d14/d2e/d2f/c7b 0 2024-02-28T16:02:06.616 INFO:tasks.workunit.client.1.smithi087.stdout:0/785: unlink d4/dd/d37/d39/d3a/d57/d74/d1f/d60/f8b 0 2024-02-28T16:02:06.618 INFO:tasks.workunit.client.0.smithi057.stdout:2/417: truncate d19/d2c/f30 2864302 0 2024-02-28T16:02:06.620 INFO:tasks.workunit.client.0.smithi057.stdout:3/395: mknod d8/dd/d14/d2e/d30/d5f/c7c 0 2024-02-28T16:02:06.623 INFO:tasks.workunit.client.0.smithi057.stdout:2/418: mknod d19/d43/c87 0 2024-02-28T16:02:06.623 INFO:tasks.workunit.client.0.smithi057.stdout:0/582: write d6/d12/d38/f5c [1176680,78273] 0 2024-02-28T16:02:06.624 INFO:tasks.workunit.client.1.smithi087.stdout:7/809: truncate d14/d2e/d89/deb/d5d/d6a/d83/f8a 5003051 0 2024-02-28T16:02:06.624 INFO:tasks.workunit.client.0.smithi057.stdout:9/498: write d2/d5e/d65/f73 [616243,90372] 0 2024-02-28T16:02:06.625 INFO:tasks.workunit.client.0.smithi057.stdout:0/583: mknod d6/d4e/cc9 0 2024-02-28T16:02:06.625 INFO:tasks.workunit.client.1.smithi087.stdout:2/777: symlink d2/d7d/l117 0 2024-02-28T16:02:06.626 INFO:tasks.workunit.client.0.smithi057.stdout:3/396: dread d8/f15 [0,4194304] 0 2024-02-28T16:02:06.626 INFO:tasks.workunit.client.1.smithi087.stdout:7/810: chown d14/d2e/d2b/d57 1016351 1 2024-02-28T16:02:06.627 INFO:tasks.workunit.client.0.smithi057.stdout:1/453: dread d1/d3/dc/ff [0,4194304] 0 2024-02-28T16:02:06.627 INFO:tasks.workunit.client.0.smithi057.stdout:2/419: symlink d19/d1d/d26/l88 0 2024-02-28T16:02:06.627 INFO:tasks.workunit.client.1.smithi087.stdout:0/786: truncate d4/d6/dc/d45/fc2 998945 0 2024-02-28T16:02:06.628 INFO:tasks.workunit.client.0.smithi057.stdout:3/397: chown d8/dd/l10 30272899 1 2024-02-28T16:02:06.630 INFO:tasks.workunit.client.1.smithi087.stdout:7/811: chown d14/d2e/f87 922176 1 2024-02-28T16:02:06.633 INFO:tasks.workunit.client.1.smithi087.stdout:2/778: write d2/d99/d28/fe5 [724564,64831] 0 2024-02-28T16:02:06.634 INFO:tasks.workunit.client.0.smithi057.stdout:2/420: write d19/f29 [2922310,91651] 0 2024-02-28T16:02:06.634 INFO:tasks.workunit.client.1.smithi087.stdout:3/907: dwrite d11/f31 [0,4194304] 0 2024-02-28T16:02:06.637 INFO:tasks.workunit.client.0.smithi057.stdout:3/398: creat d8/dd/d19/f7d x:0 0 0 2024-02-28T16:02:06.637 INFO:tasks.workunit.client.0.smithi057.stdout:2/421: dread - d19/d34/f53 zero size 2024-02-28T16:02:06.639 INFO:tasks.workunit.client.0.smithi057.stdout:9/499: fdatasync d2/d5/f8 0 2024-02-28T16:02:06.639 INFO:tasks.workunit.client.1.smithi087.stdout:7/812: read - d14/d2e/d89/dbb/fc6 zero size 2024-02-28T16:02:06.639 INFO:tasks.workunit.client.1.smithi087.stdout:5/883: dread d3/d9/d9b/dba/f20 [0,4194304] 0 2024-02-28T16:02:06.640 INFO:tasks.workunit.client.0.smithi057.stdout:3/399: chown f3 41256759 1 2024-02-28T16:02:06.641 INFO:tasks.workunit.client.1.smithi087.stdout:0/787: chown d4/dd/d37/d39/d3a/d57/d74/d1f/c4e 164265 1 2024-02-28T16:02:06.642 INFO:tasks.workunit.client.0.smithi057.stdout:2/422: mkdir d19/d1d/d89 0 2024-02-28T16:02:06.644 INFO:tasks.workunit.client.0.smithi057.stdout:9/500: write d2/d5/f37 [770755,10013] 0 2024-02-28T16:02:06.646 INFO:tasks.workunit.client.1.smithi087.stdout:7/813: unlink d14/d2e/c1a 0 2024-02-28T16:02:06.647 INFO:tasks.workunit.client.1.smithi087.stdout:5/884: chown d3/d9/d9b/dba/d30/d36/d112/d12d/da1 209242 1 2024-02-28T16:02:06.648 INFO:tasks.workunit.client.0.smithi057.stdout:3/400: creat d8/d26/f7e x:0 0 0 2024-02-28T16:02:06.651 INFO:tasks.workunit.client.0.smithi057.stdout:2/423: mknod d19/d1d/c8a 0 2024-02-28T16:02:06.651 INFO:tasks.workunit.client.0.smithi057.stdout:0/584: dwrite d6/f19 [4194304,4194304] 0 2024-02-28T16:02:06.651 INFO:tasks.workunit.client.1.smithi087.stdout:3/908: symlink d11/d3a/dd1/l139 0 2024-02-28T16:02:06.651 INFO:tasks.workunit.client.0.smithi057.stdout:9/501: dread - d2/d5/d1b/d2e/d77/f8e zero size 2024-02-28T16:02:06.652 INFO:tasks.workunit.client.0.smithi057.stdout:3/401: chown d8/c32 417 1 2024-02-28T16:02:06.657 INFO:tasks.workunit.client.0.smithi057.stdout:0/585: chown d6/d12/d17/d4b/l21 5182721 1 2024-02-28T16:02:06.659 INFO:tasks.workunit.client.1.smithi087.stdout:6/899: write d4/d12/d45/f77 [428027,76114] 0 2024-02-28T16:02:06.660 INFO:tasks.workunit.client.1.smithi087.stdout:5/885: truncate d3/d9/df6/f10b 4584251 0 2024-02-28T16:02:06.663 INFO:tasks.workunit.client.0.smithi057.stdout:2/424: rmdir d19/d1d/d2e/d31 39 2024-02-28T16:02:06.667 INFO:tasks.workunit.client.1.smithi087.stdout:7/814: rename d14/d2e/d2b/f2c to d14/d2e/d89/deb/d5d/d6a/f101 0 2024-02-28T16:02:06.668 INFO:tasks.workunit.client.0.smithi057.stdout:2/425: chown d19/d1d/c77 877790 1 2024-02-28T16:02:06.668 INFO:tasks.workunit.client.0.smithi057.stdout:9/502: unlink d2/d5/d1b/d2e/d44/f48 0 2024-02-28T16:02:06.670 INFO:tasks.workunit.client.1.smithi087.stdout:5/886: write d3/d9/d9b/dba/d30/d36/d4f/d82/ff4 [597862,51955] 0 2024-02-28T16:02:06.670 INFO:tasks.workunit.client.1.smithi087.stdout:3/909: creat d11/d61/d7c/db7/dea/deb/f13a x:0 0 0 2024-02-28T16:02:06.671 INFO:tasks.workunit.client.1.smithi087.stdout:6/900: mknod d4/d30/d13/d38/dc3/c11f 0 2024-02-28T16:02:06.671 INFO:tasks.workunit.client.0.smithi057.stdout:2/426: creat d19/d1d/d26/d86/f8b x:0 0 0 2024-02-28T16:02:06.673 INFO:tasks.workunit.client.1.smithi087.stdout:6/901: fsync d4/d30/d13/d67/daf/f112 0 2024-02-28T16:02:06.675 INFO:tasks.workunit.client.0.smithi057.stdout:2/427: write d19/d1d/d2e/f6c [227816,42541] 0 2024-02-28T16:02:06.676 INFO:tasks.workunit.client.1.smithi087.stdout:4/893: truncate d2/d9/d10/f6c 2736358 0 2024-02-28T16:02:06.677 INFO:tasks.workunit.client.1.smithi087.stdout:6/902: chown d4/d30/d13/d38/d69/fad 12506501 1 2024-02-28T16:02:06.679 INFO:tasks.workunit.client.0.smithi057.stdout:1/454: dwrite d1/f45 [0,4194304] 0 2024-02-28T16:02:06.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:06 smithi057 ceph-mon[28763]: pgmap v35: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 195 MiB/s wr, 386 op/s 2024-02-28T16:02:06.682 INFO:tasks.workunit.client.0.smithi057.stdout:2/428: rename d19/d2c/d48/c7a to d19/d1d/d2e/d3c/c8c 0 2024-02-28T16:02:06.684 INFO:tasks.workunit.client.1.smithi087.stdout:5/887: creat d3/d9/d9b/dba/dca/f140 x:0 0 0 2024-02-28T16:02:06.685 INFO:tasks.workunit.client.0.smithi057.stdout:0/586: write d6/d12/d17/d34/f40 [833321,70346] 0 2024-02-28T16:02:06.686 INFO:tasks.workunit.client.1.smithi087.stdout:3/910: chown d11/d33/d67/d98/fa7 0 1 2024-02-28T16:02:06.691 INFO:tasks.workunit.client.0.smithi057.stdout:2/429: chown d19/d43/d5a/l71 393 1 2024-02-28T16:02:06.692 INFO:tasks.workunit.client.0.smithi057.stdout:1/455: unlink d1/d3/dc/c35 0 2024-02-28T16:02:06.696 INFO:tasks.workunit.client.0.smithi057.stdout:1/456: chown d1/d21/f52 142457145 1 2024-02-28T16:02:06.697 INFO:tasks.workunit.client.0.smithi057.stdout:9/503: dwrite d2/d24/d1d/f7b [0,4194304] 0 2024-02-28T16:02:06.698 INFO:tasks.workunit.client.1.smithi087.stdout:0/788: rename d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f8f to d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/f106 0 2024-02-28T16:02:06.698 INFO:tasks.workunit.client.1.smithi087.stdout:5/888: rename d3/d9/d9b/dba to d3/d9/d9b/dba/d30/d36/d112/d12d/da1/d141 22 2024-02-28T16:02:06.701 INFO:tasks.workunit.client.0.smithi057.stdout:3/402: dwrite d8/dd/d14/d2c/f33 [0,4194304] 0 2024-02-28T16:02:06.701 INFO:tasks.workunit.client.1.smithi087.stdout:0/789: chown d4/dd/d26/d93/fd7 861581445 1 2024-02-28T16:02:06.702 INFO:tasks.workunit.client.0.smithi057.stdout:2/430: creat d19/d2c/d65/f8d x:0 0 0 2024-02-28T16:02:06.702 INFO:tasks.workunit.client.0.smithi057.stdout:0/587: symlink d6/d12/d17/d4b/d60/lca 0 2024-02-28T16:02:06.703 INFO:tasks.workunit.client.1.smithi087.stdout:3/911: dread d11/d45/f8e [0,4194304] 0 2024-02-28T16:02:06.704 INFO:tasks.workunit.client.1.smithi087.stdout:0/790: chown d4/dd/d21/d5f/lfb 3391006 1 2024-02-28T16:02:06.705 INFO:tasks.workunit.client.0.smithi057.stdout:3/403: stat d8/dd/d14/d2e/d30/f40 0 2024-02-28T16:02:06.706 INFO:tasks.workunit.client.1.smithi087.stdout:5/889: symlink d3/d9/d9b/dba/d30/d36/d112/d12d/da1/l142 0 2024-02-28T16:02:06.706 INFO:tasks.workunit.client.0.smithi057.stdout:0/588: dread - d6/d12/d45/dab/fb9 zero size 2024-02-28T16:02:06.706 INFO:tasks.workunit.client.1.smithi087.stdout:2/779: dwrite d2/d99/d28/f43 [0,4194304] 0 2024-02-28T16:02:06.709 INFO:tasks.workunit.client.1.smithi087.stdout:0/791: dread - d4/dd/d37/d39/d3a/d57/d74/ff5 zero size 2024-02-28T16:02:06.709 INFO:tasks.workunit.client.1.smithi087.stdout:1/790: sync 2024-02-28T16:02:06.712 INFO:tasks.workunit.client.0.smithi057.stdout:1/457: mknod d1/d3/dc/d15/d4e/d5f/c99 0 2024-02-28T16:02:06.714 INFO:tasks.workunit.client.0.smithi057.stdout:1/458: read d1/d21/d25/f3d [1938256,56003] 0 2024-02-28T16:02:06.715 INFO:tasks.workunit.client.0.smithi057.stdout:3/404: mkdir d8/dd/d14/d2e/d30/d49/d51/d66/d7f 0 2024-02-28T16:02:06.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:06 smithi087 ceph-mon[37122]: pgmap v35: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 195 MiB/s wr, 386 op/s 2024-02-28T16:02:06.717 INFO:tasks.workunit.client.1.smithi087.stdout:0/792: creat d4/dd/d21/d5f/f107 x:0 0 0 2024-02-28T16:02:06.718 INFO:tasks.workunit.client.0.smithi057.stdout:0/589: creat d6/d12/d5d/d71/daa/fcb x:0 0 0 2024-02-28T16:02:06.719 INFO:tasks.workunit.client.0.smithi057.stdout:3/405: fsync d8/d26/f7e 0 2024-02-28T16:02:06.720 INFO:tasks.workunit.client.1.smithi087.stdout:1/791: mknod d0/d1b/d1f/d71/db2/dae/dcd/c108 0 2024-02-28T16:02:06.720 INFO:tasks.workunit.client.1.smithi087.stdout:4/894: dread d2/f4 [0,4194304] 0 2024-02-28T16:02:06.721 INFO:tasks.workunit.client.0.smithi057.stdout:1/459: stat d1/d21/d66/d44/c4d 0 2024-02-28T16:02:06.721 INFO:tasks.workunit.client.0.smithi057.stdout:0/590: read - d6/fa6 zero size 2024-02-28T16:02:06.723 INFO:tasks.workunit.client.1.smithi087.stdout:0/793: dread - d4/d6/d9c/fb5 zero size 2024-02-28T16:02:06.723 INFO:tasks.workunit.client.1.smithi087.stdout:2/780: dread d2/d99/d28/d79/f96 [0,4194304] 0 2024-02-28T16:02:06.724 INFO:tasks.workunit.client.0.smithi057.stdout:4/430: sync 2024-02-28T16:02:06.725 INFO:tasks.workunit.client.1.smithi087.stdout:0/794: readlink d4/dd/d21/l6b 0 2024-02-28T16:02:06.726 INFO:tasks.workunit.client.0.smithi057.stdout:4/431: chown d1/d10 20 1 2024-02-28T16:02:06.728 INFO:tasks.workunit.client.1.smithi087.stdout:9/800: truncate d7/dd/d36/f4f 7261091 0 2024-02-28T16:02:06.731 INFO:tasks.workunit.client.0.smithi057.stdout:2/431: dwrite d19/d2c/d48/f7d [0,4194304] 0 2024-02-28T16:02:06.732 INFO:tasks.workunit.client.0.smithi057.stdout:1/460: symlink d1/d21/d66/d53/d7d/d67/d6c/l9a 0 2024-02-28T16:02:06.732 INFO:tasks.workunit.client.0.smithi057.stdout:9/504: dwrite d2/d5e/d65/d87/f9e [0,4194304] 0 2024-02-28T16:02:06.739 INFO:tasks.workunit.client.0.smithi057.stdout:2/432: write d19/d1d/d2e/f6c [3071641,69291] 0 2024-02-28T16:02:06.740 INFO:tasks.workunit.client.0.smithi057.stdout:9/505: write d2/d5/d9/d5d/d70/f84 [3745455,104226] 0 2024-02-28T16:02:06.742 INFO:tasks.workunit.client.0.smithi057.stdout:2/433: write d19/d2c/d48/f83 [986182,84722] 0 2024-02-28T16:02:06.743 INFO:tasks.workunit.client.0.smithi057.stdout:2/434: fsync d19/d2c/f4f 0 2024-02-28T16:02:06.746 INFO:tasks.workunit.client.0.smithi057.stdout:9/506: creat d2/d24/d1d/fa6 x:0 0 0 2024-02-28T16:02:06.750 INFO:tasks.workunit.client.0.smithi057.stdout:0/591: dread d6/d12/d45/d78/f90 [0,4194304] 0 2024-02-28T16:02:06.750 INFO:tasks.workunit.client.1.smithi087.stdout:4/895: rmdir d2/df/d2e/dad/df6 0 2024-02-28T16:02:06.751 INFO:tasks.workunit.client.0.smithi057.stdout:9/507: fdatasync d2/d24/ff 0 2024-02-28T16:02:06.752 INFO:tasks.workunit.client.0.smithi057.stdout:3/406: write d8/dd/d14/d2e/d30/f3f [678216,108194] 0 2024-02-28T16:02:06.754 INFO:tasks.workunit.client.0.smithi057.stdout:0/592: fsync d6/fa6 0 2024-02-28T16:02:06.755 INFO:tasks.workunit.client.1.smithi087.stdout:9/801: dread d7/dd/d3c/d4c/da1/f7b [0,4194304] 0 2024-02-28T16:02:06.758 INFO:tasks.workunit.client.0.smithi057.stdout:2/435: creat d19/d1d/d89/f8e x:0 0 0 2024-02-28T16:02:06.763 INFO:tasks.workunit.client.0.smithi057.stdout:4/432: dwrite d1/d10/d12/d2c/d37/d46/f6a [4194304,4194304] 0 2024-02-28T16:02:06.765 INFO:tasks.workunit.client.0.smithi057.stdout:9/508: read d2/d5/f1a [2615347,16303] 0 2024-02-28T16:02:06.767 INFO:tasks.workunit.client.0.smithi057.stdout:3/407: fdatasync d8/dd/d14/d2e/d2f/f45 0 2024-02-28T16:02:06.767 INFO:tasks.workunit.client.1.smithi087.stdout:1/792: write d0/d1b/d1f/d71/db2/d24/fb7 [685995,79990] 0 2024-02-28T16:02:06.768 INFO:tasks.workunit.client.1.smithi087.stdout:0/795: write d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/f106 [616699,129878] 0 2024-02-28T16:02:06.770 INFO:tasks.workunit.client.0.smithi057.stdout:3/408: chown d8/dd/d14/d2e/d30 16 1 2024-02-28T16:02:06.772 INFO:tasks.workunit.client.0.smithi057.stdout:4/433: mkdir d1/d10/d12/d2c/d50/d93 0 2024-02-28T16:02:06.777 INFO:tasks.workunit.client.0.smithi057.stdout:3/409: readlink d8/dd/d14/d2e/l78 0 2024-02-28T16:02:06.777 INFO:tasks.workunit.client.1.smithi087.stdout:0/796: truncate d4/f8 354290 0 2024-02-28T16:02:06.778 INFO:tasks.workunit.client.1.smithi087.stdout:1/793: creat d0/d1b/d1f/d96/dd8/f109 x:0 0 0 2024-02-28T16:02:06.779 INFO:tasks.workunit.client.0.smithi057.stdout:4/434: chown d1/d10/d12/d39 0 1 2024-02-28T16:02:06.779 INFO:tasks.workunit.client.0.smithi057.stdout:2/436: link d19/d1d/d22/l5e d19/d2c/d48/l8f 0 2024-02-28T16:02:06.780 INFO:tasks.workunit.client.1.smithi087.stdout:2/781: dwrite d2/d99/d28/d79/f90 [0,4194304] 0 2024-02-28T16:02:06.782 INFO:tasks.workunit.client.0.smithi057.stdout:1/461: dread d1/d21/f5b [0,4194304] 0 2024-02-28T16:02:06.782 INFO:tasks.workunit.client.1.smithi087.stdout:1/794: chown d0/d14/f54 440535 1 2024-02-28T16:02:06.783 INFO:tasks.workunit.client.1.smithi087.stdout:1/795: chown d0 1373951318 1 2024-02-28T16:02:06.783 INFO:tasks.workunit.client.1.smithi087.stdout:2/782: readlink d2/d99/d28/l80 0 2024-02-28T16:02:06.784 INFO:tasks.workunit.client.1.smithi087.stdout:1/796: dread - d0/f90 zero size 2024-02-28T16:02:06.784 INFO:tasks.workunit.client.1.smithi087.stdout:9/802: dread d7/d1e/d44/fc1 [0,4194304] 0 2024-02-28T16:02:06.786 INFO:tasks.workunit.client.1.smithi087.stdout:1/797: chown d0/d1b/d1f/d96/d63 818026 1 2024-02-28T16:02:06.787 INFO:tasks.workunit.client.1.smithi087.stdout:1/798: chown d0/fa2 17 1 2024-02-28T16:02:06.789 INFO:tasks.workunit.client.1.smithi087.stdout:9/803: mknod d7/d1e/d60/d69/cea 0 2024-02-28T16:02:06.790 INFO:tasks.workunit.client.0.smithi057.stdout:6/373: sync 2024-02-28T16:02:06.790 INFO:tasks.workunit.client.0.smithi057.stdout:5/433: sync 2024-02-28T16:02:06.790 INFO:tasks.workunit.client.0.smithi057.stdout:7/354: sync 2024-02-28T16:02:06.790 INFO:tasks.workunit.client.0.smithi057.stdout:8/403: sync 2024-02-28T16:02:06.791 INFO:tasks.workunit.client.1.smithi087.stdout:0/797: symlink d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/l108 0 2024-02-28T16:02:06.793 INFO:tasks.workunit.client.1.smithi087.stdout:4/896: dread d2/d9/da/d1a/d26/f35 [0,4194304] 0 2024-02-28T16:02:06.793 INFO:tasks.workunit.client.1.smithi087.stdout:1/799: readlink d0/d1b/d1f/d71/db2/l6f 0 2024-02-28T16:02:06.794 INFO:tasks.workunit.client.0.smithi057.stdout:7/355: readlink d6/d26/l45 0 2024-02-28T16:02:06.794 INFO:tasks.workunit.client.0.smithi057.stdout:9/509: truncate d2/d5/d9/fb 2880996 0 2024-02-28T16:02:06.794 INFO:tasks.workunit.client.0.smithi057.stdout:6/374: chown df/f42 726911908 1 2024-02-28T16:02:06.795 INFO:tasks.workunit.client.1.smithi087.stdout:2/783: getdents d2/d7/dc0/d111/d3d 0 2024-02-28T16:02:06.796 INFO:tasks.workunit.client.1.smithi087.stdout:9/804: creat d7/dd/d15/d79/d2e/feb x:0 0 0 2024-02-28T16:02:06.798 INFO:tasks.workunit.client.0.smithi057.stdout:2/437: creat d19/d1d/d2e/f90 x:0 0 0 2024-02-28T16:02:06.799 INFO:tasks.workunit.client.1.smithi087.stdout:1/800: creat d0/d14/d86/f10a x:0 0 0 2024-02-28T16:02:06.799 INFO:tasks.workunit.client.0.smithi057.stdout:1/462: mknod d1/d21/d25/c9b 0 2024-02-28T16:02:06.801 INFO:tasks.workunit.client.0.smithi057.stdout:5/434: mkdir d2/d15/d5e/d9a 0 2024-02-28T16:02:06.801 INFO:tasks.workunit.client.1.smithi087.stdout:9/805: symlink d7/dd/d15/d79/d2e/dbd/lec 0 2024-02-28T16:02:06.802 INFO:tasks.workunit.client.1.smithi087.stdout:1/801: chown d0/d1b/d1f/d71/db2/d24/fb7 1804285 1 2024-02-28T16:02:06.803 INFO:tasks.workunit.client.1.smithi087.stdout:4/897: unlink d2/d49/l111 0 2024-02-28T16:02:06.807 INFO:tasks.workunit.client.1.smithi087.stdout:0/798: getdents d4/dd/d21/d5f 0 2024-02-28T16:02:06.807 INFO:tasks.workunit.client.0.smithi057.stdout:1/463: fsync d1/d21/f63 0 2024-02-28T16:02:06.808 INFO:tasks.workunit.client.1.smithi087.stdout:1/802: read d0/d1b/d43/d4d/f51 [2565546,111443] 0 2024-02-28T16:02:06.810 INFO:tasks.workunit.client.1.smithi087.stdout:2/784: link d2/d7/dc0/d111/c5b d2/d99/d28/d79/d9f/c118 0 2024-02-28T16:02:06.811 INFO:tasks.workunit.client.0.smithi057.stdout:9/510: unlink d2/d24/ff 0 2024-02-28T16:02:06.811 INFO:tasks.workunit.client.0.smithi057.stdout:6/375: read df/d10/d13/f41 [254904,111648] 0 2024-02-28T16:02:06.813 INFO:tasks.workunit.client.1.smithi087.stdout:9/806: creat d7/dd/d15/d3f/dc6/fed x:0 0 0 2024-02-28T16:02:06.815 INFO:tasks.workunit.client.0.smithi057.stdout:0/593: dwrite d6/d12/d17/d34/f4d [0,4194304] 0 2024-02-28T16:02:06.815 INFO:tasks.workunit.client.1.smithi087.stdout:4/898: dread d2/f8 [0,4194304] 0 2024-02-28T16:02:06.815 INFO:tasks.workunit.client.1.smithi087.stdout:0/799: creat d4/dd/d37/d39/d3a/d57/d74/d1f/d60/f109 x:0 0 0 2024-02-28T16:02:06.818 INFO:tasks.workunit.client.1.smithi087.stdout:9/807: creat d7/dd/d3c/d4c/da1/fee x:0 0 0 2024-02-28T16:02:06.818 INFO:tasks.workunit.client.1.smithi087.stdout:1/803: dread d0/d14/d86/fe9 [0,4194304] 0 2024-02-28T16:02:06.820 INFO:tasks.workunit.client.1.smithi087.stdout:4/899: mknod d2/d9/d10/dbf/c11f 0 2024-02-28T16:02:06.824 INFO:tasks.workunit.client.1.smithi087.stdout:4/900: chown d2/d9/d10/dbf/db6/fda 4962777 1 2024-02-28T16:02:06.824 INFO:tasks.workunit.client.1.smithi087.stdout:9/808: rmdir d7/dd/d15/d3f/d5f/d90 39 2024-02-28T16:02:06.825 INFO:tasks.workunit.client.1.smithi087.stdout:1/804: creat d0/d14/d48/da7/df4/f10b x:0 0 0 2024-02-28T16:02:06.827 INFO:tasks.workunit.client.1.smithi087.stdout:9/809: creat d7/dd/d36/fef x:0 0 0 2024-02-28T16:02:06.832 INFO:tasks.workunit.client.0.smithi057.stdout:5/435: creat d2/d15/d63/f9b x:0 0 0 2024-02-28T16:02:06.833 INFO:tasks.workunit.client.0.smithi057.stdout:3/410: dwrite d8/dd/d14/d2e/d30/f69 [0,4194304] 0 2024-02-28T16:02:06.833 INFO:tasks.workunit.client.1.smithi087.stdout:9/810: mknod d7/d1e/d60/cf0 0 2024-02-28T16:02:06.834 INFO:tasks.workunit.client.1.smithi087.stdout:1/805: truncate d0/d14/f93 1691971 0 2024-02-28T16:02:06.834 INFO:tasks.workunit.client.1.smithi087.stdout:1/806: chown d0/d1b/f47 11726679 1 2024-02-28T16:02:06.836 INFO:tasks.workunit.client.1.smithi087.stdout:4/901: rename d2/d9/d10/d22/db3 to d2/d9/da/d1a/d120 0 2024-02-28T16:02:06.838 INFO:tasks.workunit.client.0.smithi057.stdout:4/435: dwrite d1/d22/f24 [0,4194304] 0 2024-02-28T16:02:06.838 INFO:tasks.workunit.client.0.smithi057.stdout:6/376: write df/d10/d13/f1e [4376354,38155] 0 2024-02-28T16:02:06.842 INFO:tasks.workunit.client.1.smithi087.stdout:0/800: dwrite d4/dd/d21/d52/f7e [0,4194304] 0 2024-02-28T16:02:06.851 INFO:tasks.workunit.client.1.smithi087.stdout:0/801: mknod d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/c10a 0 2024-02-28T16:02:06.852 INFO:tasks.workunit.client.0.smithi057.stdout:1/464: dread d1/f8a [0,4194304] 0 2024-02-28T16:02:06.853 INFO:tasks.workunit.client.1.smithi087.stdout:2/785: write d2/d7/dec/f67 [2306475,32847] 0 2024-02-28T16:02:06.855 INFO:tasks.workunit.client.1.smithi087.stdout:2/786: readlink d2/d99/lf4 0 2024-02-28T16:02:06.855 INFO:tasks.workunit.client.0.smithi057.stdout:7/356: dread d6/f23 [0,4194304] 0 2024-02-28T16:02:06.856 INFO:tasks.workunit.client.0.smithi057.stdout:6/377: mkdir df/d61/d7c 0 2024-02-28T16:02:06.856 INFO:tasks.workunit.client.0.smithi057.stdout:3/411: creat d8/dd/d14/d2c/f80 x:0 0 0 2024-02-28T16:02:06.858 INFO:tasks.workunit.client.1.smithi087.stdout:1/807: write d0/d1b/d1f/d71/f81 [579427,69456] 0 2024-02-28T16:02:06.861 INFO:tasks.workunit.client.1.smithi087.stdout:2/787: creat d2/d7/dc0/d111/d34/d88/f119 x:0 0 0 2024-02-28T16:02:06.862 INFO:tasks.workunit.client.1.smithi087.stdout:0/802: rmdir d4/dd/d21/d32/d105 0 2024-02-28T16:02:06.864 INFO:tasks.workunit.client.0.smithi057.stdout:2/438: dread d19/f37 [0,4194304] 0 2024-02-28T16:02:06.870 INFO:tasks.workunit.client.1.smithi087.stdout:9/811: dwrite d7/dd/d3c/f43 [0,4194304] 0 2024-02-28T16:02:06.872 INFO:tasks.workunit.client.0.smithi057.stdout:5/436: symlink d2/d19/d1c/l9c 0 2024-02-28T16:02:06.875 INFO:tasks.workunit.client.1.smithi087.stdout:2/788: truncate d2/f87 903312 0 2024-02-28T16:02:06.876 INFO:tasks.workunit.client.0.smithi057.stdout:5/437: chown d2/d19 891427789 1 2024-02-28T16:02:06.876 INFO:tasks.workunit.client.0.smithi057.stdout:4/436: symlink d1/d10/d12/d2c/l94 0 2024-02-28T16:02:06.879 INFO:tasks.workunit.client.1.smithi087.stdout:2/789: truncate d2/d99/d28/d79/ff9 955820 0 2024-02-28T16:02:06.880 INFO:tasks.workunit.client.1.smithi087.stdout:8/874: sync 2024-02-28T16:02:06.881 INFO:tasks.workunit.client.0.smithi057.stdout:4/437: chown d1/d10/d31/f7e 194789754 1 2024-02-28T16:02:06.882 INFO:tasks.workunit.client.1.smithi087.stdout:0/803: dwrite d4/dd/d21/fe2 [0,4194304] 0 2024-02-28T16:02:06.884 INFO:tasks.workunit.client.1.smithi087.stdout:1/808: dwrite d0/d1a/f73 [0,4194304] 0 2024-02-28T16:02:06.888 INFO:tasks.workunit.client.0.smithi057.stdout:3/412: rename d8/l73 to d8/dd/d14/d2e/d30/d49/d51/d66/l81 0 2024-02-28T16:02:06.889 INFO:tasks.workunit.client.1.smithi087.stdout:8/875: creat d2/d9/d10/f120 x:0 0 0 2024-02-28T16:02:06.891 INFO:tasks.workunit.client.0.smithi057.stdout:6/378: dwrite df/f48 [0,4194304] 0 2024-02-28T16:02:06.893 INFO:tasks.workunit.client.1.smithi087.stdout:8/876: chown d2/d63/d9b/dae/lff 384 1 2024-02-28T16:02:06.893 INFO:tasks.workunit.client.1.smithi087.stdout:0/804: fsync d4/dd/d21/f96 0 2024-02-28T16:02:06.894 INFO:tasks.workunit.client.1.smithi087.stdout:1/809: mkdir d0/d1b/d1f/d71/db2/d24/d78/d10c 0 2024-02-28T16:02:06.895 INFO:tasks.workunit.client.1.smithi087.stdout:8/877: chown d2/d33/dd1/fed 40803952 1 2024-02-28T16:02:06.895 INFO:tasks.workunit.client.1.smithi087.stdout:1/810: chown d0/d14/d3f/dd5 1014 1 2024-02-28T16:02:06.897 INFO:tasks.workunit.client.1.smithi087.stdout:0/805: mknod d4/d1c/c10b 0 2024-02-28T16:02:06.897 INFO:tasks.workunit.client.0.smithi057.stdout:8/404: link d5/d62/c6d d5/d20/d39/d49/d56/d79/c8b 0 2024-02-28T16:02:06.898 INFO:tasks.workunit.client.1.smithi087.stdout:1/811: readlink d0/d1b/d1f/d71/dad/l102 0 2024-02-28T16:02:06.899 INFO:tasks.workunit.client.1.smithi087.stdout:8/878: symlink d2/d18/d42/d62/de8/l121 0 2024-02-28T16:02:06.902 INFO:tasks.workunit.client.0.smithi057.stdout:2/439: creat d19/d1d/d26/f91 x:0 0 0 2024-02-28T16:02:06.903 INFO:tasks.workunit.client.1.smithi087.stdout:1/812: symlink d0/d14/d3f/dd5/l10d 0 2024-02-28T16:02:06.904 INFO:tasks.workunit.client.0.smithi057.stdout:1/465: dwrite d1/d21/d25/f33 [0,4194304] 0 2024-02-28T16:02:06.905 INFO:tasks.workunit.client.1.smithi087.stdout:8/879: mkdir d2/d63/d9b/dae/db1/d122 0 2024-02-28T16:02:06.905 INFO:tasks.workunit.client.0.smithi057.stdout:2/440: dread - d19/d43/f59 zero size 2024-02-28T16:02:06.906 INFO:tasks.workunit.client.1.smithi087.stdout:1/813: write d0/d14/f42 [6479838,118213] 0 2024-02-28T16:02:06.907 INFO:tasks.workunit.client.0.smithi057.stdout:2/441: chown d19/d57 1070 1 2024-02-28T16:02:06.908 INFO:tasks.workunit.client.0.smithi057.stdout:5/438: unlink d2/d15/d3b/c78 0 2024-02-28T16:02:06.908 INFO:tasks.workunit.client.0.smithi057.stdout:9/511: getdents d2/d62 0 2024-02-28T16:02:06.910 INFO:tasks.workunit.client.1.smithi087.stdout:8/880: chown d2/d18/df5/f10d 155834491 1 2024-02-28T16:02:06.912 INFO:tasks.workunit.client.0.smithi057.stdout:5/439: readlink d2/d12/d76/d7b/d50/l52 0 2024-02-28T16:02:06.915 INFO:tasks.workunit.client.1.smithi087.stdout:8/881: chown d2/d7c/fe2 111158290 1 2024-02-28T16:02:06.915 INFO:tasks.workunit.client.0.smithi057.stdout:8/405: mkdir d5/d20/d39/d8c 0 2024-02-28T16:02:06.915 INFO:tasks.workunit.client.1.smithi087.stdout:1/814: rename d0/d1b/d1f/d71/db2/d24/d5c/d69/ld2 to d0/l10e 0 2024-02-28T16:02:06.917 INFO:tasks.workunit.client.0.smithi057.stdout:4/438: creat d1/d10/d12/d2c/d50/d93/f95 x:0 0 0 2024-02-28T16:02:06.919 INFO:tasks.workunit.client.1.smithi087.stdout:1/815: chown d0/d1b/d1f/d71/db2/dae/dcd 59788 1 2024-02-28T16:02:06.922 INFO:tasks.workunit.client.1.smithi087.stdout:0/806: dwrite d4/d6/dc/f84 [4194304,4194304] 0 2024-02-28T16:02:06.925 INFO:tasks.workunit.client.1.smithi087.stdout:1/816: mkdir d0/d1b/d1f/d71/dad/d10f 0 2024-02-28T16:02:06.926 INFO:tasks.workunit.client.0.smithi057.stdout:6/379: dwrite df/d10/f4d [0,4194304] 0 2024-02-28T16:02:06.927 INFO:tasks.workunit.client.1.smithi087.stdout:0/807: chown d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/c6c 2356306 1 2024-02-28T16:02:06.929 INFO:tasks.workunit.client.1.smithi087.stdout:0/808: chown d4/dd/d26/lb2 12922 1 2024-02-28T16:02:06.929 INFO:tasks.workunit.client.1.smithi087.stdout:1/817: creat d0/d1b/d1f/d71/db2/dae/dcd/f110 x:0 0 0 2024-02-28T16:02:06.932 INFO:tasks.workunit.client.0.smithi057.stdout:8/406: fdatasync d5/de/f10 0 2024-02-28T16:02:06.934 INFO:tasks.workunit.client.1.smithi087.stdout:1/818: fdatasync d0/d14/d3f/dd5/fe1 0 2024-02-28T16:02:06.936 INFO:tasks.workunit.client.0.smithi057.stdout:3/413: dwrite d8/dd/d14/d2c/f4c [8388608,4194304] 0 2024-02-28T16:02:06.938 INFO:tasks.workunit.client.0.smithi057.stdout:1/466: symlink d1/d21/d66/d53/l9c 0 2024-02-28T16:02:06.939 INFO:tasks.workunit.client.1.smithi087.stdout:1/819: read d0/d1b/d1f/d71/db2/d24/d78/fb4 [2022347,25879] 0 2024-02-28T16:02:06.939 INFO:tasks.workunit.client.0.smithi057.stdout:2/442: dread d19/d1d/d2e/f6c [0,4194304] 0 2024-02-28T16:02:06.940 INFO:tasks.workunit.client.1.smithi087.stdout:2/790: write d2/d7/dc0/d111/d34/daf/f105 [523506,24533] 0 2024-02-28T16:02:06.942 INFO:tasks.workunit.client.1.smithi087.stdout:2/791: write d2/d7/dec/f67 [1034464,17658] 0 2024-02-28T16:02:06.949 INFO:tasks.workunit.client.0.smithi057.stdout:4/439: unlink d1/d10/d12/d15/d19/d5e/c67 0 2024-02-28T16:02:06.950 INFO:tasks.workunit.client.1.smithi087.stdout:2/792: getdents d2/d42/ddd 0 2024-02-28T16:02:06.958 INFO:tasks.workunit.client.0.smithi057.stdout:9/512: read - d2/d5/d1b/d2e/f9d zero size 2024-02-28T16:02:06.960 INFO:tasks.workunit.client.0.smithi057.stdout:8/407: dwrite d5/de/d1b/d4b/f7a [0,4194304] 0 2024-02-28T16:02:06.963 INFO:tasks.workunit.client.1.smithi087.stdout:2/793: unlink d2/f87 0 2024-02-28T16:02:06.965 INFO:tasks.workunit.client.1.smithi087.stdout:2/794: read - d2/d7/dec/f10f zero size 2024-02-28T16:02:06.967 INFO:tasks.workunit.client.0.smithi057.stdout:9/513: readlink d2/d5/d9/d64/d78/l8c 0 2024-02-28T16:02:06.968 INFO:tasks.workunit.client.0.smithi057.stdout:9/514: stat d2/d5e/f9a 0 2024-02-28T16:02:06.970 INFO:tasks.workunit.client.0.smithi057.stdout:9/515: stat d2 0 2024-02-28T16:02:06.971 INFO:tasks.workunit.client.0.smithi057.stdout:7/357: dread d6/dc/f18 [4194304,4194304] 0 2024-02-28T16:02:06.972 INFO:tasks.workunit.client.1.smithi087.stdout:2/795: creat d2/d7d/dac/f11a x:0 0 0 2024-02-28T16:02:06.973 INFO:tasks.workunit.client.0.smithi057.stdout:4/440: mknod d1/d10/d12/d2c/d37/d46/c96 0 2024-02-28T16:02:06.977 INFO:tasks.workunit.client.0.smithi057.stdout:1/467: chown d1/d3/dc/d15/d4e/c96 222 1 2024-02-28T16:02:06.977 INFO:tasks.workunit.client.0.smithi057.stdout:5/440: getdents d2/d19/d1c 0 2024-02-28T16:02:06.978 INFO:tasks.workunit.client.1.smithi087.stdout:0/809: dread d4/d6/dc/f84 [0,4194304] 0 2024-02-28T16:02:06.979 INFO:tasks.workunit.client.0.smithi057.stdout:7/358: symlink d6/dc/d35/l7d 0 2024-02-28T16:02:06.979 INFO:tasks.workunit.client.0.smithi057.stdout:3/414: link d8/f12 d8/dd/d14/d2e/d2f/f82 0 2024-02-28T16:02:06.980 INFO:tasks.workunit.client.0.smithi057.stdout:2/443: link d19/f37 d19/d43/f92 0 2024-02-28T16:02:06.981 INFO:tasks.workunit.client.0.smithi057.stdout:6/380: dread df/d10/d13/f41 [0,4194304] 0 2024-02-28T16:02:06.982 INFO:tasks.workunit.client.1.smithi087.stdout:0/810: chown d4/dd/f82 25326 1 2024-02-28T16:02:06.982 INFO:tasks.workunit.client.1.smithi087.stdout:1/820: dread d0/d1a/d28/f59 [0,4194304] 0 2024-02-28T16:02:06.982 INFO:tasks.workunit.client.0.smithi057.stdout:7/359: chown d6/d26/l4a 557948 1 2024-02-28T16:02:06.983 INFO:tasks.workunit.client.1.smithi087.stdout:2/796: write d2/d99/fb3 [2131447,109128] 0 2024-02-28T16:02:06.984 INFO:tasks.workunit.client.1.smithi087.stdout:0/811: read d4/dd/d37/d39/f70 [15824,114785] 0 2024-02-28T16:02:06.985 INFO:tasks.workunit.client.0.smithi057.stdout:1/468: unlink d1/d21/d66/d53/d62/f8e 0 2024-02-28T16:02:06.986 INFO:tasks.workunit.client.0.smithi057.stdout:3/415: fdatasync d8/dd/d14/d2e/d30/d49/d51/d66/f79 0 2024-02-28T16:02:06.986 INFO:tasks.workunit.client.1.smithi087.stdout:2/797: mkdir d2/d99/dc7/de2/de4/d11b 0 2024-02-28T16:02:06.987 INFO:tasks.workunit.client.0.smithi057.stdout:4/441: mknod d1/d10/d31/c97 0 2024-02-28T16:02:06.987 INFO:tasks.workunit.client.0.smithi057.stdout:7/360: truncate d6/dc/d35/f46 904630 0 2024-02-28T16:02:06.988 INFO:tasks.workunit.client.0.smithi057.stdout:6/381: truncate df/d14/d15/d16/f4a 957762 0 2024-02-28T16:02:06.989 INFO:tasks.workunit.client.0.smithi057.stdout:5/441: symlink d2/d3e/l9d 0 2024-02-28T16:02:06.992 INFO:tasks.workunit.client.1.smithi087.stdout:2/798: rename d2/d7/dc0/d111/d34/d88/f10d to d2/d99/dc7/de2/f11c 0 2024-02-28T16:02:06.993 INFO:tasks.workunit.client.0.smithi057.stdout:5/442: dread - d2/d12/d76/d7b/d62/d74/f8c zero size 2024-02-28T16:02:06.994 INFO:tasks.workunit.client.0.smithi057.stdout:2/444: rename d19/d43/f59 to d19/d1d/d89/f93 0 2024-02-28T16:02:06.994 INFO:tasks.workunit.client.1.smithi087.stdout:2/799: chown d2/d99/f1e 116945462 1 2024-02-28T16:02:06.996 INFO:tasks.workunit.client.0.smithi057.stdout:9/516: write d2/d24/f10 [8218559,25142] 0 2024-02-28T16:02:06.998 INFO:tasks.workunit.client.0.smithi057.stdout:2/445: truncate d19/d1d/d89/f93 146660 0 2024-02-28T16:02:07.000 INFO:tasks.workunit.client.0.smithi057.stdout:3/416: unlink d8/dd/d19/d1c/l34 0 2024-02-28T16:02:07.001 INFO:tasks.workunit.client.1.smithi087.stdout:0/812: dwrite d4/d6/d9c/feb [0,4194304] 0 2024-02-28T16:02:07.001 INFO:tasks.workunit.client.0.smithi057.stdout:4/442: rmdir d1/d10/d12/d2c/d37/d46 39 2024-02-28T16:02:07.003 INFO:tasks.workunit.client.1.smithi087.stdout:2/800: dread d2/d99/d28/d79/ff9 [0,4194304] 0 2024-02-28T16:02:07.004 INFO:tasks.workunit.client.0.smithi057.stdout:3/417: fdatasync d8/dd/d14/f20 0 2024-02-28T16:02:07.004 INFO:tasks.workunit.client.0.smithi057.stdout:6/382: creat df/d10/d13/d4b/f7d x:0 0 0 2024-02-28T16:02:07.005 INFO:tasks.workunit.client.0.smithi057.stdout:5/443: symlink d2/d19/d1c/l9e 0 2024-02-28T16:02:07.007 INFO:tasks.workunit.client.1.smithi087.stdout:0/813: symlink d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/de9/l10c 0 2024-02-28T16:02:07.009 INFO:tasks.workunit.client.0.smithi057.stdout:2/446: rmdir d19/d1d/d2e 39 2024-02-28T16:02:07.011 INFO:tasks.workunit.client.1.smithi087.stdout:2/801: rename d2/d7/dc0/d111/d34/d88/cc4 to d2/d99/d28/d54/c11d 0 2024-02-28T16:02:07.013 INFO:tasks.workunit.client.1.smithi087.stdout:0/814: chown d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d76/cd2 79 1 2024-02-28T16:02:07.014 INFO:tasks.workunit.client.0.smithi057.stdout:7/361: fsync d6/dc/d12/f5c 0 2024-02-28T16:02:07.014 INFO:tasks.workunit.client.1.smithi087.stdout:2/802: readlink d2/d7/l7a 0 2024-02-28T16:02:07.014 INFO:tasks.workunit.client.1.smithi087.stdout:1/821: dread d0/d1b/d1f/d96/dfa/fff [0,4194304] 0 2024-02-28T16:02:07.016 INFO:tasks.workunit.client.0.smithi057.stdout:5/444: symlink d2/d19/l9f 0 2024-02-28T16:02:07.017 INFO:tasks.workunit.client.0.smithi057.stdout:7/362: stat d6/dc/l53 0 2024-02-28T16:02:07.018 INFO:tasks.workunit.client.1.smithi087.stdout:1/822: creat d0/d1b/d43/f111 x:0 0 0 2024-02-28T16:02:07.019 INFO:tasks.workunit.client.0.smithi057.stdout:6/383: unlink df/d14/d15/d16/d65/f68 0 2024-02-28T16:02:07.019 INFO:tasks.workunit.client.1.smithi087.stdout:2/803: creat d2/d7/dc0/d111/d34/daf/f11e x:0 0 0 2024-02-28T16:02:07.019 INFO:tasks.workunit.client.1.smithi087.stdout:0/815: read d4/d6/dc/d45/f7b [331521,129504] 0 2024-02-28T16:02:07.020 INFO:tasks.workunit.client.0.smithi057.stdout:1/469: dread d1/d21/f52 [0,4194304] 0 2024-02-28T16:02:07.022 INFO:tasks.workunit.client.0.smithi057.stdout:4/443: creat d1/d10/d12/d15/d19/d87/f98 x:0 0 0 2024-02-28T16:02:07.022 INFO:tasks.workunit.client.0.smithi057.stdout:7/363: readlink d6/dc/d12/d29/l30 0 2024-02-28T16:02:07.022 INFO:tasks.workunit.client.0.smithi057.stdout:6/384: read - df/d61/f62 zero size 2024-02-28T16:02:07.023 INFO:tasks.workunit.client.1.smithi087.stdout:0/816: unlink d4/dd/d37/d39/d3a/fdf 0 2024-02-28T16:02:07.024 INFO:tasks.workunit.client.0.smithi057.stdout:1/470: dread - d1/f81 zero size 2024-02-28T16:02:07.027 INFO:tasks.workunit.client.1.smithi087.stdout:1/823: dread d0/ff [0,4194304] 0 2024-02-28T16:02:07.028 INFO:tasks.workunit.client.0.smithi057.stdout:1/471: stat d1/d21/d25/f33 0 2024-02-28T16:02:07.029 INFO:tasks.workunit.client.0.smithi057.stdout:3/418: dwrite d8/dd/d14/d2e/f67 [0,4194304] 0 2024-02-28T16:02:07.029 INFO:tasks.workunit.client.1.smithi087.stdout:2/804: rename d2/d7/dc0/d111/d3d/d81/l107 to d2/d7/dc0/d111/l11f 0 2024-02-28T16:02:07.029 INFO:tasks.workunit.client.1.smithi087.stdout:1/824: chown d0/d1b/d1f/d71/db2/dae/le2 89 1 2024-02-28T16:02:07.031 INFO:tasks.workunit.client.1.smithi087.stdout:1/825: write d0/d1b/d1f/f77 [313679,128901] 0 2024-02-28T16:02:07.032 INFO:tasks.workunit.client.1.smithi087.stdout:2/805: symlink d2/d7/dc0/d111/d34/d88/l120 0 2024-02-28T16:02:07.037 INFO:tasks.workunit.client.1.smithi087.stdout:7/815: sync 2024-02-28T16:02:07.038 INFO:tasks.workunit.client.1.smithi087.stdout:7/816: fsync d14/f97 0 2024-02-28T16:02:07.038 INFO:tasks.workunit.client.0.smithi057.stdout:9/517: rename d2/d24/d1d/d79 to d2/d5/d1b/d2e/d4c/da0/da7 0 2024-02-28T16:02:07.043 INFO:tasks.workunit.client.0.smithi057.stdout:1/472: rmdir d1/d21/d66/d53/d62/d73 39 2024-02-28T16:02:07.045 INFO:tasks.workunit.client.0.smithi057.stdout:6/385: rename df/d10/l35 to df/d10/d78/d5b/l7e 0 2024-02-28T16:02:07.046 INFO:tasks.workunit.client.1.smithi087.stdout:0/817: write d4/dd/d21/d5f/f72 [437056,28364] 0 2024-02-28T16:02:07.046 INFO:tasks.workunit.client.0.smithi057.stdout:4/444: dwrite d1/d10/d12/d39/f3e [0,4194304] 0 2024-02-28T16:02:07.046 INFO:tasks.workunit.client.0.smithi057.stdout:9/518: symlink d2/d92/la8 0 2024-02-28T16:02:07.047 INFO:tasks.workunit.client.1.smithi087.stdout:2/806: mkdir d2/d7/d121 0 2024-02-28T16:02:07.051 INFO:tasks.workunit.client.1.smithi087.stdout:0/818: rename d4/dd/l79 to d4/d6/dc/d45/db4/l10d 0 2024-02-28T16:02:07.053 INFO:tasks.workunit.client.0.smithi057.stdout:3/419: creat d8/dd/d14/d2e/d30/d5f/d6b/f83 x:0 0 0 2024-02-28T16:02:07.055 INFO:tasks.workunit.client.0.smithi057.stdout:5/445: symlink d2/d12/d76/d7a/d95/la0 0 2024-02-28T16:02:07.055 INFO:tasks.workunit.client.1.smithi087.stdout:0/819: mkdir d4/d6/dc/d45/d10e 0 2024-02-28T16:02:07.060 INFO:tasks.workunit.client.0.smithi057.stdout:9/519: dread - d2/f4e zero size 2024-02-28T16:02:07.061 INFO:tasks.workunit.client.1.smithi087.stdout:2/807: dread d2/d99/f5d [0,4194304] 0 2024-02-28T16:02:07.061 INFO:tasks.workunit.client.1.smithi087.stdout:7/817: write d14/d7d/f8d [144061,113188] 0 2024-02-28T16:02:07.062 INFO:tasks.workunit.client.1.smithi087.stdout:2/808: stat d2/d42/df1 0 2024-02-28T16:02:07.062 INFO:tasks.workunit.client.0.smithi057.stdout:4/445: creat d1/d10/d12/d15/f99 x:0 0 0 2024-02-28T16:02:07.062 INFO:tasks.workunit.client.0.smithi057.stdout:5/446: dread d2/d15/f3c [0,4194304] 0 2024-02-28T16:02:07.063 INFO:tasks.workunit.client.1.smithi087.stdout:1/826: dread d0/d1b/d1f/d71/f81 [0,4194304] 0 2024-02-28T16:02:07.064 INFO:tasks.workunit.client.0.smithi057.stdout:2/447: dwrite d19/d1d/d2e/f6c [0,4194304] 0 2024-02-28T16:02:07.064 INFO:tasks.workunit.client.0.smithi057.stdout:3/420: mknod d8/dd/d19/c84 0 2024-02-28T16:02:07.065 INFO:tasks.workunit.client.0.smithi057.stdout:9/520: write d2/d92/f95 [1020286,15285] 0 2024-02-28T16:02:07.067 INFO:tasks.workunit.client.1.smithi087.stdout:1/827: dread - d0/d1b/d1f/d71/db2/db3/fe0 zero size 2024-02-28T16:02:07.067 INFO:tasks.workunit.client.1.smithi087.stdout:2/809: dread - d2/d9a/dd3/f10c zero size 2024-02-28T16:02:07.067 INFO:tasks.workunit.client.1.smithi087.stdout:7/818: unlink d14/d46/f81 0 2024-02-28T16:02:07.067 INFO:tasks.workunit.client.0.smithi057.stdout:5/447: read - d2/d15/d5e/d6d/f75 zero size 2024-02-28T16:02:07.068 INFO:tasks.workunit.client.0.smithi057.stdout:7/364: rename d6/dc/d12/d1a/d4d/c5f to d6/dc/d35/d58/c7e 0 2024-02-28T16:02:07.070 INFO:tasks.workunit.client.0.smithi057.stdout:9/521: write d2/f75 [821900,20977] 0 2024-02-28T16:02:07.071 INFO:tasks.workunit.client.0.smithi057.stdout:1/473: dwrite d1/d21/d66/d53/d7d/d65/f5a [0,4194304] 0 2024-02-28T16:02:07.071 INFO:tasks.workunit.client.1.smithi087.stdout:7/819: dread - d14/d21/d4f/f53 zero size 2024-02-28T16:02:07.075 INFO:tasks.workunit.client.0.smithi057.stdout:5/448: creat d2/d15/fa1 x:0 0 0 2024-02-28T16:02:07.076 INFO:tasks.workunit.client.0.smithi057.stdout:3/421: creat d8/dd/d14/d2e/d30/d5f/f85 x:0 0 0 2024-02-28T16:02:07.077 INFO:tasks.workunit.client.1.smithi087.stdout:0/820: dwrite d4/dd/d21/d5f/f107 [0,4194304] 0 2024-02-28T16:02:07.079 INFO:tasks.workunit.client.0.smithi057.stdout:7/365: mknod d6/dc/d35/d58/c7f 0 2024-02-28T16:02:07.082 INFO:tasks.workunit.client.0.smithi057.stdout:6/386: rename df/d14/d15/d16/d39/f67 to df/d10/f7f 0 2024-02-28T16:02:07.085 INFO:tasks.workunit.client.0.smithi057.stdout:3/422: mkdir d8/dd/d14/d2e/d30/d49/d86 0 2024-02-28T16:02:07.087 INFO:tasks.workunit.client.1.smithi087.stdout:7/820: rename d14/d2e/f5c to d14/d2e/d89/deb/f102 0 2024-02-28T16:02:07.090 INFO:tasks.workunit.client.1.smithi087.stdout:2/810: dwrite d2/d42/d4b/f95 [4194304,4194304] 0 2024-02-28T16:02:07.091 INFO:tasks.workunit.client.0.smithi057.stdout:2/448: rename d19/d2c/c2f to d19/d1d/d89/c94 0 2024-02-28T16:02:07.093 INFO:tasks.workunit.client.0.smithi057.stdout:6/387: chown df/d14/d15/d16/f46 8891553 1 2024-02-28T16:02:07.093 INFO:tasks.workunit.client.0.smithi057.stdout:1/474: getdents d1 0 2024-02-28T16:02:07.093 INFO:tasks.workunit.client.1.smithi087.stdout:0/821: rename d4/dd/d21/d9b/d7c/le6 to d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/de9/l10f 0 2024-02-28T16:02:07.096 INFO:tasks.workunit.client.1.smithi087.stdout:7/821: rmdir d14/d21 39 2024-02-28T16:02:07.098 INFO:tasks.workunit.client.0.smithi057.stdout:5/449: rename d2/d12/d3d/f3f to d2/d19/fa2 0 2024-02-28T16:02:07.099 INFO:tasks.workunit.client.1.smithi087.stdout:7/822: fdatasync d14/d2e/dab/fec 0 2024-02-28T16:02:07.100 INFO:tasks.workunit.client.0.smithi057.stdout:3/423: link d8/dd/d14/d2e/d30/f69 d8/dd/d19/d1c/f87 0 2024-02-28T16:02:07.101 INFO:tasks.workunit.client.1.smithi087.stdout:0/822: fsync d4/d6/dc/d45/f6a 0 2024-02-28T16:02:07.101 INFO:tasks.workunit.client.1.smithi087.stdout:1/828: truncate d0/d14/d86/fe9 2163372 0 2024-02-28T16:02:07.104 INFO:tasks.workunit.client.1.smithi087.stdout:2/811: unlink d2/d7/dec/c8a 0 2024-02-28T16:02:07.104 INFO:tasks.workunit.client.1.smithi087.stdout:1/829: chown d0/d1a/f2e 31330229 1 2024-02-28T16:02:07.104 INFO:tasks.workunit.client.0.smithi057.stdout:6/388: mknod df/d61/d7c/c80 0 2024-02-28T16:02:07.105 INFO:tasks.workunit.client.1.smithi087.stdout:7/823: creat d14/d2e/d2b/d4e/f103 x:0 0 0 2024-02-28T16:02:07.106 INFO:tasks.workunit.client.0.smithi057.stdout:6/389: dread - df/d10/d4f/f71 zero size 2024-02-28T16:02:07.107 INFO:tasks.workunit.client.1.smithi087.stdout:1/830: readlink d0/l10e 0 2024-02-28T16:02:07.108 INFO:tasks.workunit.client.0.smithi057.stdout:1/475: rename d1/f8 to d1/d21/d66/d53/d7d/d67/d7a/d92/f9d 0 2024-02-28T16:02:07.108 INFO:tasks.workunit.client.0.smithi057.stdout:5/450: truncate d2/d12/d3d/f61 2674262 0 2024-02-28T16:02:07.111 INFO:tasks.workunit.client.1.smithi087.stdout:2/812: rename d2/d7/dc0/d111/d97/lbf to d2/d7/d121/l122 0 2024-02-28T16:02:07.115 INFO:tasks.workunit.client.0.smithi057.stdout:6/390: creat df/d14/d15/d16/f81 x:0 0 0 2024-02-28T16:02:07.116 INFO:tasks.workunit.client.1.smithi087.stdout:2/813: chown d2/d7/dc0/d111/d34/l62 1282075 1 2024-02-28T16:02:07.116 INFO:tasks.workunit.client.0.smithi057.stdout:5/451: mkdir d2/d12/d76/d7b/d62/da3 0 2024-02-28T16:02:07.117 INFO:tasks.workunit.client.0.smithi057.stdout:6/391: chown df/d61/f62 1 1 2024-02-28T16:02:07.119 INFO:tasks.workunit.client.0.smithi057.stdout:5/452: chown d2/d8/l58 1954 1 2024-02-28T16:02:07.119 INFO:tasks.workunit.client.0.smithi057.stdout:0/594: sync 2024-02-28T16:02:07.119 INFO:tasks.workunit.client.1.smithi087.stdout:0/823: write d4/d6/dc/d45/f6a [3072320,23743] 0 2024-02-28T16:02:07.121 INFO:tasks.workunit.client.0.smithi057.stdout:6/392: readlink le 0 2024-02-28T16:02:07.123 INFO:tasks.workunit.client.0.smithi057.stdout:4/446: dread d1/d3f/d5f/f83 [0,4194304] 0 2024-02-28T16:02:07.123 INFO:tasks.workunit.client.0.smithi057.stdout:3/424: link d8/dd/d19/c1e d8/dd/d14/d2e/d30/d49/d51/d66/d7f/c88 0 2024-02-28T16:02:07.127 INFO:tasks.workunit.client.0.smithi057.stdout:0/595: truncate d6/d12/d38/f5c 2035124 0 2024-02-28T16:02:07.129 INFO:tasks.workunit.client.0.smithi057.stdout:6/393: dread df/d10/d13/f41 [0,4194304] 0 2024-02-28T16:02:07.129 INFO:tasks.workunit.client.1.smithi087.stdout:2/814: dread d2/d7/dc0/d111/d34/f3a [0,4194304] 0 2024-02-28T16:02:07.132 INFO:tasks.workunit.client.1.smithi087.stdout:7/824: truncate d14/d21/d4f/ffd 2048012 0 2024-02-28T16:02:07.132 INFO:tasks.workunit.client.0.smithi057.stdout:6/394: chown df/d10/d78 4 1 2024-02-28T16:02:07.133 INFO:tasks.workunit.client.0.smithi057.stdout:9/522: write d2/d5/d9/f2a [737862,111990] 0 2024-02-28T16:02:07.134 INFO:tasks.workunit.client.1.smithi087.stdout:7/825: dread - d14/d21/d4f/ff0 zero size 2024-02-28T16:02:07.135 INFO:tasks.workunit.client.1.smithi087.stdout:2/815: unlink d2/d99/d28/d79/da3/fbd 0 2024-02-28T16:02:07.137 INFO:tasks.workunit.client.0.smithi057.stdout:3/425: rename d8/dd/d19/d1c to d8/dd/d14/d2e/d76/d89 0 2024-02-28T16:02:07.138 INFO:tasks.workunit.client.1.smithi087.stdout:8/882: sync 2024-02-28T16:02:07.138 INFO:tasks.workunit.client.1.smithi087.stdout:5/890: sync 2024-02-28T16:02:07.138 INFO:tasks.workunit.client.1.smithi087.stdout:4/902: sync 2024-02-28T16:02:07.139 INFO:tasks.workunit.client.1.smithi087.stdout:9/812: sync 2024-02-28T16:02:07.139 INFO:tasks.workunit.client.1.smithi087.stdout:3/912: sync 2024-02-28T16:02:07.139 INFO:tasks.workunit.client.1.smithi087.stdout:6/903: sync 2024-02-28T16:02:07.140 INFO:tasks.workunit.client.0.smithi057.stdout:0/596: creat d6/d12/d17/d4b/fcc x:0 0 0 2024-02-28T16:02:07.140 INFO:tasks.workunit.client.0.smithi057.stdout:2/449: truncate d19/d1d/d2e/d31/f3b 388244 0 2024-02-28T16:02:07.143 INFO:tasks.workunit.client.0.smithi057.stdout:9/523: read d2/d5/d9/f4b [3816073,52211] 0 2024-02-28T16:02:07.144 INFO:tasks.workunit.client.0.smithi057.stdout:7/366: dread d6/dc/d12/d1a/f37 [0,4194304] 0 2024-02-28T16:02:07.146 INFO:tasks.workunit.client.0.smithi057.stdout:4/447: symlink d1/d10/d31/l9a 0 2024-02-28T16:02:07.147 INFO:tasks.workunit.client.1.smithi087.stdout:4/903: write d2/d9/d10/dbf/dbb/f11c [446852,112658] 0 2024-02-28T16:02:07.147 INFO:tasks.workunit.client.1.smithi087.stdout:9/813: read d7/dc/f59 [1068031,100142] 0 2024-02-28T16:02:07.147 INFO:tasks.workunit.client.0.smithi057.stdout:6/395: mkdir df/d14/d15/d82 0 2024-02-28T16:02:07.149 INFO:tasks.workunit.client.0.smithi057.stdout:0/597: unlink d6/d12/d45/c74 0 2024-02-28T16:02:07.150 INFO:tasks.workunit.client.1.smithi087.stdout:9/814: chown d7/dd/d15/d79 1 1 2024-02-28T16:02:07.152 INFO:tasks.workunit.client.1.smithi087.stdout:2/816: mknod d2/d7/dc0/d111/d97/c123 0 2024-02-28T16:02:07.152 INFO:tasks.workunit.client.1.smithi087.stdout:1/831: dread d0/d1b/d43/d4d/fa8 [0,4194304] 0 2024-02-28T16:02:07.156 INFO:tasks.workunit.client.0.smithi057.stdout:3/426: creat d8/dd/d14/d2e/d30/d49/d51/d66/d7f/f8a x:0 0 0 2024-02-28T16:02:07.156 INFO:tasks.workunit.client.0.smithi057.stdout:1/476: symlink d1/d21/d66/l9e 0 2024-02-28T16:02:07.157 INFO:tasks.workunit.client.1.smithi087.stdout:9/815: mknod d7/d1e/d60/cf1 0 2024-02-28T16:02:07.158 INFO:tasks.workunit.client.1.smithi087.stdout:6/904: dread d4/d30/d13/d38/d69/fc2 [0,4194304] 0 2024-02-28T16:02:07.158 INFO:tasks.workunit.client.1.smithi087.stdout:0/824: dread d4/d6/dc/f99 [0,4194304] 0 2024-02-28T16:02:07.159 INFO:tasks.workunit.client.1.smithi087.stdout:9/816: fsync d7/f14 0 2024-02-28T16:02:07.160 INFO:tasks.workunit.client.1.smithi087.stdout:7/826: write d14/d21/d4f/f53 [289789,31855] 0 2024-02-28T16:02:07.160 INFO:tasks.workunit.client.0.smithi057.stdout:6/396: mknod df/c83 0 2024-02-28T16:02:07.160 INFO:tasks.workunit.client.0.smithi057.stdout:3/427: fdatasync d8/dd/d14/d2e/d30/d5f/f85 0 2024-02-28T16:02:07.162 INFO:tasks.workunit.client.0.smithi057.stdout:4/448: mkdir d1/d22/d64/d9b 0 2024-02-28T16:02:07.163 INFO:tasks.workunit.client.1.smithi087.stdout:8/883: write d2/d18/d42/d62/fc5 [693951,30454] 0 2024-02-28T16:02:07.163 INFO:tasks.workunit.client.1.smithi087.stdout:7/827: chown d14/d2e/lf4 851107 1 2024-02-28T16:02:07.164 INFO:tasks.workunit.client.1.smithi087.stdout:3/913: write d11/d3a/dd1/fdb [360131,38669] 0 2024-02-28T16:02:07.165 INFO:tasks.workunit.client.0.smithi057.stdout:0/598: mkdir d6/d12/d17/d58/d95/dcd 0 2024-02-28T16:02:07.166 INFO:tasks.workunit.client.1.smithi087.stdout:5/891: write d3/d9/d9b/dba/d30/d36/f48 [4948735,69406] 0 2024-02-28T16:02:07.166 INFO:tasks.workunit.client.0.smithi057.stdout:8/408: sync 2024-02-28T16:02:07.168 INFO:tasks.workunit.client.1.smithi087.stdout:1/832: mkdir d0/d1b/d1f/d71/db2/d112 0 2024-02-28T16:02:07.168 INFO:tasks.workunit.client.0.smithi057.stdout:0/599: readlink d6/l9 0 2024-02-28T16:02:07.169 INFO:tasks.workunit.client.0.smithi057.stdout:5/453: dread d2/d12/d3d/f4b [0,4194304] 0 2024-02-28T16:02:07.169 INFO:tasks.workunit.client.1.smithi087.stdout:6/905: creat d4/dc/d10/f120 x:0 0 0 2024-02-28T16:02:07.170 INFO:tasks.workunit.client.0.smithi057.stdout:1/477: mkdir d1/d21/d66/d44/d9f 0 2024-02-28T16:02:07.170 INFO:tasks.workunit.client.0.smithi057.stdout:4/449: write d1/d10/d12/d15/f73 [4404539,49122] 0 2024-02-28T16:02:07.173 INFO:tasks.workunit.client.1.smithi087.stdout:3/914: dread d11/d3a/d3c/fc5 [0,4194304] 0 2024-02-28T16:02:07.174 INFO:tasks.workunit.client.1.smithi087.stdout:0/825: fdatasync d4/d6/dc/f99 0 2024-02-28T16:02:07.174 INFO:tasks.workunit.client.0.smithi057.stdout:3/428: truncate d8/dd/d14/d2e/d30/d49/d51/d66/d7f/f8a 549055 0 2024-02-28T16:02:07.175 INFO:tasks.workunit.client.1.smithi087.stdout:8/884: mknod d2/d63/c123 0 2024-02-28T16:02:07.177 INFO:tasks.workunit.client.0.smithi057.stdout:2/450: dwrite d19/d2c/d65/f8d [0,4194304] 0 2024-02-28T16:02:07.178 INFO:tasks.workunit.client.1.smithi087.stdout:1/833: unlink d0/l15 0 2024-02-28T16:02:07.181 INFO:tasks.workunit.client.1.smithi087.stdout:2/817: link d2/d42/d4b/f56 d2/d99/d28/d79/da3/f124 0 2024-02-28T16:02:07.184 INFO:tasks.workunit.client.0.smithi057.stdout:4/450: rmdir d1/d3f 39 2024-02-28T16:02:07.184 INFO:tasks.workunit.client.0.smithi057.stdout:7/367: link d6/dc/d12/f47 d6/dc/d12/d1a/d4c/d63/f80 0 2024-02-28T16:02:07.185 INFO:tasks.workunit.client.1.smithi087.stdout:4/904: dwrite d2/d9/d10/d22/f6a [4194304,4194304] 0 2024-02-28T16:02:07.186 INFO:tasks.workunit.client.1.smithi087.stdout:2/818: readlink d2/d7/dec/l6d 0 2024-02-28T16:02:07.187 INFO:tasks.workunit.client.1.smithi087.stdout:4/905: read - d2/df/d65/f10e zero size 2024-02-28T16:02:07.187 INFO:tasks.workunit.client.1.smithi087.stdout:8/885: creat d2/d18/df5/f124 x:0 0 0 2024-02-28T16:02:07.188 INFO:tasks.workunit.client.0.smithi057.stdout:8/409: dread d5/f43 [0,4194304] 0 2024-02-28T16:02:07.192 INFO:tasks.workunit.client.0.smithi057.stdout:2/451: mkdir d19/d34/d78/d95 0 2024-02-28T16:02:07.193 INFO:tasks.workunit.client.1.smithi087.stdout:8/886: dread - d2/d9/d5e/dbc/ffc zero size 2024-02-28T16:02:07.196 INFO:tasks.workunit.client.1.smithi087.stdout:8/887: fdatasync d2/d9/d10/f3a 0 2024-02-28T16:02:07.197 INFO:tasks.workunit.client.0.smithi057.stdout:6/397: dread df/d14/f43 [0,4194304] 0 2024-02-28T16:02:07.197 INFO:tasks.workunit.client.1.smithi087.stdout:3/915: dread d11/d44/d5b/f78 [0,4194304] 0 2024-02-28T16:02:07.201 INFO:tasks.workunit.client.0.smithi057.stdout:8/410: write d5/de/d1b/d4b/f73 [813734,35363] 0 2024-02-28T16:02:07.202 INFO:tasks.workunit.client.0.smithi057.stdout:6/398: dread - df/f74 zero size 2024-02-28T16:02:07.203 INFO:tasks.workunit.client.0.smithi057.stdout:7/368: creat d6/dc/d12/d1a/d4d/d56/f81 x:0 0 0 2024-02-28T16:02:07.205 INFO:tasks.workunit.client.0.smithi057.stdout:2/452: write d19/f47 [626245,120823] 0 2024-02-28T16:02:07.205 INFO:tasks.workunit.client.0.smithi057.stdout:5/454: dwrite d2/d15/fa1 [0,4194304] 0 2024-02-28T16:02:07.206 INFO:tasks.workunit.client.0.smithi057.stdout:1/478: getdents d1/d21/d66/d53 0 2024-02-28T16:02:07.209 INFO:tasks.workunit.client.0.smithi057.stdout:4/451: creat d1/d10/d12/d15/d19/d87/f9c x:0 0 0 2024-02-28T16:02:07.211 INFO:tasks.workunit.client.0.smithi057.stdout:2/453: stat d19/d43/d5a 0 2024-02-28T16:02:07.213 INFO:tasks.workunit.client.0.smithi057.stdout:8/411: readlink d5/d20/l7b 0 2024-02-28T16:02:07.214 INFO:tasks.workunit.client.0.smithi057.stdout:9/524: dread d2/d5/d9/fb [0,4194304] 0 2024-02-28T16:02:07.215 INFO:tasks.workunit.client.0.smithi057.stdout:2/454: readlink d19/d1d/d26/l4c 0 2024-02-28T16:02:07.215 INFO:tasks.workunit.client.0.smithi057.stdout:3/429: dread d8/dd/d14/d2c/f33 [0,4194304] 0 2024-02-28T16:02:07.216 INFO:tasks.workunit.client.0.smithi057.stdout:4/452: stat d1/d10/d12/d15/d19/d87/f9c 0 2024-02-28T16:02:07.219 INFO:tasks.workunit.client.1.smithi087.stdout:5/892: fsync d3/f37 0 2024-02-28T16:02:07.220 INFO:tasks.workunit.client.0.smithi057.stdout:3/430: dread - d8/d26/f7e zero size 2024-02-28T16:02:07.220 INFO:tasks.workunit.client.0.smithi057.stdout:4/453: chown d1/d10/d31/f7e 61214833 1 2024-02-28T16:02:07.222 INFO:tasks.workunit.client.1.smithi087.stdout:2/819: dwrite d2/d7/dc0/d111/d3d/f55 [0,4194304] 0 2024-02-28T16:02:07.223 INFO:tasks.workunit.client.0.smithi057.stdout:9/525: dread - d2/d5/d9/f89 zero size 2024-02-28T16:02:07.226 INFO:tasks.workunit.client.0.smithi057.stdout:5/455: mkdir d2/d12/d3d/da4 0 2024-02-28T16:02:07.226 INFO:tasks.workunit.client.0.smithi057.stdout:6/399: mkdir df/d10/d13/d4b/d4e/d84 0 2024-02-28T16:02:07.229 INFO:tasks.workunit.client.0.smithi057.stdout:3/431: chown d8/dd/d14/d2c/f53 330 1 2024-02-28T16:02:07.233 INFO:tasks.workunit.client.0.smithi057.stdout:2/455: creat d19/d43/d5a/f96 x:0 0 0 2024-02-28T16:02:07.235 INFO:tasks.workunit.client.0.smithi057.stdout:8/412: fsync d5/de/d1b/d45/f4e 0 2024-02-28T16:02:07.236 INFO:tasks.workunit.client.0.smithi057.stdout:4/454: creat d1/d10/d12/d15/d19/d87/f9d x:0 0 0 2024-02-28T16:02:07.247 INFO:tasks.workunit.client.0.smithi057.stdout:4/455: creat d1/d22/d64/d9b/f9e x:0 0 0 2024-02-28T16:02:07.253 INFO:tasks.workunit.client.0.smithi057.stdout:5/456: truncate d2/d12/d76/d7b/d62/d74/f8c 299150 0 2024-02-28T16:02:07.256 INFO:tasks.workunit.client.1.smithi087.stdout:4/906: mknod d2/d9/d10/dbf/dbb/c121 0 2024-02-28T16:02:07.260 INFO:tasks.workunit.client.0.smithi057.stdout:6/400: link df/d10/d4f/c50 df/d14/c85 0 2024-02-28T16:02:07.264 INFO:tasks.workunit.client.0.smithi057.stdout:3/432: dread d8/dd/d14/d2e/f67 [0,4194304] 0 2024-02-28T16:02:07.265 INFO:tasks.workunit.client.1.smithi087.stdout:6/906: dwrite d4/dc/d61/f63 [0,4194304] 0 2024-02-28T16:02:07.265 INFO:tasks.workunit.client.1.smithi087.stdout:0/826: write d4/dd/d21/f71 [11001,72816] 0 2024-02-28T16:02:07.269 INFO:tasks.workunit.client.0.smithi057.stdout:5/457: symlink d2/d12/d76/d7b/la5 0 2024-02-28T16:02:07.271 INFO:tasks.workunit.client.0.smithi057.stdout:1/479: dwrite d1/d3/dc/d40/f88 [0,4194304] 0 2024-02-28T16:02:07.275 INFO:tasks.workunit.client.0.smithi057.stdout:6/401: dread - df/d10/d4f/f71 zero size 2024-02-28T16:02:07.275 INFO:tasks.workunit.client.0.smithi057.stdout:0/600: dread d6/f99 [0,4194304] 0 2024-02-28T16:02:07.288 INFO:tasks.workunit.client.0.smithi057.stdout:7/369: dwrite d6/dc/d12/d1a/d4c/d63/f80 [0,4194304] 0 2024-02-28T16:02:07.291 INFO:tasks.workunit.client.0.smithi057.stdout:2/456: dwrite d19/d43/d5a/f96 [0,4194304] 0 2024-02-28T16:02:07.294 INFO:tasks.workunit.client.0.smithi057.stdout:6/402: write df/d10/d13/d4b/f5e [5041805,41081] 0 2024-02-28T16:02:07.296 INFO:tasks.workunit.client.0.smithi057.stdout:3/433: write d8/dd/d14/d2c/f33 [1400086,51565] 0 2024-02-28T16:02:07.301 INFO:tasks.workunit.client.0.smithi057.stdout:9/526: dwrite d2/d5e/d65/f56 [0,4194304] 0 2024-02-28T16:02:07.306 INFO:tasks.workunit.client.0.smithi057.stdout:2/457: creat d19/d34/d78/d95/f97 x:0 0 0 2024-02-28T16:02:07.310 INFO:tasks.workunit.client.0.smithi057.stdout:7/370: read d6/dc/f2f [3614831,67717] 0 2024-02-28T16:02:07.317 INFO:tasks.workunit.client.0.smithi057.stdout:9/527: write d2/d5e/d65/f73 [519445,40122] 0 2024-02-28T16:02:07.318 INFO:tasks.workunit.client.0.smithi057.stdout:3/434: chown d8/dd/d14/d2e/d30/d49/d51/d66/l81 562707 1 2024-02-28T16:02:07.322 INFO:tasks.workunit.client.1.smithi087.stdout:8/888: creat d2/d9/d10/d24/d9d/f125 x:0 0 0 2024-02-28T16:02:07.323 INFO:tasks.workunit.client.1.smithi087.stdout:3/916: creat d11/d7b/dab/de7/f13b x:0 0 0 2024-02-28T16:02:07.325 INFO:tasks.workunit.client.0.smithi057.stdout:7/371: symlink d6/dc/d12/d29/l82 0 2024-02-28T16:02:07.326 INFO:tasks.workunit.client.1.smithi087.stdout:5/893: chown d3/d64/d67/f103 13378 1 2024-02-28T16:02:07.328 INFO:tasks.workunit.client.1.smithi087.stdout:1/834: truncate d0/d1b/d1f/f41 1465604 0 2024-02-28T16:02:07.329 INFO:tasks.workunit.client.0.smithi057.stdout:2/458: write d19/d3a/f46 [1760528,117823] 0 2024-02-28T16:02:07.329 INFO:tasks.workunit.client.1.smithi087.stdout:1/835: readlink d0/d1b/lc5 0 2024-02-28T16:02:07.329 INFO:tasks.workunit.client.1.smithi087.stdout:7/828: link d14/d2e/lf4 d14/d2e/d89/deb/l104 0 2024-02-28T16:02:07.332 INFO:tasks.workunit.client.1.smithi087.stdout:1/836: dread d0/d14/f54 [0,4194304] 0 2024-02-28T16:02:07.332 INFO:tasks.workunit.client.1.smithi087.stdout:6/907: symlink d4/d30/d13/d67/daf/l121 0 2024-02-28T16:02:07.333 INFO:tasks.workunit.client.0.smithi057.stdout:2/459: dread - d19/d1d/d26/f91 zero size 2024-02-28T16:02:07.334 INFO:tasks.workunit.client.1.smithi087.stdout:0/827: mkdir d4/dd/d21/d52/d110 0 2024-02-28T16:02:07.335 INFO:tasks.workunit.client.1.smithi087.stdout:8/889: symlink d2/d33/dd1/l126 0 2024-02-28T16:02:07.336 INFO:tasks.workunit.client.0.smithi057.stdout:4/456: truncate d1/d3f/d5f/f72 1344122 0 2024-02-28T16:02:07.337 INFO:tasks.workunit.client.0.smithi057.stdout:3/435: write d8/dd/d14/d2e/f67 [2694250,51492] 0 2024-02-28T16:02:07.338 INFO:tasks.workunit.client.1.smithi087.stdout:8/890: fsync d2/d18/d42/f70 0 2024-02-28T16:02:07.339 INFO:tasks.workunit.client.1.smithi087.stdout:3/917: mkdir d11/d3a/dd1/d13c 0 2024-02-28T16:02:07.340 INFO:tasks.workunit.client.1.smithi087.stdout:2/820: creat d2/d99/d28/d79/d9f/de1/f125 x:0 0 0 2024-02-28T16:02:07.341 INFO:tasks.workunit.client.0.smithi057.stdout:7/372: rename d6/fb to d6/dc/d35/f83 0 2024-02-28T16:02:07.342 INFO:tasks.workunit.client.0.smithi057.stdout:4/457: chown d1/d10/d12/d2c/d37/f42 71670234 1 2024-02-28T16:02:07.347 INFO:tasks.workunit.client.0.smithi057.stdout:7/373: chown d6/d26/l45 19716787 1 2024-02-28T16:02:07.347 INFO:tasks.workunit.client.1.smithi087.stdout:4/907: rename d2/df/lbe to d2/d9/d10/d11/l122 0 2024-02-28T16:02:07.347 INFO:tasks.workunit.client.0.smithi057.stdout:4/458: chown d1/d10/d12/d15 5235 1 2024-02-28T16:02:07.350 INFO:tasks.workunit.client.1.smithi087.stdout:7/829: creat d14/d21/de4/de7/f105 x:0 0 0 2024-02-28T16:02:07.350 INFO:tasks.workunit.client.0.smithi057.stdout:2/460: rename d19/f1a to d19/d3a/f98 0 2024-02-28T16:02:07.351 INFO:tasks.workunit.client.1.smithi087.stdout:1/837: mknod d0/d1b/d1f/d71/db2/db3/dda/c113 0 2024-02-28T16:02:07.352 INFO:tasks.workunit.client.0.smithi057.stdout:4/459: chown d1/d10/d12/d15/f5b 1 1 2024-02-28T16:02:07.353 INFO:tasks.workunit.client.1.smithi087.stdout:9/817: truncate d7/dd/d15/d79/f16 1146971 0 2024-02-28T16:02:07.353 INFO:tasks.workunit.client.0.smithi057.stdout:7/374: dread - d6/dc/d12/d1a/d4c/d6c/f75 zero size 2024-02-28T16:02:07.353 INFO:tasks.workunit.client.0.smithi057.stdout:3/436: unlink d8/dd/d19/f2d 0 2024-02-28T16:02:07.356 INFO:tasks.workunit.client.0.smithi057.stdout:2/461: truncate d19/d1d/d89/f93 673715 0 2024-02-28T16:02:07.359 INFO:tasks.workunit.client.1.smithi087.stdout:8/891: dwrite d2/f6 [0,4194304] 0 2024-02-28T16:02:07.361 INFO:tasks.workunit.client.0.smithi057.stdout:5/458: dwrite d2/f22 [0,4194304] 0 2024-02-28T16:02:07.362 INFO:tasks.workunit.client.1.smithi087.stdout:8/892: write d2/d63/d9b/fc3 [3839496,108481] 0 2024-02-28T16:02:07.363 INFO:tasks.workunit.client.1.smithi087.stdout:4/908: write d2/d9/d10/d22/d5b/f119 [5406844,17671] 0 2024-02-28T16:02:07.364 INFO:tasks.workunit.client.1.smithi087.stdout:5/894: dread d3/fb2 [0,4194304] 0 2024-02-28T16:02:07.370 INFO:tasks.workunit.client.0.smithi057.stdout:8/413: dread d5/d20/d72/f87 [0,4194304] 0 2024-02-28T16:02:07.370 INFO:tasks.workunit.client.0.smithi057.stdout:7/375: creat d6/dc/d35/f84 x:0 0 0 2024-02-28T16:02:07.372 INFO:tasks.workunit.client.0.smithi057.stdout:3/437: creat d8/dd/d14/d2e/d30/f8b x:0 0 0 2024-02-28T16:02:07.377 INFO:tasks.workunit.client.0.smithi057.stdout:1/480: dwrite d1/d21/d25/f3d [0,4194304] 0 2024-02-28T16:02:07.379 INFO:tasks.workunit.client.0.smithi057.stdout:2/462: mknod d19/d3a/c99 0 2024-02-28T16:02:07.382 INFO:tasks.workunit.client.1.smithi087.stdout:7/830: truncate d14/d2e/d89/dbd/fe9 1901626 0 2024-02-28T16:02:07.382 INFO:tasks.workunit.client.1.smithi087.stdout:8/893: mkdir d2/d63/d9b/dd5/dd9/d127 0 2024-02-28T16:02:07.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/528: write f0 [1395377,18762] 0 2024-02-28T16:02:07.383 INFO:tasks.workunit.client.1.smithi087.stdout:0/828: truncate d4/dd/d21/d9b/d7c/fc7 11397 0 2024-02-28T16:02:07.385 INFO:tasks.workunit.client.1.smithi087.stdout:4/909: symlink d2/d9/d10/d22/d5b/d5c/d68/l123 0 2024-02-28T16:02:07.387 INFO:tasks.workunit.client.0.smithi057.stdout:0/601: dread d6/f85 [0,4194304] 0 2024-02-28T16:02:07.388 INFO:tasks.workunit.client.0.smithi057.stdout:6/403: dwrite df/d14/d15/d16/f33 [0,4194304] 0 2024-02-28T16:02:07.391 INFO:tasks.workunit.client.1.smithi087.stdout:5/895: unlink d3/d9/d9b/dba/d30/d36/d4f/d82/fe4 0 2024-02-28T16:02:07.391 INFO:tasks.workunit.client.0.smithi057.stdout:4/460: creat d1/d10/d12/d15/d19/d5e/f9f x:0 0 0 2024-02-28T16:02:07.391 INFO:tasks.workunit.client.0.smithi057.stdout:1/481: write d1/d21/d25/f95 [2550114,19427] 0 2024-02-28T16:02:07.393 INFO:tasks.workunit.client.1.smithi087.stdout:5/896: chown d3/d64/d67/cfd 609634731 1 2024-02-28T16:02:07.394 INFO:tasks.workunit.client.1.smithi087.stdout:3/918: creat d11/f13d x:0 0 0 2024-02-28T16:02:07.397 INFO:tasks.workunit.client.1.smithi087.stdout:1/838: creat d0/d14/f114 x:0 0 0 2024-02-28T16:02:07.399 INFO:tasks.workunit.client.1.smithi087.stdout:8/894: symlink d2/d18/df5/d104/d116/l128 0 2024-02-28T16:02:07.399 INFO:tasks.workunit.client.0.smithi057.stdout:1/482: write d1/d3/dc/d15/d4e/d5f/f85 [340316,102908] 0 2024-02-28T16:02:07.404 INFO:tasks.workunit.client.0.smithi057.stdout:7/376: rename d6/dc/d35/f61 to d6/dc/d12/d1a/d4c/d63/f85 0 2024-02-28T16:02:07.405 INFO:tasks.workunit.client.0.smithi057.stdout:1/483: chown d1/d21/d66/d53/d62 229710992 1 2024-02-28T16:02:07.406 INFO:tasks.workunit.client.0.smithi057.stdout:8/414: write d5/f17 [874940,82945] 0 2024-02-28T16:02:07.407 INFO:tasks.workunit.client.1.smithi087.stdout:0/829: mkdir d4/dd/d26/d111 0 2024-02-28T16:02:07.410 INFO:tasks.workunit.client.1.smithi087.stdout:7/831: dread d14/d2e/d2b/d4e/f93 [0,4194304] 0 2024-02-28T16:02:07.414 INFO:tasks.workunit.client.1.smithi087.stdout:3/919: creat d11/d33/d58/d8c/dca/f13e x:0 0 0 2024-02-28T16:02:07.414 INFO:tasks.workunit.client.1.smithi087.stdout:7/832: truncate d14/d2e/d89/dbb/fc6 683379 0 2024-02-28T16:02:07.416 INFO:tasks.workunit.client.1.smithi087.stdout:3/920: readlink d11/d61/d65/l69 0 2024-02-28T16:02:07.417 INFO:tasks.workunit.client.1.smithi087.stdout:1/839: unlink d0/c5f 0 2024-02-28T16:02:07.418 INFO:tasks.workunit.client.1.smithi087.stdout:9/818: mknod d7/dd/d15/cf2 0 2024-02-28T16:02:07.418 INFO:tasks.workunit.client.1.smithi087.stdout:3/921: chown d11/d61/d7c 27168197 1 2024-02-28T16:02:07.420 INFO:tasks.workunit.client.0.smithi057.stdout:1/484: write d1/d3/dc/f12 [4889708,51354] 0 2024-02-28T16:02:07.420 INFO:tasks.workunit.client.0.smithi057.stdout:8/415: chown d5/d6/fd 1043516 1 2024-02-28T16:02:07.420 INFO:tasks.workunit.client.0.smithi057.stdout:6/404: creat df/d10/d13/d4b/d4e/f86 x:0 0 0 2024-02-28T16:02:07.422 INFO:tasks.workunit.client.1.smithi087.stdout:4/910: rename d2/l95 to d2/df/d62/l124 0 2024-02-28T16:02:07.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/405: readlink df/d10/d13/l52 0 2024-02-28T16:02:07.426 INFO:tasks.workunit.client.1.smithi087.stdout:7/833: rmdir d14/d2e/d89/deb 39 2024-02-28T16:02:07.429 INFO:tasks.workunit.client.1.smithi087.stdout:7/834: fsync d14/d2e/d89/fde 0 2024-02-28T16:02:07.431 INFO:tasks.workunit.client.0.smithi057.stdout:5/459: dread d2/d8/f9 [0,4194304] 0 2024-02-28T16:02:07.431 INFO:tasks.workunit.client.0.smithi057.stdout:6/406: mknod df/d10/d13/c87 0 2024-02-28T16:02:07.431 INFO:tasks.workunit.client.0.smithi057.stdout:4/461: creat d1/d10/d12/d2c/d37/d46/fa0 x:0 0 0 2024-02-28T16:02:07.432 INFO:tasks.workunit.client.1.smithi087.stdout:1/840: mkdir d0/d1b/d115 0 2024-02-28T16:02:07.435 INFO:tasks.workunit.client.1.smithi087.stdout:4/911: truncate d2/d9/d10/dbf/dbb/ffa 498114 0 2024-02-28T16:02:07.438 INFO:tasks.workunit.client.1.smithi087.stdout:4/912: chown d2/d9/da/d1a/d26/d69/cc6 27462 1 2024-02-28T16:02:07.440 INFO:tasks.workunit.client.1.smithi087.stdout:3/922: creat d11/d45/f13f x:0 0 0 2024-02-28T16:02:07.442 INFO:tasks.workunit.client.1.smithi087.stdout:9/819: creat d7/dd/d15/d3f/ff3 x:0 0 0 2024-02-28T16:02:07.443 INFO:tasks.workunit.client.1.smithi087.stdout:1/841: creat d0/d14/d48/da7/df4/f116 x:0 0 0 2024-02-28T16:02:07.446 INFO:tasks.workunit.client.1.smithi087.stdout:4/913: mkdir d2/dc1/d125 0 2024-02-28T16:02:07.446 INFO:tasks.workunit.client.1.smithi087.stdout:1/842: readlink d0/d1b/d1f/d71/db2/d24/d5c/d69/lf7 0 2024-02-28T16:02:07.447 INFO:tasks.workunit.client.1.smithi087.stdout:3/923: dread - d11/d61/d65/da9/fe4 zero size 2024-02-28T16:02:07.448 INFO:tasks.workunit.client.1.smithi087.stdout:1/843: stat d0/d14/ff5 0 2024-02-28T16:02:07.450 INFO:tasks.workunit.client.1.smithi087.stdout:7/835: rmdir d14/d30/dd1/df8/dff 0 2024-02-28T16:02:07.452 INFO:tasks.workunit.client.1.smithi087.stdout:9/820: symlink d7/dd/d15/d3f/d5f/lf4 0 2024-02-28T16:02:07.455 INFO:tasks.workunit.client.1.smithi087.stdout:3/924: creat d11/d45/d88/f140 x:0 0 0 2024-02-28T16:02:07.457 INFO:tasks.workunit.client.1.smithi087.stdout:1/844: symlink d0/d1b/d1f/d71/db2/d24/d5c/d69/l117 0 2024-02-28T16:02:07.458 INFO:tasks.workunit.client.1.smithi087.stdout:1/845: read d0/ff [419698,57574] 0 2024-02-28T16:02:07.460 INFO:tasks.workunit.client.1.smithi087.stdout:8/895: dread d2/d18/d42/d7b/f95 [0,4194304] 0 2024-02-28T16:02:07.462 INFO:tasks.workunit.client.1.smithi087.stdout:6/908: truncate d4/d30/d13/d38/d69/d99/fc4 1027366 0 2024-02-28T16:02:07.463 INFO:tasks.workunit.client.1.smithi087.stdout:8/896: stat d2/d63/d9b/dae/db1/d122 0 2024-02-28T16:02:07.464 INFO:tasks.workunit.client.1.smithi087.stdout:7/836: creat d14/d2e/d89/deb/d55/dae/f106 x:0 0 0 2024-02-28T16:02:07.466 INFO:tasks.workunit.client.1.smithi087.stdout:8/897: chown d2/d18/f79 1062251118 1 2024-02-28T16:02:07.467 INFO:tasks.workunit.client.1.smithi087.stdout:1/846: creat d0/d1b/d1f/d96/dd8/f118 x:0 0 0 2024-02-28T16:02:07.468 INFO:tasks.workunit.client.1.smithi087.stdout:2/821: truncate d2/d99/dc7/de2/f11c 2416124 0 2024-02-28T16:02:07.469 INFO:tasks.workunit.client.1.smithi087.stdout:9/821: symlink d7/dd/d99/lf5 0 2024-02-28T16:02:07.470 INFO:tasks.workunit.client.1.smithi087.stdout:7/837: creat d14/d2e/dab/f107 x:0 0 0 2024-02-28T16:02:07.472 INFO:tasks.workunit.client.1.smithi087.stdout:6/909: symlink d4/d12/d45/d92/dc1/dc7/l122 0 2024-02-28T16:02:07.472 INFO:tasks.workunit.client.1.smithi087.stdout:7/838: write f13 [1851992,65080] 0 2024-02-28T16:02:07.473 INFO:tasks.workunit.client.1.smithi087.stdout:3/925: dwrite d11/d61/fff [0,4194304] 0 2024-02-28T16:02:07.473 INFO:tasks.workunit.client.1.smithi087.stdout:9/822: fsync d7/dd/d15/d3f/d6d/dc2/fe6 0 2024-02-28T16:02:07.478 INFO:tasks.workunit.client.1.smithi087.stdout:8/898: creat d2/d63/d9b/dd5/dd9/f129 x:0 0 0 2024-02-28T16:02:07.478 INFO:tasks.workunit.client.1.smithi087.stdout:2/822: fsync d2/d7/dc0/d111/f7e 0 2024-02-28T16:02:07.483 INFO:tasks.workunit.client.1.smithi087.stdout:2/823: write d2/d7/dc0/d111/d34/daf/f11e [685064,77091] 0 2024-02-28T16:02:07.487 INFO:tasks.workunit.client.1.smithi087.stdout:3/926: creat d11/d3a/d3c/f141 x:0 0 0 2024-02-28T16:02:07.488 INFO:tasks.workunit.client.1.smithi087.stdout:7/839: creat d14/d2e/d89/deb/d55/dc5/f108 x:0 0 0 2024-02-28T16:02:07.491 INFO:tasks.workunit.client.1.smithi087.stdout:9/823: symlink d7/dd/d15/d79/d2e/dbd/lf6 0 2024-02-28T16:02:07.495 INFO:tasks.workunit.client.1.smithi087.stdout:6/910: unlink d4/d12/l41 0 2024-02-28T16:02:07.496 INFO:tasks.workunit.client.1.smithi087.stdout:2/824: rename d2/fd6 to d2/d42/ddd/f126 0 2024-02-28T16:02:07.497 INFO:tasks.workunit.client.1.smithi087.stdout:3/927: creat d11/d33/d67/d9c/da1/f142 x:0 0 0 2024-02-28T16:02:07.499 INFO:tasks.workunit.client.1.smithi087.stdout:9/824: creat d7/dd/d15/d79/d2e/ff7 x:0 0 0 2024-02-28T16:02:07.502 INFO:tasks.workunit.client.1.smithi087.stdout:0/830: write d4/dd/d21/d9b/fe3 [1937785,33788] 0 2024-02-28T16:02:07.507 INFO:tasks.workunit.client.1.smithi087.stdout:5/897: dwrite d3/d9/d9b/dba/d30/d36/d4f/fed [0,4194304] 0 2024-02-28T16:02:07.508 INFO:tasks.workunit.client.1.smithi087.stdout:2/825: creat d2/d99/d28/d79/f127 x:0 0 0 2024-02-28T16:02:07.512 INFO:tasks.workunit.client.1.smithi087.stdout:2/826: readlink d2/d99/d28/l80 0 2024-02-28T16:02:07.513 INFO:tasks.workunit.client.1.smithi087.stdout:7/840: dwrite d14/fce [0,4194304] 0 2024-02-28T16:02:07.517 INFO:tasks.workunit.client.1.smithi087.stdout:5/898: chown d3/d9/d9b/dba/d30/f32 48 1 2024-02-28T16:02:07.517 INFO:tasks.workunit.client.1.smithi087.stdout:9/825: creat d7/dd/d15/d3f/d5f/d90/ddd/ff8 x:0 0 0 2024-02-28T16:02:07.522 INFO:tasks.workunit.client.1.smithi087.stdout:9/826: write d7/dd/d15/d55/f6c [4429474,4837] 0 2024-02-28T16:02:07.523 INFO:tasks.workunit.client.1.smithi087.stdout:5/899: chown d3/d9/d9b/dba/d30/d36/d4f/fed 33753221 1 2024-02-28T16:02:07.523 INFO:tasks.workunit.client.1.smithi087.stdout:3/928: creat d11/d44/d5b/d127/f143 x:0 0 0 2024-02-28T16:02:07.526 INFO:tasks.workunit.client.1.smithi087.stdout:4/914: dwrite d2/d9/da/d1a/ff8 [0,4194304] 0 2024-02-28T16:02:07.533 INFO:tasks.workunit.client.1.smithi087.stdout:4/915: dread - d2/d9/d10/d22/d5b/d5c/d91/da9/fe9 zero size 2024-02-28T16:02:07.562 INFO:tasks.workunit.client.1.smithi087.stdout:7/841: write d14/d21/f3e [4583179,128452] 0 2024-02-28T16:02:07.567 INFO:tasks.workunit.client.1.smithi087.stdout:4/916: dread d2/d9/d10/d22/d5b/d5c/d68/f89 [0,4194304] 0 2024-02-28T16:02:07.568 INFO:tasks.workunit.client.1.smithi087.stdout:2/827: dread d2/d99/d28/d79/ff9 [0,4194304] 0 2024-02-28T16:02:07.571 INFO:tasks.workunit.client.1.smithi087.stdout:3/929: fsync d11/d33/d58/d8c/ffd 0 2024-02-28T16:02:07.573 INFO:tasks.workunit.client.0.smithi057.stdout:4/462: mknod d1/d10/d12/ca1 0 2024-02-28T16:02:07.573 INFO:tasks.workunit.client.0.smithi057.stdout:0/602: write d6/d12/d38/d5e/f46 [700000,17432] 0 2024-02-28T16:02:07.574 INFO:tasks.workunit.client.0.smithi057.stdout:2/463: truncate d19/d2c/d65/f8d 3830270 0 2024-02-28T16:02:07.574 INFO:tasks.workunit.client.1.smithi087.stdout:5/900: fsync d3/d9/d9b/dba/d30/d8f/dac/d109/d54/f10c 0 2024-02-28T16:02:07.575 INFO:tasks.workunit.client.0.smithi057.stdout:9/529: truncate d2/d5e/d65/f73 248031 0 2024-02-28T16:02:07.577 INFO:tasks.workunit.client.0.smithi057.stdout:8/416: dread d5/d20/d39/d49/f54 [0,4194304] 0 2024-02-28T16:02:07.577 INFO:tasks.workunit.client.1.smithi087.stdout:7/842: dread d14/d2e/f22 [0,4194304] 0 2024-02-28T16:02:07.578 INFO:tasks.workunit.client.1.smithi087.stdout:9/827: symlink d7/dd/lf9 0 2024-02-28T16:02:07.582 INFO:tasks.workunit.client.0.smithi057.stdout:9/530: fdatasync d2/d5/d9/f32 0 2024-02-28T16:02:07.584 INFO:tasks.workunit.client.1.smithi087.stdout:9/828: read d7/d1e/d44/f9a [1851129,129044] 0 2024-02-28T16:02:07.592 INFO:tasks.workunit.client.0.smithi057.stdout:5/460: dwrite d2/d12/d5f/f8d [0,4194304] 0 2024-02-28T16:02:07.592 INFO:tasks.workunit.client.0.smithi057.stdout:3/438: dwrite d8/f12 [4194304,4194304] 0 2024-02-28T16:02:07.604 INFO:tasks.workunit.client.0.smithi057.stdout:1/485: dwrite d1/d21/d25/f33 [4194304,4194304] 0 2024-02-28T16:02:07.617 INFO:tasks.workunit.client.0.smithi057.stdout:6/407: dread df/d10/d13/f3a [0,4194304] 0 2024-02-28T16:02:07.618 INFO:tasks.workunit.client.0.smithi057.stdout:5/461: dread d2/d8/f9 [0,4194304] 0 2024-02-28T16:02:07.619 INFO:tasks.workunit.client.0.smithi057.stdout:6/408: write df/d10/d13/f75 [308363,32702] 0 2024-02-28T16:02:07.623 INFO:tasks.workunit.client.0.smithi057.stdout:6/409: write df/d14/d15/d16/f33 [534211,20075] 0 2024-02-28T16:02:07.653 INFO:tasks.workunit.client.0.smithi057.stdout:2/464: write d19/d1d/f3f [26617,45243] 0 2024-02-28T16:02:07.654 INFO:tasks.workunit.client.0.smithi057.stdout:0/603: symlink d6/d12/d5d/d7f/lce 0 2024-02-28T16:02:07.671 INFO:tasks.workunit.client.0.smithi057.stdout:9/531: fdatasync d2/d5/d1b/d2e/d77/f8e 0 2024-02-28T16:02:07.672 INFO:tasks.workunit.client.1.smithi087.stdout:0/831: getdents d4/dd/d21 0 2024-02-28T16:02:07.674 INFO:tasks.workunit.client.1.smithi087.stdout:6/911: write d4/d12/d45/d92/dc1/dcf/fdf [308769,120125] 0 2024-02-28T16:02:07.678 INFO:tasks.workunit.client.1.smithi087.stdout:8/899: dwrite d2/d18/f22 [0,4194304] 0 2024-02-28T16:02:07.678 INFO:tasks.workunit.client.1.smithi087.stdout:2/828: write d2/d99/d28/d79/ff9 [387277,108419] 0 2024-02-28T16:02:07.679 INFO:tasks.workunit.client.1.smithi087.stdout:9/829: write d7/dc/f85 [4899733,29921] 0 2024-02-28T16:02:07.692 INFO:tasks.workunit.client.1.smithi087.stdout:5/901: dread d3/d9/d9b/dba/d30/f32 [0,4194304] 0 2024-02-28T16:02:07.698 INFO:tasks.workunit.client.1.smithi087.stdout:0/832: dread d4/d6/dc/f84 [4194304,4194304] 0 2024-02-28T16:02:07.715 INFO:tasks.workunit.client.1.smithi087.stdout:8/900: dread d2/fa9 [0,4194304] 0 2024-02-28T16:02:07.733 INFO:tasks.workunit.client.1.smithi087.stdout:8/901: dread d2/d9/d5e/dbc/fd4 [0,4194304] 0 2024-02-28T16:02:07.786 INFO:tasks.workunit.client.0.smithi057.stdout:7/377: sync 2024-02-28T16:02:07.805 INFO:tasks.workunit.client.1.smithi087.stdout:4/917: link d2/d9/da/d1a/l2b d2/df/d65/l126 0 2024-02-28T16:02:07.806 INFO:tasks.workunit.client.1.smithi087.stdout:1/847: sync 2024-02-28T16:02:07.809 INFO:tasks.workunit.client.1.smithi087.stdout:1/848: write d0/d1b/d1f/d96/dd8/f118 [501208,126161] 0 2024-02-28T16:02:07.839 INFO:tasks.workunit.client.0.smithi057.stdout:3/439: mkdir d8/dd/d14/d2e/d30/d6a/d8c 0 2024-02-28T16:02:07.840 INFO:tasks.workunit.client.0.smithi057.stdout:2/465: symlink d19/d34/d78/l9a 0 2024-02-28T16:02:07.841 INFO:tasks.workunit.client.0.smithi057.stdout:2/466: fsync d19/d1d/d2e/f90 0 2024-02-28T16:02:07.842 INFO:tasks.workunit.client.0.smithi057.stdout:8/417: mkdir d5/d20/d39/d49/d89/d8d 0 2024-02-28T16:02:07.844 INFO:tasks.workunit.client.0.smithi057.stdout:7/378: creat d6/d26/f86 x:0 0 0 2024-02-28T16:02:07.845 INFO:tasks.workunit.client.0.smithi057.stdout:9/532: dread d2/d5/d9/f6a [0,4194304] 0 2024-02-28T16:02:07.845 INFO:tasks.workunit.client.0.smithi057.stdout:5/462: mknod d2/d3e/ca6 0 2024-02-28T16:02:07.849 INFO:tasks.workunit.client.0.smithi057.stdout:6/410: creat df/d10/d78/d5b/d7b/f88 x:0 0 0 2024-02-28T16:02:07.851 INFO:tasks.workunit.client.0.smithi057.stdout:0/604: link d6/d12/d17/d4b/f7d d6/d12/d45/d78/fcf 0 2024-02-28T16:02:07.853 INFO:tasks.workunit.client.0.smithi057.stdout:2/467: mkdir d19/d43/d5a/d9b 0 2024-02-28T16:02:07.856 INFO:tasks.workunit.client.0.smithi057.stdout:9/533: symlink d2/d5e/la9 0 2024-02-28T16:02:07.857 INFO:tasks.workunit.client.0.smithi057.stdout:1/486: symlink d1/d3/d97/la0 0 2024-02-28T16:02:07.862 INFO:tasks.workunit.client.0.smithi057.stdout:0/605: creat d6/d12/d38/db4/fd0 x:0 0 0 2024-02-28T16:02:07.863 INFO:tasks.workunit.client.0.smithi057.stdout:8/418: mkdir d5/de/d63/d70/d8e 0 2024-02-28T16:02:07.865 INFO:tasks.workunit.client.0.smithi057.stdout:7/379: mkdir d6/dc/d87 0 2024-02-28T16:02:07.866 INFO:tasks.workunit.client.0.smithi057.stdout:2/468: dread d19/d34/f4b [0,4194304] 0 2024-02-28T16:02:07.868 INFO:tasks.workunit.client.0.smithi057.stdout:9/534: creat d2/d5/d1b/d2e/d4c/da0/faa x:0 0 0 2024-02-28T16:02:07.871 INFO:tasks.workunit.client.0.smithi057.stdout:9/535: dread - d2/d46/d67/d7d/fa4 zero size 2024-02-28T16:02:07.873 INFO:tasks.workunit.client.0.smithi057.stdout:9/536: stat d2/d5/d9/d57 0 2024-02-28T16:02:07.881 INFO:tasks.workunit.client.0.smithi057.stdout:7/380: creat d6/dc/d12/d29/f88 x:0 0 0 2024-02-28T16:02:07.881 INFO:tasks.workunit.client.0.smithi057.stdout:1/487: mknod d1/d21/d66/d53/d7d/ca1 0 2024-02-28T16:02:07.882 INFO:tasks.workunit.client.0.smithi057.stdout:3/440: link d8/dd/d14/d2c/f4c d8/dd/d14/d2e/d30/d49/d86/f8d 0 2024-02-28T16:02:07.882 INFO:tasks.workunit.client.0.smithi057.stdout:7/381: chown d6/dc/d12/d1a/d4c/d6c/c72 545328 1 2024-02-28T16:02:07.885 INFO:tasks.workunit.client.0.smithi057.stdout:3/441: write d8/dd/d14/d2e/d30/d49/f63 [1671611,8103] 0 2024-02-28T16:02:07.886 INFO:tasks.workunit.client.0.smithi057.stdout:4/463: truncate d1/d10/d12/d39/f3e 3737276 0 2024-02-28T16:02:07.890 INFO:tasks.workunit.client.0.smithi057.stdout:1/488: creat d1/d3/dc/d15/d4e/d5f/fa2 x:0 0 0 2024-02-28T16:02:07.891 INFO:tasks.workunit.client.0.smithi057.stdout:2/469: dread d19/f29 [0,4194304] 0 2024-02-28T16:02:07.892 INFO:tasks.workunit.client.1.smithi087.stdout:7/843: sync 2024-02-28T16:02:07.895 INFO:tasks.workunit.client.0.smithi057.stdout:9/537: creat d2/d5/d9/d5d/d82/fab x:0 0 0 2024-02-28T16:02:07.895 INFO:tasks.workunit.client.0.smithi057.stdout:6/411: dread df/d10/f36 [0,4194304] 0 2024-02-28T16:02:07.896 INFO:tasks.workunit.client.0.smithi057.stdout:1/489: write d1/d3/dc/d15/d4e/d5f/f85 [1148669,46413] 0 2024-02-28T16:02:07.896 INFO:tasks.workunit.client.0.smithi057.stdout:5/463: link d2/d19/d1c/l2b d2/d15/d3b/d91/la7 0 2024-02-28T16:02:07.896 INFO:tasks.workunit.client.1.smithi087.stdout:7/844: write d14/d21/d4f/ff0 [473405,51189] 0 2024-02-28T16:02:07.901 INFO:tasks.workunit.client.0.smithi057.stdout:8/419: getdents d5/d62 0 2024-02-28T16:02:07.908 INFO:tasks.workunit.client.0.smithi057.stdout:0/606: dwrite d6/d12/d17/d34/f76 [0,4194304] 0 2024-02-28T16:02:07.911 INFO:tasks.workunit.client.0.smithi057.stdout:9/538: symlink d2/d5/d9/d64/lac 0 2024-02-28T16:02:07.912 INFO:tasks.workunit.client.0.smithi057.stdout:6/412: creat df/d10/d13/d4b/f89 x:0 0 0 2024-02-28T16:02:07.914 INFO:tasks.workunit.client.0.smithi057.stdout:9/539: dread - d2/d5/d1b/d2e/d77/f8e zero size 2024-02-28T16:02:07.918 INFO:tasks.workunit.client.0.smithi057.stdout:0/607: fdatasync d6/d12/d45/f4f 0 2024-02-28T16:02:07.919 INFO:tasks.workunit.client.0.smithi057.stdout:7/382: rename d6/dc/l25 to d6/dc/l89 0 2024-02-28T16:02:07.921 INFO:tasks.workunit.client.0.smithi057.stdout:2/470: link d19/d1d/d2e/d3c/f79 d19/d1d/d2e/f9c 0 2024-02-28T16:02:07.926 INFO:tasks.workunit.client.0.smithi057.stdout:9/540: rmdir d2/d5e/d65 39 2024-02-28T16:02:07.926 INFO:tasks.workunit.client.0.smithi057.stdout:1/490: dread d1/d3/dc/f56 [0,4194304] 0 2024-02-28T16:02:07.936 INFO:tasks.workunit.client.0.smithi057.stdout:6/413: dwrite df/d10/f64 [4194304,4194304] 0 2024-02-28T16:02:07.940 INFO:tasks.workunit.client.0.smithi057.stdout:2/471: symlink d19/d1d/d2e/l9d 0 2024-02-28T16:02:08.012 INFO:tasks.workunit.client.1.smithi087.stdout:9/830: symlink d7/dd/d15/lfa 0 2024-02-28T16:02:08.015 INFO:tasks.workunit.client.1.smithi087.stdout:9/831: stat d7/dd/d15/d79/d2e/feb 0 2024-02-28T16:02:08.020 INFO:tasks.workunit.client.1.smithi087.stdout:6/912: creat d4/d30/d13/d38/d69/f123 x:0 0 0 2024-02-28T16:02:08.021 INFO:tasks.workunit.client.1.smithi087.stdout:5/902: symlink d3/d9/d9b/de9/d11c/l143 0 2024-02-28T16:02:08.023 INFO:tasks.workunit.client.1.smithi087.stdout:0/833: unlink d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/c6c 0 2024-02-28T16:02:08.030 INFO:tasks.workunit.client.1.smithi087.stdout:3/930: link d11/d33/d58/l79 d11/d45/d88/d91/de3/de5/l144 0 2024-02-28T16:02:08.037 INFO:tasks.workunit.client.1.smithi087.stdout:0/834: read - d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/db6/fb9 zero size 2024-02-28T16:02:08.044 INFO:tasks.workunit.client.1.smithi087.stdout:2/829: link d2/d9a/fc5 d2/d7/dc0/d111/d97/f128 0 2024-02-28T16:02:08.044 INFO:tasks.workunit.client.1.smithi087.stdout:4/918: dread d2/d49/f51 [4194304,4194304] 0 2024-02-28T16:02:08.047 INFO:tasks.workunit.client.1.smithi087.stdout:2/830: chown d2/lb0 1141351 1 2024-02-28T16:02:08.052 INFO:tasks.workunit.client.1.smithi087.stdout:9/832: dread d7/dd/d15/f22 [0,4194304] 0 2024-02-28T16:02:08.056 INFO:tasks.workunit.client.1.smithi087.stdout:9/833: fdatasync d7/dd/d15/d3f/fb6 0 2024-02-28T16:02:08.056 INFO:tasks.workunit.client.1.smithi087.stdout:1/849: dwrite d0/d1a/f2e [4194304,4194304] 0 2024-02-28T16:02:08.058 INFO:tasks.workunit.client.1.smithi087.stdout:1/850: dread - d0/fa2 zero size 2024-02-28T16:02:08.060 INFO:tasks.workunit.client.1.smithi087.stdout:7/845: dwrite d14/f64 [0,4194304] 0 2024-02-28T16:02:08.071 INFO:tasks.workunit.client.1.smithi087.stdout:0/835: dread d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/ff9 [0,4194304] 0 2024-02-28T16:02:08.074 INFO:tasks.workunit.client.1.smithi087.stdout:0/836: truncate d4/dd/d37/d39/d3a/d57/d74/d1f/ff1 972892 0 2024-02-28T16:02:08.180 INFO:tasks.workunit.client.0.smithi057.stdout:6/414: read df/d14/f2d [212393,27769] 0 2024-02-28T16:02:08.181 INFO:tasks.workunit.client.0.smithi057.stdout:1/491: dread d1/d3/dc/d15/d4e/d5f/f85 [0,4194304] 0 2024-02-28T16:02:08.183 INFO:tasks.workunit.client.0.smithi057.stdout:4/464: dwrite d1/d3f/f53 [0,4194304] 0 2024-02-28T16:02:08.183 INFO:tasks.workunit.client.0.smithi057.stdout:7/383: write d6/dc/d12/f21 [13885,123716] 0 2024-02-28T16:02:08.188 INFO:tasks.workunit.client.0.smithi057.stdout:6/415: chown df/f53 3 1 2024-02-28T16:02:08.191 INFO:tasks.workunit.client.0.smithi057.stdout:3/442: dwrite d8/dd/d14/d2e/d76/d89/f87 [0,4194304] 0 2024-02-28T16:02:08.200 INFO:tasks.workunit.client.0.smithi057.stdout:3/443: write d8/dd/d14/d2e/d30/f64 [672590,102539] 0 2024-02-28T16:02:08.209 INFO:tasks.workunit.client.0.smithi057.stdout:9/541: dwrite d2/d5/d9/f35 [0,4194304] 0 2024-02-28T16:02:08.210 INFO:tasks.workunit.client.0.smithi057.stdout:3/444: write d8/dd/d14/d2e/d3b/d71/f77 [483022,70771] 0 2024-02-28T16:02:08.216 INFO:tasks.workunit.client.0.smithi057.stdout:2/472: dwrite fe [0,4194304] 0 2024-02-28T16:02:08.216 INFO:tasks.workunit.client.0.smithi057.stdout:3/445: write d8/dd/d14/d2e/d30/d5f/f85 [619619,12550] 0 2024-02-28T16:02:08.220 INFO:tasks.workunit.client.0.smithi057.stdout:7/384: dwrite d6/dc/d35/f46 [0,4194304] 0 2024-02-28T16:02:08.234 INFO:tasks.workunit.client.0.smithi057.stdout:4/465: symlink d1/d10/d31/d36/la2 0 2024-02-28T16:02:08.235 INFO:tasks.workunit.client.0.smithi057.stdout:6/416: fdatasync df/d10/d13/d4b/f51 0 2024-02-28T16:02:08.238 INFO:tasks.workunit.client.0.smithi057.stdout:2/473: mkdir d19/d2c/d65/d9e 0 2024-02-28T16:02:08.239 INFO:tasks.workunit.client.0.smithi057.stdout:9/542: write d2/d5/f30 [1252564,57986] 0 2024-02-28T16:02:08.242 INFO:tasks.workunit.client.0.smithi057.stdout:3/446: symlink d8/dd/d19/d25/l8e 0 2024-02-28T16:02:08.243 INFO:tasks.workunit.client.0.smithi057.stdout:1/492: dread d1/d21/d25/f64 [0,4194304] 0 2024-02-28T16:02:08.244 INFO:tasks.workunit.client.0.smithi057.stdout:6/417: truncate df/d10/d13/d4b/f89 642239 0 2024-02-28T16:02:08.249 INFO:tasks.workunit.client.0.smithi057.stdout:9/543: mknod d2/d5/d1b/d2e/d4c/da0/cad 0 2024-02-28T16:02:08.250 INFO:tasks.workunit.client.0.smithi057.stdout:6/418: truncate df/d14/d15/d16/f81 504153 0 2024-02-28T16:02:08.252 INFO:tasks.workunit.client.0.smithi057.stdout:1/493: mkdir d1/d3/dc/d15/da3 0 2024-02-28T16:02:08.255 INFO:tasks.workunit.client.0.smithi057.stdout:6/419: dread - df/d10/d13/d4b/d4e/f86 zero size 2024-02-28T16:02:08.257 INFO:tasks.workunit.client.0.smithi057.stdout:1/494: chown d1/d21/d66/d53/d7d/d67/d7a/d92/f9d 0 1 2024-02-28T16:02:08.263 INFO:tasks.workunit.client.0.smithi057.stdout:1/495: mknod d1/d21/d66/d53/d7d/d67/ca4 0 2024-02-28T16:02:08.266 INFO:tasks.workunit.client.0.smithi057.stdout:1/496: write d1/d21/d25/f3d [346663,93485] 0 2024-02-28T16:02:08.271 INFO:tasks.workunit.client.1.smithi087.stdout:5/903: getdents d3/d9/d9b/dba/d30/d36/d112/d12d/d138 0 2024-02-28T16:02:08.272 INFO:tasks.workunit.client.1.smithi087.stdout:8/902: creat d2/d9/f12a x:0 0 0 2024-02-28T16:02:08.273 INFO:tasks.workunit.client.0.smithi057.stdout:1/497: dread d1/d21/d66/d44/d4c/f76 [0,4194304] 0 2024-02-28T16:02:08.273 INFO:tasks.workunit.client.0.smithi057.stdout:2/474: dread d19/d1d/d2e/d3c/f3d [0,4194304] 0 2024-02-28T16:02:08.275 INFO:tasks.workunit.client.1.smithi087.stdout:5/904: write d3/d9/d9b/dba/f2b [1732783,25665] 0 2024-02-28T16:02:08.275 INFO:tasks.workunit.client.1.smithi087.stdout:4/919: symlink d2/d9/d9e/d106/l127 0 2024-02-28T16:02:08.278 INFO:tasks.workunit.client.0.smithi057.stdout:1/498: creat d1/d21/d66/d53/d7d/d65/fa5 x:0 0 0 2024-02-28T16:02:08.278 INFO:tasks.workunit.client.1.smithi087.stdout:4/920: chown d2/d9/d10/d22/c78 1556 1 2024-02-28T16:02:08.281 INFO:tasks.workunit.client.1.smithi087.stdout:2/831: rename d2/d9a/dd3 to d2/d99/d28/d79/d9f/de1/d129 0 2024-02-28T16:02:08.281 INFO:tasks.workunit.client.1.smithi087.stdout:9/834: mknod d7/dd/d15/d3f/d6d/cfb 0 2024-02-28T16:02:08.285 INFO:tasks.workunit.client.1.smithi087.stdout:2/832: chown d2/d7/dc0/d111/d34 8439088 1 2024-02-28T16:02:08.285 INFO:tasks.workunit.client.1.smithi087.stdout:7/846: creat d14/d2e/dab/f109 x:0 0 0 2024-02-28T16:02:08.287 INFO:tasks.workunit.client.1.smithi087.stdout:9/835: chown d7/dd/d15/d3f/d5f/d90/ddd/ddf 2431237 1 2024-02-28T16:02:08.292 INFO:tasks.workunit.client.1.smithi087.stdout:9/836: chown d7/dd/d3c/d4c/da1/fb7 429342195 1 2024-02-28T16:02:08.304 INFO:tasks.workunit.client.1.smithi087.stdout:0/837: dwrite d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/f64 [0,4194304] 0 2024-02-28T16:02:08.318 INFO:tasks.workunit.client.1.smithi087.stdout:0/838: dwrite d4/dd/d21/d5f/fb7 [0,4194304] 0 2024-02-28T16:02:08.325 INFO:tasks.workunit.client.1.smithi087.stdout:3/931: fsync d11/d7b/dab/fb3 0 2024-02-28T16:02:08.327 INFO:tasks.workunit.client.1.smithi087.stdout:8/903: creat d2/d18/df5/d104/f12b x:0 0 0 2024-02-28T16:02:08.328 INFO:tasks.workunit.client.1.smithi087.stdout:4/921: creat d2/d9/d10/d22/d5b/d5c/d68/dc5/df1/f128 x:0 0 0 2024-02-28T16:02:08.330 INFO:tasks.workunit.client.1.smithi087.stdout:1/851: truncate d0/d1b/f47 1318992 0 2024-02-28T16:02:08.330 INFO:tasks.workunit.client.1.smithi087.stdout:2/833: mknod d2/d7d/c12a 0 2024-02-28T16:02:08.334 INFO:tasks.workunit.client.1.smithi087.stdout:9/837: rename d7/dd/d15/d55/fe5 to d7/dd/d15/d3f/d5f/d90/ddd/ffc 0 2024-02-28T16:02:08.336 INFO:tasks.workunit.client.1.smithi087.stdout:1/852: chown d0/d1b/d1f/d71/db2/dae 5439375 1 2024-02-28T16:02:08.337 INFO:tasks.workunit.client.1.smithi087.stdout:3/932: fdatasync d11/d44/f57 0 2024-02-28T16:02:08.338 INFO:tasks.workunit.client.1.smithi087.stdout:5/905: getdents d3/d9/d9b/dba/d30/d36/d112/d12d/d138 0 2024-02-28T16:02:08.345 INFO:tasks.workunit.client.1.smithi087.stdout:4/922: mkdir d2/d9/d10/d22/d5b/d5c/d90/d129 0 2024-02-28T16:02:08.345 INFO:tasks.workunit.client.1.smithi087.stdout:0/839: dwrite d4/dd/d21/d5f/fb7 [0,4194304] 0 2024-02-28T16:02:08.349 INFO:tasks.workunit.client.1.smithi087.stdout:8/904: creat d2/d18/d42/f12c x:0 0 0 2024-02-28T16:02:08.349 INFO:tasks.workunit.client.1.smithi087.stdout:0/840: chown d4/dd/d26/d93/fbc 138 1 2024-02-28T16:02:08.353 INFO:tasks.workunit.client.1.smithi087.stdout:0/841: write d4/d6/dc/f99 [2263468,13641] 0 2024-02-28T16:02:08.353 INFO:tasks.workunit.client.1.smithi087.stdout:2/834: creat d2/d7/dc0/d111/f12b x:0 0 0 2024-02-28T16:02:08.355 INFO:tasks.workunit.client.1.smithi087.stdout:3/933: rename d11/d33/d67/d9c/fb2 to d11/d44/d5b/d127/f145 0 2024-02-28T16:02:08.356 INFO:tasks.workunit.client.1.smithi087.stdout:0/842: stat d4/dd/d21/d5f/f72 0 2024-02-28T16:02:08.358 INFO:tasks.workunit.client.1.smithi087.stdout:8/905: symlink d2/d18/df5/d104/d116/l12d 0 2024-02-28T16:02:08.358 INFO:tasks.workunit.client.0.smithi057.stdout:7/385: truncate d6/dc/d12/d1a/d4c/d63/f80 1247373 0 2024-02-28T16:02:08.359 INFO:tasks.workunit.client.0.smithi057.stdout:2/475: creat d19/d1d/d2e/f9f x:0 0 0 2024-02-28T16:02:08.359 INFO:tasks.workunit.client.0.smithi057.stdout:3/447: write d8/dd/f41 [774795,31768] 0 2024-02-28T16:02:08.360 INFO:tasks.workunit.client.1.smithi087.stdout:5/906: dwrite d3/d9/fd [4194304,4194304] 0 2024-02-28T16:02:08.362 INFO:tasks.workunit.client.1.smithi087.stdout:0/843: write d4/dd/d37/d39/d3a/fc5 [4578889,103776] 0 2024-02-28T16:02:08.364 INFO:tasks.workunit.client.1.smithi087.stdout:4/923: creat d2/dc1/d125/f12a x:0 0 0 2024-02-28T16:02:08.370 INFO:tasks.workunit.client.1.smithi087.stdout:2/835: mknod d2/d7/c12c 0 2024-02-28T16:02:08.378 INFO:tasks.workunit.client.1.smithi087.stdout:5/907: mkdir d3/d9/d9b/dba/dca/d144 0 2024-02-28T16:02:08.378 INFO:tasks.workunit.client.1.smithi087.stdout:8/906: symlink d2/d63/d9b/dd5/dd9/df1/l12e 0 2024-02-28T16:02:08.378 INFO:tasks.workunit.client.1.smithi087.stdout:4/924: fdatasync d2/df/d2e/dad/f118 0 2024-02-28T16:02:08.382 INFO:tasks.workunit.client.1.smithi087.stdout:2/836: symlink d2/d7/dc0/d111/d34/d88/l12d 0 2024-02-28T16:02:08.384 INFO:tasks.workunit.client.1.smithi087.stdout:0/844: mkdir d4/dd/ddc/d112 0 2024-02-28T16:02:08.384 INFO:tasks.workunit.client.1.smithi087.stdout:8/907: write d2/d18/d42/dbb/fcc [2112140,37937] 0 2024-02-28T16:02:08.386 INFO:tasks.workunit.client.1.smithi087.stdout:7/847: dread d14/d2e/d2b/d4e/f52 [0,4194304] 0 2024-02-28T16:02:08.388 INFO:tasks.workunit.client.1.smithi087.stdout:8/908: write d2/d18/d42/f12c [963279,32110] 0 2024-02-28T16:02:08.389 INFO:tasks.workunit.client.1.smithi087.stdout:4/925: mkdir d2/d9/d9e/d12b 0 2024-02-28T16:02:08.389 INFO:tasks.workunit.client.1.smithi087.stdout:7/848: chown d14/d21/d4f/f53 16 1 2024-02-28T16:02:08.391 INFO:tasks.workunit.client.0.smithi057.stdout:6/420: dread df/d10/d13/f2e [0,4194304] 0 2024-02-28T16:02:08.398 INFO:tasks.workunit.client.1.smithi087.stdout:4/926: mknod d2/d9/d9e/d106/c12c 0 2024-02-28T16:02:08.400 INFO:tasks.workunit.client.1.smithi087.stdout:2/837: getdents d2/d42/d4b 0 2024-02-28T16:02:08.404 INFO:tasks.workunit.client.1.smithi087.stdout:8/909: truncate d2/d9/d5e/d9c/fe0 842580 0 2024-02-28T16:02:08.408 INFO:tasks.workunit.client.1.smithi087.stdout:8/910: chown d2/d9/f12a 70 1 2024-02-28T16:02:08.412 INFO:tasks.workunit.client.1.smithi087.stdout:9/838: rmdir d7/dd/d15/d55 39 2024-02-28T16:02:08.415 INFO:tasks.workunit.client.1.smithi087.stdout:0/845: link d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/l104 d4/dd/d37/d39/d3a/d57/d74/l113 0 2024-02-28T16:02:08.416 INFO:tasks.workunit.client.0.smithi057.stdout:3/448: dread d8/dd/d14/d2e/d2f/f82 [0,4194304] 0 2024-02-28T16:02:08.417 INFO:tasks.workunit.client.1.smithi087.stdout:3/934: dread d11/f30 [0,4194304] 0 2024-02-28T16:02:08.417 INFO:tasks.workunit.client.1.smithi087.stdout:8/911: creat d2/d63/f12f x:0 0 0 2024-02-28T16:02:08.418 INFO:tasks.workunit.client.0.smithi057.stdout:3/449: write d8/dd/d14/d2e/f67 [4129782,113310] 0 2024-02-28T16:02:08.419 INFO:tasks.workunit.client.1.smithi087.stdout:1/853: write d0/d14/f17 [39549,79066] 0 2024-02-28T16:02:08.420 INFO:tasks.workunit.client.1.smithi087.stdout:0/846: mkdir d4/dd/d21/d9b/d7c/d114 0 2024-02-28T16:02:08.421 INFO:tasks.workunit.client.0.smithi057.stdout:3/450: write d8/d26/f7e [877473,21430] 0 2024-02-28T16:02:08.422 INFO:tasks.workunit.client.1.smithi087.stdout:4/927: dwrite d2/df/d62/fdb [4194304,4194304] 0 2024-02-28T16:02:08.426 INFO:tasks.workunit.client.0.smithi057.stdout:3/451: fdatasync d8/dd/d14/d2e/f67 0 2024-02-28T16:02:08.426 INFO:tasks.workunit.client.1.smithi087.stdout:9/839: unlink d7/dd/f2d 0 2024-02-28T16:02:08.427 INFO:tasks.workunit.client.1.smithi087.stdout:3/935: symlink d11/d33/d58/d8c/l146 0 2024-02-28T16:02:08.427 INFO:tasks.workunit.client.1.smithi087.stdout:1/854: dread - d0/d1b/d1f/d96/dd8/f109 zero size 2024-02-28T16:02:08.427 INFO:tasks.workunit.client.0.smithi057.stdout:3/452: chown d8/dd/d14/d2e/d2f 14700 1 2024-02-28T16:02:08.431 INFO:tasks.workunit.client.1.smithi087.stdout:1/855: read d0/d1b/d1f/d96/fcc [1078382,99567] 0 2024-02-28T16:02:08.433 INFO:tasks.workunit.client.1.smithi087.stdout:9/840: dread - d7/f9b zero size 2024-02-28T16:02:08.433 INFO:tasks.workunit.client.1.smithi087.stdout:8/912: dread d2/fa9 [0,4194304] 0 2024-02-28T16:02:08.433 INFO:tasks.workunit.client.1.smithi087.stdout:1/856: chown d0/c9 1387206 1 2024-02-28T16:02:08.435 INFO:tasks.workunit.client.1.smithi087.stdout:1/857: dread - d0/d1b/d1f/d96/fa4 zero size 2024-02-28T16:02:08.438 INFO:tasks.workunit.client.1.smithi087.stdout:7/849: write d14/d2e/f78 [518974,73914] 0 2024-02-28T16:02:08.439 INFO:tasks.workunit.client.0.smithi057.stdout:0/608: sync 2024-02-28T16:02:08.439 INFO:tasks.workunit.client.0.smithi057.stdout:8/420: sync 2024-02-28T16:02:08.439 INFO:tasks.workunit.client.0.smithi057.stdout:5/464: sync 2024-02-28T16:02:08.439 INFO:tasks.workunit.client.0.smithi057.stdout:9/544: sync 2024-02-28T16:02:08.441 INFO:tasks.workunit.client.1.smithi087.stdout:3/936: creat d11/d3a/dd1/d13c/f147 x:0 0 0 2024-02-28T16:02:08.442 INFO:tasks.workunit.client.1.smithi087.stdout:3/937: readlink d11/d61/d65/le6 0 2024-02-28T16:02:08.443 INFO:tasks.workunit.client.0.smithi057.stdout:8/421: chown d5/f31 4590277 1 2024-02-28T16:02:08.444 INFO:tasks.workunit.client.1.smithi087.stdout:3/938: chown d11/d7b/dab 1246 1 2024-02-28T16:02:08.445 INFO:tasks.workunit.client.0.smithi057.stdout:0/609: chown d6/d12/d17/d4b/c94 218729855 1 2024-02-28T16:02:08.445 INFO:tasks.workunit.client.1.smithi087.stdout:7/850: truncate d14/d2e/d89/deb/d5d/d6a/d83/df5/ff9 13763 0 2024-02-28T16:02:08.446 INFO:tasks.workunit.client.1.smithi087.stdout:8/913: symlink d2/d63/d9b/dae/l130 0 2024-02-28T16:02:08.446 INFO:tasks.workunit.client.0.smithi057.stdout:3/453: dwrite d8/dd/d14/d2c/f80 [0,4194304] 0 2024-02-28T16:02:08.447 INFO:tasks.workunit.client.1.smithi087.stdout:1/858: mkdir d0/d14/d3f/d119 0 2024-02-28T16:02:08.448 INFO:tasks.workunit.client.1.smithi087.stdout:3/939: chown d11/f30 6879 1 2024-02-28T16:02:08.449 INFO:tasks.workunit.client.0.smithi057.stdout:3/454: truncate d8/dd/d14/d2e/d2f/f65 980943 0 2024-02-28T16:02:08.453 INFO:tasks.workunit.client.1.smithi087.stdout:8/914: mknod d2/d7c/c131 0 2024-02-28T16:02:08.454 INFO:tasks.workunit.client.1.smithi087.stdout:9/841: creat d7/ffd x:0 0 0 2024-02-28T16:02:08.456 INFO:tasks.workunit.client.1.smithi087.stdout:7/851: mknod d14/c10a 0 2024-02-28T16:02:08.457 INFO:tasks.workunit.client.1.smithi087.stdout:3/940: fsync d11/d3a/d3c/f12a 0 2024-02-28T16:02:08.457 INFO:tasks.workunit.client.1.smithi087.stdout:0/847: dread d4/dd/d37/d39/d3a/fc5 [0,4194304] 0 2024-02-28T16:02:08.459 INFO:tasks.workunit.client.1.smithi087.stdout:1/859: truncate d0/d14/d3f/dd5/fe1 715146 0 2024-02-28T16:02:08.461 INFO:tasks.workunit.client.1.smithi087.stdout:2/838: dwrite d2/d99/d28/d54/da6/fbb [0,4194304] 0 2024-02-28T16:02:08.463 INFO:tasks.workunit.client.1.smithi087.stdout:8/915: write d2/d18/f3c [1892928,8467] 0 2024-02-28T16:02:08.467 INFO:tasks.workunit.client.1.smithi087.stdout:9/842: chown d7/dd/d15/d3f/d6d/c77 163 1 2024-02-28T16:02:08.469 INFO:tasks.workunit.client.1.smithi087.stdout:3/941: mknod d11/d7b/dab/de7/d104/c148 0 2024-02-28T16:02:08.473 INFO:tasks.workunit.client.1.smithi087.stdout:9/843: chown d7/dd/d15/d79/d2e/dbd/lec 85953564 1 2024-02-28T16:02:08.476 INFO:tasks.workunit.client.1.smithi087.stdout:7/852: mknod d14/d2e/d89/deb/d5d/dac/c10b 0 2024-02-28T16:02:08.477 INFO:tasks.workunit.client.1.smithi087.stdout:2/839: rmdir d2/d7/dc0/d111 39 2024-02-28T16:02:08.479 INFO:tasks.workunit.client.1.smithi087.stdout:3/942: fsync d11/f30 0 2024-02-28T16:02:08.481 INFO:tasks.workunit.client.1.smithi087.stdout:9/844: write d7/dd/d15/d3f/d6d/dcd/fcf [4023561,122876] 0 2024-02-28T16:02:08.486 INFO:tasks.workunit.client.1.smithi087.stdout:4/928: dread d2/df/d2e/f9a [0,4194304] 0 2024-02-28T16:02:08.489 INFO:tasks.workunit.client.1.smithi087.stdout:9/845: write d7/d1e/dc4/fd5 [479753,41507] 0 2024-02-28T16:02:08.490 INFO:tasks.workunit.client.1.smithi087.stdout:1/860: dwrite d0/d1a/d28/d9b/fd6 [0,4194304] 0 2024-02-28T16:02:08.491 INFO:tasks.workunit.client.1.smithi087.stdout:7/853: symlink d14/d2e/d2b/d4e/l10c 0 2024-02-28T16:02:08.500 INFO:tasks.workunit.client.1.smithi087.stdout:8/916: getdents d2/d33 0 2024-02-28T16:02:08.504 INFO:tasks.workunit.client.1.smithi087.stdout:0/848: dread d4/dd/d21/d9b/f6f [0,4194304] 0 2024-02-28T16:02:08.505 INFO:tasks.workunit.client.1.smithi087.stdout:4/929: fsync d2/d9/d10/d22/d5b/d5c/d91/da9/fcc 0 2024-02-28T16:02:08.508 INFO:tasks.workunit.client.1.smithi087.stdout:1/861: symlink d0/d1b/d43/de3/l11a 0 2024-02-28T16:02:08.509 INFO:tasks.workunit.client.1.smithi087.stdout:3/943: creat d11/d33/f149 x:0 0 0 2024-02-28T16:02:08.511 INFO:tasks.workunit.client.1.smithi087.stdout:8/917: creat d2/d63/d9b/dae/f132 x:0 0 0 2024-02-28T16:02:08.514 INFO:tasks.workunit.client.1.smithi087.stdout:4/930: truncate d2/d9/d10/d22/f72 105303 0 2024-02-28T16:02:08.514 INFO:tasks.workunit.client.1.smithi087.stdout:0/849: getdents d4/dd/ddc 0 2024-02-28T16:02:08.515 INFO:tasks.workunit.client.1.smithi087.stdout:1/862: write d0/d1b/d1f/d71/f103 [1048508,100505] 0 2024-02-28T16:02:08.519 INFO:tasks.workunit.client.1.smithi087.stdout:3/944: symlink d11/d33/d58/l14a 0 2024-02-28T16:02:08.521 INFO:tasks.workunit.client.1.smithi087.stdout:8/918: creat d2/d9/f133 x:0 0 0 2024-02-28T16:02:08.524 INFO:tasks.workunit.client.1.smithi087.stdout:7/854: dwrite d14/d2e/d2b/f50 [0,4194304] 0 2024-02-28T16:02:08.525 INFO:tasks.workunit.client.1.smithi087.stdout:0/850: creat d4/dd/d21/d9b/d7c/d114/f115 x:0 0 0 2024-02-28T16:02:08.528 INFO:tasks.workunit.client.1.smithi087.stdout:2/840: dread d2/f21 [0,4194304] 0 2024-02-28T16:02:08.531 INFO:tasks.workunit.client.1.smithi087.stdout:3/945: rmdir d11/d61/d65 39 2024-02-28T16:02:08.531 INFO:tasks.workunit.client.1.smithi087.stdout:0/851: write d4/d6/ddb/fde [4453772,106294] 0 2024-02-28T16:02:08.533 INFO:tasks.workunit.client.1.smithi087.stdout:4/931: dread d2/d49/fd5 [0,4194304] 0 2024-02-28T16:02:08.534 INFO:tasks.workunit.client.1.smithi087.stdout:8/919: truncate d2/d9/d5e/d9c/fec 33636 0 2024-02-28T16:02:08.536 INFO:tasks.workunit.client.1.smithi087.stdout:1/863: getdents d0/d1b/d1f 0 2024-02-28T16:02:08.540 INFO:tasks.workunit.client.1.smithi087.stdout:0/852: creat d4/dd/d21/d9b/d7c/f116 x:0 0 0 2024-02-28T16:02:08.541 INFO:tasks.workunit.client.1.smithi087.stdout:7/855: rmdir d14/d2e/d89/deb/d5d/d6a/d83/df5/dfe 0 2024-02-28T16:02:08.543 INFO:tasks.workunit.client.1.smithi087.stdout:9/846: dread d7/dd/d15/d3f/d6d/dcd/fcf [0,4194304] 0 2024-02-28T16:02:08.547 INFO:tasks.workunit.client.1.smithi087.stdout:1/864: unlink d0/d14/f93 0 2024-02-28T16:02:08.549 INFO:tasks.workunit.client.1.smithi087.stdout:0/853: truncate d4/d6/dc/fcf 632288 0 2024-02-28T16:02:08.549 INFO:tasks.workunit.client.1.smithi087.stdout:4/932: creat d2/d9/da/d1a/f12d x:0 0 0 2024-02-28T16:02:08.551 INFO:tasks.workunit.client.1.smithi087.stdout:1/865: unlink d0/d1a/f3a 0 2024-02-28T16:02:08.554 INFO:tasks.workunit.client.1.smithi087.stdout:9/847: mkdir d7/dd/d15/d3f/d5f/d90/dfe 0 2024-02-28T16:02:08.556 INFO:tasks.workunit.client.1.smithi087.stdout:1/866: chown d0/d1b/d1f/d71/db2/d24/d5c/d69 233046591 1 2024-02-28T16:02:08.558 INFO:tasks.workunit.client.1.smithi087.stdout:8/920: link d2/d18/df5/f10d d2/d18/d42/d62/de8/df6/f134 0 2024-02-28T16:02:08.560 INFO:tasks.workunit.client.1.smithi087.stdout:3/946: dwrite d11/d45/f13f [0,4194304] 0 2024-02-28T16:02:08.561 INFO:tasks.workunit.client.1.smithi087.stdout:8/921: write d2/d9/f5d [845013,9641] 0 2024-02-28T16:02:08.563 INFO:tasks.workunit.client.1.smithi087.stdout:8/922: chown d2/d9/d5e/d9c 9804 1 2024-02-28T16:02:08.564 INFO:tasks.workunit.client.1.smithi087.stdout:9/848: creat d7/dd/d15/d3f/dc6/fff x:0 0 0 2024-02-28T16:02:08.569 INFO:tasks.workunit.client.1.smithi087.stdout:2/841: truncate d2/d99/d28/d79/d9f/de1/d129/fd5 359665 0 2024-02-28T16:02:08.575 INFO:tasks.workunit.client.1.smithi087.stdout:7/856: getdents d14/d7d 0 2024-02-28T16:02:08.583 INFO:tasks.workunit.client.1.smithi087.stdout:1/867: write d0/d1b/d1f/d71/db2/d24/f58 [150148,2907] 0 2024-02-28T16:02:08.584 INFO:tasks.workunit.client.1.smithi087.stdout:8/923: dwrite d2/d9/d5e/fcd [4194304,4194304] 0 2024-02-28T16:02:08.586 INFO:tasks.workunit.client.1.smithi087.stdout:2/842: unlink d2/d7/dec/l6d 0 2024-02-28T16:02:08.589 INFO:tasks.workunit.client.1.smithi087.stdout:7/857: mkdir d14/d2e/d2b/d4e/d10d 0 2024-02-28T16:02:08.593 INFO:tasks.workunit.client.1.smithi087.stdout:9/849: fdatasync d7/dd/f28 0 2024-02-28T16:02:08.594 INFO:tasks.workunit.client.1.smithi087.stdout:1/868: unlink d0/d1b/d43/d4d/f51 0 2024-02-28T16:02:08.606 INFO:tasks.workunit.client.1.smithi087.stdout:9/850: rename d7/dd/d99/da3/cda to d7/dd/d15/d79/d2e/dbd/c100 0 2024-02-28T16:02:08.606 INFO:tasks.workunit.client.1.smithi087.stdout:2/843: mkdir d2/d7/d12e 0 2024-02-28T16:02:08.607 INFO:tasks.workunit.client.1.smithi087.stdout:3/947: link d11/f26 d11/d61/d7c/db7/d132/f14b 0 2024-02-28T16:02:08.613 INFO:tasks.workunit.client.1.smithi087.stdout:9/851: mkdir d7/d101 0 2024-02-28T16:02:08.614 INFO:tasks.workunit.client.1.smithi087.stdout:0/854: truncate d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/f64 2072194 0 2024-02-28T16:02:08.616 INFO:tasks.workunit.client.1.smithi087.stdout:3/948: creat d11/d33/d67/d9c/da1/f14c x:0 0 0 2024-02-28T16:02:08.616 INFO:tasks.workunit.client.1.smithi087.stdout:7/858: dwrite d14/d2e/d89/deb/f102 [0,4194304] 0 2024-02-28T16:02:08.617 INFO:tasks.workunit.client.1.smithi087.stdout:9/852: fsync d7/dd/d15/d79/d2e/ff7 0 2024-02-28T16:02:08.617 INFO:tasks.workunit.client.1.smithi087.stdout:1/869: mkdir d0/d1b/d1f/d71/db2/dae/d11b 0 2024-02-28T16:02:08.621 INFO:tasks.workunit.client.1.smithi087.stdout:7/859: mknod d14/d2e/d2b/d57/c10e 0 2024-02-28T16:02:08.622 INFO:tasks.workunit.client.1.smithi087.stdout:2/844: link d2/d99/d28/d54/l69 d2/d42/df1/l12f 0 2024-02-28T16:02:08.622 INFO:tasks.workunit.client.1.smithi087.stdout:9/853: read d7/dd/d99/da3/fa6 [2512714,41191] 0 2024-02-28T16:02:08.623 INFO:tasks.workunit.client.1.smithi087.stdout:8/924: dread d2/d18/d42/f84 [0,4194304] 0 2024-02-28T16:02:08.631 INFO:tasks.workunit.client.1.smithi087.stdout:1/870: rename d0/d14/d86/dac/le6 to d0/d1b/d1f/d96/dd8/l11c 0 2024-02-28T16:02:08.632 INFO:tasks.workunit.client.1.smithi087.stdout:3/949: dread d11/d33/d67/d9c/fb1 [0,4194304] 0 2024-02-28T16:02:08.633 INFO:tasks.workunit.client.1.smithi087.stdout:8/925: rmdir d2/d63/d9b/dd5 39 2024-02-28T16:02:08.636 INFO:tasks.workunit.client.1.smithi087.stdout:0/855: dwrite d4/dd/d21/d9b/d7c/d114/f115 [0,4194304] 0 2024-02-28T16:02:08.636 INFO:tasks.workunit.client.1.smithi087.stdout:3/950: chown d11/d33/ca6 2228 1 2024-02-28T16:02:08.637 INFO:tasks.workunit.client.1.smithi087.stdout:2/845: unlink d2/d7/dc0/d111/l77 0 2024-02-28T16:02:08.643 INFO:tasks.workunit.client.1.smithi087.stdout:8/926: mkdir d2/d18/d42/d62/de8/df6/d135 0 2024-02-28T16:02:08.644 INFO:tasks.workunit.client.1.smithi087.stdout:3/951: write d11/d61/d7c/f84 [3418227,127936] 0 2024-02-28T16:02:08.647 INFO:tasks.workunit.client.1.smithi087.stdout:7/860: link d14/d21/c24 d14/d2e/d89/deb/d5d/dac/c10f 0 2024-02-28T16:02:08.647 INFO:tasks.workunit.client.1.smithi087.stdout:3/952: fdatasync d11/d33/d74/f11a 0 2024-02-28T16:02:08.648 INFO:tasks.workunit.client.1.smithi087.stdout:0/856: mknod d4/d6/dc/d45/db4/df2/c117 0 2024-02-28T16:02:08.648 INFO:tasks.workunit.client.1.smithi087.stdout:9/854: dwrite d7/dd/d36/fef [0,4194304] 0 2024-02-28T16:02:08.650 INFO:tasks.workunit.client.1.smithi087.stdout:7/861: stat d14/d2e/d2b/l54 0 2024-02-28T16:02:08.655 INFO:tasks.workunit.client.1.smithi087.stdout:3/953: rmdir d11/d61/d65 39 2024-02-28T16:02:08.655 INFO:tasks.workunit.client.1.smithi087.stdout:0/857: creat d4/d6/df4/f118 x:0 0 0 2024-02-28T16:02:08.658 INFO:tasks.workunit.client.1.smithi087.stdout:1/871: truncate d0/d1b/d1f/d71/db2/db3/fcb 975546 0 2024-02-28T16:02:08.659 INFO:tasks.workunit.client.1.smithi087.stdout:7/862: write d14/d7d/fb5 [3802524,68638] 0 2024-02-28T16:02:08.661 INFO:tasks.workunit.client.1.smithi087.stdout:0/858: mknod d4/d6/ddb/c119 0 2024-02-28T16:02:08.664 INFO:tasks.workunit.client.1.smithi087.stdout:1/872: mknod d0/d1b/d1f/d71/dad/d10f/c11d 0 2024-02-28T16:02:08.667 INFO:tasks.workunit.client.1.smithi087.stdout:0/859: mkdir d4/dd/d37/d39/d3a/d57/d74/d1f/d60/d11a 0 2024-02-28T16:02:08.668 INFO:tasks.workunit.client.1.smithi087.stdout:7/863: truncate d14/d2e/d89/deb/d5d/d6a/fbe 862606 0 2024-02-28T16:02:08.672 INFO:tasks.workunit.client.1.smithi087.stdout:1/873: chown d0/d1b/d1f/d71/db2/f6e 6295 1 2024-02-28T16:02:08.675 INFO:tasks.workunit.client.1.smithi087.stdout:1/874: read d0/d1b/d1f/d71/fe4 [554373,49819] 0 2024-02-28T16:02:08.675 INFO:tasks.workunit.client.1.smithi087.stdout:7/864: getdents d14/d21/de4/de7 0 2024-02-28T16:02:08.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:08 smithi057 ceph-mon[28763]: pgmap v36: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 95 MiB/s rd, 264 MiB/s wr, 478 op/s 2024-02-28T16:02:08.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:08 smithi057 ceph-mon[28763]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:02:08.683 INFO:tasks.workunit.client.1.smithi087.stdout:0/860: write d4/dd/d37/f3d [2963564,37255] 0 2024-02-28T16:02:08.689 INFO:tasks.workunit.client.1.smithi087.stdout:9/855: dread d7/dd/d99/da3/fa6 [0,4194304] 0 2024-02-28T16:02:08.693 INFO:tasks.workunit.client.1.smithi087.stdout:9/856: chown d7/d1e/d44/d76/c6e 10 1 2024-02-28T16:02:08.696 INFO:tasks.workunit.client.1.smithi087.stdout:3/954: dread d11/d33/d58/f81 [0,4194304] 0 2024-02-28T16:02:08.697 INFO:tasks.workunit.client.1.smithi087.stdout:1/875: dwrite d0/d1a/d28/f7f [4194304,4194304] 0 2024-02-28T16:02:08.697 INFO:tasks.workunit.client.1.smithi087.stdout:7/865: dwrite d14/d2e/d89/deb/d5d/f70 [0,4194304] 0 2024-02-28T16:02:08.700 INFO:tasks.workunit.client.1.smithi087.stdout:9/857: stat d7/dd/d15/d3f/d5f/fb1 0 2024-02-28T16:02:08.702 INFO:tasks.workunit.client.1.smithi087.stdout:0/861: link d4/dd/d37/d39/d3a/d57/d74/d1f/d60/f109 d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/f11b 0 2024-02-28T16:02:08.704 INFO:tasks.workunit.client.1.smithi087.stdout:9/858: fdatasync d7/dd/fe 0 2024-02-28T16:02:08.705 INFO:tasks.workunit.client.1.smithi087.stdout:0/862: readlink d4/dd/d37/d39/d3a/l3f 0 2024-02-28T16:02:08.707 INFO:tasks.workunit.client.1.smithi087.stdout:9/859: stat d7/dd/d15/d79/d2e/dbd 0 2024-02-28T16:02:08.708 INFO:tasks.workunit.client.1.smithi087.stdout:7/866: symlink d14/d2e/d89/deb/d55/l110 0 2024-02-28T16:02:08.708 INFO:tasks.workunit.client.1.smithi087.stdout:3/955: read - d11/d33/d58/d8c/dca/fd2 zero size 2024-02-28T16:02:08.708 INFO:tasks.workunit.client.1.smithi087.stdout:0/863: chown d4/dd/d37/fcb 236931 1 2024-02-28T16:02:08.711 INFO:tasks.workunit.client.1.smithi087.stdout:9/860: fdatasync d7/f9b 0 2024-02-28T16:02:08.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:08 smithi087 ceph-mon[37122]: pgmap v36: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 95 MiB/s rd, 264 MiB/s wr, 478 op/s 2024-02-28T16:02:08.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:08 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:02:08.720 INFO:tasks.workunit.client.1.smithi087.stdout:1/876: rename d0/d1b/d1f/d71/db2/dae/d11b to d0/d1b/d1f/d11e 0 2024-02-28T16:02:08.721 INFO:tasks.workunit.client.1.smithi087.stdout:7/867: creat d14/d2e/d89/deb/d5d/dac/f111 x:0 0 0 2024-02-28T16:02:08.724 INFO:tasks.workunit.client.1.smithi087.stdout:7/868: write d14/d2e/d89/deb/d55/dae/f106 [924604,72565] 0 2024-02-28T16:02:08.727 INFO:tasks.workunit.client.1.smithi087.stdout:0/864: rename d4/dd/d26/c100 to d4/d1c/dff/c11c 0 2024-02-28T16:02:08.729 INFO:tasks.workunit.client.1.smithi087.stdout:7/869: write d14/d2e/d89/deb/f102 [2702208,13003] 0 2024-02-28T16:02:08.732 INFO:tasks.workunit.client.1.smithi087.stdout:0/865: stat d4/dd/d37/d39/d3a/f46 0 2024-02-28T16:02:08.735 INFO:tasks.workunit.client.1.smithi087.stdout:3/956: write d11/f2f [1581707,68495] 0 2024-02-28T16:02:08.736 INFO:tasks.workunit.client.1.smithi087.stdout:7/870: rmdir d14/d2e/d89/deb/d5d/d6a/d83 39 2024-02-28T16:02:08.740 INFO:tasks.workunit.client.1.smithi087.stdout:1/877: getdents d0/d1b/d1f/d71/db2 0 2024-02-28T16:02:08.741 INFO:tasks.workunit.client.1.smithi087.stdout:7/871: chown d14/d21/d4f/c8c 0 1 2024-02-28T16:02:08.747 INFO:tasks.workunit.client.1.smithi087.stdout:9/861: dwrite d7/dd/d15/d79/d2e/f6a [4194304,4194304] 0 2024-02-28T16:02:08.747 INFO:tasks.workunit.client.1.smithi087.stdout:1/878: chown d0/d1b/d1f/d71/db2/d24/d78/l92 41794 1 2024-02-28T16:02:08.750 INFO:tasks.workunit.client.1.smithi087.stdout:0/866: truncate d4/dd/d37/d39/d3a/d57/d74/d1f/ff1 1546354 0 2024-02-28T16:02:08.750 INFO:tasks.workunit.client.1.smithi087.stdout:7/872: write d14/d2e/d89/deb/d5d/dac/f111 [728783,30970] 0 2024-02-28T16:02:08.752 INFO:tasks.workunit.client.1.smithi087.stdout:9/862: dread - d7/dd/d15/d3f/d5f/d90/ddd/ff8 zero size 2024-02-28T16:02:08.757 INFO:tasks.workunit.client.1.smithi087.stdout:1/879: symlink d0/d1b/d1f/d96/d63/l11f 0 2024-02-28T16:02:08.758 INFO:tasks.workunit.client.1.smithi087.stdout:7/873: mknod d14/d2e/d89/dbb/c112 0 2024-02-28T16:02:08.761 INFO:tasks.workunit.client.1.smithi087.stdout:9/863: rmdir d7/dd/d15/d3f/d5f/d90/ddd 39 2024-02-28T16:02:08.761 INFO:tasks.workunit.client.1.smithi087.stdout:7/874: fsync d14/d21/d4f/f53 0 2024-02-28T16:02:08.764 INFO:tasks.workunit.client.1.smithi087.stdout:7/875: chown d14/d46/d7c/dc3 38444 1 2024-02-28T16:02:08.769 INFO:tasks.workunit.client.1.smithi087.stdout:9/864: creat d7/dd/d15/d3f/d6d/dcd/f102 x:0 0 0 2024-02-28T16:02:08.771 INFO:tasks.workunit.client.0.smithi057.stdout:7/386: dwrite d6/dc/f18 [0,4194304] 0 2024-02-28T16:02:08.775 INFO:tasks.workunit.client.1.smithi087.stdout:7/876: write d14/d2e/d89/fde [368278,117860] 0 2024-02-28T16:02:08.780 INFO:tasks.workunit.client.1.smithi087.stdout:3/957: dwrite d11/d61/d65/f138 [0,4194304] 0 2024-02-28T16:02:08.780 INFO:tasks.workunit.client.1.smithi087.stdout:1/880: rename d0/d1b/d1f/l5e to d0/d1b/d1f/d71/dad/l120 0 2024-02-28T16:02:08.782 INFO:tasks.workunit.client.1.smithi087.stdout:7/877: fdatasync d14/d21/ffa 0 2024-02-28T16:02:08.782 INFO:tasks.workunit.client.0.smithi057.stdout:0/610: readlink d6/l3c 0 2024-02-28T16:02:08.784 INFO:tasks.workunit.client.0.smithi057.stdout:8/422: creat d5/d20/d39/d49/d56/f8f x:0 0 0 2024-02-28T16:02:08.785 INFO:tasks.workunit.client.1.smithi087.stdout:0/867: dwrite d4/dd/d21/d52/dd1/fe0 [0,4194304] 0 2024-02-28T16:02:08.788 INFO:tasks.workunit.client.1.smithi087.stdout:9/865: mkdir d7/dd/d15/d79/d56/d103 0 2024-02-28T16:02:08.794 INFO:tasks.workunit.client.0.smithi057.stdout:4/466: rename d1/f88 to d1/d22/fa3 0 2024-02-28T16:02:08.794 INFO:tasks.workunit.client.1.smithi087.stdout:3/958: mknod d11/d7b/dab/de7/c14d 0 2024-02-28T16:02:08.796 INFO:tasks.workunit.client.1.smithi087.stdout:7/878: rename d14/d2e/d2b/l54 to d14/d30/dd1/l113 0 2024-02-28T16:02:08.803 INFO:tasks.workunit.client.1.smithi087.stdout:9/866: read d7/d1e/f51 [2430997,55743] 0 2024-02-28T16:02:08.804 INFO:tasks.workunit.client.1.smithi087.stdout:3/959: mknod d11/d44/c14e 0 2024-02-28T16:02:08.807 INFO:tasks.workunit.client.1.smithi087.stdout:7/879: symlink d14/l114 0 2024-02-28T16:02:08.816 INFO:tasks.workunit.client.1.smithi087.stdout:7/880: unlink d14/d21/d4f/f53 0 2024-02-28T16:02:08.817 INFO:tasks.workunit.client.0.smithi057.stdout:2/476: symlink d19/d1d/la0 0 2024-02-28T16:02:08.818 INFO:tasks.workunit.client.0.smithi057.stdout:6/421: getdents df/d10/d13/d70/d7a 0 2024-02-28T16:02:08.820 INFO:tasks.workunit.client.0.smithi057.stdout:9/545: creat d2/d5/d1b/d2e/d44/d7e/fae x:0 0 0 2024-02-28T16:02:08.820 INFO:tasks.workunit.client.1.smithi087.stdout:0/868: dwrite d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/ff9 [0,4194304] 0 2024-02-28T16:02:08.822 INFO:tasks.workunit.client.1.smithi087.stdout:9/867: getdents d7/dd/d15/d3f/d5f 0 2024-02-28T16:02:08.823 INFO:tasks.workunit.client.0.smithi057.stdout:0/611: write d6/d12/d38/f89 [4996889,12103] 0 2024-02-28T16:02:08.824 INFO:tasks.workunit.client.1.smithi087.stdout:7/881: mkdir d14/d7d/d115 0 2024-02-28T16:02:08.824 INFO:tasks.workunit.client.0.smithi057.stdout:1/499: creat d1/d21/d66/d53/d62/fa6 x:0 0 0 2024-02-28T16:02:08.826 INFO:tasks.workunit.client.1.smithi087.stdout:0/869: write d4/dd/d21/fce [811418,78972] 0 2024-02-28T16:02:08.826 INFO:tasks.workunit.client.0.smithi057.stdout:7/387: creat d6/dc/d67/f8a x:0 0 0 2024-02-28T16:02:08.827 INFO:tasks.workunit.client.0.smithi057.stdout:2/477: stat d19/d1d/l73 0 2024-02-28T16:02:08.827 INFO:tasks.workunit.client.1.smithi087.stdout:3/960: dread d11/f31 [0,4194304] 0 2024-02-28T16:02:08.828 INFO:tasks.workunit.client.0.smithi057.stdout:9/546: creat d2/d5/d1b/d2e/d77/faf x:0 0 0 2024-02-28T16:02:08.828 INFO:tasks.workunit.client.1.smithi087.stdout:7/882: creat d14/d7d/d115/f116 x:0 0 0 2024-02-28T16:02:08.829 INFO:tasks.workunit.client.1.smithi087.stdout:3/961: stat d11/d33/d67/d98 0 2024-02-28T16:02:08.830 INFO:tasks.workunit.client.0.smithi057.stdout:8/423: symlink d5/de/d1b/d45/d81/l90 0 2024-02-28T16:02:08.833 INFO:tasks.workunit.client.0.smithi057.stdout:5/465: rename d2/d15/d3b/d91/la7 to d2/d15/d63/la8 0 2024-02-28T16:02:08.833 INFO:tasks.workunit.client.1.smithi087.stdout:0/870: creat d4/dd/d21/d52/dd1/f11d x:0 0 0 2024-02-28T16:02:08.833 INFO:tasks.workunit.client.0.smithi057.stdout:4/467: truncate d1/f28 1061130 0 2024-02-28T16:02:08.834 INFO:tasks.workunit.client.1.smithi087.stdout:7/883: truncate f12 548894 0 2024-02-28T16:02:08.837 INFO:tasks.workunit.client.1.smithi087.stdout:0/871: unlink d4/dd/fb0 0 2024-02-28T16:02:08.838 INFO:tasks.workunit.client.0.smithi057.stdout:7/388: mknod d6/dc/d12/d29/c8b 0 2024-02-28T16:02:08.840 INFO:tasks.workunit.client.1.smithi087.stdout:0/872: unlink d4/d6/d9c/feb 0 2024-02-28T16:02:08.842 INFO:tasks.workunit.client.0.smithi057.stdout:2/478: rmdir d19/d2c/d65 39 2024-02-28T16:02:08.845 INFO:tasks.workunit.client.1.smithi087.stdout:1/881: write d0/d1a/ff9 [817199,64527] 0 2024-02-28T16:02:08.847 INFO:tasks.workunit.client.0.smithi057.stdout:8/424: fsync d5/d20/d72/f7d 0 2024-02-28T16:02:08.848 INFO:tasks.workunit.client.1.smithi087.stdout:1/882: mknod d0/d1b/d1f/d96/dd8/c121 0 2024-02-28T16:02:08.849 INFO:tasks.workunit.client.0.smithi057.stdout:4/468: unlink d1/d10/d12/d2c/d37/f42 0 2024-02-28T16:02:08.850 INFO:tasks.workunit.client.1.smithi087.stdout:1/883: stat d0/d1b/d1f/d71/dad/d10f 0 2024-02-28T16:02:08.850 INFO:tasks.workunit.client.0.smithi057.stdout:5/466: write d2/d3e/f70 [810673,2020] 0 2024-02-28T16:02:08.852 INFO:tasks.workunit.client.0.smithi057.stdout:8/425: chown d5/de/d1b/c61 51056609 1 2024-02-28T16:02:08.852 INFO:tasks.workunit.client.0.smithi057.stdout:7/389: unlink d6/dc/d12/l16 0 2024-02-28T16:02:08.863 INFO:tasks.workunit.client.1.smithi087.stdout:0/873: write d4/d6/f14 [2606580,104525] 0 2024-02-28T16:02:08.865 INFO:tasks.workunit.client.1.smithi087.stdout:0/874: stat d4/dd 0 2024-02-28T16:02:08.867 INFO:tasks.workunit.client.1.smithi087.stdout:3/962: dread d11/d61/d7c/f84 [0,4194304] 0 2024-02-28T16:02:08.868 INFO:tasks.workunit.client.1.smithi087.stdout:0/875: stat d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d76/cd2 0 2024-02-28T16:02:08.871 INFO:tasks.workunit.client.1.smithi087.stdout:3/963: mknod d11/d61/d7c/db7/dea/deb/c14f 0 2024-02-28T16:02:08.872 INFO:tasks.workunit.client.1.smithi087.stdout:7/884: dread d14/d2e/dab/fec [0,4194304] 0 2024-02-28T16:02:08.873 INFO:tasks.workunit.client.1.smithi087.stdout:0/876: mknod d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/c11e 0 2024-02-28T16:02:08.876 INFO:tasks.workunit.client.1.smithi087.stdout:3/964: link d11/f24 d11/d61/d7c/db7/d12e/f150 0 2024-02-28T16:02:08.877 INFO:tasks.workunit.client.1.smithi087.stdout:7/885: chown d14/d2e/d89/deb/l104 78790 1 2024-02-28T16:02:08.877 INFO:tasks.workunit.client.1.smithi087.stdout:1/884: dread d0/d1b/f45 [4194304,4194304] 0 2024-02-28T16:02:08.878 INFO:tasks.workunit.client.1.smithi087.stdout:0/877: unlink d4/dd/d21/ca5 0 2024-02-28T16:02:08.879 INFO:tasks.workunit.client.1.smithi087.stdout:1/885: write d0/d1a/f7d [3021396,10770] 0 2024-02-28T16:02:08.880 INFO:tasks.workunit.client.1.smithi087.stdout:3/965: creat d11/d45/d88/d91/de3/de5/f151 x:0 0 0 2024-02-28T16:02:08.881 INFO:tasks.workunit.client.1.smithi087.stdout:7/886: symlink d14/d2e/d2b/d57/l117 0 2024-02-28T16:02:08.881 INFO:tasks.workunit.client.1.smithi087.stdout:1/886: stat d0/d1b/d1f/d96/l75 0 2024-02-28T16:02:08.883 INFO:tasks.workunit.client.1.smithi087.stdout:7/887: stat d14/d2e/d89/deb/d5d/d6a/d94 0 2024-02-28T16:02:08.883 INFO:tasks.workunit.client.1.smithi087.stdout:0/878: rmdir d4/dd/d21/d9b 39 2024-02-28T16:02:08.885 INFO:tasks.workunit.client.1.smithi087.stdout:3/966: unlink d11/d44/d5b/c6b 0 2024-02-28T16:02:08.886 INFO:tasks.workunit.client.1.smithi087.stdout:1/887: symlink d0/d1b/d1f/d71/db2/d24/d78/l122 0 2024-02-28T16:02:08.887 INFO:tasks.workunit.client.1.smithi087.stdout:3/967: chown d11/d61/d65/le6 0 1 2024-02-28T16:02:08.888 INFO:tasks.workunit.client.1.smithi087.stdout:0/879: creat d4/d6/dc/f11f x:0 0 0 2024-02-28T16:02:08.888 INFO:tasks.workunit.client.1.smithi087.stdout:1/888: dread - d0/fed zero size 2024-02-28T16:02:08.889 INFO:tasks.workunit.client.1.smithi087.stdout:7/888: creat d14/d30/dd1/f118 x:0 0 0 2024-02-28T16:02:08.890 INFO:tasks.workunit.client.1.smithi087.stdout:0/880: fsync d4/dd/d26/d93/fbc 0 2024-02-28T16:02:08.891 INFO:tasks.workunit.client.1.smithi087.stdout:3/968: unlink d11/d3a/d3c/fdf 0 2024-02-28T16:02:08.893 INFO:tasks.workunit.client.1.smithi087.stdout:1/889: creat d0/d14/d86/da1/f123 x:0 0 0 2024-02-28T16:02:08.897 INFO:tasks.workunit.client.1.smithi087.stdout:3/969: dread d11/d3a/dd1/fdb [0,4194304] 0 2024-02-28T16:02:08.898 INFO:tasks.workunit.client.1.smithi087.stdout:0/881: symlink d4/dd/d37/d39/d3a/d57/d74/l120 0 2024-02-28T16:02:08.899 INFO:tasks.workunit.client.1.smithi087.stdout:1/890: dread - d0/d14/d86/dac/ff3 zero size 2024-02-28T16:02:08.905 INFO:tasks.workunit.client.1.smithi087.stdout:3/970: mkdir d11/d44/d152 0 2024-02-28T16:02:08.906 INFO:tasks.workunit.client.1.smithi087.stdout:0/882: creat d4/d6/f121 x:0 0 0 2024-02-28T16:02:08.906 INFO:tasks.workunit.client.1.smithi087.stdout:1/891: truncate d0/d14/d3f/dd5/fe1 752177 0 2024-02-28T16:02:08.909 INFO:tasks.workunit.client.1.smithi087.stdout:3/971: rmdir d11/d33 39 2024-02-28T16:02:08.914 INFO:tasks.workunit.client.1.smithi087.stdout:7/889: dread f13 [0,4194304] 0 2024-02-28T16:02:08.920 INFO:tasks.workunit.client.1.smithi087.stdout:7/890: symlink d14/d30/l119 0 2024-02-28T16:02:08.920 INFO:tasks.workunit.client.1.smithi087.stdout:3/972: getdents d11/d44/d5b 0 2024-02-28T16:02:08.920 INFO:tasks.workunit.client.1.smithi087.stdout:7/891: dread - d14/d2e/d2b/d4e/fe3 zero size 2024-02-28T16:02:08.921 INFO:tasks.workunit.client.1.smithi087.stdout:0/883: dread d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/f64 [0,4194304] 0 2024-02-28T16:02:08.924 INFO:tasks.workunit.client.1.smithi087.stdout:3/973: link d11/d44/d5b/f5a d11/d44/d5b/f153 0 2024-02-28T16:02:08.926 INFO:tasks.workunit.client.1.smithi087.stdout:1/892: dwrite d0/d1b/d1f/d71/db2/d24/d78/f9c [4194304,4194304] 0 2024-02-28T16:02:08.927 INFO:tasks.workunit.client.1.smithi087.stdout:0/884: rmdir d4/dd/d37/d39 39 2024-02-28T16:02:08.932 INFO:tasks.workunit.client.1.smithi087.stdout:1/893: dread - d0/d14/d86/da1/f123 zero size 2024-02-28T16:02:08.932 INFO:tasks.workunit.client.1.smithi087.stdout:7/892: truncate d14/d7d/f8d 640795 0 2024-02-28T16:02:08.932 INFO:tasks.workunit.client.1.smithi087.stdout:1/894: readlink d0/l26 0 2024-02-28T16:02:08.933 INFO:tasks.workunit.client.1.smithi087.stdout:1/895: chown d0/d14/d3f/d119 7 1 2024-02-28T16:02:08.934 INFO:tasks.workunit.client.1.smithi087.stdout:3/974: rename ff to d11/d33/d67/d98/daf/f154 0 2024-02-28T16:02:08.934 INFO:tasks.workunit.client.1.smithi087.stdout:0/885: truncate d4/d6/d9c/fb5 552146 0 2024-02-28T16:02:08.936 INFO:tasks.workunit.client.1.smithi087.stdout:7/893: mkdir d14/d2e/d89/deb/d55/dc5/d11a 0 2024-02-28T16:02:08.937 INFO:tasks.workunit.client.1.smithi087.stdout:1/896: mkdir d0/d1a/d124 0 2024-02-28T16:02:08.939 INFO:tasks.workunit.client.1.smithi087.stdout:3/975: truncate d11/d3a/dd1/fdb 1393680 0 2024-02-28T16:02:08.941 INFO:tasks.workunit.client.1.smithi087.stdout:7/894: rmdir d14/d46 39 2024-02-28T16:02:08.943 INFO:tasks.workunit.client.1.smithi087.stdout:7/895: chown d14/d2e/d2b/ce1 47423 1 2024-02-28T16:02:08.944 INFO:tasks.workunit.client.0.smithi057.stdout:1/500: rename d1/f81 to d1/d3/dc/d15/d4e/d5f/fa7 0 2024-02-28T16:02:08.945 INFO:tasks.workunit.client.0.smithi057.stdout:2/479: rename d19/d2c/d48 to d19/d2c/d48/da1 22 2024-02-28T16:02:08.946 INFO:tasks.workunit.client.1.smithi087.stdout:1/897: fsync d0/d1b/d1f/d71/f81 0 2024-02-28T16:02:08.946 INFO:tasks.workunit.client.0.smithi057.stdout:2/480: readlink d19/d1d/l2a 0 2024-02-28T16:02:08.947 INFO:tasks.workunit.client.1.smithi087.stdout:3/976: fsync d11/d61/fff 0 2024-02-28T16:02:08.948 INFO:tasks.workunit.client.0.smithi057.stdout:7/390: stat d6/dc/d35/d58/l71 0 2024-02-28T16:02:08.948 INFO:tasks.workunit.client.1.smithi087.stdout:7/896: mknod d14/d2e/d2b/d57/c11b 0 2024-02-28T16:02:08.950 INFO:tasks.workunit.client.0.smithi057.stdout:8/426: mkdir d5/de/d1b/d57/d91 0 2024-02-28T16:02:08.950 INFO:tasks.workunit.client.1.smithi087.stdout:1/898: creat d0/d14/d3f/dd5/f125 x:0 0 0 2024-02-28T16:02:08.950 INFO:tasks.workunit.client.1.smithi087.stdout:7/897: truncate d14/d30/dd1/f118 855267 0 2024-02-28T16:02:08.952 INFO:tasks.workunit.client.0.smithi057.stdout:8/427: chown d5/d20/d72/f87 494210 1 2024-02-28T16:02:08.953 INFO:tasks.workunit.client.0.smithi057.stdout:8/428: chown d5/f2f 246 1 2024-02-28T16:02:08.953 INFO:tasks.workunit.client.1.smithi087.stdout:1/899: chown d0/d1b/d1f/d71/db2/d24/d78/fdc 1400 1 2024-02-28T16:02:08.955 INFO:tasks.workunit.client.1.smithi087.stdout:7/898: symlink d14/d2e/dab/l11c 0 2024-02-28T16:02:08.958 INFO:tasks.workunit.client.1.smithi087.stdout:1/900: chown d0/d1b/d1f/d71/dad/l102 113696195 1 2024-02-28T16:02:08.959 INFO:tasks.workunit.client.0.smithi057.stdout:9/547: getdents d2/d5/d9/d57 0 2024-02-28T16:02:08.959 INFO:tasks.workunit.client.1.smithi087.stdout:7/899: stat d14/d30/dd1/df8/lca 0 2024-02-28T16:02:08.959 INFO:tasks.workunit.client.0.smithi057.stdout:9/548: stat d2/d24/l98 0 2024-02-28T16:02:08.961 INFO:tasks.workunit.client.1.smithi087.stdout:7/900: dread - d14/d21/d4f/fd0 zero size 2024-02-28T16:02:08.962 INFO:tasks.workunit.client.0.smithi057.stdout:9/549: chown d2/d5/d1b/d2e/d77/faf 3 1 2024-02-28T16:02:08.963 INFO:tasks.workunit.client.0.smithi057.stdout:2/481: dread d19/d43/d5a/f6e [0,4194304] 0 2024-02-28T16:02:08.964 INFO:tasks.workunit.client.0.smithi057.stdout:9/550: dread - d2/d5/d1b/d2e/d4c/f91 zero size 2024-02-28T16:02:08.965 INFO:tasks.workunit.client.0.smithi057.stdout:9/551: readlink d2/d92/la8 0 2024-02-28T16:02:08.982 INFO:tasks.workunit.client.1.smithi087.stdout:3/977: dread d11/f15 [0,4194304] 0 2024-02-28T16:02:09.045 INFO:tasks.workunit.client.1.smithi087.stdout:3/978: dread d11/d61/d7c/db7/d12e/f150 [0,4194304] 0 2024-02-28T16:02:09.047 INFO:tasks.workunit.client.1.smithi087.stdout:3/979: readlink d11/d33/d58/l79 0 2024-02-28T16:02:09.153 INFO:tasks.workunit.client.1.smithi087.stdout:5/908: sync 2024-02-28T16:02:09.159 INFO:tasks.workunit.client.0.smithi057.stdout:6/422: sync 2024-02-28T16:02:09.397 INFO:tasks.workunit.client.1.smithi087.stdout:4/933: sync 2024-02-28T16:02:09.416 INFO:tasks.workunit.client.1.smithi087.stdout:4/934: dwrite d2/df/d65/f10e [0,4194304] 0 2024-02-28T16:02:09.420 INFO:tasks.workunit.client.1.smithi087.stdout:4/935: chown d2/d9/d9e/d106 12522 1 2024-02-28T16:02:09.425 INFO:tasks.workunit.client.1.smithi087.stdout:4/936: readlink d2/d9/d10/d22/d5b/d5c/l11a 0 2024-02-28T16:02:09.428 INFO:tasks.workunit.client.1.smithi087.stdout:4/937: fsync d2/d9/d10/dbf/f19 0 2024-02-28T16:02:09.448 INFO:tasks.workunit.client.1.smithi087.stdout:8/927: sync 2024-02-28T16:02:09.448 INFO:tasks.workunit.client.1.smithi087.stdout:2/846: sync 2024-02-28T16:02:09.448 INFO:tasks.workunit.client.1.smithi087.stdout:9/868: sync 2024-02-28T16:02:09.863 INFO:tasks.workunit.client.0.smithi057.stdout:8/429: rmdir d5/d20/d39/d49/d56/d84 39 2024-02-28T16:02:09.867 INFO:tasks.workunit.client.0.smithi057.stdout:2/482: mkdir d19/d2c/d48/da2 0 2024-02-28T16:02:09.868 INFO:tasks.workunit.client.0.smithi057.stdout:3/455: write d8/fa [185770,29802] 0 2024-02-28T16:02:09.901 INFO:tasks.workunit.client.0.smithi057.stdout:7/391: link d6/d26/f50 d6/dc/d12/f8c 0 2024-02-28T16:02:09.905 INFO:tasks.workunit.client.0.smithi057.stdout:2/483: read d19/d1d/d22/f6b [21748,112463] 0 2024-02-28T16:02:09.906 INFO:tasks.workunit.client.0.smithi057.stdout:6/423: symlink df/d10/l8a 0 2024-02-28T16:02:09.907 INFO:tasks.workunit.client.0.smithi057.stdout:3/456: rmdir d8/dd/d14/d2e/d30/d49/d51 39 2024-02-28T16:02:09.914 INFO:tasks.workunit.client.0.smithi057.stdout:9/552: creat d2/d5e/fb0 x:0 0 0 2024-02-28T16:02:09.917 INFO:tasks.workunit.client.0.smithi057.stdout:2/484: chown cb 5 1 2024-02-28T16:02:09.919 INFO:tasks.workunit.client.0.smithi057.stdout:3/457: symlink d8/dd/d19/l8f 0 2024-02-28T16:02:09.920 INFO:tasks.workunit.client.0.smithi057.stdout:7/392: dwrite d6/dc/d12/d1a/f24 [4194304,4194304] 0 2024-02-28T16:02:09.923 INFO:tasks.workunit.client.0.smithi057.stdout:0/612: dwrite d6/d12/d17/d4b/f31 [0,4194304] 0 2024-02-28T16:02:09.929 INFO:tasks.workunit.client.0.smithi057.stdout:2/485: truncate d19/d43/d5a/f6e 998666 0 2024-02-28T16:02:09.930 INFO:tasks.workunit.client.0.smithi057.stdout:4/469: write d1/d22/f5c [897391,97451] 0 2024-02-28T16:02:09.930 INFO:tasks.workunit.client.0.smithi057.stdout:2/486: chown d19/d1d/c8a 81325 1 2024-02-28T16:02:09.936 INFO:tasks.workunit.client.0.smithi057.stdout:0/613: symlink d6/d12/d5d/d71/daa/ld1 0 2024-02-28T16:02:09.939 INFO:tasks.workunit.client.0.smithi057.stdout:6/424: rmdir df/d10/d13/d70/d7a 0 2024-02-28T16:02:09.948 INFO:tasks.workunit.client.0.smithi057.stdout:3/458: rename d8/dd/d14/d2e/d2f/f45 to d8/dd/d14/d2e/d30/d49/d51/d66/f90 0 2024-02-28T16:02:09.950 INFO:tasks.workunit.client.0.smithi057.stdout:3/459: stat d8/dd/d14/d2e/d30/d5f/c70 0 2024-02-28T16:02:09.950 INFO:tasks.workunit.client.0.smithi057.stdout:0/614: write d6/d12/d45/d78/f9d [3892378,76784] 0 2024-02-28T16:02:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:1/501: symlink d1/d21/d66/la8 0 2024-02-28T16:02:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:3/460: stat d8/dd/d14/d2e/d76/d89/d6c 0 2024-02-28T16:02:09.955 INFO:tasks.workunit.client.0.smithi057.stdout:7/393: link d6/dc/d35/d58/l71 d6/dc/d12/d29/l8d 0 2024-02-28T16:02:09.956 INFO:tasks.workunit.client.0.smithi057.stdout:0/615: read d6/d12/d17/d4b/f36 [2176032,109555] 0 2024-02-28T16:02:09.957 INFO:tasks.workunit.client.0.smithi057.stdout:9/553: link d2/la1 d2/d5/d1b/d2e/d44/d7e/lb1 0 2024-02-28T16:02:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/425: unlink df/d14/c85 0 2024-02-28T16:02:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:4/470: link d1/d22/d64/d9b/f9e d1/d10/fa4 0 2024-02-28T16:02:09.964 INFO:tasks.workunit.client.0.smithi057.stdout:4/471: chown d1/d3f/l63 0 1 2024-02-28T16:02:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:3/461: creat d8/dd/d14/d2e/d3b/d71/f91 x:0 0 0 2024-02-28T16:02:09.971 INFO:tasks.workunit.client.0.smithi057.stdout:6/426: creat df/d10/d78/d5b/f8b x:0 0 0 2024-02-28T16:02:09.973 INFO:tasks.workunit.client.0.smithi057.stdout:4/472: fdatasync d1/d10/d31/f60 0 2024-02-28T16:02:09.976 INFO:tasks.workunit.client.0.smithi057.stdout:3/462: dread d8/dd/f41 [0,4194304] 0 2024-02-28T16:02:09.978 INFO:tasks.workunit.client.0.smithi057.stdout:8/430: write d5/de/d1b/f35 [1160904,124775] 0 2024-02-28T16:02:09.978 INFO:tasks.workunit.client.0.smithi057.stdout:9/554: dwrite d2/d5/d1b/d2e/d4c/da0/faa [0,4194304] 0 2024-02-28T16:02:09.982 INFO:tasks.workunit.client.0.smithi057.stdout:7/394: link d6/dc/d12/d29/l82 d6/dc/d87/l8e 0 2024-02-28T16:02:09.986 INFO:tasks.workunit.client.0.smithi057.stdout:6/427: creat df/d10/d78/d5b/d7b/f8c x:0 0 0 2024-02-28T16:02:09.987 INFO:tasks.workunit.client.0.smithi057.stdout:4/473: fsync d1/d10/d12/d2c/f57 0 2024-02-28T16:02:09.990 INFO:tasks.workunit.client.0.smithi057.stdout:8/431: dread - d5/de/d1b/f2e zero size 2024-02-28T16:02:09.993 INFO:tasks.workunit.client.0.smithi057.stdout:3/463: read d8/dd/d14/f20 [7019873,44276] 0 2024-02-28T16:02:09.996 INFO:tasks.workunit.client.0.smithi057.stdout:1/502: creat d1/d3/dc/fa9 x:0 0 0 2024-02-28T16:02:09.997 INFO:tasks.workunit.client.0.smithi057.stdout:4/474: truncate d1/d10/d12/d2c/d37/d46/fa0 941571 0 2024-02-28T16:02:09.998 INFO:tasks.workunit.client.0.smithi057.stdout:3/464: chown d8/dd/d14/d2e/d30/f64 96 1 2024-02-28T16:02:09.999 INFO:tasks.workunit.client.0.smithi057.stdout:5/467: dwrite d2/d19/d1c/f2c [0,4194304] 0 2024-02-28T16:02:09.999 INFO:tasks.workunit.client.0.smithi057.stdout:2/487: write d19/d1d/d22/f6b [302273,68894] 0 2024-02-28T16:02:10.003 INFO:tasks.workunit.client.0.smithi057.stdout:4/475: dread - d1/d10/d12/d2c/f8a zero size 2024-02-28T16:02:10.003 INFO:tasks.workunit.client.0.smithi057.stdout:8/432: rmdir d5/d62 39 2024-02-28T16:02:10.006 INFO:tasks.workunit.client.0.smithi057.stdout:8/433: readlink d5/l8 0 2024-02-28T16:02:10.015 INFO:tasks.workunit.client.0.smithi057.stdout:2/488: chown d19/d1d/d22/l5e 15900525 1 2024-02-28T16:02:10.018 INFO:tasks.workunit.client.0.smithi057.stdout:5/468: symlink d2/d15/d63/la9 0 2024-02-28T16:02:10.022 INFO:tasks.workunit.client.0.smithi057.stdout:1/503: mknod d1/d21/d25/caa 0 2024-02-28T16:02:10.023 INFO:tasks.workunit.client.0.smithi057.stdout:9/555: dread d2/d5/d9/d5d/d70/f84 [0,4194304] 0 2024-02-28T16:02:10.024 INFO:tasks.workunit.client.0.smithi057.stdout:0/616: write d6/d12/d17/f3b [2366790,56751] 0 2024-02-28T16:02:10.025 INFO:tasks.workunit.client.0.smithi057.stdout:5/469: write d2/d15/d5e/d6d/f75 [109070,20403] 0 2024-02-28T16:02:10.031 INFO:tasks.workunit.client.0.smithi057.stdout:3/465: dwrite d8/dd/d14/d2e/d30/d5f/d6b/f83 [0,4194304] 0 2024-02-28T16:02:10.033 INFO:tasks.workunit.client.0.smithi057.stdout:8/434: dwrite d5/f7 [0,4194304] 0 2024-02-28T16:02:10.034 INFO:tasks.workunit.client.0.smithi057.stdout:8/435: chown d5/d20/d39/d49 83020036 1 2024-02-28T16:02:10.047 INFO:tasks.workunit.client.1.smithi087.stdout:1/901: mkdir d0/d1b/d1f/d71/db2/db3/dda/d126 0 2024-02-28T16:02:10.052 INFO:tasks.workunit.client.1.smithi087.stdout:7/901: symlink d14/d21/d4f/l11d 0 2024-02-28T16:02:10.053 INFO:tasks.workunit.client.1.smithi087.stdout:0/886: write d4/d6/d9c/fb5 [829224,102890] 0 2024-02-28T16:02:10.055 INFO:tasks.workunit.client.1.smithi087.stdout:0/887: stat d4/dd/d21/f71 0 2024-02-28T16:02:10.085 INFO:tasks.workunit.client.1.smithi087.stdout:3/980: unlink d11/d61/d7c/db7/d132/l137 0 2024-02-28T16:02:10.086 INFO:tasks.workunit.client.1.smithi087.stdout:3/981: chown d11/d45/f47 39072645 1 2024-02-28T16:02:10.126 INFO:tasks.workunit.client.1.smithi087.stdout:4/938: truncate d2/df/d2e/fcd 1869350 0 2024-02-28T16:02:10.127 INFO:tasks.workunit.client.1.smithi087.stdout:2/847: fsync d2/d7/dc0/d111/f33 0 2024-02-28T16:02:10.129 INFO:tasks.workunit.client.1.smithi087.stdout:1/902: creat d0/d1b/dd7/f127 x:0 0 0 2024-02-28T16:02:10.132 INFO:tasks.workunit.client.1.smithi087.stdout:0/888: write d4/d6/f9f [4054590,58792] 0 2024-02-28T16:02:10.132 INFO:tasks.workunit.client.1.smithi087.stdout:5/909: mkdir d3/d9/d9b/dba/d69/d87/d13c/d145 0 2024-02-28T16:02:10.135 INFO:tasks.workunit.client.1.smithi087.stdout:5/910: write d3/d9/d9b/dba/f13d [963665,13924] 0 2024-02-28T16:02:10.143 INFO:tasks.workunit.client.1.smithi087.stdout:4/939: creat d2/df/d62/f12e x:0 0 0 2024-02-28T16:02:10.144 INFO:tasks.workunit.client.1.smithi087.stdout:2/848: mkdir d2/d99/d28/d79/d9f/de1/d130 0 2024-02-28T16:02:10.152 INFO:tasks.workunit.client.1.smithi087.stdout:7/902: dwrite d14/d2e/d89/deb/d5d/d6a/d83/fb3 [0,4194304] 0 2024-02-28T16:02:10.152 INFO:tasks.workunit.client.1.smithi087.stdout:7/903: chown d14/d21/d4f 1306386 1 2024-02-28T16:02:10.152 INFO:tasks.workunit.client.1.smithi087.stdout:1/903: dwrite d0/d1b/d1f/d71/db2/d24/f58 [0,4194304] 0 2024-02-28T16:02:10.152 INFO:tasks.workunit.client.1.smithi087.stdout:7/904: dread - d14/d21/de4/de7/f105 zero size 2024-02-28T16:02:10.160 INFO:tasks.workunit.client.1.smithi087.stdout:7/905: write d14/d21/f41 [1560029,19603] 0 2024-02-28T16:02:10.160 INFO:tasks.workunit.client.1.smithi087.stdout:9/869: creat d7/dd/d99/f104 x:0 0 0 2024-02-28T16:02:10.160 INFO:tasks.workunit.client.1.smithi087.stdout:2/849: fdatasync d2/d7/dc0/d111/d34/f98 0 2024-02-28T16:02:10.168 INFO:tasks.workunit.client.1.smithi087.stdout:1/904: creat d0/d14/d86/dac/f128 x:0 0 0 2024-02-28T16:02:10.175 INFO:tasks.workunit.client.1.smithi087.stdout:0/889: rename d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/fa9 to d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f122 0 2024-02-28T16:02:10.181 INFO:tasks.workunit.client.1.smithi087.stdout:8/928: write d2/d18/d42/d7b/f95 [625516,124169] 0 2024-02-28T16:02:10.184 INFO:tasks.workunit.client.1.smithi087.stdout:2/850: rename d2/d99/fa9 to d2/d42/d4b/f131 0 2024-02-28T16:02:10.186 INFO:tasks.workunit.client.1.smithi087.stdout:3/982: write d11/f82 [654391,102265] 0 2024-02-28T16:02:10.187 INFO:tasks.workunit.client.1.smithi087.stdout:7/906: dread - d14/d46/d7c/db9/fd8 zero size 2024-02-28T16:02:10.193 INFO:tasks.workunit.client.1.smithi087.stdout:3/983: truncate d11/d3a/dd1/d13c/f147 836857 0 2024-02-28T16:02:10.194 INFO:tasks.workunit.client.1.smithi087.stdout:3/984: chown d11/d45/d73 608 1 2024-02-28T16:02:10.194 INFO:tasks.workunit.client.1.smithi087.stdout:5/911: write d3/d64/f8d [4457076,110960] 0 2024-02-28T16:02:10.195 INFO:tasks.workunit.client.1.smithi087.stdout:1/905: dread d0/d1a/d28/f65 [0,4194304] 0 2024-02-28T16:02:10.196 INFO:tasks.workunit.client.1.smithi087.stdout:9/870: getdents d7/dd/d36/d89 0 2024-02-28T16:02:10.200 INFO:tasks.workunit.client.1.smithi087.stdout:0/890: fsync d4/dd/d21/d9b/d7c/f98 0 2024-02-28T16:02:10.201 INFO:tasks.workunit.client.1.smithi087.stdout:2/851: creat d2/d99/dc7/def/f132 x:0 0 0 2024-02-28T16:02:10.203 INFO:tasks.workunit.client.1.smithi087.stdout:7/907: symlink d14/d46/l11e 0 2024-02-28T16:02:10.205 INFO:tasks.workunit.client.1.smithi087.stdout:9/871: creat d7/dd/d15/d79/d56/f105 x:0 0 0 2024-02-28T16:02:10.209 INFO:tasks.workunit.client.1.smithi087.stdout:9/872: chown d7/dd/d15/d3f/d6d/cfb 6342935 1 2024-02-28T16:02:10.209 INFO:tasks.workunit.client.1.smithi087.stdout:7/908: mknod d14/d2e/dc0/c11f 0 2024-02-28T16:02:10.210 INFO:tasks.workunit.client.0.smithi057.stdout:6/428: getdents df/d10/d13 0 2024-02-28T16:02:10.210 INFO:tasks.workunit.client.1.smithi087.stdout:0/891: mkdir d4/d6/d123 0 2024-02-28T16:02:10.211 INFO:tasks.workunit.client.1.smithi087.stdout:9/873: chown d7/dc/f85 415062 1 2024-02-28T16:02:10.213 INFO:tasks.workunit.client.1.smithi087.stdout:3/985: dwrite d11/f15 [0,4194304] 0 2024-02-28T16:02:10.214 INFO:tasks.workunit.client.1.smithi087.stdout:2/852: write d2/d7/dc0/d111/d34/f98 [537109,71765] 0 2024-02-28T16:02:10.215 INFO:tasks.workunit.client.0.smithi057.stdout:0/617: creat d6/d12/d17/d58/d95/fd2 x:0 0 0 2024-02-28T16:02:10.217 INFO:tasks.workunit.client.1.smithi087.stdout:7/909: dread - d14/d46/d80/f82 zero size 2024-02-28T16:02:10.217 INFO:tasks.workunit.client.1.smithi087.stdout:0/892: unlink d4/ce4 0 2024-02-28T16:02:10.218 INFO:tasks.workunit.client.1.smithi087.stdout:5/912: link d3/d9/d9b/dba/d30/d36/d4f/c107 d3/d9/d9b/dba/d69/d87/d13c/d145/c146 0 2024-02-28T16:02:10.218 INFO:tasks.workunit.client.1.smithi087.stdout:2/853: chown d2/d7/dc0/d111/d3d/f5f 346172704 1 2024-02-28T16:02:10.218 INFO:tasks.workunit.client.1.smithi087.stdout:1/906: getdents d0/d1b/d1f/d96 0 2024-02-28T16:02:10.221 INFO:tasks.workunit.client.1.smithi087.stdout:3/986: symlink d11/d3a/dd1/d13c/l155 0 2024-02-28T16:02:10.222 INFO:tasks.workunit.client.0.smithi057.stdout:4/476: write d1/d10/d12/d15/f73 [254900,57475] 0 2024-02-28T16:02:10.225 INFO:tasks.workunit.client.0.smithi057.stdout:7/395: dwrite d6/dc/f43 [0,4194304] 0 2024-02-28T16:02:10.225 INFO:tasks.workunit.client.1.smithi087.stdout:9/874: readlink d7/dd/l95 0 2024-02-28T16:02:10.227 INFO:tasks.workunit.client.0.smithi057.stdout:4/477: read - d1/d10/d12/d39/f8f zero size 2024-02-28T16:02:10.230 INFO:tasks.workunit.client.1.smithi087.stdout:1/907: readlink d0/d1b/d1f/d71/db2/l2b 0 2024-02-28T16:02:10.230 INFO:tasks.workunit.client.0.smithi057.stdout:8/436: fdatasync d5/de/d1b/f6f 0 2024-02-28T16:02:10.231 INFO:tasks.workunit.client.1.smithi087.stdout:2/854: truncate d2/d99/f4d 4834830 0 2024-02-28T16:02:10.232 INFO:tasks.workunit.client.0.smithi057.stdout:6/429: mkdir df/d14/d15/d16/d39/d8d 0 2024-02-28T16:02:10.235 INFO:tasks.workunit.client.0.smithi057.stdout:0/618: creat d6/d4e/fd3 x:0 0 0 2024-02-28T16:02:10.237 INFO:tasks.workunit.client.0.smithi057.stdout:9/556: dread d2/d5e/d65/f56 [0,4194304] 0 2024-02-28T16:02:10.239 INFO:tasks.workunit.client.0.smithi057.stdout:6/430: write df/d10/d13/d4b/d4e/f86 [837858,76217] 0 2024-02-28T16:02:10.239 INFO:tasks.workunit.client.0.smithi057.stdout:0/619: readlink d6/d12/d38/l4c 0 2024-02-28T16:02:10.243 INFO:tasks.workunit.client.0.smithi057.stdout:5/470: rename d2/f1b to d2/d15/d5e/faa 0 2024-02-28T16:02:10.244 INFO:tasks.workunit.client.1.smithi087.stdout:0/893: dwrite d4/d6/dc/f99 [0,4194304] 0 2024-02-28T16:02:10.249 INFO:tasks.workunit.client.0.smithi057.stdout:5/471: dread - d2/d15/f99 zero size 2024-02-28T16:02:10.249 INFO:tasks.workunit.client.0.smithi057.stdout:3/466: write f3 [1910276,33605] 0 2024-02-28T16:02:10.253 INFO:tasks.workunit.client.1.smithi087.stdout:3/987: creat d11/d44/d5b/f156 x:0 0 0 2024-02-28T16:02:10.254 INFO:tasks.workunit.client.1.smithi087.stdout:7/910: symlink d14/d2e/d89/dbd/l120 0 2024-02-28T16:02:10.255 INFO:tasks.workunit.client.1.smithi087.stdout:5/913: creat d3/d9/d9b/dba/d69/d87/d13c/f147 x:0 0 0 2024-02-28T16:02:10.258 INFO:tasks.workunit.client.0.smithi057.stdout:1/504: dread d1/f34 [0,4194304] 0 2024-02-28T16:02:10.259 INFO:tasks.workunit.client.1.smithi087.stdout:9/875: mknod d7/dd/d15/d79/d2e/dbd/c106 0 2024-02-28T16:02:10.259 INFO:tasks.workunit.client.1.smithi087.stdout:5/914: chown d3/d9/d9b/dba/d30/d10f/d12c/lf0 29874822 1 2024-02-28T16:02:10.259 INFO:tasks.workunit.client.1.smithi087.stdout:0/894: rename d4/dd/d21/f69 to d4/dd/d37/d39/d3a/dc1/f124 0 2024-02-28T16:02:10.260 INFO:tasks.workunit.client.0.smithi057.stdout:1/505: readlink d1/d21/d66/la8 0 2024-02-28T16:02:10.261 INFO:tasks.workunit.client.1.smithi087.stdout:2/855: mknod d2/d7/dc0/d111/d34/c133 0 2024-02-28T16:02:10.262 INFO:tasks.workunit.client.1.smithi087.stdout:7/911: mkdir d14/d2e/d89/deb/d121 0 2024-02-28T16:02:10.265 INFO:tasks.workunit.client.1.smithi087.stdout:2/856: mkdir d2/d99/dc7/d134 0 2024-02-28T16:02:10.267 INFO:tasks.workunit.client.1.smithi087.stdout:0/895: write d4/d6/dc/d45/f6a [597620,118183] 0 2024-02-28T16:02:10.268 INFO:tasks.workunit.client.1.smithi087.stdout:5/915: rename d3/d64/d67/f76 to d3/d9/d9b/dba/d30/d8f/dac/f148 0 2024-02-28T16:02:10.271 INFO:tasks.workunit.client.1.smithi087.stdout:7/912: getdents d14/d2e/d2b 0 2024-02-28T16:02:10.274 INFO:tasks.workunit.client.1.smithi087.stdout:0/896: mknod d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/c125 0 2024-02-28T16:02:10.276 INFO:tasks.workunit.client.1.smithi087.stdout:0/897: chown d4/d6/dc/d45/fed 3645136 1 2024-02-28T16:02:10.278 INFO:tasks.workunit.client.1.smithi087.stdout:2/857: link d2/d7/dc0/d111/d3d/c9e d2/d99/d28/d79/da3/c135 0 2024-02-28T16:02:10.280 INFO:tasks.workunit.client.0.smithi057.stdout:6/431: rename df/d10/d13/l55 to df/d10/d78/d5b/d7b/l8e 0 2024-02-28T16:02:10.282 INFO:tasks.workunit.client.1.smithi087.stdout:9/876: dread d7/dd/d15/f1f [0,4194304] 0 2024-02-28T16:02:10.282 INFO:tasks.workunit.client.0.smithi057.stdout:8/437: creat d5/d20/d39/d49/d56/d79/f92 x:0 0 0 2024-02-28T16:02:10.284 INFO:tasks.workunit.client.1.smithi087.stdout:2/858: read d2/d99/d28/d79/d9f/de1/d129/fd5 [147653,42953] 0 2024-02-28T16:02:10.285 INFO:tasks.workunit.client.0.smithi057.stdout:9/557: mknod d2/d5/d1b/cb2 0 2024-02-28T16:02:10.287 INFO:tasks.workunit.client.0.smithi057.stdout:3/467: dwrite d8/dd/d14/d2c/f33 [0,4194304] 0 2024-02-28T16:02:10.291 INFO:tasks.workunit.client.0.smithi057.stdout:4/478: dread d1/d10/d12/d15/d19/f2b [0,4194304] 0 2024-02-28T16:02:10.293 INFO:tasks.workunit.client.0.smithi057.stdout:5/472: mkdir d2/d15/d3b/dab 0 2024-02-28T16:02:10.295 INFO:tasks.workunit.client.0.smithi057.stdout:3/468: symlink d8/d26/l92 0 2024-02-28T16:02:10.297 INFO:tasks.workunit.client.0.smithi057.stdout:6/432: creat df/d10/d78/d5b/f8f x:0 0 0 2024-02-28T16:02:10.301 INFO:tasks.workunit.client.0.smithi057.stdout:2/489: dread d19/d1d/f51 [0,4194304] 0 2024-02-28T16:02:10.301 INFO:tasks.workunit.client.0.smithi057.stdout:7/396: dread d6/dc/d12/d1a/d4d/d5a/f66 [0,4194304] 0 2024-02-28T16:02:10.307 INFO:tasks.workunit.client.0.smithi057.stdout:9/558: link d2/d24/f14 d2/d46/d67/fb3 0 2024-02-28T16:02:10.312 INFO:tasks.workunit.client.0.smithi057.stdout:3/469: rename f3 to d8/dd/d14/d2e/d30/d6a/f93 0 2024-02-28T16:02:10.316 INFO:tasks.workunit.client.1.smithi087.stdout:0/898: fsync d4/dd/d37/d39/d3a/dc1/f124 0 2024-02-28T16:02:10.317 INFO:tasks.workunit.client.1.smithi087.stdout:3/988: truncate d11/d61/d7c/db7/f10c 2625202 0 2024-02-28T16:02:10.318 INFO:tasks.workunit.client.0.smithi057.stdout:0/620: dwrite d6/d12/d45/d78/fcf [0,4194304] 0 2024-02-28T16:02:10.321 INFO:tasks.workunit.client.1.smithi087.stdout:1/908: dwrite d0/fa [0,4194304] 0 2024-02-28T16:02:10.321 INFO:tasks.workunit.client.0.smithi057.stdout:6/433: truncate df/d10/d13/f3a 9098 0 2024-02-28T16:02:10.323 INFO:tasks.workunit.client.1.smithi087.stdout:3/989: dread - d11/d61/d7c/f114 zero size 2024-02-28T16:02:10.326 INFO:tasks.workunit.client.1.smithi087.stdout:1/909: mknod d0/d1b/d1f/c129 0 2024-02-28T16:02:10.330 INFO:tasks.workunit.client.0.smithi057.stdout:0/621: chown d6/d12/d17/d4b/f8f 903752435 1 2024-02-28T16:02:10.331 INFO:tasks.workunit.client.0.smithi057.stdout:7/397: truncate d6/dc/fd 1993125 0 2024-02-28T16:02:10.331 INFO:tasks.workunit.client.0.smithi057.stdout:8/438: dwrite d5/de/d1b/f35 [0,4194304] 0 2024-02-28T16:02:10.331 INFO:tasks.workunit.client.1.smithi087.stdout:1/910: chown d0/d1b/d43/c7b 3491 1 2024-02-28T16:02:10.333 INFO:tasks.workunit.client.1.smithi087.stdout:2/859: dwrite d2/d99/d28/d79/f93 [0,4194304] 0 2024-02-28T16:02:10.337 INFO:tasks.workunit.client.0.smithi057.stdout:6/434: fsync df/d10/d13/f75 0 2024-02-28T16:02:10.344 INFO:tasks.workunit.client.1.smithi087.stdout:7/913: dwrite d14/d30/fd2 [0,4194304] 0 2024-02-28T16:02:10.346 INFO:tasks.workunit.client.1.smithi087.stdout:7/914: chown d14/d7d/c88 222845 1 2024-02-28T16:02:10.351 INFO:tasks.workunit.client.0.smithi057.stdout:5/473: dwrite d2/d15/d3b/f2f [0,4194304] 0 2024-02-28T16:02:10.351 INFO:tasks.workunit.client.0.smithi057.stdout:0/622: symlink d6/d4e/ld4 0 2024-02-28T16:02:10.355 INFO:tasks.workunit.client.1.smithi087.stdout:2/860: symlink d2/d99/dc7/de2/de4/d11b/l136 0 2024-02-28T16:02:10.357 INFO:tasks.workunit.client.1.smithi087.stdout:1/911: rmdir d0/d14/d3f/d119 0 2024-02-28T16:02:10.359 INFO:tasks.workunit.client.0.smithi057.stdout:4/479: dwrite d1/d3f/f53 [0,4194304] 0 2024-02-28T16:02:10.366 INFO:tasks.workunit.client.0.smithi057.stdout:5/474: chown d2/d15/d5e 69839993 1 2024-02-28T16:02:10.370 INFO:tasks.workunit.client.0.smithi057.stdout:1/506: dread d1/f45 [0,4194304] 0 2024-02-28T16:02:10.370 INFO:tasks.workunit.client.0.smithi057.stdout:8/439: creat d5/de/d1b/d45/d81/f93 x:0 0 0 2024-02-28T16:02:10.372 INFO:tasks.workunit.client.0.smithi057.stdout:0/623: rmdir d6/d12/d38/d5e 39 2024-02-28T16:02:10.376 INFO:tasks.workunit.client.1.smithi087.stdout:7/915: link d14/d2e/d2b/c6e d14/d46/d7c/df2/c122 0 2024-02-28T16:02:10.377 INFO:tasks.workunit.client.0.smithi057.stdout:6/435: stat df/d10/d78/d5b/d7b/l8e 0 2024-02-28T16:02:10.379 INFO:tasks.workunit.client.0.smithi057.stdout:4/480: unlink d1/d10/d31/d36/la2 0 2024-02-28T16:02:10.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/559: dwrite d2/d5e/d65/f28 [0,4194304] 0 2024-02-28T16:02:10.383 INFO:tasks.workunit.client.0.smithi057.stdout:3/470: dread d8/dd/d14/d2e/d76/d89/f87 [0,4194304] 0 2024-02-28T16:02:10.386 INFO:tasks.workunit.client.1.smithi087.stdout:7/916: link d14/d2e/d2b/d4e/fc8 d14/d2e/dc0/f123 0 2024-02-28T16:02:10.386 INFO:tasks.workunit.client.0.smithi057.stdout:2/490: dwrite d19/f23 [4194304,4194304] 0 2024-02-28T16:02:10.387 INFO:tasks.workunit.client.0.smithi057.stdout:8/440: write d5/de/f4d [3470721,93956] 0 2024-02-28T16:02:10.395 INFO:tasks.workunit.client.0.smithi057.stdout:5/475: mkdir d2/d15/d5e/d9a/dac 0 2024-02-28T16:02:10.398 INFO:tasks.workunit.client.0.smithi057.stdout:0/624: write d6/d12/d17/f3b [3297251,79662] 0 2024-02-28T16:02:10.399 INFO:tasks.workunit.client.1.smithi087.stdout:0/899: dread d4/d6/dc/d45/fed [4194304,4194304] 0 2024-02-28T16:02:10.405 INFO:tasks.workunit.client.0.smithi057.stdout:4/481: fsync d1/d10/d12/d2c/d50/d93/f95 0 2024-02-28T16:02:10.406 INFO:tasks.workunit.client.1.smithi087.stdout:0/900: getdents d4/dd/d37/d39 0 2024-02-28T16:02:10.406 INFO:tasks.workunit.client.0.smithi057.stdout:3/471: mkdir d8/d94 0 2024-02-28T16:02:10.408 INFO:tasks.workunit.client.1.smithi087.stdout:6/913: stat d4/dc/d61/d89 0 2024-02-28T16:02:10.408 INFO:tasks.workunit.client.0.smithi057.stdout:3/472: chown d8/dd 1 1 2024-02-28T16:02:10.410 INFO:tasks.workunit.client.0.smithi057.stdout:5/476: rmdir d2/d15/d5e/d67 39 2024-02-28T16:02:10.411 INFO:tasks.workunit.client.1.smithi087.stdout:0/901: mkdir d4/dd/d37/d39/d3a/dc1/d126 0 2024-02-28T16:02:10.412 INFO:tasks.workunit.client.1.smithi087.stdout:0/902: write d4/dd/d37/f3d [859092,114345] 0 2024-02-28T16:02:10.414 INFO:tasks.workunit.client.1.smithi087.stdout:0/903: fsync d4/dd/d21/d5f/f107 0 2024-02-28T16:02:10.416 INFO:tasks.workunit.client.0.smithi057.stdout:8/441: creat d5/d20/d39/d59/d67/f94 x:0 0 0 2024-02-28T16:02:10.418 INFO:tasks.workunit.client.1.smithi087.stdout:6/914: symlink d4/d12/d45/d57/l124 0 2024-02-28T16:02:10.418 INFO:tasks.workunit.client.1.smithi087.stdout:2/861: write d2/d7/dc0/d111/d34/f53 [3944481,100241] 0 2024-02-28T16:02:10.420 INFO:tasks.workunit.client.0.smithi057.stdout:8/442: dread - d5/d6/f88 zero size 2024-02-28T16:02:10.421 INFO:tasks.workunit.client.1.smithi087.stdout:2/862: creat d2/d99/d28/f137 x:0 0 0 2024-02-28T16:02:10.422 INFO:tasks.workunit.client.0.smithi057.stdout:1/507: getdents d1/d21/d66/d53/d62/d6f 0 2024-02-28T16:02:10.422 INFO:tasks.workunit.client.0.smithi057.stdout:0/625: rmdir d6/d12/d5d/d7f 39 2024-02-28T16:02:10.422 INFO:tasks.workunit.client.1.smithi087.stdout:0/904: fsync d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/f122 0 2024-02-28T16:02:10.422 INFO:tasks.workunit.client.0.smithi057.stdout:7/398: dwrite d6/d26/f86 [0,4194304] 0 2024-02-28T16:02:10.424 INFO:tasks.workunit.client.1.smithi087.stdout:1/912: write d0/d14/d86/fe9 [3106329,101396] 0 2024-02-28T16:02:10.425 INFO:tasks.workunit.client.1.smithi087.stdout:2/863: mkdir d2/d7/dc0/d111/d3d/d138 0 2024-02-28T16:02:10.426 INFO:tasks.workunit.client.0.smithi057.stdout:0/626: stat d6/fd 0 2024-02-28T16:02:10.427 INFO:tasks.workunit.client.1.smithi087.stdout:0/905: mkdir d4/dd/d26/d93/d127 0 2024-02-28T16:02:10.427 INFO:tasks.workunit.client.0.smithi057.stdout:5/477: write d2/d8/f9 [2330375,6047] 0 2024-02-28T16:02:10.427 INFO:tasks.workunit.client.1.smithi087.stdout:1/913: stat d0/d14/d86/dac/ff3 0 2024-02-28T16:02:10.429 INFO:tasks.workunit.client.1.smithi087.stdout:2/864: creat d2/d7/d121/f139 x:0 0 0 2024-02-28T16:02:10.429 INFO:tasks.workunit.client.0.smithi057.stdout:3/473: rename d8/dd/d14/d2e/d30/d49/d86/f8d to d8/dd/d14/d2c/f95 0 2024-02-28T16:02:10.429 INFO:tasks.workunit.client.1.smithi087.stdout:0/906: chown d4/d1c/l1e 545 1 2024-02-28T16:02:10.432 INFO:tasks.workunit.client.0.smithi057.stdout:1/508: rmdir d1/d3/dc/d40 39 2024-02-28T16:02:10.432 INFO:tasks.workunit.client.1.smithi087.stdout:1/914: chown d0/d14/d86/dac/ce8 27 1 2024-02-28T16:02:10.437 INFO:tasks.workunit.client.1.smithi087.stdout:7/917: dwrite d14/d2e/d89/deb/d5d/d6a/d94/f9f [0,4194304] 0 2024-02-28T16:02:10.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.444+0000 7f76ed600700 1 -- 172.21.15.57:0/401714909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e80fb870 msgr2=0x7f76e80fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:10.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.444+0000 7f76ed600700 1 --2- 172.21.15.57:0/401714909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e80fb870 0x7f76e80fbc80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76d8004940 tx=0x7f76d8009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:10.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.444+0000 7f76ed600700 1 -- 172.21.15.57:0/401714909 shutdown_connections 2024-02-28T16:02:10.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.444+0000 7f76ed600700 1 --2- 172.21.15.57:0/401714909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e80fc1c0 0x7f76e80fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:10.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.444+0000 7f76ed600700 1 --2- 172.21.15.57:0/401714909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e80fb870 0x7f76e80fbc80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:10.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.444+0000 7f76ed600700 1 -- 172.21.15.57:0/401714909 >> 172.21.15.57:0/401714909 conn(0x7f76e80f74e0 msgr2=0x7f76e80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:10.439 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:10 smithi057 ceph-mon[28763]: pgmap v37: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 90 MiB/s rd, 234 MiB/s wr, 491 op/s 2024-02-28T16:02:10.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.444+0000 7f76ed600700 1 -- 172.21.15.57:0/401714909 shutdown_connections 2024-02-28T16:02:10.441 INFO:tasks.workunit.client.0.smithi057.stdout:7/399: truncate d6/f23 2968418 0 2024-02-28T16:02:10.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.445+0000 7f76ed600700 1 -- 172.21.15.57:0/401714909 wait complete. 2024-02-28T16:02:10.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.446+0000 7f76ed600700 1 Processor -- start 2024-02-28T16:02:10.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.446+0000 7f76ed600700 1 -- start start 2024-02-28T16:02:10.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.447+0000 7f76ed600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e80fb870 0x7f76e810e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:10.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.447+0000 7f76ed600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e80fc1c0 0x7f76e810cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:10.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.447+0000 7f76ed600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e810e780 con 0x7f76e80fc1c0 2024-02-28T16:02:10.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.447+0000 7f76ed600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e810d110 con 0x7f76e80fb870 2024-02-28T16:02:10.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.448+0000 7f76e6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e80fb870 0x7f76e810e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:10.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.448+0000 7f76e6000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e80fc1c0 0x7f76e810cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:10.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.448+0000 7f76e6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e80fb870 0x7f76e810e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:57608/0 (socket says 172.21.15.57:57608) 2024-02-28T16:02:10.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.448+0000 7f76e6a00700 1 -- 172.21.15.57:0/1052026752 learned_addr learned my addr 172.21.15.57:0/1052026752 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:10.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.449+0000 7f76e6000700 1 -- 172.21.15.57:0/1052026752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e80fb870 msgr2=0x7f76e810e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:10.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.449+0000 7f76e6000700 1 --2- 172.21.15.57:0/1052026752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e80fb870 0x7f76e810e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:10.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.449+0000 7f76e6000700 1 -- 172.21.15.57:0/1052026752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8005040 con 0x7f76e80fc1c0 2024-02-28T16:02:10.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.450+0000 7f76e6000700 1 --2- 172.21.15.57:0/1052026752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e80fc1c0 0x7f76e810cbd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f76d400b530 tx=0x7f76d40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:10.443 INFO:tasks.workunit.client.1.smithi087.stdout:0/907: mkdir d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d128 0 2024-02-28T16:02:10.443 INFO:tasks.workunit.client.1.smithi087.stdout:1/915: creat d0/d14/f12a x:0 0 0 2024-02-28T16:02:10.443 INFO:tasks.workunit.client.1.smithi087.stdout:2/865: getdents d2/d7/dc0/d111/d34 0 2024-02-28T16:02:10.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.451+0000 7f76dea00700 1 -- 172.21.15.57:0/1052026752 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d400f6f0 con 0x7f76e80fc1c0 2024-02-28T16:02:10.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.451+0000 7f76dea00700 1 -- 172.21.15.57:0/1052026752 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76d400fd20 con 0x7f76e80fc1c0 2024-02-28T16:02:10.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.451+0000 7f76dea00700 1 -- 172.21.15.57:0/1052026752 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d40103a0 con 0x7f76e80fc1c0 2024-02-28T16:02:10.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.451+0000 7f76ed600700 1 -- 172.21.15.57:0/1052026752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e810d3f0 con 0x7f76e80fc1c0 2024-02-28T16:02:10.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.451+0000 7f76ed600700 1 -- 172.21.15.57:0/1052026752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e810d930 con 0x7f76e80fc1c0 2024-02-28T16:02:10.446 INFO:tasks.workunit.client.0.smithi057.stdout:8/443: symlink d5/d20/d39/d49/d89/d8d/l95 0 2024-02-28T16:02:10.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.454+0000 7f76ed600700 1 -- 172.21.15.57:0/1052026752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e804bed0 con 0x7f76e80fc1c0 2024-02-28T16:02:10.448 INFO:tasks.workunit.client.1.smithi087.stdout:6/915: rename d4/dc/d7e to d4/d30/d13/d67/db8/d125 0 2024-02-28T16:02:10.448 INFO:tasks.workunit.client.0.smithi057.stdout:3/474: fsync d8/dd/d19/d25/f7a 0 2024-02-28T16:02:10.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.457+0000 7f76dea00700 1 -- 172.21.15.57:0/1052026752 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7f76d400f850 con 0x7f76e80fc1c0 2024-02-28T16:02:10.450 INFO:tasks.workunit.client.0.smithi057.stdout:8/444: fsync d5/d6/f88 0 2024-02-28T16:02:10.450 INFO:tasks.workunit.client.0.smithi057.stdout:0/627: creat d6/d12/fd5 x:0 0 0 2024-02-28T16:02:10.450 INFO:tasks.workunit.client.1.smithi087.stdout:6/916: stat d4/d12/d45/c70 0 2024-02-28T16:02:10.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.459+0000 7f76dea00700 1 --2- 172.21.15.57:0/1052026752 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f76cc06b2e0 0x7f76cc06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:10.452 INFO:tasks.workunit.client.1.smithi087.stdout:2/866: truncate d2/d7/dc0/d111/d34/d88/fce 1269292 0 2024-02-28T16:02:10.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.459+0000 7f76dea00700 1 -- 172.21.15.57:0/1052026752 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f76d4089230 con 0x7f76e80fc1c0 2024-02-28T16:02:10.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.462+0000 7f76e6a00700 1 --2- 172.21.15.57:0/1052026752 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f76cc06b2e0 0x7f76cc06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:10.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.463+0000 7f76e6a00700 1 --2- 172.21.15.57:0/1052026752 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f76cc06b2e0 0x7f76cc06d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f76d800b7a0 tx=0x7f76d8009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:10.456 INFO:tasks.workunit.client.1.smithi087.stdout:2/867: creat d2/f13a x:0 0 0 2024-02-28T16:02:10.456 INFO:tasks.workunit.client.1.smithi087.stdout:6/917: creat d4/d12/f126 x:0 0 0 2024-02-28T16:02:10.457 INFO:tasks.workunit.client.0.smithi057.stdout:1/509: rmdir d1/d3/dc/d15/d4e/d5f 39 2024-02-28T16:02:10.458 INFO:tasks.workunit.client.1.smithi087.stdout:2/868: creat d2/d99/f13b x:0 0 0 2024-02-28T16:02:10.458 INFO:tasks.workunit.client.1.smithi087.stdout:7/918: dread d14/d2e/d2b/d4e/fc8 [0,4194304] 0 2024-02-28T16:02:10.459 INFO:tasks.workunit.client.1.smithi087.stdout:6/918: fsync d4/d30/d13/d38/dc3/fd1 0 2024-02-28T16:02:10.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.467+0000 7f76dea00700 1 -- 172.21.15.57:0/1052026752 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f76d4053440 con 0x7f76e80fc1c0 2024-02-28T16:02:10.459 INFO:tasks.workunit.client.1.smithi087.stdout:2/869: stat d2/d42/d4b/c68 0 2024-02-28T16:02:10.460 INFO:tasks.workunit.client.1.smithi087.stdout:7/919: fsync d14/d2e/d89/deb/d5d/d6a/f101 0 2024-02-28T16:02:10.462 INFO:tasks.workunit.client.1.smithi087.stdout:2/870: write d2/d7/dc0/d111/f33 [1597447,32957] 0 2024-02-28T16:02:10.464 INFO:tasks.workunit.client.0.smithi057.stdout:2/491: dwrite d19/f29 [0,4194304] 0 2024-02-28T16:02:10.464 INFO:tasks.workunit.client.0.smithi057.stdout:7/400: truncate d6/dc/d35/f51 276214 0 2024-02-28T16:02:10.464 INFO:tasks.workunit.client.0.smithi057.stdout:9/560: truncate d2/d46/f66 2583257 0 2024-02-28T16:02:10.466 INFO:tasks.workunit.client.1.smithi087.stdout:2/871: symlink d2/d7/dc0/d111/d97/l13c 0 2024-02-28T16:02:10.468 INFO:tasks.workunit.client.1.smithi087.stdout:1/916: dwrite d0/d1a/d28/f6b [0,4194304] 0 2024-02-28T16:02:10.469 INFO:tasks.workunit.client.0.smithi057.stdout:0/628: creat d6/d12/d17/d58/d95/daf/fd6 x:0 0 0 2024-02-28T16:02:10.470 INFO:tasks.workunit.client.0.smithi057.stdout:6/436: dwrite df/d14/d15/d16/f31 [0,4194304] 0 2024-02-28T16:02:10.470 INFO:tasks.workunit.client.1.smithi087.stdout:7/920: link d14/d2e/d89/deb/d5d/d6a/d94/f9f d14/d2e/d89/dbd/f124 0 2024-02-28T16:02:10.472 INFO:tasks.workunit.client.1.smithi087.stdout:7/921: chown d14/d2e/d89/c8f 131 1 2024-02-28T16:02:10.472 INFO:tasks.workunit.client.0.smithi057.stdout:3/475: symlink d8/dd/d14/d2e/d30/d6a/l96 0 2024-02-28T16:02:10.473 INFO:tasks.workunit.client.1.smithi087.stdout:7/922: chown d14/d7d/d115 26217 1 2024-02-28T16:02:10.473 INFO:tasks.workunit.client.1.smithi087.stdout:1/917: creat d0/d1b/d1f/d71/db2/f12b x:0 0 0 2024-02-28T16:02:10.475 INFO:tasks.workunit.client.1.smithi087.stdout:0/908: write d4/f89 [708773,61671] 0 2024-02-28T16:02:10.475 INFO:tasks.workunit.client.1.smithi087.stdout:1/918: write d0/d14/d48/fa6 [1388538,46297] 0 2024-02-28T16:02:10.482 INFO:tasks.workunit.client.1.smithi087.stdout:2/872: rmdir d2/d7/dc0/df0 0 2024-02-28T16:02:10.482 INFO:tasks.workunit.client.0.smithi057.stdout:9/561: mknod d2/d46/d67/cb4 0 2024-02-28T16:02:10.482 INFO:tasks.workunit.client.0.smithi057.stdout:1/510: truncate d1/d3/f11 3832425 0 2024-02-28T16:02:10.483 INFO:tasks.workunit.client.1.smithi087.stdout:2/873: fsync d2/d7/f15 0 2024-02-28T16:02:10.483 INFO:tasks.workunit.client.0.smithi057.stdout:5/478: dwrite d2/f10 [0,4194304] 0 2024-02-28T16:02:10.483 INFO:tasks.workunit.client.0.smithi057.stdout:8/445: rename d5/f41 to d5/de/d1b/d57/f96 0 2024-02-28T16:02:10.484 INFO:tasks.workunit.client.1.smithi087.stdout:0/909: truncate d4/dd/d37/d39/d3a/dc1/f35 6903277 0 2024-02-28T16:02:10.489 INFO:tasks.workunit.client.0.smithi057.stdout:8/446: truncate d5/de/d1b/f25 4476400 0 2024-02-28T16:02:10.492 INFO:tasks.workunit.client.0.smithi057.stdout:7/401: symlink d6/dc/d12/d1a/d4c/l8f 0 2024-02-28T16:02:10.494 INFO:tasks.workunit.client.0.smithi057.stdout:2/492: chown d19/d1d/d89/c94 238146828 1 2024-02-28T16:02:10.494 INFO:tasks.workunit.client.0.smithi057.stdout:0/629: dwrite d6/d12/d17/d58/d95/daf/fd6 [0,4194304] 0 2024-02-28T16:02:10.497 INFO:tasks.workunit.client.0.smithi057.stdout:0/630: dread - d6/d12/d38/db4/fbb zero size 2024-02-28T16:02:10.499 INFO:tasks.workunit.client.0.smithi057.stdout:6/437: mknod df/d14/d15/c90 0 2024-02-28T16:02:10.499 INFO:tasks.workunit.client.0.smithi057.stdout:0/631: chown d6/d12/d38/f52 61514 1 2024-02-28T16:02:10.510 INFO:tasks.workunit.client.0.smithi057.stdout:4/482: dread d1/d22/f2a [0,4194304] 0 2024-02-28T16:02:10.517 INFO:tasks.workunit.client.1.smithi087.stdout:6/919: dread d4/d12/d45/d92/dc1/de9/f10e [4194304,4194304] 0 2024-02-28T16:02:10.519 INFO:tasks.workunit.client.1.smithi087.stdout:1/919: write d0/d1b/d1f/d96/fcc [1913926,82882] 0 2024-02-28T16:02:10.520 INFO:tasks.workunit.client.0.smithi057.stdout:3/476: rename d8/dd/lf to d8/d4b/l97 0 2024-02-28T16:02:10.524 INFO:tasks.workunit.client.1.smithi087.stdout:6/920: chown d4/d12/d45/d92/dbd/fc6 9 1 2024-02-28T16:02:10.524 INFO:tasks.workunit.client.1.smithi087.stdout:7/923: dwrite d14/d46/d7c/f84 [0,4194304] 0 2024-02-28T16:02:10.524 INFO:tasks.workunit.client.1.smithi087.stdout:1/920: rename d0/d1b/d1f/d96 to d0/d1b/d43/d4d/d12c 0 2024-02-28T16:02:10.525 INFO:tasks.workunit.client.0.smithi057.stdout:9/562: fdatasync d2/d5e/d65/f73 0 2024-02-28T16:02:10.530 INFO:tasks.workunit.client.0.smithi057.stdout:2/493: rename d19/d1d/d26/d86 to d19/d43/d5a/d9b/da3 0 2024-02-28T16:02:10.530 INFO:tasks.workunit.client.1.smithi087.stdout:7/924: symlink d14/d46/d7c/db9/l125 0 2024-02-28T16:02:10.531 INFO:tasks.workunit.client.1.smithi087.stdout:6/921: rmdir d4/d12/d45/d92/dc1/dcf 39 2024-02-28T16:02:10.531 INFO:tasks.workunit.client.0.smithi057.stdout:2/494: readlink d19/d34/d78/l85 0 2024-02-28T16:02:10.534 INFO:tasks.workunit.client.1.smithi087.stdout:7/925: creat d14/d21/de4/f126 x:0 0 0 2024-02-28T16:02:10.537 INFO:tasks.workunit.client.1.smithi087.stdout:7/926: rmdir d14/d46/d7c/df2 39 2024-02-28T16:02:10.540 INFO:tasks.workunit.client.1.smithi087.stdout:7/927: readlink d14/d46/l7f 0 2024-02-28T16:02:10.543 INFO:tasks.workunit.client.1.smithi087.stdout:7/928: creat d14/f127 x:0 0 0 2024-02-28T16:02:10.544 INFO:tasks.workunit.client.0.smithi057.stdout:9/563: creat d2/d5/d1b/d2e/fb5 x:0 0 0 2024-02-28T16:02:10.545 INFO:tasks.workunit.client.1.smithi087.stdout:7/929: mknod d14/d7d/c128 0 2024-02-28T16:02:10.546 INFO:tasks.workunit.client.1.smithi087.stdout:7/930: chown d14/d30/dd1 1764 1 2024-02-28T16:02:10.547 INFO:tasks.workunit.client.0.smithi057.stdout:3/477: dread d8/dd/d14/d2e/d30/f3f [0,4194304] 0 2024-02-28T16:02:10.547 INFO:tasks.workunit.client.1.smithi087.stdout:7/931: dread - d14/d46/d7c/db9/fd8 zero size 2024-02-28T16:02:10.549 INFO:tasks.workunit.client.1.smithi087.stdout:1/921: dwrite d0/d1b/d1f/d71/db2/d24/d5c/d69/f7c [0,4194304] 0 2024-02-28T16:02:10.553 INFO:tasks.workunit.client.1.smithi087.stdout:7/932: creat d14/d46/d7c/db9/f129 x:0 0 0 2024-02-28T16:02:10.554 INFO:tasks.workunit.client.1.smithi087.stdout:1/922: mknod d0/d1b/d43/d4d/c12d 0 2024-02-28T16:02:10.555 INFO:tasks.workunit.client.0.smithi057.stdout:9/564: fsync d2/d5/f8 0 2024-02-28T16:02:10.559 INFO:tasks.workunit.client.1.smithi087.stdout:1/923: write d0/d1b/d1f/d71/db2/d24/d5c/d69/f7c [3446962,83037] 0 2024-02-28T16:02:10.565 INFO:tasks.workunit.client.1.smithi087.stdout:7/933: read d14/d2e/d89/deb/d5d/f5e [55630,54177] 0 2024-02-28T16:02:10.567 INFO:tasks.workunit.client.1.smithi087.stdout:7/934: dread - d14/d46/d7c/db9/fd8 zero size 2024-02-28T16:02:10.569 INFO:tasks.workunit.client.1.smithi087.stdout:2/874: dwrite d2/d99/dc7/fd9 [0,4194304] 0 2024-02-28T16:02:10.569 INFO:tasks.workunit.client.0.smithi057.stdout:3/478: creat d8/d94/f98 x:0 0 0 2024-02-28T16:02:10.569 INFO:tasks.workunit.client.0.smithi057.stdout:4/483: dwrite d1/d3f/d5f/f7c [0,4194304] 0 2024-02-28T16:02:10.570 INFO:tasks.workunit.client.1.smithi087.stdout:7/935: truncate d14/d21/ffa 869119 0 2024-02-28T16:02:10.574 INFO:tasks.workunit.client.1.smithi087.stdout:7/936: readlink d14/d2e/d89/deb/d55/lb8 0 2024-02-28T16:02:10.582 INFO:tasks.workunit.client.0.smithi057.stdout:0/632: dread d6/fd [0,4194304] 0 2024-02-28T16:02:10.582 INFO:tasks.workunit.client.1.smithi087.stdout:7/937: getdents d14/d2e/d89/deb 0 2024-02-28T16:02:10.586 INFO:tasks.workunit.client.0.smithi057.stdout:4/484: creat d1/d3f/d5f/fa5 x:0 0 0 2024-02-28T16:02:10.586 INFO:tasks.workunit.client.0.smithi057.stdout:5/479: dread d2/d12/d76/d7b/f69 [0,4194304] 0 2024-02-28T16:02:10.587 INFO:tasks.workunit.client.1.smithi087.stdout:7/938: rename d14/d7d/d115/f116 to d14/d21/de4/de7/f12a 0 2024-02-28T16:02:10.588 INFO:tasks.workunit.client.0.smithi057.stdout:5/480: chown d2/l5 26451 1 2024-02-28T16:02:10.590 INFO:tasks.workunit.client.1.smithi087.stdout:7/939: chown d14/d2e/d89/deb/d5d/d6a/d83/f7a 7 1 2024-02-28T16:02:10.591 INFO:tasks.workunit.client.1.smithi087.stdout:7/940: fdatasync d14/d2e/d89/fde 0 2024-02-28T16:02:10.592 INFO:tasks.workunit.client.1.smithi087.stdout:7/941: stat d14/d21/de4/f126 0 2024-02-28T16:02:10.593 INFO:tasks.workunit.client.1.smithi087.stdout:7/942: fsync d14/d2e/f78 0 2024-02-28T16:02:10.594 INFO:tasks.workunit.client.1.smithi087.stdout:7/943: chown d14/d2e/dc0/lcd 117874 1 2024-02-28T16:02:10.595 INFO:tasks.workunit.client.1.smithi087.stdout:7/944: fdatasync d14/d2e/d2b/f50 0 2024-02-28T16:02:10.596 INFO:tasks.workunit.client.0.smithi057.stdout:9/565: dwrite d2/d5e/d65/f15 [0,4194304] 0 2024-02-28T16:02:10.598 INFO:tasks.workunit.client.1.smithi087.stdout:7/945: creat d14/d30/dd1/f12b x:0 0 0 2024-02-28T16:02:10.599 INFO:tasks.workunit.client.0.smithi057.stdout:6/438: write df/d14/d15/d16/f46 [1094821,90901] 0 2024-02-28T16:02:10.602 INFO:tasks.workunit.client.1.smithi087.stdout:6/922: write d4/d30/d13/d38/d69/d99/fc4 [534757,60625] 0 2024-02-28T16:02:10.608 INFO:tasks.workunit.client.0.smithi057.stdout:5/481: mkdir d2/d12/d76/d7a/dad 0 2024-02-28T16:02:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:7/402: write d6/dc/d35/f51 [211596,113699] 0 2024-02-28T16:02:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:5/482: chown d2/d12/d3d 4 1 2024-02-28T16:02:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:9/566: mknod d2/d5/d1b/d2e/d44/cb6 0 2024-02-28T16:02:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:6/439: read - df/d10/d13/d4b/f7d zero size 2024-02-28T16:02:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:5/483: stat d2/d15/d3b/f59 0 2024-02-28T16:02:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:2/495: dwrite d19/f37 [0,4194304] 0 2024-02-28T16:02:10.632 INFO:tasks.workunit.client.1.smithi087.stdout:1/924: dread d0/f70 [0,4194304] 0 2024-02-28T16:02:10.632 INFO:tasks.workunit.client.1.smithi087.stdout:2/875: dread d2/d7/dc0/d111/d3d/f5f [0,4194304] 0 2024-02-28T16:02:10.633 INFO:tasks.workunit.client.1.smithi087.stdout:1/925: stat d0/cf6 0 2024-02-28T16:02:10.636 INFO:tasks.workunit.client.1.smithi087.stdout:2/876: creat d2/d99/dc7/de2/de4/d11b/f13d x:0 0 0 2024-02-28T16:02:10.636 INFO:tasks.workunit.client.1.smithi087.stdout:1/926: symlink d0/d1b/d1f/d71/db2/l12e 0 2024-02-28T16:02:10.637 INFO:tasks.workunit.client.1.smithi087.stdout:1/927: stat d0/d1b/ca0 0 2024-02-28T16:02:10.638 INFO:tasks.workunit.client.0.smithi057.stdout:1/511: dwrite d1/d3/dc/d15/f3c [0,4194304] 0 2024-02-28T16:02:10.639 INFO:tasks.workunit.client.1.smithi087.stdout:1/928: readlink d0/d1b/lc5 0 2024-02-28T16:02:10.643 INFO:tasks.workunit.client.1.smithi087.stdout:2/877: mknod d2/d99/d28/d79/d9f/de1/d129/c13e 0 2024-02-28T16:02:10.643 INFO:tasks.workunit.client.0.smithi057.stdout:8/447: dwrite d5/de/d1b/d45/f4e [0,4194304] 0 2024-02-28T16:02:10.644 INFO:tasks.workunit.client.0.smithi057.stdout:1/512: chown d1/d21/d66/d53/d7d/d67/d7a/d94 7 1 2024-02-28T16:02:10.646 INFO:tasks.workunit.client.1.smithi087.stdout:2/878: chown d2/d7d/fcb 36 1 2024-02-28T16:02:10.647 INFO:tasks.workunit.client.0.smithi057.stdout:8/448: readlink d5/de/d1b/l7f 0 2024-02-28T16:02:10.647 INFO:tasks.workunit.client.1.smithi087.stdout:1/929: creat d0/d1b/d1f/d71/dad/f12f x:0 0 0 2024-02-28T16:02:10.648 INFO:tasks.workunit.client.0.smithi057.stdout:7/403: dwrite d6/dc/d67/f8a [0,4194304] 0 2024-02-28T16:02:10.652 INFO:tasks.workunit.client.0.smithi057.stdout:0/633: creat d6/fd7 x:0 0 0 2024-02-28T16:02:10.653 INFO:tasks.workunit.client.1.smithi087.stdout:6/923: dwrite d4/dc/d61/fe0 [0,4194304] 0 2024-02-28T16:02:10.654 INFO:tasks.workunit.client.0.smithi057.stdout:6/440: creat df/d10/d78/f91 x:0 0 0 2024-02-28T16:02:10.657 INFO:tasks.workunit.client.1.smithi087.stdout:2/879: rename d2/d42/c61 to d2/d99/d28/d79/d9f/de1/d129/c13f 0 2024-02-28T16:02:10.657 INFO:tasks.workunit.client.1.smithi087.stdout:1/930: unlink d0/d14/d86/c9d 0 2024-02-28T16:02:10.661 INFO:tasks.workunit.client.1.smithi087.stdout:1/931: creat d0/d1b/d43/de3/f130 x:0 0 0 2024-02-28T16:02:10.662 INFO:tasks.workunit.client.0.smithi057.stdout:2/496: mknod d19/d1d/d26/ca4 0 2024-02-28T16:02:10.666 INFO:tasks.workunit.client.0.smithi057.stdout:5/484: unlink d2/d12/d76/d7b/d62/d74/f89 0 2024-02-28T16:02:10.666 INFO:tasks.workunit.client.0.smithi057.stdout:0/634: write d6/d12/d17/d58/d95/daf/fc2 [578707,49199] 0 2024-02-28T16:02:10.668 INFO:tasks.workunit.client.1.smithi087.stdout:1/932: rename d0/d1b/d1f/d71/db2/dae/dcd to d0/d1b/d43/de3/d131 0 2024-02-28T16:02:10.670 INFO:tasks.workunit.client.0.smithi057.stdout:5/485: write d2/d15/fa1 [1900818,42779] 0 2024-02-28T16:02:10.685 INFO:tasks.workunit.client.1.smithi087.stdout:6/924: creat d4/d12/d45/d92/de5/f127 x:0 0 0 2024-02-28T16:02:10.686 INFO:tasks.workunit.client.1.smithi087.stdout:6/925: stat d4/f23 0 2024-02-28T16:02:10.688 INFO:tasks.workunit.client.0.smithi057.stdout:2/497: symlink d19/d1d/d2e/d31/la5 0 2024-02-28T16:02:10.691 INFO:tasks.workunit.client.0.smithi057.stdout:5/486: chown d2/c21 352 1 2024-02-28T16:02:10.692 INFO:tasks.workunit.client.0.smithi057.stdout:2/498: dread d19/d1d/d22/f6b [0,4194304] 0 2024-02-28T16:02:10.695 INFO:tasks.workunit.client.1.smithi087.stdout:6/926: unlink d4/dc/d61/f63 0 2024-02-28T16:02:10.696 INFO:tasks.workunit.client.1.smithi087.stdout:2/880: write d2/d42/d4b/f56 [629652,355] 0 2024-02-28T16:02:10.697 INFO:tasks.workunit.client.0.smithi057.stdout:1/513: unlink d1/d21/d66/d53/d62/d73/l89 0 2024-02-28T16:02:10.698 INFO:tasks.workunit.client.1.smithi087.stdout:2/881: dread - d2/d99/d28/f137 zero size 2024-02-28T16:02:10.700 INFO:tasks.workunit.client.1.smithi087.stdout:2/882: unlink d2/d7/d121/f139 0 2024-02-28T16:02:10.701 INFO:tasks.workunit.client.0.smithi057.stdout:1/514: fsync d1/d21/d66/d44/d4c/f6b 0 2024-02-28T16:02:10.703 INFO:tasks.workunit.client.1.smithi087.stdout:2/883: creat d2/d42/d4b/f140 x:0 0 0 2024-02-28T16:02:10.705 INFO:tasks.workunit.client.0.smithi057.stdout:5/487: mkdir d2/dae 0 2024-02-28T16:02:10.706 INFO:tasks.workunit.client.1.smithi087.stdout:2/884: mknod d2/d99/d28/d79/c141 0 2024-02-28T16:02:10.707 INFO:tasks.workunit.client.0.smithi057.stdout:5/488: read d2/d15/fa1 [2069384,14425] 0 2024-02-28T16:02:10.707 INFO:tasks.workunit.client.0.smithi057.stdout:1/515: rename d1/d21/d66/l9e to d1/d21/d66/d53/d7d/d67/d7a/d92/lab 0 2024-02-28T16:02:10.708 INFO:tasks.workunit.client.1.smithi087.stdout:2/885: symlink d2/d99/d28/d54/da6/dd7/l142 0 2024-02-28T16:02:10.709 INFO:tasks.workunit.client.1.smithi087.stdout:6/927: dwrite d4/d30/d13/d38/d69/db0/f11a [0,4194304] 0 2024-02-28T16:02:10.709 INFO:tasks.workunit.client.0.smithi057.stdout:5/489: chown d2/d12/d3d/l71 187340630 1 2024-02-28T16:02:10.710 INFO:tasks.workunit.client.1.smithi087.stdout:6/928: stat d4/d12/ffd 0 2024-02-28T16:02:10.710 INFO:tasks.workunit.client.1.smithi087.stdout:2/886: fdatasync d2/d7/dec/f10f 0 2024-02-28T16:02:10.713 INFO:tasks.workunit.client.1.smithi087.stdout:2/887: mknod d2/d99/d28/c143 0 2024-02-28T16:02:10.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:10 smithi087 ceph-mon[37122]: pgmap v37: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 90 MiB/s rd, 234 MiB/s wr, 491 op/s 2024-02-28T16:02:10.716 INFO:tasks.workunit.client.1.smithi087.stdout:6/929: mknod d4/d30/d13/d38/d69/d99/c128 0 2024-02-28T16:02:10.717 INFO:tasks.workunit.client.1.smithi087.stdout:6/930: chown d4/d30/f84 4547 1 2024-02-28T16:02:10.718 INFO:tasks.workunit.client.0.smithi057.stdout:1/516: unlink d1/d21/d66/d53/d7d/d67/f93 0 2024-02-28T16:02:10.718 INFO:tasks.workunit.client.0.smithi057.stdout:5/490: symlink d2/d12/d5f/d77/laf 0 2024-02-28T16:02:10.723 INFO:tasks.workunit.client.1.smithi087.stdout:6/931: mknod d4/d12/d45/d57/c129 0 2024-02-28T16:02:10.724 INFO:tasks.workunit.client.0.smithi057.stdout:1/517: read d1/d3/f11 [464417,81897] 0 2024-02-28T16:02:10.724 INFO:tasks.workunit.client.0.smithi057.stdout:5/491: mkdir d2/d3e/d5b/db0 0 2024-02-28T16:02:10.725 INFO:tasks.workunit.client.0.smithi057.stdout:1/518: chown d1/d21 6 1 2024-02-28T16:02:10.732 INFO:tasks.workunit.client.0.smithi057.stdout:5/492: creat d2/d12/fb1 x:0 0 0 2024-02-28T16:02:10.734 INFO:tasks.workunit.client.1.smithi087.stdout:2/888: dwrite d2/d42/d4b/f131 [0,4194304] 0 2024-02-28T16:02:10.735 INFO:tasks.workunit.client.0.smithi057.stdout:7/404: write d6/f28 [46913,6484] 0 2024-02-28T16:02:10.735 INFO:tasks.workunit.client.0.smithi057.stdout:1/519: dread d1/d21/d66/d44/d4c/f5e [0,4194304] 0 2024-02-28T16:02:10.740 INFO:tasks.workunit.client.0.smithi057.stdout:6/441: dwrite df/d14/f2d [0,4194304] 0 2024-02-28T16:02:10.740 INFO:tasks.workunit.client.1.smithi087.stdout:6/932: dwrite d4/d30/d13/f2a [4194304,4194304] 0 2024-02-28T16:02:10.740 INFO:tasks.workunit.client.0.smithi057.stdout:9/567: dwrite d2/d24/f14 [0,4194304] 0 2024-02-28T16:02:10.741 INFO:tasks.workunit.client.1.smithi087.stdout:2/889: symlink d2/d7/dc0/d111/d34/d88/l144 0 2024-02-28T16:02:10.744 INFO:tasks.workunit.client.0.smithi057.stdout:6/442: write df/d10/d78/d5b/f8f [729646,29032] 0 2024-02-28T16:02:10.745 INFO:tasks.workunit.client.1.smithi087.stdout:2/890: creat d2/d99/f145 x:0 0 0 2024-02-28T16:02:10.747 INFO:tasks.workunit.client.0.smithi057.stdout:6/443: chown df/c83 193636 1 2024-02-28T16:02:10.752 INFO:tasks.workunit.client.1.smithi087.stdout:2/891: dread - d2/d99/d28/d79/d9f/de1/f125 zero size 2024-02-28T16:02:10.752 INFO:tasks.workunit.client.0.smithi057.stdout:7/405: mkdir d6/dc/d12/d1a/d90 0 2024-02-28T16:02:10.755 INFO:tasks.workunit.client.1.smithi087.stdout:2/892: dread - d2/d99/dc7/def/f132 zero size 2024-02-28T16:02:10.760 INFO:tasks.workunit.client.0.smithi057.stdout:1/520: mknod d1/d21/d66/d53/d62/d6f/cac 0 2024-02-28T16:02:10.762 INFO:tasks.workunit.client.1.smithi087.stdout:2/893: link d2/f85 d2/d7/dc0/d111/d34/f146 0 2024-02-28T16:02:10.763 INFO:tasks.workunit.client.0.smithi057.stdout:6/444: mkdir df/d14/d15/d16/d39/d92 0 2024-02-28T16:02:10.764 INFO:tasks.workunit.client.1.smithi087.stdout:2/894: mknod d2/d99/dc7/c147 0 2024-02-28T16:02:10.767 INFO:tasks.workunit.client.1.smithi087.stdout:2/895: dread - d2/d99/d28/d79/f101 zero size 2024-02-28T16:02:10.767 INFO:tasks.workunit.client.0.smithi057.stdout:5/493: write d2/d15/d3b/f4e [717273,92495] 0 2024-02-28T16:02:10.769 INFO:tasks.workunit.client.0.smithi057.stdout:7/406: creat d6/dc/d12/d1a/d4c/d63/f91 x:0 0 0 2024-02-28T16:02:10.770 INFO:tasks.workunit.client.1.smithi087.stdout:2/896: mknod d2/d9a/c148 0 2024-02-28T16:02:10.770 INFO:tasks.workunit.client.0.smithi057.stdout:5/494: write d2/d15/d63/f8f [297246,29875] 0 2024-02-28T16:02:10.772 INFO:tasks.workunit.client.1.smithi087.stdout:2/897: symlink d2/d99/d28/d79/l149 0 2024-02-28T16:02:10.773 INFO:tasks.workunit.client.1.smithi087.stdout:2/898: chown d2/fc 939944 1 2024-02-28T16:02:10.774 INFO:tasks.workunit.client.0.smithi057.stdout:5/495: read d2/d12/d76/d7b/f69 [926840,30866] 0 2024-02-28T16:02:10.775 INFO:tasks.workunit.client.0.smithi057.stdout:9/568: link d2/d5e/fb0 d2/d5/fb7 0 2024-02-28T16:02:10.776 INFO:tasks.workunit.client.1.smithi087.stdout:2/899: mknod d2/d99/dc7/d134/c14a 0 2024-02-28T16:02:10.776 INFO:tasks.workunit.client.0.smithi057.stdout:5/496: chown d2/d15/d3b/d91 13491998 1 2024-02-28T16:02:10.777 INFO:tasks.workunit.client.0.smithi057.stdout:6/445: read - df/d10/d13/f73 zero size 2024-02-28T16:02:10.779 INFO:tasks.workunit.client.0.smithi057.stdout:7/407: truncate d6/dc/d12/f2d 308567 0 2024-02-28T16:02:10.779 INFO:tasks.workunit.client.1.smithi087.stdout:2/900: symlink d2/d99/d28/d54/da6/dd7/l14b 0 2024-02-28T16:02:10.780 INFO:tasks.workunit.client.0.smithi057.stdout:5/497: chown d2/d12/d76/d7a 530838 1 2024-02-28T16:02:10.780 INFO:tasks.workunit.client.1.smithi087.stdout:2/901: write d2/fc [1787099,130642] 0 2024-02-28T16:02:10.781 INFO:tasks.workunit.client.0.smithi057.stdout:6/446: chown df/d10 5417 1 2024-02-28T16:02:10.782 INFO:tasks.workunit.client.1.smithi087.stdout:6/933: dread d4/d30/d13/d38/f47 [0,4194304] 0 2024-02-28T16:02:10.787 INFO:tasks.workunit.client.1.smithi087.stdout:2/902: rename d2/d99/d28/d54/f91 to d2/f14c 0 2024-02-28T16:02:10.789 INFO:tasks.workunit.client.0.smithi057.stdout:5/498: read d2/d12/d3d/f97 [1218735,46855] 0 2024-02-28T16:02:10.789 INFO:tasks.workunit.client.0.smithi057.stdout:9/569: unlink d2/d5/d9/d64/d78/l8a 0 2024-02-28T16:02:10.790 INFO:tasks.workunit.client.0.smithi057.stdout:1/521: dwrite d1/d21/d66/d53/d7d/d65/f5a [0,4194304] 0 2024-02-28T16:02:10.791 INFO:tasks.workunit.client.1.smithi087.stdout:2/903: write d2/d7/dc0/d111/d34/f3a [2203098,129166] 0 2024-02-28T16:02:10.793 INFO:tasks.workunit.client.1.smithi087.stdout:2/904: chown d2/d7/dc0/d111/f115 822 1 2024-02-28T16:02:10.795 INFO:tasks.workunit.client.0.smithi057.stdout:7/408: rename d6/dc/d12/d1a/d4d/d5a/f78 to d6/dc/d12/d1a/d4d/f92 0 2024-02-28T16:02:10.796 INFO:tasks.workunit.client.1.smithi087.stdout:2/905: mkdir d2/d42/ddd/d14d 0 2024-02-28T16:02:10.796 INFO:tasks.workunit.client.0.smithi057.stdout:5/499: mknod d2/d12/d76/cb2 0 2024-02-28T16:02:10.797 INFO:tasks.workunit.client.1.smithi087.stdout:2/906: dread - d2/f13a zero size 2024-02-28T16:02:10.801 INFO:tasks.workunit.client.0.smithi057.stdout:6/447: creat df/d14/d15/d16/d39/d92/f93 x:0 0 0 2024-02-28T16:02:10.801 INFO:tasks.workunit.client.0.smithi057.stdout:9/570: dread - d2/d5/d1b/d2e/d4c/f91 zero size 2024-02-28T16:02:10.802 INFO:tasks.workunit.client.1.smithi087.stdout:2/907: link d2/f3e d2/d99/d28/d79/d9f/f14e 0 2024-02-28T16:02:10.803 INFO:tasks.workunit.client.0.smithi057.stdout:7/409: unlink d6/dc/d12/d1a/d4d/d5a/f66 0 2024-02-28T16:02:10.804 INFO:tasks.workunit.client.0.smithi057.stdout:1/522: write d1/d3/dc/d15/d4e/d5f/f85 [2220920,124244] 0 2024-02-28T16:02:10.806 INFO:tasks.workunit.client.1.smithi087.stdout:2/908: getdents d2/d7/d12e 0 2024-02-28T16:02:10.808 INFO:tasks.workunit.client.1.smithi087.stdout:6/934: dread d4/dc/d61/d89/f9d [0,4194304] 0 2024-02-28T16:02:10.809 INFO:tasks.workunit.client.0.smithi057.stdout:9/571: creat d2/d24/fb8 x:0 0 0 2024-02-28T16:02:10.810 INFO:tasks.workunit.client.1.smithi087.stdout:2/909: dread - d2/d7/dc0/d111/d34/d88/f119 zero size 2024-02-28T16:02:10.811 INFO:tasks.workunit.client.1.smithi087.stdout:2/910: dread - d2/d7/dc0/d111/d34/d88/f119 zero size 2024-02-28T16:02:10.812 INFO:tasks.workunit.client.0.smithi057.stdout:7/410: link d6/d26/c3c d6/d26/c93 0 2024-02-28T16:02:10.812 INFO:tasks.workunit.client.0.smithi057.stdout:1/523: creat d1/d21/d66/d53/d7d/d67/d6c/fad x:0 0 0 2024-02-28T16:02:10.819 INFO:tasks.workunit.client.0.smithi057.stdout:1/524: fsync d1/d21/d66/d53/d7d/d65/f5c 0 2024-02-28T16:02:10.819 INFO:tasks.workunit.client.0.smithi057.stdout:7/411: creat d6/dc/d12/d1a/d4d/f94 x:0 0 0 2024-02-28T16:02:10.822 INFO:tasks.workunit.client.0.smithi057.stdout:1/525: readlink d1/d21/d66/l80 0 2024-02-28T16:02:10.823 INFO:tasks.workunit.client.1.smithi087.stdout:2/911: dwrite d2/d7/dc0/d111/d34/f3a [0,4194304] 0 2024-02-28T16:02:10.823 INFO:tasks.workunit.client.0.smithi057.stdout:1/526: chown d1/d21/c54 267069859 1 2024-02-28T16:02:10.824 INFO:tasks.workunit.client.0.smithi057.stdout:7/412: dread - d6/dc/d12/d1a/d4d/f69 zero size 2024-02-28T16:02:10.831 INFO:tasks.workunit.client.0.smithi057.stdout:1/527: chown d1/d21/d66/d53/d62/d73 82 1 2024-02-28T16:02:10.832 INFO:tasks.workunit.client.0.smithi057.stdout:5/500: dwrite d2/d15/f1f [0,4194304] 0 2024-02-28T16:02:10.838 INFO:tasks.workunit.client.0.smithi057.stdout:7/413: unlink d6/dc/d12/d1a/c31 0 2024-02-28T16:02:10.838 INFO:tasks.workunit.client.0.smithi057.stdout:5/501: chown d2/d15/d3b/f4e 1724474 1 2024-02-28T16:02:10.842 INFO:tasks.workunit.client.0.smithi057.stdout:7/414: mknod d6/d26/c95 0 2024-02-28T16:02:10.842 INFO:tasks.workunit.client.0.smithi057.stdout:9/572: dwrite d2/d5/d9/f32 [0,4194304] 0 2024-02-28T16:02:10.846 INFO:tasks.workunit.client.1.smithi087.stdout:2/912: write d2/d7/dc0/d111/f59 [4795579,93495] 0 2024-02-28T16:02:10.848 INFO:tasks.workunit.client.0.smithi057.stdout:7/415: write d6/dc/d12/d29/f3e [3471116,48814] 0 2024-02-28T16:02:10.849 INFO:tasks.workunit.client.0.smithi057.stdout:6/448: dwrite df/d10/d13/f3a [0,4194304] 0 2024-02-28T16:02:10.851 INFO:tasks.workunit.client.1.smithi087.stdout:2/913: rename d2/d99/d28/d54 to d2/d42/d4b/d14f 0 2024-02-28T16:02:10.854 INFO:tasks.workunit.client.1.smithi087.stdout:2/914: rmdir d2/d7/dc0/d111/d34 39 2024-02-28T16:02:10.854 INFO:tasks.workunit.client.1.smithi087.stdout:2/915: stat d2/d99/c73 0 2024-02-28T16:02:10.857 INFO:tasks.workunit.client.0.smithi057.stdout:9/573: write d2/d5e/d65/d87/f94 [998275,111524] 0 2024-02-28T16:02:10.857 INFO:tasks.workunit.client.1.smithi087.stdout:2/916: fsync d2/d7/dc0/d111/fcd 0 2024-02-28T16:02:10.858 INFO:tasks.workunit.client.0.smithi057.stdout:5/502: creat d2/d15/d3b/dab/fb3 x:0 0 0 2024-02-28T16:02:10.861 INFO:tasks.workunit.client.0.smithi057.stdout:9/574: chown d2/d5/d9/d57/l96 460213350 1 2024-02-28T16:02:10.867 INFO:tasks.workunit.client.0.smithi057.stdout:6/449: dwrite df/d10/d78/d5b/f8f [0,4194304] 0 2024-02-28T16:02:10.874 INFO:tasks.workunit.client.0.smithi057.stdout:5/503: mknod d2/d15/d3b/dab/cb4 0 2024-02-28T16:02:10.874 INFO:tasks.workunit.client.1.smithi087.stdout:2/917: dwrite d2/f14c [0,4194304] 0 2024-02-28T16:02:10.876 INFO:tasks.workunit.client.0.smithi057.stdout:9/575: symlink d2/d46/lb9 0 2024-02-28T16:02:10.882 INFO:tasks.workunit.client.1.smithi087.stdout:2/918: dread d2/f3e [0,4194304] 0 2024-02-28T16:02:10.885 INFO:tasks.workunit.client.0.smithi057.stdout:7/416: creat d6/dc/f96 x:0 0 0 2024-02-28T16:02:10.888 INFO:tasks.workunit.client.1.smithi087.stdout:2/919: symlink d2/d7/dc0/d111/d34/l150 0 2024-02-28T16:02:10.892 INFO:tasks.workunit.client.0.smithi057.stdout:9/576: creat d2/d5/d1b/fba x:0 0 0 2024-02-28T16:02:10.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.903+0000 7f76ed600700 1 -- 172.21.15.57:0/1052026752 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76e81049a0 con 0x7f76cc06b2e0 2024-02-28T16:02:10.898 INFO:tasks.workunit.client.1.smithi087.stdout:2/920: write d2/d99/d28/f83 [548065,35672] 0 2024-02-28T16:02:10.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.905+0000 7f76dea00700 1 -- 172.21.15.57:0/1052026752 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f76e81049a0 con 0x7f76cc06b2e0 2024-02-28T16:02:10.900 INFO:tasks.workunit.client.1.smithi087.stdout:2/921: mknod d2/d7/d12e/c151 0 2024-02-28T16:02:10.900 INFO:tasks.workunit.client.0.smithi057.stdout:9/577: getdents d2/d92 0 2024-02-28T16:02:10.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.909+0000 7f76ed600700 1 -- 172.21.15.57:0/1052026752 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f76cc06b2e0 msgr2=0x7f76cc06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:10.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.909+0000 7f76ed600700 1 --2- 172.21.15.57:0/1052026752 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f76cc06b2e0 0x7f76cc06d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f76d800b7a0 tx=0x7f76d8009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:10.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.909+0000 7f76ed600700 1 -- 172.21.15.57:0/1052026752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e80fc1c0 msgr2=0x7f76e810cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:10.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.909+0000 7f76ed600700 1 --2- 172.21.15.57:0/1052026752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e80fc1c0 0x7f76e810cbd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f76d400b530 tx=0x7f76d40090f0 comp rx=0 tx=0).stop 2024-02-28T16:02:10.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.909+0000 7f76ed600700 1 -- 172.21.15.57:0/1052026752 shutdown_connections 2024-02-28T16:02:10.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.909+0000 7f76ed600700 1 --2- 172.21.15.57:0/1052026752 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f76cc06b2e0 0x7f76cc06d790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:10.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.909+0000 7f76ed600700 1 --2- 172.21.15.57:0/1052026752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e80fb870 0x7f76e810e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:10.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.909+0000 7f76ed600700 1 --2- 172.21.15.57:0/1052026752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e80fc1c0 0x7f76e810cbd0 secure :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f76d400b530 tx=0x7f76d40090f0 comp rx=0 tx=0).stop 2024-02-28T16:02:10.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.909+0000 7f76ed600700 1 -- 172.21.15.57:0/1052026752 >> 172.21.15.57:0/1052026752 conn(0x7f76e80f74e0 msgr2=0x7f76e8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:10.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.909+0000 7f76ed600700 1 -- 172.21.15.57:0/1052026752 shutdown_connections 2024-02-28T16:02:10.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:10.910+0000 7f76ed600700 1 -- 172.21.15.57:0/1052026752 wait complete. 2024-02-28T16:02:10.903 INFO:tasks.workunit.client.0.smithi057.stdout:6/450: write f9 [150854,108932] 0 2024-02-28T16:02:10.903 INFO:tasks.workunit.client.0.smithi057.stdout:5/504: write d2/d12/d76/f87 [14618,36583] 0 2024-02-28T16:02:10.907 INFO:tasks.workunit.client.0.smithi057.stdout:9/578: rename d2/d5e/d65/f56 to d2/d24/d9c/fbb 0 2024-02-28T16:02:10.911 INFO:tasks.workunit.client.0.smithi057.stdout:6/451: truncate df/d10/d78/d5b/f8b 391013 0 2024-02-28T16:02:10.912 INFO:tasks.workunit.client.0.smithi057.stdout:9/579: symlink d2/d5/d9/d5d/d82/lbc 0 2024-02-28T16:02:10.921 INFO:tasks.workunit.client.1.smithi087.stdout:2/922: dread d2/d99/d28/d79/da3/fe0 [0,4194304] 0 2024-02-28T16:02:10.921 INFO:tasks.workunit.client.0.smithi057.stdout:7/417: dwrite d6/dc/d12/d1a/d4c/d63/f80 [0,4194304] 0 2024-02-28T16:02:10.926 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:02:10.928 INFO:tasks.workunit.client.0.smithi057.stdout:6/452: write df/d10/d13/f38 [929,109034] 0 2024-02-28T16:02:10.928 INFO:tasks.workunit.client.0.smithi057.stdout:9/580: write d2/d5/d9/fb [3482424,93541] 0 2024-02-28T16:02:10.930 INFO:tasks.workunit.client.0.smithi057.stdout:5/505: dwrite d2/d15/fa1 [0,4194304] 0 2024-02-28T16:02:10.934 INFO:tasks.workunit.client.0.smithi057.stdout:6/453: symlink df/d10/d13/l94 0 2024-02-28T16:02:10.936 INFO:tasks.workunit.client.0.smithi057.stdout:6/454: stat df/f53 0 2024-02-28T16:02:10.939 INFO:tasks.workunit.client.1.smithi087.stdout:2/923: dwrite d2/d7/dc0/d111/d34/f4a [0,4194304] 0 2024-02-28T16:02:10.940 INFO:tasks.workunit.client.1.smithi087.stdout:2/924: readlink d2/d99/lf4 0 2024-02-28T16:02:10.944 INFO:tasks.workunit.client.0.smithi057.stdout:7/418: dread d6/dc/f43 [0,4194304] 0 2024-02-28T16:02:10.947 INFO:tasks.workunit.client.0.smithi057.stdout:6/455: rename df/d10/f64 to df/d14/d15/d82/f95 0 2024-02-28T16:02:10.951 INFO:tasks.workunit.client.0.smithi057.stdout:7/419: mkdir d6/d38/d97 0 2024-02-28T16:02:10.955 INFO:tasks.workunit.client.0.smithi057.stdout:7/420: stat d6/dc/d12/d1a/d4c/d6c/c72 0 2024-02-28T16:02:10.956 INFO:tasks.workunit.client.0.smithi057.stdout:9/581: write d2/d5/d1b/f49 [4320989,100944] 0 2024-02-28T16:02:10.965 INFO:tasks.workunit.client.0.smithi057.stdout:5/506: dwrite d2/d3e/d5b/f94 [0,4194304] 0 2024-02-28T16:02:10.972 INFO:tasks.workunit.client.0.smithi057.stdout:7/421: getdents d6/dc/d12/d1a/d4d/d5a 0 2024-02-28T16:02:10.973 INFO:tasks.workunit.client.0.smithi057.stdout:5/507: truncate d2/d12/d3d/f61 2254173 0 2024-02-28T16:02:10.977 INFO:tasks.workunit.client.0.smithi057.stdout:5/508: mkdir d2/d12/d76/d7a/d95/db5 0 2024-02-28T16:02:10.984 INFO:tasks.workunit.client.0.smithi057.stdout:5/509: rename d2/d15/f83 to d2/d8/fb6 0 2024-02-28T16:02:10.984 INFO:tasks.workunit.client.0.smithi057.stdout:7/422: link d6/d26/c95 d6/dc/d12/d1a/d4c/d63/c98 0 2024-02-28T16:02:10.988 INFO:tasks.workunit.client.0.smithi057.stdout:6/456: dread df/d10/d13/f77 [0,4194304] 0 2024-02-28T16:02:10.996 INFO:tasks.workunit.client.0.smithi057.stdout:7/423: rename d6/dc/d35/d58/f6b to d6/dc/d12/f99 0 2024-02-28T16:02:10.997 INFO:tasks.workunit.client.0.smithi057.stdout:6/457: symlink df/d61/d7c/l96 0 2024-02-28T16:02:11.000 INFO:tasks.workunit.client.0.smithi057.stdout:6/458: chown df/d10/d78/l6f 1725390529 1 2024-02-28T16:02:11.005 INFO:tasks.workunit.client.0.smithi057.stdout:6/459: write df/f1f [3687217,67895] 0 2024-02-28T16:02:11.007 INFO:tasks.workunit.client.0.smithi057.stdout:9/582: dread d2/d5/d9/f35 [0,4194304] 0 2024-02-28T16:02:11.010 INFO:tasks.workunit.client.0.smithi057.stdout:6/460: chown df/d10/d4f/f71 1081 1 2024-02-28T16:02:11.012 INFO:tasks.workunit.client.0.smithi057.stdout:5/510: dwrite d2/d12/d3d/f97 [0,4194304] 0 2024-02-28T16:02:11.014 INFO:tasks.workunit.client.0.smithi057.stdout:6/461: mkdir df/d14/d15/d16/d97 0 2024-02-28T16:02:11.015 INFO:tasks.workunit.client.0.smithi057.stdout:7/424: dread d6/dc/d12/d1a/d4c/d63/f80 [0,4194304] 0 2024-02-28T16:02:11.016 INFO:tasks.workunit.client.0.smithi057.stdout:5/511: fdatasync d2/d15/d5e/d6d/f75 0 2024-02-28T16:02:11.016 INFO:tasks.workunit.client.0.smithi057.stdout:9/583: rename d2/d46/d67/fb3 to d2/d5e/fbd 0 2024-02-28T16:02:11.018 INFO:tasks.workunit.client.0.smithi057.stdout:6/462: readlink df/d14/d15/d16/l34 0 2024-02-28T16:02:11.019 INFO:tasks.workunit.client.0.smithi057.stdout:9/584: fdatasync d2/d5e/d65/f28 0 2024-02-28T16:02:11.020 INFO:tasks.workunit.client.0.smithi057.stdout:7/425: rename d6/d38/d97 to d6/dc/d67/d9a 0 2024-02-28T16:02:11.023 INFO:tasks.workunit.client.0.smithi057.stdout:6/463: creat df/d14/f98 x:0 0 0 2024-02-28T16:02:11.023 INFO:tasks.workunit.client.0.smithi057.stdout:9/585: mknod d2/d24/d9c/cbe 0 2024-02-28T16:02:11.026 INFO:tasks.workunit.client.0.smithi057.stdout:6/464: chown df/d14/d15/d16/f76 0 1 2024-02-28T16:02:11.028 INFO:tasks.workunit.client.0.smithi057.stdout:5/512: rename d2/d12/d76/d7a/f7d to d2/d12/fb7 0 2024-02-28T16:02:11.029 INFO:tasks.workunit.client.0.smithi057.stdout:6/465: chown df/d14/d15/d16/d39/d8d 63498671 1 2024-02-28T16:02:11.029 INFO:tasks.workunit.client.0.smithi057.stdout:5/513: chown d2/d12/d3d/da4 435635592 1 2024-02-28T16:02:11.034 INFO:tasks.workunit.client.0.smithi057.stdout:5/514: write d2/d12/d5f/d77/f93 [521379,55417] 0 2024-02-28T16:02:11.036 INFO:tasks.workunit.client.0.smithi057.stdout:6/466: link df/d10/d13/f2e df/d61/f99 0 2024-02-28T16:02:11.041 INFO:tasks.workunit.client.0.smithi057.stdout:5/515: unlink d2/d19/d1c/f4d 0 2024-02-28T16:02:11.048 INFO:tasks.workunit.client.0.smithi057.stdout:9/586: dwrite d2/d24/d1d/f7b [0,4194304] 0 2024-02-28T16:02:11.051 INFO:tasks.workunit.client.0.smithi057.stdout:5/516: mknod d2/d15/cb8 0 2024-02-28T16:02:11.056 INFO:tasks.workunit.client.0.smithi057.stdout:6/467: dread df/d10/d13/f3a [0,4194304] 0 2024-02-28T16:02:11.060 INFO:tasks.workunit.client.0.smithi057.stdout:9/587: getdents d2/d5/d1b/d2e/d44/d7e 0 2024-02-28T16:02:11.064 INFO:tasks.workunit.client.0.smithi057.stdout:5/517: rename d2/d12/d76/cb2 to d2/d15/d63/cb9 0 2024-02-28T16:02:11.066 INFO:tasks.workunit.client.0.smithi057.stdout:9/588: fsync d2/d5/fb7 0 2024-02-28T16:02:11.068 INFO:tasks.workunit.client.0.smithi057.stdout:5/518: write d2/d12/d5f/f8d [162547,9881] 0 2024-02-28T16:02:11.077 INFO:tasks.workunit.client.0.smithi057.stdout:9/589: getdents d2/d5e/d65/d87 0 2024-02-28T16:02:11.081 INFO:tasks.workunit.client.0.smithi057.stdout:6/468: dwrite df/d10/d13/f77 [4194304,4194304] 0 2024-02-28T16:02:11.090 INFO:tasks.workunit.client.0.smithi057.stdout:6/469: creat df/d14/d15/d16/d97/f9a x:0 0 0 2024-02-28T16:02:11.097 INFO:tasks.workunit.client.0.smithi057.stdout:5/519: dwrite d2/d12/fb7 [0,4194304] 0 2024-02-28T16:02:11.104 INFO:tasks.workunit.client.0.smithi057.stdout:9/590: dread d2/d5/d9/f2a [0,4194304] 0 2024-02-28T16:02:11.104 INFO:tasks.workunit.client.0.smithi057.stdout:5/520: creat d2/d15/d63/fba x:0 0 0 2024-02-28T16:02:11.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.132+0000 7f6994200700 1 -- 172.21.15.57:0/2026290735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f698c071eb0 msgr2=0x7f698c070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:11.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.132+0000 7f6994200700 1 --2- 172.21.15.57:0/2026290735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f698c071eb0 0x7f698c070320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6980004940 tx=0x7f6980009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:11.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.133+0000 7f6994200700 1 -- 172.21.15.57:0/2026290735 shutdown_connections 2024-02-28T16:02:11.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.133+0000 7f6994200700 1 --2- 172.21.15.57:0/2026290735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f698c070860 0x7f698c070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.133+0000 7f6994200700 1 --2- 172.21.15.57:0/2026290735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f698c071eb0 0x7f698c070320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.133+0000 7f6994200700 1 -- 172.21.15.57:0/2026290735 >> 172.21.15.57:0/2026290735 conn(0x7f698c0f8620 msgr2=0x7f698c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:11.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.134+0000 7f6994200700 1 -- 172.21.15.57:0/2026290735 shutdown_connections 2024-02-28T16:02:11.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.134+0000 7f6994200700 1 -- 172.21.15.57:0/2026290735 wait complete. 2024-02-28T16:02:11.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.135+0000 7f6994200700 1 Processor -- start 2024-02-28T16:02:11.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.135+0000 7f6994200700 1 -- start start 2024-02-28T16:02:11.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.135+0000 7f6994200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f698c070860 0x7f698c10fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:11.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.135+0000 7f6994200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f698c071eb0 0x7f698c10ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:11.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.136+0000 7f6994200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c110630 con 0x7f698c071eb0 2024-02-28T16:02:11.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.136+0000 7f6994200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c110e70 con 0x7f698c070860 2024-02-28T16:02:11.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.136+0000 7f6991800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f698c070860 0x7f698c10fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:11.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.136+0000 7f6991800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f698c070860 0x7f698c10fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:57622/0 (socket says 172.21.15.57:57622) 2024-02-28T16:02:11.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.136+0000 7f6991800700 1 -- 172.21.15.57:0/2510999057 learned_addr learned my addr 172.21.15.57:0/2510999057 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:11.129 INFO:tasks.workunit.client.0.smithi057.stdout:9/591: dwrite d2/d5/fb7 [0,4194304] 0 2024-02-28T16:02:11.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.137+0000 7f6991800700 1 -- 172.21.15.57:0/2510999057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f698c071eb0 msgr2=0x7f698c10ffa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:02:11.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.137+0000 7f6991800700 1 --2- 172.21.15.57:0/2510999057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f698c071eb0 0x7f698c10ffa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.137+0000 7f6991800700 1 -- 172.21.15.57:0/2510999057 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6980005040 con 0x7f698c070860 2024-02-28T16:02:11.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.137+0000 7f6991800700 1 --2- 172.21.15.57:0/2510999057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f698c070860 0x7f698c10fa60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f698000ba40 tx=0x7f6980009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:11.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.138+0000 7f6989600700 1 -- 172.21.15.57:0/2510999057 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f698000e040 con 0x7f698c070860 2024-02-28T16:02:11.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.138+0000 7f6994200700 1 -- 172.21.15.57:0/2510999057 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c1110f0 con 0x7f698c070860 2024-02-28T16:02:11.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.138+0000 7f6994200700 1 -- 172.21.15.57:0/2510999057 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c111630 con 0x7f698c070860 2024-02-28T16:02:11.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.138+0000 7f6989600700 1 -- 172.21.15.57:0/2510999057 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6980009af0 con 0x7f698c070860 2024-02-28T16:02:11.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.138+0000 7f6989600700 1 -- 172.21.15.57:0/2510999057 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6980013660 con 0x7f698c070860 2024-02-28T16:02:11.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.139+0000 7f6994200700 1 -- 172.21.15.57:0/2510999057 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c0052e0 con 0x7f698c070860 2024-02-28T16:02:11.132 INFO:tasks.workunit.client.0.smithi057.stdout:5/521: dread d2/d8/fb6 [0,4194304] 0 2024-02-28T16:02:11.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.141+0000 7f6989600700 1 -- 172.21.15.57:0/2510999057 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7f698001c610 con 0x7f698c070860 2024-02-28T16:02:11.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.142+0000 7f6989600700 1 --2- 172.21.15.57:0/2510999057 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f697406b380 0x7f697406d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:11.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.142+0000 7f6989600700 1 -- 172.21.15.57:0/2510999057 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f698008b7c0 con 0x7f698c070860 2024-02-28T16:02:11.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.143+0000 7f6990e00700 1 --2- 172.21.15.57:0/2510999057 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f697406b380 0x7f697406d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:11.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.144+0000 7f6990e00700 1 --2- 172.21.15.57:0/2510999057 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f697406b380 0x7f697406d830 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6978006fd0 tx=0x7f6978006d30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:11.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.155+0000 7f6989600700 1 -- 172.21.15.57:0/2510999057 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6980059330 con 0x7f698c070860 2024-02-28T16:02:11.334 INFO:tasks.workunit.client.1.smithi087.stdout:9/877: sync 2024-02-28T16:02:11.335 INFO:tasks.workunit.client.1.smithi087.stdout:4/940: sync 2024-02-28T16:02:11.335 INFO:tasks.workunit.client.1.smithi087.stdout:5/916: sync 2024-02-28T16:02:11.335 INFO:tasks.workunit.client.1.smithi087.stdout:8/929: sync 2024-02-28T16:02:11.379 INFO:tasks.workunit.client.1.smithi087.stdout:5/917: rename d3/d9/d9b/dba/ld9 to d3/d9/d9b/dba/d30/d36/d4f/l149 0 2024-02-28T16:02:11.384 INFO:tasks.workunit.client.1.smithi087.stdout:9/878: symlink d7/dd/l107 0 2024-02-28T16:02:11.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.394+0000 7f6994200700 1 -- 172.21.15.57:0/2510999057 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f696c000bf0 con 0x7f697406b380 2024-02-28T16:02:11.387 INFO:tasks.workunit.client.1.smithi087.stdout:9/879: fsync d7/dd/d3c/d4c/da1/f80 0 2024-02-28T16:02:11.388 INFO:tasks.workunit.client.1.smithi087.stdout:4/941: link d2/d9/d10/dbf/db6/l10f d2/d9/da/d1a/d120/l12f 0 2024-02-28T16:02:11.389 INFO:tasks.workunit.client.1.smithi087.stdout:9/880: stat d7/dd/d99 0 2024-02-28T16:02:11.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.397+0000 7f6989600700 1 -- 172.21.15.57:0/2510999057 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f696c000bf0 con 0x7f697406b380 2024-02-28T16:02:11.391 INFO:tasks.workunit.client.1.smithi087.stdout:5/918: getdents d3/d64/d67/d133 0 2024-02-28T16:02:11.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 -- 172.21.15.57:0/2510999057 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f697406b380 msgr2=0x7f697406d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:11.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 --2- 172.21.15.57:0/2510999057 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f697406b380 0x7f697406d830 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6978006fd0 tx=0x7f6978006d30 comp rx=0 tx=0).stop 2024-02-28T16:02:11.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 -- 172.21.15.57:0/2510999057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f698c070860 msgr2=0x7f698c10fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:11.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 --2- 172.21.15.57:0/2510999057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f698c070860 0x7f698c10fa60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f698000ba40 tx=0x7f6980009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:11.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 -- 172.21.15.57:0/2510999057 shutdown_connections 2024-02-28T16:02:11.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 --2- 172.21.15.57:0/2510999057 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f697406b380 0x7f697406d830 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 --2- 172.21.15.57:0/2510999057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f698c070860 0x7f698c10fa60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 --2- 172.21.15.57:0/2510999057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f698c071eb0 0x7f698c10ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 -- 172.21.15.57:0/2510999057 >> 172.21.15.57:0/2510999057 conn(0x7f698c0f8620 msgr2=0x7f698c102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 -- 172.21.15.57:0/2510999057 shutdown_connections 2024-02-28T16:02:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.400+0000 7f6994200700 1 -- 172.21.15.57:0/2510999057 wait complete. 2024-02-28T16:02:11.401 INFO:tasks.workunit.client.1.smithi087.stdout:9/881: truncate d7/f9b 942675 0 2024-02-28T16:02:11.407 INFO:tasks.workunit.client.1.smithi087.stdout:9/882: symlink d7/dd/d15/d55/l108 0 2024-02-28T16:02:11.415 INFO:tasks.workunit.client.1.smithi087.stdout:5/919: dwrite d3/f1c [0,4194304] 0 2024-02-28T16:02:11.416 INFO:tasks.workunit.client.1.smithi087.stdout:3/990: sync 2024-02-28T16:02:11.416 INFO:tasks.workunit.client.1.smithi087.stdout:7/946: sync 2024-02-28T16:02:11.416 INFO:tasks.workunit.client.1.smithi087.stdout:0/910: sync 2024-02-28T16:02:11.417 INFO:tasks.workunit.client.1.smithi087.stdout:2/925: sync 2024-02-28T16:02:11.417 INFO:tasks.workunit.client.1.smithi087.stdout:1/933: sync 2024-02-28T16:02:11.417 INFO:tasks.workunit.client.1.smithi087.stdout:6/935: sync 2024-02-28T16:02:11.422 INFO:tasks.workunit.client.1.smithi087.stdout:9/883: mknod d7/dd/d15/d3f/d5f/d90/ddd/ddf/c109 0 2024-02-28T16:02:11.431 INFO:tasks.workunit.client.1.smithi087.stdout:0/911: write d4/d6/ddb/fde [3461574,66003] 0 2024-02-28T16:02:11.431 INFO:tasks.workunit.client.1.smithi087.stdout:5/920: fdatasync d3/d9/d9b/dba/d30/d53/fd4 0 2024-02-28T16:02:11.432 INFO:tasks.workunit.client.1.smithi087.stdout:2/926: write d2/d99/d28/f137 [732382,2611] 0 2024-02-28T16:02:11.436 INFO:tasks.workunit.client.1.smithi087.stdout:3/991: mkdir d11/d33/d67/d98/d157 0 2024-02-28T16:02:11.440 INFO:tasks.workunit.client.1.smithi087.stdout:7/947: link d14/d7d/c128 d14/d2e/d89/dbd/c12c 0 2024-02-28T16:02:11.458 INFO:tasks.workunit.client.1.smithi087.stdout:3/992: creat d11/d33/d58/d8c/f158 x:0 0 0 2024-02-28T16:02:11.458 INFO:tasks.workunit.client.1.smithi087.stdout:7/948: chown d14/d46/d7c/dc3/ce6 0 1 2024-02-28T16:02:11.459 INFO:tasks.workunit.client.1.smithi087.stdout:2/927: mkdir d2/d9a/d152 0 2024-02-28T16:02:11.460 INFO:tasks.workunit.client.1.smithi087.stdout:4/942: dwrite d2/d9/da/d1a/d26/d69/ffc [0,4194304] 0 2024-02-28T16:02:11.464 INFO:tasks.workunit.client.1.smithi087.stdout:8/930: dwrite d2/d9/d5e/d9c/d9f/f10e [0,4194304] 0 2024-02-28T16:02:11.468 INFO:tasks.workunit.client.1.smithi087.stdout:1/934: dwrite d0/d14/d86/f10a [0,4194304] 0 2024-02-28T16:02:11.468 INFO:tasks.workunit.client.1.smithi087.stdout:0/912: getdents d4/dd/d21/d52 0 2024-02-28T16:02:11.473 INFO:tasks.workunit.client.1.smithi087.stdout:4/943: dread - d2/d9/d10/d22/f8b zero size 2024-02-28T16:02:11.482 INFO:tasks.workunit.client.1.smithi087.stdout:8/931: stat d2/d18/d42/d62/de8/f100 0 2024-02-28T16:02:11.494 INFO:tasks.workunit.client.1.smithi087.stdout:6/936: dwrite d4/dc/d10/f2b [0,4194304] 0 2024-02-28T16:02:11.495 INFO:tasks.workunit.client.1.smithi087.stdout:2/928: creat d2/d99/d28/d79/f153 x:0 0 0 2024-02-28T16:02:11.507 INFO:tasks.workunit.client.1.smithi087.stdout:3/993: dwrite d11/d33/d74/f11a [0,4194304] 0 2024-02-28T16:02:11.510 INFO:tasks.workunit.client.1.smithi087.stdout:4/944: symlink d2/d9/d10/d22/d5b/l130 0 2024-02-28T16:02:11.510 INFO:tasks.workunit.client.1.smithi087.stdout:6/937: stat d4/d12/d45/d92/dc1/de9 0 2024-02-28T16:02:11.511 INFO:tasks.workunit.client.1.smithi087.stdout:9/884: dwrite d7/dd/d15/d79/d2e/f8b [0,4194304] 0 2024-02-28T16:02:11.512 INFO:tasks.workunit.client.1.smithi087.stdout:0/913: dread d4/dd/d21/fce [0,4194304] 0 2024-02-28T16:02:11.513 INFO:tasks.workunit.client.1.smithi087.stdout:7/949: dwrite d14/d21/de4/de7/f105 [0,4194304] 0 2024-02-28T16:02:11.518 INFO:tasks.workunit.client.1.smithi087.stdout:5/921: dwrite d3/d64/d81/fde [4194304,4194304] 0 2024-02-28T16:02:11.518 INFO:tasks.workunit.client.1.smithi087.stdout:8/932: symlink d2/d63/d9b/dd5/dd9/d127/l136 0 2024-02-28T16:02:11.520 INFO:tasks.workunit.client.1.smithi087.stdout:4/945: fdatasync d2/d9/d10/dbf/dbb/f11c 0 2024-02-28T16:02:11.521 INFO:tasks.workunit.client.1.smithi087.stdout:3/994: creat d11/d61/d7c/f159 x:0 0 0 2024-02-28T16:02:11.521 INFO:tasks.workunit.client.1.smithi087.stdout:7/950: readlink d14/d21/d4f/l95 0 2024-02-28T16:02:11.528 INFO:tasks.workunit.client.1.smithi087.stdout:1/935: dread d0/d1b/d1f/d71/db2/d24/d78/f91 [0,4194304] 0 2024-02-28T16:02:11.529 INFO:tasks.workunit.client.1.smithi087.stdout:6/938: truncate d4/d12/d45/d57/fbb 1009042 0 2024-02-28T16:02:11.536 INFO:tasks.workunit.client.1.smithi087.stdout:6/939: truncate d4/d12/d45/d74/fec 3653013 0 2024-02-28T16:02:11.537 INFO:tasks.workunit.client.1.smithi087.stdout:7/951: symlink d14/d46/d7c/df2/l12d 0 2024-02-28T16:02:11.538 INFO:tasks.workunit.client.1.smithi087.stdout:8/933: symlink d2/d63/d96/l137 0 2024-02-28T16:02:11.538 INFO:tasks.workunit.client.1.smithi087.stdout:5/922: fdatasync d3/d64/d67/d7c/fbc 0 2024-02-28T16:02:11.541 INFO:tasks.workunit.client.1.smithi087.stdout:2/929: write d2/d9a/fde [1213301,118924] 0 2024-02-28T16:02:11.542 INFO:tasks.workunit.client.1.smithi087.stdout:3/995: creat d11/d33/d67/d98/d133/f15a x:0 0 0 2024-02-28T16:02:11.542 INFO:tasks.workunit.client.1.smithi087.stdout:8/934: stat d2/d63/d9b/dae/dca/lf2 0 2024-02-28T16:02:11.543 INFO:tasks.workunit.client.1.smithi087.stdout:6/940: unlink d4/d30/d13/d67/daf/f118 0 2024-02-28T16:02:11.544 INFO:tasks.workunit.client.1.smithi087.stdout:2/930: read d2/d99/f5d [1117479,34503] 0 2024-02-28T16:02:11.548 INFO:tasks.workunit.client.1.smithi087.stdout:0/914: write d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/db6/fb9 [254635,62527] 0 2024-02-28T16:02:11.551 INFO:tasks.workunit.client.1.smithi087.stdout:3/996: dread - d11/d33/d58/f107 zero size 2024-02-28T16:02:11.556 INFO:tasks.workunit.client.1.smithi087.stdout:9/885: write d7/dd/d15/d3f/d5f/fb1 [42298,6449] 0 2024-02-28T16:02:11.557 INFO:tasks.workunit.client.1.smithi087.stdout:5/923: fdatasync d3/d9/d9b/dba/d69/ffe 0 2024-02-28T16:02:11.562 INFO:tasks.workunit.client.1.smithi087.stdout:1/936: link d0/d14/d48/da7/df4/lfc d0/d1b/d1f/d71/db2/d112/l132 0 2024-02-28T16:02:11.563 INFO:tasks.workunit.client.1.smithi087.stdout:4/946: dwrite d2/fb7 [0,4194304] 0 2024-02-28T16:02:11.567 INFO:tasks.workunit.client.1.smithi087.stdout:0/915: fdatasync d4/dd/d21/fea 0 2024-02-28T16:02:11.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.575+0000 7f062b400700 1 -- 172.21.15.57:0/1671910194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240fe0e0 msgr2=0x7f06240fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:11.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.575+0000 7f062b400700 1 --2- 172.21.15.57:0/1671910194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240fe0e0 0x7f06240fe550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0610004940 tx=0x7f0610009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:11.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.576+0000 7f062b400700 1 -- 172.21.15.57:0/1671910194 shutdown_connections 2024-02-28T16:02:11.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.576+0000 7f062b400700 1 --2- 172.21.15.57:0/1671910194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240fe0e0 0x7f06240fe550 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.576+0000 7f062b400700 1 --2- 172.21.15.57:0/1671910194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06240fcef0 0x7f06240fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.576+0000 7f062b400700 1 -- 172.21.15.57:0/1671910194 >> 172.21.15.57:0/1671910194 conn(0x7f06240f8620 msgr2=0x7f06240faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:11.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.576+0000 7f062b400700 1 -- 172.21.15.57:0/1671910194 shutdown_connections 2024-02-28T16:02:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.576+0000 7f062b400700 1 -- 172.21.15.57:0/1671910194 wait complete. 2024-02-28T16:02:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.577+0000 7f062b400700 1 Processor -- start 2024-02-28T16:02:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.577+0000 7f062b400700 1 -- start start 2024-02-28T16:02:11.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.577+0000 7f062b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06240fcef0 0x7f0624071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:11.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.577+0000 7f062b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240fe0e0 0x7f06240702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:11.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.577+0000 7f062b400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624070970 con 0x7f06240fe0e0 2024-02-28T16:02:11.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.577+0000 7f062b400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624070ae0 con 0x7f06240fcef0 2024-02-28T16:02:11.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.578+0000 7f0623e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240fe0e0 0x7f06240702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:11.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.578+0000 7f0623e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240fe0e0 0x7f06240702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59716/0 (socket says 172.21.15.57:59716) 2024-02-28T16:02:11.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.578+0000 7f0623e00700 1 -- 172.21.15.57:0/563665691 learned_addr learned my addr 172.21.15.57:0/563665691 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:11.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.578+0000 7f0623e00700 1 -- 172.21.15.57:0/563665691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06240fcef0 msgr2=0x7f0624071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:11.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.578+0000 7f0623e00700 1 --2- 172.21.15.57:0/563665691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06240fcef0 0x7f0624071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.578+0000 7f0623e00700 1 -- 172.21.15.57:0/563665691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0610005040 con 0x7f06240fe0e0 2024-02-28T16:02:11.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.579+0000 7f0623e00700 1 --2- 172.21.15.57:0/563665691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240fe0e0 0x7f06240702e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f061000b3b0 tx=0x7f0610009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:11.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.579+0000 7f0620c00700 1 -- 172.21.15.57:0/563665691 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f061000e040 con 0x7f06240fe0e0 2024-02-28T16:02:11.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.579+0000 7f0620c00700 1 -- 172.21.15.57:0/563665691 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0610004290 con 0x7f06240fe0e0 2024-02-28T16:02:11.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.579+0000 7f0620c00700 1 -- 172.21.15.57:0/563665691 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f061001c630 con 0x7f06240fe0e0 2024-02-28T16:02:11.572 INFO:tasks.workunit.client.1.smithi087.stdout:2/931: dread d2/d42/d4b/f56 [0,4194304] 0 2024-02-28T16:02:11.572 INFO:tasks.workunit.client.1.smithi087.stdout:5/924: chown d3/d9/d9b/dba/d69/d87/df3/f111 1153 1 2024-02-28T16:02:11.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.579+0000 7f062b400700 1 -- 172.21.15.57:0/563665691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0624070d60 con 0x7f06240fe0e0 2024-02-28T16:02:11.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.579+0000 7f062b400700 1 -- 172.21.15.57:0/563665691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06241159a0 con 0x7f06240fe0e0 2024-02-28T16:02:11.573 INFO:tasks.workunit.client.1.smithi087.stdout:9/886: truncate d7/d1e/d44/fc1 1008736 0 2024-02-28T16:02:11.573 INFO:tasks.workunit.client.1.smithi087.stdout:7/952: link d14/d2e/d89/deb/d5d/f5e d14/d46/d7c/f12e 0 2024-02-28T16:02:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.581+0000 7f062b400700 1 -- 172.21.15.57:0/563665691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062404bed0 con 0x7f06240fe0e0 2024-02-28T16:02:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.582+0000 7f0620c00700 1 -- 172.21.15.57:0/563665691 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7f0610013420 con 0x7f06240fe0e0 2024-02-28T16:02:11.577 INFO:tasks.workunit.client.1.smithi087.stdout:4/947: mknod d2/d9/d10/d22/d5b/d5c/d91/da9/c131 0 2024-02-28T16:02:11.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.585+0000 7f0620c00700 1 --2- 172.21.15.57:0/563665691 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f060c06b330 0x7f060c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:11.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.585+0000 7f0620c00700 1 -- 172.21.15.57:0/563665691 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f061008b390 con 0x7f06240fe0e0 2024-02-28T16:02:11.579 INFO:tasks.workunit.client.1.smithi087.stdout:5/925: readlink d3/d9/d9b/dba/le 0 2024-02-28T16:02:11.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.587+0000 7f0628a00700 1 --2- 172.21.15.57:0/563665691 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f060c06b330 0x7f060c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:11.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.590+0000 7f0628a00700 1 --2- 172.21.15.57:0/563665691 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f060c06b330 0x7f060c06d7e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0618006fd0 tx=0x7f0618006db0 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:11.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.591+0000 7f0620c00700 1 -- 172.21.15.57:0/563665691 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0610058e80 con 0x7f06240fe0e0 2024-02-28T16:02:11.588 INFO:tasks.workunit.client.1.smithi087.stdout:7/953: creat d14/d2e/f12f x:0 0 0 2024-02-28T16:02:11.592 INFO:tasks.workunit.client.1.smithi087.stdout:7/954: stat f7 0 2024-02-28T16:02:11.593 INFO:tasks.workunit.client.1.smithi087.stdout:7/955: fsync d14/d21/f32 0 2024-02-28T16:02:11.598 INFO:tasks.workunit.client.1.smithi087.stdout:6/941: dwrite d4/d30/d13/d38/d69/db0/f11b [4194304,4194304] 0 2024-02-28T16:02:11.598 INFO:tasks.workunit.client.1.smithi087.stdout:8/935: truncate d2/d9/d5e/fd0 1422582 0 2024-02-28T16:02:11.606 INFO:tasks.workunit.client.1.smithi087.stdout:0/916: write d4/dd/ffe [948091,5106] 0 2024-02-28T16:02:11.607 INFO:tasks.workunit.client.1.smithi087.stdout:6/942: mkdir d4/d7d/d12a 0 2024-02-28T16:02:11.612 INFO:tasks.workunit.client.1.smithi087.stdout:5/926: truncate d3/d9/d9b/dba/f2b 1192512 0 2024-02-28T16:02:11.615 INFO:tasks.workunit.client.1.smithi087.stdout:3/997: dwrite d11/d3a/d3c/f12a [0,4194304] 0 2024-02-28T16:02:11.626 INFO:tasks.workunit.client.1.smithi087.stdout:2/932: dwrite d2/d99/d28/fc6 [0,4194304] 0 2024-02-28T16:02:11.629 INFO:tasks.workunit.client.1.smithi087.stdout:1/937: dread d0/d1a/f73 [0,4194304] 0 2024-02-28T16:02:11.635 INFO:tasks.workunit.client.1.smithi087.stdout:9/887: dread d7/dd/d15/d79/f7f [0,4194304] 0 2024-02-28T16:02:11.638 INFO:tasks.workunit.client.1.smithi087.stdout:0/917: getdents d4/dd/d37/d39/d3a/d57/d74/d1f 0 2024-02-28T16:02:11.643 INFO:tasks.workunit.client.1.smithi087.stdout:4/948: dwrite d2/df/d65/d8d/fa4 [0,4194304] 0 2024-02-28T16:02:11.643 INFO:tasks.workunit.client.1.smithi087.stdout:0/918: chown d4/dd/d37/d39/d3a 804606465 1 2024-02-28T16:02:11.649 INFO:tasks.workunit.client.1.smithi087.stdout:4/949: chown d2/d9/da/d1a/d26/l67 27 1 2024-02-28T16:02:11.650 INFO:tasks.workunit.client.1.smithi087.stdout:6/943: write d4/d30/d13/d38/f47 [399437,42969] 0 2024-02-28T16:02:11.653 INFO:tasks.workunit.client.1.smithi087.stdout:1/938: dread d0/d1b/d43/d4d/d12c/dd8/f118 [0,4194304] 0 2024-02-28T16:02:11.655 INFO:tasks.workunit.client.1.smithi087.stdout:3/998: dread d11/d3a/d3c/f12a [0,4194304] 0 2024-02-28T16:02:11.657 INFO:tasks.workunit.client.1.smithi087.stdout:6/944: creat d4/d12/d45/d92/dc1/de9/f12b x:0 0 0 2024-02-28T16:02:11.661 INFO:tasks.workunit.client.1.smithi087.stdout:6/945: creat d4/d30/d13/d119/f12c x:0 0 0 2024-02-28T16:02:11.670 INFO:tasks.workunit.client.1.smithi087.stdout:6/946: write d4/d12/d45/d5e/feb [404201,94379] 0 2024-02-28T16:02:11.671 INFO:tasks.workunit.client.1.smithi087.stdout:3/999: mkdir d11/d44/d15b 0 2024-02-28T16:02:11.674 INFO:tasks.workunit.client.1.smithi087.stdout:6/947: stat d4/d30/d13/d38/dc3/fd1 0 2024-02-28T16:02:11.675 INFO:tasks.workunit.client.1.smithi087.stdout:8/936: dread d2/d18/f56 [0,4194304] 0 2024-02-28T16:02:11.675 INFO:tasks.workunit.client.1.smithi087.stdout:5/927: dwrite d3/d9/d9b/dba/d30/d53/d5b/ffa [0,4194304] 0 2024-02-28T16:02:11.676 INFO:tasks.workunit.client.1.smithi087.stdout:9/888: rmdir d7/dd/d15/d3f/d6d/d9f 0 2024-02-28T16:02:11.678 INFO:tasks.workunit.client.1.smithi087.stdout:6/948: dread d4/d96/fcc [0,4194304] 0 2024-02-28T16:02:11.690 INFO:tasks.workunit.client.1.smithi087.stdout:8/937: mknod d2/d18/df5/d104/da5/c138 0 2024-02-28T16:02:11.691 INFO:tasks.workunit.client.1.smithi087.stdout:4/950: getdents d2/d9/d10/dbf/dbb 0 2024-02-28T16:02:11.694 INFO:tasks.workunit.client.1.smithi087.stdout:9/889: dread - d7/dd/d15/d3f/d5f/d90/fcc zero size 2024-02-28T16:02:11.697 INFO:tasks.workunit.client.1.smithi087.stdout:2/933: dread d2/d42/d4b/f52 [0,4194304] 0 2024-02-28T16:02:11.697 INFO:tasks.workunit.client.1.smithi087.stdout:4/951: write d2/d9/d10/d22/d5b/f119 [6615529,57578] 0 2024-02-28T16:02:11.698 INFO:tasks.workunit.client.1.smithi087.stdout:7/956: dread d14/d21/d4f/fcf [0,4194304] 0 2024-02-28T16:02:11.704 INFO:tasks.workunit.client.1.smithi087.stdout:7/957: write d14/d2e/dab/f109 [272836,23015] 0 2024-02-28T16:02:11.710 INFO:tasks.workunit.client.1.smithi087.stdout:8/938: getdents d2 0 2024-02-28T16:02:11.711 INFO:tasks.workunit.client.1.smithi087.stdout:7/958: write d14/f127 [444440,44324] 0 2024-02-28T16:02:11.714 INFO:tasks.workunit.client.1.smithi087.stdout:1/939: dwrite d0/d1b/d1f/fa9 [0,4194304] 0 2024-02-28T16:02:11.714 INFO:tasks.workunit.client.1.smithi087.stdout:9/890: rename d7/dd/d3c/d4c/da1/f80 to d7/dd/d36/f10a 0 2024-02-28T16:02:11.722 INFO:tasks.workunit.client.1.smithi087.stdout:6/949: dwrite d4/d30/d13/d67/ff5 [0,4194304] 0 2024-02-28T16:02:11.726 INFO:tasks.workunit.client.1.smithi087.stdout:2/934: getdents d2/d99/d28 0 2024-02-28T16:02:11.729 INFO:tasks.workunit.client.1.smithi087.stdout:6/950: mkdir d4/da5/d12d 0 2024-02-28T16:02:11.733 INFO:tasks.workunit.client.1.smithi087.stdout:5/928: dwrite d3/d9/d9b/dba/f116 [0,4194304] 0 2024-02-28T16:02:11.736 INFO:tasks.workunit.client.1.smithi087.stdout:5/929: readlink d3/d9/d9b/dba/d30/d8f/dac/le7 0 2024-02-28T16:02:11.738 INFO:tasks.workunit.client.1.smithi087.stdout:4/952: write d2/d9/d10/f6c [2381434,83731] 0 2024-02-28T16:02:11.740 INFO:tasks.workunit.client.1.smithi087.stdout:6/951: creat d4/d30/d13/d38/d69/d99/f12e x:0 0 0 2024-02-28T16:02:11.741 INFO:tasks.workunit.client.1.smithi087.stdout:8/939: write d2/d18/df5/d104/d116/f74 [49113,45115] 0 2024-02-28T16:02:11.752 INFO:tasks.workunit.client.1.smithi087.stdout:6/952: fsync d4/dc/d10/f40 0 2024-02-28T16:02:11.752 INFO:tasks.workunit.client.1.smithi087.stdout:8/940: mkdir d2/d9/d10/da0/d139 0 2024-02-28T16:02:11.752 INFO:tasks.workunit.client.1.smithi087.stdout:9/891: getdents d7/dd/d15/d3f 0 2024-02-28T16:02:11.759 INFO:tasks.workunit.client.1.smithi087.stdout:6/953: creat d4/d30/d13/d38/d69/f12f x:0 0 0 2024-02-28T16:02:11.764 INFO:tasks.workunit.client.1.smithi087.stdout:2/935: dwrite d2/d99/dc7/de2/de4/d11b/f13d [0,4194304] 0 2024-02-28T16:02:11.765 INFO:tasks.workunit.client.1.smithi087.stdout:9/892: creat d7/dd/d15/d3f/d5f/d90/dfe/f10b x:0 0 0 2024-02-28T16:02:11.767 INFO:tasks.workunit.client.1.smithi087.stdout:5/930: dwrite d3/d9/f1e [0,4194304] 0 2024-02-28T16:02:11.776 INFO:tasks.workunit.client.1.smithi087.stdout:2/936: mknod d2/d7/dc0/d111/d34/d88/c154 0 2024-02-28T16:02:11.783 INFO:tasks.workunit.client.1.smithi087.stdout:5/931: unlink d3/d9/le5 0 2024-02-28T16:02:11.786 INFO:tasks.workunit.client.1.smithi087.stdout:9/893: symlink d7/dd/d15/d3f/d5f/d90/ddd/ddf/l10c 0 2024-02-28T16:02:11.789 INFO:tasks.workunit.client.1.smithi087.stdout:8/941: link d2/d9/d5e/d9c/fec d2/d63/d9b/dd5/dd9/df1/f13a 0 2024-02-28T16:02:11.794 INFO:tasks.workunit.client.1.smithi087.stdout:6/954: dwrite d4/d30/d13/d38/d69/f12f [0,4194304] 0 2024-02-28T16:02:11.796 INFO:tasks.workunit.client.1.smithi087.stdout:1/940: dwrite d0/d1b/d1f/d71/db2/f72 [0,4194304] 0 2024-02-28T16:02:11.802 INFO:tasks.workunit.client.1.smithi087.stdout:5/932: symlink d3/d9/d9b/dba/d30/d53/d5b/l14a 0 2024-02-28T16:02:11.803 INFO:tasks.workunit.client.1.smithi087.stdout:6/955: rmdir d4/d96 39 2024-02-28T16:02:11.803 INFO:tasks.workunit.client.1.smithi087.stdout:9/894: read d7/d1e/d44/f46 [2574814,117270] 0 2024-02-28T16:02:11.809 INFO:tasks.workunit.client.1.smithi087.stdout:4/953: dwrite d2/df/d2e/f47 [4194304,4194304] 0 2024-02-28T16:02:11.814 INFO:tasks.workunit.client.1.smithi087.stdout:9/895: unlink d7/dd/fe2 0 2024-02-28T16:02:11.814 INFO:tasks.workunit.client.1.smithi087.stdout:1/941: dread - d0/d1b/d1f/d71/db2/d24/d78/fdc zero size 2024-02-28T16:02:11.817 INFO:tasks.workunit.client.1.smithi087.stdout:2/937: dwrite d2/d99/d28/d79/d9f/de1/f125 [0,4194304] 0 2024-02-28T16:02:11.820 INFO:tasks.workunit.client.1.smithi087.stdout:4/954: chown d2/d9/da/d1a/d120/cce 14 1 2024-02-28T16:02:11.821 INFO:tasks.workunit.client.1.smithi087.stdout:9/896: chown d7/dd/d15/fde 78962 1 2024-02-28T16:02:11.821 INFO:tasks.workunit.client.1.smithi087.stdout:8/942: dread d2/d9/f17 [0,4194304] 0 2024-02-28T16:02:11.823 INFO:tasks.workunit.client.1.smithi087.stdout:2/938: mkdir d2/d99/d28/d79/d9f/d155 0 2024-02-28T16:02:11.828 INFO:tasks.workunit.client.1.smithi087.stdout:6/956: link d4/d12/d45/f77 d4/d30/d13/d38/d69/d99/f130 0 2024-02-28T16:02:11.828 INFO:tasks.workunit.client.1.smithi087.stdout:4/955: creat d2/f132 x:0 0 0 2024-02-28T16:02:11.829 INFO:tasks.workunit.client.1.smithi087.stdout:9/897: truncate d7/dd/d3c/d4c/da1/fee 283696 0 2024-02-28T16:02:11.836 INFO:tasks.workunit.client.1.smithi087.stdout:4/956: fsync d2/d9/f48 0 2024-02-28T16:02:11.836 INFO:tasks.workunit.client.1.smithi087.stdout:2/939: rename d2/d42/d4b/d14f/da6/dd7/ffd to d2/d7/dc0/f156 0 2024-02-28T16:02:11.838 INFO:tasks.workunit.client.1.smithi087.stdout:8/943: getdents d2/d9/d5e/d9c/d9f 0 2024-02-28T16:02:11.839 INFO:tasks.workunit.client.1.smithi087.stdout:4/957: chown d2/d49/c6e 344388 1 2024-02-28T16:02:11.841 INFO:tasks.workunit.client.1.smithi087.stdout:2/940: write d2/d42/ddd/f126 [1008534,47083] 0 2024-02-28T16:02:11.842 INFO:tasks.workunit.client.1.smithi087.stdout:6/957: rename d4/d30/d13/f2d to d4/d30/d13/d67/db8/d125/f131 0 2024-02-28T16:02:11.842 INFO:tasks.workunit.client.1.smithi087.stdout:8/944: rmdir d2/d9/d10/da0 39 2024-02-28T16:02:11.848 INFO:tasks.workunit.client.1.smithi087.stdout:2/941: chown d2/d7/dc0/d111/d34/d88/l144 9 1 2024-02-28T16:02:11.851 INFO:tasks.workunit.client.1.smithi087.stdout:9/898: rename d7/dd/d15/d3f/ld6 to d7/dd/d15/d79/d2e/l10d 0 2024-02-28T16:02:11.851 INFO:tasks.workunit.client.1.smithi087.stdout:6/958: unlink d4/d30/d13/d38/f101 0 2024-02-28T16:02:11.855 INFO:tasks.workunit.client.1.smithi087.stdout:6/959: rmdir d4/d12/d45/d92/dc1 39 2024-02-28T16:02:11.855 INFO:tasks.workunit.client.1.smithi087.stdout:8/945: creat d2/d9/d8e/dda/f13b x:0 0 0 2024-02-28T16:02:11.857 INFO:tasks.workunit.client.1.smithi087.stdout:4/958: creat d2/d9/d10/d22/d5b/d5c/d91/f133 x:0 0 0 2024-02-28T16:02:11.859 INFO:tasks.workunit.client.1.smithi087.stdout:5/933: write d3/d9/d9b/dba/d30/d8f/dac/d109/f9e [99132,49283] 0 2024-02-28T16:02:11.862 INFO:tasks.workunit.client.1.smithi087.stdout:6/960: creat d4/d30/d13/d67/f132 x:0 0 0 2024-02-28T16:02:11.862 INFO:tasks.workunit.client.1.smithi087.stdout:1/942: truncate d0/d1b/d43/d4d/d12c/dfa/fff 546987 0 2024-02-28T16:02:11.866 INFO:tasks.workunit.client.1.smithi087.stdout:6/961: unlink d4/d12/c54 0 2024-02-28T16:02:11.866 INFO:tasks.workunit.client.1.smithi087.stdout:4/959: creat d2/d9/d10/d22/d5b/d5c/d68/dc5/df1/f134 x:0 0 0 2024-02-28T16:02:11.873 INFO:tasks.workunit.client.1.smithi087.stdout:9/899: link d7/dd/d15/d79/d2e/c52 d7/dd/d15/d3f/d5f/c10e 0 2024-02-28T16:02:11.874 INFO:tasks.workunit.client.1.smithi087.stdout:5/934: dread d3/d9/d9b/dba/d30/d36/d4f/fe1 [0,4194304] 0 2024-02-28T16:02:11.875 INFO:tasks.workunit.client.1.smithi087.stdout:6/962: dread d4/d30/d13/d38/f4e [0,4194304] 0 2024-02-28T16:02:11.877 INFO:tasks.workunit.client.1.smithi087.stdout:4/960: rename d2/d9/da/c56 to d2/d9/d10/dbf/dbb/c135 0 2024-02-28T16:02:11.880 INFO:tasks.workunit.client.1.smithi087.stdout:4/961: chown d2/df/d65/f10e 13823269 1 2024-02-28T16:02:11.885 INFO:tasks.workunit.client.1.smithi087.stdout:5/935: stat d3/d9/d9b/dba/d30/cce 0 2024-02-28T16:02:11.885 INFO:tasks.workunit.client.1.smithi087.stdout:9/900: creat d7/dd/d15/d3f/d5f/d90/dfe/f10f x:0 0 0 2024-02-28T16:02:11.886 INFO:tasks.workunit.client.1.smithi087.stdout:8/946: dwrite d2/d18/d42/f70 [0,4194304] 0 2024-02-28T16:02:11.887 INFO:tasks.workunit.client.1.smithi087.stdout:4/962: unlink d2/d9/l107 0 2024-02-28T16:02:11.893 INFO:tasks.workunit.client.1.smithi087.stdout:9/901: dread - d7/dd/d3c/d4c/da1/fb8 zero size 2024-02-28T16:02:11.894 INFO:tasks.workunit.client.1.smithi087.stdout:8/947: dread - d2/d18/d42/d62/de8/f100 zero size 2024-02-28T16:02:11.894 INFO:tasks.workunit.client.1.smithi087.stdout:6/963: creat d4/d12/d45/d92/de5/f133 x:0 0 0 2024-02-28T16:02:11.897 INFO:tasks.workunit.client.1.smithi087.stdout:1/943: dwrite d0/d1b/d1f/f41 [0,4194304] 0 2024-02-28T16:02:11.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.907+0000 7f062b400700 1 -- 172.21.15.57:0/563665691 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0624102ac0 con 0x7f060c06b330 2024-02-28T16:02:11.901 INFO:tasks.workunit.client.1.smithi087.stdout:4/963: rename d2/df/d65/d8d/fa4 to d2/df/d65/d8d/f136 0 2024-02-28T16:02:11.905 INFO:tasks.workunit.client.1.smithi087.stdout:9/902: creat d7/d1e/d44/d83/db0/f110 x:0 0 0 2024-02-28T16:02:11.906 INFO:tasks.workunit.client.1.smithi087.stdout:9/903: chown d7/d1e/d60/cf0 1125238706 1 2024-02-28T16:02:11.910 INFO:tasks.workunit.client.1.smithi087.stdout:1/944: dread d0/d14/d3f/dd5/fe1 [0,4194304] 0 2024-02-28T16:02:11.911 INFO:tasks.workunit.client.1.smithi087.stdout:4/964: unlink d2/d9/da/d1a/d26/d69/fa6 0 2024-02-28T16:02:11.915 INFO:tasks.workunit.client.1.smithi087.stdout:9/904: write d7/dd/d15/d3f/ff3 [345868,118323] 0 2024-02-28T16:02:11.918 INFO:tasks.workunit.client.1.smithi087.stdout:1/945: mknod d0/d1b/d43/de3/c133 0 2024-02-28T16:02:11.918 INFO:tasks.workunit.client.1.smithi087.stdout:4/965: unlink d2/d9/da/d1a/fc9 0 2024-02-28T16:02:11.919 INFO:tasks.workunit.client.1.smithi087.stdout:5/936: link d3/d9/d9b/dba/d30/d36/d112/d12d/ce8 d3/d9/d9b/c14b 0 2024-02-28T16:02:11.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.927+0000 7f0620c00700 1 -- 172.21.15.57:0/563665691 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0624102ac0 con 0x7f060c06b330 2024-02-28T16:02:11.920 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:02:11.920 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 starting - - - - 2024-02-28T16:02:11.920 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (11m) 54s ago 11m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T16:02:11.920 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (10m) 57s ago 10m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T16:02:11.920 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (9m) 54s ago 10m 74.6M - 9.4.7 954c08fa6188 60cd69b6a8d5 2024-02-28T16:02:11.920 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (4m) 54s ago 4m 75.1M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:02:11.920 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (3m) 54s ago 3m 44.2M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:02:11.920 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (4m) 57s ago 3m 104M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:02:11.920 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (3m) 57s ago 3m 50.2M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:9283 running (12m) 54s ago 12m 339M - 17.2.7-535-gc0f02e60 1c37ed371348 2db340312662 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283 running (97s) 57s ago 9m 490M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 83ce464fbb4f 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (13m) 54s ago 13m 47.2M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (9m) 57s ago 9m 36.8M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 starting - - - - 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (9m) 57s ago 9m 8132k - 1.5.0 0da6a335fe13 f91fe90e3547 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (8m) 54s ago 8m 91.3M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (8m) 54s ago 8m 97.9M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (7m) 54s ago 7m 83.3M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (7m) 57s ago 7m 99.7M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (6m) 57s ago 6m 94.7M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (5m) 57s ago 5m 89.1M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:02:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (8m) 54s ago 10m 53.5M - 2.43.0 a07b618ecd1d 2e0885a51c9e 2024-02-28T16:02:11.922 INFO:tasks.workunit.client.1.smithi087.stdout:4/966: mknod d2/df/d2e/dad/c137 0 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.930+0000 7f062b400700 1 -- 172.21.15.57:0/563665691 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f060c06b330 msgr2=0x7f060c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.930+0000 7f062b400700 1 --2- 172.21.15.57:0/563665691 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f060c06b330 0x7f060c06d7e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0618006fd0 tx=0x7f0618006db0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.930+0000 7f062b400700 1 -- 172.21.15.57:0/563665691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240fe0e0 msgr2=0x7f06240702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.930+0000 7f062b400700 1 --2- 172.21.15.57:0/563665691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240fe0e0 0x7f06240702e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f061000b3b0 tx=0x7f0610009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.930+0000 7f062b400700 1 -- 172.21.15.57:0/563665691 shutdown_connections 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.930+0000 7f062b400700 1 --2- 172.21.15.57:0/563665691 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f060c06b330 0x7f060c06d7e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.930+0000 7f062b400700 1 --2- 172.21.15.57:0/563665691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06240fcef0 0x7f0624071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.930+0000 7f062b400700 1 --2- 172.21.15.57:0/563665691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240fe0e0 0x7f06240702e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.930+0000 7f062b400700 1 -- 172.21.15.57:0/563665691 >> 172.21.15.57:0/563665691 conn(0x7f06240f8620 msgr2=0x7f06241013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.931+0000 7f062b400700 1 -- 172.21.15.57:0/563665691 shutdown_connections 2024-02-28T16:02:11.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:11.931+0000 7f062b400700 1 -- 172.21.15.57:0/563665691 wait complete. 2024-02-28T16:02:11.924 INFO:tasks.workunit.client.1.smithi087.stdout:9/905: chown d7/dd/d15/d3f/d6d/dc2/ld2 376 1 2024-02-28T16:02:11.929 INFO:tasks.workunit.client.1.smithi087.stdout:5/937: creat d3/d9/d9b/dba/d30/d8f/dac/d109/f14c x:0 0 0 2024-02-28T16:02:11.932 INFO:tasks.workunit.client.1.smithi087.stdout:5/938: fsync d3/d9/d9b/dba/d30/d36/d4f/d82/ff4 0 2024-02-28T16:02:11.933 INFO:tasks.workunit.client.1.smithi087.stdout:9/906: mknod d7/dd/d15/d3f/dc6/c111 0 2024-02-28T16:02:11.934 INFO:tasks.workunit.client.1.smithi087.stdout:8/948: truncate d2/d18/d42/f84 3882477 0 2024-02-28T16:02:11.936 INFO:tasks.workunit.client.1.smithi087.stdout:9/907: chown d7/d1e/d44/d76/l84 1 1 2024-02-28T16:02:11.939 INFO:tasks.workunit.client.1.smithi087.stdout:8/949: creat d2/d18/df5/f13c x:0 0 0 2024-02-28T16:02:11.942 INFO:tasks.workunit.client.1.smithi087.stdout:5/939: mknod d3/d9/d9b/dba/d30/c14d 0 2024-02-28T16:02:11.945 INFO:tasks.workunit.client.1.smithi087.stdout:8/950: mkdir d2/d63/d9b/d13d 0 2024-02-28T16:02:11.947 INFO:tasks.workunit.client.1.smithi087.stdout:5/940: mkdir d3/d64/d14e 0 2024-02-28T16:02:11.949 INFO:tasks.workunit.client.1.smithi087.stdout:8/951: mknod d2/d63/d96/c13e 0 2024-02-28T16:02:11.950 INFO:tasks.workunit.client.1.smithi087.stdout:9/908: dread d7/dd/d15/d79/d2e/fa9 [0,4194304] 0 2024-02-28T16:02:11.952 INFO:tasks.workunit.client.1.smithi087.stdout:8/952: chown d2/d18/d25/fc6 4 1 2024-02-28T16:02:11.953 INFO:tasks.workunit.client.1.smithi087.stdout:5/941: dread - d3/d9/d9b/dba/dca/f13a zero size 2024-02-28T16:02:11.954 INFO:tasks.workunit.client.1.smithi087.stdout:1/946: dwrite d0/d1b/d1f/f7e [0,4194304] 0 2024-02-28T16:02:11.957 INFO:tasks.workunit.client.1.smithi087.stdout:4/967: dread d2/d9/d10/d22/d5b/d5c/d91/da9/fca [0,4194304] 0 2024-02-28T16:02:11.963 INFO:tasks.workunit.client.1.smithi087.stdout:8/953: rename d2/d18/df5/d104/d116/l12d to d2/d63/d9b/dd5/dd9/de5/d111/d11a/l13f 0 2024-02-28T16:02:11.968 INFO:tasks.workunit.client.1.smithi087.stdout:1/947: creat d0/d14/f134 x:0 0 0 2024-02-28T16:02:11.969 INFO:tasks.workunit.client.1.smithi087.stdout:9/909: getdents d7/d1e/d44/d83 0 2024-02-28T16:02:11.972 INFO:tasks.workunit.client.1.smithi087.stdout:9/910: symlink d7/dc/l112 0 2024-02-28T16:02:11.973 INFO:tasks.workunit.client.1.smithi087.stdout:1/948: chown d0/d14/d86/f89 120871 1 2024-02-28T16:02:11.973 INFO:tasks.workunit.client.1.smithi087.stdout:4/968: link d2/d9/da/d1a/d26/d69/de3/l83 d2/df/d62/d116/l138 0 2024-02-28T16:02:11.975 INFO:tasks.workunit.client.1.smithi087.stdout:5/942: write d3/f43 [611752,87874] 0 2024-02-28T16:02:11.976 INFO:tasks.workunit.client.1.smithi087.stdout:8/954: write d2/d33/dd1/fd8 [933575,92444] 0 2024-02-28T16:02:11.977 INFO:tasks.workunit.client.1.smithi087.stdout:4/969: creat d2/df/d62/f139 x:0 0 0 2024-02-28T16:02:11.980 INFO:tasks.workunit.client.1.smithi087.stdout:9/911: rename d7/dd/d99/da3/fd8 to d7/dd/d3c/d4c/dbf/f113 0 2024-02-28T16:02:11.983 INFO:tasks.workunit.client.1.smithi087.stdout:4/970: symlink d2/df/d2e/dad/l13a 0 2024-02-28T16:02:11.983 INFO:tasks.workunit.client.1.smithi087.stdout:9/912: chown d7/dd/d15/d3f/d5f/d90/ddd 205269 1 2024-02-28T16:02:11.984 INFO:tasks.workunit.client.1.smithi087.stdout:8/955: rename d2/d63/f12f to d2/d18/df5/d104/da5/f140 0 2024-02-28T16:02:11.986 INFO:tasks.workunit.client.1.smithi087.stdout:4/971: fsync d2/d9/d10/d11/fdf 0 2024-02-28T16:02:11.986 INFO:tasks.workunit.client.1.smithi087.stdout:1/949: link d0/d1b/d1f/d71/db2/d24/d78/cef d0/d1a/d124/c135 0 2024-02-28T16:02:11.988 INFO:tasks.workunit.client.1.smithi087.stdout:9/913: creat d7/dd/d3c/d4c/da1/f114 x:0 0 0 2024-02-28T16:02:11.988 INFO:tasks.workunit.client.1.smithi087.stdout:4/972: stat d2/df/d65/d8d 0 2024-02-28T16:02:11.992 INFO:tasks.workunit.client.1.smithi087.stdout:0/919: sync 2024-02-28T16:02:11.995 INFO:tasks.workunit.client.1.smithi087.stdout:1/950: mkdir d0/d1a/d28/d9b/d136 0 2024-02-28T16:02:11.999 INFO:tasks.workunit.client.1.smithi087.stdout:0/920: truncate d4/dd/f1b 958894 0 2024-02-28T16:02:12.003 INFO:tasks.workunit.client.1.smithi087.stdout:1/951: rmdir d0/d14/d86 39 2024-02-28T16:02:12.007 INFO:tasks.workunit.client.1.smithi087.stdout:9/914: rename d7/dd/d15/d3f/d9d to d7/dd/d15/d3f/d5f/d90/ddd/d115 0 2024-02-28T16:02:12.007 INFO:tasks.workunit.client.1.smithi087.stdout:5/943: write d3/d9/f2a [2893231,66778] 0 2024-02-28T16:02:12.008 INFO:tasks.workunit.client.1.smithi087.stdout:1/952: fsync d0/d1b/fbd 0 2024-02-28T16:02:12.011 INFO:tasks.workunit.client.1.smithi087.stdout:4/973: getdents d2/d9/d9e 0 2024-02-28T16:02:12.012 INFO:tasks.workunit.client.1.smithi087.stdout:0/921: rename d4/d6/dc/f99 to d4/dd/d26/d111/f129 0 2024-02-28T16:02:12.014 INFO:tasks.workunit.client.1.smithi087.stdout:5/944: fdatasync d3/d9/fc6 0 2024-02-28T16:02:12.017 INFO:tasks.workunit.client.1.smithi087.stdout:0/922: write d4/d6/dc/f11f [652661,82849] 0 2024-02-28T16:02:12.022 INFO:tasks.workunit.client.1.smithi087.stdout:1/953: truncate d0/d1b/d1f/d71/db2/d24/d78/f8e 240343 0 2024-02-28T16:02:12.024 INFO:tasks.workunit.client.1.smithi087.stdout:9/915: unlink d7/dc/f7d 0 2024-02-28T16:02:12.024 INFO:tasks.workunit.client.1.smithi087.stdout:5/945: truncate d3/d9/d9b/dba/dca/f13a 145949 0 2024-02-28T16:02:12.026 INFO:tasks.workunit.client.1.smithi087.stdout:0/923: stat d4/dd/d37/d39/d3a/d57/d74/l113 0 2024-02-28T16:02:12.026 INFO:tasks.workunit.client.1.smithi087.stdout:9/916: readlink d7/dd/d15/d79/d2e/l5e 0 2024-02-28T16:02:12.026 INFO:tasks.workunit.client.1.smithi087.stdout:1/954: stat d0/d1b/d1f/d71/db2/db3/ldb 0 2024-02-28T16:02:12.030 INFO:tasks.workunit.client.1.smithi087.stdout:9/917: symlink d7/dd/d15/d79/l116 0 2024-02-28T16:02:12.030 INFO:tasks.workunit.client.1.smithi087.stdout:0/924: truncate d4/dd/d37/fcb 5037566 0 2024-02-28T16:02:12.033 INFO:tasks.workunit.client.1.smithi087.stdout:1/955: creat d0/d1b/d1f/d71/db2/d24/d5c/d69/f137 x:0 0 0 2024-02-28T16:02:12.033 INFO:tasks.workunit.client.1.smithi087.stdout:9/918: mknod d7/dd/d3c/d4c/dbf/c117 0 2024-02-28T16:02:12.035 INFO:tasks.workunit.client.1.smithi087.stdout:1/956: chown d0/d1b/d43 0 1 2024-02-28T16:02:12.037 INFO:tasks.workunit.client.1.smithi087.stdout:9/919: chown d7/dc/l25 6922879 1 2024-02-28T16:02:12.037 INFO:tasks.workunit.client.1.smithi087.stdout:0/925: symlink d4/dd/d37/d39/d3a/d57/d74/d1f/d60/d11a/l12a 0 2024-02-28T16:02:12.041 INFO:tasks.workunit.client.1.smithi087.stdout:0/926: mknod d4/dd/d21/d32/c12b 0 2024-02-28T16:02:12.042 INFO:tasks.workunit.client.1.smithi087.stdout:9/920: stat d7/dd/d15/d3f/d5f/f8f 0 2024-02-28T16:02:12.043 INFO:tasks.workunit.client.1.smithi087.stdout:5/946: dwrite d3/d9/f2a [4194304,4194304] 0 2024-02-28T16:02:12.047 INFO:tasks.workunit.client.1.smithi087.stdout:5/947: unlink d3/d9/d9b/dba/f2e 0 2024-02-28T16:02:12.051 INFO:tasks.workunit.client.1.smithi087.stdout:5/948: symlink d3/d9/d9b/l14f 0 2024-02-28T16:02:12.051 INFO:tasks.workunit.client.1.smithi087.stdout:1/957: dwrite d0/d1b/d43/d4d/d12c/fcc [0,4194304] 0 2024-02-28T16:02:12.058 INFO:tasks.workunit.client.1.smithi087.stdout:5/949: link d3/d9/d9b/dba/d30/d53/d5b/f108 d3/d9/d9b/dba/d30/d36/f150 0 2024-02-28T16:02:12.060 INFO:tasks.workunit.client.1.smithi087.stdout:5/950: fsync d3/d9/d9b/dba/d69/f88 0 2024-02-28T16:02:12.063 INFO:tasks.workunit.client.1.smithi087.stdout:5/951: creat d3/d9/d9b/dba/d30/d10f/f151 x:0 0 0 2024-02-28T16:02:12.066 INFO:tasks.workunit.client.1.smithi087.stdout:5/952: creat d3/d9/d9b/dba/d30/d8f/dac/f152 x:0 0 0 2024-02-28T16:02:12.069 INFO:tasks.workunit.client.1.smithi087.stdout:5/953: dread - d3/d9/d9b/dba/d30/d36/d4f/d82/fcc zero size 2024-02-28T16:02:12.077 INFO:tasks.workunit.client.1.smithi087.stdout:5/954: creat d3/d9/d9b/dba/d69/d87/df3/d117/d135/f153 x:0 0 0 2024-02-28T16:02:12.082 INFO:tasks.workunit.client.1.smithi087.stdout:5/955: chown d3/d9/d9b/dba/dca/f13a 787626 1 2024-02-28T16:02:12.084 INFO:tasks.workunit.client.1.smithi087.stdout:5/956: readlink d3/d9/d9b/dba/l5c 0 2024-02-28T16:02:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.094+0000 7f9ac9a00700 1 -- 172.21.15.57:0/2274982617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ac4070860 msgr2=0x7f9ac4070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.094+0000 7f9ac9a00700 1 --2- 172.21.15.57:0/2274982617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ac4070860 0x7f9ac4070cd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0004940 tx=0x7f9ab0009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.094+0000 7f9ac9a00700 1 -- 172.21.15.57:0/2274982617 shutdown_connections 2024-02-28T16:02:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.094+0000 7f9ac9a00700 1 --2- 172.21.15.57:0/2274982617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ac4070860 0x7f9ac4070cd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.094+0000 7f9ac9a00700 1 --2- 172.21.15.57:0/2274982617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ac4071eb0 0x7f9ac4070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:12.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.094+0000 7f9ac9a00700 1 -- 172.21.15.57:0/2274982617 >> 172.21.15.57:0/2274982617 conn(0x7f9ac40f8620 msgr2=0x7f9ac40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:12.087 INFO:tasks.workunit.client.1.smithi087.stdout:4/974: write d2/f8 [475341,109612] 0 2024-02-28T16:02:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.094+0000 7f9ac9a00700 1 -- 172.21.15.57:0/2274982617 shutdown_connections 2024-02-28T16:02:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.094+0000 7f9ac9a00700 1 -- 172.21.15.57:0/2274982617 wait complete. 2024-02-28T16:02:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.095+0000 7f9ac9a00700 1 Processor -- start 2024-02-28T16:02:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.095+0000 7f9ac9a00700 1 -- start start 2024-02-28T16:02:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.096+0000 7f9ac9a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ac4070860 0x7f9ac410fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.096+0000 7f9ac9a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ac4071eb0 0x7f9ac4110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.096+0000 7f9ac9a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41106f0 con 0x7f9ac4071eb0 2024-02-28T16:02:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.096+0000 7f9ac9a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4110f30 con 0x7f9ac4070860 2024-02-28T16:02:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.096+0000 7f9ac2000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ac4071eb0 0x7f9ac4110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.096+0000 7f9ac2000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ac4071eb0 0x7f9ac4110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55930/0 (socket says 172.21.15.57:55930) 2024-02-28T16:02:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.096+0000 7f9ac2000700 1 -- 172.21.15.57:0/4235492838 learned_addr learned my addr 172.21.15.57:0/4235492838 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.097+0000 7f9ac2000700 1 -- 172.21.15.57:0/4235492838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ac4070860 msgr2=0x7f9ac410fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.097+0000 7f9ac2000700 1 --2- 172.21.15.57:0/4235492838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ac4070860 0x7f9ac410fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.097+0000 7f9ac2000700 1 -- 172.21.15.57:0/4235492838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0005040 con 0x7f9ac4071eb0 2024-02-28T16:02:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.097+0000 7f9ac2000700 1 --2- 172.21.15.57:0/4235492838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ac4071eb0 0x7f9ac4110060 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000b3b0 tx=0x7f9ab0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.098+0000 7f9abaa00700 1 -- 172.21.15.57:0/4235492838 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ab000e040 con 0x7f9ac4071eb0 2024-02-28T16:02:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.098+0000 7f9abaa00700 1 -- 172.21.15.57:0/4235492838 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ab000bd90 con 0x7f9ac4071eb0 2024-02-28T16:02:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.098+0000 7f9abaa00700 1 -- 172.21.15.57:0/4235492838 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ab001c630 con 0x7f9ac4071eb0 2024-02-28T16:02:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.098+0000 7f9ac9a00700 1 -- 172.21.15.57:0/4235492838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac41111b0 con 0x7f9ac4071eb0 2024-02-28T16:02:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.098+0000 7f9ac9a00700 1 -- 172.21.15.57:0/4235492838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac41116f0 con 0x7f9ac4071eb0 2024-02-28T16:02:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.099+0000 7f9ac9a00700 1 -- 172.21.15.57:0/4235492838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac404bed0 con 0x7f9ac4071eb0 2024-02-28T16:02:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.100+0000 7f9abaa00700 1 -- 172.21.15.57:0/4235492838 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7f9ab00139f0 con 0x7f9ac4071eb0 2024-02-28T16:02:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.101+0000 7f9abaa00700 1 --2- 172.21.15.57:0/4235492838 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f9aa806b2e0 0x7f9aa806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.101+0000 7f9abaa00700 1 -- 172.21.15.57:0/4235492838 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f9ab008b300 con 0x7f9ac4071eb0 2024-02-28T16:02:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.102+0000 7f9ac2a00700 1 --2- 172.21.15.57:0/4235492838 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f9aa806b2e0 0x7f9aa806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.103+0000 7f9ac2a00700 1 --2- 172.21.15.57:0/4235492838 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f9aa806b2e0 0x7f9aa806d790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4006fd0 tx=0x7f9ab4006db0 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:12.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.106+0000 7f9abaa00700 1 -- 172.21.15.57:0/4235492838 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9ab0058f20 con 0x7f9ac4071eb0 2024-02-28T16:02:12.103 INFO:tasks.workunit.client.1.smithi087.stdout:5/957: write d3/d9/d9b/dba/d30/d36/d4f/d82/fcc [511362,17407] 0 2024-02-28T16:02:12.103 INFO:tasks.workunit.client.1.smithi087.stdout:4/975: write d2/d9/d10/d22/d5b/d5c/d91/da9/fcc [796761,90979] 0 2024-02-28T16:02:12.110 INFO:tasks.workunit.client.1.smithi087.stdout:1/958: dwrite d0/d14/d48/fc9 [0,4194304] 0 2024-02-28T16:02:12.119 INFO:tasks.workunit.client.1.smithi087.stdout:5/958: write d3/d64/d81/d124/f128 [644001,118263] 0 2024-02-28T16:02:12.125 INFO:tasks.workunit.client.1.smithi087.stdout:5/959: mknod d3/d102/c154 0 2024-02-28T16:02:12.126 INFO:tasks.workunit.client.1.smithi087.stdout:4/976: dwrite d2/d49/f51 [0,4194304] 0 2024-02-28T16:02:12.128 INFO:tasks.workunit.client.1.smithi087.stdout:4/977: stat d2/d9/l57 0 2024-02-28T16:02:12.129 INFO:tasks.workunit.client.1.smithi087.stdout:4/978: chown d2/d9/d10/d22/cee 701291643 1 2024-02-28T16:02:12.136 INFO:tasks.workunit.client.1.smithi087.stdout:4/979: dread d2/d9/d10/dbf/db6/fcb [0,4194304] 0 2024-02-28T16:02:12.137 INFO:tasks.workunit.client.1.smithi087.stdout:5/960: rename d3/d9/d9b/d115/c130 to d3/d9/d9b/dba/d30/d36/c155 0 2024-02-28T16:02:12.139 INFO:tasks.workunit.client.1.smithi087.stdout:5/961: chown d3/d64/d67/d7c/ld8 1345362 1 2024-02-28T16:02:12.143 INFO:tasks.workunit.client.1.smithi087.stdout:1/959: dread d0/fa [0,4194304] 0 2024-02-28T16:02:12.146 INFO:tasks.workunit.client.1.smithi087.stdout:5/962: getdents d3/d9/d9b/dba/d30/d8f/dac 0 2024-02-28T16:02:12.152 INFO:tasks.workunit.client.1.smithi087.stdout:1/960: creat d0/d1b/d43/d4d/d12c/dd8/f138 x:0 0 0 2024-02-28T16:02:12.157 INFO:tasks.workunit.client.1.smithi087.stdout:1/961: creat d0/d1b/d1f/d71/db2/d24/d78/f139 x:0 0 0 2024-02-28T16:02:12.157 INFO:tasks.workunit.client.1.smithi087.stdout:4/980: dwrite d2/d9/d10/d22/d5b/d5c/d68/dc5/df1/f128 [0,4194304] 0 2024-02-28T16:02:12.159 INFO:tasks.workunit.client.1.smithi087.stdout:5/963: write d3/d9/d9b/dba/d30/d53/d5b/fbf [1013285,41877] 0 2024-02-28T16:02:12.160 INFO:tasks.workunit.client.1.smithi087.stdout:4/981: chown d2/df/d2e/f10a 38 1 2024-02-28T16:02:12.162 INFO:tasks.workunit.client.1.smithi087.stdout:1/962: rename d0/fa2 to d0/d1a/f13a 0 2024-02-28T16:02:12.162 INFO:tasks.workunit.client.1.smithi087.stdout:7/959: sync 2024-02-28T16:02:12.165 INFO:tasks.workunit.client.1.smithi087.stdout:4/982: write d2/d9/d10/d22/d5b/d5c/d91/da9/fe9 [214303,4253] 0 2024-02-28T16:02:12.166 INFO:tasks.workunit.client.1.smithi087.stdout:4/983: readlink d2/d9/da/d1a/l2b 0 2024-02-28T16:02:12.171 INFO:tasks.workunit.client.1.smithi087.stdout:4/984: rmdir d2/d9/da/d1a/d26 39 2024-02-28T16:02:12.175 INFO:tasks.workunit.client.1.smithi087.stdout:1/963: getdents d0/d1b/d43/d4d/d12c/dd8 0 2024-02-28T16:02:12.175 INFO:tasks.workunit.client.1.smithi087.stdout:4/985: mknod d2/df/d62/c13b 0 2024-02-28T16:02:12.242 INFO:tasks.workunit.client.0.smithi057.stdout:3/479: sync 2024-02-28T16:02:12.242 INFO:tasks.workunit.client.0.smithi057.stdout:4/485: sync 2024-02-28T16:02:12.250 INFO:tasks.workunit.client.0.smithi057.stdout:3/480: read d8/dd/d14/d2c/f95 [6195114,77834] 0 2024-02-28T16:02:12.253 INFO:tasks.workunit.client.0.smithi057.stdout:4/486: dread d1/d10/d31/f6b [0,4194304] 0 2024-02-28T16:02:12.258 INFO:tasks.workunit.client.0.smithi057.stdout:3/481: rmdir d8/dd/d14/d2c 39 2024-02-28T16:02:12.266 INFO:tasks.workunit.client.0.smithi057.stdout:3/482: creat d8/dd/d14/d2e/d3b/d54/f99 x:0 0 0 2024-02-28T16:02:12.281 INFO:tasks.workunit.client.1.smithi087.stdout:7/960: write d14/d46/d7c/db9/fc7 [686952,13369] 0 2024-02-28T16:02:12.281 INFO:tasks.workunit.client.1.smithi087.stdout:4/986: creat d2/d9/d10/d22/d5b/d5c/f13c x:0 0 0 2024-02-28T16:02:12.283 INFO:tasks.workunit.client.1.smithi087.stdout:7/961: chown d14/d2e/d89/fde 48501 1 2024-02-28T16:02:12.291 INFO:tasks.workunit.client.0.smithi057.stdout:4/487: dwrite d1/d10/d31/f60 [0,4194304] 0 2024-02-28T16:02:12.294 INFO:tasks.workunit.client.0.smithi057.stdout:4/488: readlink d1/d10/d31/l9a 0 2024-02-28T16:02:12.306 INFO:tasks.workunit.client.0.smithi057.stdout:4/489: write d1/d22/d64/d9b/f9e [164800,80905] 0 2024-02-28T16:02:12.315 INFO:tasks.workunit.client.0.smithi057.stdout:4/490: write d1/d10/d12/d2c/d37/d46/f6a [3214222,128986] 0 2024-02-28T16:02:12.316 INFO:tasks.workunit.client.0.smithi057.stdout:3/483: dwrite d8/dd/d14/d2e/d30/d49/d51/d66/f90 [0,4194304] 0 2024-02-28T16:02:12.318 INFO:tasks.workunit.client.0.smithi057.stdout:4/491: chown d1/d10/d12/d2c/f8a 119017737 1 2024-02-28T16:02:12.321 INFO:tasks.workunit.client.0.smithi057.stdout:3/484: mknod d8/dd/d14/c9a 0 2024-02-28T16:02:12.326 INFO:tasks.workunit.client.0.smithi057.stdout:4/492: creat d1/d10/fa6 x:0 0 0 2024-02-28T16:02:12.332 INFO:tasks.workunit.client.0.smithi057.stdout:4/493: read d1/d10/d12/d2c/d50/f6c [440488,1793] 0 2024-02-28T16:02:12.346 INFO:tasks.workunit.client.1.smithi087.stdout:2/942: sync 2024-02-28T16:02:12.348 INFO:tasks.workunit.client.1.smithi087.stdout:2/943: chown d2/d7d/dac/f11a 80713040 1 2024-02-28T16:02:12.352 INFO:tasks.workunit.client.0.smithi057.stdout:3/485: dwrite d8/f12 [0,4194304] 0 2024-02-28T16:02:12.359 INFO:tasks.workunit.client.0.smithi057.stdout:4/494: dwrite d1/d10/d12/d39/f8f [0,4194304] 0 2024-02-28T16:02:12.361 INFO:tasks.workunit.client.0.smithi057.stdout:4/495: stat d1/d22/f2a 0 2024-02-28T16:02:12.367 INFO:tasks.workunit.client.0.smithi057.stdout:4/496: rename d1/d10/d12/d2c/f8a to d1/d10/d12/d2c/d50/d93/fa7 0 2024-02-28T16:02:12.373 INFO:tasks.workunit.client.0.smithi057.stdout:4/497: mknod d1/d10/d12/d15/d19/d5e/ca8 0 2024-02-28T16:02:12.374 INFO:tasks.workunit.client.0.smithi057.stdout:4/498: chown d1/d3f/d5f 3331593 1 2024-02-28T16:02:12.379 INFO:tasks.workunit.client.0.smithi057.stdout:4/499: fsync d1/d10/d12/d15/f4a 0 2024-02-28T16:02:12.379 INFO:tasks.workunit.client.0.smithi057.stdout:1/528: sync 2024-02-28T16:02:12.380 INFO:tasks.workunit.client.0.smithi057.stdout:8/449: sync 2024-02-28T16:02:12.385 INFO:tasks.workunit.client.0.smithi057.stdout:8/450: mkdir d5/d6/d97 0 2024-02-28T16:02:12.386 INFO:tasks.workunit.client.0.smithi057.stdout:4/500: unlink d1/d10/d12/d15/d19/d5e/ca8 0 2024-02-28T16:02:12.389 INFO:tasks.workunit.client.0.smithi057.stdout:4/501: dread - d1/d10/d12/f7f zero size 2024-02-28T16:02:12.392 INFO:tasks.workunit.client.0.smithi057.stdout:1/529: dread d1/d3/dc/f12 [4194304,4194304] 0 2024-02-28T16:02:12.392 INFO:tasks.workunit.client.0.smithi057.stdout:4/502: write d1/d22/f5c [627629,49096] 0 2024-02-28T16:02:12.394 INFO:tasks.workunit.client.0.smithi057.stdout:8/451: creat d5/d20/d39/d49/d56/f98 x:0 0 0 2024-02-28T16:02:12.396 INFO:tasks.workunit.client.0.smithi057.stdout:8/452: dread - d5/d20/d39/d49/d56/f98 zero size 2024-02-28T16:02:12.400 INFO:tasks.workunit.client.0.smithi057.stdout:8/453: creat d5/de/d63/d70/f99 x:0 0 0 2024-02-28T16:02:12.410 INFO:tasks.workunit.client.0.smithi057.stdout:1/530: dwrite d1/f34 [0,4194304] 0 2024-02-28T16:02:12.413 INFO:tasks.workunit.client.0.smithi057.stdout:1/531: chown d1/d21/d66/d44/d4c/f5e 372 1 2024-02-28T16:02:12.413 INFO:tasks.workunit.client.0.smithi057.stdout:8/454: write d5/de/f15 [4088740,81274] 0 2024-02-28T16:02:12.414 INFO:tasks.workunit.client.0.smithi057.stdout:8/455: dread - d5/de/d1b/f6f zero size 2024-02-28T16:02:12.417 INFO:tasks.workunit.client.0.smithi057.stdout:1/532: stat d1/d21/d66/d53/d7d/d67/d7a/d92/lab 0 2024-02-28T16:02:12.417 INFO:tasks.workunit.client.0.smithi057.stdout:8/456: write d5/de/d1b/f25 [2491187,104989] 0 2024-02-28T16:02:12.421 INFO:tasks.workunit.client.0.smithi057.stdout:8/457: creat d5/d20/f9a x:0 0 0 2024-02-28T16:02:12.421 INFO:tasks.workunit.client.0.smithi057.stdout:1/533: dread - d1/d21/d66/d53/d7d/d65/fa5 zero size 2024-02-28T16:02:12.423 INFO:tasks.workunit.client.0.smithi057.stdout:1/534: rmdir d1/d21/d25 39 2024-02-28T16:02:12.426 INFO:tasks.workunit.client.0.smithi057.stdout:8/458: getdents d5/d20/d39 0 2024-02-28T16:02:12.436 INFO:tasks.workunit.client.0.smithi057.stdout:1/535: write d1/d21/d66/d53/d7d/d65/f83 [1029989,62757] 0 2024-02-28T16:02:12.441 INFO:tasks.workunit.client.0.smithi057.stdout:1/536: read d1/d21/d66/f2f [3676768,81613] 0 2024-02-28T16:02:12.444 INFO:tasks.workunit.client.1.smithi087.stdout:4/987: mkdir d2/d9/d10/d22/d5b/d5c/d13d 0 2024-02-28T16:02:12.444 INFO:tasks.workunit.client.0.smithi057.stdout:8/459: dwrite d5/f7 [4194304,4194304] 0 2024-02-28T16:02:12.445 INFO:tasks.workunit.client.0.smithi057.stdout:1/537: symlink d1/d21/d66/d53/d7d/d67/d6c/d82/lae 0 2024-02-28T16:02:12.446 INFO:tasks.workunit.client.0.smithi057.stdout:8/460: chown d5/d20/d39/d49/d56 129 1 2024-02-28T16:02:12.449 INFO:tasks.workunit.client.1.smithi087.stdout:7/962: unlink d14/d2e/d89/deb/d5d/d6a/l77 0 2024-02-28T16:02:12.449 INFO:tasks.workunit.client.1.smithi087.stdout:2/944: creat d2/d42/ddd/f157 x:0 0 0 2024-02-28T16:02:12.451 INFO:tasks.workunit.client.1.smithi087.stdout:7/963: truncate d14/d46/d7c/db9/f129 1014359 0 2024-02-28T16:02:12.455 INFO:tasks.workunit.client.1.smithi087.stdout:4/988: mkdir d2/df/d62/d13e 0 2024-02-28T16:02:12.456 INFO:tasks.workunit.client.1.smithi087.stdout:4/989: stat d2/d9/d10/c7f 0 2024-02-28T16:02:12.459 INFO:tasks.workunit.client.1.smithi087.stdout:1/964: getdents d0/d1a/d28/d9b 0 2024-02-28T16:02:12.459 INFO:tasks.workunit.client.0.smithi057.stdout:1/538: rename d1/d3/dc/fa9 to d1/d3/dc/d15/d4e/faf 0 2024-02-28T16:02:12.462 INFO:tasks.workunit.client.1.smithi087.stdout:4/990: chown d2/d9/d10/f92 14421268 1 2024-02-28T16:02:12.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:12 smithi087 ceph-mon[37122]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:12.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:12 smithi087 ceph-mon[37122]: pgmap v38: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 84 MiB/s rd, 219 MiB/s wr, 452 op/s 2024-02-28T16:02:12.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:12 smithi087 ceph-mon[37122]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:12.467 INFO:tasks.workunit.client.0.smithi057.stdout:1/539: rename d1/d21/d66/d53/d7d/d67/d6c/d82/lae to d1/d21/d66/d53/d62/d73/lb0 0 2024-02-28T16:02:12.468 INFO:tasks.workunit.client.1.smithi087.stdout:4/991: chown d2/d9/da/d1a/d26 1 1 2024-02-28T16:02:12.471 INFO:tasks.workunit.client.0.smithi057.stdout:1/540: stat d1/d21/d66/d53/d7d/d65 0 2024-02-28T16:02:12.473 INFO:tasks.workunit.client.0.smithi057.stdout:8/461: dwrite d5/de/f4a [0,4194304] 0 2024-02-28T16:02:12.473 INFO:tasks.workunit.client.1.smithi087.stdout:7/964: dwrite d14/d2e/d2b/f50 [0,4194304] 0 2024-02-28T16:02:12.477 INFO:tasks.workunit.client.1.smithi087.stdout:1/965: rename d0/d1b/d1f/d71/db2/d24/d78/lce to d0/d1b/d1f/d71/db2/d24/d5c/d69/l13b 0 2024-02-28T16:02:12.477 INFO:tasks.workunit.client.1.smithi087.stdout:7/965: chown d14/d21/f32 31969093 1 2024-02-28T16:02:12.480 INFO:tasks.workunit.client.0.smithi057.stdout:8/462: getdents d5/d20/d39/d59/d67 0 2024-02-28T16:02:12.481 INFO:tasks.workunit.client.1.smithi087.stdout:4/992: symlink d2/d9/da/d1a/d26/da7/l13f 0 2024-02-28T16:02:12.490 INFO:tasks.workunit.client.1.smithi087.stdout:6/964: sync 2024-02-28T16:02:12.491 INFO:tasks.workunit.client.1.smithi087.stdout:4/993: creat d2/df/d62/d13e/f140 x:0 0 0 2024-02-28T16:02:12.495 INFO:tasks.workunit.client.1.smithi087.stdout:6/965: mknod d4/d12/d45/d57/c134 0 2024-02-28T16:02:12.500 INFO:tasks.workunit.client.0.smithi057.stdout:1/541: dwrite d1/d3/dc/d15/d4e/d5f/fa7 [0,4194304] 0 2024-02-28T16:02:12.506 INFO:tasks.workunit.client.1.smithi087.stdout:4/994: getdents d2/d9/d10/d22/d5b/d5c/d68 0 2024-02-28T16:02:12.510 INFO:tasks.workunit.client.0.smithi057.stdout:1/542: creat d1/d3/dc/d40/fb1 x:0 0 0 2024-02-28T16:02:12.512 INFO:tasks.workunit.client.0.smithi057.stdout:5/522: sync 2024-02-28T16:02:12.512 INFO:tasks.workunit.client.0.smithi057.stdout:7/426: sync 2024-02-28T16:02:12.512 INFO:tasks.workunit.client.0.smithi057.stdout:2/499: sync 2024-02-28T16:02:12.512 INFO:tasks.workunit.client.0.smithi057.stdout:0/635: sync 2024-02-28T16:02:12.512 INFO:tasks.workunit.client.1.smithi087.stdout:4/995: write d2/d9/d10/d22/f6a [6893127,7564] 0 2024-02-28T16:02:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:6/470: sync 2024-02-28T16:02:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:9/592: sync 2024-02-28T16:02:12.514 INFO:tasks.workunit.client.1.smithi087.stdout:4/996: read - d2/f132 zero size 2024-02-28T16:02:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:8/463: write d5/de/d1b/f6f [362214,85988] 0 2024-02-28T16:02:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:7/427: fsync d6/dc/d35/f83 0 2024-02-28T16:02:12.518 INFO:tasks.workunit.client.1.smithi087.stdout:4/997: stat d2/d9/d10/d11/fb9 0 2024-02-28T16:02:12.521 INFO:tasks.workunit.client.1.smithi087.stdout:4/998: mkdir d2/d9/d10/d22/d5b/d5c/d68/d141 0 2024-02-28T16:02:12.522 INFO:tasks.workunit.client.0.smithi057.stdout:8/464: stat d5/d6/d97 0 2024-02-28T16:02:12.522 INFO:tasks.workunit.client.0.smithi057.stdout:2/500: write d19/d3a/f98 [1486767,33872] 0 2024-02-28T16:02:12.523 INFO:tasks.workunit.client.0.smithi057.stdout:6/471: mknod df/d14/d15/d16/d65/c9b 0 2024-02-28T16:02:12.525 INFO:tasks.workunit.client.1.smithi087.stdout:1/966: dread d0/d1b/d1f/d71/db2/d24/f36 [4194304,4194304] 0 2024-02-28T16:02:12.525 INFO:tasks.workunit.client.1.smithi087.stdout:6/966: write d4/f23 [4109967,72901] 0 2024-02-28T16:02:12.526 INFO:tasks.workunit.client.0.smithi057.stdout:9/593: fsync d2/d5/d1b/f3c 0 2024-02-28T16:02:12.528 INFO:tasks.workunit.client.0.smithi057.stdout:8/465: mknod d5/d20/c9b 0 2024-02-28T16:02:12.530 INFO:tasks.workunit.client.1.smithi087.stdout:6/967: fdatasync d4/d30/d13/d38/d69/db0/f11a 0 2024-02-28T16:02:12.531 INFO:tasks.workunit.client.0.smithi057.stdout:7/428: chown d6/dc/d35/d58/l71 216005 1 2024-02-28T16:02:12.531 INFO:tasks.workunit.client.0.smithi057.stdout:1/543: rmdir d1/d3/dc 39 2024-02-28T16:02:12.531 INFO:tasks.workunit.client.1.smithi087.stdout:1/967: mknod d0/d1a/d28/d9b/c13c 0 2024-02-28T16:02:12.534 INFO:tasks.workunit.client.0.smithi057.stdout:0/636: write d6/d12/d17/f59 [699543,40743] 0 2024-02-28T16:02:12.534 INFO:tasks.workunit.client.0.smithi057.stdout:6/472: dread - df/d10/f5c zero size 2024-02-28T16:02:12.537 INFO:tasks.workunit.client.0.smithi057.stdout:7/429: unlink d6/d26/l45 0 2024-02-28T16:02:12.540 INFO:tasks.workunit.client.1.smithi087.stdout:6/968: truncate d4/da5/ffb 1986950 0 2024-02-28T16:02:12.540 INFO:tasks.workunit.client.0.smithi057.stdout:2/501: link d19/f29 d19/d1d/d89/fa6 0 2024-02-28T16:02:12.542 INFO:tasks.workunit.client.0.smithi057.stdout:6/473: chown df/d14/d15/d16/d39/d92/f93 1603200 1 2024-02-28T16:02:12.542 INFO:tasks.workunit.client.1.smithi087.stdout:6/969: chown d4/da5/ca8 872 1 2024-02-28T16:02:12.543 INFO:tasks.workunit.client.0.smithi057.stdout:5/523: truncate d2/d3e/f70 31901 0 2024-02-28T16:02:12.543 INFO:tasks.workunit.client.1.smithi087.stdout:8/956: sync 2024-02-28T16:02:12.544 INFO:tasks.workunit.client.1.smithi087.stdout:0/927: sync 2024-02-28T16:02:12.544 INFO:tasks.workunit.client.1.smithi087.stdout:9/921: sync 2024-02-28T16:02:12.545 INFO:tasks.workunit.client.1.smithi087.stdout:5/964: sync 2024-02-28T16:02:12.545 INFO:tasks.workunit.client.0.smithi057.stdout:8/466: symlink d5/de/d1b/d57/d85/l9c 0 2024-02-28T16:02:12.545 INFO:tasks.workunit.client.0.smithi057.stdout:0/637: read d6/d12/d5d/fc0 [32413,107510] 0 2024-02-28T16:02:12.546 INFO:tasks.workunit.client.0.smithi057.stdout:7/430: stat d6/dc/le 0 2024-02-28T16:02:12.547 INFO:tasks.workunit.client.1.smithi087.stdout:0/928: fdatasync d4/dd/ffe 0 2024-02-28T16:02:12.548 INFO:tasks.workunit.client.1.smithi087.stdout:5/965: chown d3/d64/d67/d7c/c84 56 1 2024-02-28T16:02:12.548 INFO:tasks.workunit.client.1.smithi087.stdout:8/957: chown d2/d63/d9b/dd5/dd9/l118 97675 1 2024-02-28T16:02:12.551 INFO:tasks.workunit.client.1.smithi087.stdout:9/922: chown d7/dd/d15/d55/l67 0 1 2024-02-28T16:02:12.552 INFO:tasks.workunit.client.0.smithi057.stdout:1/544: creat d1/d21/d66/d53/d62/fb2 x:0 0 0 2024-02-28T16:02:12.552 INFO:tasks.workunit.client.0.smithi057.stdout:8/467: write d5/de/d63/d70/f99 [452536,26047] 0 2024-02-28T16:02:12.552 INFO:tasks.workunit.client.0.smithi057.stdout:2/502: dread d19/d43/d5a/f6e [0,4194304] 0 2024-02-28T16:02:12.553 INFO:tasks.workunit.client.1.smithi087.stdout:8/958: write d2/d63/d9b/dd5/dd9/f129 [190009,57476] 0 2024-02-28T16:02:12.553 INFO:tasks.workunit.client.0.smithi057.stdout:6/474: mknod df/d14/d15/d16/d39/d92/c9c 0 2024-02-28T16:02:12.554 INFO:tasks.workunit.client.1.smithi087.stdout:5/966: read d3/d64/d81/d124/f128 [758228,21505] 0 2024-02-28T16:02:12.555 INFO:tasks.workunit.client.1.smithi087.stdout:4/999: dread d2/d9/f2c [0,4194304] 0 2024-02-28T16:02:12.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.563+0000 7f9ac9a00700 1 -- 172.21.15.57:0/4235492838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ac4111a20 con 0x7f9ac4071eb0 2024-02-28T16:02:12.557 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:02:12.557 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 13, 2024-02-28T16:02:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:02:12.559 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:02:12.559 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:02:12.559 INFO:tasks.workunit.client.0.smithi057.stdout:9/594: dwrite d2/d5/d1b/d2e/fb5 [0,4194304] 0 2024-02-28T16:02:12.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.564+0000 7f9abaa00700 1 -- 172.21.15.57:0/4235492838 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f9ab0058ab0 con 0x7f9ac4071eb0 2024-02-28T16:02:12.560 INFO:tasks.workunit.client.1.smithi087.stdout:6/970: rename d4/dc/d61/d89/fdc to d4/dc/d10/d102/f135 0 2024-02-28T16:02:12.560 INFO:tasks.workunit.client.1.smithi087.stdout:9/923: symlink d7/dd/d36/d89/l118 0 2024-02-28T16:02:12.563 INFO:tasks.workunit.client.1.smithi087.stdout:5/967: creat d3/d9/d9b/dba/d69/d87/df3/d117/f156 x:0 0 0 2024-02-28T16:02:12.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.570+0000 7f9ac9a00700 1 -- 172.21.15.57:0/4235492838 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f9aa806b2e0 msgr2=0x7f9aa806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:12.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.570+0000 7f9ac9a00700 1 --2- 172.21.15.57:0/4235492838 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f9aa806b2e0 0x7f9aa806d790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4006fd0 tx=0x7f9ab4006db0 comp rx=0 tx=0).stop 2024-02-28T16:02:12.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.570+0000 7f9ac9a00700 1 -- 172.21.15.57:0/4235492838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ac4071eb0 msgr2=0x7f9ac4110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:12.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.570+0000 7f9ac9a00700 1 --2- 172.21.15.57:0/4235492838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ac4071eb0 0x7f9ac4110060 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000b3b0 tx=0x7f9ab0009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:12.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.571+0000 7f9ac9a00700 1 -- 172.21.15.57:0/4235492838 shutdown_connections 2024-02-28T16:02:12.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.571+0000 7f9ac9a00700 1 --2- 172.21.15.57:0/4235492838 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f9aa806b2e0 0x7f9aa806d790 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:12.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.571+0000 7f9ac9a00700 1 --2- 172.21.15.57:0/4235492838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ac4070860 0x7f9ac410fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:12.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.571+0000 7f9ac9a00700 1 --2- 172.21.15.57:0/4235492838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ac4071eb0 0x7f9ac4110060 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:12.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.571+0000 7f9ac9a00700 1 -- 172.21.15.57:0/4235492838 >> 172.21.15.57:0/4235492838 conn(0x7f9ac40f8620 msgr2=0x7f9ac4102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:12.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.571+0000 7f9ac9a00700 1 -- 172.21.15.57:0/4235492838 shutdown_connections 2024-02-28T16:02:12.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.572+0000 7f9ac9a00700 1 -- 172.21.15.57:0/4235492838 wait complete. 2024-02-28T16:02:12.567 INFO:tasks.workunit.client.1.smithi087.stdout:0/929: rename d4/dd/d21/d9b/d7c/f98 to d4/d6/ddb/f12c 0 2024-02-28T16:02:12.570 INFO:tasks.workunit.client.1.smithi087.stdout:6/971: mknod d4/d30/c136 0 2024-02-28T16:02:12.575 INFO:tasks.workunit.client.1.smithi087.stdout:8/959: mkdir d2/d9/d5e/d9c/d141 0 2024-02-28T16:02:12.576 INFO:tasks.workunit.client.1.smithi087.stdout:6/972: fdatasync d4/dc/d10/f19 0 2024-02-28T16:02:12.576 INFO:tasks.workunit.client.1.smithi087.stdout:5/968: mknod d3/d9/d9b/de9/d11c/c157 0 2024-02-28T16:02:12.582 INFO:tasks.workunit.client.1.smithi087.stdout:2/945: dwrite d2/d7/f15 [0,4194304] 0 2024-02-28T16:02:12.582 INFO:tasks.workunit.client.0.smithi057.stdout:9/595: symlink d2/d5/d1b/d2e/d77/lbf 0 2024-02-28T16:02:12.583 INFO:tasks.workunit.client.0.smithi057.stdout:0/638: write d6/d12/d17/d4b/d60/f91 [203880,33309] 0 2024-02-28T16:02:12.586 INFO:tasks.workunit.client.1.smithi087.stdout:5/969: symlink d3/d64/d81/d124/l158 0 2024-02-28T16:02:12.588 INFO:tasks.workunit.client.1.smithi087.stdout:6/973: mknod d4/d30/d13/d38/c137 0 2024-02-28T16:02:12.592 INFO:tasks.workunit.client.1.smithi087.stdout:6/974: readlink d4/d30/d13/lfe 0 2024-02-28T16:02:12.592 INFO:tasks.workunit.client.1.smithi087.stdout:8/960: rename d2/d9/f19 to d2/d63/d9b/dae/db1/d122/f142 0 2024-02-28T16:02:12.594 INFO:tasks.workunit.client.1.smithi087.stdout:1/968: write d0/d1b/d1f/d71/db2/d24/d78/f8e [204015,99830] 0 2024-02-28T16:02:12.595 INFO:tasks.workunit.client.0.smithi057.stdout:2/503: dwrite d19/d1d/d2e/f90 [0,4194304] 0 2024-02-28T16:02:12.596 INFO:tasks.workunit.client.1.smithi087.stdout:7/966: dwrite d14/fa5 [0,4194304] 0 2024-02-28T16:02:12.596 INFO:tasks.workunit.client.1.smithi087.stdout:8/961: fsync d2/d63/d9b/dae/f132 0 2024-02-28T16:02:12.598 INFO:tasks.workunit.client.0.smithi057.stdout:0/639: mknod d6/d12/d5d/d71/daa/cd8 0 2024-02-28T16:02:12.599 INFO:tasks.workunit.client.1.smithi087.stdout:1/969: stat d0/d14/d48/da7/df4/f116 0 2024-02-28T16:02:12.604 INFO:tasks.workunit.client.0.smithi057.stdout:6/475: dwrite df/d10/d13/d4b/f51 [0,4194304] 0 2024-02-28T16:02:12.604 INFO:tasks.workunit.client.0.smithi057.stdout:5/524: dwrite d2/d8/f6c [0,4194304] 0 2024-02-28T16:02:12.606 INFO:tasks.workunit.client.1.smithi087.stdout:7/967: mknod d14/d46/d7c/df2/c130 0 2024-02-28T16:02:12.610 INFO:tasks.workunit.client.1.smithi087.stdout:6/975: dread - d4/d12/d45/d57/f110 zero size 2024-02-28T16:02:12.613 INFO:tasks.workunit.client.0.smithi057.stdout:9/596: link d2/d24/d1d/f7b d2/d5/d1b/d2e/d77/fc0 0 2024-02-28T16:02:12.613 INFO:tasks.workunit.client.0.smithi057.stdout:6/476: stat df/d61/d66 0 2024-02-28T16:02:12.613 INFO:tasks.workunit.client.0.smithi057.stdout:2/504: fdatasync d19/d2c/f56 0 2024-02-28T16:02:12.614 INFO:tasks.workunit.client.1.smithi087.stdout:8/962: symlink d2/d9/d5e/d9c/l143 0 2024-02-28T16:02:12.620 INFO:tasks.workunit.client.1.smithi087.stdout:7/968: mknod d14/d46/d7c/dc3/c131 0 2024-02-28T16:02:12.623 INFO:tasks.workunit.client.1.smithi087.stdout:2/946: dwrite d2/f14c [0,4194304] 0 2024-02-28T16:02:12.626 INFO:tasks.workunit.client.0.smithi057.stdout:2/505: chown d19/d3a/l4d 722873 1 2024-02-28T16:02:12.627 INFO:tasks.workunit.client.1.smithi087.stdout:7/969: read - d14/d30/dd1/f12b zero size 2024-02-28T16:02:12.634 INFO:tasks.workunit.client.0.smithi057.stdout:9/597: write d2/d5/d9/d5d/d82/fab [652989,51970] 0 2024-02-28T16:02:12.636 INFO:tasks.workunit.client.1.smithi087.stdout:9/924: write d7/f58 [5079451,40167] 0 2024-02-28T16:02:12.644 INFO:tasks.workunit.client.0.smithi057.stdout:1/545: dread d1/d3/dc/d40/f88 [0,4194304] 0 2024-02-28T16:02:12.644 INFO:tasks.workunit.client.1.smithi087.stdout:9/925: unlink d7/d1e/d44/d83/cc3 0 2024-02-28T16:02:12.651 INFO:tasks.workunit.client.1.smithi087.stdout:9/926: mkdir d7/dd/d3c/d4c/d119 0 2024-02-28T16:02:12.654 INFO:tasks.workunit.client.1.smithi087.stdout:7/970: creat d14/d46/f132 x:0 0 0 2024-02-28T16:02:12.657 INFO:tasks.workunit.client.0.smithi057.stdout:8/468: dread d5/d20/f38 [0,4194304] 0 2024-02-28T16:02:12.659 INFO:tasks.workunit.client.0.smithi057.stdout:8/469: dread - d5/de/d1b/f2e zero size 2024-02-28T16:02:12.660 INFO:tasks.workunit.client.0.smithi057.stdout:5/525: dread d2/d15/d5e/d7f/f88 [0,4194304] 0 2024-02-28T16:02:12.661 INFO:tasks.workunit.client.1.smithi087.stdout:8/963: getdents d2/d18/df5/d104 0 2024-02-28T16:02:12.664 INFO:tasks.workunit.client.0.smithi057.stdout:0/640: write d6/d12/d17/d34/f98 [952552,82569] 0 2024-02-28T16:02:12.664 INFO:tasks.workunit.client.1.smithi087.stdout:9/927: read d7/dd/d15/d3f/ff3 [151514,116622] 0 2024-02-28T16:02:12.671 INFO:tasks.workunit.client.0.smithi057.stdout:8/470: dread d5/d20/f38 [0,4194304] 0 2024-02-28T16:02:12.672 INFO:tasks.workunit.client.1.smithi087.stdout:9/928: truncate d7/dd/d3c/f43 3475536 0 2024-02-28T16:02:12.673 INFO:tasks.workunit.client.0.smithi057.stdout:3/486: sync 2024-02-28T16:02:12.673 INFO:tasks.workunit.client.0.smithi057.stdout:4/503: sync 2024-02-28T16:02:12.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:12 smithi057 ceph-mon[28763]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:12.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:12 smithi057 ceph-mon[28763]: pgmap v38: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 84 MiB/s rd, 219 MiB/s wr, 452 op/s 2024-02-28T16:02:12.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:12 smithi057 ceph-mon[28763]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:12.682 INFO:tasks.workunit.client.1.smithi087.stdout:0/930: dwrite d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/fc8 [0,4194304] 0 2024-02-28T16:02:12.686 INFO:tasks.workunit.client.1.smithi087.stdout:6/976: dwrite d4/dc/d10/f6e [0,4194304] 0 2024-02-28T16:02:12.686 INFO:tasks.workunit.client.0.smithi057.stdout:3/487: dread d8/dd/d19/d25/f7a [4194304,4194304] 0 2024-02-28T16:02:12.688 INFO:tasks.workunit.client.0.smithi057.stdout:9/598: creat d2/d5/d9/fc1 x:0 0 0 2024-02-28T16:02:12.688 INFO:tasks.workunit.client.1.smithi087.stdout:2/947: write d2/d7/dc0/d111/d3d/fab [625785,60439] 0 2024-02-28T16:02:12.689 INFO:tasks.workunit.client.1.smithi087.stdout:5/970: dwrite d3/d9/d9b/dba/d30/d8f/dac/fc2 [0,4194304] 0 2024-02-28T16:02:12.690 INFO:tasks.workunit.client.0.smithi057.stdout:5/526: creat d2/d3e/d5b/fbb x:0 0 0 2024-02-28T16:02:12.691 INFO:tasks.workunit.client.1.smithi087.stdout:5/971: fsync d3/d9/f2a 0 2024-02-28T16:02:12.692 INFO:tasks.workunit.client.1.smithi087.stdout:8/964: dwrite d2/d63/d9b/dae/f132 [0,4194304] 0 2024-02-28T16:02:12.693 INFO:tasks.workunit.client.0.smithi057.stdout:4/504: fsync d1/d10/d12/d2c/f57 0 2024-02-28T16:02:12.694 INFO:tasks.workunit.client.0.smithi057.stdout:2/506: symlink d19/d2c/d48/da2/la7 0 2024-02-28T16:02:12.695 INFO:tasks.workunit.client.1.smithi087.stdout:0/931: readlink d4/dd/d37/d39/d3a/d57/lbd 0 2024-02-28T16:02:12.696 INFO:tasks.workunit.client.1.smithi087.stdout:7/971: write d14/d46/f4c [1234935,39886] 0 2024-02-28T16:02:12.699 INFO:tasks.workunit.client.1.smithi087.stdout:2/948: symlink d2/d7/d12e/l158 0 2024-02-28T16:02:12.701 INFO:tasks.workunit.client.0.smithi057.stdout:5/527: read d2/d15/d5e/d6d/f75 [108574,115595] 0 2024-02-28T16:02:12.702 INFO:tasks.workunit.client.1.smithi087.stdout:2/949: dread - d2/d99/f13b zero size 2024-02-28T16:02:12.710 INFO:tasks.workunit.client.0.smithi057.stdout:1/546: symlink d1/lb3 0 2024-02-28T16:02:12.710 INFO:tasks.workunit.client.0.smithi057.stdout:9/599: creat d2/d46/d67/d7d/fc2 x:0 0 0 2024-02-28T16:02:12.711 INFO:tasks.workunit.client.1.smithi087.stdout:8/965: rename d2/d63/l82 to d2/d9/d5e/d9c/d141/l144 0 2024-02-28T16:02:12.717 INFO:tasks.workunit.client.1.smithi087.stdout:2/950: fdatasync d2/d7/f7f 0 2024-02-28T16:02:12.719 INFO:tasks.workunit.client.1.smithi087.stdout:9/929: getdents d7/dd/d3c/d4c/da1 0 2024-02-28T16:02:12.719 INFO:tasks.workunit.client.1.smithi087.stdout:7/972: write d14/d2e/d89/deb/d5d/d6a/d94/f9f [3671053,102361] 0 2024-02-28T16:02:12.720 INFO:tasks.workunit.client.0.smithi057.stdout:6/477: link df/d14/d15/d16/f56 df/d10/d13/d4b/f9d 0 2024-02-28T16:02:12.723 INFO:tasks.workunit.client.0.smithi057.stdout:4/505: write d1/d10/d12/d15/d19/d5e/f9f [237297,44938] 0 2024-02-28T16:02:12.724 INFO:tasks.workunit.client.1.smithi087.stdout:2/951: mkdir d2/d99/d28/d79/da3/d159 0 2024-02-28T16:02:12.725 INFO:tasks.workunit.client.0.smithi057.stdout:0/641: link d6/f41 d6/d12/d17/d92/fd9 0 2024-02-28T16:02:12.736 INFO:tasks.workunit.client.1.smithi087.stdout:5/972: write d3/d9/d9b/dba/d30/d36/d4f/fb8 [944178,101960] 0 2024-02-28T16:02:12.739 INFO:tasks.workunit.client.0.smithi057.stdout:8/471: rmdir d5/d20/d60 0 2024-02-28T16:02:12.743 INFO:tasks.workunit.client.0.smithi057.stdout:6/478: dread df/d14/d15/d16/f76 [0,4194304] 0 2024-02-28T16:02:12.744 INFO:tasks.workunit.client.1.smithi087.stdout:5/973: stat d3/d9/d9b/dba/cdc 0 2024-02-28T16:02:12.744 INFO:tasks.workunit.client.0.smithi057.stdout:2/507: dwrite d19/d3a/f46 [0,4194304] 0 2024-02-28T16:02:12.746 INFO:tasks.workunit.client.0.smithi057.stdout:9/600: write d2/d5/d9/f4b [438207,20058] 0 2024-02-28T16:02:12.750 INFO:tasks.workunit.client.1.smithi087.stdout:5/974: read - d3/d9/d9b/dba/d30/d8f/dac/d109/d54/f10c zero size 2024-02-28T16:02:12.752 INFO:tasks.workunit.client.0.smithi057.stdout:4/506: rename d1/d10/d12/d15/d19/d87/f9c to d1/d22/d64/d8c/fa9 0 2024-02-28T16:02:12.753 INFO:tasks.workunit.client.0.smithi057.stdout:2/508: dread d19/d43/d5a/f6e [0,4194304] 0 2024-02-28T16:02:12.753 INFO:tasks.workunit.client.1.smithi087.stdout:2/952: dwrite d2/d42/ddd/f126 [0,4194304] 0 2024-02-28T16:02:12.754 INFO:tasks.workunit.client.0.smithi057.stdout:4/507: stat d1/d22/f24 0 2024-02-28T16:02:12.755 INFO:tasks.workunit.client.1.smithi087.stdout:5/975: readlink d3/d9/d9b/dba/d30/d53/d5b/la3 0 2024-02-28T16:02:12.756 INFO:tasks.workunit.client.0.smithi057.stdout:2/509: chown d19/d1d/d2e/d3c 8234971 1 2024-02-28T16:02:12.761 INFO:tasks.workunit.client.1.smithi087.stdout:2/953: chown d2/d99/d28/d79/d9f/c118 1 1 2024-02-28T16:02:12.762 INFO:tasks.workunit.client.1.smithi087.stdout:9/930: dwrite d7/dd/d15/d3f/d5f/d90/fe8 [0,4194304] 0 2024-02-28T16:02:12.763 INFO:tasks.workunit.client.0.smithi057.stdout:7/431: sync 2024-02-28T16:02:12.763 INFO:tasks.workunit.client.0.smithi057.stdout:3/488: getdents d8 0 2024-02-28T16:02:12.768 INFO:tasks.workunit.client.1.smithi087.stdout:5/976: unlink d3/d9/d9b/dba/d30/d53/d5b/f6c 0 2024-02-28T16:02:12.768 INFO:tasks.workunit.client.0.smithi057.stdout:8/472: dread d5/d20/f38 [0,4194304] 0 2024-02-28T16:02:12.768 INFO:tasks.workunit.client.0.smithi057.stdout:1/547: mknod d1/d21/d66/d53/d7d/cb4 0 2024-02-28T16:02:12.771 INFO:tasks.workunit.client.0.smithi057.stdout:4/508: mknod d1/d10/d31/d86/caa 0 2024-02-28T16:02:12.772 INFO:tasks.workunit.client.1.smithi087.stdout:5/977: creat d3/d9/d9b/dba/d69/d87/df3/d117/f159 x:0 0 0 2024-02-28T16:02:12.774 INFO:tasks.workunit.client.1.smithi087.stdout:7/973: dread d14/d2e/d89/deb/d5d/d6a/d83/fb3 [0,4194304] 0 2024-02-28T16:02:12.774 INFO:tasks.workunit.client.0.smithi057.stdout:7/432: symlink d6/d26/l9b 0 2024-02-28T16:02:12.775 INFO:tasks.workunit.client.1.smithi087.stdout:5/978: stat d3/d64/d67/d7c/dc5/f101 0 2024-02-28T16:02:12.776 INFO:tasks.workunit.client.0.smithi057.stdout:9/601: mkdir d2/d5e/dc3 0 2024-02-28T16:02:12.781 INFO:tasks.workunit.client.0.smithi057.stdout:6/479: rename df/d10/d13/f2e to df/d14/d15/d16/d97/f9e 0 2024-02-28T16:02:12.781 INFO:tasks.workunit.client.1.smithi087.stdout:5/979: chown d3/d9/d9b/dba/d30/d53 51378 1 2024-02-28T16:02:12.783 INFO:tasks.workunit.client.0.smithi057.stdout:1/548: creat d1/d21/d66/d53/d7d/d65/fb5 x:0 0 0 2024-02-28T16:02:12.784 INFO:tasks.workunit.client.1.smithi087.stdout:7/974: unlink d14/d2e/d2b/d4e/f103 0 2024-02-28T16:02:12.786 INFO:tasks.workunit.client.0.smithi057.stdout:6/480: stat df/d10/d13/f3a 0 2024-02-28T16:02:12.788 INFO:tasks.workunit.client.1.smithi087.stdout:5/980: symlink d3/d9/d9b/dba/d30/d10f/l15a 0 2024-02-28T16:02:12.789 INFO:tasks.workunit.client.1.smithi087.stdout:8/966: dread d2/d18/df5/d104/f46 [0,4194304] 0 2024-02-28T16:02:12.790 INFO:tasks.workunit.client.0.smithi057.stdout:5/528: dwrite d2/d19/d1c/f36 [0,4194304] 0 2024-02-28T16:02:12.799 INFO:tasks.workunit.client.1.smithi087.stdout:7/975: dread d14/d2e/d89/deb/d55/dae/f106 [0,4194304] 0 2024-02-28T16:02:12.800 INFO:tasks.workunit.client.1.smithi087.stdout:2/954: write d2/d99/d28/f2e [736927,111383] 0 2024-02-28T16:02:12.802 INFO:tasks.workunit.client.1.smithi087.stdout:5/981: creat d3/d9/d9b/dba/d30/d36/d4f/d82/f15b x:0 0 0 2024-02-28T16:02:12.802 INFO:tasks.workunit.client.1.smithi087.stdout:6/977: dwrite d4/d30/d13/d38/d69/f79 [0,4194304] 0 2024-02-28T16:02:12.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.817+0000 7fa115800700 1 -- 172.21.15.57:0/2231441173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1100fe0e0 msgr2=0x7fa1100fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:12.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.817+0000 7fa115800700 1 --2- 172.21.15.57:0/2231441173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1100fe0e0 0x7fa1100fe550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0048b0 tx=0x7fa0fc009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:12.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.817+0000 7fa115800700 1 -- 172.21.15.57:0/2231441173 shutdown_connections 2024-02-28T16:02:12.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.817+0000 7fa115800700 1 --2- 172.21.15.57:0/2231441173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1100fe0e0 0x7fa1100fe550 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:12.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.818+0000 7fa115800700 1 --2- 172.21.15.57:0/2231441173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1100fcef0 0x7fa1100fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:12.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.818+0000 7fa115800700 1 -- 172.21.15.57:0/2231441173 >> 172.21.15.57:0/2231441173 conn(0x7fa1100f8620 msgr2=0x7fa1100faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:12.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.818+0000 7fa115800700 1 -- 172.21.15.57:0/2231441173 shutdown_connections 2024-02-28T16:02:12.811 INFO:tasks.workunit.client.1.smithi087.stdout:2/955: chown d2/d7/dc0/d111/d34/f4c 27 1 2024-02-28T16:02:12.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.818+0000 7fa115800700 1 -- 172.21.15.57:0/2231441173 wait complete. 2024-02-28T16:02:12.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.820+0000 7fa115800700 1 Processor -- start 2024-02-28T16:02:12.813 INFO:tasks.workunit.client.0.smithi057.stdout:8/473: getdents d5/d20/d39/d49/d89/d8d 0 2024-02-28T16:02:12.814 INFO:tasks.workunit.client.1.smithi087.stdout:5/982: mknod d3/d9/d9b/dba/d30/d53/d5b/c15c 0 2024-02-28T16:02:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.821+0000 7fa115800700 1 -- start start 2024-02-28T16:02:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.823+0000 7fa115800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1100fcef0 0x7fa11010fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.823+0000 7fa115800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1100fe0e0 0x7fa1101103c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.823+0000 7fa115800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa110110a10 con 0x7fa1100fcef0 2024-02-28T16:02:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.823+0000 7fa115800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11010b800 con 0x7fa1100fe0e0 2024-02-28T16:02:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.823+0000 7fa10ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1100fcef0 0x7fa11010fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:12.817 INFO:tasks.workunit.client.1.smithi087.stdout:2/956: write d2/f14c [855345,98022] 0 2024-02-28T16:02:12.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.824+0000 7fa10e000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1100fe0e0 0x7fa1101103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:12.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.824+0000 7fa10e000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1100fe0e0 0x7fa1101103c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:41724/0 (socket says 172.21.15.57:41724) 2024-02-28T16:02:12.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.825+0000 7fa10e000700 1 -- 172.21.15.57:0/466244292 learned_addr learned my addr 172.21.15.57:0/466244292 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:12.818 INFO:tasks.workunit.client.0.smithi057.stdout:4/509: getdents d1/d10/d12/d15 0 2024-02-28T16:02:12.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.826+0000 7fa10e000700 1 -- 172.21.15.57:0/466244292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1100fcef0 msgr2=0x7fa11010fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:12.818 INFO:tasks.workunit.client.0.smithi057.stdout:5/529: truncate d2/d15/d5e/d7f/f88 1259820 0 2024-02-28T16:02:12.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.826+0000 7fa10e000700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1100fcef0 0x7fa11010fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:12.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.826+0000 7fa10e000700 1 -- 172.21.15.57:0/466244292 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc005040 con 0x7fa1100fe0e0 2024-02-28T16:02:12.819 INFO:tasks.workunit.client.0.smithi057.stdout:6/481: rename df/d14/d15/l32 to df/d10/d13/d4b/d4e/l9f 0 2024-02-28T16:02:12.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.827+0000 7fa10ea00700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1100fcef0 0x7fa11010fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:02:12.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.828+0000 7fa10e000700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1100fe0e0 0x7fa1101103c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0136a0 tx=0x7fa0fc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:12.821 INFO:tasks.workunit.client.1.smithi087.stdout:5/983: chown d3/d9/d9b/dba/d69/l71 0 1 2024-02-28T16:02:12.822 INFO:tasks.workunit.client.1.smithi087.stdout:9/931: dwrite d7/d1e/f24 [0,4194304] 0 2024-02-28T16:02:12.823 INFO:tasks.workunit.client.1.smithi087.stdout:2/957: chown d2/d99/d28/d79/d9f/de1/d129/f10c 16987 1 2024-02-28T16:02:12.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.830+0000 7fa106a00700 1 -- 172.21.15.57:0/466244292 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0fc00e040 con 0x7fa1100fe0e0 2024-02-28T16:02:12.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.830+0000 7fa106a00700 1 -- 172.21.15.57:0/466244292 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0fc014d30 con 0x7fa1100fe0e0 2024-02-28T16:02:12.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.831+0000 7fa106a00700 1 -- 172.21.15.57:0/466244292 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0fc0125e0 con 0x7fa1100fe0e0 2024-02-28T16:02:12.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.832+0000 7fa115800700 1 -- 172.21.15.57:0/466244292 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11010ba80 con 0x7fa1100fe0e0 2024-02-28T16:02:12.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.832+0000 7fa115800700 1 -- 172.21.15.57:0/466244292 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11010bee0 con 0x7fa1100fe0e0 2024-02-28T16:02:12.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.834+0000 7fa115800700 1 -- 172.21.15.57:0/466244292 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11004bed0 con 0x7fa1100fe0e0 2024-02-28T16:02:12.828 INFO:tasks.workunit.client.0.smithi057.stdout:4/510: dread - d1/d22/fa3 zero size 2024-02-28T16:02:12.829 INFO:tasks.workunit.client.0.smithi057.stdout:1/549: dread d1/d21/d66/d53/d7d/d65/f61 [0,4194304] 0 2024-02-28T16:02:12.830 INFO:tasks.workunit.client.0.smithi057.stdout:6/482: readlink df/d14/d15/l57 0 2024-02-28T16:02:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.836+0000 7fa106a00700 1 -- 172.21.15.57:0/466244292 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7fa0fc01ca00 con 0x7fa1100fe0e0 2024-02-28T16:02:12.831 INFO:tasks.workunit.client.0.smithi057.stdout:8/474: symlink d5/l9d 0 2024-02-28T16:02:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.838+0000 7fa106a00700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa0f406b2e0 0x7fa0f406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.838+0000 7fa106a00700 1 -- 172.21.15.57:0/466244292 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fa0fc08ac70 con 0x7fa1100fe0e0 2024-02-28T16:02:12.832 INFO:tasks.workunit.client.0.smithi057.stdout:5/530: mknod d2/dae/cbc 0 2024-02-28T16:02:12.832 INFO:tasks.workunit.client.0.smithi057.stdout:7/433: dread d6/dc/f43 [0,4194304] 0 2024-02-28T16:02:12.833 INFO:tasks.workunit.client.1.smithi087.stdout:8/967: write d2/d18/d25/fc6 [8444951,58172] 0 2024-02-28T16:02:12.833 INFO:tasks.workunit.client.1.smithi087.stdout:2/958: fsync d2/d99/d28/d79/da3/fe0 0 2024-02-28T16:02:12.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.840+0000 7fa10ea00700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa0f406b2e0 0x7fa0f406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:12.833 INFO:tasks.workunit.client.0.smithi057.stdout:0/642: dwrite d6/f19 [4194304,4194304] 0 2024-02-28T16:02:12.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.845+0000 7fa10ea00700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa0f406b2e0 0x7fa0f406d790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa1000043d0 tx=0x7fa10000b040 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:12.839 INFO:tasks.workunit.client.1.smithi087.stdout:5/984: truncate d3/d9/d9b/dba/d30/d8f/dac/d109/f85 1103949 0 2024-02-28T16:02:12.840 INFO:tasks.workunit.client.1.smithi087.stdout:9/932: mkdir d7/dd/d3c/d4c/da1/d11a 0 2024-02-28T16:02:12.841 INFO:tasks.workunit.client.1.smithi087.stdout:2/959: mkdir d2/d42/ddd/d15a 0 2024-02-28T16:02:12.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:12.850+0000 7fa106a00700 1 -- 172.21.15.57:0/466244292 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa0fc054bf0 con 0x7fa1100fe0e0 2024-02-28T16:02:12.844 INFO:tasks.workunit.client.1.smithi087.stdout:9/933: readlink d7/dd/d15/d3f/d5f/d90/ddd/ddf/l10c 0 2024-02-28T16:02:12.844 INFO:tasks.workunit.client.0.smithi057.stdout:0/643: dread - d6/fd7 zero size 2024-02-28T16:02:12.845 INFO:tasks.workunit.client.0.smithi057.stdout:7/434: read - d6/dc/d12/d1a/d4d/f69 zero size 2024-02-28T16:02:12.846 INFO:tasks.workunit.client.1.smithi087.stdout:5/985: mkdir d3/d9/d9b/dba/d30/d36/d4f/d15d 0 2024-02-28T16:02:12.847 INFO:tasks.workunit.client.0.smithi057.stdout:5/531: write d2/d15/d5e/d6d/f75 [1117428,80326] 0 2024-02-28T16:02:12.848 INFO:tasks.workunit.client.0.smithi057.stdout:4/511: chown d1/d10/d31/d86/c69 178437 1 2024-02-28T16:02:12.848 INFO:tasks.workunit.client.1.smithi087.stdout:2/960: mknod d2/d99/dc7/def/c15b 0 2024-02-28T16:02:12.851 INFO:tasks.workunit.client.0.smithi057.stdout:9/602: dwrite d2/d5/d1b/d2e/f9d [0,4194304] 0 2024-02-28T16:02:12.854 INFO:tasks.workunit.client.1.smithi087.stdout:6/978: dread d4/d12/d45/d74/fec [0,4194304] 0 2024-02-28T16:02:12.856 INFO:tasks.workunit.client.1.smithi087.stdout:7/976: dread d14/d2e/d89/deb/d5d/f99 [0,4194304] 0 2024-02-28T16:02:12.859 INFO:tasks.workunit.client.0.smithi057.stdout:0/644: symlink d6/d12/da4/lda 0 2024-02-28T16:02:12.865 INFO:tasks.workunit.client.0.smithi057.stdout:6/483: write df/d10/f4d [4908210,1520] 0 2024-02-28T16:02:12.869 INFO:tasks.workunit.client.1.smithi087.stdout:2/961: link d2/d42/d4b/c68 d2/d99/d28/d79/d9f/de1/c15c 0 2024-02-28T16:02:12.869 INFO:tasks.workunit.client.1.smithi087.stdout:7/977: dread d14/d46/d7c/db9/f129 [0,4194304] 0 2024-02-28T16:02:12.872 INFO:tasks.workunit.client.1.smithi087.stdout:8/968: write d2/d9/d5e/d9c/fe4 [171102,16896] 0 2024-02-28T16:02:12.872 INFO:tasks.workunit.client.0.smithi057.stdout:5/532: symlink d2/d12/d3d/lbd 0 2024-02-28T16:02:12.875 INFO:tasks.workunit.client.1.smithi087.stdout:2/962: dread d2/d99/d28/d79/da3/f124 [0,4194304] 0 2024-02-28T16:02:12.876 INFO:tasks.workunit.client.0.smithi057.stdout:6/484: dread df/d10/d78/d5b/f8b [0,4194304] 0 2024-02-28T16:02:12.878 INFO:tasks.workunit.client.1.smithi087.stdout:6/979: truncate d4/d12/d45/d74/d9a/fb2 548063 0 2024-02-28T16:02:12.878 INFO:tasks.workunit.client.0.smithi057.stdout:5/533: stat d2/d15/d5e/d6d/f75 0 2024-02-28T16:02:12.880 INFO:tasks.workunit.client.1.smithi087.stdout:8/969: creat d2/d63/d9b/dd5/dd9/de5/d111/d11a/f145 x:0 0 0 2024-02-28T16:02:12.881 INFO:tasks.workunit.client.0.smithi057.stdout:9/603: mkdir d2/d5/d9/d64/dc4 0 2024-02-28T16:02:12.885 INFO:tasks.workunit.client.1.smithi087.stdout:9/934: dwrite d7/dd/d3c/f6f [0,4194304] 0 2024-02-28T16:02:12.887 INFO:tasks.workunit.client.0.smithi057.stdout:6/485: chown df/d14/d15/d16/c79 297 1 2024-02-28T16:02:12.887 INFO:tasks.workunit.client.1.smithi087.stdout:8/970: mknod d2/d63/d9b/dd5/dd9/de5/d111/c146 0 2024-02-28T16:02:12.890 INFO:tasks.workunit.client.0.smithi057.stdout:9/604: readlink d2/d5/d9/d57/l96 0 2024-02-28T16:02:12.891 INFO:tasks.workunit.client.1.smithi087.stdout:8/971: chown d2/d9/d10/l50 0 1 2024-02-28T16:02:12.893 INFO:tasks.workunit.client.1.smithi087.stdout:9/935: creat d7/dd/d3c/d4c/f11b x:0 0 0 2024-02-28T16:02:12.896 INFO:tasks.workunit.client.0.smithi057.stdout:0/645: mknod d6/d12/d5d/d71/daa/db6/cdb 0 2024-02-28T16:02:12.898 INFO:tasks.workunit.client.0.smithi057.stdout:1/550: dread d1/d21/d25/f95 [0,4194304] 0 2024-02-28T16:02:12.901 INFO:tasks.workunit.client.1.smithi087.stdout:2/963: dwrite d2/d7/dc0/d111/d34/f4c [0,4194304] 0 2024-02-28T16:02:12.905 INFO:tasks.workunit.client.0.smithi057.stdout:4/512: dwrite d1/d10/f43 [0,4194304] 0 2024-02-28T16:02:12.906 INFO:tasks.workunit.client.1.smithi087.stdout:9/936: getdents d7/dd/d99/da3 0 2024-02-28T16:02:12.907 INFO:tasks.workunit.client.0.smithi057.stdout:1/551: write d1/d21/d66/d53/d7d/d67/d6c/fad [923209,13277] 0 2024-02-28T16:02:12.912 INFO:tasks.workunit.client.1.smithi087.stdout:2/964: mknod d2/d99/d28/d79/d9f/de1/d129/c15d 0 2024-02-28T16:02:12.912 INFO:tasks.workunit.client.1.smithi087.stdout:8/972: write d2/d9/d5e/d9c/fec [633602,47766] 0 2024-02-28T16:02:12.915 INFO:tasks.workunit.client.0.smithi057.stdout:8/475: dread d5/d6/fa [4194304,4194304] 0 2024-02-28T16:02:12.915 INFO:tasks.workunit.client.1.smithi087.stdout:6/980: creat d4/d12/d45/d92/de5/f138 x:0 0 0 2024-02-28T16:02:12.923 INFO:tasks.workunit.client.0.smithi057.stdout:6/486: truncate df/d14/f43 497268 0 2024-02-28T16:02:12.925 INFO:tasks.workunit.client.0.smithi057.stdout:0/646: symlink d6/d12/d17/d4b/ldc 0 2024-02-28T16:02:12.926 INFO:tasks.workunit.client.1.smithi087.stdout:9/937: dwrite d7/dd/d15/d79/f7f [0,4194304] 0 2024-02-28T16:02:12.927 INFO:tasks.workunit.client.1.smithi087.stdout:6/981: truncate d4/d12/d45/d74/fec 3581647 0 2024-02-28T16:02:12.930 INFO:tasks.workunit.client.0.smithi057.stdout:7/435: getdents d6/d26 0 2024-02-28T16:02:12.935 INFO:tasks.workunit.client.0.smithi057.stdout:5/534: rename d2/d15/d5e/faa to d2/d15/d5e/d67/fbe 0 2024-02-28T16:02:12.936 INFO:tasks.workunit.client.1.smithi087.stdout:9/938: creat d7/dd/d36/d89/f11c x:0 0 0 2024-02-28T16:02:12.943 INFO:tasks.workunit.client.0.smithi057.stdout:1/552: fsync d1/d21/d66/d53/d7d/d67/d6c/fad 0 2024-02-28T16:02:12.946 INFO:tasks.workunit.client.1.smithi087.stdout:6/982: rename d4/d30/d13/d38/f64 to d4/dc/d61/d89/df2/f139 0 2024-02-28T16:02:12.952 INFO:tasks.workunit.client.1.smithi087.stdout:8/973: dread d2/d18/d42/f43 [0,4194304] 0 2024-02-28T16:02:12.953 INFO:tasks.workunit.client.1.smithi087.stdout:9/939: write d7/dd/d15/f7a [1536626,40497] 0 2024-02-28T16:02:12.954 INFO:tasks.workunit.client.0.smithi057.stdout:9/605: link d2/d24/l18 d2/d5/d1b/d2e/d4c/da0/lc5 0 2024-02-28T16:02:12.954 INFO:tasks.workunit.client.1.smithi087.stdout:2/965: dread d2/d99/f4d [0,4194304] 0 2024-02-28T16:02:12.955 INFO:tasks.workunit.client.1.smithi087.stdout:6/983: chown d4/d12/d45/d57/cf3 34 1 2024-02-28T16:02:12.957 INFO:tasks.workunit.client.1.smithi087.stdout:2/966: chown d2/d42/ddd/f126 29355143 1 2024-02-28T16:02:12.958 INFO:tasks.workunit.client.1.smithi087.stdout:9/940: dread - d7/dd/d15/fde zero size 2024-02-28T16:02:12.961 INFO:tasks.workunit.client.1.smithi087.stdout:2/967: chown d2/d7/dc0/d111/d34/daf 2724 1 2024-02-28T16:02:12.962 INFO:tasks.workunit.client.0.smithi057.stdout:7/436: creat d6/dc/d12/d29/f9c x:0 0 0 2024-02-28T16:02:12.964 INFO:tasks.workunit.client.0.smithi057.stdout:0/647: dread d6/d12/d17/d58/f84 [0,4194304] 0 2024-02-28T16:02:12.964 INFO:tasks.workunit.client.0.smithi057.stdout:7/437: stat d6/dc/f10 0 2024-02-28T16:02:12.965 INFO:tasks.workunit.client.1.smithi087.stdout:6/984: symlink d4/d12/d45/d92/dbd/l13a 0 2024-02-28T16:02:12.966 INFO:tasks.workunit.client.1.smithi087.stdout:9/941: fsync d7/dd/d15/d79/f16 0 2024-02-28T16:02:12.966 INFO:tasks.workunit.client.0.smithi057.stdout:0/648: chown d6/d12/l26 17 1 2024-02-28T16:02:12.967 INFO:tasks.workunit.client.1.smithi087.stdout:2/968: creat d2/d99/dc7/de2/de4/f15e x:0 0 0 2024-02-28T16:02:12.968 INFO:tasks.workunit.client.0.smithi057.stdout:7/438: write d6/d26/f86 [981252,114371] 0 2024-02-28T16:02:12.970 INFO:tasks.workunit.client.1.smithi087.stdout:9/942: chown d7/dd/d15/d3f/fb6 17957 1 2024-02-28T16:02:12.970 INFO:tasks.workunit.client.1.smithi087.stdout:2/969: symlink d2/d42/df1/l15f 0 2024-02-28T16:02:12.974 INFO:tasks.workunit.client.1.smithi087.stdout:2/970: mkdir d2/d7/d12e/d160 0 2024-02-28T16:02:12.975 INFO:tasks.workunit.client.1.smithi087.stdout:6/985: unlink d4/d30/d13/d38/c137 0 2024-02-28T16:02:12.976 INFO:tasks.workunit.client.1.smithi087.stdout:1/970: sync 2024-02-28T16:02:12.977 INFO:tasks.workunit.client.1.smithi087.stdout:8/974: dwrite d2/d63/d9b/dae/db1/d122/f142 [0,4194304] 0 2024-02-28T16:02:12.981 INFO:tasks.workunit.client.1.smithi087.stdout:9/943: fsync d7/d1e/d44/d83/fdb 0 2024-02-28T16:02:12.983 INFO:tasks.workunit.client.1.smithi087.stdout:8/975: chown d2/d63/d9b/dae/db1/df4 40 1 2024-02-28T16:02:12.983 INFO:tasks.workunit.client.1.smithi087.stdout:6/986: mknod d4/d30/d9b/c13b 0 2024-02-28T16:02:12.984 INFO:tasks.workunit.client.1.smithi087.stdout:2/971: unlink d2/d7/dc0/d111/d3d/c9e 0 2024-02-28T16:02:12.984 INFO:tasks.workunit.client.0.smithi057.stdout:8/476: getdents d5/d6 0 2024-02-28T16:02:12.987 INFO:tasks.workunit.client.1.smithi087.stdout:1/971: rename d0/d14/c53 to d0/d1b/d1f/d71/dad/c13d 0 2024-02-28T16:02:12.989 INFO:tasks.workunit.client.0.smithi057.stdout:8/477: fdatasync d5/d6/f88 0 2024-02-28T16:02:12.993 INFO:tasks.workunit.client.0.smithi057.stdout:7/439: truncate d6/dc/d12/d1a/d4d/f69 538885 0 2024-02-28T16:02:12.994 INFO:tasks.workunit.client.1.smithi087.stdout:8/976: truncate d2/d18/df5/d104/da5/faa 807346 0 2024-02-28T16:02:13.000 INFO:tasks.workunit.client.1.smithi087.stdout:6/987: mkdir d4/d12/d45/d5e/d13c 0 2024-02-28T16:02:13.001 INFO:tasks.workunit.client.0.smithi057.stdout:1/553: dwrite d1/d21/f52 [4194304,4194304] 0 2024-02-28T16:02:13.002 INFO:tasks.workunit.client.1.smithi087.stdout:8/977: getdents d2/d9/d5e/d9c 0 2024-02-28T16:02:13.002 INFO:tasks.workunit.client.0.smithi057.stdout:8/478: mkdir d5/de/d1b/d57/d9e 0 2024-02-28T16:02:13.003 INFO:tasks.workunit.client.1.smithi087.stdout:2/972: write d2/d42/f76 [3542937,33137] 0 2024-02-28T16:02:13.009 INFO:tasks.workunit.client.0.smithi057.stdout:5/535: link d2/c54 d2/d19/cbf 0 2024-02-28T16:02:13.013 INFO:tasks.workunit.client.1.smithi087.stdout:9/944: truncate d7/dd/d15/d79/f7f 2261762 0 2024-02-28T16:02:13.013 INFO:tasks.workunit.client.1.smithi087.stdout:8/978: rmdir d2/d63/d9b/dae/db1/d122 39 2024-02-28T16:02:13.013 INFO:tasks.workunit.client.1.smithi087.stdout:2/973: mknod d2/d99/d28/d79/d9f/de1/d129/c161 0 2024-02-28T16:02:13.015 INFO:tasks.workunit.client.0.smithi057.stdout:7/440: creat d6/dc/d12/d1a/d4c/f9d x:0 0 0 2024-02-28T16:02:13.016 INFO:tasks.workunit.client.1.smithi087.stdout:8/979: dread - d2/d18/df5/d104/f12b zero size 2024-02-28T16:02:13.017 INFO:tasks.workunit.client.1.smithi087.stdout:9/945: getdents d7/d101 0 2024-02-28T16:02:13.018 INFO:tasks.workunit.client.1.smithi087.stdout:9/946: dread - d7/dd/d3c/f78 zero size 2024-02-28T16:02:13.019 INFO:tasks.workunit.client.0.smithi057.stdout:9/606: write f0 [1980494,111339] 0 2024-02-28T16:02:13.020 INFO:tasks.workunit.client.0.smithi057.stdout:8/479: dwrite d5/de/f4a [0,4194304] 0 2024-02-28T16:02:13.030 INFO:tasks.workunit.client.0.smithi057.stdout:0/649: rename d6/d12/c2e to d6/cdd 0 2024-02-28T16:02:13.033 INFO:tasks.workunit.client.0.smithi057.stdout:6/487: dwrite df/d14/f43 [0,4194304] 0 2024-02-28T16:02:13.034 INFO:tasks.workunit.client.1.smithi087.stdout:6/988: link d4/d30/c136 d4/dc/d61/d89/df2/c13d 0 2024-02-28T16:02:13.035 INFO:tasks.workunit.client.1.smithi087.stdout:2/974: write d2/f5a [1008967,98731] 0 2024-02-28T16:02:13.036 INFO:tasks.workunit.client.0.smithi057.stdout:1/554: fsync d1/d3/dc/d40/f88 0 2024-02-28T16:02:13.036 INFO:tasks.workunit.client.1.smithi087.stdout:9/947: write d7/f14 [624997,85102] 0 2024-02-28T16:02:13.038 INFO:tasks.workunit.client.0.smithi057.stdout:6/488: chown lb 13192679 1 2024-02-28T16:02:13.042 INFO:tasks.workunit.client.1.smithi087.stdout:9/948: symlink d7/dd/d99/da3/l11d 0 2024-02-28T16:02:13.042 INFO:tasks.workunit.client.1.smithi087.stdout:2/975: write d2/d7/dc0/d111/d3d/fab [384785,123256] 0 2024-02-28T16:02:13.042 INFO:tasks.workunit.client.0.smithi057.stdout:5/536: rename d2/d19/d1c/f2c to d2/d3e/d5b/db0/fc0 0 2024-02-28T16:02:13.046 INFO:tasks.workunit.client.1.smithi087.stdout:9/949: rmdir d7/d1e/dc4 39 2024-02-28T16:02:13.047 INFO:tasks.workunit.client.1.smithi087.stdout:2/976: write d2/d42/d4b/f56 [1635998,124766] 0 2024-02-28T16:02:13.050 INFO:tasks.workunit.client.1.smithi087.stdout:9/950: mknod d7/dd/d15/d79/d56/c11e 0 2024-02-28T16:02:13.052 INFO:tasks.workunit.client.0.smithi057.stdout:4/513: sync 2024-02-28T16:02:13.052 INFO:tasks.workunit.client.0.smithi057.stdout:2/510: sync 2024-02-28T16:02:13.052 INFO:tasks.workunit.client.0.smithi057.stdout:3/489: sync 2024-02-28T16:02:13.054 INFO:tasks.workunit.client.1.smithi087.stdout:9/951: truncate d7/d1e/f24 5132496 0 2024-02-28T16:02:13.062 INFO:tasks.workunit.client.1.smithi087.stdout:9/952: getdents d7/dd/d15/d3f/d5f/d90/ddd/d115 0 2024-02-28T16:02:13.062 INFO:tasks.workunit.client.1.smithi087.stdout:9/953: stat d7/d1e/d60/d69/lca 0 2024-02-28T16:02:13.063 INFO:tasks.workunit.client.0.smithi057.stdout:1/555: dread - d1/d3/f59 zero size 2024-02-28T16:02:13.064 INFO:tasks.workunit.client.1.smithi087.stdout:9/954: chown d7/d1e/d60/d69/cea 334 1 2024-02-28T16:02:13.065 INFO:tasks.workunit.client.0.smithi057.stdout:6/489: symlink df/d10/d78/d5b/d7b/la0 0 2024-02-28T16:02:13.067 INFO:tasks.workunit.client.1.smithi087.stdout:9/955: mkdir d7/dd/d15/d3f/d5f/d90/ddd/d11f 0 2024-02-28T16:02:13.069 INFO:tasks.workunit.client.0.smithi057.stdout:5/537: dwrite d2/d15/d5e/d6d/f75 [0,4194304] 0 2024-02-28T16:02:13.070 INFO:tasks.workunit.client.1.smithi087.stdout:9/956: mkdir d7/dd/d36/d120 0 2024-02-28T16:02:13.073 INFO:tasks.workunit.client.0.smithi057.stdout:8/480: rename d5/d20/d72 to d5/d62/d9f 0 2024-02-28T16:02:13.073 INFO:tasks.workunit.client.1.smithi087.stdout:6/989: dread d4/d12/d45/d74/d9a/fb2 [0,4194304] 0 2024-02-28T16:02:13.074 INFO:tasks.workunit.client.0.smithi057.stdout:4/514: rmdir d1 39 2024-02-28T16:02:13.080 INFO:tasks.workunit.client.0.smithi057.stdout:7/441: creat d6/dc/d35/d58/f9e x:0 0 0 2024-02-28T16:02:13.081 INFO:tasks.workunit.client.0.smithi057.stdout:1/556: mknod d1/d21/d66/d44/cb6 0 2024-02-28T16:02:13.085 INFO:tasks.workunit.client.0.smithi057.stdout:5/538: symlink d2/d12/d76/d7b/lc1 0 2024-02-28T16:02:13.088 INFO:tasks.workunit.client.0.smithi057.stdout:0/650: creat d6/d12/d5d/fde x:0 0 0 2024-02-28T16:02:13.089 INFO:tasks.workunit.client.1.smithi087.stdout:2/977: dread d2/d7/dc0/d111/f59 [0,4194304] 0 2024-02-28T16:02:13.090 INFO:tasks.workunit.client.0.smithi057.stdout:0/651: read - d6/fd7 zero size 2024-02-28T16:02:13.090 INFO:tasks.workunit.client.0.smithi057.stdout:6/490: rename df/d10/f4d to df/d10/d78/d5b/d7b/fa1 0 2024-02-28T16:02:13.092 INFO:tasks.workunit.client.1.smithi087.stdout:9/957: dwrite d7/d1e/dc4/fd1 [0,4194304] 0 2024-02-28T16:02:13.094 INFO:tasks.workunit.client.1.smithi087.stdout:2/978: getdents d2/d99/d28/d79/d9f/de1/d130 0 2024-02-28T16:02:13.096 INFO:tasks.workunit.client.0.smithi057.stdout:8/481: creat d5/de/fa0 x:0 0 0 2024-02-28T16:02:13.097 INFO:tasks.workunit.client.1.smithi087.stdout:2/979: stat d2/d7/dc0/d111/d3d/l70 0 2024-02-28T16:02:13.098 INFO:tasks.workunit.client.1.smithi087.stdout:9/958: symlink d7/dd/d15/d3f/dc6/l121 0 2024-02-28T16:02:13.099 INFO:tasks.workunit.client.0.smithi057.stdout:3/490: write d8/dd/d14/d2e/d30/d49/d51/d66/d7f/f8a [1549325,88402] 0 2024-02-28T16:02:13.102 INFO:tasks.workunit.client.0.smithi057.stdout:7/442: rmdir d6/dc/d87 39 2024-02-28T16:02:13.102 INFO:tasks.workunit.client.0.smithi057.stdout:9/607: getdents d2/d5/d1b/d2e/d44 0 2024-02-28T16:02:13.105 INFO:tasks.workunit.client.0.smithi057.stdout:1/557: chown d1/d3/l71 11784 1 2024-02-28T16:02:13.107 INFO:tasks.workunit.client.1.smithi087.stdout:9/959: mknod d7/dd/d3c/d4c/da1/d11a/c122 0 2024-02-28T16:02:13.112 INFO:tasks.workunit.client.1.smithi087.stdout:9/960: getdents d7/dd/d3c/d4c/da1 0 2024-02-28T16:02:13.114 INFO:tasks.workunit.client.0.smithi057.stdout:4/515: creat d1/d22/fab x:0 0 0 2024-02-28T16:02:13.116 INFO:tasks.workunit.client.0.smithi057.stdout:2/511: dwrite d19/d1d/d26/f61 [0,4194304] 0 2024-02-28T16:02:13.117 INFO:tasks.workunit.client.0.smithi057.stdout:4/516: fsync d1/d10/f43 0 2024-02-28T16:02:13.122 INFO:tasks.workunit.client.1.smithi087.stdout:2/980: dwrite d2/d99/d28/d79/da3/f124 [0,4194304] 0 2024-02-28T16:02:13.122 INFO:tasks.workunit.client.1.smithi087.stdout:6/990: rename d4/d30/d13/d38/d69/db0 to d4/d12/d45/d92/dc1/dc7/d13e 0 2024-02-28T16:02:13.126 INFO:tasks.workunit.client.0.smithi057.stdout:3/491: mknod d8/dd/d19/c9b 0 2024-02-28T16:02:13.127 INFO:tasks.workunit.client.1.smithi087.stdout:6/991: dread - d4/d30/fef zero size 2024-02-28T16:02:13.127 INFO:tasks.workunit.client.0.smithi057.stdout:0/652: write d6/f85 [86105,28173] 0 2024-02-28T16:02:13.127 INFO:tasks.workunit.client.0.smithi057.stdout:9/608: mknod d2/d5/d9/d5d/cc6 0 2024-02-28T16:02:13.129 INFO:tasks.workunit.client.1.smithi087.stdout:2/981: symlink d2/d7/d121/l162 0 2024-02-28T16:02:13.132 INFO:tasks.workunit.client.0.smithi057.stdout:7/443: rename c2 to d6/dc/d12/d1a/d4c/d6c/c9f 0 2024-02-28T16:02:13.135 INFO:tasks.workunit.client.1.smithi087.stdout:2/982: fdatasync d2/d7/dc0/d111/d97/ffc 0 2024-02-28T16:02:13.136 INFO:tasks.workunit.client.1.smithi087.stdout:9/961: dwrite d7/dd/d99/fe9 [0,4194304] 0 2024-02-28T16:02:13.137 INFO:tasks.workunit.client.0.smithi057.stdout:1/558: truncate d1/d21/d66/f2f 5090726 0 2024-02-28T16:02:13.142 INFO:tasks.workunit.client.0.smithi057.stdout:6/491: creat df/fa2 x:0 0 0 2024-02-28T16:02:13.143 INFO:tasks.workunit.client.0.smithi057.stdout:3/492: mknod d8/dd/d14/d2e/d76/d89/c9c 0 2024-02-28T16:02:13.146 INFO:tasks.workunit.client.1.smithi087.stdout:9/962: symlink d7/dd/d15/d3f/dc6/l123 0 2024-02-28T16:02:13.147 INFO:tasks.workunit.client.0.smithi057.stdout:5/539: dwrite d2/d15/d5e/d6d/f81 [0,4194304] 0 2024-02-28T16:02:13.148 INFO:tasks.workunit.client.0.smithi057.stdout:0/653: truncate d6/d12/d17/d4b/f36 3515415 0 2024-02-28T16:02:13.149 INFO:tasks.workunit.client.0.smithi057.stdout:1/559: rename d1/d3/dc/c32 to d1/d21/d66/d53/cb7 0 2024-02-28T16:02:13.150 INFO:tasks.workunit.client.0.smithi057.stdout:7/444: read d6/dc/d35/f6a [2282100,36848] 0 2024-02-28T16:02:13.150 INFO:tasks.workunit.client.0.smithi057.stdout:3/493: fdatasync d8/dd/d14/d2e/d2f/f5a 0 2024-02-28T16:02:13.152 INFO:tasks.workunit.client.1.smithi087.stdout:6/992: dread d4/d30/d13/d38/d69/f12f [0,4194304] 0 2024-02-28T16:02:13.152 INFO:tasks.workunit.client.1.smithi087.stdout:9/963: chown d7/dd/d15/d3f/d6d/c77 126 1 2024-02-28T16:02:13.153 INFO:tasks.workunit.client.0.smithi057.stdout:8/482: link d5/de/d1b/c7c d5/de/d1b/d57/d85/ca1 0 2024-02-28T16:02:13.153 INFO:tasks.workunit.client.0.smithi057.stdout:0/654: chown d6/d4e/f77 116 1 2024-02-28T16:02:13.153 INFO:tasks.workunit.client.0.smithi057.stdout:2/512: getdents d19/d2c/d7b 0 2024-02-28T16:02:13.162 INFO:tasks.workunit.client.0.smithi057.stdout:8/483: write d5/de/d1b/f35 [4480899,41639] 0 2024-02-28T16:02:13.165 INFO:tasks.workunit.client.0.smithi057.stdout:7/445: read d6/f14 [2438647,73674] 0 2024-02-28T16:02:13.168 INFO:tasks.workunit.client.0.smithi057.stdout:6/492: rename df/d10/d78/d5b/l5d to df/d14/d15/d16/d39/la3 0 2024-02-28T16:02:13.171 INFO:tasks.workunit.client.0.smithi057.stdout:9/609: write d2/d5e/d65/f9b [352302,29535] 0 2024-02-28T16:02:13.172 INFO:tasks.workunit.client.0.smithi057.stdout:4/517: write d1/d10/d31/d36/f47 [2501529,23067] 0 2024-02-28T16:02:13.174 INFO:tasks.workunit.client.1.smithi087.stdout:6/993: mknod d4/d30/c13f 0 2024-02-28T16:02:13.177 INFO:tasks.workunit.client.1.smithi087.stdout:9/964: dwrite d7/dd/d36/f4f [4194304,4194304] 0 2024-02-28T16:02:13.182 INFO:tasks.workunit.client.1.smithi087.stdout:9/965: unlink d7/dd/d15/d55/f6c 0 2024-02-28T16:02:13.184 INFO:tasks.workunit.client.1.smithi087.stdout:9/966: truncate d7/f12 3818359 0 2024-02-28T16:02:13.185 INFO:tasks.workunit.client.1.smithi087.stdout:6/994: write d4/d12/d45/d92/dc1/dc7/d13e/f11b [3166962,75559] 0 2024-02-28T16:02:13.187 INFO:tasks.workunit.client.1.smithi087.stdout:2/983: dread d2/d99/dc7/de2/f11c [0,4194304] 0 2024-02-28T16:02:13.189 INFO:tasks.workunit.client.1.smithi087.stdout:2/984: chown d2/d7/dc0/d111 229746 1 2024-02-28T16:02:13.189 INFO:tasks.workunit.client.1.smithi087.stdout:6/995: read d4/d30/d13/fd3 [468524,7839] 0 2024-02-28T16:02:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:8/484: unlink d5/d62/d9f/f87 0 2024-02-28T16:02:13.196 INFO:tasks.workunit.client.1.smithi087.stdout:9/967: write d7/dd/d36/d89/fb5 [303087,99112] 0 2024-02-28T16:02:13.196 INFO:tasks.workunit.client.1.smithi087.stdout:2/985: write d2/f3e [889446,124262] 0 2024-02-28T16:02:13.199 INFO:tasks.workunit.client.1.smithi087.stdout:0/932: sync 2024-02-28T16:02:13.206 INFO:tasks.workunit.client.0.smithi057.stdout:4/518: dwrite d1/d22/f2a [0,4194304] 0 2024-02-28T16:02:13.206 INFO:tasks.workunit.client.1.smithi087.stdout:0/933: mkdir d4/dd/ddc/d112/d12d 0 2024-02-28T16:02:13.208 INFO:tasks.workunit.client.1.smithi087.stdout:9/968: rename d7/dd/d15/d3f/d5f/d90/ddd/d115 to d7/d1e/d44/d83/d8e/d124 0 2024-02-28T16:02:13.210 INFO:tasks.workunit.client.0.smithi057.stdout:5/540: fsync d2/d15/d5e/d6d/f81 0 2024-02-28T16:02:13.212 INFO:tasks.workunit.client.1.smithi087.stdout:0/934: readlink d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/de9/l10f 0 2024-02-28T16:02:13.214 INFO:tasks.workunit.client.0.smithi057.stdout:1/560: dread d1/d21/d66/f2f [0,4194304] 0 2024-02-28T16:02:13.217 INFO:tasks.workunit.client.0.smithi057.stdout:0/655: dread d6/d12/d17/d58/d95/daf/fd6 [0,4194304] 0 2024-02-28T16:02:13.217 INFO:tasks.workunit.client.1.smithi087.stdout:0/935: creat d4/d6/dc/f12e x:0 0 0 2024-02-28T16:02:13.227 INFO:tasks.workunit.client.1.smithi087.stdout:9/969: write d7/d1e/d60/fa4 [144173,20992] 0 2024-02-28T16:02:13.233 INFO:tasks.workunit.client.1.smithi087.stdout:9/970: truncate d7/dd/d15/f22 4119190 0 2024-02-28T16:02:13.239 INFO:tasks.workunit.client.1.smithi087.stdout:9/971: symlink d7/dd/l125 0 2024-02-28T16:02:13.243 INFO:tasks.workunit.client.1.smithi087.stdout:0/936: dwrite d4/d6/dc/d45/fed [0,4194304] 0 2024-02-28T16:02:13.248 INFO:tasks.workunit.client.1.smithi087.stdout:9/972: creat d7/dd/d3c/d4c/dbf/f126 x:0 0 0 2024-02-28T16:02:13.255 INFO:tasks.workunit.client.1.smithi087.stdout:9/973: rmdir d7/dd/d15 39 2024-02-28T16:02:13.269 INFO:tasks.workunit.client.1.smithi087.stdout:0/937: write d4/dd/d21/d32/f7a [3071659,105425] 0 2024-02-28T16:02:13.287 INFO:tasks.workunit.client.0.smithi057.stdout:3/494: unlink d8/dd/d14/d2e/d30/d49/d51/d66/d7f/c88 0 2024-02-28T16:02:13.288 INFO:tasks.workunit.client.1.smithi087.stdout:9/974: dread d7/dd/d15/f7a [0,4194304] 0 2024-02-28T16:02:13.293 INFO:tasks.workunit.client.0.smithi057.stdout:2/513: rename d19/d1d/d2e/d31/f3b to d19/d43/d5a/d70/fa8 0 2024-02-28T16:02:13.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.300+0000 7fa115800700 1 -- 172.21.15.57:0/466244292 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa11010c220 con 0x7fa1100fe0e0 2024-02-28T16:02:13.296 INFO:tasks.workunit.client.1.smithi087.stdout:0/938: write d4/d6/dc/d45/fc2 [1730563,129640] 0 2024-02-28T16:02:13.297 INFO:tasks.workunit.client.0.smithi057.stdout:5/541: creat d2/d12/d76/d7b/d62/d74/fc2 x:0 0 0 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout:e16 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 16 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:02:13.298 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:02:07.353165+0000 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:02:13.299 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:02:13.300 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:02:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.301+0000 7fa106a00700 1 -- 172.21.15.57:0/466244292 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1859 (secure 0 0 0) 0x7fa0fc0582b0 con 0x7fa1100fe0e0 2024-02-28T16:02:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 -- 172.21.15.57:0/466244292 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa0f406b2e0 msgr2=0x7fa0f406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa0f406b2e0 0x7fa0f406d790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa1000043d0 tx=0x7fa10000b040 comp rx=0 tx=0).stop 2024-02-28T16:02:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 -- 172.21.15.57:0/466244292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1100fe0e0 msgr2=0x7fa1101103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1100fe0e0 0x7fa1101103c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0136a0 tx=0x7fa0fc009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:13.302 INFO:tasks.workunit.client.0.smithi057.stdout:1/561: symlink d1/d21/d66/d44/d4c/lb8 0 2024-02-28T16:02:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 -- 172.21.15.57:0/466244292 shutdown_connections 2024-02-28T16:02:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa0f406b2e0 0x7fa0f406d790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1100fcef0 0x7fa11010fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 --2- 172.21.15.57:0/466244292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1100fe0e0 0x7fa1101103c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 -- 172.21.15.57:0/466244292 >> 172.21.15.57:0/466244292 conn(0x7fa1100f8620 msgr2=0x7fa1100fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 -- 172.21.15.57:0/466244292 shutdown_connections 2024-02-28T16:02:13.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.306+0000 7fa115800700 1 -- 172.21.15.57:0/466244292 wait complete. 2024-02-28T16:02:13.303 INFO:tasks.workunit.client.1.smithi087.stdout:6/996: write d4/d30/d13/d67/f87 [2597634,101378] 0 2024-02-28T16:02:13.306 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2024-02-28T16:02:13.313 INFO:tasks.workunit.client.0.smithi057.stdout:2/514: mknod d19/d1d/d2e/d3c/ca9 0 2024-02-28T16:02:13.315 INFO:tasks.workunit.client.1.smithi087.stdout:9/975: creat d7/dd/d3c/d4c/da1/f127 x:0 0 0 2024-02-28T16:02:13.318 INFO:tasks.workunit.client.1.smithi087.stdout:9/976: chown d7/dd/d15/d3f/d6d/dcd/fcf 125630783 1 2024-02-28T16:02:13.323 INFO:tasks.workunit.client.1.smithi087.stdout:6/997: symlink d4/d96/l140 0 2024-02-28T16:02:13.325 INFO:tasks.workunit.client.0.smithi057.stdout:4/519: dwrite d1/d3f/f89 [0,4194304] 0 2024-02-28T16:02:13.325 INFO:tasks.workunit.client.1.smithi087.stdout:0/939: dread d4/d6/dc/d45/f63 [0,4194304] 0 2024-02-28T16:02:13.327 INFO:tasks.workunit.client.0.smithi057.stdout:5/542: truncate d2/d15/d3b/f59 679272 0 2024-02-28T16:02:13.328 INFO:tasks.workunit.client.1.smithi087.stdout:0/940: chown d4/dd/ddc/d112/d12d 15 1 2024-02-28T16:02:13.331 INFO:tasks.workunit.client.0.smithi057.stdout:4/520: chown d1/d22/f24 0 1 2024-02-28T16:02:13.335 INFO:tasks.workunit.client.0.smithi057.stdout:7/446: sync 2024-02-28T16:02:13.336 INFO:tasks.workunit.client.0.smithi057.stdout:2/515: dwrite d19/f23 [8388608,4194304] 0 2024-02-28T16:02:13.339 INFO:tasks.workunit.client.1.smithi087.stdout:9/977: dwrite d7/dd/d15/d3f/d5f/d90/ddd/ff8 [0,4194304] 0 2024-02-28T16:02:13.342 INFO:tasks.workunit.client.0.smithi057.stdout:5/543: mknod d2/d8/cc3 0 2024-02-28T16:02:13.342 INFO:tasks.workunit.client.0.smithi057.stdout:6/493: getdents df/d14/d15/d16/d39/d92 0 2024-02-28T16:02:13.343 INFO:tasks.workunit.client.0.smithi057.stdout:4/521: mkdir d1/d10/d12/d2c/d37/d46/dac 0 2024-02-28T16:02:13.346 INFO:tasks.workunit.client.0.smithi057.stdout:6/494: chown lb 1384629 1 2024-02-28T16:02:13.347 INFO:tasks.workunit.client.1.smithi087.stdout:0/941: getdents d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/de9 0 2024-02-28T16:02:13.347 INFO:tasks.workunit.client.1.smithi087.stdout:9/978: mkdir d7/dd/d15/d79/d2e/dbd/d128 0 2024-02-28T16:02:13.350 INFO:tasks.workunit.client.0.smithi057.stdout:2/516: unlink d19/d1d/d89/f8e 0 2024-02-28T16:02:13.350 INFO:tasks.workunit.client.1.smithi087.stdout:9/979: stat d7/d1e/d60/lce 0 2024-02-28T16:02:13.351 INFO:tasks.workunit.client.1.smithi087.stdout:5/986: sync 2024-02-28T16:02:13.351 INFO:tasks.workunit.client.1.smithi087.stdout:7/978: sync 2024-02-28T16:02:13.351 INFO:tasks.workunit.client.1.smithi087.stdout:0/942: dread - d4/d6/dc/fdd zero size 2024-02-28T16:02:13.354 INFO:tasks.workunit.client.0.smithi057.stdout:6/495: mkdir df/d14/d15/d16/d39/d92/da4 0 2024-02-28T16:02:13.356 INFO:tasks.workunit.client.1.smithi087.stdout:0/943: write d4/d6/dc/d45/f63 [602865,68599] 0 2024-02-28T16:02:13.359 INFO:tasks.workunit.client.1.smithi087.stdout:7/979: readlink d14/d46/d80/ld9 0 2024-02-28T16:02:13.361 INFO:tasks.workunit.client.1.smithi087.stdout:7/980: write d14/d21/de4/f126 [380727,58416] 0 2024-02-28T16:02:13.362 INFO:tasks.workunit.client.1.smithi087.stdout:5/987: truncate d3/d9/d9b/dba/d30/d10f/d12c/ff2 804125 0 2024-02-28T16:02:13.371 INFO:tasks.workunit.client.1.smithi087.stdout:7/981: fsync d14/d46/d7c/db9/f129 0 2024-02-28T16:02:13.376 INFO:tasks.workunit.client.0.smithi057.stdout:6/496: creat df/d14/d15/d16/d39/d92/da4/fa5 x:0 0 0 2024-02-28T16:02:13.378 INFO:tasks.workunit.client.1.smithi087.stdout:1/972: sync 2024-02-28T16:02:13.378 INFO:tasks.workunit.client.1.smithi087.stdout:9/980: getdents d7/d1e/d44/d83/db0 0 2024-02-28T16:02:13.378 INFO:tasks.workunit.client.1.smithi087.stdout:8/980: sync 2024-02-28T16:02:13.378 INFO:tasks.workunit.client.0.smithi057.stdout:2/517: link d19/f29 d19/d2c/d65/faa 0 2024-02-28T16:02:13.380 INFO:tasks.workunit.client.0.smithi057.stdout:6/497: rmdir df/d14/d15/d82 39 2024-02-28T16:02:13.380 INFO:tasks.workunit.client.1.smithi087.stdout:6/998: dread d4/dc/d61/fe0 [0,4194304] 0 2024-02-28T16:02:13.382 INFO:tasks.workunit.client.0.smithi057.stdout:6/498: dread - df/d14/d15/d16/d39/d92/f93 zero size 2024-02-28T16:02:13.383 INFO:tasks.workunit.client.1.smithi087.stdout:1/973: fsync d0/d1b/d1f/d71/dad/f12f 0 2024-02-28T16:02:13.383 INFO:tasks.workunit.client.0.smithi057.stdout:2/518: mkdir d19/d1d/d2e/d3c/dab 0 2024-02-28T16:02:13.384 INFO:tasks.workunit.client.1.smithi087.stdout:8/981: write d2/d9/f5d [4522724,113455] 0 2024-02-28T16:02:13.384 INFO:tasks.workunit.client.1.smithi087.stdout:6/999: stat d4/dc/d10/f10c 0 2024-02-28T16:02:13.387 INFO:tasks.workunit.client.1.smithi087.stdout:5/988: rename d3/c11 to d3/d9/d9b/dba/d30/d36/d4f/c15e 0 2024-02-28T16:02:13.388 INFO:tasks.workunit.client.0.smithi057.stdout:6/499: dread - df/d10/d13/d4b/f9d zero size 2024-02-28T16:02:13.388 INFO:tasks.workunit.client.1.smithi087.stdout:9/981: dread - d7/dd/d15/d79/d2e/feb zero size 2024-02-28T16:02:13.391 INFO:tasks.workunit.client.1.smithi087.stdout:8/982: dread - d2/d9/d10/f120 zero size 2024-02-28T16:02:13.392 INFO:tasks.workunit.client.0.smithi057.stdout:6/500: mknod df/d10/ca6 0 2024-02-28T16:02:13.392 INFO:tasks.workunit.client.1.smithi087.stdout:9/982: stat d7/dd/d3c/d4c/da1/f7b 0 2024-02-28T16:02:13.395 INFO:tasks.workunit.client.1.smithi087.stdout:1/974: mkdir d0/d1b/d1f/d71/db2/dae/d13e 0 2024-02-28T16:02:13.399 INFO:tasks.workunit.client.1.smithi087.stdout:5/989: rename d3/d64/d67/f103 to d3/d9/d9b/dba/d30/d10f/f15f 0 2024-02-28T16:02:13.400 INFO:tasks.workunit.client.0.smithi057.stdout:6/501: link df/d14/d15/d16/f81 df/d14/d15/d16/fa7 0 2024-02-28T16:02:13.402 INFO:tasks.workunit.client.0.smithi057.stdout:6/502: write df/d14/d15/d16/d97/f9a [426001,61290] 0 2024-02-28T16:02:13.405 INFO:tasks.workunit.client.1.smithi087.stdout:7/982: dread d14/d46/d7c/f84 [0,4194304] 0 2024-02-28T16:02:13.406 INFO:tasks.workunit.client.0.smithi057.stdout:6/503: rmdir df/d10 39 2024-02-28T16:02:13.408 INFO:tasks.workunit.client.1.smithi087.stdout:8/983: creat d2/d18/f147 x:0 0 0 2024-02-28T16:02:13.414 INFO:tasks.workunit.client.0.smithi057.stdout:9/610: dwrite d2/d5/f37 [0,4194304] 0 2024-02-28T16:02:13.415 INFO:tasks.workunit.client.1.smithi087.stdout:1/975: link d0/d1a/d28/d9b/fd6 d0/d1b/d1f/d71/db2/d24/f13f 0 2024-02-28T16:02:13.415 INFO:tasks.workunit.client.1.smithi087.stdout:0/944: truncate d4/d6/dc/d45/f6a 3042787 0 2024-02-28T16:02:13.416 INFO:tasks.workunit.client.0.smithi057.stdout:0/656: dwrite d6/f2f [0,4194304] 0 2024-02-28T16:02:13.416 INFO:tasks.workunit.client.0.smithi057.stdout:6/504: mknod df/d10/d78/d5b/ca8 0 2024-02-28T16:02:13.418 INFO:tasks.workunit.client.1.smithi087.stdout:7/983: truncate d14/d21/f3e 811488 0 2024-02-28T16:02:13.419 INFO:tasks.workunit.client.0.smithi057.stdout:3/495: write d8/dd/d14/d2c/f95 [823552,70379] 0 2024-02-28T16:02:13.419 INFO:tasks.workunit.client.1.smithi087.stdout:9/983: dwrite d7/dd/d15/d3f/d6d/dcd/fd9 [0,4194304] 0 2024-02-28T16:02:13.420 INFO:tasks.workunit.client.0.smithi057.stdout:2/519: dread d19/d2c/d65/faa [0,4194304] 0 2024-02-28T16:02:13.423 INFO:tasks.workunit.client.0.smithi057.stdout:1/562: write d1/d3/f47 [1516055,96492] 0 2024-02-28T16:02:13.425 INFO:tasks.workunit.client.1.smithi087.stdout:0/945: creat d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d128/f12f x:0 0 0 2024-02-28T16:02:13.427 INFO:tasks.workunit.client.1.smithi087.stdout:1/976: creat d0/d1b/d1f/d71/db2/d24/d78/f140 x:0 0 0 2024-02-28T16:02:13.432 INFO:tasks.workunit.client.1.smithi087.stdout:0/946: chown d4/dd/d21/fe2 142 1 2024-02-28T16:02:13.432 INFO:tasks.workunit.client.0.smithi057.stdout:2/520: chown d19/d2c/d7b/c7f 1 1 2024-02-28T16:02:13.432 INFO:tasks.workunit.client.0.smithi057.stdout:0/657: chown d6/d12/d5d/d7f/cac 2198 1 2024-02-28T16:02:13.436 INFO:tasks.workunit.client.0.smithi057.stdout:6/505: getdents df/d10/d13/d4b/d4e/d84 0 2024-02-28T16:02:13.436 INFO:tasks.workunit.client.0.smithi057.stdout:3/496: creat d8/dd/d14/d2e/d3b/d71/f9d x:0 0 0 2024-02-28T16:02:13.438 INFO:tasks.workunit.client.0.smithi057.stdout:9/611: truncate d2/d5/d1b/d2e/d4c/f5a 373050 0 2024-02-28T16:02:13.438 INFO:tasks.workunit.client.0.smithi057.stdout:2/521: mknod d19/d2c/d65/cac 0 2024-02-28T16:02:13.444 INFO:tasks.workunit.client.0.smithi057.stdout:4/522: creat d1/d10/d12/d2c/fad x:0 0 0 2024-02-28T16:02:13.446 INFO:tasks.workunit.client.1.smithi087.stdout:7/984: dwrite f13 [0,4194304] 0 2024-02-28T16:02:13.447 INFO:tasks.workunit.client.1.smithi087.stdout:9/984: dread d7/dd/d15/d3f/d5f/d90/fe8 [0,4194304] 0 2024-02-28T16:02:13.447 INFO:tasks.workunit.client.1.smithi087.stdout:5/990: write d3/d9/d9b/dba/d30/d53/d5b/f108 [4052360,97573] 0 2024-02-28T16:02:13.450 INFO:tasks.workunit.client.1.smithi087.stdout:5/991: chown d3/d9/d9b/dba/l6f 471846 1 2024-02-28T16:02:13.451 INFO:tasks.workunit.client.1.smithi087.stdout:0/947: getdents d4 0 2024-02-28T16:02:13.454 INFO:tasks.workunit.client.0.smithi057.stdout:5/544: creat d2/d12/fc4 x:0 0 0 2024-02-28T16:02:13.456 INFO:tasks.workunit.client.1.smithi087.stdout:9/985: symlink d7/d1e/d44/d76/l129 0 2024-02-28T16:02:13.459 INFO:tasks.workunit.client.0.smithi057.stdout:5/545: write d2/d12/d76/f87 [69736,71201] 0 2024-02-28T16:02:13.460 INFO:tasks.workunit.client.1.smithi087.stdout:9/986: dread - d7/dd/d15/d3f/d6d/dcd/f102 zero size 2024-02-28T16:02:13.462 INFO:tasks.workunit.client.1.smithi087.stdout:7/985: fsync d14/d21/de4/de7/fed 0 2024-02-28T16:02:13.465 INFO:tasks.workunit.client.0.smithi057.stdout:7/447: dwrite d6/dc/d12/d1a/d4d/d56/f81 [0,4194304] 0 2024-02-28T16:02:13.465 INFO:tasks.workunit.client.0.smithi057.stdout:3/497: symlink d8/dd/d14/d2e/d3b/d71/l9e 0 2024-02-28T16:02:13.474 INFO:tasks.workunit.client.0.smithi057.stdout:9/612: dwrite d2/d5e/d65/f15 [0,4194304] 0 2024-02-28T16:02:13.482 INFO:tasks.workunit.client.1.smithi087.stdout:0/948: creat d4/d6/f130 x:0 0 0 2024-02-28T16:02:13.484 INFO:tasks.workunit.client.1.smithi087.stdout:1/977: dwrite d0/d1b/d1f/d71/db2/d24/f13f [0,4194304] 0 2024-02-28T16:02:13.486 INFO:tasks.workunit.client.1.smithi087.stdout:0/949: fdatasync d4/d6/d9c/fb5 0 2024-02-28T16:02:13.488 INFO:tasks.workunit.client.0.smithi057.stdout:2/522: fsync d19/d2c/d65/faa 0 2024-02-28T16:02:13.488 INFO:tasks.workunit.client.0.smithi057.stdout:3/498: creat d8/d4b/f9f x:0 0 0 2024-02-28T16:02:13.489 INFO:tasks.workunit.client.1.smithi087.stdout:1/978: write d0/d14/d48/fc9 [1548276,75590] 0 2024-02-28T16:02:13.499 INFO:tasks.workunit.client.0.smithi057.stdout:8/485: rename d5/d20/d39/d49/d89 to d5/d20/da2 0 2024-02-28T16:02:13.501 INFO:tasks.workunit.client.1.smithi087.stdout:1/979: rename d0/d1b/d1f/d71/db2/f12b to d0/d1a/d124/f141 0 2024-02-28T16:02:13.508 INFO:tasks.workunit.client.0.smithi057.stdout:2/523: dread d19/d1d/f44 [0,4194304] 0 2024-02-28T16:02:13.511 INFO:tasks.workunit.client.0.smithi057.stdout:3/499: symlink d8/dd/d19/la0 0 2024-02-28T16:02:13.517 INFO:tasks.workunit.client.0.smithi057.stdout:8/486: dread d5/de/d1b/f6f [0,4194304] 0 2024-02-28T16:02:13.517 INFO:tasks.workunit.client.0.smithi057.stdout:0/658: rename d6/d12/d17/d4b/d60/cc5 to d6/d12/d5d/d7f/cdf 0 2024-02-28T16:02:13.519 INFO:tasks.workunit.client.0.smithi057.stdout:4/523: write d1/d22/f75 [496148,32339] 0 2024-02-28T16:02:13.521 INFO:tasks.workunit.client.1.smithi087.stdout:5/992: dwrite d3/d64/d81/fcf [0,4194304] 0 2024-02-28T16:02:13.523 INFO:tasks.workunit.client.0.smithi057.stdout:9/613: link d2/d5/d1b/l38 d2/d5/d9/d57/d8b/lc7 0 2024-02-28T16:02:13.525 INFO:tasks.workunit.client.1.smithi087.stdout:9/987: dwrite d7/dd/d3c/d4c/da1/fb8 [0,4194304] 0 2024-02-28T16:02:13.525 INFO:tasks.workunit.client.1.smithi087.stdout:5/993: read - d3/f100 zero size 2024-02-28T16:02:13.526 INFO:tasks.workunit.client.0.smithi057.stdout:6/506: dread df/d10/d13/d4b/f5e [0,4194304] 0 2024-02-28T16:02:13.528 INFO:tasks.workunit.client.0.smithi057.stdout:3/500: rmdir d8/dd/d14/d2e/d2f 39 2024-02-28T16:02:13.530 INFO:tasks.workunit.client.0.smithi057.stdout:3/501: chown c6 924085 1 2024-02-28T16:02:13.533 INFO:tasks.workunit.client.1.smithi087.stdout:5/994: fsync d3/d9/d9b/de9/f12a 0 2024-02-28T16:02:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.541+0000 7f6bbbe00700 1 -- 172.21.15.57:0/3833252313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb40fcef0 msgr2=0x7f6bb40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.541+0000 7f6bbbe00700 1 --2- 172.21.15.57:0/3833252313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb40fcef0 0x7f6bb40fd320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8004940 tx=0x7f6ba8009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.543+0000 7f6bbbe00700 1 -- 172.21.15.57:0/3833252313 shutdown_connections 2024-02-28T16:02:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.543+0000 7f6bbbe00700 1 --2- 172.21.15.57:0/3833252313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb40fe0e0 0x7f6bb40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.543+0000 7f6bbbe00700 1 --2- 172.21.15.57:0/3833252313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb40fcef0 0x7f6bb40fd320 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.543+0000 7f6bbbe00700 1 -- 172.21.15.57:0/3833252313 >> 172.21.15.57:0/3833252313 conn(0x7f6bb40f8620 msgr2=0x7f6bb40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.543+0000 7f6bbbe00700 1 -- 172.21.15.57:0/3833252313 shutdown_connections 2024-02-28T16:02:13.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.543+0000 7f6bbbe00700 1 -- 172.21.15.57:0/3833252313 wait complete. 2024-02-28T16:02:13.537 INFO:tasks.workunit.client.1.smithi087.stdout:9/988: truncate d7/dd/d15/fde 714188 0 2024-02-28T16:02:13.537 INFO:tasks.workunit.client.1.smithi087.stdout:5/995: write d3/d64/d81/f55 [941442,125996] 0 2024-02-28T16:02:13.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.544+0000 7f6bbbe00700 1 Processor -- start 2024-02-28T16:02:13.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.546+0000 7f6bbbe00700 1 -- start start 2024-02-28T16:02:13.538 INFO:tasks.workunit.client.1.smithi087.stdout:5/996: chown d3/d9/d4a/l122 117986 1 2024-02-28T16:02:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.547+0000 7f6bbbe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb40fcef0 0x7f6bb4114040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:13.540 INFO:tasks.workunit.client.0.smithi057.stdout:5/546: truncate d2/d12/fb7 3448402 0 2024-02-28T16:02:13.540 INFO:tasks.workunit.client.0.smithi057.stdout:1/563: dread d1/d21/d66/d53/d7d/d65/f5a [0,4194304] 0 2024-02-28T16:02:13.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.548+0000 7f6bbbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb40fe0e0 0x7f6bb4114580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:13.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.549+0000 7f6bbbe00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4114c10 con 0x7f6bb40fcef0 2024-02-28T16:02:13.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.549+0000 7f6bbbe00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4115450 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.542 INFO:tasks.workunit.client.0.smithi057.stdout:8/487: symlink d5/d20/d39/d59/d67/la3 0 2024-02-28T16:02:13.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.550+0000 7f6bb9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb40fcef0 0x7f6bb4114040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:13.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.550+0000 7f6bb9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb40fcef0 0x7f6bb4114040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55964/0 (socket says 172.21.15.57:55964) 2024-02-28T16:02:13.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.549+0000 7f6bb8a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb40fe0e0 0x7f6bb4114580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:13.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.551+0000 7f6bb8a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb40fe0e0 0x7f6bb4114580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:41738/0 (socket says 172.21.15.57:41738) 2024-02-28T16:02:13.544 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:13 smithi057 ceph-mon[28763]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:13.544 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:13 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/4235492838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:02:13.544 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:13 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/466244292' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:02:13.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.551+0000 7f6bb8a00700 1 -- 172.21.15.57:0/1238114531 learned_addr learned my addr 172.21.15.57:0/1238114531 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:13.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.552+0000 7f6bb8a00700 1 -- 172.21.15.57:0/1238114531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb40fcef0 msgr2=0x7f6bb4114040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:13.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.552+0000 7f6bb8a00700 1 --2- 172.21.15.57:0/1238114531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb40fcef0 0x7f6bb4114040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:13.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.553+0000 7f6bb8a00700 1 -- 172.21.15.57:0/1238114531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba8005040 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.547 INFO:tasks.workunit.client.1.smithi087.stdout:5/997: creat d3/d64/d81/f160 x:0 0 0 2024-02-28T16:02:13.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.554+0000 7f6bb8a00700 1 --2- 172.21.15.57:0/1238114531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb40fe0e0 0x7f6bb4114580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000b580 tx=0x7f6ba00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:13.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.556+0000 7f6bb1600700 1 -- 172.21.15.57:0/1238114531 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba000f6f0 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.550 INFO:tasks.workunit.client.0.smithi057.stdout:9/614: creat d2/d62/fc8 x:0 0 0 2024-02-28T16:02:13.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.556+0000 7f6bbbe00700 1 -- 172.21.15.57:0/1238114531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb4115730 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.556+0000 7f6bbbe00700 1 -- 172.21.15.57:0/1238114531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb4115c70 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.559+0000 7f6bbbe00700 1 -- 172.21.15.57:0/1238114531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb4102210 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.551 INFO:tasks.workunit.client.0.smithi057.stdout:9/615: stat d2/d62/fc8 0 2024-02-28T16:02:13.554 INFO:tasks.workunit.client.1.smithi087.stdout:7/986: dwrite d14/d2e/d89/dbd/fe9 [0,4194304] 0 2024-02-28T16:02:13.555 INFO:tasks.workunit.client.1.smithi087.stdout:0/950: write d4/dd/d21/d9b/fbe [79420,116317] 0 2024-02-28T16:02:13.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.566+0000 7f6bb1600700 1 -- 172.21.15.57:0/1238114531 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ba000fd20 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.566+0000 7f6bb1600700 1 -- 172.21.15.57:0/1238114531 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba001ae80 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.566+0000 7f6bb1600700 1 -- 172.21.15.57:0/1238114531 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7f6ba0011400 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.559 INFO:tasks.workunit.client.1.smithi087.stdout:9/989: creat d7/f12a x:0 0 0 2024-02-28T16:02:13.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.568+0000 7f6bb1600700 1 --2- 172.21.15.57:0/1238114531 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f6b9c06b480 0x7f6b9c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:13.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.568+0000 7f6bb1600700 1 -- 172.21.15.57:0/1238114531 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f6ba008adc0 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.569+0000 7f6bb9400700 1 --2- 172.21.15.57:0/1238114531 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f6b9c06b480 0x7f6b9c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:13.562 INFO:tasks.workunit.client.0.smithi057.stdout:5/547: creat d2/d12/d3d/fc5 x:0 0 0 2024-02-28T16:02:13.563 INFO:tasks.workunit.client.0.smithi057.stdout:1/564: creat d1/d3/dc/d15/d4e/d57/fb9 x:0 0 0 2024-02-28T16:02:13.564 INFO:tasks.workunit.client.1.smithi087.stdout:5/998: creat d3/d9/d9b/dba/d30/d36/d4f/d82/f161 x:0 0 0 2024-02-28T16:02:13.566 INFO:tasks.workunit.client.0.smithi057.stdout:4/524: symlink d1/d10/lae 0 2024-02-28T16:02:13.566 INFO:tasks.workunit.client.0.smithi057.stdout:5/548: fdatasync d2/d15/d3b/f2f 0 2024-02-28T16:02:13.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.574+0000 7f6bb1600700 1 -- 172.21.15.57:0/1238114531 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6ba0058a40 con 0x7f6bb40fe0e0 2024-02-28T16:02:13.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.574+0000 7f6bb9400700 1 --2- 172.21.15.57:0/1238114531 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f6b9c06b480 0x7f6b9c06d930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800b840 tx=0x7f6ba8009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:13.569 INFO:tasks.workunit.client.0.smithi057.stdout:1/565: readlink d1/d21/d66/d53/d7d/l84 0 2024-02-28T16:02:13.571 INFO:tasks.workunit.client.1.smithi087.stdout:5/999: mkdir d3/d9/d9b/d162 0 2024-02-28T16:02:13.571 INFO:tasks.workunit.client.1.smithi087.stdout:0/951: creat d4/dd/d37/f131 x:0 0 0 2024-02-28T16:02:13.573 INFO:tasks.workunit.client.1.smithi087.stdout:1/980: dwrite d0/d14/d3f/dd5/fe1 [0,4194304] 0 2024-02-28T16:02:13.575 INFO:tasks.workunit.client.0.smithi057.stdout:8/488: truncate d5/de/f2b 4694464 0 2024-02-28T16:02:13.578 INFO:tasks.workunit.client.1.smithi087.stdout:0/952: chown d4/dd/d37/d39/d3a/l3f 100 1 2024-02-28T16:02:13.580 INFO:tasks.workunit.client.1.smithi087.stdout:1/981: symlink d0/d14/d3f/l142 0 2024-02-28T16:02:13.581 INFO:tasks.workunit.client.0.smithi057.stdout:7/448: rename d6/dc/d12/d29/l8d to d6/dc/d12/la0 0 2024-02-28T16:02:13.583 INFO:tasks.workunit.client.1.smithi087.stdout:1/982: readlink d0/d14/lab 0 2024-02-28T16:02:13.589 INFO:tasks.workunit.client.1.smithi087.stdout:1/983: mknod d0/d14/c143 0 2024-02-28T16:02:13.591 INFO:tasks.workunit.client.1.smithi087.stdout:0/953: getdents d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58 0 2024-02-28T16:02:13.592 INFO:tasks.workunit.client.1.smithi087.stdout:9/990: dwrite d7/dd/d15/d3f/d6d/dcd/fd9 [0,4194304] 0 2024-02-28T16:02:13.594 INFO:tasks.workunit.client.1.smithi087.stdout:1/984: read - d0/d1a/d124/f141 zero size 2024-02-28T16:02:13.594 INFO:tasks.workunit.client.1.smithi087.stdout:0/954: chown d4/dd/d21/d52/dd1/fe0 2 1 2024-02-28T16:02:13.595 INFO:tasks.workunit.client.0.smithi057.stdout:2/524: dwrite d19/d1d/d26/f91 [0,4194304] 0 2024-02-28T16:02:13.599 INFO:tasks.workunit.client.1.smithi087.stdout:9/991: chown d7/f9b 1869 1 2024-02-28T16:02:13.601 INFO:tasks.workunit.client.1.smithi087.stdout:0/955: fdatasync d4/dd/d37/d39/d3a/dc1/f124 0 2024-02-28T16:02:13.604 INFO:tasks.workunit.client.1.smithi087.stdout:2/986: sync 2024-02-28T16:02:13.604 INFO:tasks.workunit.client.1.smithi087.stdout:1/985: link d0/cf6 d0/d1b/d1f/d71/dad/c144 0 2024-02-28T16:02:13.613 INFO:tasks.workunit.client.1.smithi087.stdout:9/992: write d7/dd/d15/d79/d2e/dbd/fe1 [553419,31940] 0 2024-02-28T16:02:13.623 INFO:tasks.workunit.client.1.smithi087.stdout:7/987: dread d14/f5b [0,4194304] 0 2024-02-28T16:02:13.625 INFO:tasks.workunit.client.1.smithi087.stdout:0/956: truncate d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/ff9 1189427 0 2024-02-28T16:02:13.626 INFO:tasks.workunit.client.1.smithi087.stdout:1/986: dwrite d0/d14/d3f/dd5/f125 [0,4194304] 0 2024-02-28T16:02:13.628 INFO:tasks.workunit.client.1.smithi087.stdout:0/957: stat d4/dd/d21/f71 0 2024-02-28T16:02:13.632 INFO:tasks.workunit.client.1.smithi087.stdout:7/988: mknod d14/d2e/dc0/c133 0 2024-02-28T16:02:13.632 INFO:tasks.workunit.client.1.smithi087.stdout:0/958: mkdir d4/dd/d21/d9b/d7c/d132 0 2024-02-28T16:02:13.634 INFO:tasks.workunit.client.1.smithi087.stdout:1/987: rename d0/d1b/d43/f111 to d0/d1b/d43/d4d/d12c/dfa/f145 0 2024-02-28T16:02:13.635 INFO:tasks.workunit.client.1.smithi087.stdout:9/993: dwrite d7/dd/d99/fe9 [0,4194304] 0 2024-02-28T16:02:13.639 INFO:tasks.workunit.client.1.smithi087.stdout:0/959: mkdir d4/dd/d21/d52/d133 0 2024-02-28T16:02:13.643 INFO:tasks.workunit.client.0.smithi057.stdout:3/502: dread d8/dd/d14/d2c/f95 [0,4194304] 0 2024-02-28T16:02:13.651 INFO:tasks.workunit.client.1.smithi087.stdout:2/987: read d2/d7/dc0/d111/d34/f8d [4184451,112666] 0 2024-02-28T16:02:13.653 INFO:tasks.workunit.client.0.smithi057.stdout:4/525: rmdir d1/d10/d12/d15 39 2024-02-28T16:02:13.653 INFO:tasks.workunit.client.0.smithi057.stdout:5/549: symlink d2/d12/d76/d7a/lc6 0 2024-02-28T16:02:13.654 INFO:tasks.workunit.client.1.smithi087.stdout:1/988: mknod d0/d1b/d1f/d71/db2/dae/d13e/c146 0 2024-02-28T16:02:13.659 INFO:tasks.workunit.client.1.smithi087.stdout:7/989: write d14/d21/de4/fe5 [892467,91835] 0 2024-02-28T16:02:13.662 INFO:tasks.workunit.client.1.smithi087.stdout:8/984: sync 2024-02-28T16:02:13.663 INFO:tasks.workunit.client.1.smithi087.stdout:2/988: creat d2/d42/ddd/d14d/f163 x:0 0 0 2024-02-28T16:02:13.663 INFO:tasks.workunit.client.0.smithi057.stdout:7/449: rename d6/dc/d12/d1a/d4c/d6c to d6/dc/d67/d9a/da1 0 2024-02-28T16:02:13.666 INFO:tasks.workunit.client.0.smithi057.stdout:4/526: chown d1/d10/d12/d2c/d50 77 1 2024-02-28T16:02:13.669 INFO:tasks.workunit.client.0.smithi057.stdout:4/527: stat d1/d10/d31/d86/f23 0 2024-02-28T16:02:13.669 INFO:tasks.workunit.client.0.smithi057.stdout:0/659: dread d6/d12/d17/d34/f76 [0,4194304] 0 2024-02-28T16:02:13.669 INFO:tasks.workunit.client.0.smithi057.stdout:3/503: truncate d8/dd/d14/d2e/d3b/d71/f91 349035 0 2024-02-28T16:02:13.670 INFO:tasks.workunit.client.1.smithi087.stdout:1/989: mkdir d0/d1b/d1f/d71/db2/dae/d147 0 2024-02-28T16:02:13.670 INFO:tasks.workunit.client.1.smithi087.stdout:9/994: dwrite d7/dd/d36/f4f [4194304,4194304] 0 2024-02-28T16:02:13.670 INFO:tasks.workunit.client.1.smithi087.stdout:0/960: truncate d4/d6/dc/d45/fed 1587943 0 2024-02-28T16:02:13.671 INFO:tasks.workunit.client.0.smithi057.stdout:3/504: dread - d8/d94/f98 zero size 2024-02-28T16:02:13.672 INFO:tasks.workunit.client.0.smithi057.stdout:0/660: stat d6/d12/d38/db4/lbc 0 2024-02-28T16:02:13.675 INFO:tasks.workunit.client.1.smithi087.stdout:8/985: mkdir d2/d9/d5e/d9c/d148 0 2024-02-28T16:02:13.675 INFO:tasks.workunit.client.1.smithi087.stdout:2/989: unlink d2/d99/f13b 0 2024-02-28T16:02:13.675 INFO:tasks.workunit.client.1.smithi087.stdout:0/961: dread - d4/dd/d37/d39/d3a/d57/d74/d1f/d60/f109 zero size 2024-02-28T16:02:13.678 INFO:tasks.workunit.client.1.smithi087.stdout:8/986: chown d2/d63/d9b/dd5/dd9/de5 25 1 2024-02-28T16:02:13.680 INFO:tasks.workunit.client.1.smithi087.stdout:0/962: mknod d4/d6/dc/d45/c134 0 2024-02-28T16:02:13.682 INFO:tasks.workunit.client.1.smithi087.stdout:9/995: creat d7/dd/d99/f12b x:0 0 0 2024-02-28T16:02:13.683 INFO:tasks.workunit.client.0.smithi057.stdout:1/566: creat d1/d21/d66/d53/d7d/d67/d7a/d94/fba x:0 0 0 2024-02-28T16:02:13.683 INFO:tasks.workunit.client.0.smithi057.stdout:6/507: link df/d14/d15/l57 df/d10/la9 0 2024-02-28T16:02:13.684 INFO:tasks.workunit.client.1.smithi087.stdout:8/987: creat d2/d18/df5/f149 x:0 0 0 2024-02-28T16:02:13.685 INFO:tasks.workunit.client.0.smithi057.stdout:5/550: creat d2/d12/d5f/fc7 x:0 0 0 2024-02-28T16:02:13.685 INFO:tasks.workunit.client.1.smithi087.stdout:9/996: fsync d7/dd/d15/d3f/d5f/d90/dfe/f10b 0 2024-02-28T16:02:13.686 INFO:tasks.workunit.client.1.smithi087.stdout:2/990: getdents d2/d7/dc0/d111/d34/daf 0 2024-02-28T16:02:13.686 INFO:tasks.workunit.client.0.smithi057.stdout:7/450: mknod d6/dc/d67/d9a/ca2 0 2024-02-28T16:02:13.689 INFO:tasks.workunit.client.0.smithi057.stdout:4/528: rename d1/d10/d12/c2d to d1/d3f/caf 0 2024-02-28T16:02:13.689 INFO:tasks.workunit.client.1.smithi087.stdout:2/991: chown d2/d42/d4b/d14f/da6 176260 1 2024-02-28T16:02:13.693 INFO:tasks.workunit.client.1.smithi087.stdout:9/997: symlink d7/d1e/d44/d83/db0/l12c 0 2024-02-28T16:02:13.693 INFO:tasks.workunit.client.1.smithi087.stdout:9/998: chown d7/d1e 101505007 1 2024-02-28T16:02:13.694 INFO:tasks.workunit.client.1.smithi087.stdout:8/988: creat d2/d63/d9b/dd5/dd9/de5/d111/d11a/d11b/f14a x:0 0 0 2024-02-28T16:02:13.698 INFO:tasks.workunit.client.0.smithi057.stdout:5/551: rename d2/d8/fb to d2/d15/fc8 0 2024-02-28T16:02:13.702 INFO:tasks.workunit.client.1.smithi087.stdout:9/999: dread d7/d1e/f24 [4194304,4194304] 0 2024-02-28T16:02:13.705 INFO:tasks.workunit.client.0.smithi057.stdout:2/525: link d19/d3a/l74 d19/d1d/d89/lad 0 2024-02-28T16:02:13.706 INFO:tasks.workunit.client.0.smithi057.stdout:5/552: symlink d2/d15/d5e/d9a/dac/lc9 0 2024-02-28T16:02:13.707 INFO:tasks.workunit.client.0.smithi057.stdout:0/661: getdents d6/d12/d38/da3 0 2024-02-28T16:02:13.707 INFO:tasks.workunit.client.0.smithi057.stdout:7/451: dwrite d6/dc/f18 [8388608,4194304] 0 2024-02-28T16:02:13.709 INFO:tasks.workunit.client.0.smithi057.stdout:0/662: chown d6/f2f 121869764 1 2024-02-28T16:02:13.711 INFO:tasks.workunit.client.0.smithi057.stdout:2/526: rename d19/d1d/d2e/l41 to d19/d1d/d2e/d31/lae 0 2024-02-28T16:02:13.713 INFO:tasks.workunit.client.0.smithi057.stdout:7/452: creat d6/d38/fa3 x:0 0 0 2024-02-28T16:02:13.714 INFO:tasks.workunit.client.1.smithi087.stdout:7/990: dwrite d14/d2e/fa7 [4194304,4194304] 0 2024-02-28T16:02:13.714 INFO:tasks.workunit.client.1.smithi087.stdout:2/992: dwrite d2/d42/ddd/f157 [0,4194304] 0 2024-02-28T16:02:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:13 smithi087 ceph-mon[37122]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:13 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/4235492838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:02:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:13 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/466244292' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:02:13.715 INFO:tasks.workunit.client.0.smithi057.stdout:5/553: dread d2/d15/d3b/f59 [0,4194304] 0 2024-02-28T16:02:13.717 INFO:tasks.workunit.client.0.smithi057.stdout:0/663: rename d6/d12/d38/da3/cbe to d6/d12/d17/d4b/d60/d6b/ce0 0 2024-02-28T16:02:13.719 INFO:tasks.workunit.client.0.smithi057.stdout:2/527: creat d19/d1d/d2e/d3c/dab/faf x:0 0 0 2024-02-28T16:02:13.720 INFO:tasks.workunit.client.1.smithi087.stdout:7/991: mknod d14/d2e/d2b/d4e/c134 0 2024-02-28T16:02:13.722 INFO:tasks.workunit.client.0.smithi057.stdout:7/453: rename d6/dc/d35/f51 to d6/dc/d67/d9a/da1/fa4 0 2024-02-28T16:02:13.723 INFO:tasks.workunit.client.1.smithi087.stdout:2/993: link d2/d7/dc0/d111/d34/d88/f119 d2/d42/df1/f164 0 2024-02-28T16:02:13.723 INFO:tasks.workunit.client.0.smithi057.stdout:7/454: chown d6/dc/f96 41 1 2024-02-28T16:02:13.725 INFO:tasks.workunit.client.1.smithi087.stdout:2/994: readlink d2/d99/d28/d79/l149 0 2024-02-28T16:02:13.726 INFO:tasks.workunit.client.0.smithi057.stdout:2/528: creat d19/d3a/fb0 x:0 0 0 2024-02-28T16:02:13.727 INFO:tasks.workunit.client.0.smithi057.stdout:5/554: creat d2/d3e/fca x:0 0 0 2024-02-28T16:02:13.728 INFO:tasks.workunit.client.0.smithi057.stdout:0/664: creat d6/d12/d38/da3/fe1 x:0 0 0 2024-02-28T16:02:13.729 INFO:tasks.workunit.client.0.smithi057.stdout:7/455: creat d6/dc/d67/fa5 x:0 0 0 2024-02-28T16:02:13.734 INFO:tasks.workunit.client.1.smithi087.stdout:2/995: creat d2/d7/dc0/d111/d34/d88/f165 x:0 0 0 2024-02-28T16:02:13.739 INFO:tasks.workunit.client.1.smithi087.stdout:8/989: dread d2/d9/d5e/d9c/d9f/fde [0,4194304] 0 2024-02-28T16:02:13.740 INFO:tasks.workunit.client.1.smithi087.stdout:2/996: creat d2/d99/d28/d79/d9f/de1/f166 x:0 0 0 2024-02-28T16:02:13.741 INFO:tasks.workunit.client.1.smithi087.stdout:2/997: stat d2/d99/dc7/de2/de4/d11b/f13d 0 2024-02-28T16:02:13.742 INFO:tasks.workunit.client.1.smithi087.stdout:8/990: fsync d2/d9/d8e/faf 0 2024-02-28T16:02:13.744 INFO:tasks.workunit.client.1.smithi087.stdout:8/991: chown d2/d9/d5e/dbc 732201122 1 2024-02-28T16:02:13.747 INFO:tasks.workunit.client.0.smithi057.stdout:3/505: write d8/dd/d19/d25/f2b [500641,100733] 0 2024-02-28T16:02:13.750 INFO:tasks.workunit.client.0.smithi057.stdout:4/529: write d1/d10/d31/d86/f33 [1100861,10337] 0 2024-02-28T16:02:13.752 INFO:tasks.workunit.client.0.smithi057.stdout:1/567: write d1/f8a [4954082,58491] 0 2024-02-28T16:02:13.753 INFO:tasks.workunit.client.0.smithi057.stdout:3/506: mkdir d8/dd/d14/d2e/d76/da1 0 2024-02-28T16:02:13.756 INFO:tasks.workunit.client.0.smithi057.stdout:4/530: truncate d1/d10/d12/d2c/d37/f4e 231948 0 2024-02-28T16:02:13.757 INFO:tasks.workunit.client.1.smithi087.stdout:7/992: write d14/d21/f42 [1848443,91096] 0 2024-02-28T16:02:13.759 INFO:tasks.workunit.client.1.smithi087.stdout:2/998: write d2/d99/fe7 [490431,37250] 0 2024-02-28T16:02:13.762 INFO:tasks.workunit.client.1.smithi087.stdout:2/999: rmdir d2/d99/d28/d79 39 2024-02-28T16:02:13.764 INFO:tasks.workunit.client.0.smithi057.stdout:6/508: truncate df/d10/d78/d5b/f8f 849616 0 2024-02-28T16:02:13.764 INFO:tasks.workunit.client.0.smithi057.stdout:3/507: mkdir d8/dd/d14/d2e/d2f/da2 0 2024-02-28T16:02:13.766 INFO:tasks.workunit.client.0.smithi057.stdout:4/531: write d1/d10/d12/d15/d19/f2b [4602869,4526] 0 2024-02-28T16:02:13.768 INFO:tasks.workunit.client.1.smithi087.stdout:8/992: dwrite d2/d18/df5/d104/f44 [0,4194304] 0 2024-02-28T16:02:13.771 INFO:tasks.workunit.client.1.smithi087.stdout:7/993: link d14/d2e/d89/dbd/f124 d14/d2e/d89/deb/d5d/d6a/f135 0 2024-02-28T16:02:13.771 INFO:tasks.workunit.client.1.smithi087.stdout:7/994: readlink d14/d46/d7c/df2/l12d 0 2024-02-28T16:02:13.773 INFO:tasks.workunit.client.1.smithi087.stdout:8/993: getdents d2/d9/d5e/d9c/d9f 0 2024-02-28T16:02:13.774 INFO:tasks.workunit.client.1.smithi087.stdout:8/994: chown d2/d33 171951146 1 2024-02-28T16:02:13.774 INFO:tasks.workunit.client.0.smithi057.stdout:1/568: dread d1/d3/dc/d15/f17 [0,4194304] 0 2024-02-28T16:02:13.778 INFO:tasks.workunit.client.0.smithi057.stdout:0/665: write d6/d12/d45/f9a [999102,27095] 0 2024-02-28T16:02:13.782 INFO:tasks.workunit.client.0.smithi057.stdout:4/532: link d1/d10/d12/d2c/d50/c49 d1/d10/d12/d2c/d50/cb0 0 2024-02-28T16:02:13.783 INFO:tasks.workunit.client.0.smithi057.stdout:1/569: rename d1/d3/dc/d40/f88 to d1/d3/dc/d15/d4e/d5f/fbb 0 2024-02-28T16:02:13.788 INFO:tasks.workunit.client.1.smithi087.stdout:7/995: dwrite d14/d2e/d89/fde [0,4194304] 0 2024-02-28T16:02:13.789 INFO:tasks.workunit.client.0.smithi057.stdout:0/666: write d6/d12/d17/d58/d95/daf/fc2 [1660914,56335] 0 2024-02-28T16:02:13.789 INFO:tasks.workunit.client.0.smithi057.stdout:6/509: write df/f53 [1026028,38996] 0 2024-02-28T16:02:13.792 INFO:tasks.workunit.client.1.smithi087.stdout:8/995: write d2/d18/d42/d62/f7e [615406,63360] 0 2024-02-28T16:02:13.796 INFO:tasks.workunit.client.0.smithi057.stdout:4/533: write d1/d10/d12/d2c/d50/d93/fa7 [901054,53224] 0 2024-02-28T16:02:13.797 INFO:tasks.workunit.client.1.smithi087.stdout:8/996: mknod d2/d9/d10/da0/c14b 0 2024-02-28T16:02:13.797 INFO:tasks.workunit.client.1.smithi087.stdout:7/996: symlink d14/d46/d7c/l136 0 2024-02-28T16:02:13.797 INFO:tasks.workunit.client.0.smithi057.stdout:0/667: mkdir d6/d12/d17/d34/de2 0 2024-02-28T16:02:13.797 INFO:tasks.workunit.client.0.smithi057.stdout:1/570: creat d1/d21/d66/d53/fbc x:0 0 0 2024-02-28T16:02:13.799 INFO:tasks.workunit.client.0.smithi057.stdout:2/529: dwrite d19/d2c/d48/f75 [0,4194304] 0 2024-02-28T16:02:13.801 INFO:tasks.workunit.client.0.smithi057.stdout:6/510: creat df/d14/d15/d16/d97/faa x:0 0 0 2024-02-28T16:02:13.801 INFO:tasks.workunit.client.0.smithi057.stdout:7/456: dwrite d6/dc/d12/f2d [0,4194304] 0 2024-02-28T16:02:13.801 INFO:tasks.workunit.client.0.smithi057.stdout:4/534: readlink d1/d22/l51 0 2024-02-28T16:02:13.802 INFO:tasks.workunit.client.1.smithi087.stdout:7/997: unlink d14/d2e/d89/deb/d5d/f70 0 2024-02-28T16:02:13.806 INFO:tasks.workunit.client.1.smithi087.stdout:8/997: write d2/d9/d10/f3a [608166,53741] 0 2024-02-28T16:02:13.806 INFO:tasks.workunit.client.0.smithi057.stdout:4/535: fsync d1/d10/d12/d15/d19/f2b 0 2024-02-28T16:02:13.807 INFO:tasks.workunit.client.1.smithi087.stdout:8/998: stat d2/d9/l39 0 2024-02-28T16:02:13.813 INFO:tasks.workunit.client.1.smithi087.stdout:8/999: mkdir d2/d18/df5/d14c 0 2024-02-28T16:02:13.813 INFO:tasks.workunit.client.0.smithi057.stdout:6/511: unlink df/d14/d15/d16/f63 0 2024-02-28T16:02:13.815 INFO:tasks.workunit.client.1.smithi087.stdout:7/998: write d14/d7d/fad [1095157,22501] 0 2024-02-28T16:02:13.818 INFO:tasks.workunit.client.0.smithi057.stdout:1/571: creat d1/d3/dc/d15/da3/fbd x:0 0 0 2024-02-28T16:02:13.820 INFO:tasks.workunit.client.0.smithi057.stdout:0/668: truncate d6/f41 586746 0 2024-02-28T16:02:13.824 INFO:tasks.workunit.client.0.smithi057.stdout:6/512: rename df/d10/ca6 to df/d14/d15/d16/cab 0 2024-02-28T16:02:13.827 INFO:tasks.workunit.client.0.smithi057.stdout:7/457: dwrite d6/dc/d35/d58/f9e [0,4194304] 0 2024-02-28T16:02:13.829 INFO:tasks.workunit.client.0.smithi057.stdout:7/458: chown d6/dc/d35/f83 8474 1 2024-02-28T16:02:13.835 INFO:tasks.workunit.client.0.smithi057.stdout:1/572: truncate d1/d3/dc/f69 2738381 0 2024-02-28T16:02:13.836 INFO:tasks.workunit.client.0.smithi057.stdout:6/513: truncate df/d14/d15/f25 2503604 0 2024-02-28T16:02:13.836 INFO:tasks.workunit.client.0.smithi057.stdout:2/530: write d19/d1d/d2e/f9f [328726,98146] 0 2024-02-28T16:02:13.837 INFO:tasks.workunit.client.0.smithi057.stdout:6/514: readlink l1 0 2024-02-28T16:02:13.837 INFO:tasks.workunit.client.0.smithi057.stdout:7/459: mkdir d6/dc/d35/da6 0 2024-02-28T16:02:13.848 INFO:tasks.workunit.client.0.smithi057.stdout:6/515: creat df/d14/d15/d16/d39/fac x:0 0 0 2024-02-28T16:02:13.851 INFO:tasks.workunit.client.0.smithi057.stdout:1/573: getdents d1/d21/d66/d53 0 2024-02-28T16:02:13.857 INFO:tasks.workunit.client.0.smithi057.stdout:6/516: rename df/d14/d15/d16/d97 to df/d14/d15/d16/d39/d92/da4/dad 0 2024-02-28T16:02:13.857 INFO:tasks.workunit.client.0.smithi057.stdout:1/574: chown d1/d21/d66/d53/cb7 5 1 2024-02-28T16:02:13.857 INFO:tasks.workunit.client.1.smithi087.stdout:7/999: dread d14/d21/f32 [0,4194304] 0 2024-02-28T16:02:13.863 INFO:tasks.workunit.client.1.smithi087.stdout:1/990: sync 2024-02-28T16:02:13.867 INFO:tasks.workunit.client.0.smithi057.stdout:7/460: write f4 [5128275,3778] 0 2024-02-28T16:02:13.867 INFO:tasks.workunit.client.1.smithi087.stdout:1/991: chown d0/d1b/d1f/d71/db2/c21 0 1 2024-02-28T16:02:13.867 INFO:tasks.workunit.client.0.smithi057.stdout:2/531: write d19/d1d/f3f [4776161,36521] 0 2024-02-28T16:02:13.870 INFO:tasks.workunit.client.0.smithi057.stdout:6/517: write df/d10/f36 [2941227,112480] 0 2024-02-28T16:02:13.873 INFO:tasks.workunit.client.1.smithi087.stdout:1/992: write d0/d1b/d43/d4d/d12c/d63/fc3 [349384,118702] 0 2024-02-28T16:02:13.874 INFO:tasks.workunit.client.0.smithi057.stdout:7/461: mknod d6/dc/d87/ca7 0 2024-02-28T16:02:13.878 INFO:tasks.workunit.client.0.smithi057.stdout:2/532: write d19/d3a/f98 [8119131,32633] 0 2024-02-28T16:02:13.879 INFO:tasks.workunit.client.1.smithi087.stdout:1/993: rename d0/d14/d3f/l142 to d0/d1b/d1f/d71/db2/db3/dda/l148 0 2024-02-28T16:02:13.880 INFO:tasks.workunit.client.0.smithi057.stdout:6/518: chown df/d10/d13/d4b/d4e/f86 3632 1 2024-02-28T16:02:13.881 INFO:tasks.workunit.client.0.smithi057.stdout:1/575: dwrite d1/d3/dc/d15/f3c [4194304,4194304] 0 2024-02-28T16:02:13.881 INFO:tasks.workunit.client.0.smithi057.stdout:7/462: chown d6/dc/f18 1350117804 1 2024-02-28T16:02:13.882 INFO:tasks.workunit.client.1.smithi087.stdout:1/994: dread - d0/d14/d48/da7/df4/f116 zero size 2024-02-28T16:02:13.884 INFO:tasks.workunit.client.0.smithi057.stdout:0/669: dwrite d6/d12/d38/d5e/f48 [4194304,4194304] 0 2024-02-28T16:02:13.887 INFO:tasks.workunit.client.0.smithi057.stdout:1/576: chown d1/d21/l2c 39164 1 2024-02-28T16:02:13.895 INFO:tasks.workunit.client.0.smithi057.stdout:1/577: mkdir d1/d3/dc/d15/d4e/d5f/dbe 0 2024-02-28T16:02:13.900 INFO:tasks.workunit.client.1.smithi087.stdout:1/995: dwrite d0/d1a/feb [0,4194304] 0 2024-02-28T16:02:13.902 INFO:tasks.workunit.client.0.smithi057.stdout:1/578: symlink d1/d3/dc/lbf 0 2024-02-28T16:02:13.914 INFO:tasks.workunit.client.0.smithi057.stdout:6/519: dwrite df/d14/d15/d16/f46 [0,4194304] 0 2024-02-28T16:02:13.920 INFO:tasks.workunit.client.0.smithi057.stdout:2/533: dwrite d19/d1d/d2e/f9c [0,4194304] 0 2024-02-28T16:02:13.923 INFO:tasks.workunit.client.0.smithi057.stdout:6/520: creat df/d14/d15/d16/d39/fae x:0 0 0 2024-02-28T16:02:13.924 INFO:tasks.workunit.client.1.smithi087.stdout:1/996: dread d0/d1b/d1f/d71/db2/d24/d5c/d69/f7c [0,4194304] 0 2024-02-28T16:02:13.925 INFO:tasks.workunit.client.0.smithi057.stdout:7/463: dread d6/f14 [0,4194304] 0 2024-02-28T16:02:13.926 INFO:tasks.workunit.client.1.smithi087.stdout:1/997: chown d0/d1b/d1f/d71/fe4 80758 1 2024-02-28T16:02:13.930 INFO:tasks.workunit.client.1.smithi087.stdout:1/998: creat d0/d1b/d43/de3/f149 x:0 0 0 2024-02-28T16:02:13.932 INFO:tasks.workunit.client.0.smithi057.stdout:7/464: write d6/dc/d35/f83 [2994043,6794] 0 2024-02-28T16:02:13.933 INFO:tasks.workunit.client.0.smithi057.stdout:0/670: dread d6/f8 [0,4194304] 0 2024-02-28T16:02:13.934 INFO:tasks.workunit.client.0.smithi057.stdout:2/534: mkdir d19/d1d/d2e/d31/db1 0 2024-02-28T16:02:13.941 INFO:tasks.workunit.client.1.smithi087.stdout:1/999: creat d0/d1b/d1f/d71/db2/db3/dda/d126/f14a x:0 0 0 2024-02-28T16:02:13.946 INFO:tasks.workunit.client.1.smithi087.stdout:0/963: sync 2024-02-28T16:02:13.950 INFO:tasks.workunit.client.1.smithi087.stdout:0/964: creat d4/dd/d37/d39/d3a/f135 x:0 0 0 2024-02-28T16:02:13.954 INFO:tasks.workunit.client.0.smithi057.stdout:2/535: dread d19/f23 [8388608,4194304] 0 2024-02-28T16:02:13.954 INFO:tasks.workunit.client.0.smithi057.stdout:7/465: dwrite d6/dc/d12/d1a/d4c/d63/f85 [0,4194304] 0 2024-02-28T16:02:13.955 INFO:tasks.workunit.client.0.smithi057.stdout:2/536: readlink d19/d43/l5f 0 2024-02-28T16:02:13.959 INFO:tasks.workunit.client.0.smithi057.stdout:7/466: mkdir d6/dc/d67/d9a/da1/da8 0 2024-02-28T16:02:13.962 INFO:tasks.workunit.client.0.smithi057.stdout:7/467: unlink d6/d26/l9b 0 2024-02-28T16:02:13.963 INFO:tasks.workunit.client.1.smithi087.stdout:0/965: dwrite d4/f89 [0,4194304] 0 2024-02-28T16:02:13.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.973+0000 7f6bbbe00700 1 -- 172.21.15.57:0/1238114531 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bb4116050 con 0x7f6b9c06b480 2024-02-28T16:02:13.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.974+0000 7f6bb1600700 1 -- 172.21.15.57:0/1238114531 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f6bb4116050 con 0x7f6b9c06b480 2024-02-28T16:02:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:02:13.967 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:02:13.967 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:02:13.967 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:02:13.967 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [], 2024-02-28T16:02:13.967 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "1/21 daemons upgraded", 2024-02-28T16:02:13.967 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "", 2024-02-28T16:02:13.967 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:02:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:02:13.971 INFO:tasks.workunit.client.1.smithi087.stdout:0/966: rmdir d4/dd/d21/d52/d110 0 2024-02-28T16:02:13.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.978+0000 7f6bbbe00700 1 -- 172.21.15.57:0/1238114531 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f6b9c06b480 msgr2=0x7f6b9c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.978+0000 7f6bbbe00700 1 --2- 172.21.15.57:0/1238114531 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f6b9c06b480 0x7f6b9c06d930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800b840 tx=0x7f6ba8009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.978+0000 7f6bbbe00700 1 -- 172.21.15.57:0/1238114531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb40fe0e0 msgr2=0x7f6bb4114580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.978+0000 7f6bbbe00700 1 --2- 172.21.15.57:0/1238114531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb40fe0e0 0x7f6bb4114580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000b580 tx=0x7f6ba00091a0 comp rx=0 tx=0).stop 2024-02-28T16:02:13.973 INFO:tasks.workunit.client.0.smithi057.stdout:2/537: dwrite d19/d1d/d2e/d3c/f79 [4194304,4194304] 0 2024-02-28T16:02:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.978+0000 7f6bbbe00700 1 -- 172.21.15.57:0/1238114531 shutdown_connections 2024-02-28T16:02:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.978+0000 7f6bbbe00700 1 --2- 172.21.15.57:0/1238114531 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f6b9c06b480 0x7f6b9c06d930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:13.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.978+0000 7f6bbbe00700 1 --2- 172.21.15.57:0/1238114531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb40fcef0 0x7f6bb4114040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:13.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.978+0000 7f6bbbe00700 1 --2- 172.21.15.57:0/1238114531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb40fe0e0 0x7f6bb4114580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:13.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.978+0000 7f6bbbe00700 1 -- 172.21.15.57:0/1238114531 >> 172.21.15.57:0/1238114531 conn(0x7f6bb40f8620 msgr2=0x7f6bb40ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:13.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.979+0000 7f6bbbe00700 1 -- 172.21.15.57:0/1238114531 shutdown_connections 2024-02-28T16:02:13.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:13.979+0000 7f6bbbe00700 1 -- 172.21.15.57:0/1238114531 wait complete. 2024-02-28T16:02:13.976 INFO:tasks.workunit.client.1.smithi087.stdout:0/967: truncate d4/dd/d37/d39/fca 841284 0 2024-02-28T16:02:13.978 INFO:tasks.workunit.client.1.smithi087.stdout:0/968: fsync d4/dd/f1b 0 2024-02-28T16:02:13.979 INFO:tasks.workunit.client.0.smithi057.stdout:2/538: mkdir d19/d1d/db2 0 2024-02-28T16:02:13.985 INFO:tasks.workunit.client.0.smithi057.stdout:2/539: creat d19/d43/d5a/d70/fb3 x:0 0 0 2024-02-28T16:02:13.986 INFO:tasks.workunit.client.0.smithi057.stdout:1/579: getdents d1/d3/dc 0 2024-02-28T16:02:13.991 INFO:tasks.workunit.client.1.smithi087.stdout:0/969: fdatasync d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/ff9 0 2024-02-28T16:02:13.992 INFO:tasks.workunit.client.0.smithi057.stdout:1/580: write d1/d3/dc/f12 [4366883,12930] 0 2024-02-28T16:02:13.994 INFO:tasks.workunit.client.1.smithi087.stdout:0/970: symlink d4/dd/d21/d9b/d7c/d132/l136 0 2024-02-28T16:02:13.999 INFO:tasks.workunit.client.0.smithi057.stdout:6/521: dwrite df/d10/d78/d5b/f8f [0,4194304] 0 2024-02-28T16:02:14.000 INFO:tasks.workunit.client.1.smithi087.stdout:0/971: rmdir d4/dd/d21 39 2024-02-28T16:02:14.001 INFO:tasks.workunit.client.0.smithi057.stdout:1/581: chown d1/d21/d66/d53/d7d/d65/fa5 1967698 1 2024-02-28T16:02:14.001 INFO:tasks.workunit.client.0.smithi057.stdout:0/671: dwrite d6/d12/d17/d58/f6e [0,4194304] 0 2024-02-28T16:02:14.003 INFO:tasks.workunit.client.0.smithi057.stdout:2/540: write d19/d43/d5a/f96 [3678455,43487] 0 2024-02-28T16:02:14.005 INFO:tasks.workunit.client.1.smithi087.stdout:0/972: truncate d4/d6/d9c/fb5 9762 0 2024-02-28T16:02:14.008 INFO:tasks.workunit.client.0.smithi057.stdout:7/468: dwrite d6/dc/d35/f6a [0,4194304] 0 2024-02-28T16:02:14.010 INFO:tasks.workunit.client.1.smithi087.stdout:0/973: creat d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/db6/f137 x:0 0 0 2024-02-28T16:02:14.014 INFO:tasks.workunit.client.0.smithi057.stdout:7/469: chown d6/dc/f10 636535902 1 2024-02-28T16:02:14.015 INFO:tasks.workunit.client.0.smithi057.stdout:2/541: mknod d19/d1d/d2e/d3c/cb4 0 2024-02-28T16:02:14.016 INFO:tasks.workunit.client.0.smithi057.stdout:6/522: write df/d14/d15/d16/d39/d92/da4/dad/faa [44477,28590] 0 2024-02-28T16:02:14.019 INFO:tasks.workunit.client.0.smithi057.stdout:7/470: write d6/dc/d12/f2d [2088317,48641] 0 2024-02-28T16:02:14.025 INFO:tasks.workunit.client.0.smithi057.stdout:0/672: write d6/fa6 [761222,78179] 0 2024-02-28T16:02:14.027 INFO:tasks.workunit.client.0.smithi057.stdout:6/523: read df/d14/d15/d16/f49 [1870463,42515] 0 2024-02-28T16:02:14.029 INFO:tasks.workunit.client.0.smithi057.stdout:0/673: fdatasync d6/d12/d5d/d71/daa/fcb 0 2024-02-28T16:02:14.029 INFO:tasks.workunit.client.0.smithi057.stdout:6/524: readlink df/d10/d78/d5b/d7b/la0 0 2024-02-28T16:02:14.034 INFO:tasks.workunit.client.0.smithi057.stdout:0/674: mkdir d6/d12/d45/d55/de3 0 2024-02-28T16:02:14.034 INFO:tasks.workunit.client.0.smithi057.stdout:6/525: chown df/d10/d4f/c50 170 1 2024-02-28T16:02:14.038 INFO:tasks.workunit.client.0.smithi057.stdout:6/526: mknod df/d10/d4f/caf 0 2024-02-28T16:02:14.042 INFO:tasks.workunit.client.0.smithi057.stdout:1/582: dwrite d1/d21/d66/d44/d4c/f5e [0,4194304] 0 2024-02-28T16:02:14.047 INFO:tasks.workunit.client.0.smithi057.stdout:6/527: mknod df/d10/d78/d5b/d7b/cb0 0 2024-02-28T16:02:14.059 INFO:tasks.workunit.client.0.smithi057.stdout:0/675: dwrite d6/d12/d38/f93 [4194304,4194304] 0 2024-02-28T16:02:14.061 INFO:tasks.workunit.client.0.smithi057.stdout:1/583: dread d1/d21/d25/f95 [0,4194304] 0 2024-02-28T16:02:14.063 INFO:tasks.workunit.client.0.smithi057.stdout:7/471: dread d6/dc/d12/d29/f3e [0,4194304] 0 2024-02-28T16:02:14.067 INFO:tasks.workunit.client.0.smithi057.stdout:7/472: fsync d6/dc/f43 0 2024-02-28T16:02:14.068 INFO:tasks.workunit.client.0.smithi057.stdout:7/473: stat d6/dc/d12/d1a/l48 0 2024-02-28T16:02:14.074 INFO:tasks.workunit.client.0.smithi057.stdout:7/474: write d6/dc/d12/d1a/d4c/d63/f80 [4192823,89987] 0 2024-02-28T16:02:14.077 INFO:tasks.workunit.client.0.smithi057.stdout:7/475: stat d6/dc/d12/d1a/d4d/d5a/f7b 0 2024-02-28T16:02:14.085 INFO:tasks.workunit.client.0.smithi057.stdout:7/476: write d6/dc/d12/d1a/f37 [383370,8584] 0 2024-02-28T16:02:14.090 INFO:tasks.workunit.client.0.smithi057.stdout:7/477: rmdir d6/dc/d12/d29 39 2024-02-28T16:02:14.090 INFO:tasks.workunit.client.0.smithi057.stdout:1/584: dread d1/d3/dc/f69 [0,4194304] 0 2024-02-28T16:02:14.093 INFO:tasks.workunit.client.0.smithi057.stdout:6/528: dread df/d14/d15/d16/f49 [0,4194304] 0 2024-02-28T16:02:14.093 INFO:tasks.workunit.client.0.smithi057.stdout:1/585: mknod d1/d21/d66/cc0 0 2024-02-28T16:02:14.093 INFO:tasks.workunit.client.0.smithi057.stdout:7/478: symlink d6/dc/la9 0 2024-02-28T16:02:14.095 INFO:tasks.workunit.client.0.smithi057.stdout:6/529: read - df/d10/d78/d5b/d7b/f8c zero size 2024-02-28T16:02:14.097 INFO:tasks.workunit.client.0.smithi057.stdout:1/586: truncate d1/d21/d66/d53/fbc 88388 0 2024-02-28T16:02:14.099 INFO:tasks.workunit.client.0.smithi057.stdout:7/479: getdents d6/dc/d12/d1a/d4d 0 2024-02-28T16:02:14.100 INFO:tasks.workunit.client.0.smithi057.stdout:1/587: stat d1/d21/d66/d44/l4b 0 2024-02-28T16:02:14.102 INFO:tasks.workunit.client.0.smithi057.stdout:6/530: rename df/d14/d15/d16/d39/f59 to df/d10/fb1 0 2024-02-28T16:02:14.103 INFO:tasks.workunit.client.0.smithi057.stdout:7/480: symlink d6/dc/d35/da6/laa 0 2024-02-28T16:02:14.104 INFO:tasks.workunit.client.0.smithi057.stdout:6/531: chown df/d61/f62 2 1 2024-02-28T16:02:14.104 INFO:tasks.workunit.client.0.smithi057.stdout:1/588: mknod d1/d21/d66/d44/d4c/d75/cc1 0 2024-02-28T16:02:14.105 INFO:tasks.workunit.client.0.smithi057.stdout:7/481: write d6/dc/f43 [3042906,92712] 0 2024-02-28T16:02:14.107 INFO:tasks.workunit.client.0.smithi057.stdout:7/482: fsync d6/dc/d12/f47 0 2024-02-28T16:02:14.109 INFO:tasks.workunit.client.0.smithi057.stdout:6/532: fdatasync df/d14/d15/d16/f49 0 2024-02-28T16:02:14.111 INFO:tasks.workunit.client.0.smithi057.stdout:1/589: creat d1/d3/dc/d15/d4e/d5f/fc2 x:0 0 0 2024-02-28T16:02:14.113 INFO:tasks.workunit.client.0.smithi057.stdout:7/483: readlink d6/dc/d12/la0 0 2024-02-28T16:02:14.114 INFO:tasks.workunit.client.0.smithi057.stdout:6/533: mkdir df/d14/d15/d82/db2 0 2024-02-28T16:02:14.114 INFO:tasks.workunit.client.0.smithi057.stdout:7/484: read - d6/dc/d67/fa5 zero size 2024-02-28T16:02:14.118 INFO:tasks.workunit.client.0.smithi057.stdout:6/534: creat df/d10/d13/fb3 x:0 0 0 2024-02-28T16:02:14.123 INFO:tasks.workunit.client.0.smithi057.stdout:1/590: rmdir d1/d21/d86 0 2024-02-28T16:02:14.125 INFO:tasks.workunit.client.0.smithi057.stdout:1/591: fdatasync d1/d3/dc/d15/f3c 0 2024-02-28T16:02:14.131 INFO:tasks.workunit.client.0.smithi057.stdout:1/592: creat d1/d21/d66/d53/d62/d6f/fc3 x:0 0 0 2024-02-28T16:02:14.131 INFO:tasks.workunit.client.0.smithi057.stdout:6/535: write df/d61/f62 [274990,68740] 0 2024-02-28T16:02:14.132 INFO:tasks.workunit.client.0.smithi057.stdout:6/536: dread - df/d14/f98 zero size 2024-02-28T16:02:14.134 INFO:tasks.workunit.client.0.smithi057.stdout:1/593: unlink d1/d21/d66/d44/cb6 0 2024-02-28T16:02:14.136 INFO:tasks.workunit.client.0.smithi057.stdout:6/537: rmdir df/d10/d13/d4b/d4e 39 2024-02-28T16:02:14.137 INFO:tasks.workunit.client.0.smithi057.stdout:7/485: dread d6/dc/d67/f8a [0,4194304] 0 2024-02-28T16:02:14.138 INFO:tasks.workunit.client.0.smithi057.stdout:6/538: unlink f6 0 2024-02-28T16:02:14.140 INFO:tasks.workunit.client.0.smithi057.stdout:7/486: fsync d6/dc/d35/d58/f9e 0 2024-02-28T16:02:14.141 INFO:tasks.workunit.client.0.smithi057.stdout:7/487: stat d6/f28 0 2024-02-28T16:02:14.142 INFO:tasks.workunit.client.0.smithi057.stdout:6/539: unlink f9 0 2024-02-28T16:02:14.144 INFO:tasks.workunit.client.0.smithi057.stdout:6/540: write df/f53 [33136,46094] 0 2024-02-28T16:02:14.144 INFO:tasks.workunit.client.0.smithi057.stdout:7/488: chown d6/d26/f86 1 1 2024-02-28T16:02:14.144 INFO:tasks.workunit.client.0.smithi057.stdout:1/594: link d1/d21/c37 d1/d3/dc/d15/cc4 0 2024-02-28T16:02:14.147 INFO:tasks.workunit.client.0.smithi057.stdout:1/595: chown d1/d21/d66/d53/d7d/d67/d7a/d92/f9d 28153399 1 2024-02-28T16:02:14.149 INFO:tasks.workunit.client.0.smithi057.stdout:6/541: rmdir df/d14 39 2024-02-28T16:02:14.151 INFO:tasks.workunit.client.0.smithi057.stdout:6/542: dread - df/d10/d13/fb3 zero size 2024-02-28T16:02:14.153 INFO:tasks.workunit.client.0.smithi057.stdout:1/596: fsync d1/d3/dc/d15/d4e/d57/f77 0 2024-02-28T16:02:14.158 INFO:tasks.workunit.client.0.smithi057.stdout:6/543: symlink df/d10/d78/d5b/d7b/lb4 0 2024-02-28T16:02:14.161 INFO:tasks.workunit.client.0.smithi057.stdout:7/489: write d6/f14 [2954410,92919] 0 2024-02-28T16:02:14.163 INFO:tasks.workunit.client.0.smithi057.stdout:1/597: creat d1/d21/d25/fc5 x:0 0 0 2024-02-28T16:02:14.164 INFO:tasks.workunit.client.0.smithi057.stdout:7/490: stat d6/dc/d35/d58/c7e 0 2024-02-28T16:02:14.165 INFO:tasks.workunit.client.0.smithi057.stdout:7/491: chown d6/d38/l55 783 1 2024-02-28T16:02:14.165 INFO:tasks.workunit.client.0.smithi057.stdout:1/598: chown d1/d21/d66/d53/d7d/d65/fa5 210438 1 2024-02-28T16:02:14.166 INFO:tasks.workunit.client.0.smithi057.stdout:7/492: readlink d6/l9 0 2024-02-28T16:02:14.170 INFO:tasks.workunit.client.0.smithi057.stdout:1/599: read d1/d21/d25/f64 [870518,114732] 0 2024-02-28T16:02:14.171 INFO:tasks.workunit.client.0.smithi057.stdout:1/600: stat d1/d21/l2c 0 2024-02-28T16:02:14.172 INFO:tasks.workunit.client.0.smithi057.stdout:7/493: mkdir d6/dc/dab 0 2024-02-28T16:02:14.174 INFO:tasks.workunit.client.0.smithi057.stdout:6/544: unlink df/d10/d13/f1e 0 2024-02-28T16:02:14.175 INFO:tasks.workunit.client.0.smithi057.stdout:1/601: fdatasync d1/d21/d66/d53/d7d/d65/f61 0 2024-02-28T16:02:14.180 INFO:tasks.workunit.client.0.smithi057.stdout:7/494: link d6/dc/d12/d1a/d4d/d56/c6d d6/dc/d12/cac 0 2024-02-28T16:02:14.182 INFO:tasks.workunit.client.0.smithi057.stdout:7/495: fdatasync d6/d26/f50 0 2024-02-28T16:02:14.185 INFO:tasks.workunit.client.0.smithi057.stdout:9/616: sync 2024-02-28T16:02:14.186 INFO:tasks.workunit.client.0.smithi057.stdout:7/496: symlink d6/dc/d87/lad 0 2024-02-28T16:02:14.189 INFO:tasks.workunit.client.1.smithi087.stdout:0/974: sync 2024-02-28T16:02:14.192 INFO:tasks.workunit.client.0.smithi057.stdout:9/617: mknod d2/d24/cc9 0 2024-02-28T16:02:14.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.201+0000 7f790f600700 1 -- 172.21.15.57:0/4209631831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7908102430 msgr2=0x7f7908104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:14.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.201+0000 7f790f600700 1 --2- 172.21.15.57:0/4209631831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7908102430 0x7f7908104810 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f78fc004940 tx=0x7f78fc009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:14.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.202+0000 7f790f600700 1 -- 172.21.15.57:0/4209631831 shutdown_connections 2024-02-28T16:02:14.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.202+0000 7f790f600700 1 --2- 172.21.15.57:0/4209631831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7908102430 0x7f7908104810 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:14.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.202+0000 7f790f600700 1 --2- 172.21.15.57:0/4209631831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79080663e0 0x7f7908101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:14.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.202+0000 7f790f600700 1 -- 172.21.15.57:0/4209631831 >> 172.21.15.57:0/4209631831 conn(0x7f79080f74e0 msgr2=0x7f79080f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:14.195 INFO:tasks.workunit.client.0.smithi057.stdout:7/497: creat d6/dc/d12/d1a/d90/fae x:0 0 0 2024-02-28T16:02:14.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.203+0000 7f790f600700 1 -- 172.21.15.57:0/4209631831 shutdown_connections 2024-02-28T16:02:14.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.203+0000 7f790f600700 1 -- 172.21.15.57:0/4209631831 wait complete. 2024-02-28T16:02:14.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.204+0000 7f790f600700 1 Processor -- start 2024-02-28T16:02:14.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.204+0000 7f790f600700 1 -- start start 2024-02-28T16:02:14.196 INFO:tasks.workunit.client.0.smithi057.stdout:9/618: fsync d2/d5/d1b/f49 0 2024-02-28T16:02:14.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.205+0000 7f790f600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79080663e0 0x7f790810b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:14.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.205+0000 7f790f600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7908102430 0x7f790810bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:14.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.205+0000 7f790f600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790810c220 con 0x7f79080663e0 2024-02-28T16:02:14.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.205+0000 7f790f600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790810fd10 con 0x7f7908102430 2024-02-28T16:02:14.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.206+0000 7f790cc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79080663e0 0x7f790810b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:14.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.206+0000 7f790cc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79080663e0 0x7f790810b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55984/0 (socket says 172.21.15.57:55984) 2024-02-28T16:02:14.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.206+0000 7f790cc00700 1 -- 172.21.15.57:0/3593951582 learned_addr learned my addr 172.21.15.57:0/3593951582 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:14.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.206+0000 7f7907e00700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7908102430 0x7f790810bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:14.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.207+0000 7f790cc00700 1 -- 172.21.15.57:0/3593951582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7908102430 msgr2=0x7f790810bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:14.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.207+0000 7f790cc00700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7908102430 0x7f790810bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:14.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.207+0000 7f790cc00700 1 -- 172.21.15.57:0/3593951582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc005040 con 0x7f79080663e0 2024-02-28T16:02:14.199 INFO:tasks.workunit.client.0.smithi057.stdout:6/545: dread df/d10/d13/d4b/d4e/f86 [0,4194304] 0 2024-02-28T16:02:14.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.207+0000 7f790cc00700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79080663e0 0x7f790810b690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f78f800eb40 tx=0x7f78f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:14.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.208+0000 7f7904c00700 1 -- 172.21.15.57:0/3593951582 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78f8007cc0 con 0x7f79080663e0 2024-02-28T16:02:14.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.208+0000 7f7904c00700 1 -- 172.21.15.57:0/3593951582 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78f800f040 con 0x7f79080663e0 2024-02-28T16:02:14.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.208+0000 7f7904c00700 1 -- 172.21.15.57:0/3593951582 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78f8009620 con 0x7f79080663e0 2024-02-28T16:02:14.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.209+0000 7f790f600700 1 -- 172.21.15.57:0/3593951582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790810ff90 con 0x7f79080663e0 2024-02-28T16:02:14.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.209+0000 7f790f600700 1 -- 172.21.15.57:0/3593951582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79081104d0 con 0x7f79080663e0 2024-02-28T16:02:14.201 INFO:tasks.workunit.client.0.smithi057.stdout:7/498: creat d6/dc/d35/da6/faf x:0 0 0 2024-02-28T16:02:14.202 INFO:tasks.workunit.client.1.smithi087.stdout:0/975: fsync d4/d6/d9c/fb5 0 2024-02-28T16:02:14.202 INFO:tasks.workunit.client.0.smithi057.stdout:1/602: dwrite d1/d21/d25/f64 [0,4194304] 0 2024-02-28T16:02:14.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.213+0000 7f790f600700 1 -- 172.21.15.57:0/3593951582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790804bed0 con 0x7f79080663e0 2024-02-28T16:02:14.207 INFO:tasks.workunit.client.0.smithi057.stdout:6/546: read df/f1f [5880013,99288] 0 2024-02-28T16:02:14.207 INFO:tasks.workunit.client.1.smithi087.stdout:0/976: getdents d4/dd/d37/d39/d3a/dc1/d126 0 2024-02-28T16:02:14.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.215+0000 7f7904c00700 1 -- 172.21.15.57:0/3593951582 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 89012+0+0 (secure 0 0 0) 0x7f78f8009780 con 0x7f79080663e0 2024-02-28T16:02:14.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.216+0000 7f7904c00700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f78f006b2e0 0x7f78f006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:14.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.216+0000 7f7904c00700 1 -- 172.21.15.57:0/3593951582 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f78f8089990 con 0x7f79080663e0 2024-02-28T16:02:14.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.217+0000 7f7907e00700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f78f006b2e0 0x7f78f006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:14.209 INFO:tasks.workunit.client.1.smithi087.stdout:0/977: stat d4/d6/dc 0 2024-02-28T16:02:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.218+0000 7f7907e00700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f78f006b2e0 0x7f78f006d790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00b0d0 tx=0x7f78fc009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:14.210 INFO:tasks.workunit.client.0.smithi057.stdout:9/619: getdents d2/d5/d9/d57 0 2024-02-28T16:02:14.214 INFO:tasks.workunit.client.0.smithi057.stdout:7/499: mkdir d6/dc/d12/d1a/d4d/d56/db0 0 2024-02-28T16:02:14.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.223+0000 7f7904c00700 1 -- 172.21.15.57:0/3593951582 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f78f804f620 con 0x7f79080663e0 2024-02-28T16:02:14.217 INFO:tasks.workunit.client.0.smithi057.stdout:7/500: chown d6/dc/d12/d1a/d90/fae 359 1 2024-02-28T16:02:14.218 INFO:tasks.workunit.client.1.smithi087.stdout:0/978: link d4/dd/d37/d39/d3a/l3f d4/dd/d21/d9b/d7c/d114/l138 0 2024-02-28T16:02:14.219 INFO:tasks.workunit.client.0.smithi057.stdout:7/501: stat d6/dc/d35/f83 0 2024-02-28T16:02:14.220 INFO:tasks.workunit.client.0.smithi057.stdout:6/547: rename df/d10/c27 to df/d14/cb5 0 2024-02-28T16:02:14.223 INFO:tasks.workunit.client.0.smithi057.stdout:9/620: creat d2/d5/d1b/d2e/fca x:0 0 0 2024-02-28T16:02:14.224 INFO:tasks.workunit.client.1.smithi087.stdout:0/979: write d4/dd/d37/d39/d3a/fc5 [5456042,55171] 0 2024-02-28T16:02:14.224 INFO:tasks.workunit.client.0.smithi057.stdout:7/502: symlink d6/dc/d12/d1a/d90/lb1 0 2024-02-28T16:02:14.229 INFO:tasks.workunit.client.0.smithi057.stdout:1/603: dwrite d1/d21/d66/d44/f58 [0,4194304] 0 2024-02-28T16:02:14.229 INFO:tasks.workunit.client.0.smithi057.stdout:7/503: mkdir d6/dc/d35/db2 0 2024-02-28T16:02:14.229 INFO:tasks.workunit.client.1.smithi087.stdout:0/980: creat d4/dd/d21/d9b/d7c/d132/f139 x:0 0 0 2024-02-28T16:02:14.231 INFO:tasks.workunit.client.0.smithi057.stdout:9/621: unlink d2/d5/d1b/f3c 0 2024-02-28T16:02:14.232 INFO:tasks.workunit.client.0.smithi057.stdout:9/622: chown d2/f75 75769541 1 2024-02-28T16:02:14.233 INFO:tasks.workunit.client.0.smithi057.stdout:9/623: chown d2/d46 309257 1 2024-02-28T16:02:14.240 INFO:tasks.workunit.client.1.smithi087.stdout:0/981: truncate d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d128/f12f 111583 0 2024-02-28T16:02:14.241 INFO:tasks.workunit.client.0.smithi057.stdout:7/504: rename d6/d38/l3a to d6/dc/d12/d1a/d90/lb3 0 2024-02-28T16:02:14.242 INFO:tasks.workunit.client.0.smithi057.stdout:9/624: symlink d2/d5/d9/lcb 0 2024-02-28T16:02:14.246 INFO:tasks.workunit.client.0.smithi057.stdout:1/604: dwrite d1/d21/d25/f64 [4194304,4194304] 0 2024-02-28T16:02:14.252 INFO:tasks.workunit.client.1.smithi087.stdout:0/982: rename d4/d6/dc/d45/db4/df2 to d4/dd/d21/d9b/d7c/d13a 0 2024-02-28T16:02:14.254 INFO:tasks.workunit.client.1.smithi087.stdout:0/983: dread - d4/dd/d37/f131 zero size 2024-02-28T16:02:14.262 INFO:tasks.workunit.client.0.smithi057.stdout:7/505: write d6/dc/d12/d1a/d4d/f69 [941118,14293] 0 2024-02-28T16:02:14.262 INFO:tasks.workunit.client.0.smithi057.stdout:1/605: rename d1/d3/f2a to d1/d3/fc6 0 2024-02-28T16:02:14.262 INFO:tasks.workunit.client.1.smithi087.stdout:0/984: chown d4/dd/d21/d9b/d7c/d132/f139 4 1 2024-02-28T16:02:14.266 INFO:tasks.workunit.client.1.smithi087.stdout:0/985: getdents d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d76 0 2024-02-28T16:02:14.266 INFO:tasks.workunit.client.0.smithi057.stdout:7/506: creat d6/dc/d12/d1a/d90/fb4 x:0 0 0 2024-02-28T16:02:14.267 INFO:tasks.workunit.client.1.smithi087.stdout:0/986: chown d4/dd/d37/d39/d3a/d57/d74/f44 5 1 2024-02-28T16:02:14.268 INFO:tasks.workunit.client.0.smithi057.stdout:9/625: dwrite d2/d5/d9/d57/d8b/f8d [0,4194304] 0 2024-02-28T16:02:14.272 INFO:tasks.workunit.client.0.smithi057.stdout:1/606: getdents d1/d21/d66/d44/d4c/d75 0 2024-02-28T16:02:14.273 INFO:tasks.workunit.client.1.smithi087.stdout:0/987: truncate d4/dd/d21/d52/f7e 635062 0 2024-02-28T16:02:14.274 INFO:tasks.workunit.client.0.smithi057.stdout:9/626: symlink d2/d5/d9/d57/d8b/lcc 0 2024-02-28T16:02:14.274 INFO:tasks.workunit.client.1.smithi087.stdout:0/988: write d4/d6/df4/f118 [1013038,63188] 0 2024-02-28T16:02:14.277 INFO:tasks.workunit.client.0.smithi057.stdout:6/548: dread df/d14/d15/d16/d39/d92/da4/dad/f9e [0,4194304] 0 2024-02-28T16:02:14.280 INFO:tasks.workunit.client.0.smithi057.stdout:9/627: mknod d2/d5/d1b/d2e/d4c/da0/ccd 0 2024-02-28T16:02:14.283 INFO:tasks.workunit.client.0.smithi057.stdout:9/628: chown d2/d46/d67/d7d/fa4 166783 1 2024-02-28T16:02:14.283 INFO:tasks.workunit.client.0.smithi057.stdout:6/549: creat df/d10/fb6 x:0 0 0 2024-02-28T16:02:14.289 INFO:tasks.workunit.client.0.smithi057.stdout:9/629: symlink d2/d5/d9/d57/lce 0 2024-02-28T16:02:14.291 INFO:tasks.workunit.client.0.smithi057.stdout:1/607: dwrite d1/d3/dc/d15/d4e/faf [0,4194304] 0 2024-02-28T16:02:14.295 INFO:tasks.workunit.client.0.smithi057.stdout:1/608: chown d1/d21/d66/d53/cb7 839998303 1 2024-02-28T16:02:14.301 INFO:tasks.workunit.client.0.smithi057.stdout:7/507: dread d6/dc/fd [0,4194304] 0 2024-02-28T16:02:14.302 INFO:tasks.workunit.client.0.smithi057.stdout:1/609: mkdir d1/d21/d66/dc7 0 2024-02-28T16:02:14.302 INFO:tasks.workunit.client.0.smithi057.stdout:6/550: link df/d10/d78/d5b/ca8 df/d14/d15/d16/d39/d92/da4/dad/cb7 0 2024-02-28T16:02:14.304 INFO:tasks.workunit.client.0.smithi057.stdout:1/610: read d1/f45 [1197964,96648] 0 2024-02-28T16:02:14.308 INFO:tasks.workunit.client.0.smithi057.stdout:1/611: write d1/d21/d66/d53/fbc [1011887,2481] 0 2024-02-28T16:02:14.308 INFO:tasks.workunit.client.0.smithi057.stdout:6/551: unlink df/d14/d15/f25 0 2024-02-28T16:02:14.310 INFO:tasks.workunit.client.0.smithi057.stdout:6/552: chown df/d10 42519 1 2024-02-28T16:02:14.313 INFO:tasks.workunit.client.0.smithi057.stdout:6/553: dread - df/d14/d15/d16/d39/fae zero size 2024-02-28T16:02:14.318 INFO:tasks.workunit.client.0.smithi057.stdout:6/554: mknod df/d14/d15/d16/d39/d8d/cb8 0 2024-02-28T16:02:14.320 INFO:tasks.workunit.client.1.smithi087.stdout:0/989: dread d4/dd/d21/d5f/fb7 [0,4194304] 0 2024-02-28T16:02:14.322 INFO:tasks.workunit.client.0.smithi057.stdout:6/555: chown df/d10/d13/d4b/f9d 451967340 1 2024-02-28T16:02:14.328 INFO:tasks.workunit.client.0.smithi057.stdout:7/508: dwrite d6/d26/f36 [4194304,4194304] 0 2024-02-28T16:02:14.330 INFO:tasks.workunit.client.0.smithi057.stdout:7/509: write d6/dc/d35/f83 [873146,54741] 0 2024-02-28T16:02:14.331 INFO:tasks.workunit.client.0.smithi057.stdout:6/556: rmdir df/d10/d13/d4b/d4e/d84 0 2024-02-28T16:02:14.332 INFO:tasks.workunit.client.1.smithi087.stdout:0/990: dread d4/dd/d26/fc3 [0,4194304] 0 2024-02-28T16:02:14.334 INFO:tasks.workunit.client.0.smithi057.stdout:9/630: dread d2/d5e/d65/d87/f9e [0,4194304] 0 2024-02-28T16:02:14.337 INFO:tasks.workunit.client.1.smithi087.stdout:0/991: link d4/dd/d21/d5f/f107 d4/dd/d37/d39/d3a/dc1/d126/f13b 0 2024-02-28T16:02:14.337 INFO:tasks.workunit.client.0.smithi057.stdout:6/557: creat df/d10/d78/fb9 x:0 0 0 2024-02-28T16:02:14.338 INFO:tasks.workunit.client.0.smithi057.stdout:1/612: dread d1/d3/dc/d15/d4e/d5f/fa7 [0,4194304] 0 2024-02-28T16:02:14.338 INFO:tasks.workunit.client.0.smithi057.stdout:7/510: rename d6/d38/c68 to d6/dc/d35/da6/cb5 0 2024-02-28T16:02:14.338 INFO:tasks.workunit.client.0.smithi057.stdout:6/558: read - df/fa2 zero size 2024-02-28T16:02:14.341 INFO:tasks.workunit.client.1.smithi087.stdout:0/992: creat d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/de9/f13c x:0 0 0 2024-02-28T16:02:14.341 INFO:tasks.workunit.client.0.smithi057.stdout:6/559: stat df/d10/d78/d5b/f8b 0 2024-02-28T16:02:14.346 INFO:tasks.workunit.client.0.smithi057.stdout:1/613: mknod d1/d3/cc8 0 2024-02-28T16:02:14.346 INFO:tasks.workunit.client.0.smithi057.stdout:6/560: creat df/d61/fba x:0 0 0 2024-02-28T16:02:14.351 INFO:tasks.workunit.client.0.smithi057.stdout:8/489: sync 2024-02-28T16:02:14.354 INFO:tasks.workunit.client.0.smithi057.stdout:6/561: rmdir df/d14/d15/d82/db2 0 2024-02-28T16:02:14.358 INFO:tasks.workunit.client.0.smithi057.stdout:6/562: stat df/d14/d15/d16/d39/d92/da4/dad/f9e 0 2024-02-28T16:02:14.362 INFO:tasks.workunit.client.0.smithi057.stdout:6/563: mkdir df/d61/dbb 0 2024-02-28T16:02:14.364 INFO:tasks.workunit.client.0.smithi057.stdout:8/490: truncate d5/de/f7e 778685 0 2024-02-28T16:02:14.365 INFO:tasks.workunit.client.0.smithi057.stdout:9/631: dwrite d2/d5e/d65/f71 [0,4194304] 0 2024-02-28T16:02:14.368 INFO:tasks.workunit.client.1.smithi087.stdout:0/993: write d4/d6/dc/fdd [803474,44702] 0 2024-02-28T16:02:14.371 INFO:tasks.workunit.client.1.smithi087.stdout:0/994: chown d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d31/d58/cee 159 1 2024-02-28T16:02:14.373 INFO:tasks.workunit.client.0.smithi057.stdout:8/491: mknod d5/d20/d39/ca4 0 2024-02-28T16:02:14.374 INFO:tasks.workunit.client.0.smithi057.stdout:6/564: getdents df/d10/d4f 0 2024-02-28T16:02:14.374 INFO:tasks.workunit.client.1.smithi087.stdout:0/995: truncate d4/dd/d37/d39/d3a/dc1/fe5 3338670 0 2024-02-28T16:02:14.378 INFO:tasks.workunit.client.1.smithi087.stdout:0/996: symlink d4/dd/ddc/l13d 0 2024-02-28T16:02:14.383 INFO:tasks.workunit.client.0.smithi057.stdout:8/492: unlink d5/d6/f22 0 2024-02-28T16:02:14.383 INFO:tasks.workunit.client.0.smithi057.stdout:9/632: rename d2/d24/d1d/f60 to d2/d5/d1b/fcf 0 2024-02-28T16:02:14.384 INFO:tasks.workunit.client.1.smithi087.stdout:0/997: write d4/dd/d21/d9b/d7c/d114/f115 [4479045,41] 0 2024-02-28T16:02:14.388 INFO:tasks.workunit.client.1.smithi087.stdout:0/998: creat d4/dd/d37/d39/d3a/dc1/f13e x:0 0 0 2024-02-28T16:02:14.389 INFO:tasks.workunit.client.0.smithi057.stdout:7/511: dread d6/dc/d12/f8c [4194304,4194304] 0 2024-02-28T16:02:14.392 INFO:tasks.workunit.client.0.smithi057.stdout:9/633: mkdir d2/d46/d67/d7d/dd0 0 2024-02-28T16:02:14.392 INFO:tasks.workunit.client.1.smithi087.stdout:0/999: mkdir d4/dd/d37/d39/d3a/d57/d74/d1f/d2e/d5e/d9a/d13f 0 2024-02-28T16:02:14.395 INFO:tasks.workunit.client.0.smithi057.stdout:1/614: dread d1/d3/fc6 [0,4194304] 0 2024-02-28T16:02:14.398 INFO:tasks.workunit.client.0.smithi057.stdout:7/512: dread - d6/dc/d12/d29/f88 zero size 2024-02-28T16:02:14.402 INFO:tasks.workunit.client.0.smithi057.stdout:9/634: fdatasync d2/d5/d1b/d2e/d4c/f5a 0 2024-02-28T16:02:14.403 INFO:tasks.workunit.client.0.smithi057.stdout:1/615: symlink d1/d3/dc/d15/lc9 0 2024-02-28T16:02:14.404 INFO:tasks.workunit.client.1.smithi087.stderr:+ rm -rf -- ./tmp.Q1MBZpkjM6 2024-02-28T16:02:14.405 INFO:tasks.workunit.client.0.smithi057.stdout:3/508: sync 2024-02-28T16:02:14.405 INFO:tasks.workunit.client.0.smithi057.stdout:5/555: sync 2024-02-28T16:02:14.405 INFO:tasks.workunit.client.0.smithi057.stdout:4/536: sync 2024-02-28T16:02:14.406 INFO:tasks.workunit.client.0.smithi057.stdout:0/676: sync 2024-02-28T16:02:14.406 INFO:tasks.workunit.client.0.smithi057.stdout:2/542: sync 2024-02-28T16:02:14.407 INFO:tasks.workunit.client.0.smithi057.stdout:6/565: dwrite df/f42 [0,4194304] 0 2024-02-28T16:02:14.412 INFO:tasks.workunit.client.0.smithi057.stdout:6/566: chown df/d10/d78/d5b/f8b 478 1 2024-02-28T16:02:14.415 INFO:tasks.workunit.client.0.smithi057.stdout:3/509: mknod d8/dd/d19/ca3 0 2024-02-28T16:02:14.416 INFO:tasks.workunit.client.0.smithi057.stdout:7/513: truncate d6/dc/d12/d1a/d4c/d63/f91 448601 0 2024-02-28T16:02:14.418 INFO:tasks.workunit.client.0.smithi057.stdout:2/543: creat d19/d34/fb5 x:0 0 0 2024-02-28T16:02:14.421 INFO:tasks.workunit.client.0.smithi057.stdout:1/616: mkdir d1/d21/d66/d53/dca 0 2024-02-28T16:02:14.422 INFO:tasks.workunit.client.0.smithi057.stdout:0/677: mknod d6/ce4 0 2024-02-28T16:02:14.431 INFO:tasks.workunit.client.0.smithi057.stdout:9/635: getdents d2/d46 0 2024-02-28T16:02:14.433 INFO:tasks.workunit.client.0.smithi057.stdout:6/567: mkdir df/d14/d15/dbc 0 2024-02-28T16:02:14.434 INFO:tasks.workunit.client.0.smithi057.stdout:0/678: mkdir d6/d12/d17/d4b/de5 0 2024-02-28T16:02:14.436 INFO:tasks.workunit.client.0.smithi057.stdout:1/617: mknod d1/d21/d66/dc7/ccb 0 2024-02-28T16:02:14.437 INFO:tasks.workunit.client.0.smithi057.stdout:6/568: chown df/d10/d78/fb9 972739 1 2024-02-28T16:02:14.439 INFO:tasks.workunit.client.0.smithi057.stdout:3/510: write d8/f15 [1127658,70712] 0 2024-02-28T16:02:14.441 INFO:tasks.workunit.client.0.smithi057.stdout:2/544: write d19/d1d/d2e/d31/f50 [333481,85260] 0 2024-02-28T16:02:14.444 INFO:tasks.workunit.client.0.smithi057.stdout:8/493: dread d5/d6/fa [4194304,4194304] 0 2024-02-28T16:02:14.448 INFO:tasks.workunit.client.0.smithi057.stdout:0/679: creat d6/d12/d5d/d71/daa/fe6 x:0 0 0 2024-02-28T16:02:14.450 INFO:tasks.workunit.client.0.smithi057.stdout:1/618: rmdir d1/d21/d66/d53/d7d/d67/d6c 39 2024-02-28T16:02:14.450 INFO:tasks.workunit.client.0.smithi057.stdout:5/556: dread d2/d8/f16 [0,4194304] 0 2024-02-28T16:02:14.451 INFO:tasks.workunit.client.0.smithi057.stdout:9/636: rename d2/d5/d1b/f49 to d2/d5e/d65/fd1 0 2024-02-28T16:02:14.452 INFO:tasks.workunit.client.0.smithi057.stdout:0/680: chown d6/d12/d38/f89 26107008 1 2024-02-28T16:02:14.454 INFO:tasks.workunit.client.0.smithi057.stdout:2/545: mkdir d19/d1d/d2e/db6 0 2024-02-28T16:02:14.455 INFO:tasks.workunit.client.0.smithi057.stdout:8/494: rmdir d5/de/d63/d70 39 2024-02-28T16:02:14.456 INFO:tasks.workunit.client.0.smithi057.stdout:7/514: dwrite d6/dc/d12/f2d [0,4194304] 0 2024-02-28T16:02:14.458 INFO:tasks.workunit.client.0.smithi057.stdout:3/511: write d8/dd/d14/d2e/d30/d49/d51/d66/f90 [882076,5979] 0 2024-02-28T16:02:14.465 INFO:tasks.workunit.client.0.smithi057.stdout:9/637: write d2/d62/fc8 [967334,48648] 0 2024-02-28T16:02:14.465 INFO:tasks.workunit.client.0.smithi057.stdout:4/537: dwrite d1/d10/d31/f62 [0,4194304] 0 2024-02-28T16:02:14.467 INFO:tasks.workunit.client.0.smithi057.stdout:2/546: symlink d19/d2c/d65/lb7 0 2024-02-28T16:02:14.469 INFO:tasks.workunit.client.0.smithi057.stdout:1/619: creat d1/d3/dc/d15/da3/fcc x:0 0 0 2024-02-28T16:02:14.470 INFO:tasks.workunit.client.0.smithi057.stdout:6/569: write df/d10/fb1 [278236,28130] 0 2024-02-28T16:02:14.470 INFO:tasks.workunit.client.0.smithi057.stdout:8/495: mkdir d5/d20/d39/d59/d67/da5 0 2024-02-28T16:02:14.471 INFO:tasks.workunit.client.0.smithi057.stdout:7/515: chown d6/dc/d35/d58/c7e 1636584 1 2024-02-28T16:02:14.472 INFO:tasks.workunit.client.0.smithi057.stdout:5/557: rename d2/d15/d3b to d2/d12/d76/d7a/d95/db5/dcb 0 2024-02-28T16:02:14.472 INFO:tasks.workunit.client.0.smithi057.stdout:9/638: chown d2/d24/l2b 127318547 1 2024-02-28T16:02:14.484 INFO:tasks.workunit.client.0.smithi057.stdout:7/516: unlink d6/dc/d35/f46 0 2024-02-28T16:02:14.488 INFO:tasks.workunit.client.0.smithi057.stdout:4/538: symlink d1/d10/d12/d15/d19/d5e/lb1 0 2024-02-28T16:02:14.489 INFO:tasks.workunit.client.0.smithi057.stdout:9/639: write d2/d5/d9/fc1 [399748,34912] 0 2024-02-28T16:02:14.490 INFO:tasks.workunit.client.0.smithi057.stdout:8/496: read d5/de/f7e [220314,35301] 0 2024-02-28T16:02:14.491 INFO:tasks.workunit.client.0.smithi057.stdout:1/620: fsync d1/d3/dc/d15/f17 0 2024-02-28T16:02:14.495 INFO:tasks.workunit.client.0.smithi057.stdout:4/539: read - d1/d10/fa6 zero size 2024-02-28T16:02:14.496 INFO:tasks.workunit.client.0.smithi057.stdout:8/497: stat d5/de/d1b/d4b/l74 0 2024-02-28T16:02:14.497 INFO:tasks.workunit.client.0.smithi057.stdout:0/681: write d6/d12/d17/fb5 [464933,25844] 0 2024-02-28T16:02:14.501 INFO:tasks.workunit.client.0.smithi057.stdout:6/570: link ld df/d10/d78/d5b/d7b/lbd 0 2024-02-28T16:02:14.503 INFO:tasks.workunit.client.0.smithi057.stdout:7/517: truncate d6/dc/d12/f8c 2240412 0 2024-02-28T16:02:14.505 INFO:tasks.workunit.client.0.smithi057.stdout:8/498: symlink d5/de/d1b/d57/la6 0 2024-02-28T16:02:14.508 INFO:tasks.workunit.client.0.smithi057.stdout:0/682: dread - d6/d12/d17/d4b/f83 zero size 2024-02-28T16:02:14.509 INFO:tasks.workunit.client.0.smithi057.stdout:9/640: fsync d2/d5/f1a 0 2024-02-28T16:02:14.511 INFO:tasks.workunit.client.0.smithi057.stdout:5/558: dwrite d2/d12/fb1 [0,4194304] 0 2024-02-28T16:02:14.513 INFO:tasks.workunit.client.0.smithi057.stdout:6/571: creat df/d10/d78/fbe x:0 0 0 2024-02-28T16:02:14.518 INFO:tasks.workunit.client.0.smithi057.stdout:2/547: dwrite d19/f47 [0,4194304] 0 2024-02-28T16:02:14.523 INFO:tasks.workunit.client.0.smithi057.stdout:8/499: mknod d5/de/d1b/d45/ca7 0 2024-02-28T16:02:14.526 INFO:tasks.workunit.client.0.smithi057.stdout:7/518: mknod d6/dc/d12/d1a/d90/cb6 0 2024-02-28T16:02:14.527 INFO:tasks.workunit.client.0.smithi057.stdout:9/641: chown d2/d5/d1b/d2e/d44/d7e 0 1 2024-02-28T16:02:14.528 INFO:tasks.workunit.client.0.smithi057.stdout:4/540: rename d1/d10/d12/d2c/d50/d93/f95 to d1/d10/d12/d2c/d37/fb2 0 2024-02-28T16:02:14.533 INFO:tasks.workunit.client.0.smithi057.stdout:5/559: creat d2/d12/d76/d7a/d95/db5/dcb/d91/fcc x:0 0 0 2024-02-28T16:02:14.533 INFO:tasks.workunit.client.0.smithi057.stdout:9/642: chown d2/d46/c61 39 1 2024-02-28T16:02:14.537 INFO:tasks.workunit.client.0.smithi057.stdout:7/519: fsync d6/dc/d67/d9a/da1/f75 0 2024-02-28T16:02:14.538 INFO:tasks.workunit.client.0.smithi057.stdout:6/572: write df/d14/d15/d16/f4a [237120,131056] 0 2024-02-28T16:02:14.540 INFO:tasks.workunit.client.0.smithi057.stdout:2/548: truncate d19/d2c/f30 1982427 0 2024-02-28T16:02:14.541 INFO:tasks.workunit.client.0.smithi057.stdout:5/560: chown d2/d12/d76/d7a/lc6 4254 1 2024-02-28T16:02:14.543 INFO:tasks.workunit.client.0.smithi057.stdout:9/643: chown d2/d5/d1b/d2e/d77/c43 15775105 1 2024-02-28T16:02:14.547 INFO:tasks.workunit.client.0.smithi057.stdout:9/644: dread - d2/d5/d1b/fba zero size 2024-02-28T16:02:14.548 INFO:tasks.workunit.client.0.smithi057.stdout:0/683: dwrite d6/d12/d17/f3b [0,4194304] 0 2024-02-28T16:02:14.552 INFO:tasks.workunit.client.0.smithi057.stdout:5/561: mknod d2/d15/d5e/d6d/ccd 0 2024-02-28T16:02:14.553 INFO:tasks.workunit.client.0.smithi057.stdout:1/621: dread d1/d3/dc/ff [0,4194304] 0 2024-02-28T16:02:14.556 INFO:tasks.workunit.client.0.smithi057.stdout:4/541: dread d1/d22/f24 [4194304,4194304] 0 2024-02-28T16:02:14.564 INFO:tasks.workunit.client.0.smithi057.stdout:5/562: read - d2/d12/d76/d7b/f96 zero size 2024-02-28T16:02:14.564 INFO:tasks.workunit.client.0.smithi057.stdout:9/645: fsync d2/d5/f8 0 2024-02-28T16:02:14.567 INFO:tasks.workunit.client.0.smithi057.stdout:0/684: read d6/d12/d38/f5c [311270,1285] 0 2024-02-28T16:02:14.569 INFO:tasks.workunit.client.0.smithi057.stdout:1/622: creat d1/d21/d66/d53/d62/d73/fcd x:0 0 0 2024-02-28T16:02:14.570 INFO:tasks.workunit.client.0.smithi057.stdout:9/646: chown d2/d5/d9/d57 1 1 2024-02-28T16:02:14.571 INFO:tasks.workunit.client.0.smithi057.stdout:7/520: link d6/l9 d6/lb7 0 2024-02-28T16:02:14.574 INFO:tasks.workunit.client.0.smithi057.stdout:6/573: link df/d10/f7f df/d10/d13/d4b/fbf 0 2024-02-28T16:02:14.576 INFO:tasks.workunit.client.0.smithi057.stdout:5/563: mkdir d2/d12/d76/d7a/d95/db5/dce 0 2024-02-28T16:02:14.579 INFO:tasks.workunit.client.0.smithi057.stdout:1/623: creat d1/d21/d66/d44/fce x:0 0 0 2024-02-28T16:02:14.581 INFO:tasks.workunit.client.0.smithi057.stdout:2/549: dwrite d19/d1d/d2e/d31/f40 [4194304,4194304] 0 2024-02-28T16:02:14.582 INFO:tasks.workunit.client.0.smithi057.stdout:0/685: symlink d6/d12/d17/d4b/le7 0 2024-02-28T16:02:14.583 INFO:tasks.workunit.client.0.smithi057.stdout:9/647: rmdir d2/d5 39 2024-02-28T16:02:14.587 INFO:tasks.workunit.client.0.smithi057.stdout:2/550: write d19/d1d/d2e/f90 [4256187,95276] 0 2024-02-28T16:02:14.592 INFO:tasks.workunit.client.0.smithi057.stdout:0/686: read - d6/d12/d38/fbf zero size 2024-02-28T16:02:14.592 INFO:tasks.workunit.client.0.smithi057.stdout:5/564: dread d2/d3e/f70 [0,4194304] 0 2024-02-28T16:02:14.592 INFO:tasks.workunit.client.0.smithi057.stdout:4/542: dwrite d1/d10/d12/d2c/d37/d46/fa0 [0,4194304] 0 2024-02-28T16:02:14.598 INFO:tasks.workunit.client.0.smithi057.stdout:0/687: readlink d6/d12/d17/d58/d95/la0 0 2024-02-28T16:02:14.602 INFO:tasks.workunit.client.0.smithi057.stdout:1/624: link d1/d21/d66/d44/d4c/f5e d1/d21/d66/d53/fcf 0 2024-02-28T16:02:14.604 INFO:tasks.workunit.client.0.smithi057.stdout:7/521: link d6/d26/l49 d6/dc/d12/lb8 0 2024-02-28T16:02:14.606 INFO:tasks.workunit.client.0.smithi057.stdout:0/688: write d6/d12/d17/d58/d95/daf/fc2 [1367603,76838] 0 2024-02-28T16:02:14.610 INFO:tasks.workunit.client.0.smithi057.stdout:2/551: creat d19/d1d/d2e/d31/fb8 x:0 0 0 2024-02-28T16:02:14.614 INFO:tasks.workunit.client.0.smithi057.stdout:5/565: creat d2/d15/d5e/d6d/fcf x:0 0 0 2024-02-28T16:02:14.616 INFO:tasks.workunit.client.0.smithi057.stdout:4/543: mknod d1/d10/d12/d15/d19/cb3 0 2024-02-28T16:02:14.617 INFO:tasks.workunit.client.0.smithi057.stdout:5/566: chown d2/d12/d76/d7b/d62/d74/l7c 55 1 2024-02-28T16:02:14.618 INFO:tasks.workunit.client.0.smithi057.stdout:1/625: mkdir d1/d21/d66/dd0 0 2024-02-28T16:02:14.634 INFO:tasks.workunit.client.0.smithi057.stdout:7/522: fsync d6/dc/d12/f99 0 2024-02-28T16:02:14.634 INFO:tasks.workunit.client.0.smithi057.stdout:4/544: truncate d1/d22/fa3 622985 0 2024-02-28T16:02:14.634 INFO:tasks.workunit.client.0.smithi057.stdout:9/648: rename d2/d46/lb9 to d2/d5/d1b/ld2 0 2024-02-28T16:02:14.638 INFO:tasks.workunit.client.0.smithi057.stdout:9/649: fdatasync d2/d5e/d65/f9b 0 2024-02-28T16:02:14.642 INFO:tasks.workunit.client.0.smithi057.stdout:6/574: dread df/d10/d78/d5b/d7b/fa1 [0,4194304] 0 2024-02-28T16:02:14.648 INFO:tasks.workunit.client.0.smithi057.stdout:7/523: getdents d6/dc/dab 0 2024-02-28T16:02:14.648 INFO:tasks.workunit.client.0.smithi057.stdout:2/552: dread d19/d43/f92 [0,4194304] 0 2024-02-28T16:02:14.651 INFO:tasks.workunit.client.0.smithi057.stdout:5/567: write d2/d15/d5e/d6d/f75 [5168005,6446] 0 2024-02-28T16:02:14.664 INFO:tasks.workunit.client.0.smithi057.stdout:0/689: dwrite d6/d4e/f77 [0,4194304] 0 2024-02-28T16:02:14.668 INFO:tasks.workunit.client.0.smithi057.stdout:9/650: rename d2/d5/d9/d57 to d2/d5/dd3 0 2024-02-28T16:02:14.668 INFO:tasks.workunit.client.0.smithi057.stdout:4/545: getdents d1/d10/d12/d2c 0 2024-02-28T16:02:14.668 INFO:tasks.workunit.client.0.smithi057.stdout:1/626: dwrite d1/d21/d66/d53/d7d/d65/f61 [0,4194304] 0 2024-02-28T16:02:14.669 INFO:tasks.workunit.client.0.smithi057.stdout:2/553: symlink d19/d1d/d26/lb9 0 2024-02-28T16:02:14.673 INFO:tasks.workunit.client.0.smithi057.stdout:6/575: dwrite df/d10/d13/d4b/f89 [0,4194304] 0 2024-02-28T16:02:14.673 INFO:tasks.workunit.client.0.smithi057.stdout:5/568: symlink d2/d3e/ld0 0 2024-02-28T16:02:14.675 INFO:tasks.workunit.client.0.smithi057.stdout:7/524: rename d6/d26/f86 to d6/dc/d67/d9a/da1/da8/fb9 0 2024-02-28T16:02:14.676 INFO:tasks.workunit.client.0.smithi057.stdout:2/554: read d19/d43/d5a/f96 [2964545,77603] 0 2024-02-28T16:02:14.677 INFO:tasks.workunit.client.0.smithi057.stdout:0/690: chown d6/d12/d17/d58/l62 19328 1 2024-02-28T16:02:14.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:14 smithi057 ceph-mon[28763]: pgmap v39: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 110 MiB/s rd, 269 MiB/s wr, 578 op/s 2024-02-28T16:02:14.678 INFO:tasks.workunit.client.0.smithi057.stdout:2/555: stat d19/f37 0 2024-02-28T16:02:14.678 INFO:tasks.workunit.client.0.smithi057.stdout:0/691: readlink d6/l14 0 2024-02-28T16:02:14.678 INFO:tasks.workunit.client.0.smithi057.stdout:9/651: symlink d2/d5/d1b/d2e/d77/ld4 0 2024-02-28T16:02:14.678 INFO:tasks.workunit.client.0.smithi057.stdout:4/546: mkdir d1/d10/d12/d39/db4 0 2024-02-28T16:02:14.680 INFO:tasks.workunit.client.0.smithi057.stdout:9/652: chown d2/d5/d9/f6a 48048 1 2024-02-28T16:02:14.681 INFO:tasks.workunit.client.0.smithi057.stdout:6/576: rmdir df 39 2024-02-28T16:02:14.687 INFO:tasks.workunit.client.0.smithi057.stdout:2/556: creat d19/d2c/d48/fba x:0 0 0 2024-02-28T16:02:14.687 INFO:tasks.workunit.client.0.smithi057.stdout:0/692: mknod d6/d12/d45/dab/ce8 0 2024-02-28T16:02:14.689 INFO:tasks.workunit.client.0.smithi057.stdout:9/653: creat d2/d5e/d65/d87/fd5 x:0 0 0 2024-02-28T16:02:14.691 INFO:tasks.workunit.client.0.smithi057.stdout:4/547: write d1/d10/d12/d2c/d37/fb2 [777094,70246] 0 2024-02-28T16:02:14.693 INFO:tasks.workunit.client.0.smithi057.stdout:7/525: unlink d6/dc/d12/lb8 0 2024-02-28T16:02:14.700 INFO:tasks.workunit.client.0.smithi057.stdout:7/526: stat l0 0 2024-02-28T16:02:14.704 INFO:tasks.workunit.client.0.smithi057.stdout:6/577: write df/d10/d13/f77 [9162212,70517] 0 2024-02-28T16:02:14.704 INFO:tasks.workunit.client.0.smithi057.stdout:2/557: dread d19/d1d/d2e/f9f [0,4194304] 0 2024-02-28T16:02:14.707 INFO:tasks.workunit.client.0.smithi057.stdout:4/548: dread d1/d10/d12/d2c/d37/f4e [0,4194304] 0 2024-02-28T16:02:14.708 INFO:tasks.workunit.client.0.smithi057.stdout:2/558: write d19/d34/fb5 [34061,102049] 0 2024-02-28T16:02:14.712 INFO:tasks.workunit.client.0.smithi057.stdout:6/578: symlink df/d61/d66/lc0 0 2024-02-28T16:02:14.713 INFO:tasks.workunit.client.0.smithi057.stdout:4/549: mknod d1/d22/cb5 0 2024-02-28T16:02:14.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:14 smithi087 ceph-mon[37122]: pgmap v39: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 110 MiB/s rd, 269 MiB/s wr, 578 op/s 2024-02-28T16:02:14.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.756+0000 7f790f600700 1 -- 172.21.15.57:0/3593951582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7908110120 con 0x7f79080663e0 2024-02-28T16:02:14.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.757+0000 7f7904c00700 1 -- 172.21.15.57:0/3593951582 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7908110120 con 0x7f79080663e0 2024-02-28T16:02:14.750 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:02:14.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.759+0000 7f790f600700 1 -- 172.21.15.57:0/3593951582 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f78f006b2e0 msgr2=0x7f78f006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:14.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.759+0000 7f790f600700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f78f006b2e0 0x7f78f006d790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00b0d0 tx=0x7f78fc009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:14.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.759+0000 7f790f600700 1 -- 172.21.15.57:0/3593951582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79080663e0 msgr2=0x7f790810b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:14.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.759+0000 7f790f600700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79080663e0 0x7f790810b690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f78f800eb40 tx=0x7f78f800b040 comp rx=0 tx=0).stop 2024-02-28T16:02:14.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.759+0000 7f790f600700 1 -- 172.21.15.57:0/3593951582 shutdown_connections 2024-02-28T16:02:14.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.759+0000 7f790f600700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f78f006b2e0 0x7f78f006d790 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:14.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.759+0000 7f790f600700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79080663e0 0x7f790810b690 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:14.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.759+0000 7f790f600700 1 --2- 172.21.15.57:0/3593951582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7908102430 0x7f790810bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:14.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.759+0000 7f790f600700 1 -- 172.21.15.57:0/3593951582 >> 172.21.15.57:0/3593951582 conn(0x7f79080f74e0 msgr2=0x7f79080f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:14.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.760+0000 7f790f600700 1 -- 172.21.15.57:0/3593951582 shutdown_connections 2024-02-28T16:02:14.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:14.760+0000 7f790f600700 1 -- 172.21.15.57:0/3593951582 wait complete. 2024-02-28T16:02:14.768 INFO:tasks.workunit.client.0.smithi057.stdout:5/569: write d2/f22 [2707870,123268] 0 2024-02-28T16:02:14.768 INFO:tasks.workunit.client.0.smithi057.stdout:2/559: link d19/d3a/l4d d19/d34/d78/lbb 0 2024-02-28T16:02:14.771 INFO:tasks.workunit.client.0.smithi057.stdout:4/550: write d1/d3f/d5f/fa5 [189269,46931] 0 2024-02-28T16:02:14.775 INFO:tasks.workunit.client.0.smithi057.stdout:2/560: read d19/d43/d5a/f6e [552851,31856] 0 2024-02-28T16:02:14.788 INFO:tasks.workunit.client.0.smithi057.stdout:5/570: getdents d2/d15/d5e/d7f 0 2024-02-28T16:02:14.789 INFO:tasks.workunit.client.0.smithi057.stdout:4/551: write d1/d10/d12/d2c/f57 [712776,66906] 0 2024-02-28T16:02:14.789 INFO:tasks.workunit.client.0.smithi057.stdout:0/693: dwrite d6/d12/d38/db4/fd0 [0,4194304] 0 2024-02-28T16:02:14.789 INFO:tasks.workunit.client.0.smithi057.stdout:1/627: dread d1/d21/d25/f33 [0,4194304] 0 2024-02-28T16:02:14.789 INFO:tasks.workunit.client.0.smithi057.stdout:9/654: dwrite d2/d5/d1b/d2e/d44/d7e/fae [0,4194304] 0 2024-02-28T16:02:14.792 INFO:tasks.workunit.client.0.smithi057.stdout:0/694: mkdir d6/d12/d5d/de9 0 2024-02-28T16:02:14.795 INFO:tasks.workunit.client.0.smithi057.stdout:6/579: dwrite df/d10/d13/d4b/f89 [0,4194304] 0 2024-02-28T16:02:14.797 INFO:tasks.workunit.client.0.smithi057.stdout:5/571: rename d2/d15/d63/fba to d2/d15/d5e/d67/fd1 0 2024-02-28T16:02:14.798 INFO:tasks.workunit.client.0.smithi057.stdout:1/628: creat d1/d21/d66/d53/d7d/d67/d6c/d82/fd1 x:0 0 0 2024-02-28T16:02:14.804 INFO:tasks.workunit.client.0.smithi057.stdout:9/655: link d2/d5/d9/d5d/l7f d2/d5/d1b/d2e/ld6 0 2024-02-28T16:02:14.805 INFO:tasks.workunit.client.0.smithi057.stdout:5/572: unlink d2/d19/l38 0 2024-02-28T16:02:14.807 INFO:tasks.workunit.client.0.smithi057.stdout:0/695: link d6/d12/d17/f59 d6/d12/d38/fea 0 2024-02-28T16:02:14.807 INFO:tasks.workunit.client.0.smithi057.stdout:5/573: readlink d2/d12/d3d/lbd 0 2024-02-28T16:02:14.809 INFO:tasks.workunit.client.0.smithi057.stdout:1/629: fdatasync d1/d21/d66/d53/d7d/d65/f5a 0 2024-02-28T16:02:14.809 INFO:tasks.workunit.client.0.smithi057.stdout:9/656: dread - d2/d5/dd3/f81 zero size 2024-02-28T16:02:14.813 INFO:tasks.workunit.client.0.smithi057.stdout:6/580: write df/d14/d15/d16/f49 [3335681,130102] 0 2024-02-28T16:02:14.817 INFO:tasks.workunit.client.0.smithi057.stdout:5/574: unlink d2/d12/d76/d7b/d62/d74/fc2 0 2024-02-28T16:02:14.821 INFO:tasks.workunit.client.0.smithi057.stdout:1/630: mknod d1/d21/d66/d53/d7d/cd2 0 2024-02-28T16:02:14.825 INFO:tasks.workunit.client.0.smithi057.stdout:5/575: creat d2/d12/d76/d7b/d62/da3/fd2 x:0 0 0 2024-02-28T16:02:14.827 INFO:tasks.workunit.client.0.smithi057.stdout:1/631: mkdir d1/d3/dc/d15/d4e/d5f/dbe/dd3 0 2024-02-28T16:02:14.831 INFO:tasks.workunit.client.0.smithi057.stdout:0/696: dwrite d6/d12/d17/d4b/f31 [0,4194304] 0 2024-02-28T16:02:14.832 INFO:tasks.workunit.client.0.smithi057.stdout:5/576: mkdir d2/d12/dd3 0 2024-02-28T16:02:14.837 INFO:tasks.workunit.client.0.smithi057.stdout:1/632: readlink d1/d21/d66/d53/d62/d73/lb0 0 2024-02-28T16:02:14.840 INFO:tasks.workunit.client.0.smithi057.stdout:6/581: dwrite df/d14/d15/d16/d39/fac [0,4194304] 0 2024-02-28T16:02:14.840 INFO:tasks.workunit.client.0.smithi057.stdout:0/697: mknod d6/d12/d17/d4b/ceb 0 2024-02-28T16:02:14.842 INFO:tasks.workunit.client.0.smithi057.stdout:9/657: dwrite d2/d5/d1b/d2e/d4c/da0/faa [0,4194304] 0 2024-02-28T16:02:14.847 INFO:tasks.workunit.client.0.smithi057.stdout:1/633: rmdir d1/d21/d66/d53/d62/d73 39 2024-02-28T16:02:14.853 INFO:tasks.workunit.client.0.smithi057.stdout:6/582: rename df/d61/d66/lc0 to df/d10/d13/d4b/d4e/lc1 0 2024-02-28T16:02:14.861 INFO:tasks.workunit.client.0.smithi057.stdout:0/698: write d6/f67 [755402,106175] 0 2024-02-28T16:02:14.863 INFO:tasks.workunit.client.0.smithi057.stdout:0/699: write d6/fd7 [300456,44989] 0 2024-02-28T16:02:14.866 INFO:tasks.workunit.client.0.smithi057.stdout:0/700: stat d6/d12/d17/d4b/l21 0 2024-02-28T16:02:14.869 INFO:tasks.workunit.client.0.smithi057.stdout:0/701: symlink d6/d12/d45/lec 0 2024-02-28T16:02:14.873 INFO:tasks.workunit.client.0.smithi057.stdout:5/577: dread d2/d12/d3d/f4b [4194304,4194304] 0 2024-02-28T16:02:14.873 INFO:tasks.workunit.client.0.smithi057.stdout:0/702: rename d6/d12/l61 to d6/d12/d45/led 0 2024-02-28T16:02:14.877 INFO:tasks.workunit.client.0.smithi057.stdout:5/578: unlink d2/d15/d63/la9 0 2024-02-28T16:02:14.879 INFO:tasks.workunit.client.0.smithi057.stdout:0/703: mknod d6/d12/d5d/cee 0 2024-02-28T16:02:14.884 INFO:tasks.workunit.client.0.smithi057.stdout:5/579: truncate d2/d12/d5f/fc7 1037378 0 2024-02-28T16:02:14.890 INFO:tasks.workunit.client.0.smithi057.stdout:6/583: dread df/d10/d13/d4b/f51 [0,4194304] 0 2024-02-28T16:02:14.893 INFO:tasks.workunit.client.0.smithi057.stdout:6/584: creat df/d14/fc2 x:0 0 0 2024-02-28T16:02:14.893 INFO:tasks.workunit.client.0.smithi057.stdout:0/704: write d6/f8 [2429969,120859] 0 2024-02-28T16:02:14.894 INFO:tasks.workunit.client.0.smithi057.stdout:1/634: dread d1/d3/dc/d15/d4e/d5f/fbb [0,4194304] 0 2024-02-28T16:02:14.961 INFO:tasks.workunit.client.0.smithi057.stdout:3/512: sync 2024-02-28T16:02:14.962 INFO:tasks.workunit.client.0.smithi057.stdout:8/500: sync 2024-02-28T16:02:14.976 INFO:tasks.workunit.client.0.smithi057.stdout:8/501: readlink d5/de/d1b/l32 0 2024-02-28T16:02:14.979 INFO:tasks.workunit.client.0.smithi057.stdout:1/635: creat d1/d21/d66/d44/d4c/fd4 x:0 0 0 2024-02-28T16:02:14.980 INFO:tasks.workunit.client.0.smithi057.stdout:0/705: dread d6/d12/d17/fb5 [0,4194304] 0 2024-02-28T16:02:14.981 INFO:tasks.workunit.client.0.smithi057.stdout:5/580: dwrite d2/d15/f99 [0,4194304] 0 2024-02-28T16:02:15.028 INFO:tasks.workunit.client.0.smithi057.stdout:1/636: fsync d1/f7 0 2024-02-28T16:02:15.032 INFO:tasks.workunit.client.0.smithi057.stdout:8/502: write d5/de/d1b/f30 [881994,19332] 0 2024-02-28T16:02:15.034 INFO:tasks.workunit.client.0.smithi057.stdout:5/581: write d2/f22 [2736780,28126] 0 2024-02-28T16:02:15.036 INFO:tasks.workunit.client.0.smithi057.stdout:3/513: getdents d8/dd/d14/d2e/d3b 0 2024-02-28T16:02:15.041 INFO:tasks.workunit.client.0.smithi057.stdout:1/637: mknod d1/d3/dc/cd5 0 2024-02-28T16:02:15.049 INFO:tasks.workunit.client.0.smithi057.stdout:0/706: link d6/d4e/l9f d6/d12/d17/d92/lef 0 2024-02-28T16:02:15.052 INFO:tasks.workunit.client.0.smithi057.stdout:5/582: creat d2/d12/d76/d7a/d95/db5/dce/fd4 x:0 0 0 2024-02-28T16:02:15.052 INFO:tasks.workunit.client.0.smithi057.stdout:6/585: dwrite df/d10/d13/d4b/f89 [4194304,4194304] 0 2024-02-28T16:02:15.055 INFO:tasks.workunit.client.0.smithi057.stdout:3/514: mknod d8/dd/d14/d2e/d76/da1/ca4 0 2024-02-28T16:02:15.060 INFO:tasks.workunit.client.0.smithi057.stdout:0/707: creat d6/d12/d5d/d71/daa/db6/ff0 x:0 0 0 2024-02-28T16:02:15.061 INFO:tasks.workunit.client.0.smithi057.stdout:5/583: symlink d2/d15/d63/ld5 0 2024-02-28T16:02:15.061 INFO:tasks.workunit.client.0.smithi057.stdout:6/586: symlink df/d10/lc3 0 2024-02-28T16:02:15.065 INFO:tasks.workunit.client.0.smithi057.stdout:5/584: stat d2/d12/d5f/d77/f93 0 2024-02-28T16:02:15.066 INFO:tasks.workunit.client.0.smithi057.stdout:0/708: chown d6/d12/d45/dab/ce8 164624992 1 2024-02-28T16:02:15.066 INFO:tasks.workunit.client.0.smithi057.stdout:1/638: write d1/d21/d66/d53/d7d/d65/f5c [897197,62997] 0 2024-02-28T16:02:15.066 INFO:tasks.workunit.client.0.smithi057.stdout:6/587: rmdir df/d10/d13 39 2024-02-28T16:02:15.081 INFO:tasks.workunit.client.0.smithi057.stdout:6/588: rmdir df/d14/d15/d82 39 2024-02-28T16:02:15.081 INFO:tasks.workunit.client.0.smithi057.stdout:8/503: dwrite d5/de/d1b/d57/f96 [0,4194304] 0 2024-02-28T16:02:15.081 INFO:tasks.workunit.client.0.smithi057.stdout:5/585: rmdir d2/d15/d5e/d9a/dac 39 2024-02-28T16:02:15.081 INFO:tasks.workunit.client.0.smithi057.stdout:0/709: chown d6/d12/d5d/d7f/lc7 29 1 2024-02-28T16:02:15.083 INFO:tasks.workunit.client.0.smithi057.stdout:7/527: sync 2024-02-28T16:02:15.083 INFO:tasks.workunit.client.0.smithi057.stdout:9/658: sync 2024-02-28T16:02:15.083 INFO:tasks.workunit.client.0.smithi057.stdout:4/552: sync 2024-02-28T16:02:15.083 INFO:tasks.workunit.client.0.smithi057.stdout:2/561: sync 2024-02-28T16:02:15.088 INFO:tasks.workunit.client.0.smithi057.stdout:6/589: mknod df/d14/d15/d16/d65/cc4 0 2024-02-28T16:02:15.088 INFO:tasks.workunit.client.0.smithi057.stdout:0/710: symlink d6/d12/d45/dab/lf1 0 2024-02-28T16:02:15.089 INFO:tasks.workunit.client.0.smithi057.stdout:9/659: chown d2/d5/d1b/f34 28723848 1 2024-02-28T16:02:15.091 INFO:tasks.workunit.client.0.smithi057.stdout:7/528: rmdir d6/dc/d12/d1a/d4d/d56 39 2024-02-28T16:02:15.094 INFO:tasks.workunit.client.0.smithi057.stdout:8/504: creat d5/de/d63/d70/d8e/fa8 x:0 0 0 2024-02-28T16:02:15.095 INFO:tasks.workunit.client.0.smithi057.stdout:7/529: chown c3 19730 1 2024-02-28T16:02:15.097 INFO:tasks.workunit.client.0.smithi057.stdout:1/639: write d1/d3/dc/d15/f17 [885779,44931] 0 2024-02-28T16:02:15.097 INFO:tasks.workunit.client.0.smithi057.stdout:5/586: write d2/d12/d3d/f82 [2477381,35627] 0 2024-02-28T16:02:15.102 INFO:tasks.workunit.client.0.smithi057.stdout:0/711: creat d6/d12/d17/d4b/ff2 x:0 0 0 2024-02-28T16:02:15.104 INFO:tasks.workunit.client.0.smithi057.stdout:9/660: write d2/d24/d1d/fa6 [499458,45216] 0 2024-02-28T16:02:15.104 INFO:tasks.workunit.client.0.smithi057.stdout:3/515: dwrite d8/dd/d14/d2e/d30/f3f [0,4194304] 0 2024-02-28T16:02:15.112 INFO:tasks.workunit.client.0.smithi057.stdout:6/590: truncate df/d10/d78/d5b/f8b 860108 0 2024-02-28T16:02:15.112 INFO:tasks.workunit.client.0.smithi057.stdout:1/640: mknod d1/d3/cd6 0 2024-02-28T16:02:15.113 INFO:tasks.workunit.client.0.smithi057.stdout:0/712: readlink d6/d4e/l9f 0 2024-02-28T16:02:15.113 INFO:tasks.workunit.client.0.smithi057.stdout:5/587: creat d2/d12/fd6 x:0 0 0 2024-02-28T16:02:15.117 INFO:tasks.workunit.client.0.smithi057.stdout:5/588: fsync d2/d12/fc4 0 2024-02-28T16:02:15.118 INFO:tasks.workunit.client.0.smithi057.stdout:9/661: unlink d2/d5/d1b/d2e/d4c/f5a 0 2024-02-28T16:02:15.119 INFO:tasks.workunit.client.0.smithi057.stdout:2/562: dwrite d19/d43/f92 [0,4194304] 0 2024-02-28T16:02:15.120 INFO:tasks.workunit.client.0.smithi057.stdout:3/516: chown d8/dd/d14/d2e/d30/d49/d51/d66/l81 21627 1 2024-02-28T16:02:15.126 INFO:tasks.workunit.client.0.smithi057.stdout:1/641: mknod d1/d21/d66/d44/d4c/d75/cd7 0 2024-02-28T16:02:15.135 INFO:tasks.workunit.client.0.smithi057.stdout:7/530: dwrite d6/f23 [0,4194304] 0 2024-02-28T16:02:15.135 INFO:tasks.workunit.client.0.smithi057.stdout:2/563: creat d19/d2c/d65/fbc x:0 0 0 2024-02-28T16:02:15.136 INFO:tasks.workunit.client.0.smithi057.stdout:6/591: write df/d14/d15/d82/f95 [7641752,20589] 0 2024-02-28T16:02:15.145 INFO:tasks.workunit.client.0.smithi057.stdout:4/553: dread d1/d10/d31/f7e [0,4194304] 0 2024-02-28T16:02:15.145 INFO:tasks.workunit.client.0.smithi057.stdout:6/592: symlink df/d14/d15/d16/d65/lc5 0 2024-02-28T16:02:15.145 INFO:tasks.workunit.client.0.smithi057.stdout:2/564: mknod d19/d1d/cbd 0 2024-02-28T16:02:15.151 INFO:tasks.workunit.client.0.smithi057.stdout:4/554: readlink d1/d10/l90 0 2024-02-28T16:02:15.154 INFO:tasks.workunit.client.0.smithi057.stdout:0/713: dwrite d6/d12/d45/d55/f6d [0,4194304] 0 2024-02-28T16:02:15.156 INFO:tasks.workunit.client.0.smithi057.stdout:2/565: rmdir d19/d1d/d22 39 2024-02-28T16:02:15.159 INFO:tasks.workunit.client.0.smithi057.stdout:4/555: chown d1/d10/d12/d2c/d50/f6c 46617883 1 2024-02-28T16:02:15.166 INFO:tasks.workunit.client.0.smithi057.stdout:6/593: write df/d14/d15/d16/d39/d92/da4/fa5 [920882,38251] 0 2024-02-28T16:02:15.168 INFO:tasks.workunit.client.0.smithi057.stdout:5/589: dwrite d2/d12/d3d/f97 [0,4194304] 0 2024-02-28T16:02:15.171 INFO:tasks.workunit.client.0.smithi057.stdout:2/566: creat d19/d43/d5a/fbe x:0 0 0 2024-02-28T16:02:15.172 INFO:tasks.workunit.client.0.smithi057.stdout:3/517: dwrite d8/dd/d14/d2e/d3b/d71/f91 [0,4194304] 0 2024-02-28T16:02:15.174 INFO:tasks.workunit.client.0.smithi057.stdout:0/714: creat d6/d12/d5d/de9/ff3 x:0 0 0 2024-02-28T16:02:15.176 INFO:tasks.workunit.client.0.smithi057.stdout:8/505: dread d5/de/d1b/f3d [0,4194304] 0 2024-02-28T16:02:15.177 INFO:tasks.workunit.client.0.smithi057.stdout:5/590: chown d2/d12/c8e 12580833 1 2024-02-28T16:02:15.178 INFO:tasks.workunit.client.0.smithi057.stdout:9/662: dwrite d2/d46/f6b [0,4194304] 0 2024-02-28T16:02:15.181 INFO:tasks.workunit.client.0.smithi057.stdout:1/642: dread d1/d3/dc/ff [0,4194304] 0 2024-02-28T16:02:15.183 INFO:tasks.workunit.client.0.smithi057.stdout:6/594: creat df/d14/d15/d16/d39/d92/da4/fc6 x:0 0 0 2024-02-28T16:02:15.188 INFO:tasks.workunit.client.0.smithi057.stdout:2/567: symlink d19/d2c/d48/lbf 0 2024-02-28T16:02:15.190 INFO:tasks.workunit.client.0.smithi057.stdout:3/518: creat d8/dd/d14/d2c/fa5 x:0 0 0 2024-02-28T16:02:15.193 INFO:tasks.workunit.client.0.smithi057.stdout:9/663: dread d2/d62/fc8 [0,4194304] 0 2024-02-28T16:02:15.197 INFO:tasks.workunit.client.0.smithi057.stdout:5/591: symlink d2/d12/d3d/da4/ld7 0 2024-02-28T16:02:15.197 INFO:tasks.workunit.client.0.smithi057.stdout:3/519: readlink d8/dd/d19/l8f 0 2024-02-28T16:02:15.199 INFO:tasks.workunit.client.0.smithi057.stdout:3/520: dread - d8/f74 zero size 2024-02-28T16:02:15.202 INFO:tasks.workunit.client.0.smithi057.stdout:3/521: chown d8/dd/c23 1027573 1 2024-02-28T16:02:15.210 INFO:tasks.workunit.client.0.smithi057.stdout:5/592: write d2/d3e/d5b/fbb [150248,109742] 0 2024-02-28T16:02:15.211 INFO:tasks.workunit.client.0.smithi057.stdout:8/506: dread f1 [0,4194304] 0 2024-02-28T16:02:15.211 INFO:tasks.workunit.client.0.smithi057.stdout:9/664: dread d2/d5e/d65/f9b [0,4194304] 0 2024-02-28T16:02:15.215 INFO:tasks.workunit.client.0.smithi057.stdout:9/665: readlink d2/d24/l31 0 2024-02-28T16:02:15.216 INFO:tasks.workunit.client.0.smithi057.stdout:7/531: dread d6/dc/d12/d1a/d4d/d5a/f7b [8388608,4194304] 0 2024-02-28T16:02:15.218 INFO:tasks.workunit.client.0.smithi057.stdout:2/568: getdents d19/d3a 0 2024-02-28T16:02:15.219 INFO:tasks.workunit.client.0.smithi057.stdout:5/593: dread - d2/d15/d63/f9b zero size 2024-02-28T16:02:15.221 INFO:tasks.workunit.client.0.smithi057.stdout:1/643: link d1/d3/f59 d1/d21/d66/d53/d7d/fd8 0 2024-02-28T16:02:15.226 INFO:tasks.workunit.client.0.smithi057.stdout:2/569: rmdir d19/d43/d5a 39 2024-02-28T16:02:15.226 INFO:tasks.workunit.client.0.smithi057.stdout:0/715: dwrite d6/d12/d38/f93 [4194304,4194304] 0 2024-02-28T16:02:15.227 INFO:tasks.workunit.client.0.smithi057.stdout:9/666: dread - d2/d5/d1b/d2e/d77/f8e zero size 2024-02-28T16:02:15.228 INFO:tasks.workunit.client.0.smithi057.stdout:5/594: creat d2/d12/d5f/fd8 x:0 0 0 2024-02-28T16:02:15.232 INFO:tasks.workunit.client.0.smithi057.stdout:7/532: unlink d6/dc/d12/d1a/d4c/d63/f85 0 2024-02-28T16:02:15.237 INFO:tasks.workunit.client.0.smithi057.stdout:0/716: creat d6/d12/d45/ff4 x:0 0 0 2024-02-28T16:02:15.238 INFO:tasks.workunit.client.0.smithi057.stdout:6/595: dwrite df/d14/d15/d16/f31 [0,4194304] 0 2024-02-28T16:02:15.240 INFO:tasks.workunit.client.0.smithi057.stdout:9/667: write d2/d5/d9/f2a [424852,30892] 0 2024-02-28T16:02:15.244 INFO:tasks.workunit.client.0.smithi057.stdout:6/596: read - df/d10/f7f zero size 2024-02-28T16:02:15.246 INFO:tasks.workunit.client.0.smithi057.stdout:3/522: dread d8/dd/d14/d2c/f33 [0,4194304] 0 2024-02-28T16:02:15.250 INFO:tasks.workunit.client.0.smithi057.stdout:1/644: rename d1/d21/d66/d44/d4c/d75/cd7 to d1/d3/dc/cd9 0 2024-02-28T16:02:15.252 INFO:tasks.workunit.client.0.smithi057.stdout:6/597: mknod df/d61/cc7 0 2024-02-28T16:02:15.254 INFO:tasks.workunit.client.0.smithi057.stdout:6/598: dread - df/d10/d78/fbe zero size 2024-02-28T16:02:15.257 INFO:tasks.workunit.client.0.smithi057.stdout:8/507: dwrite d5/de/d1b/f6f [0,4194304] 0 2024-02-28T16:02:15.261 INFO:tasks.workunit.client.0.smithi057.stdout:0/717: rename d6/d12/d17/d34/c75 to d6/d4e/cf5 0 2024-02-28T16:02:15.262 INFO:tasks.workunit.client.0.smithi057.stdout:2/570: dwrite d19/d1d/d2e/d31/fb8 [0,4194304] 0 2024-02-28T16:02:15.263 INFO:tasks.workunit.client.0.smithi057.stdout:0/718: stat d6/d12/d38/da3/fe1 0 2024-02-28T16:02:15.268 INFO:tasks.workunit.client.0.smithi057.stdout:1/645: mknod d1/d21/cda 0 2024-02-28T16:02:15.269 INFO:tasks.workunit.client.0.smithi057.stdout:2/571: stat d19/d1d/d26/f61 0 2024-02-28T16:02:15.271 INFO:tasks.workunit.client.0.smithi057.stdout:8/508: truncate d5/d20/d39/d59/d67/f94 1021408 0 2024-02-28T16:02:15.281 INFO:tasks.workunit.client.0.smithi057.stdout:6/599: rename df/d14/f98 to df/d10/fc8 0 2024-02-28T16:02:15.281 INFO:tasks.workunit.client.0.smithi057.stdout:2/572: creat d19/d1d/d26/fc0 x:0 0 0 2024-02-28T16:02:15.281 INFO:tasks.workunit.client.0.smithi057.stdout:5/595: link d2/d12/d76/d7a/d95/db5/dcb/f3a d2/d19/d1c/fd9 0 2024-02-28T16:02:15.281 INFO:tasks.workunit.client.0.smithi057.stdout:1/646: rename d1/d21 to d1/d21/d66/d44/d4c/ddb 22 2024-02-28T16:02:15.281 INFO:tasks.workunit.client.0.smithi057.stdout:0/719: creat d6/d12/d17/d34/de2/ff6 x:0 0 0 2024-02-28T16:02:15.283 INFO:tasks.workunit.client.0.smithi057.stdout:9/668: dwrite d2/d5e/d65/f73 [0,4194304] 0 2024-02-28T16:02:15.284 INFO:tasks.workunit.client.0.smithi057.stdout:5/596: write d2/d15/d5e/d6d/f81 [2406406,47207] 0 2024-02-28T16:02:15.287 INFO:tasks.workunit.client.0.smithi057.stdout:5/597: chown d2/d19/fa2 65225404 1 2024-02-28T16:02:15.289 INFO:tasks.workunit.client.0.smithi057.stdout:0/720: creat d6/d12/d38/db4/ff7 x:0 0 0 2024-02-28T16:02:15.289 INFO:tasks.workunit.client.0.smithi057.stdout:6/600: creat df/d14/d15/d82/fc9 x:0 0 0 2024-02-28T16:02:15.289 INFO:tasks.workunit.client.0.smithi057.stdout:2/573: mkdir d19/dc1 0 2024-02-28T16:02:15.293 INFO:tasks.workunit.client.0.smithi057.stdout:5/598: write d2/d8/f6c [5198524,32985] 0 2024-02-28T16:02:15.293 INFO:tasks.workunit.client.0.smithi057.stdout:6/601: dread - df/d14/d15/d82/fc9 zero size 2024-02-28T16:02:15.293 INFO:tasks.workunit.client.0.smithi057.stdout:1/647: creat d1/d3/dc/d15/d4e/fdc x:0 0 0 2024-02-28T16:02:15.293 INFO:tasks.workunit.client.0.smithi057.stdout:9/669: dread d2/d5/d9/f6a [0,4194304] 0 2024-02-28T16:02:15.293 INFO:tasks.workunit.client.0.smithi057.stdout:0/721: write d6/d4e/fd3 [327671,38339] 0 2024-02-28T16:02:15.295 INFO:tasks.workunit.client.0.smithi057.stdout:7/533: dread d6/dc/d12/d1a/d4d/d5a/f7b [0,4194304] 0 2024-02-28T16:02:15.297 INFO:tasks.workunit.client.0.smithi057.stdout:9/670: fsync d2/d5/d1b/d2e/fb5 0 2024-02-28T16:02:15.300 INFO:tasks.workunit.client.0.smithi057.stdout:0/722: chown d6/d4e/fd3 11 1 2024-02-28T16:02:15.300 INFO:tasks.workunit.client.0.smithi057.stdout:2/574: write d19/d1d/d2e/d3c/dab/faf [251810,68265] 0 2024-02-28T16:02:15.302 INFO:tasks.workunit.client.0.smithi057.stdout:5/599: creat d2/d86/fda x:0 0 0 2024-02-28T16:02:15.307 INFO:tasks.workunit.client.0.smithi057.stdout:9/671: stat d2/d5/l4a 0 2024-02-28T16:02:15.313 INFO:tasks.workunit.client.0.smithi057.stdout:9/672: write d2/d46/d67/d7d/fc2 [190101,127677] 0 2024-02-28T16:02:15.315 INFO:tasks.workunit.client.0.smithi057.stdout:0/723: creat d6/d12/d45/ff8 x:0 0 0 2024-02-28T16:02:15.323 INFO:tasks.workunit.client.0.smithi057.stdout:7/534: dwrite d6/dc/d35/f83 [0,4194304] 0 2024-02-28T16:02:15.326 INFO:tasks.workunit.client.0.smithi057.stdout:0/724: chown d6/d12/d45/d55/f56 428575418 1 2024-02-28T16:02:15.327 INFO:tasks.workunit.client.0.smithi057.stdout:9/673: mkdir d2/d5/d9/d5d/dd7 0 2024-02-28T16:02:15.333 INFO:tasks.workunit.client.0.smithi057.stdout:8/509: dwrite d5/de/d1b/d57/f78 [0,4194304] 0 2024-02-28T16:02:15.334 INFO:tasks.workunit.client.0.smithi057.stdout:6/602: dwrite df/d10/d78/d5b/d7b/fa1 [4194304,4194304] 0 2024-02-28T16:02:15.335 INFO:tasks.workunit.client.0.smithi057.stdout:7/535: symlink d6/dc/d35/da6/lba 0 2024-02-28T16:02:15.341 INFO:tasks.workunit.client.0.smithi057.stdout:6/603: dread - df/fa2 zero size 2024-02-28T16:02:15.342 INFO:tasks.workunit.client.0.smithi057.stdout:5/600: dwrite d2/d12/d3d/f4b [4194304,4194304] 0 2024-02-28T16:02:15.343 INFO:tasks.workunit.client.0.smithi057.stdout:2/575: dwrite d19/d1d/f51 [0,4194304] 0 2024-02-28T16:02:15.343 INFO:tasks.workunit.client.0.smithi057.stdout:7/536: dread - d6/dc/d67/d9a/da1/f75 zero size 2024-02-28T16:02:15.346 INFO:tasks.workunit.client.0.smithi057.stdout:9/674: mkdir d2/d5/dd8 0 2024-02-28T16:02:15.346 INFO:tasks.workunit.client.0.smithi057.stdout:0/725: rename d6/d12/d17/d58/d95/la0 to d6/d12/d17/d34/lf9 0 2024-02-28T16:02:15.352 INFO:tasks.workunit.client.0.smithi057.stdout:8/510: readlink d5/d20/d39/d49/d56/d84/l86 0 2024-02-28T16:02:15.352 INFO:tasks.workunit.client.0.smithi057.stdout:2/576: read - d19/d2c/d65/fbc zero size 2024-02-28T16:02:15.354 INFO:tasks.workunit.client.0.smithi057.stdout:6/604: truncate df/d10/f5c 296753 0 2024-02-28T16:02:15.355 INFO:tasks.workunit.client.0.smithi057.stdout:2/577: readlink d19/d3a/l52 0 2024-02-28T16:02:15.356 INFO:tasks.workunit.client.0.smithi057.stdout:0/726: truncate d6/d12/d17/d4b/ff2 1001388 0 2024-02-28T16:02:15.358 INFO:tasks.workunit.client.0.smithi057.stdout:6/605: write df/d10/d78/d5b/d7b/fa1 [3229106,570] 0 2024-02-28T16:02:15.360 INFO:tasks.workunit.client.0.smithi057.stdout:7/537: creat d6/dc/d67/d9a/da1/fbb x:0 0 0 2024-02-28T16:02:15.362 INFO:tasks.workunit.client.0.smithi057.stdout:2/578: write d19/d1d/d26/fc0 [281150,121302] 0 2024-02-28T16:02:15.362 INFO:tasks.workunit.client.0.smithi057.stdout:5/601: creat d2/d12/d3d/da4/fdb x:0 0 0 2024-02-28T16:02:15.365 INFO:tasks.workunit.client.0.smithi057.stdout:6/606: write df/d14/d15/d16/d39/d92/da4/dad/f9a [1166778,187] 0 2024-02-28T16:02:15.366 INFO:tasks.workunit.client.0.smithi057.stdout:9/675: creat d2/d5e/dc3/fd9 x:0 0 0 2024-02-28T16:02:15.366 INFO:tasks.workunit.client.0.smithi057.stdout:0/727: truncate d6/d12/d17/d92/fb3 709167 0 2024-02-28T16:02:15.369 INFO:tasks.workunit.client.0.smithi057.stdout:8/511: rename d5/d20/l7b to d5/de/d63/la9 0 2024-02-28T16:02:15.369 INFO:tasks.workunit.client.0.smithi057.stdout:7/538: chown d6/dc/d12/f8c 0 1 2024-02-28T16:02:15.371 INFO:tasks.workunit.client.0.smithi057.stdout:9/676: write d2/d5/d9/f2a [1687818,22028] 0 2024-02-28T16:02:15.373 INFO:tasks.workunit.client.0.smithi057.stdout:6/607: read df/d10/d13/d4b/f51 [719896,82773] 0 2024-02-28T16:02:15.375 INFO:tasks.workunit.client.0.smithi057.stdout:7/539: mknod d6/dc/d12/d1a/d90/cbc 0 2024-02-28T16:02:15.378 INFO:tasks.workunit.client.0.smithi057.stdout:0/728: truncate d6/d12/d17/d34/de2/ff6 702157 0 2024-02-28T16:02:15.385 INFO:tasks.workunit.client.0.smithi057.stdout:8/512: link d5/d20/d39/d49/f54 d5/de/d1b/faa 0 2024-02-28T16:02:15.388 INFO:tasks.workunit.client.0.smithi057.stdout:5/602: truncate d2/d12/d3d/f97 2704003 0 2024-02-28T16:02:15.389 INFO:tasks.workunit.client.0.smithi057.stdout:6/608: write df/d14/d15/d16/f81 [1465348,23991] 0 2024-02-28T16:02:15.390 INFO:tasks.workunit.client.0.smithi057.stdout:7/540: link d6/d26/l5d d6/dc/d12/d1a/d90/lbd 0 2024-02-28T16:02:15.393 INFO:tasks.workunit.client.0.smithi057.stdout:9/677: truncate d2/d62/fc8 282956 0 2024-02-28T16:02:15.393 INFO:tasks.workunit.client.0.smithi057.stdout:6/609: chown df/d14/d15/d16/d39/d92 8 1 2024-02-28T16:02:15.394 INFO:tasks.workunit.client.0.smithi057.stdout:5/603: mkdir d2/ddc 0 2024-02-28T16:02:15.395 INFO:tasks.workunit.client.0.smithi057.stdout:7/541: dread - d6/dc/d12/d1a/f62 zero size 2024-02-28T16:02:15.397 INFO:tasks.workunit.client.0.smithi057.stdout:0/729: dread d6/d12/d45/d55/f54 [0,4194304] 0 2024-02-28T16:02:15.401 INFO:tasks.workunit.client.0.smithi057.stdout:0/730: creat d6/d4e/ffa x:0 0 0 2024-02-28T16:02:15.403 INFO:tasks.workunit.client.0.smithi057.stdout:2/579: dread d19/d2c/d48/f75 [0,4194304] 0 2024-02-28T16:02:15.403 INFO:tasks.workunit.client.0.smithi057.stdout:5/604: dread d2/d8/f16 [0,4194304] 0 2024-02-28T16:02:15.404 INFO:tasks.workunit.client.0.smithi057.stdout:7/542: link d6/dc/d12/d29/f88 d6/dc/d67/fbe 0 2024-02-28T16:02:15.407 INFO:tasks.workunit.client.0.smithi057.stdout:0/731: creat d6/d12/ffb x:0 0 0 2024-02-28T16:02:15.409 INFO:tasks.workunit.client.0.smithi057.stdout:2/580: fdatasync d19/d43/d5a/d70/fb3 0 2024-02-28T16:02:15.409 INFO:tasks.workunit.client.0.smithi057.stdout:7/543: fdatasync d6/dc/f11 0 2024-02-28T16:02:15.411 INFO:tasks.workunit.client.0.smithi057.stdout:6/610: dwrite df/fa2 [0,4194304] 0 2024-02-28T16:02:15.412 INFO:tasks.workunit.client.0.smithi057.stdout:7/544: stat d6/dc/d12/d1a/d4d/d5a 0 2024-02-28T16:02:15.414 INFO:tasks.workunit.client.0.smithi057.stdout:5/605: rename d2/d12/d76/d7b/d50 to d2/ddd 0 2024-02-28T16:02:15.414 INFO:tasks.workunit.client.0.smithi057.stdout:7/545: readlink d6/dc/d35/da6/lba 0 2024-02-28T16:02:15.416 INFO:tasks.workunit.client.0.smithi057.stdout:0/732: truncate d6/d12/d38/f52 3513091 0 2024-02-28T16:02:15.416 INFO:tasks.workunit.client.0.smithi057.stdout:5/606: chown d2/d8/c6f 1862 1 2024-02-28T16:02:15.443 INFO:tasks.workunit.client.0.smithi057.stdout:5/607: write d2/d12/fb1 [1404971,103885] 0 2024-02-28T16:02:15.447 INFO:tasks.workunit.client.0.smithi057.stdout:2/581: creat d19/d2c/d48/fc2 x:0 0 0 2024-02-28T16:02:15.450 INFO:tasks.workunit.client.0.smithi057.stdout:0/733: mknod d6/d12/d17/d58/d95/cfc 0 2024-02-28T16:02:15.452 INFO:tasks.workunit.client.0.smithi057.stdout:7/546: dread d6/dc/d35/f39 [8388608,4194304] 0 2024-02-28T16:02:15.452 INFO:tasks.workunit.client.0.smithi057.stdout:2/582: mknod d19/d1d/d2e/d31/cc3 0 2024-02-28T16:02:15.454 INFO:tasks.workunit.client.0.smithi057.stdout:0/734: symlink d6/d12/d5d/d7f/lfd 0 2024-02-28T16:02:15.454 INFO:tasks.workunit.client.0.smithi057.stdout:2/583: chown d19/d1d/d89/fa6 59803088 1 2024-02-28T16:02:15.455 INFO:tasks.workunit.client.0.smithi057.stdout:6/611: getdents df/d14/d15 0 2024-02-28T16:02:15.456 INFO:tasks.workunit.client.0.smithi057.stdout:0/735: chown d6/d12/d38/l9b 1481530652 1 2024-02-28T16:02:15.460 INFO:tasks.workunit.client.0.smithi057.stdout:6/612: getdents df/d10/d4f 0 2024-02-28T16:02:15.463 INFO:tasks.workunit.client.0.smithi057.stdout:2/584: creat d19/d1d/fc4 x:0 0 0 2024-02-28T16:02:15.471 INFO:tasks.workunit.client.0.smithi057.stdout:7/547: dwrite d6/d38/f44 [8388608,4194304] 0 2024-02-28T16:02:15.474 INFO:tasks.workunit.client.0.smithi057.stdout:7/548: chown d6/dc/d67/d9a/ca2 73715 1 2024-02-28T16:02:15.477 INFO:tasks.workunit.client.0.smithi057.stdout:7/549: chown d6/dc/d12/d29/l30 0 1 2024-02-28T16:02:15.477 INFO:tasks.workunit.client.0.smithi057.stdout:6/613: dwrite df/d14/d15/d16/d39/d92/f93 [0,4194304] 0 2024-02-28T16:02:15.483 INFO:tasks.workunit.client.0.smithi057.stdout:7/550: symlink d6/dc/d67/d9a/da1/da8/lbf 0 2024-02-28T16:02:15.486 INFO:tasks.workunit.client.0.smithi057.stdout:7/551: stat d6/dc/d12/d1a/d4d/d5a/f7b 0 2024-02-28T16:02:15.489 INFO:tasks.workunit.client.0.smithi057.stdout:7/552: fsync d6/dc/d12/f2d 0 2024-02-28T16:02:15.492 INFO:tasks.workunit.client.0.smithi057.stdout:2/585: dwrite d19/d43/d5a/d70/fa8 [0,4194304] 0 2024-02-28T16:02:15.494 INFO:tasks.workunit.client.0.smithi057.stdout:7/553: dread - d6/dc/d67/fbe zero size 2024-02-28T16:02:15.495 INFO:tasks.workunit.client.0.smithi057.stdout:6/614: write df/d10/d78/d5b/f8b [1277777,1940] 0 2024-02-28T16:02:15.496 INFO:tasks.workunit.client.0.smithi057.stdout:2/586: mknod d19/d43/d5a/cc5 0 2024-02-28T16:02:15.512 INFO:tasks.workunit.client.0.smithi057.stdout:7/554: write d6/dc/d12/d29/f88 [634214,81140] 0 2024-02-28T16:02:15.528 INFO:tasks.workunit.client.0.smithi057.stdout:7/555: dwrite d6/dc/d12/d1a/d4d/d56/f81 [0,4194304] 0 2024-02-28T16:02:15.536 INFO:tasks.workunit.client.0.smithi057.stdout:6/615: dread df/d14/d15/d16/f46 [0,4194304] 0 2024-02-28T16:02:15.538 INFO:tasks.workunit.client.0.smithi057.stdout:2/587: dread d19/d3a/f98 [4194304,4194304] 0 2024-02-28T16:02:15.540 INFO:tasks.workunit.client.0.smithi057.stdout:2/588: dread - d19/d2c/d48/fba zero size 2024-02-28T16:02:15.542 INFO:tasks.workunit.client.0.smithi057.stdout:7/556: dwrite d6/dc/f96 [0,4194304] 0 2024-02-28T16:02:15.544 INFO:tasks.workunit.client.0.smithi057.stdout:7/557: fsync d6/dc/d67/d9a/da1/f75 0 2024-02-28T16:02:15.547 INFO:tasks.workunit.client.0.smithi057.stdout:7/558: dread - d6/dc/d12/d1a/d4c/f9d zero size 2024-02-28T16:02:15.557 INFO:tasks.workunit.client.0.smithi057.stdout:2/589: dwrite d19/d43/f92 [0,4194304] 0 2024-02-28T16:02:15.561 INFO:tasks.workunit.client.0.smithi057.stdout:2/590: creat d19/d1d/d2e/d31/fc6 x:0 0 0 2024-02-28T16:02:15.565 INFO:tasks.workunit.client.0.smithi057.stdout:7/559: dwrite d6/dc/d12/d1a/f62 [0,4194304] 0 2024-02-28T16:02:15.567 INFO:tasks.workunit.client.0.smithi057.stdout:7/560: write d6/dc/d12/d1a/d90/fb4 [168926,37148] 0 2024-02-28T16:02:15.572 INFO:tasks.workunit.client.0.smithi057.stdout:7/561: creat d6/dc/d12/d1a/d90/fc0 x:0 0 0 2024-02-28T16:02:15.573 INFO:tasks.workunit.client.0.smithi057.stdout:7/562: stat d6/dc/f10 0 2024-02-28T16:02:15.584 INFO:tasks.workunit.client.0.smithi057.stdout:7/563: dread d6/dc/d12/d1a/d4c/d63/f80 [0,4194304] 0 2024-02-28T16:02:15.587 INFO:tasks.workunit.client.0.smithi057.stdout:7/564: mknod d6/dc/d12/d1a/cc1 0 2024-02-28T16:02:15.620 INFO:tasks.workunit.client.0.smithi057.stdout:4/556: sync 2024-02-28T16:02:15.632 INFO:tasks.workunit.client.0.smithi057.stdout:7/565: link d6/dc/d67/d9a/da1/c72 d6/dc/d67/cc2 0 2024-02-28T16:02:15.638 INFO:tasks.workunit.client.0.smithi057.stdout:7/566: write d6/dc/d12/d1a/d4d/d56/f81 [1586283,27959] 0 2024-02-28T16:02:15.644 INFO:tasks.workunit.client.0.smithi057.stdout:4/557: rename d1/d22/fab to d1/d22/d64/fb6 0 2024-02-28T16:02:15.646 INFO:tasks.workunit.client.0.smithi057.stdout:7/567: symlink d6/dc/d67/d9a/da1/da8/lc3 0 2024-02-28T16:02:15.650 INFO:tasks.workunit.client.0.smithi057.stdout:7/568: fdatasync d6/dc/d12/d1a/f37 0 2024-02-28T16:02:15.650 INFO:tasks.workunit.client.0.smithi057.stdout:4/558: mkdir d1/d10/d12/d2c/d50/d93/db7 0 2024-02-28T16:02:15.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:15 smithi057 ceph-mon[28763]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:15.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:15 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/3593951582' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:02:15.683 INFO:tasks.workunit.client.0.smithi057.stdout:7/569: link d6/d26/l77 d6/dc/d67/d9a/da1/lc4 0 2024-02-28T16:02:15.688 INFO:tasks.workunit.client.0.smithi057.stdout:7/570: chown d6/dc/d12/d1a/d4c/d63/c98 1 1 2024-02-28T16:02:15.696 INFO:tasks.workunit.client.0.smithi057.stdout:7/571: symlink d6/dc/d12/lc5 0 2024-02-28T16:02:15.702 INFO:tasks.workunit.client.0.smithi057.stdout:7/572: symlink d6/dc/d35/d58/lc6 0 2024-02-28T16:02:15.706 INFO:tasks.workunit.client.0.smithi057.stdout:7/573: creat d6/dc/d67/fc7 x:0 0 0 2024-02-28T16:02:15.710 INFO:tasks.workunit.client.0.smithi057.stdout:7/574: read - d6/dc/d35/da6/faf zero size 2024-02-28T16:02:15.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:15 smithi087 ceph-mon[37122]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:15.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:15 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3593951582' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:02:15.718 INFO:tasks.workunit.client.0.smithi057.stdout:4/559: write d1/d10/d12/d39/f3e [1076793,38570] 0 2024-02-28T16:02:15.721 INFO:tasks.workunit.client.0.smithi057.stdout:7/575: rename d6/dc/d12/f99 to d6/dc/d12/d1a/d4d/fc8 0 2024-02-28T16:02:15.724 INFO:tasks.workunit.client.0.smithi057.stdout:4/560: mkdir d1/db8 0 2024-02-28T16:02:15.728 INFO:tasks.workunit.client.0.smithi057.stdout:7/576: mkdir d6/dc/d12/dc9 0 2024-02-28T16:02:15.728 INFO:tasks.workunit.client.0.smithi057.stdout:4/561: readlink d1/d10/d12/d2c/l6d 0 2024-02-28T16:02:15.730 INFO:tasks.workunit.client.0.smithi057.stdout:4/562: fsync d1/d10/d12/d15/f4a 0 2024-02-28T16:02:15.733 INFO:tasks.workunit.client.0.smithi057.stdout:4/563: write d1/d3f/d5f/f83 [2218307,87851] 0 2024-02-28T16:02:15.743 INFO:tasks.workunit.client.0.smithi057.stdout:7/577: dread d6/dc/d12/d29/f52 [0,4194304] 0 2024-02-28T16:02:15.745 INFO:tasks.workunit.client.0.smithi057.stdout:7/578: fsync d6/dc/d12/f47 0 2024-02-28T16:02:15.746 INFO:tasks.workunit.client.0.smithi057.stdout:4/564: write d1/d10/d12/d2c/d37/f4e [292366,10191] 0 2024-02-28T16:02:15.747 INFO:tasks.workunit.client.0.smithi057.stdout:7/579: read d6/dc/d12/f47 [2985038,90203] 0 2024-02-28T16:02:15.769 INFO:tasks.workunit.client.0.smithi057.stdout:1/648: sync 2024-02-28T16:02:15.769 INFO:tasks.workunit.client.0.smithi057.stdout:3/523: sync 2024-02-28T16:02:15.794 INFO:tasks.workunit.client.0.smithi057.stdout:4/565: dread d1/d10/fa4 [0,4194304] 0 2024-02-28T16:02:15.799 INFO:tasks.workunit.client.0.smithi057.stdout:1/649: write d1/d3/dc/d15/f3c [9235946,63081] 0 2024-02-28T16:02:15.800 INFO:tasks.workunit.client.0.smithi057.stdout:3/524: symlink d8/dd/d14/d2e/d30/d5f/la6 0 2024-02-28T16:02:15.805 INFO:tasks.workunit.client.0.smithi057.stdout:4/566: rename d1/d10/d31/d86/l4b to d1/d3f/d5f/lb9 0 2024-02-28T16:02:15.810 INFO:tasks.workunit.client.0.smithi057.stdout:3/525: creat d8/dd/d14/d2e/d30/d6a/fa7 x:0 0 0 2024-02-28T16:02:15.811 INFO:tasks.workunit.client.0.smithi057.stdout:4/567: creat d1/d10/d12/d39/fba x:0 0 0 2024-02-28T16:02:15.815 INFO:tasks.workunit.client.0.smithi057.stdout:3/526: creat d8/dd/d14/d2e/d3b/d54/fa8 x:0 0 0 2024-02-28T16:02:15.816 INFO:tasks.workunit.client.0.smithi057.stdout:4/568: fsync d1/d22/d64/fb6 0 2024-02-28T16:02:15.819 INFO:tasks.workunit.client.0.smithi057.stdout:3/527: rmdir d8/d26 39 2024-02-28T16:02:15.826 INFO:tasks.workunit.client.0.smithi057.stdout:7/580: dwrite d6/dc/d12/d1a/f24 [0,4194304] 0 2024-02-28T16:02:15.834 INFO:tasks.workunit.client.0.smithi057.stdout:3/528: write d8/f12 [4112557,66615] 0 2024-02-28T16:02:15.837 INFO:tasks.workunit.client.0.smithi057.stdout:1/650: dwrite d1/d21/d66/d53/d7d/d67/d7a/d94/fba [0,4194304] 0 2024-02-28T16:02:15.844 INFO:tasks.workunit.client.0.smithi057.stdout:3/529: mknod d8/dd/ca9 0 2024-02-28T16:02:15.850 INFO:tasks.workunit.client.0.smithi057.stdout:4/569: dwrite d1/d10/d12/f81 [0,4194304] 0 2024-02-28T16:02:15.856 INFO:tasks.workunit.client.0.smithi057.stdout:3/530: stat d8/dd/d14/d2e/d76/d89/d6c/c6e 0 2024-02-28T16:02:15.858 INFO:tasks.workunit.client.0.smithi057.stdout:4/570: rename d1/d10/d12/d15/f4a to d1/d10/d12/d2c/fbb 0 2024-02-28T16:02:15.859 INFO:tasks.workunit.client.0.smithi057.stdout:1/651: getdents d1/d3/dc/d40 0 2024-02-28T16:02:15.861 INFO:tasks.workunit.client.0.smithi057.stdout:3/531: chown d8/dd/d14/d2e/d30/d49/f63 2847 1 2024-02-28T16:02:15.862 INFO:tasks.workunit.client.0.smithi057.stdout:4/571: read - d1/d10/d12/d15/d19/d87/f98 zero size 2024-02-28T16:02:15.864 INFO:tasks.workunit.client.0.smithi057.stdout:3/532: write d8/dd/d14/d2e/d2f/f82 [98347,7781] 0 2024-02-28T16:02:15.867 INFO:tasks.workunit.client.0.smithi057.stdout:1/652: link d1/d21/d25/f33 d1/d3/fdd 0 2024-02-28T16:02:15.869 INFO:tasks.workunit.client.0.smithi057.stdout:3/533: creat d8/dd/d14/d2e/d76/da1/faa x:0 0 0 2024-02-28T16:02:15.871 INFO:tasks.workunit.client.0.smithi057.stdout:1/653: chown d1/d21/d66/d53/d62/fa6 908 1 2024-02-28T16:02:15.875 INFO:tasks.workunit.client.0.smithi057.stdout:3/534: symlink d8/dd/d14/d2e/d30/d5f/d6b/lab 0 2024-02-28T16:02:15.876 INFO:tasks.workunit.client.0.smithi057.stdout:1/654: symlink d1/d21/d66/lde 0 2024-02-28T16:02:15.879 INFO:tasks.workunit.client.0.smithi057.stdout:3/535: dread - d8/dd/d14/d2e/d76/da1/faa zero size 2024-02-28T16:02:15.881 INFO:tasks.workunit.client.0.smithi057.stdout:7/581: dread d6/dc/d12/f2d [0,4194304] 0 2024-02-28T16:02:15.884 INFO:tasks.workunit.client.0.smithi057.stdout:3/536: unlink d8/dd/d19/l8f 0 2024-02-28T16:02:15.886 INFO:tasks.workunit.client.0.smithi057.stdout:4/572: dwrite d1/d10/d12/d2c/d50/f6c [0,4194304] 0 2024-02-28T16:02:15.890 INFO:tasks.workunit.client.0.smithi057.stdout:7/582: write d6/dc/d12/d29/f52 [1943594,32645] 0 2024-02-28T16:02:15.890 INFO:tasks.workunit.client.0.smithi057.stdout:3/537: fsync d8/dd/d14/d2e/d30/f40 0 2024-02-28T16:02:15.891 INFO:tasks.workunit.client.0.smithi057.stdout:4/573: dread - d1/d10/d12/d15/d19/d87/f9d zero size 2024-02-28T16:02:15.901 INFO:tasks.workunit.client.0.smithi057.stdout:7/583: creat d6/dc/d12/d1a/d90/fca x:0 0 0 2024-02-28T16:02:15.902 INFO:tasks.workunit.client.0.smithi057.stdout:3/538: symlink d8/dd/d14/lac 0 2024-02-28T16:02:15.902 INFO:tasks.workunit.client.0.smithi057.stdout:4/574: creat d1/d10/d12/d2c/fbc x:0 0 0 2024-02-28T16:02:15.906 INFO:tasks.workunit.client.0.smithi057.stdout:7/584: chown d6/dc/d12/d1a/l5b 36435 1 2024-02-28T16:02:15.908 INFO:tasks.workunit.client.0.smithi057.stdout:1/655: dwrite d1/d3/dc/d15/d4e/d5f/fbb [4194304,4194304] 0 2024-02-28T16:02:15.909 INFO:tasks.workunit.client.0.smithi057.stdout:4/575: write d1/d10/d12/f40 [4650860,70687] 0 2024-02-28T16:02:15.910 INFO:tasks.workunit.client.0.smithi057.stdout:8/513: sync 2024-02-28T16:02:15.913 INFO:tasks.workunit.client.0.smithi057.stdout:1/656: chown d1/d21/f5b 228239 1 2024-02-28T16:02:15.914 INFO:tasks.workunit.client.0.smithi057.stdout:7/585: creat d6/dc/dab/fcb x:0 0 0 2024-02-28T16:02:15.919 INFO:tasks.workunit.client.0.smithi057.stdout:7/586: dread - d6/dc/d67/fa5 zero size 2024-02-28T16:02:15.919 INFO:tasks.workunit.client.0.smithi057.stdout:4/576: mknod d1/d10/d12/d39/db4/cbd 0 2024-02-28T16:02:15.922 INFO:tasks.workunit.client.0.smithi057.stdout:3/539: dread d8/dd/d14/d2c/f33 [0,4194304] 0 2024-02-28T16:02:15.922 INFO:tasks.workunit.client.0.smithi057.stdout:7/587: mkdir d6/dc/d12/d29/dcc 0 2024-02-28T16:02:15.925 INFO:tasks.workunit.client.0.smithi057.stdout:7/588: mknod d6/d26/ccd 0 2024-02-28T16:02:15.928 INFO:tasks.workunit.client.0.smithi057.stdout:3/540: mknod d8/dd/d14/d2e/d30/d5f/d6b/cad 0 2024-02-28T16:02:15.931 INFO:tasks.workunit.client.0.smithi057.stdout:7/589: truncate d6/dc/d12/f21 798797 0 2024-02-28T16:02:15.932 INFO:tasks.workunit.client.0.smithi057.stdout:4/577: dread d1/d10/d12/f81 [0,4194304] 0 2024-02-28T16:02:15.932 INFO:tasks.workunit.client.0.smithi057.stdout:3/541: creat d8/dd/d19/d25/fae x:0 0 0 2024-02-28T16:02:15.934 INFO:tasks.workunit.client.0.smithi057.stdout:7/590: write d6/d26/f36 [1588222,12313] 0 2024-02-28T16:02:15.937 INFO:tasks.workunit.client.0.smithi057.stdout:4/578: read d1/d10/fa4 [134849,93725] 0 2024-02-28T16:02:15.940 INFO:tasks.workunit.client.0.smithi057.stdout:8/514: dwrite d5/d20/d39/f42 [0,4194304] 0 2024-02-28T16:02:15.943 INFO:tasks.workunit.client.0.smithi057.stdout:1/657: dwrite d1/d3/f11 [0,4194304] 0 2024-02-28T16:02:15.945 INFO:tasks.workunit.client.0.smithi057.stdout:8/515: dread d5/f7 [0,4194304] 0 2024-02-28T16:02:15.945 INFO:tasks.workunit.client.0.smithi057.stdout:5/608: sync 2024-02-28T16:02:15.945 INFO:tasks.workunit.client.0.smithi057.stdout:9/678: sync 2024-02-28T16:02:15.946 INFO:tasks.workunit.client.0.smithi057.stdout:1/658: chown d1/d21/d66/d53/d7d/d67/d7a 789 1 2024-02-28T16:02:15.949 INFO:tasks.workunit.client.0.smithi057.stdout:5/609: chown d2/d12/d76/d7a/d95/db5/dcb/dab/fb3 21069 1 2024-02-28T16:02:15.951 INFO:tasks.workunit.client.0.smithi057.stdout:3/542: rename d8/dd/d14/d2e/d76/da1/ca4 to d8/dd/d19/d25/caf 0 2024-02-28T16:02:15.952 INFO:tasks.workunit.client.0.smithi057.stdout:3/543: readlink d8/dd/l10 0 2024-02-28T16:02:15.956 INFO:tasks.workunit.client.0.smithi057.stdout:7/591: mkdir d6/dc/d12/dc9/dce 0 2024-02-28T16:02:15.957 INFO:tasks.workunit.client.0.smithi057.stdout:4/579: rmdir d1/d10/d12/d2c 39 2024-02-28T16:02:15.958 INFO:tasks.workunit.client.0.smithi057.stdout:5/610: mknod d2/d12/d76/d7a/d95/db5/dcb/dab/cde 0 2024-02-28T16:02:15.960 INFO:tasks.workunit.client.0.smithi057.stdout:3/544: rename d8/dd/d19/d25/l28 to d8/dd/d14/d2e/d2f/lb0 0 2024-02-28T16:02:15.964 INFO:tasks.workunit.client.0.smithi057.stdout:8/516: creat d5/fab x:0 0 0 2024-02-28T16:02:15.964 INFO:tasks.workunit.client.0.smithi057.stdout:3/545: mkdir d8/dd/d19/db1 0 2024-02-28T16:02:15.965 INFO:tasks.workunit.client.0.smithi057.stdout:9/679: write d2/d46/f66 [3066709,93879] 0 2024-02-28T16:02:15.970 INFO:tasks.workunit.client.0.smithi057.stdout:8/517: chown d5/de/d1b/d4b/f73 13038923 1 2024-02-28T16:02:15.970 INFO:tasks.workunit.client.0.smithi057.stdout:9/680: write d2/d5e/d65/f73 [5214960,9566] 0 2024-02-28T16:02:15.971 INFO:tasks.workunit.client.0.smithi057.stdout:5/611: getdents d2/d15/d63 0 2024-02-28T16:02:15.975 INFO:tasks.workunit.client.0.smithi057.stdout:8/518: read d5/de/d1b/f3d [3007590,123132] 0 2024-02-28T16:02:15.976 INFO:tasks.workunit.client.0.smithi057.stdout:3/546: truncate d8/dd/d14/d2e/d30/d6a/f93 3389179 0 2024-02-28T16:02:15.981 INFO:tasks.workunit.client.0.smithi057.stdout:9/681: creat d2/d24/d1d/fda x:0 0 0 2024-02-28T16:02:15.982 INFO:tasks.workunit.client.0.smithi057.stdout:5/612: read d2/d12/d76/d7a/d95/db5/dcb/f59 [670592,51333] 0 2024-02-28T16:02:15.982 INFO:tasks.workunit.client.0.smithi057.stdout:8/519: stat d5/d6/c44 0 2024-02-28T16:02:15.986 INFO:tasks.workunit.client.0.smithi057.stdout:3/547: mknod d8/dd/cb2 0 2024-02-28T16:02:15.989 INFO:tasks.workunit.client.0.smithi057.stdout:5/613: mkdir d2/d12/d5f/d77/ddf 0 2024-02-28T16:02:15.990 INFO:tasks.workunit.client.0.smithi057.stdout:7/592: dwrite d6/d38/f44 [8388608,4194304] 0 2024-02-28T16:02:15.993 INFO:tasks.workunit.client.0.smithi057.stdout:8/520: truncate d5/d62/d9f/f7d 821711 0 2024-02-28T16:02:15.995 INFO:tasks.workunit.client.0.smithi057.stdout:4/580: dread d1/d22/f24 [0,4194304] 0 2024-02-28T16:02:15.997 INFO:tasks.workunit.client.0.smithi057.stdout:7/593: dread - d6/dc/d67/d9a/da1/fbb zero size 2024-02-28T16:02:15.997 INFO:tasks.workunit.client.0.smithi057.stdout:5/614: creat d2/d15/d5e/d7f/fe0 x:0 0 0 2024-02-28T16:02:15.998 INFO:tasks.workunit.client.0.smithi057.stdout:8/521: chown d5/de/d63/d70 280 1 2024-02-28T16:02:16.002 INFO:tasks.workunit.client.0.smithi057.stdout:5/615: unlink d2/f10 0 2024-02-28T16:02:16.003 INFO:tasks.workunit.client.0.smithi057.stdout:9/682: dwrite d2/d5/f37 [0,4194304] 0 2024-02-28T16:02:16.005 INFO:tasks.workunit.client.0.smithi057.stdout:4/581: chown d1/d10/d12/d2c/d50/d93 0 1 2024-02-28T16:02:16.006 INFO:tasks.workunit.client.0.smithi057.stdout:7/594: mkdir d6/dc/dab/dcf 0 2024-02-28T16:02:16.010 INFO:tasks.workunit.client.0.smithi057.stdout:5/616: mkdir d2/d12/d3d/d8a/de1 0 2024-02-28T16:02:16.013 INFO:tasks.workunit.client.0.smithi057.stdout:9/683: rename d2/d5/d9/f6a to d2/d62/fdb 0 2024-02-28T16:02:16.015 INFO:tasks.workunit.client.0.smithi057.stdout:7/595: rmdir d6/dc/d35/da6 39 2024-02-28T16:02:16.019 INFO:tasks.workunit.client.0.smithi057.stdout:3/548: truncate d8/dd/d14/d2e/d2f/f82 3946407 0 2024-02-28T16:02:16.020 INFO:tasks.workunit.client.0.smithi057.stdout:7/596: write d6/dc/d12/f2d [4276864,22570] 0 2024-02-28T16:02:16.023 INFO:tasks.workunit.client.0.smithi057.stdout:4/582: creat d1/fbe x:0 0 0 2024-02-28T16:02:16.025 INFO:tasks.workunit.client.0.smithi057.stdout:8/522: write d5/d6/f3f [1093574,61073] 0 2024-02-28T16:02:16.027 INFO:tasks.workunit.client.0.smithi057.stdout:5/617: link d2/d12/fd6 d2/d12/d76/d7b/d62/da3/fe2 0 2024-02-28T16:02:16.028 INFO:tasks.workunit.client.0.smithi057.stdout:7/597: truncate d6/dc/d12/f5c 1060624 0 2024-02-28T16:02:16.031 INFO:tasks.workunit.client.0.smithi057.stdout:4/583: dread d1/d3f/d5f/fa5 [0,4194304] 0 2024-02-28T16:02:16.032 INFO:tasks.workunit.client.0.smithi057.stdout:3/549: rename d8/dd/f41 to d8/dd/d14/d2e/d30/d49/d51/d66/d7f/fb3 0 2024-02-28T16:02:16.033 INFO:tasks.workunit.client.0.smithi057.stdout:4/584: stat d1/d10/d31/c97 0 2024-02-28T16:02:16.033 INFO:tasks.workunit.client.0.smithi057.stdout:8/523: fsync d5/d20/d39/d49/d56/d84/f8a 0 2024-02-28T16:02:16.035 INFO:tasks.workunit.client.0.smithi057.stdout:9/684: dwrite d2/d46/f66 [0,4194304] 0 2024-02-28T16:02:16.038 INFO:tasks.workunit.client.0.smithi057.stdout:5/618: creat d2/ddc/fe3 x:0 0 0 2024-02-28T16:02:16.042 INFO:tasks.workunit.client.0.smithi057.stdout:4/585: unlink d1/d10/d12/d15/d19/cb3 0 2024-02-28T16:02:16.044 INFO:tasks.workunit.client.0.smithi057.stdout:8/524: mknod d5/d20/d39/d49/cac 0 2024-02-28T16:02:16.047 INFO:tasks.workunit.client.0.smithi057.stdout:8/525: chown d5/de/f4a 17356320 1 2024-02-28T16:02:16.048 INFO:tasks.workunit.client.0.smithi057.stdout:4/586: chown d1/d10/d12/d2c/d50/d93/fa7 60478 1 2024-02-28T16:02:16.049 INFO:tasks.workunit.client.0.smithi057.stdout:3/550: truncate d8/dd/d14/d2e/d30/f64 138846 0 2024-02-28T16:02:16.051 INFO:tasks.workunit.client.0.smithi057.stdout:8/526: rmdir d5/d62/d9f 39 2024-02-28T16:02:16.053 INFO:tasks.workunit.client.0.smithi057.stdout:7/598: dwrite d6/dc/d67/f8a [0,4194304] 0 2024-02-28T16:02:16.053 INFO:tasks.workunit.client.0.smithi057.stdout:4/587: symlink d1/d3f/lbf 0 2024-02-28T16:02:16.057 INFO:tasks.workunit.client.0.smithi057.stdout:4/588: write d1/d22/f2a [4759353,126981] 0 2024-02-28T16:02:16.059 INFO:tasks.workunit.client.0.smithi057.stdout:3/551: dread - d8/dd/d14/d2e/d30/d49/d51/d66/f79 zero size 2024-02-28T16:02:16.059 INFO:tasks.workunit.client.0.smithi057.stdout:5/619: write d2/d15/f43 [1184060,16095] 0 2024-02-28T16:02:16.065 INFO:tasks.workunit.client.0.smithi057.stdout:8/527: creat d5/de/d63/fad x:0 0 0 2024-02-28T16:02:16.068 INFO:tasks.workunit.client.0.smithi057.stdout:4/589: rmdir d1/d10/d12/d15/d19/d87 39 2024-02-28T16:02:16.071 INFO:tasks.workunit.client.0.smithi057.stdout:3/552: creat d8/dd/d14/d2e/d30/d6a/fb4 x:0 0 0 2024-02-28T16:02:16.071 INFO:tasks.workunit.client.0.smithi057.stdout:0/736: sync 2024-02-28T16:02:16.074 INFO:tasks.workunit.client.0.smithi057.stdout:2/591: sync 2024-02-28T16:02:16.074 INFO:tasks.workunit.client.0.smithi057.stdout:6/616: sync 2024-02-28T16:02:16.076 INFO:tasks.workunit.client.0.smithi057.stdout:4/590: creat d1/d22/d64/d8c/fc0 x:0 0 0 2024-02-28T16:02:16.078 INFO:tasks.workunit.client.0.smithi057.stdout:3/553: rmdir d8/dd 39 2024-02-28T16:02:16.079 INFO:tasks.workunit.client.0.smithi057.stdout:8/528: chown d5/d62/c6d 153 1 2024-02-28T16:02:16.080 INFO:tasks.workunit.client.0.smithi057.stdout:0/737: unlink d6/fa 0 2024-02-28T16:02:16.083 INFO:tasks.workunit.client.0.smithi057.stdout:2/592: mkdir d19/d57/dc7 0 2024-02-28T16:02:16.084 INFO:tasks.workunit.client.0.smithi057.stdout:5/620: write d2/d12/d76/d7b/d62/d74/f8c [922864,116020] 0 2024-02-28T16:02:16.084 INFO:tasks.workunit.client.0.smithi057.stdout:6/617: fsync df/d10/fc8 0 2024-02-28T16:02:16.086 INFO:tasks.workunit.client.0.smithi057.stdout:8/529: chown d5/de/d1b/d57/f96 4672671 1 2024-02-28T16:02:16.087 INFO:tasks.workunit.client.0.smithi057.stdout:0/738: read - d6/d12/d45/d55/f97 zero size 2024-02-28T16:02:16.089 INFO:tasks.workunit.client.0.smithi057.stdout:7/599: dwrite d6/dc/d12/d1a/d4d/fc8 [0,4194304] 0 2024-02-28T16:02:16.091 INFO:tasks.workunit.client.0.smithi057.stdout:2/593: rename d19/d3a/l52 to d19/d57/lc8 0 2024-02-28T16:02:16.095 INFO:tasks.workunit.client.0.smithi057.stdout:5/621: mknod d2/d12/d76/d7a/ce4 0 2024-02-28T16:02:16.098 INFO:tasks.workunit.client.0.smithi057.stdout:8/530: mkdir d5/de/d1b/d45/d81/dae 0 2024-02-28T16:02:16.103 INFO:tasks.workunit.client.0.smithi057.stdout:6/618: rename df/d14 to df/d10/d78/dca 0 2024-02-28T16:02:16.107 INFO:tasks.workunit.client.0.smithi057.stdout:2/594: mknod d19/d1d/d89/cc9 0 2024-02-28T16:02:16.107 INFO:tasks.workunit.client.0.smithi057.stdout:5/622: symlink d2/dae/le5 0 2024-02-28T16:02:16.113 INFO:tasks.workunit.client.0.smithi057.stdout:7/600: mknod d6/dc/dab/dcf/cd0 0 2024-02-28T16:02:16.114 INFO:tasks.workunit.client.0.smithi057.stdout:6/619: chown df/d10/d13/f41 284229 1 2024-02-28T16:02:16.115 INFO:tasks.workunit.client.0.smithi057.stdout:0/739: dwrite f0 [4194304,4194304] 0 2024-02-28T16:02:16.115 INFO:tasks.workunit.client.0.smithi057.stdout:2/595: creat d19/d2c/d48/da2/fca x:0 0 0 2024-02-28T16:02:16.117 INFO:tasks.workunit.client.0.smithi057.stdout:6/620: dread - df/d10/f7f zero size 2024-02-28T16:02:16.118 INFO:tasks.workunit.client.0.smithi057.stdout:3/554: link d8/dd/d19/d25/f7a d8/dd/d14/d2e/d30/d49/fb5 0 2024-02-28T16:02:16.121 INFO:tasks.workunit.client.0.smithi057.stdout:8/531: mkdir d5/d20/d39/d6e/daf 0 2024-02-28T16:02:16.124 INFO:tasks.workunit.client.0.smithi057.stdout:8/532: write d5/de/d63/fad [1016211,43720] 0 2024-02-28T16:02:16.125 INFO:tasks.workunit.client.0.smithi057.stdout:4/591: truncate d1/d10/d12/d2c/d37/d46/f6a 4939178 0 2024-02-28T16:02:16.127 INFO:tasks.workunit.client.0.smithi057.stdout:2/596: chown d19/d2c/f30 108580957 1 2024-02-28T16:02:16.128 INFO:tasks.workunit.client.0.smithi057.stdout:0/740: stat d6/d12/d45/d55/c28 0 2024-02-28T16:02:16.129 INFO:tasks.workunit.client.0.smithi057.stdout:3/555: unlink d8/dd/d14/d2c/f80 0 2024-02-28T16:02:16.130 INFO:tasks.workunit.client.0.smithi057.stdout:0/741: dread - d6/d12/d45/ff4 zero size 2024-02-28T16:02:16.131 INFO:tasks.workunit.client.0.smithi057.stdout:6/621: creat df/d10/d78/dca/d15/d16/d39/d92/fcb x:0 0 0 2024-02-28T16:02:16.132 INFO:tasks.workunit.client.0.smithi057.stdout:5/623: fsync d2/d12/d76/d7a/d95/db5/dcb/f3a 0 2024-02-28T16:02:16.133 INFO:tasks.workunit.client.0.smithi057.stdout:3/556: write d8/dd/d14/d2e/d3b/d54/f99 [342867,72930] 0 2024-02-28T16:02:16.133 INFO:tasks.workunit.client.0.smithi057.stdout:8/533: stat d5/cf 0 2024-02-28T16:02:16.134 INFO:tasks.workunit.client.0.smithi057.stdout:7/601: symlink d6/dc/d12/dc9/dce/ld1 0 2024-02-28T16:02:16.136 INFO:tasks.workunit.client.0.smithi057.stdout:4/592: symlink d1/d22/d64/lc1 0 2024-02-28T16:02:16.139 INFO:tasks.workunit.client.0.smithi057.stdout:4/593: read d1/d10/d12/d2c/d37/fb2 [293049,116843] 0 2024-02-28T16:02:16.144 INFO:tasks.workunit.client.0.smithi057.stdout:6/622: write df/d10/d13/fb3 [452552,108971] 0 2024-02-28T16:02:16.148 INFO:tasks.workunit.client.0.smithi057.stdout:6/623: readlink df/d10/d78/d5b/d7b/lb4 0 2024-02-28T16:02:16.153 INFO:tasks.workunit.client.0.smithi057.stdout:4/594: creat d1/d10/d12/d2c/fc2 x:0 0 0 2024-02-28T16:02:16.157 INFO:tasks.workunit.client.0.smithi057.stdout:0/742: truncate d6/d12/d17/d34/f98 1830803 0 2024-02-28T16:02:16.159 INFO:tasks.workunit.client.0.smithi057.stdout:3/557: write d8/dd/d14/d2e/d3b/f3e [462166,76426] 0 2024-02-28T16:02:16.162 INFO:tasks.workunit.client.0.smithi057.stdout:4/595: mknod d1/d10/d12/d39/db4/cc3 0 2024-02-28T16:02:16.163 INFO:tasks.workunit.client.0.smithi057.stdout:8/534: getdents d5/d62/d9f 0 2024-02-28T16:02:16.164 INFO:tasks.workunit.client.0.smithi057.stdout:5/624: dread d2/d15/fa1 [0,4194304] 0 2024-02-28T16:02:16.165 INFO:tasks.workunit.client.0.smithi057.stdout:4/596: stat d1/d10/f71 0 2024-02-28T16:02:16.170 INFO:tasks.workunit.client.0.smithi057.stdout:1/659: sync 2024-02-28T16:02:16.172 INFO:tasks.workunit.client.0.smithi057.stdout:2/597: dwrite d19/d2c/f30 [0,4194304] 0 2024-02-28T16:02:16.176 INFO:tasks.workunit.client.0.smithi057.stdout:3/558: rename d8/f12 to d8/dd/d14/d2e/d3b/d54/fb6 0 2024-02-28T16:02:16.177 INFO:tasks.workunit.client.0.smithi057.stdout:6/624: dwrite df/f1f [0,4194304] 0 2024-02-28T16:02:16.181 INFO:tasks.workunit.client.0.smithi057.stdout:7/602: dwrite d6/dc/f10 [0,4194304] 0 2024-02-28T16:02:16.185 INFO:tasks.workunit.client.0.smithi057.stdout:8/535: link d5/l8 d5/d20/da2/d8d/lb0 0 2024-02-28T16:02:16.196 INFO:tasks.workunit.client.0.smithi057.stdout:6/625: mkdir df/d10/d13/d4b/dcc 0 2024-02-28T16:02:16.199 INFO:tasks.workunit.client.0.smithi057.stdout:7/603: unlink d6/dc/d12/dc9/dce/ld1 0 2024-02-28T16:02:16.200 INFO:tasks.workunit.client.0.smithi057.stdout:5/625: dwrite d2/f22 [4194304,4194304] 0 2024-02-28T16:02:16.205 INFO:tasks.workunit.client.0.smithi057.stdout:4/597: link d1/d22/d64/lc1 d1/d10/d12/d15/d19/d5e/lc4 0 2024-02-28T16:02:16.207 INFO:tasks.workunit.client.0.smithi057.stdout:8/536: write d5/de/d1b/f25 [637934,118540] 0 2024-02-28T16:02:16.211 INFO:tasks.workunit.client.0.smithi057.stdout:6/626: rename lb to df/d10/d78/lcd 0 2024-02-28T16:02:16.216 INFO:tasks.workunit.client.0.smithi057.stdout:0/743: dwrite d6/d12/d38/f52 [0,4194304] 0 2024-02-28T16:02:16.221 INFO:tasks.workunit.client.0.smithi057.stdout:2/598: dwrite d19/d1d/f44 [0,4194304] 0 2024-02-28T16:02:16.221 INFO:tasks.workunit.client.0.smithi057.stdout:4/598: symlink d1/d10/d12/d2c/d50/d93/lc5 0 2024-02-28T16:02:16.226 INFO:tasks.workunit.client.0.smithi057.stdout:6/627: mknod df/d10/d78/dca/cce 0 2024-02-28T16:02:16.226 INFO:tasks.workunit.client.0.smithi057.stdout:7/604: link d6/dc/c40 d6/dc/d67/d9a/da1/cd2 0 2024-02-28T16:02:16.231 INFO:tasks.workunit.client.0.smithi057.stdout:8/537: truncate d5/d20/f38 2597643 0 2024-02-28T16:02:16.231 INFO:tasks.workunit.client.0.smithi057.stdout:1/660: dwrite d1/d3/dc/d15/d4e/f98 [0,4194304] 0 2024-02-28T16:02:16.235 INFO:tasks.workunit.client.0.smithi057.stdout:7/605: creat d6/dc/d12/dc9/dce/fd3 x:0 0 0 2024-02-28T16:02:16.235 INFO:tasks.workunit.client.0.smithi057.stdout:5/626: write d2/d19/d1c/fd9 [1339073,72340] 0 2024-02-28T16:02:16.236 INFO:tasks.workunit.client.0.smithi057.stdout:1/661: stat d1/d3/dc/cd9 0 2024-02-28T16:02:16.237 INFO:tasks.workunit.client.0.smithi057.stdout:6/628: read df/d10/d78/dca/d15/d16/f46 [3631962,91687] 0 2024-02-28T16:02:16.240 INFO:tasks.workunit.client.0.smithi057.stdout:2/599: fdatasync d19/d1d/d22/f6b 0 2024-02-28T16:02:16.242 INFO:tasks.workunit.client.0.smithi057.stdout:1/662: chown d1/d21/f52 45002124 1 2024-02-28T16:02:16.246 INFO:tasks.workunit.client.0.smithi057.stdout:3/559: dwrite d8/dd/d14/d2e/d30/d49/f63 [0,4194304] 0 2024-02-28T16:02:16.246 INFO:tasks.workunit.client.0.smithi057.stdout:5/627: write d2/d8/fb6 [5228368,60497] 0 2024-02-28T16:02:16.249 INFO:tasks.workunit.client.0.smithi057.stdout:7/606: getdents d6/d38 0 2024-02-28T16:02:16.249 INFO:tasks.workunit.client.0.smithi057.stdout:2/600: truncate d19/d2c/d48/f75 4771879 0 2024-02-28T16:02:16.252 INFO:tasks.workunit.client.0.smithi057.stdout:6/629: read df/d10/d78/dca/d15/d16/f49 [2013746,33603] 0 2024-02-28T16:02:16.255 INFO:tasks.workunit.client.0.smithi057.stdout:1/663: mkdir d1/d21/d66/d53/d62/d6f/ddf 0 2024-02-28T16:02:16.261 INFO:tasks.workunit.client.0.smithi057.stdout:3/560: fdatasync d8/dd/d14/d2e/d2f/f5a 0 2024-02-28T16:02:16.262 INFO:tasks.workunit.client.0.smithi057.stdout:4/599: link d1/d3f/d5f/f83 d1/d10/d12/d15/d19/d5e/fc6 0 2024-02-28T16:02:16.262 INFO:tasks.workunit.client.0.smithi057.stdout:8/538: read d5/de/d63/fad [458100,73280] 0 2024-02-28T16:02:16.266 INFO:tasks.workunit.client.0.smithi057.stdout:7/607: symlink d6/dc/d67/ld4 0 2024-02-28T16:02:16.272 INFO:tasks.workunit.client.0.smithi057.stdout:3/561: chown d8/dd/d14/d2e/c3d 5227391 1 2024-02-28T16:02:16.276 INFO:tasks.workunit.client.0.smithi057.stdout:7/608: mkdir d6/dc/d35/d58/dd5 0 2024-02-28T16:02:16.276 INFO:tasks.workunit.client.0.smithi057.stdout:5/628: dwrite d2/d12/d76/d7a/d95/db5/dcb/d91/fcc [0,4194304] 0 2024-02-28T16:02:16.282 INFO:tasks.workunit.client.0.smithi057.stdout:6/630: rename df/d10/d78/dca/d15/l19 to df/lcf 0 2024-02-28T16:02:16.282 INFO:tasks.workunit.client.0.smithi057.stdout:4/600: creat d1/d10/d12/d15/d19/fc7 x:0 0 0 2024-02-28T16:02:16.282 INFO:tasks.workunit.client.0.smithi057.stdout:3/562: read d8/dd/d14/d2e/d30/f64 [75696,15640] 0 2024-02-28T16:02:16.283 INFO:tasks.workunit.client.0.smithi057.stdout:4/601: write d1/d10/d12/f40 [1228284,83365] 0 2024-02-28T16:02:16.285 INFO:tasks.workunit.client.0.smithi057.stdout:5/629: fsync d2/d12/d76/d7b/f96 0 2024-02-28T16:02:16.288 INFO:tasks.workunit.client.0.smithi057.stdout:4/602: dread d1/d3f/d5f/fa5 [0,4194304] 0 2024-02-28T16:02:16.290 INFO:tasks.workunit.client.0.smithi057.stdout:1/664: write d1/d3/dc/d15/d4e/d5f/fa2 [681497,25263] 0 2024-02-28T16:02:16.291 INFO:tasks.workunit.client.0.smithi057.stdout:3/563: rmdir d8/dd 39 2024-02-28T16:02:16.295 INFO:tasks.workunit.client.0.smithi057.stdout:4/603: write d1/d22/f75 [574520,20696] 0 2024-02-28T16:02:16.298 INFO:tasks.workunit.client.0.smithi057.stdout:6/631: truncate df/d10/f5c 850240 0 2024-02-28T16:02:16.300 INFO:tasks.workunit.client.0.smithi057.stdout:3/564: truncate d8/f15 1798145 0 2024-02-28T16:02:16.300 INFO:tasks.workunit.client.0.smithi057.stdout:1/665: read - d1/d21/d66/d53/d62/fb2 zero size 2024-02-28T16:02:16.305 INFO:tasks.workunit.client.0.smithi057.stdout:2/601: dwrite d19/d1d/d89/f93 [0,4194304] 0 2024-02-28T16:02:16.306 INFO:tasks.workunit.client.0.smithi057.stdout:7/609: dwrite d6/dc/d35/d58/f9e [0,4194304] 0 2024-02-28T16:02:16.312 INFO:tasks.workunit.client.0.smithi057.stdout:6/632: chown df/d10/d78/d5b/d7b/f8c 35 1 2024-02-28T16:02:16.312 INFO:tasks.workunit.client.0.smithi057.stdout:8/539: dwrite d5/d20/d39/d49/d56/f51 [0,4194304] 0 2024-02-28T16:02:16.312 INFO:tasks.workunit.client.0.smithi057.stdout:1/666: dread - d1/d3/dc/d15/d4e/fdc zero size 2024-02-28T16:02:16.313 INFO:tasks.workunit.client.0.smithi057.stdout:4/604: mkdir d1/d10/d12/d15/d19/d5e/dc8 0 2024-02-28T16:02:16.323 INFO:tasks.workunit.client.0.smithi057.stdout:7/610: unlink d6/d26/c3c 0 2024-02-28T16:02:16.325 INFO:tasks.workunit.client.0.smithi057.stdout:9/685: sync 2024-02-28T16:02:16.326 INFO:tasks.workunit.client.0.smithi057.stdout:2/602: rename d19/d1d/c77 to d19/d2c/d48/da2/ccb 0 2024-02-28T16:02:16.326 INFO:tasks.workunit.client.0.smithi057.stdout:7/611: rmdir d6/dc/d12 39 2024-02-28T16:02:16.333 INFO:tasks.workunit.client.0.smithi057.stdout:2/603: creat d19/dc1/fcc x:0 0 0 2024-02-28T16:02:16.334 INFO:tasks.workunit.client.0.smithi057.stdout:8/540: dread d5/d6/f19 [4194304,4194304] 0 2024-02-28T16:02:16.334 INFO:tasks.workunit.client.0.smithi057.stdout:5/630: dwrite d2/d12/d76/d7b/d62/da3/fd2 [0,4194304] 0 2024-02-28T16:02:16.337 INFO:tasks.workunit.client.0.smithi057.stdout:1/667: rename d1/d3/dc/d15/da3/fcc to d1/d21/fe0 0 2024-02-28T16:02:16.339 INFO:tasks.workunit.client.0.smithi057.stdout:1/668: stat d1/d21/d66/d53/d7d/l84 0 2024-02-28T16:02:16.346 INFO:tasks.workunit.client.0.smithi057.stdout:3/565: write d8/dd/d19/f5e [3949867,59476] 0 2024-02-28T16:02:16.354 INFO:tasks.workunit.client.0.smithi057.stdout:7/612: getdents d6/dc/d12/d29 0 2024-02-28T16:02:16.361 INFO:tasks.workunit.client.0.smithi057.stdout:6/633: dwrite df/d10/d13/d4b/f9d [0,4194304] 0 2024-02-28T16:02:16.361 INFO:tasks.workunit.client.0.smithi057.stdout:2/604: write fe [5002700,24118] 0 2024-02-28T16:02:16.361 INFO:tasks.workunit.client.0.smithi057.stdout:8/541: link d5/d62/f76 d5/d62/fb1 0 2024-02-28T16:02:16.364 INFO:tasks.workunit.client.0.smithi057.stdout:1/669: dwrite d1/d21/d66/d44/fce [0,4194304] 0 2024-02-28T16:02:16.364 INFO:tasks.workunit.client.0.smithi057.stdout:9/686: truncate d2/d5e/d65/d87/f94 2201482 0 2024-02-28T16:02:16.368 INFO:tasks.workunit.client.0.smithi057.stdout:8/542: stat d5/de/d1b/d4b/f73 0 2024-02-28T16:02:16.368 INFO:tasks.workunit.client.0.smithi057.stdout:6/634: write df/d10/d78/dca/f2d [3816502,2745] 0 2024-02-28T16:02:16.372 INFO:tasks.workunit.client.0.smithi057.stdout:6/635: stat df/d10/d78/dca/d15/d16/d39/d92/f93 0 2024-02-28T16:02:16.380 INFO:tasks.workunit.client.0.smithi057.stdout:3/566: write d8/d26/f7e [1393606,78617] 0 2024-02-28T16:02:16.381 INFO:tasks.workunit.client.0.smithi057.stdout:7/613: dread d6/dc/d35/d58/f74 [0,4194304] 0 2024-02-28T16:02:16.383 INFO:tasks.workunit.client.0.smithi057.stdout:5/631: dread d2/f4a [0,4194304] 0 2024-02-28T16:02:16.386 INFO:tasks.workunit.client.0.smithi057.stdout:8/543: chown d5/de/f2b 5336 1 2024-02-28T16:02:16.387 INFO:tasks.workunit.client.0.smithi057.stdout:6/636: rename df/d10/d78/dca/d15/dbc to df/d10/d78/dca/dd0 0 2024-02-28T16:02:16.388 INFO:tasks.workunit.client.0.smithi057.stdout:2/605: mknod d19/d2c/ccd 0 2024-02-28T16:02:16.390 INFO:tasks.workunit.client.0.smithi057.stdout:3/567: creat d8/dd/d14/d2e/d2f/fb7 x:0 0 0 2024-02-28T16:02:16.396 INFO:tasks.workunit.client.0.smithi057.stdout:7/614: creat d6/dc/d67/fd6 x:0 0 0 2024-02-28T16:02:16.396 INFO:tasks.workunit.client.0.smithi057.stdout:1/670: write d1/d3/dc/d15/f3e [5599970,7833] 0 2024-02-28T16:02:16.396 INFO:tasks.workunit.client.0.smithi057.stdout:2/606: write d19/d43/d5a/f6e [4562827,16437] 0 2024-02-28T16:02:16.398 INFO:tasks.workunit.client.0.smithi057.stdout:8/544: rename d5/de/d63/f64 to d5/d20/d39/d8c/fb2 0 2024-02-28T16:02:16.400 INFO:tasks.workunit.client.0.smithi057.stdout:5/632: chown d2/d15/d5e/l64 4 1 2024-02-28T16:02:16.403 INFO:tasks.workunit.client.0.smithi057.stdout:8/545: mknod d5/d20/d39/d8c/cb3 0 2024-02-28T16:02:16.404 INFO:tasks.workunit.client.0.smithi057.stdout:7/615: symlink d6/dc/d12/d1a/d4d/ld7 0 2024-02-28T16:02:16.407 INFO:tasks.workunit.client.0.smithi057.stdout:5/633: creat d2/d15/d63/fe6 x:0 0 0 2024-02-28T16:02:16.409 INFO:tasks.workunit.client.0.smithi057.stdout:8/546: creat d5/d6/fb4 x:0 0 0 2024-02-28T16:02:16.411 INFO:tasks.workunit.client.0.smithi057.stdout:1/671: creat d1/d21/d66/d44/d4c/d75/fe1 x:0 0 0 2024-02-28T16:02:16.414 INFO:tasks.workunit.client.0.smithi057.stdout:5/634: mkdir d2/d15/d63/de7 0 2024-02-28T16:02:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:8/547: creat d5/d20/d39/d59/d67/fb5 x:0 0 0 2024-02-28T16:02:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:3/568: write d8/dd/d14/d2e/d30/f69 [4987396,9541] 0 2024-02-28T16:02:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:1/672: fsync d1/d21/d66/d44/d4c/f76 0 2024-02-28T16:02:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:6/637: write df/d10/d13/f73 [956604,68796] 0 2024-02-28T16:02:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:2/607: dwrite d19/d1d/d26/fc0 [0,4194304] 0 2024-02-28T16:02:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:5/635: stat d2/d15/d5e/d9a/dac/lc9 0 2024-02-28T16:02:16.430 INFO:tasks.workunit.client.0.smithi057.stdout:3/569: creat d8/dd/d14/d2e/d76/da1/fb8 x:0 0 0 2024-02-28T16:02:16.430 INFO:tasks.workunit.client.0.smithi057.stdout:7/616: dwrite d6/dc/d12/f2d [4194304,4194304] 0 2024-02-28T16:02:16.432 INFO:tasks.workunit.client.0.smithi057.stdout:9/687: dwrite d2/d5/d1b/d2e/f2f [0,4194304] 0 2024-02-28T16:02:16.438 INFO:tasks.workunit.client.0.smithi057.stdout:5/636: write d2/d12/d76/d7b/f96 [416678,52967] 0 2024-02-28T16:02:16.438 INFO:tasks.workunit.client.0.smithi057.stdout:6/638: dread df/d10/d13/fb3 [0,4194304] 0 2024-02-28T16:02:16.441 INFO:tasks.workunit.client.0.smithi057.stdout:7/617: unlink d6/dc/d67/d9a/da1/da8/lc3 0 2024-02-28T16:02:16.442 INFO:tasks.workunit.client.0.smithi057.stdout:2/608: rmdir d19/d2c/d65/d9e 0 2024-02-28T16:02:16.443 INFO:tasks.workunit.client.0.smithi057.stdout:6/639: write df/d10/d78/fb9 [1034288,130985] 0 2024-02-28T16:02:16.445 INFO:tasks.workunit.client.0.smithi057.stdout:9/688: getdents d2/d5e/dc3 0 2024-02-28T16:02:16.449 INFO:tasks.workunit.client.0.smithi057.stdout:8/548: dread d5/de/d1b/faa [0,4194304] 0 2024-02-28T16:02:16.455 INFO:tasks.workunit.client.0.smithi057.stdout:9/689: rename d2/d5e/d65/f9b to d2/d46/d67/fdc 0 2024-02-28T16:02:16.461 INFO:tasks.workunit.client.0.smithi057.stdout:6/640: rename df/d10/d78/dca/d15/d16/f81 to df/d10/d78/dca/d15/d82/fd1 0 2024-02-28T16:02:16.464 INFO:tasks.workunit.client.0.smithi057.stdout:5/637: dwrite d2/d12/d76/d7b/f96 [0,4194304] 0 2024-02-28T16:02:16.465 INFO:tasks.workunit.client.0.smithi057.stdout:6/641: dread - df/d10/d78/f91 zero size 2024-02-28T16:02:16.468 INFO:tasks.workunit.client.0.smithi057.stdout:9/690: mkdir d2/d24/d9c/ddd 0 2024-02-28T16:02:16.469 INFO:tasks.workunit.client.0.smithi057.stdout:8/549: truncate d5/de/d1b/d57/f96 1829583 0 2024-02-28T16:02:16.470 INFO:tasks.workunit.client.0.smithi057.stdout:2/609: dwrite d19/d43/d5a/d70/fa8 [0,4194304] 0 2024-02-28T16:02:16.471 INFO:tasks.workunit.client.0.smithi057.stdout:3/570: dwrite d8/dd/d14/d2e/f67 [4194304,4194304] 0 2024-02-28T16:02:16.472 INFO:tasks.workunit.client.0.smithi057.stdout:8/550: chown d5/d6/f2d 92310 1 2024-02-28T16:02:16.473 INFO:tasks.workunit.client.0.smithi057.stdout:6/642: mknod df/d10/d78/dca/d15/d16/d39/d92/cd2 0 2024-02-28T16:02:16.474 INFO:tasks.workunit.client.0.smithi057.stdout:5/638: write d2/d12/d76/d7a/d95/db5/dce/fd4 [694717,47000] 0 2024-02-28T16:02:16.475 INFO:tasks.workunit.client.0.smithi057.stdout:9/691: fdatasync d2/d5e/d65/fd1 0 2024-02-28T16:02:16.476 INFO:tasks.workunit.client.0.smithi057.stdout:8/551: creat d5/d6/fb6 x:0 0 0 2024-02-28T16:02:16.482 INFO:tasks.workunit.client.0.smithi057.stdout:3/571: unlink d8/dd/d14/d2e/d30/f69 0 2024-02-28T16:02:16.484 INFO:tasks.workunit.client.0.smithi057.stdout:6/643: creat df/d10/d78/fd3 x:0 0 0 2024-02-28T16:02:16.485 INFO:tasks.workunit.client.0.smithi057.stdout:2/610: rename d19/d2c/d7b/c7f to d19/d1d/d22/cce 0 2024-02-28T16:02:16.487 INFO:tasks.workunit.client.0.smithi057.stdout:8/552: unlink d5/de/d1b/d57/d85/ca1 0 2024-02-28T16:02:16.494 INFO:tasks.workunit.client.0.smithi057.stdout:8/553: mkdir d5/d20/d39/d59/db7 0 2024-02-28T16:02:16.496 INFO:tasks.workunit.client.0.smithi057.stdout:6/644: getdents df/d10/d13/d4b/d4e 0 2024-02-28T16:02:16.497 INFO:tasks.workunit.client.0.smithi057.stdout:8/554: mknod d5/de/d63/d70/d8e/cb8 0 2024-02-28T16:02:16.503 INFO:tasks.workunit.client.0.smithi057.stdout:6/645: getdents df/d10/d78/dca/d15/d16/d39 0 2024-02-28T16:02:16.510 INFO:tasks.workunit.client.0.smithi057.stdout:2/611: dwrite d19/d1d/d2e/f9f [0,4194304] 0 2024-02-28T16:02:16.513 INFO:tasks.workunit.client.0.smithi057.stdout:6/646: unlink df/d10/d78/dca/d15/d16/d39/d92/da4/dad/f9e 0 2024-02-28T16:02:16.515 INFO:tasks.workunit.client.0.smithi057.stdout:2/612: mkdir d19/d2c/d65/dcf 0 2024-02-28T16:02:16.516 INFO:tasks.workunit.client.0.smithi057.stdout:8/555: dwrite d5/de/f15 [0,4194304] 0 2024-02-28T16:02:16.521 INFO:tasks.workunit.client.0.smithi057.stdout:6/647: creat df/d10/d78/dca/d15/d16/d39/fd4 x:0 0 0 2024-02-28T16:02:16.522 INFO:tasks.workunit.client.0.smithi057.stdout:9/692: write d2/d5/f30 [2620021,62225] 0 2024-02-28T16:02:16.524 INFO:tasks.workunit.client.0.smithi057.stdout:6/648: write df/d61/f62 [207205,104674] 0 2024-02-28T16:02:16.528 INFO:tasks.workunit.client.0.smithi057.stdout:6/649: write df/d10/d13/f77 [2152527,72053] 0 2024-02-28T16:02:16.529 INFO:tasks.workunit.client.0.smithi057.stdout:5/639: write d2/d19/d1c/f34 [693797,35886] 0 2024-02-28T16:02:16.530 INFO:tasks.workunit.client.0.smithi057.stdout:3/572: write d8/f18 [2885872,42298] 0 2024-02-28T16:02:16.531 INFO:tasks.workunit.client.0.smithi057.stdout:6/650: chown df/d10/c60 36 1 2024-02-28T16:02:16.532 INFO:tasks.workunit.client.0.smithi057.stdout:5/640: chown d2/d12/fc4 22440 1 2024-02-28T16:02:16.534 INFO:tasks.workunit.client.0.smithi057.stdout:9/693: creat d2/d5/d9/d64/fde x:0 0 0 2024-02-28T16:02:16.534 INFO:tasks.workunit.client.0.smithi057.stdout:6/651: stat df/d10/d13/d4b/dcc 0 2024-02-28T16:02:16.537 INFO:tasks.workunit.client.0.smithi057.stdout:3/573: write d8/dd/d19/d25/f2b [616756,52288] 0 2024-02-28T16:02:16.539 INFO:tasks.workunit.client.0.smithi057.stdout:9/694: mknod d2/d62/cdf 0 2024-02-28T16:02:16.544 INFO:tasks.workunit.client.0.smithi057.stdout:8/556: write d5/f2f [959766,61199] 0 2024-02-28T16:02:16.547 INFO:tasks.workunit.client.0.smithi057.stdout:5/641: fdatasync d2/d19/fa2 0 2024-02-28T16:02:16.547 INFO:tasks.workunit.client.0.smithi057.stdout:6/652: readlink df/d10/la9 0 2024-02-28T16:02:16.547 INFO:tasks.workunit.client.0.smithi057.stdout:3/574: mkdir d8/dd/d14/d2c/db9 0 2024-02-28T16:02:16.547 INFO:tasks.workunit.client.0.smithi057.stdout:9/695: creat d2/d5/d1b/d2e/d4c/fe0 x:0 0 0 2024-02-28T16:02:16.548 INFO:tasks.workunit.client.0.smithi057.stdout:8/557: creat d5/d20/d39/fb9 x:0 0 0 2024-02-28T16:02:16.549 INFO:tasks.workunit.client.0.smithi057.stdout:6/653: chown df/d10/f5c 11590 1 2024-02-28T16:02:16.551 INFO:tasks.workunit.client.0.smithi057.stdout:9/696: readlink d2/d5/d1b/d2e/d4c/da0/lc5 0 2024-02-28T16:02:16.552 INFO:tasks.workunit.client.0.smithi057.stdout:8/558: unlink f1 0 2024-02-28T16:02:16.553 INFO:tasks.workunit.client.0.smithi057.stdout:5/642: creat d2/d15/d63/de7/fe8 x:0 0 0 2024-02-28T16:02:16.555 INFO:tasks.workunit.client.0.smithi057.stdout:9/697: creat d2/d24/d1d/fe1 x:0 0 0 2024-02-28T16:02:16.560 INFO:tasks.workunit.client.0.smithi057.stdout:6/654: rename df/d10/d78/dca/d15/d16/d65/cc4 to df/d10/d78/d5b/d7b/cd5 0 2024-02-28T16:02:16.562 INFO:tasks.workunit.client.0.smithi057.stdout:2/613: truncate d19/f47 2097483 0 2024-02-28T16:02:16.564 INFO:tasks.workunit.client.0.smithi057.stdout:9/698: symlink d2/d5/d1b/d2e/d44/le2 0 2024-02-28T16:02:16.565 INFO:tasks.workunit.client.0.smithi057.stdout:3/575: creat d8/dd/d14/d2e/d76/d89/fba x:0 0 0 2024-02-28T16:02:16.567 INFO:tasks.workunit.client.0.smithi057.stdout:9/699: chown d2/d5/d1b/d2e/d44 49709151 1 2024-02-28T16:02:16.571 INFO:tasks.workunit.client.0.smithi057.stdout:2/614: rename d19/d1d/d89/lad to d19/d3a/ld0 0 2024-02-28T16:02:16.576 INFO:tasks.workunit.client.0.smithi057.stdout:2/615: rename d19/d3a/c42 to d19/d1d/d2e/d3c/cd1 0 2024-02-28T16:02:16.585 INFO:tasks.workunit.client.0.smithi057.stdout:8/559: dwrite d5/de/f10 [4194304,4194304] 0 2024-02-28T16:02:16.588 INFO:tasks.workunit.client.0.smithi057.stdout:3/576: dwrite d8/f15 [0,4194304] 0 2024-02-28T16:02:16.659 INFO:tasks.workunit.client.0.smithi057.stdout:9/700: getdents d2/d5e 0 2024-02-28T16:02:16.666 INFO:tasks.workunit.client.0.smithi057.stdout:8/560: creat d5/d20/d39/d59/fba x:0 0 0 2024-02-28T16:02:16.667 INFO:tasks.workunit.client.0.smithi057.stdout:5/643: dwrite d2/d8/f57 [0,4194304] 0 2024-02-28T16:02:16.670 INFO:tasks.workunit.client.0.smithi057.stdout:8/561: read d5/d6/f3f [1049554,24981] 0 2024-02-28T16:02:16.670 INFO:tasks.workunit.client.0.smithi057.stdout:3/577: truncate d8/dd/d19/d25/f2b 924657 0 2024-02-28T16:02:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:16 smithi057 ceph-mon[28763]: pgmap v40: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 68 MiB/s rd, 165 MiB/s wr, 365 op/s 2024-02-28T16:02:16.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:16 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:02:16.683 INFO:tasks.workunit.client.0.smithi057.stdout:9/701: symlink d2/d24/le3 0 2024-02-28T16:02:16.684 INFO:tasks.workunit.client.0.smithi057.stdout:8/562: fsync d5/d20/d39/d8c/fb2 0 2024-02-28T16:02:16.690 INFO:tasks.workunit.client.0.smithi057.stdout:2/616: dread d19/d1d/d2e/d3c/f3d [0,4194304] 0 2024-02-28T16:02:16.692 INFO:tasks.workunit.client.0.smithi057.stdout:5/644: dwrite d2/d15/f1f [0,4194304] 0 2024-02-28T16:02:16.696 INFO:tasks.workunit.client.0.smithi057.stdout:2/617: rmdir d19/d2c/d7b 39 2024-02-28T16:02:16.699 INFO:tasks.workunit.client.0.smithi057.stdout:8/563: dread d5/de/d63/fad [0,4194304] 0 2024-02-28T16:02:16.699 INFO:tasks.workunit.client.0.smithi057.stdout:3/578: write d8/dd/d14/d2e/d30/f40 [7519114,90953] 0 2024-02-28T16:02:16.700 INFO:tasks.workunit.client.0.smithi057.stdout:5/645: creat d2/d19/fe9 x:0 0 0 2024-02-28T16:02:16.702 INFO:tasks.workunit.client.0.smithi057.stdout:2/618: unlink d19/d1d/l21 0 2024-02-28T16:02:16.703 INFO:tasks.workunit.client.0.smithi057.stdout:9/702: write d2/d5/d9/f36 [540420,26452] 0 2024-02-28T16:02:16.703 INFO:tasks.workunit.client.0.smithi057.stdout:5/646: fsync d2/d19/d1c/f34 0 2024-02-28T16:02:16.705 INFO:tasks.workunit.client.0.smithi057.stdout:2/619: chown d19/dc1 88 1 2024-02-28T16:02:16.706 INFO:tasks.workunit.client.0.smithi057.stdout:3/579: symlink d8/dd/d14/d2e/d30/d6a/lbb 0 2024-02-28T16:02:16.708 INFO:tasks.workunit.client.0.smithi057.stdout:2/620: stat d19/f47 0 2024-02-28T16:02:16.709 INFO:tasks.workunit.client.0.smithi057.stdout:9/703: creat d2/d5/d1b/d2e/d4c/fe4 x:0 0 0 2024-02-28T16:02:16.711 INFO:tasks.workunit.client.0.smithi057.stdout:8/564: dread d5/d20/d39/d59/d67/f94 [0,4194304] 0 2024-02-28T16:02:16.714 INFO:tasks.workunit.client.0.smithi057.stdout:3/580: symlink d8/d94/lbc 0 2024-02-28T16:02:16.715 INFO:tasks.workunit.client.0.smithi057.stdout:2/621: symlink d19/d2c/d7b/ld2 0 2024-02-28T16:02:16.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:16 smithi087 ceph-mon[37122]: pgmap v40: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 68 MiB/s rd, 165 MiB/s wr, 365 op/s 2024-02-28T16:02:16.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:16 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:02:16.716 INFO:tasks.workunit.client.0.smithi057.stdout:9/704: mknod d2/d5/d9/d64/dc4/ce5 0 2024-02-28T16:02:16.717 INFO:tasks.workunit.client.0.smithi057.stdout:8/565: symlink d5/d20/d39/d6e/lbb 0 2024-02-28T16:02:16.719 INFO:tasks.workunit.client.0.smithi057.stdout:2/622: unlink d19/d2c/d7b/c80 0 2024-02-28T16:02:16.720 INFO:tasks.workunit.client.0.smithi057.stdout:2/623: dread - d19/dc1/fcc zero size 2024-02-28T16:02:16.728 INFO:tasks.workunit.client.0.smithi057.stdout:3/581: stat d8/dd/d14/d2e/d76/d89/c9c 0 2024-02-28T16:02:16.728 INFO:tasks.workunit.client.0.smithi057.stdout:8/566: unlink d5/d62/c6d 0 2024-02-28T16:02:16.728 INFO:tasks.workunit.client.0.smithi057.stdout:0/744: sync 2024-02-28T16:02:16.728 INFO:tasks.workunit.client.0.smithi057.stdout:5/647: write d2/d12/d76/d7a/d95/db5/dcb/dab/fb3 [661149,32909] 0 2024-02-28T16:02:16.729 INFO:tasks.workunit.client.0.smithi057.stdout:9/705: getdents d2/d92 0 2024-02-28T16:02:16.731 INFO:tasks.workunit.client.0.smithi057.stdout:8/567: write d5/d20/f9a [299241,77642] 0 2024-02-28T16:02:16.731 INFO:tasks.workunit.client.0.smithi057.stdout:3/582: symlink d8/dd/d14/d2e/d30/lbd 0 2024-02-28T16:02:16.733 INFO:tasks.workunit.client.0.smithi057.stdout:5/648: rmdir d2/d12/d3d/d8a 39 2024-02-28T16:02:16.734 INFO:tasks.workunit.client.0.smithi057.stdout:9/706: readlink d2/d5/d9/lcb 0 2024-02-28T16:02:16.738 INFO:tasks.workunit.client.0.smithi057.stdout:0/745: symlink d6/d12/d17/d58/db8/lfe 0 2024-02-28T16:02:16.739 INFO:tasks.workunit.client.0.smithi057.stdout:9/707: creat d2/d5/d1b/d2e/d77/fe6 x:0 0 0 2024-02-28T16:02:16.740 INFO:tasks.workunit.client.0.smithi057.stdout:5/649: truncate d2/d86/fda 194315 0 2024-02-28T16:02:16.740 INFO:tasks.workunit.client.0.smithi057.stdout:2/624: dwrite d19/d43/d5a/f6e [0,4194304] 0 2024-02-28T16:02:16.747 INFO:tasks.workunit.client.0.smithi057.stdout:2/625: unlink d19/d2c/d48/fc2 0 2024-02-28T16:02:16.754 INFO:tasks.workunit.client.0.smithi057.stdout:0/746: write d6/d4e/f33 [52876,108160] 0 2024-02-28T16:02:16.759 INFO:tasks.workunit.client.0.smithi057.stdout:3/583: dwrite d8/dd/d14/d2c/f95 [8388608,4194304] 0 2024-02-28T16:02:16.764 INFO:tasks.workunit.client.0.smithi057.stdout:9/708: creat d2/d5/fe7 x:0 0 0 2024-02-28T16:02:16.764 INFO:tasks.workunit.client.0.smithi057.stdout:0/747: creat d6/d12/d17/d58/db8/fff x:0 0 0 2024-02-28T16:02:16.764 INFO:tasks.workunit.client.0.smithi057.stdout:5/650: getdents d2/d12/d76/d7b/d62 0 2024-02-28T16:02:16.767 INFO:tasks.workunit.client.0.smithi057.stdout:0/748: stat d6/d12/d45/d78 0 2024-02-28T16:02:16.769 INFO:tasks.workunit.client.0.smithi057.stdout:9/709: symlink d2/d46/d67/d7d/dd0/le8 0 2024-02-28T16:02:16.770 INFO:tasks.workunit.client.0.smithi057.stdout:8/568: dwrite d5/d20/d39/d49/d56/f8f [0,4194304] 0 2024-02-28T16:02:16.784 INFO:tasks.workunit.client.0.smithi057.stdout:0/749: dread d6/fd7 [0,4194304] 0 2024-02-28T16:02:16.784 INFO:tasks.workunit.client.0.smithi057.stdout:9/710: dread d2/d5/d9/f1c [0,4194304] 0 2024-02-28T16:02:16.786 INFO:tasks.workunit.client.0.smithi057.stdout:0/750: stat d6/d12/l26 0 2024-02-28T16:02:16.789 INFO:tasks.workunit.client.0.smithi057.stdout:2/626: dread d19/d2c/d65/faa [0,4194304] 0 2024-02-28T16:02:16.792 INFO:tasks.workunit.client.0.smithi057.stdout:3/584: dwrite d8/dd/d14/d2e/d3b/d54/f5b [0,4194304] 0 2024-02-28T16:02:16.792 INFO:tasks.workunit.client.0.smithi057.stdout:5/651: dwrite d2/d3e/d5b/db0/fc0 [0,4194304] 0 2024-02-28T16:02:16.792 INFO:tasks.workunit.client.0.smithi057.stdout:0/751: creat d6/d12/d17/d58/f100 x:0 0 0 2024-02-28T16:02:16.795 INFO:tasks.workunit.client.0.smithi057.stdout:3/585: read - d8/dd/d19/d25/fae zero size 2024-02-28T16:02:16.800 INFO:tasks.workunit.client.0.smithi057.stdout:2/627: getdents d19/d1d/d2e 0 2024-02-28T16:02:16.807 INFO:tasks.workunit.client.0.smithi057.stdout:2/628: write d19/f29 [5936120,80823] 0 2024-02-28T16:02:16.808 INFO:tasks.workunit.client.0.smithi057.stdout:2/629: chown d19/d1d/f51 126 1 2024-02-28T16:02:16.817 INFO:tasks.workunit.client.0.smithi057.stdout:5/652: write d2/d12/d76/d7a/d95/db5/dcb/f4e [2729517,75594] 0 2024-02-28T16:02:16.818 INFO:tasks.workunit.client.0.smithi057.stdout:2/630: write d19/d2c/f4f [2537772,25848] 0 2024-02-28T16:02:16.827 INFO:tasks.workunit.client.0.smithi057.stdout:2/631: creat d19/d43/d5a/d70/fd3 x:0 0 0 2024-02-28T16:02:16.827 INFO:tasks.workunit.client.0.smithi057.stdout:5/653: creat d2/d12/d76/d7a/d95/db5/dcb/dab/fea x:0 0 0 2024-02-28T16:02:16.829 INFO:tasks.workunit.client.0.smithi057.stdout:9/711: dread d2/d5/fb7 [0,4194304] 0 2024-02-28T16:02:16.830 INFO:tasks.workunit.client.0.smithi057.stdout:3/586: dwrite d8/dd/d14/d2e/d30/f64 [0,4194304] 0 2024-02-28T16:02:16.833 INFO:tasks.workunit.client.0.smithi057.stdout:2/632: write d19/d1d/d2e/d31/f50 [3519513,2203] 0 2024-02-28T16:02:16.834 INFO:tasks.workunit.client.0.smithi057.stdout:0/752: dwrite d6/d12/d17/d34/f63 [0,4194304] 0 2024-02-28T16:02:16.834 INFO:tasks.workunit.client.0.smithi057.stdout:9/712: stat d2/d5e/d65/d87/fd5 0 2024-02-28T16:02:16.834 INFO:tasks.workunit.client.0.smithi057.stdout:3/587: chown d8/dd/d19/d25/l5d 9993979 1 2024-02-28T16:02:16.836 INFO:tasks.workunit.client.0.smithi057.stdout:9/713: write d2/d5e/d65/fd1 [4706767,371] 0 2024-02-28T16:02:16.838 INFO:tasks.workunit.client.0.smithi057.stdout:5/654: fsync d2/d8/f46 0 2024-02-28T16:02:16.840 INFO:tasks.workunit.client.0.smithi057.stdout:0/753: rename d6/c1f to d6/d12/d17/d92/c101 0 2024-02-28T16:02:16.840 INFO:tasks.workunit.client.0.smithi057.stdout:9/714: chown d2/d5/d1b/d2e/d77/fc0 180094 1 2024-02-28T16:02:16.842 INFO:tasks.workunit.client.0.smithi057.stdout:5/655: rmdir d2/d86 39 2024-02-28T16:02:16.847 INFO:tasks.workunit.client.0.smithi057.stdout:3/588: link d8/f18 d8/dd/d14/d2e/fbe 0 2024-02-28T16:02:16.851 INFO:tasks.workunit.client.0.smithi057.stdout:9/715: creat d2/d5e/d65/d6e/fe9 x:0 0 0 2024-02-28T16:02:16.854 INFO:tasks.workunit.client.0.smithi057.stdout:3/589: fsync d8/d4b/f60 0 2024-02-28T16:02:16.858 INFO:tasks.workunit.client.0.smithi057.stdout:9/716: chown d2/d5/d1b/d2e/f53 31160 1 2024-02-28T16:02:16.858 INFO:tasks.workunit.client.0.smithi057.stdout:0/754: link d6/d12/d38/l4c d6/d12/d5d/l102 0 2024-02-28T16:02:16.861 INFO:tasks.workunit.client.0.smithi057.stdout:3/590: symlink d8/dd/d14/d2c/db9/lbf 0 2024-02-28T16:02:16.865 INFO:tasks.workunit.client.0.smithi057.stdout:5/656: dwrite d2/d15/f43 [0,4194304] 0 2024-02-28T16:02:16.869 INFO:tasks.workunit.client.0.smithi057.stdout:3/591: creat d8/dd/d14/d2e/d30/fc0 x:0 0 0 2024-02-28T16:02:16.871 INFO:tasks.workunit.client.0.smithi057.stdout:0/755: symlink d6/d12/d17/d58/d95/daf/l103 0 2024-02-28T16:02:16.875 INFO:tasks.workunit.client.0.smithi057.stdout:5/657: unlink d2/d86/fda 0 2024-02-28T16:02:16.875 INFO:tasks.workunit.client.0.smithi057.stdout:2/633: dwrite d19/d2c/f58 [0,4194304] 0 2024-02-28T16:02:16.877 INFO:tasks.workunit.client.0.smithi057.stdout:3/592: symlink d8/dd/d14/d2e/d2f/da2/lc1 0 2024-02-28T16:02:16.885 INFO:tasks.workunit.client.0.smithi057.stdout:3/593: creat d8/dd/d14/d2c/db9/fc2 x:0 0 0 2024-02-28T16:02:16.889 INFO:tasks.workunit.client.0.smithi057.stdout:0/756: link d6/d4e/l35 d6/d12/d45/d55/de3/l104 0 2024-02-28T16:02:16.892 INFO:tasks.workunit.client.0.smithi057.stdout:3/594: creat d8/dd/d14/d2e/d3b/d54/fc3 x:0 0 0 2024-02-28T16:02:16.893 INFO:tasks.workunit.client.0.smithi057.stdout:2/634: link d19/d1d/c8a d19/d43/d5a/d9b/da3/cd4 0 2024-02-28T16:02:16.895 INFO:tasks.workunit.client.0.smithi057.stdout:0/757: mkdir d6/d12/d5d/d71/d105 0 2024-02-28T16:02:16.897 INFO:tasks.workunit.client.0.smithi057.stdout:3/595: chown d8/dd/d14/d2c/f4c 37075 1 2024-02-28T16:02:16.897 INFO:tasks.workunit.client.0.smithi057.stdout:2/635: write d19/d2c/f30 [117034,79668] 0 2024-02-28T16:02:16.898 INFO:tasks.workunit.client.0.smithi057.stdout:0/758: chown d6/fd 16626763 1 2024-02-28T16:02:16.900 INFO:tasks.workunit.client.0.smithi057.stdout:9/717: dwrite d2/f3a [0,4194304] 0 2024-02-28T16:02:16.902 INFO:tasks.workunit.client.0.smithi057.stdout:0/759: chown d6/d12/d17/d58/cc3 6054 1 2024-02-28T16:02:16.904 INFO:tasks.workunit.client.0.smithi057.stdout:2/636: creat d19/d57/dc7/fd5 x:0 0 0 2024-02-28T16:02:16.904 INFO:tasks.workunit.client.0.smithi057.stdout:0/760: chown d6/d12/d5d/c66 0 1 2024-02-28T16:02:16.905 INFO:tasks.workunit.client.0.smithi057.stdout:9/718: mkdir d2/d5/dd8/dea 0 2024-02-28T16:02:16.910 INFO:tasks.workunit.client.0.smithi057.stdout:5/658: dwrite d2/d15/d5e/d67/fbe [0,4194304] 0 2024-02-28T16:02:16.911 INFO:tasks.workunit.client.0.smithi057.stdout:2/637: getdents d19/d2c/d65 0 2024-02-28T16:02:16.914 INFO:tasks.workunit.client.0.smithi057.stdout:9/719: rename d2/d5/d1b/d2e/d77/faf to d2/d5/d9/d5d/d70/feb 0 2024-02-28T16:02:16.918 INFO:tasks.workunit.client.0.smithi057.stdout:9/720: chown d2/d5/d1b/d2e/d44 0 1 2024-02-28T16:02:16.921 INFO:tasks.workunit.client.0.smithi057.stdout:5/659: rename d2/d12/fb7 to d2/ddc/feb 0 2024-02-28T16:02:16.922 INFO:tasks.workunit.client.0.smithi057.stdout:2/638: getdents d19/d1d/d2e/d31/db1 0 2024-02-28T16:02:16.926 INFO:tasks.workunit.client.0.smithi057.stdout:2/639: unlink d19/d2c/f56 0 2024-02-28T16:02:16.928 INFO:tasks.workunit.client.0.smithi057.stdout:2/640: fsync d19/d1d/d2e/d3c/f79 0 2024-02-28T16:02:16.931 INFO:tasks.workunit.client.0.smithi057.stdout:3/596: write d8/dd/d14/d2e/d30/f8b [84082,59647] 0 2024-02-28T16:02:16.931 INFO:tasks.workunit.client.0.smithi057.stdout:0/761: write d6/d12/d45/d78/fcf [3083332,107183] 0 2024-02-28T16:02:16.932 INFO:tasks.workunit.client.0.smithi057.stdout:5/660: rename d2/d8/fb6 to d2/d12/d76/d7a/d95/db5/dcb/fec 0 2024-02-28T16:02:16.934 INFO:tasks.workunit.client.0.smithi057.stdout:2/641: mkdir d19/d57/dc7/dd6 0 2024-02-28T16:02:16.935 INFO:tasks.workunit.client.0.smithi057.stdout:4/605: sync 2024-02-28T16:02:16.935 INFO:tasks.workunit.client.0.smithi057.stdout:1/673: sync 2024-02-28T16:02:16.937 INFO:tasks.workunit.client.0.smithi057.stdout:2/642: write d19/d43/f92 [3689326,57366] 0 2024-02-28T16:02:16.939 INFO:tasks.workunit.client.0.smithi057.stdout:5/661: mknod d2/dae/ced 0 2024-02-28T16:02:16.941 INFO:tasks.workunit.client.0.smithi057.stdout:4/606: creat d1/d10/d31/d86/fc9 x:0 0 0 2024-02-28T16:02:16.942 INFO:tasks.workunit.client.0.smithi057.stdout:1/674: write d1/d21/d66/d53/d7d/d65/fa5 [974317,76162] 0 2024-02-28T16:02:16.942 INFO:tasks.workunit.client.0.smithi057.stdout:3/597: link d8/d26/c4f d8/dd/d14/d2e/d30/d6a/d8c/cc4 0 2024-02-28T16:02:16.952 INFO:tasks.workunit.client.0.smithi057.stdout:3/598: creat d8/dd/d19/db1/fc5 x:0 0 0 2024-02-28T16:02:16.954 INFO:tasks.workunit.client.0.smithi057.stdout:9/721: dread d2/f20 [0,4194304] 0 2024-02-28T16:02:16.955 INFO:tasks.workunit.client.0.smithi057.stdout:1/675: rename d1/d3/dc/d15/l72 to d1/d3/dc/d15/d4e/d5f/dbe/le2 0 2024-02-28T16:02:16.955 INFO:tasks.workunit.client.0.smithi057.stdout:3/599: chown d8/dd/d14/d2e/fbe 1293799 1 2024-02-28T16:02:16.956 INFO:tasks.workunit.client.0.smithi057.stdout:5/662: truncate d2/ddc/feb 4314420 0 2024-02-28T16:02:16.961 INFO:tasks.workunit.client.0.smithi057.stdout:9/722: write d2/d24/d1d/fa6 [180182,66146] 0 2024-02-28T16:02:16.963 INFO:tasks.workunit.client.0.smithi057.stdout:1/676: mknod d1/d21/d66/d44/d4c/d75/ce3 0 2024-02-28T16:02:16.965 INFO:tasks.workunit.client.0.smithi057.stdout:3/600: mkdir d8/dd/d14/d2e/d30/d49/d51/dc6 0 2024-02-28T16:02:16.966 INFO:tasks.workunit.client.0.smithi057.stdout:9/723: unlink d2/d5e/f9a 0 2024-02-28T16:02:16.968 INFO:tasks.workunit.client.0.smithi057.stdout:1/677: chown d1/d21/d66/d44/l4b 271 1 2024-02-28T16:02:16.968 INFO:tasks.workunit.client.0.smithi057.stdout:5/663: mknod d2/d12/d76/d7a/d95/db5/dcb/cee 0 2024-02-28T16:02:16.971 INFO:tasks.workunit.client.0.smithi057.stdout:2/643: dread d19/d3a/f46 [0,4194304] 0 2024-02-28T16:02:16.971 INFO:tasks.workunit.client.0.smithi057.stdout:1/678: chown d1/d3/dc/d40 1 1 2024-02-28T16:02:16.972 INFO:tasks.workunit.client.0.smithi057.stdout:9/724: write d2/d24/d1d/fa6 [931336,103355] 0 2024-02-28T16:02:16.973 INFO:tasks.workunit.client.0.smithi057.stdout:4/607: dread d1/d10/d12/f40 [0,4194304] 0 2024-02-28T16:02:16.973 INFO:tasks.workunit.client.0.smithi057.stdout:0/762: dwrite d6/d12/d45/f4f [0,4194304] 0 2024-02-28T16:02:16.973 INFO:tasks.workunit.client.0.smithi057.stdout:3/601: symlink d8/dd/d14/d2e/d30/d49/lc7 0 2024-02-28T16:02:16.974 INFO:tasks.workunit.client.0.smithi057.stdout:6/655: sync 2024-02-28T16:02:16.974 INFO:tasks.workunit.client.0.smithi057.stdout:7/618: sync 2024-02-28T16:02:16.977 INFO:tasks.workunit.client.0.smithi057.stdout:0/763: readlink d6/d12/da4/lda 0 2024-02-28T16:02:16.981 INFO:tasks.workunit.client.0.smithi057.stdout:1/679: dread - d1/d21/d66/d53/d7d/fd8 zero size 2024-02-28T16:02:16.981 INFO:tasks.workunit.client.0.smithi057.stdout:9/725: symlink d2/d46/d67/d7d/lec 0 2024-02-28T16:02:16.983 INFO:tasks.workunit.client.0.smithi057.stdout:3/602: unlink d8/fa 0 2024-02-28T16:02:16.986 INFO:tasks.workunit.client.0.smithi057.stdout:4/608: rename d1/d10/d12/d15/c18 to d1/d10/d12/d15/d19/d5e/cca 0 2024-02-28T16:02:16.986 INFO:tasks.workunit.client.0.smithi057.stdout:6/656: write df/d10/d78/dca/d15/d16/d39/d92/da4/dad/f9a [343511,19577] 0 2024-02-28T16:02:16.991 INFO:tasks.workunit.client.0.smithi057.stdout:1/680: symlink d1/d3/le4 0 2024-02-28T16:02:16.993 INFO:tasks.workunit.client.0.smithi057.stdout:3/603: fsync d8/d4b/f60 0 2024-02-28T16:02:16.995 INFO:tasks.workunit.client.0.smithi057.stdout:4/609: mkdir d1/d22/dcb 0 2024-02-28T16:02:16.997 INFO:tasks.workunit.client.0.smithi057.stdout:9/726: unlink d2/d62/fc8 0 2024-02-28T16:02:17.000 INFO:tasks.workunit.client.0.smithi057.stdout:2/644: dread d19/d43/d5a/d70/fa8 [0,4194304] 0 2024-02-28T16:02:17.000 INFO:tasks.workunit.client.0.smithi057.stdout:1/681: creat d1/d21/d66/d44/d4c/fe5 x:0 0 0 2024-02-28T16:02:17.002 INFO:tasks.workunit.client.0.smithi057.stdout:5/664: truncate d2/d15/f43 2577129 0 2024-02-28T16:02:17.002 INFO:tasks.workunit.client.0.smithi057.stdout:1/682: chown d1/d21/d66/d53/c6e 60143770 1 2024-02-28T16:02:17.003 INFO:tasks.workunit.client.0.smithi057.stdout:0/764: link d6/d12/d17/fb5 d6/d12/d17/d34/f106 0 2024-02-28T16:02:17.007 INFO:tasks.workunit.client.0.smithi057.stdout:0/765: write d6/d12/d17/d58/db8/fff [449628,51281] 0 2024-02-28T16:02:17.011 INFO:tasks.workunit.client.0.smithi057.stdout:2/645: symlink d19/d1d/d26/ld7 0 2024-02-28T16:02:17.011 INFO:tasks.workunit.client.0.smithi057.stdout:6/657: getdents df/d10/d13/d4b/d4e 0 2024-02-28T16:02:17.011 INFO:tasks.workunit.client.0.smithi057.stdout:0/766: dread - d6/d12/d45/ff8 zero size 2024-02-28T16:02:17.013 INFO:tasks.workunit.client.0.smithi057.stdout:3/604: symlink d8/dd/d14/d2e/lc8 0 2024-02-28T16:02:17.016 INFO:tasks.workunit.client.0.smithi057.stdout:3/605: readlink d8/dd/d14/d2e/d2f/l59 0 2024-02-28T16:02:17.020 INFO:tasks.workunit.client.0.smithi057.stdout:6/658: mkdir df/d10/d78/dd6 0 2024-02-28T16:02:17.023 INFO:tasks.workunit.client.0.smithi057.stdout:9/727: truncate d2/d5e/d65/d6e/fe9 725094 0 2024-02-28T16:02:17.023 INFO:tasks.workunit.client.0.smithi057.stdout:5/665: dwrite d2/d15/d5e/d6d/fcf [0,4194304] 0 2024-02-28T16:02:17.029 INFO:tasks.workunit.client.0.smithi057.stdout:4/610: getdents d1/d10/d31/d36 0 2024-02-28T16:02:17.031 INFO:tasks.workunit.client.0.smithi057.stdout:4/611: readlink d1/d10/l90 0 2024-02-28T16:02:17.032 INFO:tasks.workunit.client.0.smithi057.stdout:0/767: write d6/d12/fd5 [332720,129688] 0 2024-02-28T16:02:17.033 INFO:tasks.workunit.client.0.smithi057.stdout:4/612: stat d1/d3f/f5d 0 2024-02-28T16:02:17.033 INFO:tasks.workunit.client.0.smithi057.stdout:9/728: dread - d2/d5/d1b/d2e/f45 zero size 2024-02-28T16:02:17.036 INFO:tasks.workunit.client.0.smithi057.stdout:6/659: mkdir df/d10/d78/dca/d15/d82/dd7 0 2024-02-28T16:02:17.036 INFO:tasks.workunit.client.0.smithi057.stdout:1/683: getdents d1/d3/dc/d15/d4e/d57 0 2024-02-28T16:02:17.038 INFO:tasks.workunit.client.0.smithi057.stdout:0/768: write d6/d12/d5d/de9/ff3 [475695,65185] 0 2024-02-28T16:02:17.038 INFO:tasks.workunit.client.0.smithi057.stdout:3/606: symlink d8/dd/d14/d2e/d76/d89/d6c/lc9 0 2024-02-28T16:02:17.039 INFO:tasks.workunit.client.0.smithi057.stdout:4/613: fsync d1/d22/d64/d9b/f9e 0 2024-02-28T16:02:17.040 INFO:tasks.workunit.client.0.smithi057.stdout:9/729: read d2/d5/d1b/d2e/d44/d7e/fae [3003897,87201] 0 2024-02-28T16:02:17.042 INFO:tasks.workunit.client.0.smithi057.stdout:5/666: link d2/d15/d63/fe6 d2/d12/d3d/da4/fef 0 2024-02-28T16:02:17.043 INFO:tasks.workunit.client.0.smithi057.stdout:4/614: stat d1/d10/d31/d86/caa 0 2024-02-28T16:02:17.047 INFO:tasks.workunit.client.0.smithi057.stdout:5/667: truncate d2/f22 8503470 0 2024-02-28T16:02:17.047 INFO:tasks.workunit.client.0.smithi057.stdout:0/769: creat d6/d12/d5d/d71/f107 x:0 0 0 2024-02-28T16:02:17.049 INFO:tasks.workunit.client.0.smithi057.stdout:1/684: truncate d1/d3/dc/d15/d4e/d5f/fa2 1300861 0 2024-02-28T16:02:17.050 INFO:tasks.workunit.client.0.smithi057.stdout:2/646: dread d19/d1d/f3f [0,4194304] 0 2024-02-28T16:02:17.050 INFO:tasks.workunit.client.0.smithi057.stdout:9/730: creat d2/d5/d9/d5d/fed x:0 0 0 2024-02-28T16:02:17.050 INFO:tasks.workunit.client.0.smithi057.stdout:6/660: truncate df/d61/fba 535146 0 2024-02-28T16:02:17.051 INFO:tasks.workunit.client.0.smithi057.stdout:0/770: readlink d6/d12/d17/d4b/le7 0 2024-02-28T16:02:17.055 INFO:tasks.workunit.client.0.smithi057.stdout:3/607: rename d8/dd/d14/d2e/l78 to d8/dd/d14/d2c/lca 0 2024-02-28T16:02:17.057 INFO:tasks.workunit.client.0.smithi057.stdout:4/615: rmdir d1/d10/d12/d2c/d50/d93/db7 0 2024-02-28T16:02:17.057 INFO:tasks.workunit.client.0.smithi057.stdout:9/731: chown d2/d5/d9/l19 0 1 2024-02-28T16:02:17.059 INFO:tasks.workunit.client.0.smithi057.stdout:2/647: read d19/d1d/d2e/d31/fb8 [213505,53075] 0 2024-02-28T16:02:17.063 INFO:tasks.workunit.client.0.smithi057.stdout:0/771: symlink d6/d12/d45/d55/de3/l108 0 2024-02-28T16:02:17.064 INFO:tasks.workunit.client.0.smithi057.stdout:3/608: creat d8/dd/d14/d2e/d2f/fcb x:0 0 0 2024-02-28T16:02:17.066 INFO:tasks.workunit.client.0.smithi057.stdout:2/648: write d19/d2c/d48/fba [1012828,101912] 0 2024-02-28T16:02:17.066 INFO:tasks.workunit.client.0.smithi057.stdout:5/668: getdents d2/d19/d1c 0 2024-02-28T16:02:17.068 INFO:tasks.workunit.client.0.smithi057.stdout:9/732: symlink d2/d5e/dc3/lee 0 2024-02-28T16:02:17.068 INFO:tasks.workunit.client.0.smithi057.stdout:0/772: chown d6/f65 25 1 2024-02-28T16:02:17.070 INFO:tasks.workunit.client.0.smithi057.stdout:5/669: chown d2/d3e/l40 341840094 1 2024-02-28T16:02:17.070 INFO:tasks.workunit.client.0.smithi057.stdout:3/609: chown d8/dd/d19/db1/fc5 7 1 2024-02-28T16:02:17.073 INFO:tasks.workunit.client.0.smithi057.stdout:9/733: read d2/d24/d1d/f7b [55400,17360] 0 2024-02-28T16:02:17.073 INFO:tasks.workunit.client.0.smithi057.stdout:2/649: rmdir d19/d3a 39 2024-02-28T16:02:17.078 INFO:tasks.workunit.client.0.smithi057.stdout:2/650: chown d19/d1d/d2e/d31 3594594 1 2024-02-28T16:02:17.080 INFO:tasks.workunit.client.0.smithi057.stdout:4/616: link d1/d10/d12/d2c/l94 d1/d10/d31/d36/lcc 0 2024-02-28T16:02:17.081 INFO:tasks.workunit.client.0.smithi057.stdout:2/651: stat d19/d1d/d26/fc0 0 2024-02-28T16:02:17.083 INFO:tasks.workunit.client.0.smithi057.stdout:9/734: creat d2/d5/d9/d64/dc4/fef x:0 0 0 2024-02-28T16:02:17.083 INFO:tasks.workunit.client.0.smithi057.stdout:3/610: mknod d8/dd/d14/d2e/d3b/ccc 0 2024-02-28T16:02:17.087 INFO:tasks.workunit.client.0.smithi057.stdout:1/685: dwrite d1/d21/d66/d53/d7d/d67/d7a/d92/f9d [0,4194304] 0 2024-02-28T16:02:17.087 INFO:tasks.workunit.client.0.smithi057.stdout:2/652: stat d19/d3a 0 2024-02-28T16:02:17.087 INFO:tasks.workunit.client.0.smithi057.stdout:4/617: rmdir d1/d10/d12/d15/d19 39 2024-02-28T16:02:17.091 INFO:tasks.workunit.client.0.smithi057.stdout:3/611: mkdir d8/d4b/dcd 0 2024-02-28T16:02:17.099 INFO:tasks.workunit.client.0.smithi057.stdout:6/661: dread df/d10/d13/f3a [0,4194304] 0 2024-02-28T16:02:17.099 INFO:tasks.workunit.client.0.smithi057.stdout:9/735: truncate d2/d46/d67/d7d/fa4 494903 0 2024-02-28T16:02:17.101 INFO:tasks.workunit.client.0.smithi057.stdout:3/612: fdatasync d8/dd/f1f 0 2024-02-28T16:02:17.103 INFO:tasks.workunit.client.0.smithi057.stdout:5/670: link d2/d12/d3d/l60 d2/d3e/lf0 0 2024-02-28T16:02:17.104 INFO:tasks.workunit.client.0.smithi057.stdout:2/653: read d19/f47 [1382157,101937] 0 2024-02-28T16:02:17.105 INFO:tasks.workunit.client.0.smithi057.stdout:6/662: stat df/d10/d78/f91 0 2024-02-28T16:02:17.113 INFO:tasks.workunit.client.0.smithi057.stdout:2/654: write d19/d2c/d65/faa [271624,30764] 0 2024-02-28T16:02:17.115 INFO:tasks.workunit.client.0.smithi057.stdout:1/686: dread d1/d21/d66/d53/d7d/d65/f83 [0,4194304] 0 2024-02-28T16:02:17.116 INFO:tasks.workunit.client.0.smithi057.stdout:5/671: chown d2/l6 25 1 2024-02-28T16:02:17.117 INFO:tasks.workunit.client.0.smithi057.stdout:4/618: mknod d1/d10/d12/d15/d19/ccd 0 2024-02-28T16:02:17.124 INFO:tasks.workunit.client.0.smithi057.stdout:6/663: truncate df/d10/d13/f41 312180 0 2024-02-28T16:02:17.124 INFO:tasks.workunit.client.0.smithi057.stdout:9/736: write d2/d5e/d65/d87/f9e [3462520,48265] 0 2024-02-28T16:02:17.125 INFO:tasks.workunit.client.0.smithi057.stdout:0/773: dread d6/d12/d45/f8e [4194304,4194304] 0 2024-02-28T16:02:17.126 INFO:tasks.workunit.client.0.smithi057.stdout:2/655: link d19/d3a/fb0 d19/d57/fd8 0 2024-02-28T16:02:17.128 INFO:tasks.workunit.client.0.smithi057.stdout:5/672: fdatasync d2/d12/d76/d7a/d95/db5/dcb/d91/fcc 0 2024-02-28T16:02:17.128 INFO:tasks.workunit.client.0.smithi057.stdout:9/737: stat d2/d5/d9/l19 0 2024-02-28T16:02:17.128 INFO:tasks.workunit.client.0.smithi057.stdout:1/687: getdents d1/d3/dc/d15/d4e/d57 0 2024-02-28T16:02:17.129 INFO:tasks.workunit.client.0.smithi057.stdout:8/569: sync 2024-02-28T16:02:17.132 INFO:tasks.workunit.client.0.smithi057.stdout:5/673: read - d2/d12/fd6 zero size 2024-02-28T16:02:17.133 INFO:tasks.workunit.client.0.smithi057.stdout:0/774: mknod d6/d12/d5d/de9/c109 0 2024-02-28T16:02:17.136 INFO:tasks.workunit.client.0.smithi057.stdout:6/664: chown df/d61/d7c/c80 0 1 2024-02-28T16:02:17.136 INFO:tasks.workunit.client.0.smithi057.stdout:4/619: creat d1/d10/d12/d15/d19/d87/fce x:0 0 0 2024-02-28T16:02:17.137 INFO:tasks.workunit.client.0.smithi057.stdout:2/656: symlink d19/d2c/ld9 0 2024-02-28T16:02:17.143 INFO:tasks.workunit.client.0.smithi057.stdout:6/665: write df/d10/fc8 [778745,92889] 0 2024-02-28T16:02:17.146 INFO:tasks.workunit.client.0.smithi057.stdout:9/738: symlink d2/d24/lf0 0 2024-02-28T16:02:17.146 INFO:tasks.workunit.client.0.smithi057.stdout:8/570: truncate d5/de/d1b/f25 4966105 0 2024-02-28T16:02:17.147 INFO:tasks.workunit.client.0.smithi057.stdout:5/674: mkdir d2/d12/d76/d7a/d95/db5/df1 0 2024-02-28T16:02:17.149 INFO:tasks.workunit.client.0.smithi057.stdout:2/657: fdatasync d19/d1d/d2e/f6c 0 2024-02-28T16:02:17.153 INFO:tasks.workunit.client.0.smithi057.stdout:8/571: dread - d5/d20/d39/d49/d56/f98 zero size 2024-02-28T16:02:17.156 INFO:tasks.workunit.client.0.smithi057.stdout:4/620: mknod d1/d22/dcb/ccf 0 2024-02-28T16:02:17.158 INFO:tasks.workunit.client.0.smithi057.stdout:4/621: stat d1/d3f/d5f/f83 0 2024-02-28T16:02:17.159 INFO:tasks.workunit.client.0.smithi057.stdout:9/739: chown d2/d5/d1b/d2e/d44/f4f 3547 1 2024-02-28T16:02:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:5/675: creat d2/d15/d5e/d7f/ff2 x:0 0 0 2024-02-28T16:02:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:1/688: rename d1/d21/d66/d53/d7d/d67/d6c/d82/f8d to d1/d21/d66/dc7/fe6 0 2024-02-28T16:02:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:7/619: sync 2024-02-28T16:02:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:1/689: write d1/d3/dc/d15/d4e/d57/fb9 [523586,53910] 0 2024-02-28T16:02:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:2/658: mkdir d19/d2c/d65/dda 0 2024-02-28T16:02:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:7/620: read - d6/dc/d67/d9a/da1/fbb zero size 2024-02-28T16:02:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:2/659: write d19/d1d/fc4 [19527,106067] 0 2024-02-28T16:02:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:8/572: rmdir d5/de/d63 39 2024-02-28T16:02:17.179 INFO:tasks.workunit.client.0.smithi057.stdout:0/775: write d6/d12/d17/d34/f4d [1049697,53415] 0 2024-02-28T16:02:17.180 INFO:tasks.workunit.client.0.smithi057.stdout:7/621: write d6/dc/f18 [735724,80877] 0 2024-02-28T16:02:17.181 INFO:tasks.workunit.client.0.smithi057.stdout:0/776: chown d6/fa6 2878 1 2024-02-28T16:02:17.182 INFO:tasks.workunit.client.0.smithi057.stdout:2/660: readlink d19/d2c/d48/lbf 0 2024-02-28T16:02:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:4/622: creat d1/d10/d12/d39/db4/fd0 x:0 0 0 2024-02-28T16:02:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:0/777: chown d6/d12/d17/d58/db8 4913118 1 2024-02-28T16:02:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:6/666: rename df/d10/d13/d4b/d4e/l9f to df/d10/d78/dca/d15/d16/d39/d8d/ld8 0 2024-02-28T16:02:17.191 INFO:tasks.workunit.client.0.smithi057.stdout:2/661: read d19/d43/d5a/d70/fa8 [3755422,37398] 0 2024-02-28T16:02:17.192 INFO:tasks.workunit.client.0.smithi057.stdout:4/623: chown d1/d10/d31/d86 0 1 2024-02-28T16:02:17.197 INFO:tasks.workunit.client.0.smithi057.stdout:8/573: chown d5/de/f7e 117 1 2024-02-28T16:02:17.198 INFO:tasks.workunit.client.0.smithi057.stdout:4/624: chown d1/d10/d12/d2c/fbb 71 1 2024-02-28T16:02:17.200 INFO:tasks.workunit.client.0.smithi057.stdout:7/622: symlink d6/dc/d67/d9a/ld8 0 2024-02-28T16:02:17.202 INFO:tasks.workunit.client.0.smithi057.stdout:3/613: dread d8/dd/d14/d2e/d3b/d71/f91 [0,4194304] 0 2024-02-28T16:02:17.205 INFO:tasks.workunit.client.0.smithi057.stdout:6/667: dread df/d10/d78/fb9 [0,4194304] 0 2024-02-28T16:02:17.208 INFO:tasks.workunit.client.0.smithi057.stdout:6/668: chown df/d10/d4f 1030163540 1 2024-02-28T16:02:17.211 INFO:tasks.workunit.client.0.smithi057.stdout:9/740: rename d2/d46/c76 to d2/d5/d9/d5d/d70/cf1 0 2024-02-28T16:02:17.211 INFO:tasks.workunit.client.0.smithi057.stdout:6/669: chown df/d10/l8a 1 1 2024-02-28T16:02:17.214 INFO:tasks.workunit.client.0.smithi057.stdout:0/778: mkdir d6/d12/d5d/d71/d10a 0 2024-02-28T16:02:17.217 INFO:tasks.workunit.client.0.smithi057.stdout:5/676: dwrite d2/d15/d5e/d67/fd1 [0,4194304] 0 2024-02-28T16:02:17.227 INFO:tasks.workunit.client.0.smithi057.stdout:2/662: symlink d19/d34/ldb 0 2024-02-28T16:02:17.227 INFO:tasks.workunit.client.0.smithi057.stdout:8/574: mkdir d5/de/d1b/d57/d85/dbc 0 2024-02-28T16:02:17.230 INFO:tasks.workunit.client.0.smithi057.stdout:7/623: rmdir d6/dc/dab 39 2024-02-28T16:02:17.236 INFO:tasks.workunit.client.0.smithi057.stdout:9/741: creat d2/d46/d67/d7d/ff2 x:0 0 0 2024-02-28T16:02:17.238 INFO:tasks.workunit.client.0.smithi057.stdout:6/670: dwrite df/d10/d78/dca/f2d [4194304,4194304] 0 2024-02-28T16:02:17.238 INFO:tasks.workunit.client.0.smithi057.stdout:0/779: chown d6/d12/d17/d34/f40 3 1 2024-02-28T16:02:17.240 INFO:tasks.workunit.client.0.smithi057.stdout:1/690: dread d1/d21/f52 [0,4194304] 0 2024-02-28T16:02:17.244 INFO:tasks.workunit.client.0.smithi057.stdout:9/742: write d2/d5/d9/d64/dc4/fef [570203,11464] 0 2024-02-28T16:02:17.246 INFO:tasks.workunit.client.0.smithi057.stdout:0/780: read - d6/d12/d5d/d71/f107 zero size 2024-02-28T16:02:17.247 INFO:tasks.workunit.client.0.smithi057.stdout:1/691: readlink d1/d21/d66/d44/l4b 0 2024-02-28T16:02:17.250 INFO:tasks.workunit.client.0.smithi057.stdout:5/677: dwrite d2/d19/d1c/f34 [0,4194304] 0 2024-02-28T16:02:17.257 INFO:tasks.workunit.client.0.smithi057.stdout:2/663: dwrite d19/f29 [4194304,4194304] 0 2024-02-28T16:02:17.261 INFO:tasks.workunit.client.0.smithi057.stdout:8/575: rename d5/d6/c3b to d5/de/d1b/cbd 0 2024-02-28T16:02:17.265 INFO:tasks.workunit.client.0.smithi057.stdout:7/624: mkdir d6/dc/d12/d1a/d4d/dd9 0 2024-02-28T16:02:17.269 INFO:tasks.workunit.client.0.smithi057.stdout:0/781: mkdir d6/d12/d5d/de9/d10b 0 2024-02-28T16:02:17.269 INFO:tasks.workunit.client.0.smithi057.stdout:6/671: mkdir df/d10/d78/dca/d15/d16/d39/d8d/dd9 0 2024-02-28T16:02:17.276 INFO:tasks.workunit.client.0.smithi057.stdout:4/625: dread d1/d3f/d5f/f72 [0,4194304] 0 2024-02-28T16:02:17.280 INFO:tasks.workunit.client.0.smithi057.stdout:5/678: truncate d2/d12/d76/d7a/d95/db5/dcb/f59 22451 0 2024-02-28T16:02:17.281 INFO:tasks.workunit.client.0.smithi057.stdout:0/782: write d6/d12/d38/d5e/f48 [308431,92785] 0 2024-02-28T16:02:17.282 INFO:tasks.workunit.client.0.smithi057.stdout:3/614: dread d8/dd/d14/d2e/d30/d6a/f93 [0,4194304] 0 2024-02-28T16:02:17.283 INFO:tasks.workunit.client.0.smithi057.stdout:8/576: mkdir d5/d20/dbe 0 2024-02-28T16:02:17.294 INFO:tasks.workunit.client.0.smithi057.stdout:7/625: write d6/dc/d35/da6/faf [31182,123129] 0 2024-02-28T16:02:17.297 INFO:tasks.workunit.client.0.smithi057.stdout:3/615: rmdir d8 39 2024-02-28T16:02:17.300 INFO:tasks.workunit.client.0.smithi057.stdout:9/743: dwrite d2/d5/d1b/d2e/d77/fc0 [4194304,4194304] 0 2024-02-28T16:02:17.309 INFO:tasks.workunit.client.0.smithi057.stdout:8/577: dwrite d5/d20/f9a [0,4194304] 0 2024-02-28T16:02:17.311 INFO:tasks.workunit.client.0.smithi057.stdout:1/692: link d1/d21/d66/d53/d62/d73/fcd d1/d3/dc/d40/fe7 0 2024-02-28T16:02:17.317 INFO:tasks.workunit.client.0.smithi057.stdout:6/672: rename df/d10/d78/d5b/ca8 to df/d10/d78/dca/d15/d16/d39/d8d/dd9/cda 0 2024-02-28T16:02:17.321 INFO:tasks.workunit.client.0.smithi057.stdout:1/693: chown d1/d21/d66/d53/d7d/d67/d6c/fad 384 1 2024-02-28T16:02:17.321 INFO:tasks.workunit.client.0.smithi057.stdout:9/744: dread d2/d5/d9/d5d/d82/fab [0,4194304] 0 2024-02-28T16:02:17.321 INFO:tasks.workunit.client.0.smithi057.stdout:2/664: dwrite d19/f47 [0,4194304] 0 2024-02-28T16:02:17.344 INFO:tasks.workunit.client.0.smithi057.stdout:4/626: dwrite d1/d10/d12/f7f [0,4194304] 0 2024-02-28T16:02:17.349 INFO:tasks.workunit.client.0.smithi057.stdout:6/673: readlink df/d10/d78/d5b/d7b/lbd 0 2024-02-28T16:02:17.349 INFO:tasks.workunit.client.0.smithi057.stdout:4/627: fdatasync d1/d10/d12/d2c/fc2 0 2024-02-28T16:02:17.352 INFO:tasks.workunit.client.0.smithi057.stdout:4/628: dread - d1/d22/d64/d8c/fa9 zero size 2024-02-28T16:02:17.355 INFO:tasks.workunit.client.0.smithi057.stdout:4/629: write d1/d22/f5c [3620895,23133] 0 2024-02-28T16:02:17.360 INFO:tasks.workunit.client.0.smithi057.stdout:7/626: write d6/f28 [805822,121229] 0 2024-02-28T16:02:17.363 INFO:tasks.workunit.client.0.smithi057.stdout:3/616: fdatasync d8/dd/d14/d2e/d3b/d54/f99 0 2024-02-28T16:02:17.366 INFO:tasks.workunit.client.0.smithi057.stdout:3/617: dread - d8/dd/d14/d2c/fa5 zero size 2024-02-28T16:02:17.368 INFO:tasks.workunit.client.0.smithi057.stdout:2/665: rename d19/d1d/d2e/c84 to d19/d1d/db2/cdc 0 2024-02-28T16:02:17.371 INFO:tasks.workunit.client.0.smithi057.stdout:6/674: fsync df/d10/d13/d4b/f7d 0 2024-02-28T16:02:17.374 INFO:tasks.workunit.client.0.smithi057.stdout:6/675: chown df/d10/lc3 15367219 1 2024-02-28T16:02:17.377 INFO:tasks.workunit.client.0.smithi057.stdout:6/676: write df/d10/d78/f91 [703558,34844] 0 2024-02-28T16:02:17.378 INFO:tasks.workunit.client.0.smithi057.stdout:8/578: write d5/d20/f83 [887602,15981] 0 2024-02-28T16:02:17.378 INFO:tasks.workunit.client.0.smithi057.stdout:9/745: creat d2/d5/d9/d5d/dd7/ff3 x:0 0 0 2024-02-28T16:02:17.381 INFO:tasks.workunit.client.0.smithi057.stdout:1/694: dwrite d1/d21/d66/d53/d7d/d65/f83 [0,4194304] 0 2024-02-28T16:02:17.383 INFO:tasks.workunit.client.0.smithi057.stdout:0/783: dwrite d6/d12/d17/d4b/f36 [0,4194304] 0 2024-02-28T16:02:17.385 INFO:tasks.workunit.client.0.smithi057.stdout:6/677: chown df/d10/d78/dca/d15/d16/d39/d8d 1135 1 2024-02-28T16:02:17.388 INFO:tasks.workunit.client.0.smithi057.stdout:4/630: rename d1/d22/d64 to d1/d10/d31/d86/dd1 0 2024-02-28T16:02:17.389 INFO:tasks.workunit.client.0.smithi057.stdout:4/631: chown d1/d10/d31/d86 121 1 2024-02-28T16:02:17.399 INFO:tasks.workunit.client.0.smithi057.stdout:8/579: mknod d5/de/d1b/d4b/cbf 0 2024-02-28T16:02:17.399 INFO:tasks.workunit.client.0.smithi057.stdout:1/695: read d1/d3/dc/f12 [1182723,86899] 0 2024-02-28T16:02:17.402 INFO:tasks.workunit.client.0.smithi057.stdout:2/666: read d19/d1d/d2e/d31/f40 [6996739,36552] 0 2024-02-28T16:02:17.406 INFO:tasks.workunit.client.0.smithi057.stdout:0/784: write d6/d12/d45/d55/f97 [127812,5020] 0 2024-02-28T16:02:17.408 INFO:tasks.workunit.client.0.smithi057.stdout:9/746: creat d2/d5e/ff4 x:0 0 0 2024-02-28T16:02:17.411 INFO:tasks.workunit.client.0.smithi057.stdout:6/678: getdents df/d10/d78/dca/d15/d16/d39/d92 0 2024-02-28T16:02:17.412 INFO:tasks.workunit.client.0.smithi057.stdout:1/696: fsync d1/d21/d66/d53/d7d/d67/d6c/fad 0 2024-02-28T16:02:17.413 INFO:tasks.workunit.client.0.smithi057.stdout:7/627: dwrite d6/dc/d35/d58/f74 [0,4194304] 0 2024-02-28T16:02:17.415 INFO:tasks.workunit.client.0.smithi057.stdout:2/667: mkdir d19/d43/ddd 0 2024-02-28T16:02:17.420 INFO:tasks.workunit.client.0.smithi057.stdout:8/580: getdents d5/de/d63/d70/d8e 0 2024-02-28T16:02:17.421 INFO:tasks.workunit.client.0.smithi057.stdout:4/632: dwrite d1/d22/f2a [0,4194304] 0 2024-02-28T16:02:17.423 INFO:tasks.workunit.client.0.smithi057.stdout:1/697: chown d1/d3/c27 0 1 2024-02-28T16:02:17.425 INFO:tasks.workunit.client.0.smithi057.stdout:2/668: chown d19/d1d/d2e/d3c/f3d 0 1 2024-02-28T16:02:17.428 INFO:tasks.workunit.client.0.smithi057.stdout:7/628: mknod d6/dc/d12/d1a/d4d/d56/cda 0 2024-02-28T16:02:17.428 INFO:tasks.workunit.client.0.smithi057.stdout:9/747: write d2/f20 [3937491,85881] 0 2024-02-28T16:02:17.428 INFO:tasks.workunit.client.0.smithi057.stdout:4/633: readlink d1/d10/d12/d2c/d50/d93/lc5 0 2024-02-28T16:02:17.437 INFO:tasks.workunit.client.0.smithi057.stdout:2/669: symlink d19/dc1/lde 0 2024-02-28T16:02:17.437 INFO:tasks.workunit.client.0.smithi057.stdout:7/629: rmdir d6/dc/d35 39 2024-02-28T16:02:17.440 INFO:tasks.workunit.client.0.smithi057.stdout:4/634: stat d1/d10/c4f 0 2024-02-28T16:02:17.440 INFO:tasks.workunit.client.0.smithi057.stdout:9/748: symlink d2/d24/d1d/lf5 0 2024-02-28T16:02:17.442 INFO:tasks.workunit.client.0.smithi057.stdout:0/785: truncate d6/d12/d45/d55/f1e 5394590 0 2024-02-28T16:02:17.443 INFO:tasks.workunit.client.0.smithi057.stdout:2/670: write d19/d43/d5a/f6e [2778345,34782] 0 2024-02-28T16:02:17.447 INFO:tasks.workunit.client.0.smithi057.stdout:4/635: symlink d1/d10/d12/d15/d19/d5e/ld2 0 2024-02-28T16:02:17.452 INFO:tasks.workunit.client.0.smithi057.stdout:9/749: write d2/d5/d9/d5d/dd7/ff3 [640341,129255] 0 2024-02-28T16:02:17.456 INFO:tasks.workunit.client.0.smithi057.stdout:0/786: fdatasync d6/d12/d17/d34/f76 0 2024-02-28T16:02:17.457 INFO:tasks.workunit.client.0.smithi057.stdout:1/698: dwrite d1/d21/d66/d53/d7d/d65/f5a [4194304,4194304] 0 2024-02-28T16:02:17.458 INFO:tasks.workunit.client.0.smithi057.stdout:4/636: creat d1/d22/dcb/fd3 x:0 0 0 2024-02-28T16:02:17.462 INFO:tasks.workunit.client.0.smithi057.stdout:9/750: mkdir d2/d24/d9c/ddd/df6 0 2024-02-28T16:02:17.463 INFO:tasks.workunit.client.0.smithi057.stdout:6/679: dread df/d10/d78/d5b/f8f [0,4194304] 0 2024-02-28T16:02:17.466 INFO:tasks.workunit.client.0.smithi057.stdout:4/637: read d1/d22/f2a [1609414,64702] 0 2024-02-28T16:02:17.470 INFO:tasks.workunit.client.0.smithi057.stdout:9/751: dread - d2/d24/d1d/fe1 zero size 2024-02-28T16:02:17.471 INFO:tasks.workunit.client.0.smithi057.stdout:1/699: unlink d1/d21/d66/d53/d7d/fd8 0 2024-02-28T16:02:17.476 INFO:tasks.workunit.client.0.smithi057.stdout:0/787: link d6/d12/d17/d4b/f36 d6/d12/d17/f10c 0 2024-02-28T16:02:17.480 INFO:tasks.workunit.client.0.smithi057.stdout:1/700: write d1/d21/d25/f64 [5861886,26641] 0 2024-02-28T16:02:17.481 INFO:tasks.workunit.client.0.smithi057.stdout:7/630: dwrite d6/dc/d35/f83 [0,4194304] 0 2024-02-28T16:02:17.481 INFO:tasks.workunit.client.0.smithi057.stdout:2/671: dread d19/d2c/d65/faa [0,4194304] 0 2024-02-28T16:02:17.483 INFO:tasks.workunit.client.0.smithi057.stdout:8/581: dread d5/de/f10 [0,4194304] 0 2024-02-28T16:02:17.485 INFO:tasks.workunit.client.0.smithi057.stdout:4/638: symlink d1/d10/d12/d15/d19/ld4 0 2024-02-28T16:02:17.486 INFO:tasks.workunit.client.0.smithi057.stdout:8/582: chown d5/f17 4 1 2024-02-28T16:02:17.491 INFO:tasks.workunit.client.0.smithi057.stdout:2/672: creat d19/d43/d5a/fdf x:0 0 0 2024-02-28T16:02:17.495 INFO:tasks.workunit.client.0.smithi057.stdout:1/701: symlink d1/d21/d66/d53/d7d/d67/d6c/le8 0 2024-02-28T16:02:17.495 INFO:tasks.workunit.client.0.smithi057.stdout:4/639: rmdir d1/d10/d12/d2c/d50 39 2024-02-28T16:02:17.496 INFO:tasks.workunit.client.0.smithi057.stdout:8/583: mkdir d5/de/d63/d70/dc0 0 2024-02-28T16:02:17.496 INFO:tasks.workunit.client.0.smithi057.stdout:0/788: truncate d6/d12/d17/d92/fd9 1372984 0 2024-02-28T16:02:17.499 INFO:tasks.workunit.client.0.smithi057.stdout:0/789: dread - d6/d12/d17/d58/f100 zero size 2024-02-28T16:02:17.499 INFO:tasks.workunit.client.0.smithi057.stdout:7/631: creat d6/dc/d12/fdb x:0 0 0 2024-02-28T16:02:17.502 INFO:tasks.workunit.client.0.smithi057.stdout:1/702: symlink d1/le9 0 2024-02-28T16:02:17.503 INFO:tasks.workunit.client.0.smithi057.stdout:0/790: readlink d6/d12/d45/d55/l53 0 2024-02-28T16:02:17.507 INFO:tasks.workunit.client.0.smithi057.stdout:6/680: truncate df/d10/d13/d4b/f9d 1116066 0 2024-02-28T16:02:17.511 INFO:tasks.workunit.client.0.smithi057.stdout:8/584: creat d5/de/d1b/d45/d81/dae/fc1 x:0 0 0 2024-02-28T16:02:17.513 INFO:tasks.workunit.client.0.smithi057.stdout:4/640: link d1/d10/d31/l9a d1/d10/d12/d2c/d50/d93/ld5 0 2024-02-28T16:02:17.516 INFO:tasks.workunit.client.0.smithi057.stdout:9/752: dwrite d2/d5/d9/f54 [0,4194304] 0 2024-02-28T16:02:17.518 INFO:tasks.workunit.client.0.smithi057.stdout:4/641: dread - d1/d22/f7d zero size 2024-02-28T16:02:17.519 INFO:tasks.workunit.client.0.smithi057.stdout:0/791: dread d6/d12/d17/d92/fb3 [0,4194304] 0 2024-02-28T16:02:17.520 INFO:tasks.workunit.client.0.smithi057.stdout:6/681: creat df/d61/dbb/fdb x:0 0 0 2024-02-28T16:02:17.534 INFO:tasks.workunit.client.0.smithi057.stdout:1/703: dread d1/d3/dc/d15/f3e [4194304,4194304] 0 2024-02-28T16:02:17.536 INFO:tasks.workunit.client.0.smithi057.stdout:8/585: symlink d5/d62/lc2 0 2024-02-28T16:02:17.540 INFO:tasks.workunit.client.0.smithi057.stdout:6/682: fdatasync df/f74 0 2024-02-28T16:02:17.541 INFO:tasks.workunit.client.0.smithi057.stdout:0/792: read d6/d12/d45/d55/f1e [412247,20472] 0 2024-02-28T16:02:17.543 INFO:tasks.workunit.client.0.smithi057.stdout:8/586: symlink d5/d20/d39/d8c/lc3 0 2024-02-28T16:02:17.546 INFO:tasks.workunit.client.0.smithi057.stdout:1/704: rename d1/d21/d66/d53/d62/fa6 to d1/d3/dc/d15/d4e/d5f/dbe/fea 0 2024-02-28T16:02:17.547 INFO:tasks.workunit.client.0.smithi057.stdout:6/683: read df/d10/d78/d5b/d7b/fa1 [2655959,4632] 0 2024-02-28T16:02:17.547 INFO:tasks.workunit.client.0.smithi057.stdout:9/753: write d2/d24/fb8 [983784,102090] 0 2024-02-28T16:02:17.548 INFO:tasks.workunit.client.0.smithi057.stdout:7/632: dread d6/dc/d67/f8a [0,4194304] 0 2024-02-28T16:02:17.551 INFO:tasks.workunit.client.0.smithi057.stdout:0/793: mkdir d6/d12/d38/d10d 0 2024-02-28T16:02:17.553 INFO:tasks.workunit.client.0.smithi057.stdout:7/633: fdatasync d6/dc/d12/d1a/d90/fc0 0 2024-02-28T16:02:17.559 INFO:tasks.workunit.client.0.smithi057.stdout:7/634: dread - d6/dc/d67/d9a/da1/f75 zero size 2024-02-28T16:02:17.564 INFO:tasks.workunit.client.0.smithi057.stdout:4/642: dwrite d1/d22/f2a [4194304,4194304] 0 2024-02-28T16:02:17.564 INFO:tasks.workunit.client.0.smithi057.stdout:7/635: chown d6/dc/d12/d29/dcc 21090 1 2024-02-28T16:02:17.565 INFO:tasks.workunit.client.0.smithi057.stdout:8/587: dwrite d5/d20/f83 [0,4194304] 0 2024-02-28T16:02:17.567 INFO:tasks.workunit.client.0.smithi057.stdout:7/636: chown d6/dc/d67/d9a/da1 3 1 2024-02-28T16:02:17.573 INFO:tasks.workunit.client.0.smithi057.stdout:1/705: dwrite d1/d21/d66/d44/d4c/fe5 [0,4194304] 0 2024-02-28T16:02:17.574 INFO:tasks.workunit.client.0.smithi057.stdout:8/588: stat d5/de/d1b/c24 0 2024-02-28T16:02:17.578 INFO:tasks.workunit.client.0.smithi057.stdout:8/589: write d5/de/d1b/d45/d81/dae/fc1 [943107,47529] 0 2024-02-28T16:02:17.581 INFO:tasks.workunit.client.0.smithi057.stdout:1/706: read d1/d3/dc/d15/f3e [1328570,91650] 0 2024-02-28T16:02:17.581 INFO:tasks.workunit.client.0.smithi057.stdout:6/684: dwrite df/d10/d78/dca/d15/d16/f46 [0,4194304] 0 2024-02-28T16:02:17.584 INFO:tasks.workunit.client.0.smithi057.stdout:0/794: dread d6/d12/d5d/de9/ff3 [0,4194304] 0 2024-02-28T16:02:17.593 INFO:tasks.workunit.client.0.smithi057.stdout:4/643: dwrite d1/d10/d12/d39/fba [0,4194304] 0 2024-02-28T16:02:17.593 INFO:tasks.workunit.client.0.smithi057.stdout:6/685: mkdir df/d61/dbb/ddc 0 2024-02-28T16:02:17.595 INFO:tasks.workunit.client.0.smithi057.stdout:1/707: mknod d1/d3/dc/d40/ceb 0 2024-02-28T16:02:17.597 INFO:tasks.workunit.client.0.smithi057.stdout:1/708: readlink d1/d21/d66/d53/d7d/d65/l78 0 2024-02-28T16:02:17.597 INFO:tasks.workunit.client.0.smithi057.stdout:0/795: symlink d6/d12/d17/d34/db7/l10e 0 2024-02-28T16:02:17.599 INFO:tasks.workunit.client.0.smithi057.stdout:6/686: truncate df/d10/d78/fbe 840272 0 2024-02-28T16:02:17.605 INFO:tasks.workunit.client.0.smithi057.stdout:1/709: read d1/d3/fdd [4271029,43076] 0 2024-02-28T16:02:17.610 INFO:tasks.workunit.client.0.smithi057.stdout:4/644: truncate d1/d10/f78 860103 0 2024-02-28T16:02:17.615 INFO:tasks.workunit.client.0.smithi057.stdout:6/687: creat df/d10/d78/dca/d15/d16/d39/d92/da4/fdd x:0 0 0 2024-02-28T16:02:17.616 INFO:tasks.workunit.client.0.smithi057.stdout:7/637: truncate d6/dc/d35/d58/f9e 3533058 0 2024-02-28T16:02:17.618 INFO:tasks.workunit.client.0.smithi057.stdout:8/590: dread d5/de/d1b/f3d [0,4194304] 0 2024-02-28T16:02:17.621 INFO:tasks.workunit.client.0.smithi057.stdout:6/688: creat df/d61/dbb/fde x:0 0 0 2024-02-28T16:02:17.622 INFO:tasks.workunit.client.0.smithi057.stdout:7/638: rmdir d6/dc/d12/dc9 39 2024-02-28T16:02:17.623 INFO:tasks.workunit.client.0.smithi057.stdout:8/591: dread - d5/de/d1b/d45/d81/f93 zero size 2024-02-28T16:02:17.624 INFO:tasks.workunit.client.0.smithi057.stdout:6/689: write df/d61/dbb/fde [353414,5624] 0 2024-02-28T16:02:17.625 INFO:tasks.workunit.client.0.smithi057.stdout:4/645: getdents d1/d22 0 2024-02-28T16:02:17.630 INFO:tasks.workunit.client.0.smithi057.stdout:8/592: unlink d5/c52 0 2024-02-28T16:02:17.631 INFO:tasks.workunit.client.0.smithi057.stdout:8/593: chown d5/d20/d39 509 1 2024-02-28T16:02:17.634 INFO:tasks.workunit.client.0.smithi057.stdout:7/639: symlink d6/dc/d12/dc9/ldc 0 2024-02-28T16:02:17.636 INFO:tasks.workunit.client.0.smithi057.stdout:8/594: write d5/d20/d39/f42 [610492,116483] 0 2024-02-28T16:02:17.636 INFO:tasks.workunit.client.0.smithi057.stdout:4/646: truncate d1/d22/f35 4955107 0 2024-02-28T16:02:17.647 INFO:tasks.workunit.client.0.smithi057.stdout:0/796: dread d6/d4e/f77 [0,4194304] 0 2024-02-28T16:02:17.647 INFO:tasks.workunit.client.0.smithi057.stdout:6/690: dwrite df/d61/dbb/fde [0,4194304] 0 2024-02-28T16:02:17.651 INFO:tasks.workunit.client.0.smithi057.stdout:8/595: rename d5/d6/fb4 to d5/de/d1b/d45/d81/dae/fc4 0 2024-02-28T16:02:17.651 INFO:tasks.workunit.client.0.smithi057.stdout:1/710: dwrite d1/d21/f63 [0,4194304] 0 2024-02-28T16:02:17.654 INFO:tasks.workunit.client.0.smithi057.stdout:8/596: readlink d5/de/d1b/d4b/l74 0 2024-02-28T16:02:17.661 INFO:tasks.workunit.client.0.smithi057.stdout:6/691: creat df/d10/d78/dca/d15/d16/d39/d92/da4/dad/fdf x:0 0 0 2024-02-28T16:02:17.668 INFO:tasks.workunit.client.0.smithi057.stdout:8/597: rename d5/de/d1b/c61 to d5/d20/d39/d59/cc5 0 2024-02-28T16:02:17.668 INFO:tasks.workunit.client.0.smithi057.stdout:1/711: truncate d1/d3/dc/d15/d4e/d57/f77 635451 0 2024-02-28T16:02:17.671 INFO:tasks.workunit.client.0.smithi057.stdout:8/598: readlink d5/de/d1b/d4b/l71 0 2024-02-28T16:02:17.675 INFO:tasks.workunit.client.0.smithi057.stdout:7/640: dwrite d6/dc/d12/f5c [0,4194304] 0 2024-02-28T16:02:17.680 INFO:tasks.workunit.client.0.smithi057.stdout:8/599: dread d5/d62/d9f/f7d [0,4194304] 0 2024-02-28T16:02:17.685 INFO:tasks.workunit.client.0.smithi057.stdout:4/647: dwrite d1/d10/d12/d15/d19/d5e/fc6 [0,4194304] 0 2024-02-28T16:02:17.694 INFO:tasks.workunit.client.0.smithi057.stdout:6/692: dwrite df/d10/d78/dca/d15/d16/d39/d92/da4/dad/faa [0,4194304] 0 2024-02-28T16:02:17.695 INFO:tasks.workunit.client.0.smithi057.stdout:1/712: truncate d1/d21/d66/d53/fbc 412275 0 2024-02-28T16:02:17.697 INFO:tasks.workunit.client.0.smithi057.stdout:7/641: dread d6/dc/d12/f5c [0,4194304] 0 2024-02-28T16:02:17.700 INFO:tasks.workunit.client.0.smithi057.stdout:6/693: symlink df/d10/d78/dca/d15/le0 0 2024-02-28T16:02:17.701 INFO:tasks.workunit.client.0.smithi057.stdout:8/600: mknod d5/d20/d39/d49/d56/d79/cc6 0 2024-02-28T16:02:17.701 INFO:tasks.workunit.client.0.smithi057.stdout:7/642: symlink d6/dc/d12/d1a/d90/ldd 0 2024-02-28T16:02:17.703 INFO:tasks.workunit.client.0.smithi057.stdout:1/713: creat d1/d3/fec x:0 0 0 2024-02-28T16:02:17.705 INFO:tasks.workunit.client.0.smithi057.stdout:4/648: creat d1/d10/d12/fd6 x:0 0 0 2024-02-28T16:02:17.707 INFO:tasks.workunit.client.0.smithi057.stdout:8/601: rmdir d5/de/d1b 39 2024-02-28T16:02:17.710 INFO:tasks.workunit.client.0.smithi057.stdout:6/694: unlink df/d10/d78/fd3 0 2024-02-28T16:02:17.713 INFO:tasks.workunit.client.0.smithi057.stdout:1/714: chown d1/d3/dc/d15/c1d 8562 1 2024-02-28T16:02:17.713 INFO:tasks.workunit.client.0.smithi057.stdout:6/695: write df/d61/fba [402454,95890] 0 2024-02-28T16:02:17.716 INFO:tasks.workunit.client.0.smithi057.stdout:7/643: mkdir d6/dc/d12/d1a/d4d/dd9/dde 0 2024-02-28T16:02:17.717 INFO:tasks.workunit.client.0.smithi057.stdout:4/649: symlink d1/d10/d12/d15/d19/ld7 0 2024-02-28T16:02:17.717 INFO:tasks.workunit.client.0.smithi057.stdout:8/602: getdents d5/d20/dbe 0 2024-02-28T16:02:17.720 INFO:tasks.workunit.client.0.smithi057.stdout:6/696: mknod df/d10/d78/ce1 0 2024-02-28T16:02:17.722 INFO:tasks.workunit.client.0.smithi057.stdout:6/697: chown df/d10/d78/dca/d15/d82/fd1 0 1 2024-02-28T16:02:17.726 INFO:tasks.workunit.client.0.smithi057.stdout:1/715: truncate d1/d3/dc/f69 3634737 0 2024-02-28T16:02:17.727 INFO:tasks.workunit.client.0.smithi057.stdout:8/603: fsync d5/d62/f76 0 2024-02-28T16:02:17.729 INFO:tasks.workunit.client.0.smithi057.stdout:4/650: rename d1/d10/d12/d15/d19/d5e/cca to d1/d22/cd8 0 2024-02-28T16:02:17.731 INFO:tasks.workunit.client.0.smithi057.stdout:6/698: creat df/d10/d78/dca/d15/d16/d39/d92/fe2 x:0 0 0 2024-02-28T16:02:17.736 INFO:tasks.workunit.client.0.smithi057.stdout:8/604: symlink d5/de/d63/d70/lc7 0 2024-02-28T16:02:17.738 INFO:tasks.workunit.client.0.smithi057.stdout:6/699: dread df/d10/d13/d4b/d4e/f86 [0,4194304] 0 2024-02-28T16:02:17.747 INFO:tasks.workunit.client.0.smithi057.stdout:6/700: mkdir df/d10/d78/d5b/d7b/de3 0 2024-02-28T16:02:17.750 INFO:tasks.workunit.client.0.smithi057.stdout:1/716: dread d1/d3/dc/d15/d4e/d5f/f85 [0,4194304] 0 2024-02-28T16:02:17.752 INFO:tasks.workunit.client.0.smithi057.stdout:7/644: truncate d6/d26/f36 4026755 0 2024-02-28T16:02:17.752 INFO:tasks.workunit.client.0.smithi057.stdout:4/651: write d1/d10/d31/f60 [1521222,109316] 0 2024-02-28T16:02:17.755 INFO:tasks.workunit.client.0.smithi057.stdout:6/701: dread df/d10/fb1 [0,4194304] 0 2024-02-28T16:02:17.760 INFO:tasks.workunit.client.0.smithi057.stdout:1/717: rename d1/d3/dc/d15/d4e/d57/fb9 to d1/d21/d66/d44/d4c/d75/fed 0 2024-02-28T16:02:17.760 INFO:tasks.workunit.client.0.smithi057.stdout:8/605: link d5/de/d1b/l46 d5/d20/d39/d49/d56/lc8 0 2024-02-28T16:02:17.762 INFO:tasks.workunit.client.0.smithi057.stdout:1/718: stat d1/d21/d66/d44/d4c/f6b 0 2024-02-28T16:02:17.763 INFO:tasks.workunit.client.0.smithi057.stdout:4/652: mkdir d1/d10/d12/d2c/dd9 0 2024-02-28T16:02:17.764 INFO:tasks.workunit.client.0.smithi057.stdout:7/645: symlink d6/dc/d35/ldf 0 2024-02-28T16:02:17.767 INFO:tasks.workunit.client.0.smithi057.stdout:6/702: truncate df/d10/d13/d4b/f7d 139897 0 2024-02-28T16:02:17.769 INFO:tasks.workunit.client.0.smithi057.stdout:6/703: write df/d10/d78/dca/f43 [716443,93605] 0 2024-02-28T16:02:17.770 INFO:tasks.workunit.client.0.smithi057.stdout:1/719: mknod d1/d3/dc/d15/cee 0 2024-02-28T16:02:17.771 INFO:tasks.workunit.client.0.smithi057.stdout:4/653: truncate d1/d3f/d5f/f72 2045309 0 2024-02-28T16:02:17.774 INFO:tasks.workunit.client.0.smithi057.stdout:7/646: mknod d6/dc/d12/dc9/dce/ce0 0 2024-02-28T16:02:17.786 INFO:tasks.workunit.client.0.smithi057.stdout:4/654: mknod d1/d10/d12/d15/d19/d87/cda 0 2024-02-28T16:02:17.791 INFO:tasks.workunit.client.0.smithi057.stdout:8/606: write d5/de/d1b/d4b/f73 [451844,94249] 0 2024-02-28T16:02:17.792 INFO:tasks.workunit.client.0.smithi057.stdout:4/655: dread - d1/d10/d12/d2c/d50/f7b zero size 2024-02-28T16:02:17.793 INFO:tasks.workunit.client.0.smithi057.stdout:1/720: dwrite d1/d21/d66/d53/d7d/d67/d7a/d94/fba [0,4194304] 0 2024-02-28T16:02:17.795 INFO:tasks.workunit.client.0.smithi057.stdout:4/656: readlink d1/d10/d12/d15/d19/ld4 0 2024-02-28T16:02:17.797 INFO:tasks.workunit.client.0.smithi057.stdout:7/647: link d6/dc/d12/f5c d6/dc/d35/d58/dd5/fe1 0 2024-02-28T16:02:17.798 INFO:tasks.workunit.client.0.smithi057.stdout:7/648: stat d6/dc/d67/d9a/da1/fbb 0 2024-02-28T16:02:17.799 INFO:tasks.workunit.client.0.smithi057.stdout:6/704: getdents df/d10/d78/d5b 0 2024-02-28T16:02:17.809 INFO:tasks.workunit.client.0.smithi057.stdout:1/721: creat d1/d3/dc/d15/da3/fef x:0 0 0 2024-02-28T16:02:17.809 INFO:tasks.workunit.client.0.smithi057.stdout:6/705: creat df/d10/d4f/fe4 x:0 0 0 2024-02-28T16:02:17.816 INFO:tasks.workunit.client.0.smithi057.stdout:6/706: fdatasync df/d10/d78/dca/d15/d16/d39/d92/da4/dad/f9a 0 2024-02-28T16:02:17.816 INFO:tasks.workunit.client.0.smithi057.stdout:1/722: creat d1/d21/d66/d53/ff0 x:0 0 0 2024-02-28T16:02:17.820 INFO:tasks.workunit.client.0.smithi057.stdout:4/657: getdents d1/d22 0 2024-02-28T16:02:17.824 INFO:tasks.workunit.client.0.smithi057.stdout:7/649: dwrite d6/dc/d12/d1a/d90/fae [0,4194304] 0 2024-02-28T16:02:17.824 INFO:tasks.workunit.client.0.smithi057.stdout:6/707: symlink df/d10/d78/dca/d15/d16/d39/d8d/le5 0 2024-02-28T16:02:17.829 INFO:tasks.workunit.client.0.smithi057.stdout:4/658: creat d1/d10/d12/d39/db4/fdb x:0 0 0 2024-02-28T16:02:17.830 INFO:tasks.workunit.client.0.smithi057.stdout:7/650: read d6/dc/d12/f2d [6028133,37994] 0 2024-02-28T16:02:17.831 INFO:tasks.workunit.client.0.smithi057.stdout:6/708: fsync df/d10/d78/dca/d15/d16/d39/d92/fe2 0 2024-02-28T16:02:17.832 INFO:tasks.workunit.client.0.smithi057.stdout:8/607: dwrite d5/d6/f2d [4194304,4194304] 0 2024-02-28T16:02:17.842 INFO:tasks.workunit.client.0.smithi057.stdout:1/723: dwrite d1/d21/d66/d44/d4c/fd4 [0,4194304] 0 2024-02-28T16:02:17.850 INFO:tasks.workunit.client.0.smithi057.stdout:1/724: mknod d1/d3/dc/d15/da3/cf1 0 2024-02-28T16:02:17.854 INFO:tasks.workunit.client.0.smithi057.stdout:7/651: dwrite d6/d26/f50 [0,4194304] 0 2024-02-28T16:02:17.855 INFO:tasks.workunit.client.0.smithi057.stdout:1/725: symlink d1/d3/dc/d15/d4e/d57/lf2 0 2024-02-28T16:02:17.871 INFO:tasks.workunit.client.0.smithi057.stdout:7/652: dwrite d6/dc/f10 [4194304,4194304] 0 2024-02-28T16:02:17.874 INFO:tasks.workunit.client.0.smithi057.stdout:4/659: dread d1/d10/d31/f7e [0,4194304] 0 2024-02-28T16:02:17.878 INFO:tasks.workunit.client.0.smithi057.stdout:4/660: truncate d1/d10/f8e 438839 0 2024-02-28T16:02:17.881 INFO:tasks.workunit.client.0.smithi057.stdout:4/661: write d1/d10/d12/d39/fba [4294750,74352] 0 2024-02-28T16:02:17.887 INFO:tasks.workunit.client.0.smithi057.stdout:6/709: truncate df/d10/d78/d5b/f8b 980036 0 2024-02-28T16:02:17.888 INFO:tasks.workunit.client.0.smithi057.stdout:4/662: mkdir d1/d10/d12/d2c/d50/ddc 0 2024-02-28T16:02:17.894 INFO:tasks.workunit.client.0.smithi057.stdout:6/710: chown df/d10/d78/dca/d15/d16/d39/d92/da4/dad/fdf 30146266 1 2024-02-28T16:02:17.896 INFO:tasks.workunit.client.0.smithi057.stdout:4/663: creat d1/d10/d12/d2c/d50/d93/fdd x:0 0 0 2024-02-28T16:02:17.896 INFO:tasks.workunit.client.0.smithi057.stdout:8/608: dread d5/d6/f19 [0,4194304] 0 2024-02-28T16:02:17.899 INFO:tasks.workunit.client.0.smithi057.stdout:1/726: write d1/d21/d25/f33 [3614405,71733] 0 2024-02-28T16:02:17.899 INFO:tasks.workunit.client.0.smithi057.stdout:7/653: write d6/dc/f2f [1394654,92294] 0 2024-02-28T16:02:17.901 INFO:tasks.workunit.client.0.smithi057.stdout:6/711: write df/d10/d78/dca/d15/d16/d39/d92/fe2 [815395,13264] 0 2024-02-28T16:02:17.903 INFO:tasks.workunit.client.0.smithi057.stdout:8/609: symlink d5/de/d1b/d57/d85/lc9 0 2024-02-28T16:02:17.905 INFO:tasks.workunit.client.0.smithi057.stdout:7/654: creat d6/dc/d67/d9a/fe2 x:0 0 0 2024-02-28T16:02:17.906 INFO:tasks.workunit.client.0.smithi057.stdout:1/727: fsync d1/d21/d66/d53/d7d/d67/d7a/d94/fba 0 2024-02-28T16:02:17.910 INFO:tasks.workunit.client.0.smithi057.stdout:1/728: chown d1/d3/dc/d15/d4e/d5f/fa7 475 1 2024-02-28T16:02:17.910 INFO:tasks.workunit.client.0.smithi057.stdout:6/712: creat df/d10/d78/dca/d15/fe6 x:0 0 0 2024-02-28T16:02:17.912 INFO:tasks.workunit.client.0.smithi057.stdout:8/610: creat d5/d20/d39/d6e/fca x:0 0 0 2024-02-28T16:02:17.914 INFO:tasks.workunit.client.0.smithi057.stdout:7/655: creat d6/dc/d67/d9a/fe3 x:0 0 0 2024-02-28T16:02:17.917 INFO:tasks.workunit.client.0.smithi057.stdout:4/664: link d1/d10/d12/d2c/d50/c3c d1/d10/d12/d2c/d50/ddc/cde 0 2024-02-28T16:02:17.918 INFO:tasks.workunit.client.0.smithi057.stdout:4/665: stat d1/d10/d12/f7f 0 2024-02-28T16:02:17.921 INFO:tasks.workunit.client.0.smithi057.stdout:6/713: unlink df/d10/d13/f3a 0 2024-02-28T16:02:17.923 INFO:tasks.workunit.client.0.smithi057.stdout:5/679: sync 2024-02-28T16:02:17.927 INFO:tasks.workunit.client.0.smithi057.stdout:4/666: rename d1/d10/d12/d39/f8f to d1/d10/d12/d2c/d50/ddc/fdf 0 2024-02-28T16:02:17.938 INFO:tasks.workunit.client.0.smithi057.stdout:4/667: write d1/d10/d12/d2c/fbb [1301048,456] 0 2024-02-28T16:02:17.942 INFO:tasks.workunit.client.0.smithi057.stdout:6/714: dread df/d61/dbb/fde [0,4194304] 0 2024-02-28T16:02:17.943 INFO:tasks.workunit.client.0.smithi057.stdout:4/668: chown d1/d10/d12/d15/d19 32950083 1 2024-02-28T16:02:17.944 INFO:tasks.workunit.client.0.smithi057.stdout:5/680: dwrite d2/d15/d5e/d6d/f75 [4194304,4194304] 0 2024-02-28T16:02:17.952 INFO:tasks.workunit.client.0.smithi057.stdout:1/729: dread d1/d3/dc/f12 [0,4194304] 0 2024-02-28T16:02:17.952 INFO:tasks.workunit.client.0.smithi057.stdout:8/611: dwrite d5/f43 [0,4194304] 0 2024-02-28T16:02:17.952 INFO:tasks.workunit.client.0.smithi057.stdout:5/681: write d2/d12/d5f/fd8 [334220,43446] 0 2024-02-28T16:02:17.953 INFO:tasks.workunit.client.0.smithi057.stdout:6/715: symlink df/d61/dbb/le7 0 2024-02-28T16:02:17.956 INFO:tasks.workunit.client.0.smithi057.stdout:6/716: readlink df/d10/d78/dca/d15/d16/d65/lc5 0 2024-02-28T16:02:17.959 INFO:tasks.workunit.client.0.smithi057.stdout:7/656: dread d6/dc/d35/d58/f9e [0,4194304] 0 2024-02-28T16:02:17.966 INFO:tasks.workunit.client.0.smithi057.stdout:8/612: fdatasync d5/f31 0 2024-02-28T16:02:17.966 INFO:tasks.workunit.client.0.smithi057.stdout:1/730: truncate d1/d3/dc/d15/d4e/d5f/f85 2140765 0 2024-02-28T16:02:17.966 INFO:tasks.workunit.client.0.smithi057.stdout:4/669: mknod d1/d10/d12/d15/d19/d5e/dc8/ce0 0 2024-02-28T16:02:17.968 INFO:tasks.workunit.client.0.smithi057.stdout:6/717: creat df/d10/d78/dca/d15/d16/fe8 x:0 0 0 2024-02-28T16:02:17.969 INFO:tasks.workunit.client.0.smithi057.stdout:1/731: dread - d1/d3/dc/d15/da3/fbd zero size 2024-02-28T16:02:17.971 INFO:tasks.workunit.client.0.smithi057.stdout:7/657: getdents d6/dc/d12/d1a/d4d/dd9/dde 0 2024-02-28T16:02:17.971 INFO:tasks.workunit.client.0.smithi057.stdout:1/732: chown d1/d3/dc/ff 213841490 1 2024-02-28T16:02:17.972 INFO:tasks.workunit.client.0.smithi057.stdout:6/718: dread - df/d10/d78/d5b/d7b/f8c zero size 2024-02-28T16:02:17.974 INFO:tasks.workunit.client.0.smithi057.stdout:5/682: rmdir d2/d86 0 2024-02-28T16:02:17.977 INFO:tasks.workunit.client.0.smithi057.stdout:5/683: write d2/d19/fe9 [288550,68225] 0 2024-02-28T16:02:17.977 INFO:tasks.workunit.client.0.smithi057.stdout:4/670: write d1/d10/d12/f81 [3000316,128841] 0 2024-02-28T16:02:17.979 INFO:tasks.workunit.client.0.smithi057.stdout:8/613: link d5/de/d1b/f35 d5/d20/d39/d49/fcb 0 2024-02-28T16:02:17.979 INFO:tasks.workunit.client.0.smithi057.stdout:5/684: fdatasync d2/d12/d76/d7b/f96 0 2024-02-28T16:02:17.985 INFO:tasks.workunit.client.0.smithi057.stdout:4/671: dread - d1/d10/d31/d86/dd1/d8c/fc0 zero size 2024-02-28T16:02:17.985 INFO:tasks.workunit.client.0.smithi057.stdout:1/733: creat d1/d21/d66/d53/d7d/d67/d7a/d94/ff3 x:0 0 0 2024-02-28T16:02:17.986 INFO:tasks.workunit.client.0.smithi057.stdout:7/658: creat d6/dc/d12/d1a/d4d/dd9/dde/fe4 x:0 0 0 2024-02-28T16:02:18.009 INFO:tasks.workunit.client.0.smithi057.stdout:3/618: sync 2024-02-28T16:02:18.009 INFO:tasks.workunit.client.0.smithi057.stdout:2/673: sync 2024-02-28T16:02:18.012 INFO:tasks.workunit.client.0.smithi057.stdout:4/672: creat d1/d10/d12/d2c/fe1 x:0 0 0 2024-02-28T16:02:18.014 INFO:tasks.workunit.client.0.smithi057.stdout:4/673: chown d1/d10/d31/d86/dd1/d8c/fa9 818 1 2024-02-28T16:02:18.015 INFO:tasks.workunit.client.0.smithi057.stdout:6/719: getdents df/d10/d78/dca 0 2024-02-28T16:02:18.018 INFO:tasks.workunit.client.0.smithi057.stdout:1/734: symlink d1/lf4 0 2024-02-28T16:02:18.021 INFO:tasks.workunit.client.0.smithi057.stdout:3/619: mknod d8/dd/d14/d2e/d3b/d71/cce 0 2024-02-28T16:02:18.022 INFO:tasks.workunit.client.0.smithi057.stdout:7/659: symlink d6/dc/d12/d29/dcc/le5 0 2024-02-28T16:02:18.023 INFO:tasks.workunit.client.0.smithi057.stdout:4/674: symlink d1/d10/d31/d86/dd1/d8c/le2 0 2024-02-28T16:02:18.024 INFO:tasks.workunit.client.0.smithi057.stdout:6/720: mkdir df/d10/d78/dca/d15/de9 0 2024-02-28T16:02:18.025 INFO:tasks.workunit.client.0.smithi057.stdout:1/735: fsync d1/d3/dc/d40/fb1 0 2024-02-28T16:02:18.028 INFO:tasks.workunit.client.0.smithi057.stdout:1/736: write d1/d21/d25/f64 [3597313,54659] 0 2024-02-28T16:02:18.028 INFO:tasks.workunit.client.0.smithi057.stdout:2/674: write d19/d1d/d2e/d31/fb8 [2806114,14153] 0 2024-02-28T16:02:18.031 INFO:tasks.workunit.client.0.smithi057.stdout:2/675: chown d19/d57/dc7 1551 1 2024-02-28T16:02:18.033 INFO:tasks.workunit.client.0.smithi057.stdout:6/721: symlink df/d10/d78/dca/dd0/lea 0 2024-02-28T16:02:18.038 INFO:tasks.workunit.client.0.smithi057.stdout:4/675: truncate d1/d10/d12/d15/f73 2739525 0 2024-02-28T16:02:18.045 INFO:tasks.workunit.client.0.smithi057.stdout:2/676: dwrite d19/d1d/f44 [0,4194304] 0 2024-02-28T16:02:18.046 INFO:tasks.workunit.client.0.smithi057.stdout:6/722: creat df/d10/d13/d70/feb x:0 0 0 2024-02-28T16:02:18.048 INFO:tasks.workunit.client.0.smithi057.stdout:4/676: mknod d1/d10/d12/ce3 0 2024-02-28T16:02:18.050 INFO:tasks.workunit.client.0.smithi057.stdout:2/677: fdatasync d19/d2c/d48/f7d 0 2024-02-28T16:02:18.052 INFO:tasks.workunit.client.0.smithi057.stdout:2/678: fsync d19/d34/fb5 0 2024-02-28T16:02:18.052 INFO:tasks.workunit.client.0.smithi057.stdout:1/737: truncate d1/d21/d66/d53/d7d/d65/f83 4017720 0 2024-02-28T16:02:18.054 INFO:tasks.workunit.client.0.smithi057.stdout:2/679: write d19/d43/d5a/fdf [609203,26670] 0 2024-02-28T16:02:18.056 INFO:tasks.workunit.client.0.smithi057.stdout:4/677: mkdir d1/d10/d12/d39/de4 0 2024-02-28T16:02:18.061 INFO:tasks.workunit.client.0.smithi057.stdout:1/738: creat d1/d21/d66/ff5 x:0 0 0 2024-02-28T16:02:18.065 INFO:tasks.workunit.client.0.smithi057.stdout:2/680: creat d19/d43/ddd/fe0 x:0 0 0 2024-02-28T16:02:18.066 INFO:tasks.workunit.client.0.smithi057.stdout:1/739: dread d1/d21/d66/d44/d4c/f76 [0,4194304] 0 2024-02-28T16:02:18.068 INFO:tasks.workunit.client.0.smithi057.stdout:2/681: write d19/d43/d5a/f6e [1102865,52605] 0 2024-02-28T16:02:18.069 INFO:tasks.workunit.client.0.smithi057.stdout:4/678: creat d1/d10/d12/d2c/fe5 x:0 0 0 2024-02-28T16:02:18.071 INFO:tasks.workunit.client.0.smithi057.stdout:1/740: write d1/d21/d66/d53/d7d/d67/d7a/d94/fba [2283749,14889] 0 2024-02-28T16:02:18.074 INFO:tasks.workunit.client.0.smithi057.stdout:4/679: symlink d1/d10/d31/d86/dd1/d9b/le6 0 2024-02-28T16:02:18.078 INFO:tasks.workunit.client.0.smithi057.stdout:2/682: link d19/d1d/cbd d19/d57/dc7/ce1 0 2024-02-28T16:02:18.086 INFO:tasks.workunit.client.0.smithi057.stdout:2/683: rmdir d19/d57/dc7/dd6 0 2024-02-28T16:02:18.090 INFO:tasks.workunit.client.0.smithi057.stdout:6/723: dread df/d10/d13/f77 [4194304,4194304] 0 2024-02-28T16:02:18.092 INFO:tasks.workunit.client.0.smithi057.stdout:2/684: mkdir d19/d1d/d2e/de2 0 2024-02-28T16:02:18.093 INFO:tasks.workunit.client.0.smithi057.stdout:4/680: dwrite d1/d10/d12/d39/fba [4194304,4194304] 0 2024-02-28T16:02:18.095 INFO:tasks.workunit.client.0.smithi057.stdout:1/741: dwrite d1/d21/d66/d53/d7d/d65/fa5 [0,4194304] 0 2024-02-28T16:02:18.096 INFO:tasks.workunit.client.0.smithi057.stdout:2/685: mknod d19/d1d/d22/ce3 0 2024-02-28T16:02:18.097 INFO:tasks.workunit.client.0.smithi057.stdout:1/742: read - d1/d21/fe0 zero size 2024-02-28T16:02:18.097 INFO:tasks.workunit.client.0.smithi057.stdout:4/681: mkdir d1/d10/d12/d39/db4/de7 0 2024-02-28T16:02:18.102 INFO:tasks.workunit.client.0.smithi057.stdout:2/686: write d19/d2c/d48/da2/fca [616590,88570] 0 2024-02-28T16:02:18.103 INFO:tasks.workunit.client.0.smithi057.stdout:1/743: truncate d1/d3/fec 585402 0 2024-02-28T16:02:18.109 INFO:tasks.workunit.client.0.smithi057.stdout:2/687: dread - d19/d34/d78/d95/f97 zero size 2024-02-28T16:02:18.111 INFO:tasks.workunit.client.0.smithi057.stdout:1/744: mknod d1/d21/d66/cf6 0 2024-02-28T16:02:18.115 INFO:tasks.workunit.client.0.smithi057.stdout:2/688: creat d19/d43/d5a/fe4 x:0 0 0 2024-02-28T16:02:18.121 INFO:tasks.workunit.client.0.smithi057.stdout:1/745: truncate d1/d3/dc/d15/d4e/fdc 784841 0 2024-02-28T16:02:18.122 INFO:tasks.workunit.client.0.smithi057.stdout:2/689: symlink d19/d1d/d26/le5 0 2024-02-28T16:02:18.128 INFO:tasks.workunit.client.0.smithi057.stdout:6/724: dwrite df/d10/d78/dca/d15/fe6 [0,4194304] 0 2024-02-28T16:02:18.130 INFO:tasks.workunit.client.0.smithi057.stdout:2/690: write d19/d2c/d48/f7d [4247789,53270] 0 2024-02-28T16:02:18.135 INFO:tasks.workunit.client.0.smithi057.stdout:2/691: write d19/d2c/d48/f7d [3656541,125582] 0 2024-02-28T16:02:18.149 INFO:tasks.workunit.client.0.smithi057.stdout:6/725: creat df/d10/d13/fec x:0 0 0 2024-02-28T16:02:18.151 INFO:tasks.workunit.client.0.smithi057.stdout:6/726: dread - df/d61/dbb/fdb zero size 2024-02-28T16:02:18.155 INFO:tasks.workunit.client.0.smithi057.stdout:6/727: write df/d10/d13/f73 [340222,86] 0 2024-02-28T16:02:18.156 INFO:tasks.workunit.client.0.smithi057.stdout:4/682: dread d1/d10/d12/d2c/d37/d46/fa0 [0,4194304] 0 2024-02-28T16:02:18.161 INFO:tasks.workunit.client.0.smithi057.stdout:1/746: write d1/d21/d66/dc7/fe6 [856302,88646] 0 2024-02-28T16:02:18.163 INFO:tasks.workunit.client.0.smithi057.stdout:1/747: stat d1/d21/d66/d53/d7d/cb4 0 2024-02-28T16:02:18.170 INFO:tasks.workunit.client.0.smithi057.stdout:1/748: fsync d1/d3/dc/d15/d4e/d5f/fa7 0 2024-02-28T16:02:18.170 INFO:tasks.workunit.client.0.smithi057.stdout:4/683: mkdir d1/d10/d12/d15/d19/d5e/de8 0 2024-02-28T16:02:18.170 INFO:tasks.workunit.client.0.smithi057.stdout:6/728: truncate df/d10/d78/d5b/d7b/f88 676477 0 2024-02-28T16:02:18.191 INFO:tasks.workunit.client.0.smithi057.stdout:4/684: rename d1/d10/d12/d15/d19 to d1/d10/d12/d2c/d37/d46/dac/de9 0 2024-02-28T16:02:18.192 INFO:tasks.workunit.client.0.smithi057.stdout:6/729: dwrite df/d10/d78/dca/f2d [4194304,4194304] 0 2024-02-28T16:02:18.194 INFO:tasks.workunit.client.0.smithi057.stdout:2/692: dread d19/f23 [0,4194304] 0 2024-02-28T16:02:18.195 INFO:tasks.workunit.client.0.smithi057.stdout:1/749: dwrite d1/d21/fe0 [0,4194304] 0 2024-02-28T16:02:18.217 INFO:tasks.workunit.client.0.smithi057.stdout:0/797: sync 2024-02-28T16:02:18.218 INFO:tasks.workunit.client.0.smithi057.stdout:9/754: sync 2024-02-28T16:02:18.246 INFO:tasks.workunit.client.0.smithi057.stdout:2/693: mknod d19/d2c/d48/da2/ce6 0 2024-02-28T16:02:18.264 INFO:tasks.workunit.client.0.smithi057.stdout:0/798: creat d6/d12/d17/d4b/d60/d6b/f10f x:0 0 0 2024-02-28T16:02:18.273 INFO:tasks.workunit.client.0.smithi057.stdout:6/730: write df/d10/d13/d4b/f5e [575527,76160] 0 2024-02-28T16:02:18.287 INFO:tasks.workunit.client.0.smithi057.stdout:1/750: rename d1/d21/d66/d53/d62/d6f to d1/d21/d25/df7 0 2024-02-28T16:02:18.290 INFO:tasks.workunit.client.0.smithi057.stdout:1/751: write d1/f45 [4460792,35869] 0 2024-02-28T16:02:18.293 INFO:tasks.workunit.client.0.smithi057.stdout:1/752: symlink d1/d3/dc/d15/da3/lf8 0 2024-02-28T16:02:18.295 INFO:tasks.workunit.client.0.smithi057.stdout:1/753: chown d1/d3/dc/d15/d4e/d5f/fa7 41897362 1 2024-02-28T16:02:18.300 INFO:tasks.workunit.client.0.smithi057.stdout:1/754: rename d1/d3/fec to d1/d21/d66/d44/ff9 0 2024-02-28T16:02:18.305 INFO:tasks.workunit.client.0.smithi057.stdout:1/755: creat d1/d21/d66/d53/d7d/ffa x:0 0 0 2024-02-28T16:02:18.307 INFO:tasks.workunit.client.0.smithi057.stdout:1/756: write d1/d3/fdd [5936677,7969] 0 2024-02-28T16:02:18.309 INFO:tasks.workunit.client.0.smithi057.stdout:2/694: dwrite d19/d2c/d65/faa [0,4194304] 0 2024-02-28T16:02:18.311 INFO:tasks.workunit.client.0.smithi057.stdout:4/685: mknod d1/cea 0 2024-02-28T16:02:18.311 INFO:tasks.workunit.client.0.smithi057.stdout:1/757: mknod d1/d21/d66/d44/d4c/d75/cfb 0 2024-02-28T16:02:18.323 INFO:tasks.workunit.client.0.smithi057.stdout:4/686: symlink d1/d10/d31/d86/dd1/d9b/leb 0 2024-02-28T16:02:18.326 INFO:tasks.workunit.client.0.smithi057.stdout:2/695: mkdir d19/d1d/d2e/de7 0 2024-02-28T16:02:18.326 INFO:tasks.workunit.client.0.smithi057.stdout:6/731: dwrite df/d10/d13/d4b/f9d [0,4194304] 0 2024-02-28T16:02:18.328 INFO:tasks.workunit.client.0.smithi057.stdout:6/732: fdatasync df/d10/d78/fbe 0 2024-02-28T16:02:18.329 INFO:tasks.workunit.client.0.smithi057.stdout:1/758: dread d1/d21/d66/d53/d7d/d67/d7a/d94/fba [0,4194304] 0 2024-02-28T16:02:18.333 INFO:tasks.workunit.client.0.smithi057.stdout:2/696: dread d19/d1d/d2e/d3c/dab/faf [0,4194304] 0 2024-02-28T16:02:18.334 INFO:tasks.workunit.client.0.smithi057.stdout:2/697: stat d19/d1d/c82 0 2024-02-28T16:02:18.336 INFO:tasks.workunit.client.0.smithi057.stdout:4/687: creat d1/d3f/d5f/fec x:0 0 0 2024-02-28T16:02:18.341 INFO:tasks.workunit.client.0.smithi057.stdout:4/688: chown d1/d10/d31/d86/dd1/d8c/fa9 114 1 2024-02-28T16:02:18.343 INFO:tasks.workunit.client.0.smithi057.stdout:6/733: getdents df/d10/d13/d4b/dcc 0 2024-02-28T16:02:18.347 INFO:tasks.workunit.client.0.smithi057.stdout:1/759: dwrite d1/d3/dc/d15/d4e/d5f/fa7 [4194304,4194304] 0 2024-02-28T16:02:18.347 INFO:tasks.workunit.client.0.smithi057.stdout:4/689: unlink d1/d10/d12/d2c/c70 0 2024-02-28T16:02:18.351 INFO:tasks.workunit.client.0.smithi057.stdout:1/760: truncate d1/d21/d66/d53/ff0 65860 0 2024-02-28T16:02:18.360 INFO:tasks.workunit.client.0.smithi057.stdout:1/761: mkdir d1/d21/d66/d53/d7d/dfc 0 2024-02-28T16:02:18.360 INFO:tasks.workunit.client.0.smithi057.stdout:4/690: creat d1/d10/d12/d2c/d37/d46/dac/de9/fed x:0 0 0 2024-02-28T16:02:18.365 INFO:tasks.workunit.client.0.smithi057.stdout:4/691: write d1/d22/f75 [1459113,42986] 0 2024-02-28T16:02:18.365 INFO:tasks.workunit.client.0.smithi057.stdout:1/762: rmdir d1/d3/d97 39 2024-02-28T16:02:18.365 INFO:tasks.workunit.client.0.smithi057.stdout:4/692: creat d1/d10/d31/d36/fee x:0 0 0 2024-02-28T16:02:18.367 INFO:tasks.workunit.client.0.smithi057.stdout:1/763: getdents d1/d21/d66/dd0 0 2024-02-28T16:02:18.371 INFO:tasks.workunit.client.0.smithi057.stdout:1/764: truncate d1/d21/d66/d44/d4c/d75/fe1 420346 0 2024-02-28T16:02:18.375 INFO:tasks.workunit.client.0.smithi057.stdout:2/698: dwrite d19/d2c/d48/f83 [0,4194304] 0 2024-02-28T16:02:18.383 INFO:tasks.workunit.client.0.smithi057.stdout:2/699: mknod d19/d43/d5a/ce8 0 2024-02-28T16:02:18.384 INFO:tasks.workunit.client.0.smithi057.stdout:1/765: symlink d1/d3/dc/d15/d4e/d5f/dbe/dd3/lfd 0 2024-02-28T16:02:18.387 INFO:tasks.workunit.client.0.smithi057.stdout:4/693: write d1/d10/d12/d15/f99 [652963,109558] 0 2024-02-28T16:02:18.391 INFO:tasks.workunit.client.0.smithi057.stdout:1/766: creat d1/d3/dc/d15/d4e/d5f/dbe/dd3/ffe x:0 0 0 2024-02-28T16:02:18.391 INFO:tasks.workunit.client.0.smithi057.stdout:4/694: write d1/d10/d12/d2c/fe1 [525585,24989] 0 2024-02-28T16:02:18.392 INFO:tasks.workunit.client.0.smithi057.stdout:2/700: dread d19/d2c/d48/fba [0,4194304] 0 2024-02-28T16:02:18.396 INFO:tasks.workunit.client.0.smithi057.stdout:2/701: mkdir d19/d2c/d65/de9 0 2024-02-28T16:02:18.400 INFO:tasks.workunit.client.0.smithi057.stdout:2/702: symlink d19/d2c/d48/da2/lea 0 2024-02-28T16:02:18.400 INFO:tasks.workunit.client.0.smithi057.stdout:4/695: getdents d1/d10/d12/d2c/d37/d46/dac/de9/d5e/de8 0 2024-02-28T16:02:18.405 INFO:tasks.workunit.client.0.smithi057.stdout:4/696: creat d1/d10/d12/d2c/d37/d46/dac/fef x:0 0 0 2024-02-28T16:02:18.408 INFO:tasks.workunit.client.0.smithi057.stdout:8/614: sync 2024-02-28T16:02:18.418 INFO:tasks.workunit.client.0.smithi057.stdout:2/703: truncate d19/d3a/f98 1729097 0 2024-02-28T16:02:18.419 INFO:tasks.workunit.client.0.smithi057.stdout:8/615: mkdir d5/d20/d39/d59/db7/dcc 0 2024-02-28T16:02:18.419 INFO:tasks.workunit.client.0.smithi057.stdout:8/616: dread - d5/fab zero size 2024-02-28T16:02:18.420 INFO:tasks.workunit.client.0.smithi057.stdout:4/697: rename d1/d10/d12/d2c/d37/d46/dac/de9/d5e/lc4 to d1/d10/d12/lf0 0 2024-02-28T16:02:18.421 INFO:tasks.workunit.client.0.smithi057.stdout:1/767: dread d1/d21/d66/d53/d7d/d67/f6a [0,4194304] 0 2024-02-28T16:02:18.422 INFO:tasks.workunit.client.0.smithi057.stdout:8/617: truncate d5/f31 2997334 0 2024-02-28T16:02:18.425 INFO:tasks.workunit.client.0.smithi057.stdout:8/618: mknod d5/de/d1b/d45/d81/ccd 0 2024-02-28T16:02:18.426 INFO:tasks.workunit.client.0.smithi057.stdout:8/619: fsync d5/d20/f9a 0 2024-02-28T16:02:18.434 INFO:tasks.workunit.client.0.smithi057.stdout:2/704: truncate d19/d2c/d48/f7d 4155480 0 2024-02-28T16:02:18.434 INFO:tasks.workunit.client.0.smithi057.stdout:8/620: rmdir d5/d20/d39/d49/d56 39 2024-02-28T16:02:18.437 INFO:tasks.workunit.client.0.smithi057.stdout:1/768: getdents d1/d3/dc/d15 0 2024-02-28T16:02:18.440 INFO:tasks.workunit.client.0.smithi057.stdout:8/621: read d5/f18 [1826814,81662] 0 2024-02-28T16:02:18.442 INFO:tasks.workunit.client.0.smithi057.stdout:2/705: mkdir d19/d1d/d2e/d31/deb 0 2024-02-28T16:02:18.444 INFO:tasks.workunit.client.0.smithi057.stdout:8/622: symlink d5/de/d1b/d45/lce 0 2024-02-28T16:02:18.445 INFO:tasks.workunit.client.0.smithi057.stdout:2/706: creat d19/d2c/d48/da2/fec x:0 0 0 2024-02-28T16:02:18.446 INFO:tasks.workunit.client.0.smithi057.stdout:1/769: truncate d1/d21/d66/d44/d4c/f5e 2489193 0 2024-02-28T16:02:18.447 INFO:tasks.workunit.client.0.smithi057.stdout:8/623: creat d5/d20/d39/d6e/fcf x:0 0 0 2024-02-28T16:02:18.450 INFO:tasks.workunit.client.0.smithi057.stdout:2/707: mknod d19/d43/ced 0 2024-02-28T16:02:18.450 INFO:tasks.workunit.client.0.smithi057.stdout:1/770: creat d1/d3/dc/d15/d4e/d5f/dbe/dd3/fff x:0 0 0 2024-02-28T16:02:18.450 INFO:tasks.workunit.client.0.smithi057.stdout:2/708: chown d19/d1d/d2e 0 1 2024-02-28T16:02:18.451 INFO:tasks.workunit.client.0.smithi057.stdout:8/624: truncate d5/d6/f36 1974434 0 2024-02-28T16:02:18.453 INFO:tasks.workunit.client.0.smithi057.stdout:2/709: symlink d19/d2c/d65/dda/lee 0 2024-02-28T16:02:18.455 INFO:tasks.workunit.client.0.smithi057.stdout:2/710: chown d19/d1d/d89 4572 1 2024-02-28T16:02:18.455 INFO:tasks.workunit.client.0.smithi057.stdout:8/625: fsync d5/d6/f3f 0 2024-02-28T16:02:18.456 INFO:tasks.workunit.client.0.smithi057.stdout:2/711: fsync d19/d1d/d2e/d31/f40 0 2024-02-28T16:02:18.457 INFO:tasks.workunit.client.0.smithi057.stdout:1/771: rename d1/d21/d66/d44/d4c/d75/cfb to d1/d3/dc/d15/d4e/d5f/dbe/dd3/c100 0 2024-02-28T16:02:18.458 INFO:tasks.workunit.client.0.smithi057.stdout:2/712: chown d19/d1d/d22/l28 38649 1 2024-02-28T16:02:18.459 INFO:tasks.workunit.client.0.smithi057.stdout:2/713: stat d19/d1d/fc4 0 2024-02-28T16:02:18.461 INFO:tasks.workunit.client.0.smithi057.stdout:8/626: readlink d5/de/d63/la9 0 2024-02-28T16:02:18.462 INFO:tasks.workunit.client.0.smithi057.stdout:8/627: chown d5/de/d1b/d45/d81/dae 572101 1 2024-02-28T16:02:18.467 INFO:tasks.workunit.client.0.smithi057.stdout:1/772: unlink d1/l2e 0 2024-02-28T16:02:18.470 INFO:tasks.workunit.client.0.smithi057.stdout:2/714: link d19/d1d/d22/f6b d19/d1d/d2e/de7/fef 0 2024-02-28T16:02:18.480 INFO:tasks.workunit.client.0.smithi057.stdout:2/715: symlink d19/d1d/d2e/de7/lf0 0 2024-02-28T16:02:18.481 INFO:tasks.workunit.client.0.smithi057.stdout:1/773: link d1/d3/dc/d15/d4e/d57/lf2 d1/l101 0 2024-02-28T16:02:18.481 INFO:tasks.workunit.client.0.smithi057.stdout:2/716: chown d19/d1d/d2e/d31 0 1 2024-02-28T16:02:18.484 INFO:tasks.workunit.client.0.smithi057.stdout:1/774: mknod d1/d3/c102 0 2024-02-28T16:02:18.495 INFO:tasks.workunit.client.0.smithi057.stdout:8/628: truncate d5/de/d1b/f25 1376565 0 2024-02-28T16:02:18.499 INFO:tasks.workunit.client.0.smithi057.stdout:1/775: getdents d1/d21/d66/d53 0 2024-02-28T16:02:18.502 INFO:tasks.workunit.client.0.smithi057.stdout:2/717: truncate d19/d2c/d48/da2/fca 366490 0 2024-02-28T16:02:18.511 INFO:tasks.workunit.client.0.smithi057.stdout:2/718: link d19/d2c/d48/da2/fec d19/d1d/d2e/de7/ff1 0 2024-02-28T16:02:18.518 INFO:tasks.workunit.client.0.smithi057.stdout:8/629: dwrite d5/d20/d39/d49/f54 [0,4194304] 0 2024-02-28T16:02:18.522 INFO:tasks.workunit.client.0.smithi057.stdout:2/719: mkdir d19/d43/df2 0 2024-02-28T16:02:18.522 INFO:tasks.workunit.client.0.smithi057.stdout:8/630: dread - d5/d20/d39/d59/d67/fb5 zero size 2024-02-28T16:02:18.524 INFO:tasks.workunit.client.0.smithi057.stdout:1/776: dwrite d1/d3/fc6 [0,4194304] 0 2024-02-28T16:02:18.531 INFO:tasks.workunit.client.0.smithi057.stdout:8/631: creat d5/d20/d39/d49/d56/d84/fd0 x:0 0 0 2024-02-28T16:02:18.535 INFO:tasks.workunit.client.0.smithi057.stdout:8/632: unlink d5/d20/d39/d59/d67/f94 0 2024-02-28T16:02:18.540 INFO:tasks.workunit.client.0.smithi057.stdout:8/633: chown d5/de/f4d 21037 1 2024-02-28T16:02:18.541 INFO:tasks.workunit.client.0.smithi057.stdout:1/777: dwrite d1/d21/d66/d53/d62/fb2 [0,4194304] 0 2024-02-28T16:02:18.548 INFO:tasks.workunit.client.0.smithi057.stdout:8/634: unlink d5/de/d1b/d4b/f73 0 2024-02-28T16:02:18.556 INFO:tasks.workunit.client.0.smithi057.stdout:8/635: mknod d5/de/d63/cd1 0 2024-02-28T16:02:18.560 INFO:tasks.workunit.client.0.smithi057.stdout:8/636: rename d5/f43 to d5/fd2 0 2024-02-28T16:02:18.562 INFO:tasks.workunit.client.0.smithi057.stdout:8/637: chown d5/de/d1b/f6f 22000407 1 2024-02-28T16:02:18.562 INFO:tasks.workunit.client.0.smithi057.stdout:1/778: dwrite d1/d21/f52 [4194304,4194304] 0 2024-02-28T16:02:18.564 INFO:tasks.workunit.client.0.smithi057.stdout:8/638: stat d5/de/d1b/d4b/l74 0 2024-02-28T16:02:18.567 INFO:tasks.workunit.client.0.smithi057.stdout:8/639: chown d5/de/d1b/d45/lce 51626 1 2024-02-28T16:02:18.568 INFO:tasks.workunit.client.0.smithi057.stdout:1/779: symlink d1/d3/l103 0 2024-02-28T16:02:18.572 INFO:tasks.workunit.client.0.smithi057.stdout:8/640: rmdir d5/de/d63/d70/dc0 0 2024-02-28T16:02:18.580 INFO:tasks.workunit.client.0.smithi057.stdout:1/780: truncate d1/d21/d66/d53/d7d/d67/d6c/fad 917914 0 2024-02-28T16:02:18.581 INFO:tasks.workunit.client.0.smithi057.stdout:8/641: symlink d5/de/d63/ld3 0 2024-02-28T16:02:18.582 INFO:tasks.workunit.client.0.smithi057.stdout:1/781: write d1/f8a [1821411,38140] 0 2024-02-28T16:02:18.590 INFO:tasks.workunit.client.0.smithi057.stdout:8/642: mknod d5/d20/d39/d49/d56/d79/cd4 0 2024-02-28T16:02:18.592 INFO:tasks.workunit.client.0.smithi057.stdout:8/643: fdatasync d5/fd2 0 2024-02-28T16:02:18.599 INFO:tasks.workunit.client.0.smithi057.stdout:8/644: symlink d5/d6/d97/ld5 0 2024-02-28T16:02:18.602 INFO:tasks.workunit.client.0.smithi057.stdout:1/782: dwrite d1/d3/f3b [4194304,4194304] 0 2024-02-28T16:02:18.607 INFO:tasks.workunit.client.0.smithi057.stdout:1/783: rmdir d1/d21/d66/d53/d7d/d67/d6c 39 2024-02-28T16:02:18.610 INFO:tasks.workunit.client.0.smithi057.stdout:5/685: sync 2024-02-28T16:02:18.611 INFO:tasks.workunit.client.0.smithi057.stdout:1/784: mknod d1/d21/d66/d53/d7d/d67/d7a/c104 0 2024-02-28T16:02:18.612 INFO:tasks.workunit.client.0.smithi057.stdout:5/686: dread d2/d3e/f70 [0,4194304] 0 2024-02-28T16:02:18.613 INFO:tasks.workunit.client.0.smithi057.stdout:8/645: dread d5/de/d1b/faa [0,4194304] 0 2024-02-28T16:02:18.615 INFO:tasks.workunit.client.0.smithi057.stdout:1/785: symlink d1/d3/dc/d15/d4e/d57/l105 0 2024-02-28T16:02:18.616 INFO:tasks.workunit.client.0.smithi057.stdout:8/646: creat d5/d20/da2/d8d/fd6 x:0 0 0 2024-02-28T16:02:18.618 INFO:tasks.workunit.client.0.smithi057.stdout:5/687: creat d2/d12/d76/d7b/d62/da3/ff3 x:0 0 0 2024-02-28T16:02:18.620 INFO:tasks.workunit.client.0.smithi057.stdout:1/786: write d1/d21/d66/d44/d4c/fe5 [4421151,27889] 0 2024-02-28T16:02:18.621 INFO:tasks.workunit.client.0.smithi057.stdout:8/647: creat d5/de/d1b/d57/d85/fd7 x:0 0 0 2024-02-28T16:02:18.624 INFO:tasks.workunit.client.0.smithi057.stdout:5/688: mkdir d2/d12/d76/d7b/d62/df4 0 2024-02-28T16:02:18.626 INFO:tasks.workunit.client.0.smithi057.stdout:5/689: truncate d2/d19/fe9 1137487 0 2024-02-28T16:02:18.631 INFO:tasks.workunit.client.0.smithi057.stdout:5/690: mknod d2/d15/d5e/d67/cf5 0 2024-02-28T16:02:18.633 INFO:tasks.workunit.client.0.smithi057.stdout:1/787: creat d1/d21/d25/f106 x:0 0 0 2024-02-28T16:02:18.634 INFO:tasks.workunit.client.0.smithi057.stdout:5/691: truncate d2/d12/d3d/da4/fef 124058 0 2024-02-28T16:02:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:8/648: write d5/d6/f36 [1952978,1717] 0 2024-02-28T16:02:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:8/649: rmdir d5/de/d1b 39 2024-02-28T16:02:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:5/692: getdents d2/dae 0 2024-02-28T16:02:18.646 INFO:tasks.workunit.client.0.smithi057.stdout:5/693: mknod d2/dae/cf6 0 2024-02-28T16:02:18.646 INFO:tasks.workunit.client.0.smithi057.stdout:8/650: fdatasync d5/de/d1b/d4b/f5d 0 2024-02-28T16:02:18.647 INFO:tasks.workunit.client.0.smithi057.stdout:5/694: chown d2/d15/d63/fe6 3 1 2024-02-28T16:02:18.649 INFO:tasks.workunit.client.0.smithi057.stdout:1/788: truncate d1/d21/d66/d53/d7d/d65/fa5 3066919 0 2024-02-28T16:02:18.650 INFO:tasks.workunit.client.0.smithi057.stdout:8/651: mknod d5/d20/da2/d8d/cd8 0 2024-02-28T16:02:18.656 INFO:tasks.workunit.client.0.smithi057.stdout:5/695: link d2/d15/d5e/d67/l72 d2/d3e/d5b/lf7 0 2024-02-28T16:02:18.666 INFO:tasks.workunit.client.0.smithi057.stdout:1/789: dwrite d1/d21/d25/f64 [4194304,4194304] 0 2024-02-28T16:02:18.673 INFO:tasks.workunit.client.0.smithi057.stdout:5/696: truncate d2/d12/d76/d7a/d95/db5/dcb/d91/fcc 3298787 0 2024-02-28T16:02:18.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:18 smithi057 ceph-mon[28763]: pgmap v41: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 86 MiB/s rd, 205 MiB/s wr, 508 op/s 2024-02-28T16:02:18.681 INFO:tasks.workunit.client.0.smithi057.stdout:8/652: dwrite d5/de/d1b/f3d [0,4194304] 0 2024-02-28T16:02:18.684 INFO:tasks.workunit.client.0.smithi057.stdout:8/653: chown d5/de/d1b/d57/d85/l9c 47876 1 2024-02-28T16:02:18.709 INFO:tasks.workunit.client.0.smithi057.stdout:5/697: symlink d2/d12/d76/d7a/d95/db5/dcb/dab/lf8 0 2024-02-28T16:02:18.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:18 smithi087 ceph-mon[37122]: pgmap v41: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 86 MiB/s rd, 205 MiB/s wr, 508 op/s 2024-02-28T16:02:18.722 INFO:tasks.workunit.client.0.smithi057.stdout:5/698: unlink d2/d12/d76/d7a/d95/db5/dcb/l6b 0 2024-02-28T16:02:18.724 INFO:tasks.workunit.client.0.smithi057.stdout:5/699: write d2/d15/d63/de7/fe8 [898762,105435] 0 2024-02-28T16:02:18.738 INFO:tasks.workunit.client.0.smithi057.stdout:8/654: dwrite d5/d62/fb1 [8388608,4194304] 0 2024-02-28T16:02:18.739 INFO:tasks.workunit.client.0.smithi057.stdout:8/655: chown d5/d20/f83 99 1 2024-02-28T16:02:18.745 INFO:tasks.workunit.client.0.smithi057.stdout:1/790: dread d1/d21/d66/d53/d7d/d67/d7a/d92/f9d [0,4194304] 0 2024-02-28T16:02:18.747 INFO:tasks.workunit.client.0.smithi057.stdout:5/700: dwrite d2/d12/d76/d7a/d95/db5/dcb/dab/fb3 [0,4194304] 0 2024-02-28T16:02:18.751 INFO:tasks.workunit.client.0.smithi057.stdout:8/656: unlink d5/d20/d39/d49/d56/d84/f8a 0 2024-02-28T16:02:18.754 INFO:tasks.workunit.client.0.smithi057.stdout:5/701: dread d2/d15/f3c [0,4194304] 0 2024-02-28T16:02:18.758 INFO:tasks.workunit.client.0.smithi057.stdout:8/657: mkdir d5/d20/d39/dd9 0 2024-02-28T16:02:18.761 INFO:tasks.workunit.client.0.smithi057.stdout:1/791: dwrite d1/d21/d25/f33 [0,4194304] 0 2024-02-28T16:02:18.762 INFO:tasks.workunit.client.0.smithi057.stdout:5/702: rename d2/d12/d76/d7a/d95/db5/df1 to d2/d12/d76/d7a/d95/db5/dcb/dab/df9 0 2024-02-28T16:02:18.765 INFO:tasks.workunit.client.0.smithi057.stdout:5/703: symlink d2/d12/d76/lfa 0 2024-02-28T16:02:18.772 INFO:tasks.workunit.client.0.smithi057.stdout:5/704: rename d2/d12/d76/d7b/d62/d74/f8c to d2/d12/d3d/da4/ffb 0 2024-02-28T16:02:18.776 INFO:tasks.workunit.client.0.smithi057.stdout:5/705: stat d2/d12/d76/d7a/d95/db5/dce/fd4 0 2024-02-28T16:02:18.780 INFO:tasks.workunit.client.0.smithi057.stdout:5/706: readlink d2/d3e/d5b/lf7 0 2024-02-28T16:02:18.784 INFO:tasks.workunit.client.0.smithi057.stdout:1/792: dwrite d1/d21/d66/ff5 [0,4194304] 0 2024-02-28T16:02:18.787 INFO:tasks.workunit.client.0.smithi057.stdout:8/658: dread d5/d6/fa [4194304,4194304] 0 2024-02-28T16:02:18.791 INFO:tasks.workunit.client.0.smithi057.stdout:8/659: chown d5/de/d1b/c28 5 1 2024-02-28T16:02:18.794 INFO:tasks.workunit.client.0.smithi057.stdout:8/660: dread - d5/d20/da2/d8d/fd6 zero size 2024-02-28T16:02:18.797 INFO:tasks.workunit.client.0.smithi057.stdout:8/661: chown d5/de/d1b/d4b/l71 1 1 2024-02-28T16:02:18.798 INFO:tasks.workunit.client.0.smithi057.stdout:5/707: link d2/d12/d3d/da4/fdb d2/d12/d76/d7a/d95/db5/dcb/dab/df9/ffc 0 2024-02-28T16:02:18.804 INFO:tasks.workunit.client.0.smithi057.stdout:1/793: dwrite d1/d3/dc/d15/d4e/fdc [0,4194304] 0 2024-02-28T16:02:18.814 INFO:tasks.workunit.client.0.smithi057.stdout:1/794: rmdir d1/d21/d66/d53/d7d/d67/d6c/d82 39 2024-02-28T16:02:18.815 INFO:tasks.workunit.client.0.smithi057.stdout:8/662: link d5/d20/d39/d49/d56/l5f d5/d20/d39/d59/db7/dcc/lda 0 2024-02-28T16:02:18.817 INFO:tasks.workunit.client.0.smithi057.stdout:8/663: truncate d5/f2f 1054878 0 2024-02-28T16:02:18.818 INFO:tasks.workunit.client.0.smithi057.stdout:5/708: getdents d2/d12/d5f 0 2024-02-28T16:02:18.819 INFO:tasks.workunit.client.0.smithi057.stdout:1/795: creat d1/d21/d66/d44/d9f/f107 x:0 0 0 2024-02-28T16:02:18.821 INFO:tasks.workunit.client.0.smithi057.stdout:8/664: fsync d5/de/f15 0 2024-02-28T16:02:18.822 INFO:tasks.workunit.client.0.smithi057.stdout:8/665: fdatasync d5/d20/d39/f42 0 2024-02-28T16:02:18.827 INFO:tasks.workunit.client.0.smithi057.stdout:5/709: mknod d2/cfd 0 2024-02-28T16:02:18.829 INFO:tasks.workunit.client.0.smithi057.stdout:8/666: mkdir d5/de/d63/ddb 0 2024-02-28T16:02:18.836 INFO:tasks.workunit.client.0.smithi057.stdout:8/667: creat d5/d20/d39/d6e/daf/fdc x:0 0 0 2024-02-28T16:02:18.839 INFO:tasks.workunit.client.0.smithi057.stdout:8/668: mkdir d5/d20/ddd 0 2024-02-28T16:02:18.839 INFO:tasks.workunit.client.0.smithi057.stdout:1/796: dwrite d1/d3/dc/d15/d4e/f98 [4194304,4194304] 0 2024-02-28T16:02:18.843 INFO:tasks.workunit.client.0.smithi057.stdout:1/797: symlink d1/d21/d25/df7/l108 0 2024-02-28T16:02:18.848 INFO:tasks.workunit.client.0.smithi057.stdout:8/669: rename d5/de/d1b/c7c to d5/d20/da2/d8d/cde 0 2024-02-28T16:02:18.850 INFO:tasks.workunit.client.0.smithi057.stdout:5/710: dwrite d2/d8/f57 [0,4194304] 0 2024-02-28T16:02:18.856 INFO:tasks.workunit.client.0.smithi057.stdout:5/711: write d2/d8/f16 [3819422,109170] 0 2024-02-28T16:02:18.862 INFO:tasks.workunit.client.0.smithi057.stdout:3/620: sync 2024-02-28T16:02:18.872 INFO:tasks.workunit.client.0.smithi057.stdout:1/798: dwrite d1/d21/fe0 [4194304,4194304] 0 2024-02-28T16:02:18.877 INFO:tasks.workunit.client.0.smithi057.stdout:3/621: creat d8/dd/d14/d2e/d2f/da2/fcf x:0 0 0 2024-02-28T16:02:18.878 INFO:tasks.workunit.client.0.smithi057.stdout:5/712: unlink d2/d15/d5e/d6d/f75 0 2024-02-28T16:02:18.878 INFO:tasks.workunit.client.0.smithi057.stdout:8/670: link d5/de/d1b/d4b/l74 d5/de/d1b/d45/d81/ldf 0 2024-02-28T16:02:18.892 INFO:tasks.workunit.client.0.smithi057.stdout:1/799: link d1/d3/dc/d15/da3/fbd d1/d3/f109 0 2024-02-28T16:02:18.893 INFO:tasks.workunit.client.0.smithi057.stdout:3/622: link d8/dd/d14/lac d8/dd/d14/d2e/d76/d89/d6c/ld0 0 2024-02-28T16:02:18.902 INFO:tasks.workunit.client.0.smithi057.stdout:5/713: dwrite d2/d19/fe9 [0,4194304] 0 2024-02-28T16:02:18.904 INFO:tasks.workunit.client.0.smithi057.stdout:9/755: sync 2024-02-28T16:02:18.904 INFO:tasks.workunit.client.0.smithi057.stdout:2/720: sync 2024-02-28T16:02:18.904 INFO:tasks.workunit.client.0.smithi057.stdout:4/698: sync 2024-02-28T16:02:18.905 INFO:tasks.workunit.client.0.smithi057.stdout:0/799: sync 2024-02-28T16:02:18.905 INFO:tasks.workunit.client.0.smithi057.stdout:6/734: sync 2024-02-28T16:02:18.905 INFO:tasks.workunit.client.0.smithi057.stdout:7/660: sync 2024-02-28T16:02:18.905 INFO:tasks.workunit.client.0.smithi057.stdout:1/800: creat d1/d21/d66/dc7/f10a x:0 0 0 2024-02-28T16:02:18.906 INFO:tasks.workunit.client.0.smithi057.stdout:8/671: truncate d5/de/d1b/faa 2378333 0 2024-02-28T16:02:18.910 INFO:tasks.workunit.client.0.smithi057.stdout:4/699: readlink d1/d3f/l76 0 2024-02-28T16:02:18.912 INFO:tasks.workunit.client.0.smithi057.stdout:8/672: stat d5/d20/da2/d8d/fd6 0 2024-02-28T16:02:18.913 INFO:tasks.workunit.client.0.smithi057.stdout:1/801: chown d1/d21/d66/cf6 6 1 2024-02-28T16:02:18.920 INFO:tasks.workunit.client.0.smithi057.stdout:6/735: mkdir df/d10/d4f/ded 0 2024-02-28T16:02:18.921 INFO:tasks.workunit.client.0.smithi057.stdout:1/802: read - d1/d3/dc/d15/d4e/d5f/fc2 zero size 2024-02-28T16:02:18.923 INFO:tasks.workunit.client.0.smithi057.stdout:0/800: mknod d6/d12/d5d/d71/c110 0 2024-02-28T16:02:18.924 INFO:tasks.workunit.client.0.smithi057.stdout:3/623: write d8/dd/d19/f29 [209335,68532] 0 2024-02-28T16:02:18.924 INFO:tasks.workunit.client.0.smithi057.stdout:6/736: dread - df/d10/d78/dca/fc2 zero size 2024-02-28T16:02:18.927 INFO:tasks.workunit.client.0.smithi057.stdout:2/721: chown d19/d1d/d2e/d31/l5c 545 1 2024-02-28T16:02:18.927 INFO:tasks.workunit.client.0.smithi057.stdout:1/803: write d1/d3/dc/d15/f17 [744536,22934] 0 2024-02-28T16:02:18.928 INFO:tasks.workunit.client.0.smithi057.stdout:6/737: dread - df/d10/d13/fec zero size 2024-02-28T16:02:18.930 INFO:tasks.workunit.client.0.smithi057.stdout:9/756: symlink d2/d5/d1b/d2e/lf7 0 2024-02-28T16:02:18.931 INFO:tasks.workunit.client.0.smithi057.stdout:7/661: symlink d6/dc/dab/le6 0 2024-02-28T16:02:18.933 INFO:tasks.workunit.client.0.smithi057.stdout:6/738: chown df/d10/d4f/c50 1492746481 1 2024-02-28T16:02:18.934 INFO:tasks.workunit.client.0.smithi057.stdout:3/624: read d8/dd/d14/d2e/d30/d49/fb5 [2640254,80192] 0 2024-02-28T16:02:18.934 INFO:tasks.workunit.client.0.smithi057.stdout:0/801: mknod d6/d12/d45/dab/c111 0 2024-02-28T16:02:18.935 INFO:tasks.workunit.client.0.smithi057.stdout:2/722: symlink d19/d1d/db2/lf3 0 2024-02-28T16:02:18.940 INFO:tasks.workunit.client.0.smithi057.stdout:5/714: creat d2/d12/ffe x:0 0 0 2024-02-28T16:02:18.940 INFO:tasks.workunit.client.0.smithi057.stdout:3/625: fdatasync d8/dd/d14/d2e/d76/d89/fba 0 2024-02-28T16:02:18.942 INFO:tasks.workunit.client.0.smithi057.stdout:9/757: fsync d2/d5/d9/f35 0 2024-02-28T16:02:18.942 INFO:tasks.workunit.client.0.smithi057.stdout:4/700: dwrite d1/d10/d12/fd6 [0,4194304] 0 2024-02-28T16:02:18.945 INFO:tasks.workunit.client.0.smithi057.stdout:1/804: creat d1/d3/dc/d15/d4e/d5f/dbe/dd3/f10b x:0 0 0 2024-02-28T16:02:18.945 INFO:tasks.workunit.client.0.smithi057.stdout:4/701: read - d1/fbe zero size 2024-02-28T16:02:18.946 INFO:tasks.workunit.client.0.smithi057.stdout:8/673: write d5/de/d1b/f35 [691475,27177] 0 2024-02-28T16:02:18.950 INFO:tasks.workunit.client.0.smithi057.stdout:8/674: chown d5/de/d1b/d45/d81 28877 1 2024-02-28T16:02:18.951 INFO:tasks.workunit.client.0.smithi057.stdout:4/702: chown d1/d10/d12/d2c/d37/d46/fa0 112918274 1 2024-02-28T16:02:18.952 INFO:tasks.workunit.client.0.smithi057.stdout:2/723: unlink d19/d2c/d65/c68 0 2024-02-28T16:02:18.954 INFO:tasks.workunit.client.0.smithi057.stdout:0/802: dread - d6/d12/d17/d58/d95/fd2 zero size 2024-02-28T16:02:18.962 INFO:tasks.workunit.client.0.smithi057.stdout:9/758: dwrite d2/d46/f66 [0,4194304] 0 2024-02-28T16:02:18.964 INFO:tasks.workunit.client.0.smithi057.stdout:1/805: dwrite d1/d3/fc6 [0,4194304] 0 2024-02-28T16:02:19.029 INFO:tasks.workunit.client.0.smithi057.stdout:6/739: rename df/d10/f36 to df/d10/d78/dca/d15/d16/d39/d8d/dd9/fee 0 2024-02-28T16:02:19.032 INFO:tasks.workunit.client.0.smithi057.stdout:3/626: unlink d8/dd/d14/d2e/l4d 0 2024-02-28T16:02:19.035 INFO:tasks.workunit.client.0.smithi057.stdout:3/627: fdatasync d8/dd/d14/d2e/d76/da1/faa 0 2024-02-28T16:02:19.039 INFO:tasks.workunit.client.0.smithi057.stdout:8/675: creat d5/de/d1b/d57/fe0 x:0 0 0 2024-02-28T16:02:19.040 INFO:tasks.workunit.client.0.smithi057.stdout:8/676: stat d5/d6/d97 0 2024-02-28T16:02:19.044 INFO:tasks.workunit.client.0.smithi057.stdout:0/803: creat d6/d12/da4/f112 x:0 0 0 2024-02-28T16:02:19.047 INFO:tasks.workunit.client.0.smithi057.stdout:9/759: truncate d2/d5e/fbd 4893581 0 2024-02-28T16:02:19.049 INFO:tasks.workunit.client.0.smithi057.stdout:1/806: mkdir d1/d21/d66/d53/d62/d73/d10c 0 2024-02-28T16:02:19.052 INFO:tasks.workunit.client.0.smithi057.stdout:6/740: mkdir df/d10/d13/d4b/d4e/def 0 2024-02-28T16:02:19.056 INFO:tasks.workunit.client.0.smithi057.stdout:3/628: rename d8/dd/d14/d2e/d30/d6a/l96 to d8/dd/d14/d2e/d2f/ld1 0 2024-02-28T16:02:19.059 INFO:tasks.workunit.client.0.smithi057.stdout:2/724: unlink d19/d3a/ld0 0 2024-02-28T16:02:19.061 INFO:tasks.workunit.client.0.smithi057.stdout:4/703: truncate d1/d10/d12/d15/f73 2194296 0 2024-02-28T16:02:19.063 INFO:tasks.workunit.client.0.smithi057.stdout:2/725: write d19/d2c/d48/f83 [3915264,120985] 0 2024-02-28T16:02:19.069 INFO:tasks.workunit.client.0.smithi057.stdout:0/804: symlink d6/d12/d17/d4b/de5/l113 0 2024-02-28T16:02:19.069 INFO:tasks.workunit.client.0.smithi057.stdout:9/760: mknod d2/d5e/d65/cf8 0 2024-02-28T16:02:19.072 INFO:tasks.workunit.client.0.smithi057.stdout:0/805: stat d6/d12/d17/d58/db8/fff 0 2024-02-28T16:02:19.073 INFO:tasks.workunit.client.0.smithi057.stdout:4/704: rename d1/d22/c58 to d1/d3f/d5f/cf1 0 2024-02-28T16:02:19.074 INFO:tasks.workunit.client.0.smithi057.stdout:0/806: chown d6/ce4 452990769 1 2024-02-28T16:02:19.075 INFO:tasks.workunit.client.0.smithi057.stdout:2/726: unlink d19/d43/ced 0 2024-02-28T16:02:19.077 INFO:tasks.workunit.client.0.smithi057.stdout:2/727: stat d19/d43/l6a 0 2024-02-28T16:02:19.078 INFO:tasks.workunit.client.0.smithi057.stdout:8/677: fdatasync d5/d20/d39/d49/d56/d79/f92 0 2024-02-28T16:02:19.080 INFO:tasks.workunit.client.0.smithi057.stdout:9/761: creat d2/d5/d9/d64/d78/ff9 x:0 0 0 2024-02-28T16:02:19.083 INFO:tasks.workunit.client.0.smithi057.stdout:9/762: readlink d2/d5/d1b/d2e/lf7 0 2024-02-28T16:02:19.086 INFO:tasks.workunit.client.0.smithi057.stdout:2/728: mkdir d19/d1d/d26/df4 0 2024-02-28T16:02:19.089 INFO:tasks.workunit.client.0.smithi057.stdout:9/763: truncate d2/d5/d1b/d2e/fca 378330 0 2024-02-28T16:02:19.092 INFO:tasks.workunit.client.0.smithi057.stdout:4/705: mkdir d1/d10/d12/d15/df2 0 2024-02-28T16:02:19.093 INFO:tasks.workunit.client.0.smithi057.stdout:9/764: chown d2/d5e/d65/d6e/fe9 6640803 1 2024-02-28T16:02:19.095 INFO:tasks.workunit.client.0.smithi057.stdout:1/807: dread d1/d21/f5b [0,4194304] 0 2024-02-28T16:02:19.098 INFO:tasks.workunit.client.0.smithi057.stdout:9/765: chown d2/d24/f14 87447 1 2024-02-28T16:02:19.098 INFO:tasks.workunit.client.0.smithi057.stdout:0/807: dwrite d6/d12/d17/d34/f4d [0,4194304] 0 2024-02-28T16:02:19.098 INFO:tasks.workunit.client.0.smithi057.stdout:2/729: rename d19/d43/f92 to d19/d43/d5a/d9b/ff5 0 2024-02-28T16:02:19.099 INFO:tasks.workunit.client.0.smithi057.stdout:4/706: dread - d1/d10/d12/d39/db4/fdb zero size 2024-02-28T16:02:19.102 INFO:tasks.workunit.client.0.smithi057.stdout:8/678: dread d5/de/d1b/faa [0,4194304] 0 2024-02-28T16:02:19.103 INFO:tasks.workunit.client.0.smithi057.stdout:9/766: chown d2/d5e/d65/fd1 9 1 2024-02-28T16:02:19.104 INFO:tasks.workunit.client.0.smithi057.stdout:6/741: dread df/d10/d78/dca/d15/d82/f95 [4194304,4194304] 0 2024-02-28T16:02:19.104 INFO:tasks.workunit.client.0.smithi057.stdout:2/730: chown d19/d1d/d2e/d3c/ca9 0 1 2024-02-28T16:02:19.109 INFO:tasks.workunit.client.0.smithi057.stdout:0/808: chown d6/d12/d5d/d7f/la2 12 1 2024-02-28T16:02:19.112 INFO:tasks.workunit.client.0.smithi057.stdout:4/707: creat d1/d10/d31/d86/dd1/ff3 x:0 0 0 2024-02-28T16:02:19.114 INFO:tasks.workunit.client.0.smithi057.stdout:8/679: symlink d5/d62/d9f/le1 0 2024-02-28T16:02:19.118 INFO:tasks.workunit.client.0.smithi057.stdout:2/731: unlink d19/d2c/f30 0 2024-02-28T16:02:19.119 INFO:tasks.workunit.client.0.smithi057.stdout:9/767: creat d2/d5/d1b/d2e/d4c/da0/ffa x:0 0 0 2024-02-28T16:02:19.120 INFO:tasks.workunit.client.0.smithi057.stdout:8/680: write d5/f2f [1900199,17389] 0 2024-02-28T16:02:19.121 INFO:tasks.workunit.client.0.smithi057.stdout:3/629: dwrite d8/dd/d14/d2e/d2f/f65 [0,4194304] 0 2024-02-28T16:02:19.125 INFO:tasks.workunit.client.0.smithi057.stdout:6/742: dread df/d10/d78/f91 [0,4194304] 0 2024-02-28T16:02:19.126 INFO:tasks.workunit.client.0.smithi057.stdout:3/630: mkdir d8/d4b/dd2 0 2024-02-28T16:02:19.130 INFO:tasks.workunit.client.0.smithi057.stdout:6/743: fsync df/d10/d13/d70/feb 0 2024-02-28T16:02:19.132 INFO:tasks.workunit.client.0.smithi057.stdout:9/768: mkdir d2/d5/d9/d5d/d70/dfb 0 2024-02-28T16:02:19.136 INFO:tasks.workunit.client.0.smithi057.stdout:0/809: dread d6/fa6 [0,4194304] 0 2024-02-28T16:02:19.136 INFO:tasks.workunit.client.0.smithi057.stdout:1/808: dwrite d1/d21/d66/d44/d4c/d75/fe1 [0,4194304] 0 2024-02-28T16:02:19.140 INFO:tasks.workunit.client.0.smithi057.stdout:4/708: mkdir d1/d10/d12/d2c/d37/d46/dac/de9/df4 0 2024-02-28T16:02:19.141 INFO:tasks.workunit.client.0.smithi057.stdout:8/681: symlink d5/de/d63/le2 0 2024-02-28T16:02:19.142 INFO:tasks.workunit.client.0.smithi057.stdout:6/744: stat df/d10/d78/dca/d15/d16/d39/d92/da4/fa5 0 2024-02-28T16:02:19.156 INFO:tasks.workunit.client.0.smithi057.stdout:2/732: symlink d19/d1d/d2e/de2/lf6 0 2024-02-28T16:02:19.164 INFO:tasks.workunit.client.0.smithi057.stdout:0/810: dwrite d6/d4e/fd3 [0,4194304] 0 2024-02-28T16:02:19.169 INFO:tasks.workunit.client.0.smithi057.stdout:2/733: creat d19/d1d/d26/ff7 x:0 0 0 2024-02-28T16:02:19.171 INFO:tasks.workunit.client.0.smithi057.stdout:8/682: fdatasync d5/de/d1b/d57/f5e 0 2024-02-28T16:02:19.172 INFO:tasks.workunit.client.0.smithi057.stdout:1/809: dwrite d1/d3/f3b [0,4194304] 0 2024-02-28T16:02:19.186 INFO:tasks.workunit.client.0.smithi057.stdout:0/811: truncate d6/d12/d38/fbf 1019652 0 2024-02-28T16:02:19.201 INFO:tasks.workunit.client.0.smithi057.stdout:3/631: getdents d8/dd/d14/d2e/d3b/d71 0 2024-02-28T16:02:19.203 INFO:tasks.workunit.client.0.smithi057.stdout:6/745: dread df/d10/d78/dca/d15/d16/d39/d92/f93 [0,4194304] 0 2024-02-28T16:02:19.207 INFO:tasks.workunit.client.0.smithi057.stdout:6/746: chown df/lcf 15860 1 2024-02-28T16:02:19.211 INFO:tasks.workunit.client.0.smithi057.stdout:0/812: dwrite d6/d12/d17/d58/db8/fff [0,4194304] 0 2024-02-28T16:02:19.212 INFO:tasks.workunit.client.0.smithi057.stdout:2/734: rmdir d19/d1d/d26/df4 0 2024-02-28T16:02:19.213 INFO:tasks.workunit.client.0.smithi057.stdout:8/683: link d5/d6/f3f d5/d20/d39/d59/db7/dcc/fe3 0 2024-02-28T16:02:19.215 INFO:tasks.workunit.client.0.smithi057.stdout:4/709: dwrite d1/d3f/d5f/f72 [0,4194304] 0 2024-02-28T16:02:19.218 INFO:tasks.workunit.client.0.smithi057.stdout:2/735: write d19/d1d/d26/fc0 [1007552,72122] 0 2024-02-28T16:02:19.219 INFO:tasks.workunit.client.0.smithi057.stdout:4/710: read - d1/d22/dcb/fd3 zero size 2024-02-28T16:02:19.223 INFO:tasks.workunit.client.0.smithi057.stdout:1/810: creat d1/d21/d66/d53/d7d/d67/f10d x:0 0 0 2024-02-28T16:02:19.229 INFO:tasks.workunit.client.0.smithi057.stdout:6/747: mkdir df/d10/d78/dca/dd0/df0 0 2024-02-28T16:02:19.239 INFO:tasks.workunit.client.0.smithi057.stdout:4/711: symlink d1/d22/dcb/lf5 0 2024-02-28T16:02:19.241 INFO:tasks.workunit.client.0.smithi057.stdout:3/632: creat d8/dd/fd3 x:0 0 0 2024-02-28T16:02:19.242 INFO:tasks.workunit.client.0.smithi057.stdout:1/811: mknod d1/d21/d66/dc7/c10e 0 2024-02-28T16:02:19.244 INFO:tasks.workunit.client.0.smithi057.stdout:6/748: symlink df/d10/d78/d5b/lf1 0 2024-02-28T16:02:19.245 INFO:tasks.workunit.client.0.smithi057.stdout:4/712: chown d1/d10/d12/d2c/d37/d46/dac/de9/d87 1 1 2024-02-28T16:02:19.246 INFO:tasks.workunit.client.0.smithi057.stdout:0/813: dread d6/d12/d38/d5e/f46 [0,4194304] 0 2024-02-28T16:02:19.248 INFO:tasks.workunit.client.0.smithi057.stdout:2/736: fdatasync d19/d2c/d48/f7d 0 2024-02-28T16:02:19.251 INFO:tasks.workunit.client.0.smithi057.stdout:3/633: symlink d8/dd/d14/d2e/d30/ld4 0 2024-02-28T16:02:19.252 INFO:tasks.workunit.client.0.smithi057.stdout:2/737: dread - d19/d1d/d26/ff7 zero size 2024-02-28T16:02:19.252 INFO:tasks.workunit.client.0.smithi057.stdout:4/713: write d1/d10/d31/d36/fee [376110,125577] 0 2024-02-28T16:02:19.253 INFO:tasks.workunit.client.0.smithi057.stdout:1/812: unlink d1/d21/d66/d44/d9f/f107 0 2024-02-28T16:02:19.256 INFO:tasks.workunit.client.0.smithi057.stdout:4/714: stat d1/d10/d12/l16 0 2024-02-28T16:02:19.262 INFO:tasks.workunit.client.0.smithi057.stdout:6/749: truncate df/d10/d78/dca/d15/d16/d39/d92/fcb 441255 0 2024-02-28T16:02:19.270 INFO:tasks.workunit.client.0.smithi057.stdout:2/738: creat d19/d1d/d2e/d3c/ff8 x:0 0 0 2024-02-28T16:02:19.273 INFO:tasks.workunit.client.0.smithi057.stdout:8/684: dread d5/de/f15 [0,4194304] 0 2024-02-28T16:02:19.274 INFO:tasks.workunit.client.0.smithi057.stdout:6/750: mknod df/d10/d78/dca/cf2 0 2024-02-28T16:02:19.282 INFO:tasks.workunit.client.0.smithi057.stdout:4/715: mknod d1/cf6 0 2024-02-28T16:02:19.284 INFO:tasks.workunit.client.0.smithi057.stdout:1/813: dread d1/d21/d25/f64 [4194304,4194304] 0 2024-02-28T16:02:19.285 INFO:tasks.workunit.client.0.smithi057.stdout:4/716: chown d1/d10/d12/c3b 1751 1 2024-02-28T16:02:19.289 INFO:tasks.workunit.client.0.smithi057.stdout:8/685: rmdir d5/de/d1b/d4b 39 2024-02-28T16:02:19.291 INFO:tasks.workunit.client.0.smithi057.stdout:6/751: write df/d10/d78/dca/d15/d16/d39/d92/f93 [3752830,107986] 0 2024-02-28T16:02:19.299 INFO:tasks.workunit.client.0.smithi057.stdout:0/814: dread d6/d12/d45/d78/fcf [0,4194304] 0 2024-02-28T16:02:19.299 INFO:tasks.workunit.client.0.smithi057.stdout:6/752: fsync df/d10/d78/dca/d15/d16/d39/d92/fcb 0 2024-02-28T16:02:19.300 INFO:tasks.workunit.client.0.smithi057.stdout:8/686: truncate d5/f18 4721735 0 2024-02-28T16:02:19.303 INFO:tasks.workunit.client.0.smithi057.stdout:2/739: dwrite d19/d43/d5a/d70/fb3 [0,4194304] 0 2024-02-28T16:02:19.304 INFO:tasks.workunit.client.0.smithi057.stdout:4/717: mknod d1/d10/d12/d2c/d37/cf7 0 2024-02-28T16:02:19.307 INFO:tasks.workunit.client.0.smithi057.stdout:8/687: write d5/de/d1b/d57/fe0 [242411,897] 0 2024-02-28T16:02:19.307 INFO:tasks.workunit.client.0.smithi057.stdout:6/753: truncate df/d10/d78/d5b/d7b/f8c 826674 0 2024-02-28T16:02:19.313 INFO:tasks.workunit.client.0.smithi057.stdout:0/815: creat d6/d12/d17/d92/f114 x:0 0 0 2024-02-28T16:02:19.315 INFO:tasks.workunit.client.0.smithi057.stdout:6/754: truncate df/d10/d78/dca/d15/d16/d39/d92/f93 4412485 0 2024-02-28T16:02:19.317 INFO:tasks.workunit.client.0.smithi057.stdout:7/662: sync 2024-02-28T16:02:19.317 INFO:tasks.workunit.client.0.smithi057.stdout:5/715: sync 2024-02-28T16:02:19.318 INFO:tasks.workunit.client.0.smithi057.stdout:9/769: sync 2024-02-28T16:02:19.318 INFO:tasks.workunit.client.0.smithi057.stdout:3/634: dread d8/dd/d14/d2c/f4c [4194304,4194304] 0 2024-02-28T16:02:19.318 INFO:tasks.workunit.client.0.smithi057.stdout:2/740: fsync d19/d1d/d2e/d3c/f3d 0 2024-02-28T16:02:19.322 INFO:tasks.workunit.client.0.smithi057.stdout:6/755: fdatasync df/d10/d78/dca/d15/d16/d39/fac 0 2024-02-28T16:02:19.324 INFO:tasks.workunit.client.0.smithi057.stdout:9/770: chown d2/d5/d9/d5d/d70/dfb 24 1 2024-02-28T16:02:19.328 INFO:tasks.workunit.client.0.smithi057.stdout:1/814: dwrite d1/d21/d66/d53/d7d/d67/d7a/d92/f9d [0,4194304] 0 2024-02-28T16:02:19.405 INFO:tasks.workunit.client.0.smithi057.stdout:4/718: creat d1/d10/d12/d39/de4/ff8 x:0 0 0 2024-02-28T16:02:19.405 INFO:tasks.workunit.client.0.smithi057.stdout:1/815: stat d1/d3/f47 0 2024-02-28T16:02:19.405 INFO:tasks.workunit.client.0.smithi057.stdout:4/719: write d1/d22/f5c [2944919,27171] 0 2024-02-28T16:02:19.405 INFO:tasks.workunit.client.0.smithi057.stdout:8/688: dwrite d5/de/d1b/d45/d81/dae/fc4 [0,4194304] 0 2024-02-28T16:02:19.405 INFO:tasks.workunit.client.0.smithi057.stdout:6/756: dread df/d10/d13/f41 [0,4194304] 0 2024-02-28T16:02:19.405 INFO:tasks.workunit.client.0.smithi057.stdout:5/716: dwrite d2/d12/d76/d7a/d95/db5/dcb/f3a [0,4194304] 0 2024-02-28T16:02:19.405 INFO:tasks.workunit.client.0.smithi057.stdout:3/635: rename d8/dd/d14/d2e/d3b/d71/f9d to d8/dd/d14/d2e/d30/d5f/d6b/fd5 0 2024-02-28T16:02:19.405 INFO:tasks.workunit.client.0.smithi057.stdout:1/816: creat d1/d3/dc/d15/f10f x:0 0 0 2024-02-28T16:02:19.406 INFO:tasks.workunit.client.0.smithi057.stdout:3/636: chown d8/d26/f7e 86445734 1 2024-02-28T16:02:19.406 INFO:tasks.workunit.client.0.smithi057.stdout:0/816: truncate f0 6949235 0 2024-02-28T16:02:19.406 INFO:tasks.workunit.client.0.smithi057.stdout:1/817: chown d1/d3/dc/d15/da3/fbd 73467986 1 2024-02-28T16:02:19.406 INFO:tasks.workunit.client.0.smithi057.stdout:3/637: fsync d8/dd/d14/d2e/d2f/f65 0 2024-02-28T16:02:19.406 INFO:tasks.workunit.client.0.smithi057.stdout:9/771: dwrite d2/d5/d1b/f34 [0,4194304] 0 2024-02-28T16:02:19.406 INFO:tasks.workunit.client.0.smithi057.stdout:8/689: dwrite d5/d62/f76 [8388608,4194304] 0 2024-02-28T16:02:19.406 INFO:tasks.workunit.client.0.smithi057.stdout:5/717: unlink d2/d12/fb1 0 2024-02-28T16:02:19.407 INFO:tasks.workunit.client.0.smithi057.stdout:4/720: creat d1/d10/d12/d2c/dd9/ff9 x:0 0 0 2024-02-28T16:02:19.407 INFO:tasks.workunit.client.0.smithi057.stdout:7/663: creat d6/d26/fe7 x:0 0 0 2024-02-28T16:02:19.407 INFO:tasks.workunit.client.0.smithi057.stdout:0/817: creat d6/d12/d45/f115 x:0 0 0 2024-02-28T16:02:19.407 INFO:tasks.workunit.client.0.smithi057.stdout:1/818: rename d1/d3/dc/d40/fe7 to d1/d21/d66/f110 0 2024-02-28T16:02:19.407 INFO:tasks.workunit.client.0.smithi057.stdout:9/772: mknod d2/d92/cfc 0 2024-02-28T16:02:19.407 INFO:tasks.workunit.client.0.smithi057.stdout:6/757: creat df/d10/d13/d4b/d4e/def/ff3 x:0 0 0 2024-02-28T16:02:19.407 INFO:tasks.workunit.client.0.smithi057.stdout:4/721: fsync d1/d10/d12/d15/f5b 0 2024-02-28T16:02:19.407 INFO:tasks.workunit.client.0.smithi057.stdout:4/722: truncate d1/fbe 695435 0 2024-02-28T16:02:19.407 INFO:tasks.workunit.client.0.smithi057.stdout:3/638: rename d8/dd/d14/d2e/d3b/d71/f91 to d8/dd/d14/d2e/d30/fd6 0 2024-02-28T16:02:19.407 INFO:tasks.workunit.client.0.smithi057.stdout:4/723: write d1/d10/d12/d39/f3e [4584382,101987] 0 2024-02-28T16:02:19.408 INFO:tasks.workunit.client.0.smithi057.stdout:8/690: symlink d5/d20/ddd/le4 0 2024-02-28T16:02:19.409 INFO:tasks.workunit.client.0.smithi057.stdout:9/773: read d2/d5e/fb0 [60464,9146] 0 2024-02-28T16:02:19.409 INFO:tasks.workunit.client.0.smithi057.stdout:7/664: symlink d6/dc/d12/le8 0 2024-02-28T16:02:19.409 INFO:tasks.workunit.client.0.smithi057.stdout:9/774: chown d2/d5/d9/d5d/l83 15755 1 2024-02-28T16:02:19.414 INFO:tasks.workunit.client.0.smithi057.stdout:3/639: stat d8/dd/d14/c1a 0 2024-02-28T16:02:19.421 INFO:tasks.workunit.client.0.smithi057.stdout:7/665: rmdir d6/d38 39 2024-02-28T16:02:19.422 INFO:tasks.workunit.client.0.smithi057.stdout:5/718: dwrite d2/d12/d5f/d77/f93 [0,4194304] 0 2024-02-28T16:02:19.428 INFO:tasks.workunit.client.0.smithi057.stdout:9/775: creat d2/d5/d9/ffd x:0 0 0 2024-02-28T16:02:19.428 INFO:tasks.workunit.client.0.smithi057.stdout:1/819: write d1/d3/f59 [713681,91490] 0 2024-02-28T16:02:19.433 INFO:tasks.workunit.client.0.smithi057.stdout:4/724: write d1/d3f/f53 [2834958,68364] 0 2024-02-28T16:02:19.438 INFO:tasks.workunit.client.0.smithi057.stdout:4/725: fsync d1/d10/d12/d39/de4/ff8 0 2024-02-28T16:02:19.440 INFO:tasks.workunit.client.0.smithi057.stdout:8/691: unlink d5/d20/d39/d59/cc5 0 2024-02-28T16:02:19.443 INFO:tasks.workunit.client.0.smithi057.stdout:8/692: readlink d5/d6/l1a 0 2024-02-28T16:02:19.443 INFO:tasks.workunit.client.0.smithi057.stdout:7/666: dwrite d6/dc/d12/d1a/d90/fae [0,4194304] 0 2024-02-28T16:02:19.444 INFO:tasks.workunit.client.0.smithi057.stdout:0/818: link d6/d12/d17/d4b/la8 d6/d12/d17/d4b/d60/l116 0 2024-02-28T16:02:19.446 INFO:tasks.workunit.client.0.smithi057.stdout:5/719: dwrite d2/d15/d63/de7/fe8 [0,4194304] 0 2024-02-28T16:02:19.447 INFO:tasks.workunit.client.0.smithi057.stdout:1/820: chown d1/c1b 4070621 1 2024-02-28T16:02:19.452 INFO:tasks.workunit.client.0.smithi057.stdout:9/776: creat d2/d5/dd3/ffe x:0 0 0 2024-02-28T16:02:19.455 INFO:tasks.workunit.client.0.smithi057.stdout:6/758: rename df/d10/fb1 to df/d61/ff4 0 2024-02-28T16:02:19.455 INFO:tasks.workunit.client.0.smithi057.stdout:3/640: dread d8/dd/d14/d2e/d30/d49/d51/d66/f90 [0,4194304] 0 2024-02-28T16:02:19.459 INFO:tasks.workunit.client.0.smithi057.stdout:0/819: readlink d6/d12/d17/d34/l44 0 2024-02-28T16:02:19.461 INFO:tasks.workunit.client.0.smithi057.stdout:7/667: rmdir d6/dc/d67 39 2024-02-28T16:02:19.461 INFO:tasks.workunit.client.0.smithi057.stdout:0/820: write d6/d12/d45/f115 [169359,48929] 0 2024-02-28T16:02:19.464 INFO:tasks.workunit.client.0.smithi057.stdout:4/726: dread d1/d3f/f5d [0,4194304] 0 2024-02-28T16:02:19.468 INFO:tasks.workunit.client.0.smithi057.stdout:0/821: read d6/d12/d17/f3b [2420526,117643] 0 2024-02-28T16:02:19.469 INFO:tasks.workunit.client.0.smithi057.stdout:1/821: creat d1/d21/d25/df7/f111 x:0 0 0 2024-02-28T16:02:19.475 INFO:tasks.workunit.client.0.smithi057.stdout:3/641: symlink d8/dd/d14/d2c/db9/ld7 0 2024-02-28T16:02:19.483 INFO:tasks.workunit.client.0.smithi057.stdout:9/777: mkdir d2/d5/dff 0 2024-02-28T16:02:19.483 INFO:tasks.workunit.client.0.smithi057.stdout:1/822: readlink d1/d3/l38 0 2024-02-28T16:02:19.483 INFO:tasks.workunit.client.0.smithi057.stdout:8/693: truncate d5/f2f 590744 0 2024-02-28T16:02:19.483 INFO:tasks.workunit.client.0.smithi057.stdout:5/720: dread d2/d15/d5e/d7f/f88 [0,4194304] 0 2024-02-28T16:02:19.489 INFO:tasks.workunit.client.0.smithi057.stdout:4/727: dread d1/d10/f4d [0,4194304] 0 2024-02-28T16:02:19.490 INFO:tasks.workunit.client.0.smithi057.stdout:8/694: creat d5/de/d1b/d45/d81/dae/fe5 x:0 0 0 2024-02-28T16:02:19.493 INFO:tasks.workunit.client.0.smithi057.stdout:4/728: dread - d1/d10/d31/d86/fc9 zero size 2024-02-28T16:02:19.493 INFO:tasks.workunit.client.0.smithi057.stdout:9/778: symlink d2/d5/d9/d64/dc4/l100 0 2024-02-28T16:02:19.494 INFO:tasks.workunit.client.0.smithi057.stdout:0/822: dread d6/d4e/f77 [0,4194304] 0 2024-02-28T16:02:19.495 INFO:tasks.workunit.client.0.smithi057.stdout:6/759: getdents df/d10/d78/d5b 0 2024-02-28T16:02:19.496 INFO:tasks.workunit.client.0.smithi057.stdout:7/668: link d6/dc/d12/dc9/ldc d6/dc/d35/da6/le9 0 2024-02-28T16:02:19.496 INFO:tasks.workunit.client.0.smithi057.stdout:3/642: dwrite d8/dd/d14/d2e/d30/d6a/fa7 [0,4194304] 0 2024-02-28T16:02:19.498 INFO:tasks.workunit.client.0.smithi057.stdout:1/823: mkdir d1/d21/d66/d53/d7d/d67/d6c/d82/d112 0 2024-02-28T16:02:19.499 INFO:tasks.workunit.client.0.smithi057.stdout:0/823: dread - d6/d12/d5d/d71/daa/fcb zero size 2024-02-28T16:02:19.500 INFO:tasks.workunit.client.0.smithi057.stdout:4/729: stat d1/d10/d12/d2c/d50/d93 0 2024-02-28T16:02:19.504 INFO:tasks.workunit.client.0.smithi057.stdout:4/730: chown d1/d10/d12/d2c/d50/ddc 12683 1 2024-02-28T16:02:19.505 INFO:tasks.workunit.client.0.smithi057.stdout:3/643: write d8/dd/d14/d2e/d30/f8b [1095029,12314] 0 2024-02-28T16:02:19.505 INFO:tasks.workunit.client.0.smithi057.stdout:9/779: mknod d2/d5/dd8/c101 0 2024-02-28T16:02:19.507 INFO:tasks.workunit.client.0.smithi057.stdout:9/780: readlink d2/d24/lf0 0 2024-02-28T16:02:19.512 INFO:tasks.workunit.client.0.smithi057.stdout:1/824: unlink d1/d21/d25/f106 0 2024-02-28T16:02:19.513 INFO:tasks.workunit.client.0.smithi057.stdout:5/721: write d2/d12/d76/d7b/f69 [3224441,82580] 0 2024-02-28T16:02:19.518 INFO:tasks.workunit.client.0.smithi057.stdout:8/695: creat d5/de/d1b/d57/d9e/fe6 x:0 0 0 2024-02-28T16:02:19.519 INFO:tasks.workunit.client.0.smithi057.stdout:1/825: write d1/d3/dc/d15/d4e/d5f/dbe/dd3/f10b [158715,19449] 0 2024-02-28T16:02:19.524 INFO:tasks.workunit.client.0.smithi057.stdout:3/644: truncate d8/dd/f1f 4252304 0 2024-02-28T16:02:19.532 INFO:tasks.workunit.client.0.smithi057.stdout:5/722: dwrite d2/d12/d3d/f61 [0,4194304] 0 2024-02-28T16:02:19.534 INFO:tasks.workunit.client.0.smithi057.stdout:1/826: creat d1/d3/dc/d40/f113 x:0 0 0 2024-02-28T16:02:19.536 INFO:tasks.workunit.client.0.smithi057.stdout:6/760: dread df/d10/d13/f77 [0,4194304] 0 2024-02-28T16:02:19.541 INFO:tasks.workunit.client.0.smithi057.stdout:4/731: write d1/d10/d31/f6b [411364,76305] 0 2024-02-28T16:02:19.542 INFO:tasks.workunit.client.0.smithi057.stdout:3/645: creat d8/dd/d14/d2c/fd8 x:0 0 0 2024-02-28T16:02:19.542 INFO:tasks.workunit.client.0.smithi057.stdout:8/696: mkdir d5/de7 0 2024-02-28T16:02:19.543 INFO:tasks.workunit.client.0.smithi057.stdout:7/669: write d6/dc/f34 [2243241,5879] 0 2024-02-28T16:02:19.547 INFO:tasks.workunit.client.0.smithi057.stdout:2/741: sync 2024-02-28T16:02:19.549 INFO:tasks.workunit.client.0.smithi057.stdout:9/781: rename d2/d5/d1b/d2e/d77/c86 to d2/d5/c102 0 2024-02-28T16:02:19.552 INFO:tasks.workunit.client.0.smithi057.stdout:1/827: mknod d1/d3/dc/c114 0 2024-02-28T16:02:19.552 INFO:tasks.workunit.client.0.smithi057.stdout:6/761: chown df/d61/f62 50 1 2024-02-28T16:02:19.552 INFO:tasks.workunit.client.0.smithi057.stdout:3/646: write d8/dd/d14/d2e/d3b/d54/f99 [784701,15089] 0 2024-02-28T16:02:19.555 INFO:tasks.workunit.client.0.smithi057.stdout:6/762: chown df/d10/c3f 31407 1 2024-02-28T16:02:19.558 INFO:tasks.workunit.client.0.smithi057.stdout:5/723: getdents d2/ddd 0 2024-02-28T16:02:19.560 INFO:tasks.workunit.client.0.smithi057.stdout:8/697: symlink d5/d20/d39/d49/d56/d79/le8 0 2024-02-28T16:02:19.561 INFO:tasks.workunit.client.0.smithi057.stdout:4/732: creat d1/d10/d12/d2c/ffa x:0 0 0 2024-02-28T16:02:19.561 INFO:tasks.workunit.client.0.smithi057.stdout:3/647: mkdir d8/dd/d14/d2e/d30/d5f/dd9 0 2024-02-28T16:02:19.561 INFO:tasks.workunit.client.0.smithi057.stdout:5/724: fsync d2/d12/d3d/f82 0 2024-02-28T16:02:19.568 INFO:tasks.workunit.client.0.smithi057.stdout:5/725: readlink d2/d12/d3d/lbd 0 2024-02-28T16:02:19.568 INFO:tasks.workunit.client.0.smithi057.stdout:0/824: dwrite d6/d12/d17/d4b/fcc [0,4194304] 0 2024-02-28T16:02:19.576 INFO:tasks.workunit.client.0.smithi057.stdout:1/828: getdents d1/d21/d66/d53/d7d/dfc 0 2024-02-28T16:02:19.584 INFO:tasks.workunit.client.0.smithi057.stdout:8/698: mkdir d5/de/d1b/d57/d91/de9 0 2024-02-28T16:02:19.594 INFO:tasks.workunit.client.0.smithi057.stdout:1/829: symlink d1/d21/d66/d44/d4c/l115 0 2024-02-28T16:02:19.599 INFO:tasks.workunit.client.0.smithi057.stdout:5/726: creat d2/d15/d5e/fff x:0 0 0 2024-02-28T16:02:19.605 INFO:tasks.workunit.client.0.smithi057.stdout:2/742: dwrite d19/d2c/d48/da2/fec [0,4194304] 0 2024-02-28T16:02:19.606 INFO:tasks.workunit.client.0.smithi057.stdout:4/733: dwrite d1/d10/d12/d2c/d37/d46/dac/fef [0,4194304] 0 2024-02-28T16:02:19.606 INFO:tasks.workunit.client.0.smithi057.stdout:8/699: mkdir d5/d20/d39/d59/db7/dea 0 2024-02-28T16:02:19.607 INFO:tasks.workunit.client.0.smithi057.stdout:3/648: dwrite d8/dd/d14/d2e/d30/d6a/fa7 [0,4194304] 0 2024-02-28T16:02:19.611 INFO:tasks.workunit.client.0.smithi057.stdout:9/782: dwrite d2/d5/d1b/d2e/f53 [0,4194304] 0 2024-02-28T16:02:19.612 INFO:tasks.workunit.client.0.smithi057.stdout:2/743: chown d19/d1d/d89/fa6 0 1 2024-02-28T16:02:19.616 INFO:tasks.workunit.client.0.smithi057.stdout:1/830: fdatasync d1/d21/d66/d53/d7d/d67/d7a/d92/f9d 0 2024-02-28T16:02:19.627 INFO:tasks.workunit.client.0.smithi057.stdout:0/825: dwrite d6/d12/d17/d34/f76 [4194304,4194304] 0 2024-02-28T16:02:19.627 INFO:tasks.workunit.client.0.smithi057.stdout:4/734: unlink d1/d10/d12/d2c/fbc 0 2024-02-28T16:02:19.631 INFO:tasks.workunit.client.0.smithi057.stdout:4/735: read - d1/d10/d12/d2c/fe5 zero size 2024-02-28T16:02:19.632 INFO:tasks.workunit.client.0.smithi057.stdout:0/826: fdatasync d6/d12/d45/d78/f90 0 2024-02-28T16:02:19.634 INFO:tasks.workunit.client.0.smithi057.stdout:0/827: chown d6/c72 616412 1 2024-02-28T16:02:19.641 INFO:tasks.workunit.client.0.smithi057.stdout:6/763: dread df/d61/f99 [0,4194304] 0 2024-02-28T16:02:19.641 INFO:tasks.workunit.client.0.smithi057.stdout:4/736: write d1/d10/d31/d86/dd1/fb6 [88081,124103] 0 2024-02-28T16:02:19.648 INFO:tasks.workunit.client.0.smithi057.stdout:8/700: creat d5/d20/d39/d8c/feb x:0 0 0 2024-02-28T16:02:19.659 INFO:tasks.workunit.client.0.smithi057.stdout:5/727: mknod d2/d12/c100 0 2024-02-28T16:02:19.665 INFO:tasks.workunit.client.0.smithi057.stdout:3/649: truncate d8/dd/d14/d2e/d30/d5f/d6b/fd5 843886 0 2024-02-28T16:02:19.668 INFO:tasks.workunit.client.0.smithi057.stdout:9/783: rmdir d2/d5e/dc3 39 2024-02-28T16:02:19.677 INFO:tasks.workunit.client.0.smithi057.stdout:1/831: creat d1/d21/d66/dd0/f116 x:0 0 0 2024-02-28T16:02:19.678 INFO:tasks.workunit.client.0.smithi057.stdout:2/744: write d19/d34/f53 [979078,86870] 0 2024-02-28T16:02:19.678 INFO:tasks.workunit.client.0.smithi057.stdout:3/650: creat d8/d94/fda x:0 0 0 2024-02-28T16:02:19.679 INFO:tasks.workunit.client.0.smithi057.stdout:5/728: chown d2/l33 712 1 2024-02-28T16:02:19.683 INFO:tasks.workunit.client.0.smithi057.stdout:8/701: dread d5/d20/f9a [0,4194304] 0 2024-02-28T16:02:19.683 INFO:tasks.workunit.client.0.smithi057.stdout:6/764: mknod df/d10/d13/cf5 0 2024-02-28T16:02:19.686 INFO:tasks.workunit.client.0.smithi057.stdout:8/702: dread - d5/d20/d39/d59/d67/fb5 zero size 2024-02-28T16:02:19.687 INFO:tasks.workunit.client.0.smithi057.stdout:9/784: chown d2/d5/d1b/d2e/ld6 1716354374 1 2024-02-28T16:02:19.697 INFO:tasks.workunit.client.0.smithi057.stdout:8/703: readlink d5/de/d1b/l32 0 2024-02-28T16:02:19.702 INFO:tasks.workunit.client.0.smithi057.stdout:8/704: truncate d5/d20/d39/fb9 584797 0 2024-02-28T16:02:19.702 INFO:tasks.workunit.client.0.smithi057.stdout:0/828: dwrite d6/d12/d17/f10c [0,4194304] 0 2024-02-28T16:02:19.707 INFO:tasks.workunit.client.0.smithi057.stdout:1/832: dwrite d1/d3/dc/ff [0,4194304] 0 2024-02-28T16:02:19.709 INFO:tasks.workunit.client.0.smithi057.stdout:5/729: dwrite d2/d15/d63/de7/fe8 [0,4194304] 0 2024-02-28T16:02:19.712 INFO:tasks.workunit.client.0.smithi057.stdout:1/833: chown d1/d21/d66/ff5 126 1 2024-02-28T16:02:19.714 INFO:tasks.workunit.client.0.smithi057.stdout:5/730: truncate d2/d15/f1f 8578271 0 2024-02-28T16:02:19.723 INFO:tasks.workunit.client.0.smithi057.stdout:4/737: link d1/d10/d31/c91 d1/db8/cfb 0 2024-02-28T16:02:19.724 INFO:tasks.workunit.client.0.smithi057.stdout:3/651: mknod d8/d4b/cdb 0 2024-02-28T16:02:19.725 INFO:tasks.workunit.client.0.smithi057.stdout:6/765: symlink df/d61/d7c/lf6 0 2024-02-28T16:02:19.728 INFO:tasks.workunit.client.0.smithi057.stdout:9/785: dread - d2/d5/d1b/fba zero size 2024-02-28T16:02:19.733 INFO:tasks.workunit.client.0.smithi057.stdout:7/670: sync 2024-02-28T16:02:19.738 INFO:tasks.workunit.client.0.smithi057.stdout:5/731: mkdir d2/d15/d101 0 2024-02-28T16:02:19.739 INFO:tasks.workunit.client.0.smithi057.stdout:4/738: symlink d1/d3f/lfc 0 2024-02-28T16:02:19.740 INFO:tasks.workunit.client.0.smithi057.stdout:3/652: rename d8/dd/d14/d2e/d30/f64 to d8/d4b/dd2/fdc 0 2024-02-28T16:02:19.745 INFO:tasks.workunit.client.0.smithi057.stdout:2/745: link d19/d2c/ld9 d19/d34/d78/d95/lf9 0 2024-02-28T16:02:19.747 INFO:tasks.workunit.client.0.smithi057.stdout:2/746: chown d19/d1d/d2e/de2 88 1 2024-02-28T16:02:19.749 INFO:tasks.workunit.client.0.smithi057.stdout:5/732: creat d2/d15/d5e/d6d/f102 x:0 0 0 2024-02-28T16:02:19.752 INFO:tasks.workunit.client.0.smithi057.stdout:5/733: chown d2/d15/d5e/d67/l72 0 1 2024-02-28T16:02:19.753 INFO:tasks.workunit.client.0.smithi057.stdout:5/734: read - d2/d15/d5e/d6d/f102 zero size 2024-02-28T16:02:19.754 INFO:tasks.workunit.client.0.smithi057.stdout:6/766: rename df/d10/d13/fb3 to df/d10/d78/dca/d15/d16/d39/d92/da4/ff7 0 2024-02-28T16:02:19.759 INFO:tasks.workunit.client.0.smithi057.stdout:2/747: mknod d19/d43/d5a/d70/cfa 0 2024-02-28T16:02:19.760 INFO:tasks.workunit.client.0.smithi057.stdout:5/735: creat d2/d15/d63/f103 x:0 0 0 2024-02-28T16:02:19.760 INFO:tasks.workunit.client.0.smithi057.stdout:7/671: rename d6/dc/d67/fa5 to d6/dc/d35/db2/fea 0 2024-02-28T16:02:19.764 INFO:tasks.workunit.client.0.smithi057.stdout:4/739: mkdir d1/d10/d12/d39/db4/de7/dfd 0 2024-02-28T16:02:19.772 INFO:tasks.workunit.client.0.smithi057.stdout:6/767: dwrite df/d10/d78/dca/d15/d16/f46 [0,4194304] 0 2024-02-28T16:02:19.772 INFO:tasks.workunit.client.0.smithi057.stdout:7/672: stat d6/d26/ccd 0 2024-02-28T16:02:19.775 INFO:tasks.workunit.client.0.smithi057.stdout:5/736: truncate d2/d12/fd6 650062 0 2024-02-28T16:02:19.776 INFO:tasks.workunit.client.0.smithi057.stdout:6/768: write df/d10/d78/dca/fc2 [180390,59857] 0 2024-02-28T16:02:19.778 INFO:tasks.workunit.client.0.smithi057.stdout:3/653: getdents d8/dd/d14/d2e/d3b/d71 0 2024-02-28T16:02:19.782 INFO:tasks.workunit.client.0.smithi057.stdout:6/769: chown df/d10/d78/d5b/d7b/fa1 1538 1 2024-02-28T16:02:19.784 INFO:tasks.workunit.client.0.smithi057.stdout:2/748: creat d19/d2c/ffb x:0 0 0 2024-02-28T16:02:19.788 INFO:tasks.workunit.client.0.smithi057.stdout:7/673: rename d6/dc/c6f to d6/dc/d12/dc9/ceb 0 2024-02-28T16:02:19.789 INFO:tasks.workunit.client.0.smithi057.stdout:3/654: fdatasync d8/dd/d14/d2e/fbe 0 2024-02-28T16:02:19.798 INFO:tasks.workunit.client.0.smithi057.stdout:4/740: dread d1/d10/d12/d2c/fbb [0,4194304] 0 2024-02-28T16:02:19.798 INFO:tasks.workunit.client.0.smithi057.stdout:2/749: chown d19/d43/c4e 5928868 1 2024-02-28T16:02:19.800 INFO:tasks.workunit.client.0.smithi057.stdout:7/674: creat d6/dc/d67/d9a/da1/fec x:0 0 0 2024-02-28T16:02:19.803 INFO:tasks.workunit.client.0.smithi057.stdout:3/655: rename d8/d4b/dcd to d8/d4b/dd2/ddd 0 2024-02-28T16:02:19.804 INFO:tasks.workunit.client.0.smithi057.stdout:5/737: link d2/d15/d5e/d9a/dac/lc9 d2/ddc/l104 0 2024-02-28T16:02:19.810 INFO:tasks.workunit.client.0.smithi057.stdout:6/770: symlink df/d61/d66/lf8 0 2024-02-28T16:02:19.816 INFO:tasks.workunit.client.0.smithi057.stdout:8/705: truncate d5/de/d1b/d45/d81/dae/fc4 3921200 0 2024-02-28T16:02:19.820 INFO:tasks.workunit.client.0.smithi057.stdout:2/750: rename d19/d1d/d2e/de7 to d19/d1d/d2e/d3c/dab/dfc 0 2024-02-28T16:02:19.821 INFO:tasks.workunit.client.0.smithi057.stdout:8/706: chown d5/d6/fd 154 1 2024-02-28T16:02:19.822 INFO:tasks.workunit.client.0.smithi057.stdout:9/786: write d2/d5/d9/f1c [787473,86800] 0 2024-02-28T16:02:19.823 INFO:tasks.workunit.client.0.smithi057.stdout:4/741: dwrite d1/d22/f2a [4194304,4194304] 0 2024-02-28T16:02:19.825 INFO:tasks.workunit.client.0.smithi057.stdout:0/829: dwrite d6/d12/d5d/d71/daa/fcb [0,4194304] 0 2024-02-28T16:02:19.827 INFO:tasks.workunit.client.0.smithi057.stdout:3/656: creat d8/dd/d14/d2e/d76/d89/d6c/fde x:0 0 0 2024-02-28T16:02:19.827 INFO:tasks.workunit.client.0.smithi057.stdout:5/738: creat d2/d12/d76/d7a/d95/f105 x:0 0 0 2024-02-28T16:02:19.828 INFO:tasks.workunit.client.0.smithi057.stdout:1/834: dwrite d1/d3/dc/d15/da3/fbd [0,4194304] 0 2024-02-28T16:02:19.833 INFO:tasks.workunit.client.0.smithi057.stdout:6/771: rmdir df/d10/d13 39 2024-02-28T16:02:19.835 INFO:tasks.workunit.client.0.smithi057.stdout:0/830: rename d6 to d6/d12/d17/d4b/d60/d6b/d117 22 2024-02-28T16:02:19.835 INFO:tasks.workunit.client.0.smithi057.stdout:4/742: chown d1/d10/d12/d2c/d37/d46/dac/de9/df4 2817 1 2024-02-28T16:02:19.840 INFO:tasks.workunit.client.0.smithi057.stdout:6/772: read - df/d10/d4f/fe4 zero size 2024-02-28T16:02:19.843 INFO:tasks.workunit.client.0.smithi057.stdout:8/707: symlink d5/d20/d39/d59/lec 0 2024-02-28T16:02:19.846 INFO:tasks.workunit.client.0.smithi057.stdout:1/835: truncate d1/d21/d66/d53/d7d/d67/d7a/d94/ff3 745503 0 2024-02-28T16:02:19.846 INFO:tasks.workunit.client.0.smithi057.stdout:2/751: write d19/d2c/d48/fba [2033317,123780] 0 2024-02-28T16:02:19.848 INFO:tasks.workunit.client.0.smithi057.stdout:3/657: mknod d8/dd/d14/d2e/d30/d49/d51/cdf 0 2024-02-28T16:02:19.848 INFO:tasks.workunit.client.0.smithi057.stdout:8/708: readlink d5/d20/da2/d8d/l95 0 2024-02-28T16:02:19.851 INFO:tasks.workunit.client.0.smithi057.stdout:5/739: mknod d2/d15/d5e/d9a/dac/c106 0 2024-02-28T16:02:19.852 INFO:tasks.workunit.client.0.smithi057.stdout:3/658: readlink d8/dd/d14/d2e/d76/d89/d6c/lc9 0 2024-02-28T16:02:19.856 INFO:tasks.workunit.client.0.smithi057.stdout:5/740: fdatasync d2/d12/d76/d7a/d95/db5/dce/fd4 0 2024-02-28T16:02:19.858 INFO:tasks.workunit.client.0.smithi057.stdout:9/787: dread d2/d46/d67/fdc [0,4194304] 0 2024-02-28T16:02:19.860 INFO:tasks.workunit.client.0.smithi057.stdout:7/675: fsync d6/dc/d67/d9a/da1/fec 0 2024-02-28T16:02:19.862 INFO:tasks.workunit.client.0.smithi057.stdout:7/676: dread - d6/dc/d12/fdb zero size 2024-02-28T16:02:19.866 INFO:tasks.workunit.client.0.smithi057.stdout:2/752: fdatasync d19/d1d/d2e/f9c 0 2024-02-28T16:02:19.878 INFO:tasks.workunit.client.0.smithi057.stdout:3/659: creat d8/dd/d14/d2e/d2f/fe0 x:0 0 0 2024-02-28T16:02:19.881 INFO:tasks.workunit.client.0.smithi057.stdout:4/743: mkdir d1/d10/d12/d2c/d37/dfe 0 2024-02-28T16:02:19.882 INFO:tasks.workunit.client.0.smithi057.stdout:5/741: creat d2/d15/d5e/d67/f107 x:0 0 0 2024-02-28T16:02:19.883 INFO:tasks.workunit.client.0.smithi057.stdout:6/773: symlink df/d10/d78/dd6/lf9 0 2024-02-28T16:02:19.896 INFO:tasks.workunit.client.0.smithi057.stdout:1/836: dread d1/d21/d66/d44/d4c/fe5 [0,4194304] 0 2024-02-28T16:02:19.898 INFO:tasks.workunit.client.0.smithi057.stdout:2/753: mkdir d19/d3a/dfd 0 2024-02-28T16:02:19.899 INFO:tasks.workunit.client.0.smithi057.stdout:7/677: unlink d6/dc/le 0 2024-02-28T16:02:19.904 INFO:tasks.workunit.client.0.smithi057.stdout:0/831: truncate d6/d12/d17/d34/f76 5690806 0 2024-02-28T16:02:19.908 INFO:tasks.workunit.client.0.smithi057.stdout:3/660: rename d8/dd/d14/d2c/f95 to d8/dd/d14/d2e/d2f/da2/fe1 0 2024-02-28T16:02:19.908 INFO:tasks.workunit.client.0.smithi057.stdout:5/742: rmdir d2/d15 39 2024-02-28T16:02:19.911 INFO:tasks.workunit.client.0.smithi057.stdout:6/774: unlink df/f42 0 2024-02-28T16:02:19.913 INFO:tasks.workunit.client.0.smithi057.stdout:5/743: write d2/d12/d3d/f82 [33305,4582] 0 2024-02-28T16:02:19.913 INFO:tasks.workunit.client.0.smithi057.stdout:3/661: chown d8/dd/d14/d2e/d30/d5f/d6b/cad 6716 1 2024-02-28T16:02:19.914 INFO:tasks.workunit.client.0.smithi057.stdout:2/754: fdatasync d19/d1d/f3f 0 2024-02-28T16:02:19.917 INFO:tasks.workunit.client.0.smithi057.stdout:5/744: dread - d2/d12/fc4 zero size 2024-02-28T16:02:19.918 INFO:tasks.workunit.client.0.smithi057.stdout:8/709: link d5/f17 d5/de/d1b/d57/d91/de9/fed 0 2024-02-28T16:02:19.918 INFO:tasks.workunit.client.0.smithi057.stdout:7/678: chown d6/lb7 30466860 1 2024-02-28T16:02:19.920 INFO:tasks.workunit.client.0.smithi057.stdout:2/755: write d19/d1d/d89/f93 [982638,106543] 0 2024-02-28T16:02:19.928 INFO:tasks.workunit.client.0.smithi057.stdout:0/832: dwrite d6/d12/ffb [0,4194304] 0 2024-02-28T16:02:19.932 INFO:tasks.workunit.client.0.smithi057.stdout:9/788: link d2/d5/d9/d64/dc4/l100 d2/l103 0 2024-02-28T16:02:19.932 INFO:tasks.workunit.client.0.smithi057.stdout:6/775: creat df/d10/d78/dca/d15/d16/d39/d8d/dd9/ffa x:0 0 0 2024-02-28T16:02:19.933 INFO:tasks.workunit.client.0.smithi057.stdout:4/744: dread d1/d10/d12/d2c/d37/d46/fa0 [0,4194304] 0 2024-02-28T16:02:19.933 INFO:tasks.workunit.client.0.smithi057.stdout:5/745: fdatasync d2/d3e/f70 0 2024-02-28T16:02:19.936 INFO:tasks.workunit.client.0.smithi057.stdout:5/746: fdatasync d2/d12/d76/d7a/d95/db5/dcb/f4e 0 2024-02-28T16:02:19.937 INFO:tasks.workunit.client.0.smithi057.stdout:8/710: mknod d5/d20/d39/d59/d67/cee 0 2024-02-28T16:02:19.937 INFO:tasks.workunit.client.0.smithi057.stdout:0/833: write d6/d12/d45/f115 [837011,25980] 0 2024-02-28T16:02:19.943 INFO:tasks.workunit.client.0.smithi057.stdout:0/834: dread - d6/d12/d38/db4/ff7 zero size 2024-02-28T16:02:19.948 INFO:tasks.workunit.client.0.smithi057.stdout:7/679: dwrite d6/dc/d12/d29/f52 [8388608,4194304] 0 2024-02-28T16:02:19.953 INFO:tasks.workunit.client.0.smithi057.stdout:7/680: read - d6/dc/d67/fd6 zero size 2024-02-28T16:02:19.961 INFO:tasks.workunit.client.0.smithi057.stdout:4/745: mkdir d1/d10/d12/d2c/d50/dff 0 2024-02-28T16:02:19.961 INFO:tasks.workunit.client.0.smithi057.stdout:2/756: mkdir d19/d1d/d2e/d31/db1/dfe 0 2024-02-28T16:02:19.966 INFO:tasks.workunit.client.0.smithi057.stdout:8/711: readlink d5/d20/da2/d8d/lb0 0 2024-02-28T16:02:19.967 INFO:tasks.workunit.client.0.smithi057.stdout:4/746: write d1/d22/dcb/fd3 [1015816,50773] 0 2024-02-28T16:02:19.981 INFO:tasks.workunit.client.0.smithi057.stdout:6/776: dwrite df/d61/ff4 [0,4194304] 0 2024-02-28T16:02:19.986 INFO:tasks.workunit.client.0.smithi057.stdout:2/757: mknod d19/d2c/d7b/cff 0 2024-02-28T16:02:19.989 INFO:tasks.workunit.client.0.smithi057.stdout:3/662: dread d8/dd/d14/d2e/d3b/d54/fb6 [0,4194304] 0 2024-02-28T16:02:19.993 INFO:tasks.workunit.client.0.smithi057.stdout:3/663: write d8/dd/d14/d2e/d76/da1/faa [74139,12852] 0 2024-02-28T16:02:19.999 INFO:tasks.workunit.client.0.smithi057.stdout:4/747: creat d1/d10/d12/d2c/d50/f100 x:0 0 0 2024-02-28T16:02:20.000 INFO:tasks.workunit.client.0.smithi057.stdout:0/835: truncate d6/d12/d17/f37 578399 0 2024-02-28T16:02:20.000 INFO:tasks.workunit.client.0.smithi057.stdout:2/758: creat d19/d34/d78/d95/f100 x:0 0 0 2024-02-28T16:02:20.003 INFO:tasks.workunit.client.0.smithi057.stdout:0/836: chown d6/d12/d17/f3b 8252705 1 2024-02-28T16:02:20.010 INFO:tasks.workunit.client.0.smithi057.stdout:8/712: dwrite d5/de/d1b/f35 [4194304,4194304] 0 2024-02-28T16:02:20.021 INFO:tasks.workunit.client.0.smithi057.stdout:8/713: write d5/d20/d39/d49/d56/f51 [4952848,7418] 0 2024-02-28T16:02:20.031 INFO:tasks.workunit.client.0.smithi057.stdout:5/747: rename d2/l56 to d2/d12/d76/d7a/d95/db5/dcb/l108 0 2024-02-28T16:02:20.032 INFO:tasks.workunit.client.0.smithi057.stdout:3/664: truncate d8/dd/d14/d2e/d30/d5f/f85 832338 0 2024-02-28T16:02:20.046 INFO:tasks.workunit.client.0.smithi057.stdout:2/759: dread d19/d2c/f58 [0,4194304] 0 2024-02-28T16:02:20.046 INFO:tasks.workunit.client.0.smithi057.stdout:4/748: truncate d1/d10/d12/d2c/d50/ddc/fdf 3366404 0 2024-02-28T16:02:20.055 INFO:tasks.workunit.client.0.smithi057.stdout:6/777: rename df/f1f to df/d10/d78/d5b/d7b/de3/ffb 0 2024-02-28T16:02:20.057 INFO:tasks.workunit.client.0.smithi057.stdout:6/778: readlink df/d10/d78/dca/d15/d16/d39/la3 0 2024-02-28T16:02:20.061 INFO:tasks.workunit.client.0.smithi057.stdout:8/714: creat d5/d20/d39/d59/d67/da5/fef x:0 0 0 2024-02-28T16:02:20.063 INFO:tasks.workunit.client.0.smithi057.stdout:7/681: write d6/dc/d67/d9a/da1/f73 [885544,115256] 0 2024-02-28T16:02:20.070 INFO:tasks.workunit.client.0.smithi057.stdout:3/665: mkdir d8/dd/d14/d2e/d76/d89/de2 0 2024-02-28T16:02:20.074 INFO:tasks.workunit.client.0.smithi057.stdout:6/779: mknod df/d10/d78/dca/d15/d16/d39/d92/cfc 0 2024-02-28T16:02:20.078 INFO:tasks.workunit.client.0.smithi057.stdout:5/748: mknod d2/d15/d5e/c109 0 2024-02-28T16:02:20.078 INFO:tasks.workunit.client.0.smithi057.stdout:8/715: mknod d5/d20/d39/cf0 0 2024-02-28T16:02:20.083 INFO:tasks.workunit.client.0.smithi057.stdout:7/682: mknod d6/dc/d12/d1a/d4d/d56/ced 0 2024-02-28T16:02:20.084 INFO:tasks.workunit.client.0.smithi057.stdout:4/749: symlink d1/d10/d12/d2c/d37/d46/dac/de9/df4/l101 0 2024-02-28T16:02:20.091 INFO:tasks.workunit.client.0.smithi057.stdout:6/780: creat df/d10/d78/dca/dd0/ffd x:0 0 0 2024-02-28T16:02:20.092 INFO:tasks.workunit.client.0.smithi057.stdout:3/666: dwrite d8/dd/d19/d25/fae [0,4194304] 0 2024-02-28T16:02:20.102 INFO:tasks.workunit.client.0.smithi057.stdout:2/760: getdents d19/d34/d78/d95 0 2024-02-28T16:02:20.105 INFO:tasks.workunit.client.0.smithi057.stdout:2/761: chown d19/dc1/fcc 115 1 2024-02-28T16:02:20.107 INFO:tasks.workunit.client.0.smithi057.stdout:2/762: chown d19/d1d/d26/l33 6293037 1 2024-02-28T16:02:20.107 INFO:tasks.workunit.client.0.smithi057.stdout:3/667: dread d8/dd/d14/d2c/f4c [8388608,4194304] 0 2024-02-28T16:02:20.109 INFO:tasks.workunit.client.0.smithi057.stdout:4/750: unlink d1/d10/d12/d2c/d37/d46/dac/de9/d87/f9d 0 2024-02-28T16:02:20.111 INFO:tasks.workunit.client.0.smithi057.stdout:7/683: mknod d6/d38/cee 0 2024-02-28T16:02:20.128 INFO:tasks.workunit.client.0.smithi057.stdout:3/668: mkdir d8/dd/d19/d2a/de3 0 2024-02-28T16:02:20.131 INFO:tasks.workunit.client.0.smithi057.stdout:5/749: dwrite d2/d15/d63/f8f [0,4194304] 0 2024-02-28T16:02:20.138 INFO:tasks.workunit.client.0.smithi057.stdout:2/763: mkdir d19/d101 0 2024-02-28T16:02:20.138 INFO:tasks.workunit.client.0.smithi057.stdout:6/781: truncate df/d10/d13/d4b/f7d 863070 0 2024-02-28T16:02:20.141 INFO:tasks.workunit.client.0.smithi057.stdout:6/782: dread - df/d10/f7f zero size 2024-02-28T16:02:20.141 INFO:tasks.workunit.client.0.smithi057.stdout:6/783: stat df/d10/la9 0 2024-02-28T16:02:20.144 INFO:tasks.workunit.client.0.smithi057.stdout:3/669: creat d8/dd/d14/d2e/d76/fe4 x:0 0 0 2024-02-28T16:02:20.146 INFO:tasks.workunit.client.0.smithi057.stdout:3/670: stat d8/dd/d14/d2e/d30/fc0 0 2024-02-28T16:02:20.147 INFO:tasks.workunit.client.0.smithi057.stdout:5/750: fsync d2/d12/d3d/da4/fdb 0 2024-02-28T16:02:20.148 INFO:tasks.workunit.client.0.smithi057.stdout:5/751: readlink d2/l33 0 2024-02-28T16:02:20.149 INFO:tasks.workunit.client.0.smithi057.stdout:2/764: mkdir d19/d1d/d2e/de2/d102 0 2024-02-28T16:02:20.152 INFO:tasks.workunit.client.0.smithi057.stdout:4/751: creat d1/d10/f102 x:0 0 0 2024-02-28T16:02:20.160 INFO:tasks.workunit.client.0.smithi057.stdout:4/752: write d1/d10/d12/d2c/dd9/ff9 [752594,124456] 0 2024-02-28T16:02:20.167 INFO:tasks.workunit.client.0.smithi057.stdout:6/784: link df/d10/d78/dca/d15/d16/d39/d92/f93 df/d10/d4f/ded/ffe 0 2024-02-28T16:02:20.176 INFO:tasks.workunit.client.0.smithi057.stdout:4/753: rename d1/d22/dcb to d1/d10/d12/d2c/d50/dff/d103 0 2024-02-28T16:02:20.177 INFO:tasks.workunit.client.0.smithi057.stdout:7/684: dread d6/dc/d12/d1a/d4d/d56/f81 [0,4194304] 0 2024-02-28T16:02:20.182 INFO:tasks.workunit.client.0.smithi057.stdout:5/752: write d2/d12/d76/f87 [719886,88319] 0 2024-02-28T16:02:20.184 INFO:tasks.workunit.client.0.smithi057.stdout:7/685: chown d6/d26/l5d 411823276 1 2024-02-28T16:02:20.190 INFO:tasks.workunit.client.0.smithi057.stdout:7/686: mknod d6/dc/d12/d1a/d4c/d63/cef 0 2024-02-28T16:02:20.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/753: symlink d2/d3e/l10a 0 2024-02-28T16:02:20.194 INFO:tasks.workunit.client.0.smithi057.stdout:7/687: write d6/dc/d35/d58/f74 [129079,52487] 0 2024-02-28T16:02:20.200 INFO:tasks.workunit.client.0.smithi057.stdout:2/765: dwrite d19/d43/d5a/d9b/da3/f8b [0,4194304] 0 2024-02-28T16:02:20.204 INFO:tasks.workunit.client.0.smithi057.stdout:3/671: dread d8/f18 [0,4194304] 0 2024-02-28T16:02:20.206 INFO:tasks.workunit.client.0.smithi057.stdout:4/754: write d1/d10/d12/d2c/d37/fb2 [182311,83662] 0 2024-02-28T16:02:20.215 INFO:tasks.workunit.client.0.smithi057.stdout:6/785: dwrite df/d10/d78/dca/d15/d16/f4a [0,4194304] 0 2024-02-28T16:02:20.220 INFO:tasks.workunit.client.0.smithi057.stdout:3/672: symlink d8/dd/d19/d25/le5 0 2024-02-28T16:02:20.222 INFO:tasks.workunit.client.0.smithi057.stdout:6/786: dread df/d10/d78/fbe [0,4194304] 0 2024-02-28T16:02:20.226 INFO:tasks.workunit.client.0.smithi057.stdout:7/688: mkdir d6/dc/d12/d1a/d4d/df0 0 2024-02-28T16:02:20.227 INFO:tasks.workunit.client.0.smithi057.stdout:5/754: getdents d2/d12/d76/d7a 0 2024-02-28T16:02:20.231 INFO:tasks.workunit.client.0.smithi057.stdout:1/837: sync 2024-02-28T16:02:20.235 INFO:tasks.workunit.client.0.smithi057.stdout:6/787: rename df/d10/d13/d4b/d4e/def/ff3 to df/d10/d78/dca/d15/fff 0 2024-02-28T16:02:20.236 INFO:tasks.workunit.client.0.smithi057.stdout:4/755: symlink d1/d10/d12/d2c/l104 0 2024-02-28T16:02:20.241 INFO:tasks.workunit.client.0.smithi057.stdout:4/756: dread - d1/d10/d31/d86/dd1/ff3 zero size 2024-02-28T16:02:20.244 INFO:tasks.workunit.client.0.smithi057.stdout:6/788: write df/d10/d78/dca/d15/d16/d39/fd4 [499856,81144] 0 2024-02-28T16:02:20.245 INFO:tasks.workunit.client.0.smithi057.stdout:5/755: write d2/d8/f46 [50247,116694] 0 2024-02-28T16:02:20.248 INFO:tasks.workunit.client.0.smithi057.stdout:2/766: dwrite d19/d43/d5a/f96 [0,4194304] 0 2024-02-28T16:02:20.248 INFO:tasks.workunit.client.0.smithi057.stdout:1/838: write d1/d21/d66/d44/d4c/d75/fed [1449,26591] 0 2024-02-28T16:02:20.251 INFO:tasks.workunit.client.0.smithi057.stdout:4/757: creat d1/d10/d31/d86/f105 x:0 0 0 2024-02-28T16:02:20.258 INFO:tasks.workunit.client.0.smithi057.stdout:3/673: dwrite d8/dd/d14/d2e/d30/fc0 [0,4194304] 0 2024-02-28T16:02:20.264 INFO:tasks.workunit.client.0.smithi057.stdout:6/789: truncate df/d10/d78/dca/d15/d16/d39/d92/da4/ff7 1457891 0 2024-02-28T16:02:20.264 INFO:tasks.workunit.client.0.smithi057.stdout:7/689: dread d6/dc/d35/d58/f74 [0,4194304] 0 2024-02-28T16:02:20.266 INFO:tasks.workunit.client.0.smithi057.stdout:5/756: creat d2/d12/d76/d7b/f10b x:0 0 0 2024-02-28T16:02:20.266 INFO:tasks.workunit.client.0.smithi057.stdout:6/790: dread - df/d10/d4f/f71 zero size 2024-02-28T16:02:20.266 INFO:tasks.workunit.client.0.smithi057.stdout:4/758: fdatasync d1/d10/d12/d2c/d37/d46/dac/de9/f2b 0 2024-02-28T16:02:20.268 INFO:tasks.workunit.client.0.smithi057.stdout:3/674: chown d8/dd/d14/d2e/d30/d49/d51/cdf 362468992 1 2024-02-28T16:02:20.269 INFO:tasks.workunit.client.0.smithi057.stdout:9/789: sync 2024-02-28T16:02:20.269 INFO:tasks.workunit.client.0.smithi057.stdout:0/837: sync 2024-02-28T16:02:20.269 INFO:tasks.workunit.client.0.smithi057.stdout:8/716: sync 2024-02-28T16:02:20.273 INFO:tasks.workunit.client.0.smithi057.stdout:4/759: chown d1/d10/d12/d2c/d50/f6c 2 1 2024-02-28T16:02:20.278 INFO:tasks.workunit.client.0.smithi057.stdout:9/790: write d2/d46/d67/d7d/ff2 [906570,29170] 0 2024-02-28T16:02:20.280 INFO:tasks.workunit.client.0.smithi057.stdout:9/791: chown d2/d92/la8 13600 1 2024-02-28T16:02:20.283 INFO:tasks.workunit.client.0.smithi057.stdout:0/838: read d6/d12/d17/d4b/ff2 [626277,13202] 0 2024-02-28T16:02:20.283 INFO:tasks.workunit.client.0.smithi057.stdout:5/757: mkdir d2/d3e/d5b/db0/d10c 0 2024-02-28T16:02:20.286 INFO:tasks.workunit.client.0.smithi057.stdout:6/791: mknod df/d10/d78/dca/d15/d16/c100 0 2024-02-28T16:02:20.289 INFO:tasks.workunit.client.0.smithi057.stdout:2/767: link d19/d2c/d65/l66 d19/d1d/d2e/d3c/l103 0 2024-02-28T16:02:20.293 INFO:tasks.workunit.client.0.smithi057.stdout:8/717: mknod d5/de/d63/d70/cf1 0 2024-02-28T16:02:20.293 INFO:tasks.workunit.client.0.smithi057.stdout:2/768: chown d19/d34/d78 594517735 1 2024-02-28T16:02:20.294 INFO:tasks.workunit.client.0.smithi057.stdout:6/792: truncate df/d61/fba 1066163 0 2024-02-28T16:02:20.297 INFO:tasks.workunit.client.0.smithi057.stdout:2/769: truncate d19/d3a/f46 4447145 0 2024-02-28T16:02:20.298 INFO:tasks.workunit.client.0.smithi057.stdout:0/839: creat d6/d12/d45/d55/de3/f118 x:0 0 0 2024-02-28T16:02:20.298 INFO:tasks.workunit.client.0.smithi057.stdout:3/675: mknod d8/dd/d14/d2c/ce6 0 2024-02-28T16:02:20.300 INFO:tasks.workunit.client.0.smithi057.stdout:5/758: creat d2/d12/d76/d7a/d95/f10d x:0 0 0 2024-02-28T16:02:20.325 INFO:tasks.workunit.client.0.smithi057.stdout:1/839: dread d1/d3/dc/f69 [0,4194304] 0 2024-02-28T16:02:20.326 INFO:tasks.workunit.client.0.smithi057.stdout:0/840: write d6/d12/d17/d4b/d60/f73 [6863489,39969] 0 2024-02-28T16:02:20.327 INFO:tasks.workunit.client.0.smithi057.stdout:6/793: fdatasync df/d10/d78/dca/d15/d16/f49 0 2024-02-28T16:02:20.327 INFO:tasks.workunit.client.0.smithi057.stdout:2/770: creat d19/d1d/f104 x:0 0 0 2024-02-28T16:02:20.329 INFO:tasks.workunit.client.0.smithi057.stdout:7/690: dwrite d6/dc/f43 [0,4194304] 0 2024-02-28T16:02:20.330 INFO:tasks.workunit.client.0.smithi057.stdout:1/840: fsync d1/d21/d66/dc7/f10a 0 2024-02-28T16:02:20.332 INFO:tasks.workunit.client.0.smithi057.stdout:9/792: dwrite d2/d5/d1b/d2e/d4c/da0/ffa [0,4194304] 0 2024-02-28T16:02:20.332 INFO:tasks.workunit.client.0.smithi057.stdout:3/676: symlink d8/dd/d14/d2e/d3b/d54/le7 0 2024-02-28T16:02:20.335 INFO:tasks.workunit.client.0.smithi057.stdout:0/841: chown d6/d12/d45/dab/lae 1508583 1 2024-02-28T16:02:20.338 INFO:tasks.workunit.client.0.smithi057.stdout:7/691: chown d6/dc/d12/d1a/d4d/d5a/f7b 143 1 2024-02-28T16:02:20.341 INFO:tasks.workunit.client.0.smithi057.stdout:7/692: read - d6/dc/d12/d1a/d4d/f92 zero size 2024-02-28T16:02:20.347 INFO:tasks.workunit.client.0.smithi057.stdout:2/771: mkdir d19/d57/dc7/d105 0 2024-02-28T16:02:20.349 INFO:tasks.workunit.client.0.smithi057.stdout:6/794: symlink df/d10/d78/dca/d15/l101 0 2024-02-28T16:02:20.350 INFO:tasks.workunit.client.0.smithi057.stdout:3/677: read d8/dd/d19/d25/f7a [3754292,21928] 0 2024-02-28T16:02:20.354 INFO:tasks.workunit.client.0.smithi057.stdout:5/759: creat d2/d15/d5e/f10e x:0 0 0 2024-02-28T16:02:20.354 INFO:tasks.workunit.client.0.smithi057.stdout:6/795: fdatasync df/d10/d78/dca/d15/d82/fc9 0 2024-02-28T16:02:20.354 INFO:tasks.workunit.client.0.smithi057.stdout:1/841: dread d1/f7 [0,4194304] 0 2024-02-28T16:02:20.356 INFO:tasks.workunit.client.0.smithi057.stdout:0/842: fsync d6/d12/d17/f37 0 2024-02-28T16:02:20.359 INFO:tasks.workunit.client.0.smithi057.stdout:2/772: creat d19/d1d/d2e/d3c/dab/dfc/f106 x:0 0 0 2024-02-28T16:02:20.361 INFO:tasks.workunit.client.0.smithi057.stdout:5/760: rmdir d2/d15/d63/de7 39 2024-02-28T16:02:20.361 INFO:tasks.workunit.client.0.smithi057.stdout:0/843: read d6/fa6 [61121,120635] 0 2024-02-28T16:02:20.366 INFO:tasks.workunit.client.0.smithi057.stdout:1/842: rmdir d1/d21/d66/d53/d62 39 2024-02-28T16:02:20.368 INFO:tasks.workunit.client.0.smithi057.stdout:2/773: symlink d19/d3a/l107 0 2024-02-28T16:02:20.371 INFO:tasks.workunit.client.0.smithi057.stdout:7/693: getdents d6/dc/d12/d1a/d90 0 2024-02-28T16:02:20.372 INFO:tasks.workunit.client.0.smithi057.stdout:0/844: mknod d6/d12/d17/d34/db7/c119 0 2024-02-28T16:02:20.375 INFO:tasks.workunit.client.0.smithi057.stdout:9/793: truncate d2/d24/f14 2290040 0 2024-02-28T16:02:20.377 INFO:tasks.workunit.client.0.smithi057.stdout:2/774: fdatasync d19/d3a/fb0 0 2024-02-28T16:02:20.379 INFO:tasks.workunit.client.0.smithi057.stdout:7/694: creat d6/d38/ff1 x:0 0 0 2024-02-28T16:02:20.380 INFO:tasks.workunit.client.0.smithi057.stdout:0/845: readlink d6/d12/d45/l7b 0 2024-02-28T16:02:20.381 INFO:tasks.workunit.client.0.smithi057.stdout:5/761: fdatasync d2/d12/d76/d7a/d95/db5/dcb/d91/fcc 0 2024-02-28T16:02:20.385 INFO:tasks.workunit.client.0.smithi057.stdout:3/678: truncate d8/dd/d19/d25/fae 2093079 0 2024-02-28T16:02:20.385 INFO:tasks.workunit.client.0.smithi057.stdout:9/794: truncate d2/d5/d9/fb 2613172 0 2024-02-28T16:02:20.391 INFO:tasks.workunit.client.0.smithi057.stdout:7/695: symlink d6/dc/d67/d9a/da1/lf2 0 2024-02-28T16:02:20.392 INFO:tasks.workunit.client.0.smithi057.stdout:6/796: getdents df/d10/d78/dca/d15/d16/d39/d92 0 2024-02-28T16:02:20.394 INFO:tasks.workunit.client.0.smithi057.stdout:0/846: creat d6/d12/d5d/d71/daa/db6/f11a x:0 0 0 2024-02-28T16:02:20.397 INFO:tasks.workunit.client.0.smithi057.stdout:9/795: truncate d2/d5/d9/f32 3875537 0 2024-02-28T16:02:20.404 INFO:tasks.workunit.client.0.smithi057.stdout:7/696: creat d6/dc/d67/ff3 x:0 0 0 2024-02-28T16:02:20.407 INFO:tasks.workunit.client.0.smithi057.stdout:7/697: stat d6/dc/d12/le8 0 2024-02-28T16:02:20.410 INFO:tasks.workunit.client.0.smithi057.stdout:0/847: rmdir d6/d12/d5d/de9 39 2024-02-28T16:02:20.414 INFO:tasks.workunit.client.0.smithi057.stdout:6/797: dwrite df/d10/d78/dca/d15/d16/f31 [0,4194304] 0 2024-02-28T16:02:20.424 INFO:tasks.workunit.client.0.smithi057.stdout:2/775: dwrite d19/d57/fd8 [0,4194304] 0 2024-02-28T16:02:20.425 INFO:tasks.workunit.client.0.smithi057.stdout:7/698: creat d6/dc/d12/d1a/ff4 x:0 0 0 2024-02-28T16:02:20.426 INFO:tasks.workunit.client.0.smithi057.stdout:3/679: creat d8/fe8 x:0 0 0 2024-02-28T16:02:20.430 INFO:tasks.workunit.client.0.smithi057.stdout:5/762: truncate d2/d19/fe9 2623135 0 2024-02-28T16:02:20.437 INFO:tasks.workunit.client.0.smithi057.stdout:3/680: chown d8/dd/d14/d2e/d76/d89 3 1 2024-02-28T16:02:20.441 INFO:tasks.workunit.client.0.smithi057.stdout:2/776: truncate d19/d2c/d48/f7d 4876479 0 2024-02-28T16:02:20.441 INFO:tasks.workunit.client.0.smithi057.stdout:6/798: dread df/d10/d78/dca/d15/d16/d39/d92/fe2 [0,4194304] 0 2024-02-28T16:02:20.442 INFO:tasks.workunit.client.0.smithi057.stdout:7/699: mknod d6/dc/d35/cf5 0 2024-02-28T16:02:20.445 INFO:tasks.workunit.client.0.smithi057.stdout:7/700: fsync d6/dc/f2f 0 2024-02-28T16:02:20.454 INFO:tasks.workunit.client.0.smithi057.stdout:2/777: read - d19/d1d/d2e/d3c/dab/dfc/f106 zero size 2024-02-28T16:02:20.454 INFO:tasks.workunit.client.0.smithi057.stdout:0/848: dwrite d6/d12/d17/d92/f114 [0,4194304] 0 2024-02-28T16:02:20.455 INFO:tasks.workunit.client.0.smithi057.stdout:3/681: creat d8/dd/d14/d2e/d30/d5f/fe9 x:0 0 0 2024-02-28T16:02:20.464 INFO:tasks.workunit.client.0.smithi057.stdout:9/796: dwrite d2/d5/d1b/d2e/d77/f8e [0,4194304] 0 2024-02-28T16:02:20.468 INFO:tasks.workunit.client.0.smithi057.stdout:6/799: truncate df/d10/d78/dca/d15/d16/d39/fae 117950 0 2024-02-28T16:02:20.472 INFO:tasks.workunit.client.0.smithi057.stdout:5/763: dwrite d2/d12/d3d/f4b [0,4194304] 0 2024-02-28T16:02:20.474 INFO:tasks.workunit.client.0.smithi057.stdout:2/778: rename d19/d34/fb5 to d19/d43/df2/f108 0 2024-02-28T16:02:20.476 INFO:tasks.workunit.client.0.smithi057.stdout:6/800: dread - df/d10/d78/dca/d15/d16/fe8 zero size 2024-02-28T16:02:20.477 INFO:tasks.workunit.client.0.smithi057.stdout:0/849: truncate d6/d12/d17/d58/d95/daf/fc2 815634 0 2024-02-28T16:02:20.482 INFO:tasks.workunit.client.0.smithi057.stdout:9/797: rename d2/d5e to d2/d24/d1d/d104 0 2024-02-28T16:02:20.486 INFO:tasks.workunit.client.0.smithi057.stdout:2/779: creat d19/dc1/f109 x:0 0 0 2024-02-28T16:02:20.490 INFO:tasks.workunit.client.0.smithi057.stdout:6/801: symlink df/d10/d13/d70/l102 0 2024-02-28T16:02:20.493 INFO:tasks.workunit.client.0.smithi057.stdout:9/798: rename d2/d5/d9/d64/lac to d2/d24/d1d/d104/d65/d87/l105 0 2024-02-28T16:02:20.497 INFO:tasks.workunit.client.0.smithi057.stdout:2/780: write d19/d2c/d48/da2/fec [713209,97385] 0 2024-02-28T16:02:20.497 INFO:tasks.workunit.client.0.smithi057.stdout:0/850: mknod d6/d12/d38/c11b 0 2024-02-28T16:02:20.498 INFO:tasks.workunit.client.0.smithi057.stdout:6/802: mkdir df/d10/d78/dca/dd0/d103 0 2024-02-28T16:02:20.500 INFO:tasks.workunit.client.0.smithi057.stdout:9/799: chown d2/d5/d1b/d2e/d77/c72 22231 1 2024-02-28T16:02:20.500 INFO:tasks.workunit.client.0.smithi057.stdout:7/701: dwrite d6/dc/d12/d29/f3e [0,4194304] 0 2024-02-28T16:02:20.506 INFO:tasks.workunit.client.0.smithi057.stdout:5/764: getdents d2/d12/d5f/d77 0 2024-02-28T16:02:20.506 INFO:tasks.workunit.client.0.smithi057.stdout:6/803: readlink df/d10/d78/l6d 0 2024-02-28T16:02:20.506 INFO:tasks.workunit.client.0.smithi057.stdout:5/765: readlink d2/d12/d76/d7a/d95/db5/dcb/dab/lf8 0 2024-02-28T16:02:20.506 INFO:tasks.workunit.client.0.smithi057.stdout:2/781: mknod d19/d1d/d2e/de2/c10a 0 2024-02-28T16:02:20.508 INFO:tasks.workunit.client.0.smithi057.stdout:7/702: truncate d6/dc/d67/fbe 748686 0 2024-02-28T16:02:20.511 INFO:tasks.workunit.client.0.smithi057.stdout:5/766: write d2/d8/f46 [290411,116527] 0 2024-02-28T16:02:20.514 INFO:tasks.workunit.client.0.smithi057.stdout:0/851: rename d6/d4e/cbd to d6/d12/d45/d55/de3/c11c 0 2024-02-28T16:02:20.515 INFO:tasks.workunit.client.0.smithi057.stdout:9/800: creat d2/d5/d9/d5d/dd7/f106 x:0 0 0 2024-02-28T16:02:20.523 INFO:tasks.workunit.client.0.smithi057.stdout:2/782: dwrite fe [0,4194304] 0 2024-02-28T16:02:20.526 INFO:tasks.workunit.client.0.smithi057.stdout:7/703: mknod d6/dc/d12/d1a/d4d/d56/cf6 0 2024-02-28T16:02:20.528 INFO:tasks.workunit.client.0.smithi057.stdout:7/704: write d6/dc/d12/d1a/d4d/d5a/f7b [12381328,126555] 0 2024-02-28T16:02:20.530 INFO:tasks.workunit.client.0.smithi057.stdout:6/804: creat df/d10/d4f/ded/f104 x:0 0 0 2024-02-28T16:02:20.535 INFO:tasks.workunit.client.0.smithi057.stdout:0/852: symlink d6/d12/d17/d58/l11d 0 2024-02-28T16:02:20.538 INFO:tasks.workunit.client.0.smithi057.stdout:9/801: rmdir d2/d5/d1b/d2e/d4c/da0/da7 39 2024-02-28T16:02:20.540 INFO:tasks.workunit.client.0.smithi057.stdout:2/783: creat d19/d1d/d89/f10b x:0 0 0 2024-02-28T16:02:20.544 INFO:tasks.workunit.client.0.smithi057.stdout:7/705: creat d6/dc/d35/db2/ff7 x:0 0 0 2024-02-28T16:02:20.551 INFO:tasks.workunit.client.0.smithi057.stdout:5/767: truncate d2/d19/fa2 4199758 0 2024-02-28T16:02:20.553 INFO:tasks.workunit.client.0.smithi057.stdout:9/802: creat d2/d24/d9c/ddd/f107 x:0 0 0 2024-02-28T16:02:20.557 INFO:tasks.workunit.client.0.smithi057.stdout:0/853: write d6/d12/d45/d55/f1e [6069480,77369] 0 2024-02-28T16:02:20.559 INFO:tasks.workunit.client.0.smithi057.stdout:2/784: fsync d19/d1d/d2e/d3c/dab/dfc/fef 0 2024-02-28T16:02:20.560 INFO:tasks.workunit.client.0.smithi057.stdout:4/760: sync 2024-02-28T16:02:20.560 INFO:tasks.workunit.client.0.smithi057.stdout:0/854: write d6/d12/ffb [4009906,11393] 0 2024-02-28T16:02:20.562 INFO:tasks.workunit.client.0.smithi057.stdout:2/785: stat d19/d43/d5a/fdf 0 2024-02-28T16:02:20.562 INFO:tasks.workunit.client.0.smithi057.stdout:4/761: read - d1/d10/d12/d2c/d50/d93/fdd zero size 2024-02-28T16:02:20.565 INFO:tasks.workunit.client.0.smithi057.stdout:6/805: truncate df/d10/d78/dca/f43 2895779 0 2024-02-28T16:02:20.568 INFO:tasks.workunit.client.0.smithi057.stdout:0/855: mknod d6/d12/d45/d78/c11e 0 2024-02-28T16:02:20.575 INFO:tasks.workunit.client.0.smithi057.stdout:2/786: creat d19/d1d/d2e/d3c/dab/f10c x:0 0 0 2024-02-28T16:02:20.579 INFO:tasks.workunit.client.0.smithi057.stdout:4/762: dwrite d1/d10/d31/f6b [0,4194304] 0 2024-02-28T16:02:20.580 INFO:tasks.workunit.client.0.smithi057.stdout:9/803: rmdir d2/d24/d9c/ddd/df6 0 2024-02-28T16:02:20.584 INFO:tasks.workunit.client.0.smithi057.stdout:0/856: rename d6/d12/d5d/d71/c110 to d6/d12/da4/c11f 0 2024-02-28T16:02:20.588 INFO:tasks.workunit.client.0.smithi057.stdout:5/768: getdents d2/d19 0 2024-02-28T16:02:20.592 INFO:tasks.workunit.client.0.smithi057.stdout:2/787: unlink d19/d1d/d26/f91 0 2024-02-28T16:02:20.592 INFO:tasks.workunit.client.0.smithi057.stdout:9/804: fdatasync d2/d62/f88 0 2024-02-28T16:02:20.595 INFO:tasks.workunit.client.0.smithi057.stdout:9/805: write d2/d5/d9/f54 [1265415,90713] 0 2024-02-28T16:02:20.595 INFO:tasks.workunit.client.0.smithi057.stdout:4/763: unlink d1/d10/d12/d2c/d50/d93/lc5 0 2024-02-28T16:02:20.598 INFO:tasks.workunit.client.0.smithi057.stdout:5/769: creat d2/d19/d1c/f10f x:0 0 0 2024-02-28T16:02:20.598 INFO:tasks.workunit.client.0.smithi057.stdout:4/764: truncate d1/d10/d12/d39/db4/fd0 517707 0 2024-02-28T16:02:20.600 INFO:tasks.workunit.client.0.smithi057.stdout:2/788: rmdir d19/d1d/d2e/d3c/dab 39 2024-02-28T16:02:20.601 INFO:tasks.workunit.client.0.smithi057.stdout:5/770: write d2/d15/d5e/d67/fbe [379493,114207] 0 2024-02-28T16:02:20.602 INFO:tasks.workunit.client.0.smithi057.stdout:4/765: fsync d1/d10/d12/d39/fba 0 2024-02-28T16:02:20.604 INFO:tasks.workunit.client.0.smithi057.stdout:2/789: write d19/d43/d5a/fdf [1435445,120891] 0 2024-02-28T16:02:20.604 INFO:tasks.workunit.client.0.smithi057.stdout:0/857: dread d6/d12/d38/f5c [0,4194304] 0 2024-02-28T16:02:20.608 INFO:tasks.workunit.client.0.smithi057.stdout:4/766: chown d1/d10/d12/d39/de4/ff8 2243707 1 2024-02-28T16:02:20.608 INFO:tasks.workunit.client.0.smithi057.stdout:2/790: stat d19/d3a/l107 0 2024-02-28T16:02:20.608 INFO:tasks.workunit.client.0.smithi057.stdout:6/806: getdents df/d61/d66 0 2024-02-28T16:02:20.609 INFO:tasks.workunit.client.0.smithi057.stdout:9/806: readlink d2/d24/d1d/d104/la9 0 2024-02-28T16:02:20.609 INFO:tasks.workunit.client.0.smithi057.stdout:4/767: dread - d1/d10/d12/d2c/fe5 zero size 2024-02-28T16:02:20.611 INFO:tasks.workunit.client.0.smithi057.stdout:9/807: chown d2/d24/d1d/d104/d65 23297904 1 2024-02-28T16:02:20.612 INFO:tasks.workunit.client.0.smithi057.stdout:4/768: write d1/d10/d12/d2c/fe1 [954136,57572] 0 2024-02-28T16:02:20.613 INFO:tasks.workunit.client.0.smithi057.stdout:9/808: chown d2/d5/d1b/d2e 808097860 1 2024-02-28T16:02:20.614 INFO:tasks.workunit.client.0.smithi057.stdout:5/771: read - d2/d3e/fca zero size 2024-02-28T16:02:20.618 INFO:tasks.workunit.client.0.smithi057.stdout:4/769: stat d1/d10/d12/d2c/d37/d46/dac/de9/d5e/de8 0 2024-02-28T16:02:20.618 INFO:tasks.workunit.client.0.smithi057.stdout:6/807: creat df/d10/d4f/ded/f105 x:0 0 0 2024-02-28T16:02:20.621 INFO:tasks.workunit.client.0.smithi057.stdout:0/858: dread d6/d12/d17/d4b/fcc [0,4194304] 0 2024-02-28T16:02:20.625 INFO:tasks.workunit.client.0.smithi057.stdout:0/859: truncate d6/d4e/f33 1832976 0 2024-02-28T16:02:20.626 INFO:tasks.workunit.client.0.smithi057.stdout:2/791: mkdir d19/d101/d10d 0 2024-02-28T16:02:20.629 INFO:tasks.workunit.client.0.smithi057.stdout:9/809: fdatasync d2/d24/f14 0 2024-02-28T16:02:20.637 INFO:tasks.workunit.client.0.smithi057.stdout:4/770: dwrite d1/d3f/d5f/f83 [0,4194304] 0 2024-02-28T16:02:20.641 INFO:tasks.workunit.client.0.smithi057.stdout:6/808: truncate df/d10/d13/d4b/f89 1856637 0 2024-02-28T16:02:20.644 INFO:tasks.workunit.client.0.smithi057.stdout:2/792: creat d19/d2c/f10e x:0 0 0 2024-02-28T16:02:20.645 INFO:tasks.workunit.client.0.smithi057.stdout:6/809: rmdir df/d10 39 2024-02-28T16:02:20.646 INFO:tasks.workunit.client.0.smithi057.stdout:5/772: dread d2/d12/d5f/d77/f93 [0,4194304] 0 2024-02-28T16:02:20.647 INFO:tasks.workunit.client.0.smithi057.stdout:9/810: getdents d2/d46/d67 0 2024-02-28T16:02:20.650 INFO:tasks.workunit.client.0.smithi057.stdout:5/773: rmdir d2/d19 39 2024-02-28T16:02:20.655 INFO:tasks.workunit.client.0.smithi057.stdout:0/860: dread d6/d12/d45/d78/f90 [0,4194304] 0 2024-02-28T16:02:20.656 INFO:tasks.workunit.client.0.smithi057.stdout:0/861: stat d6/d12/d17/d58/db8/fff 0 2024-02-28T16:02:20.659 INFO:tasks.workunit.client.0.smithi057.stdout:0/862: dread - d6/d12/d5d/d71/f107 zero size 2024-02-28T16:02:20.660 INFO:tasks.workunit.client.0.smithi057.stdout:2/793: rename d19/d1d/d2e/d3c/c8c to d19/d1d/d2e/c10f 0 2024-02-28T16:02:20.663 INFO:tasks.workunit.client.0.smithi057.stdout:9/811: creat d2/d5/d1b/d2e/d4c/da0/f108 x:0 0 0 2024-02-28T16:02:20.663 INFO:tasks.workunit.client.0.smithi057.stdout:5/774: truncate d2/d15/d63/f9b 878376 0 2024-02-28T16:02:20.663 INFO:tasks.workunit.client.0.smithi057.stdout:9/812: readlink d2/d5/d9/d64/d78/l99 0 2024-02-28T16:02:20.666 INFO:tasks.workunit.client.0.smithi057.stdout:2/794: stat d19/d1d/d2e/d3c/l103 0 2024-02-28T16:02:20.667 INFO:tasks.workunit.client.0.smithi057.stdout:9/813: write d2/d5/f37 [3412118,125464] 0 2024-02-28T16:02:20.669 INFO:tasks.workunit.client.0.smithi057.stdout:6/810: link df/d10/d78/dca/d15/d16/c79 df/d10/d78/dca/dd0/c106 0 2024-02-28T16:02:20.673 INFO:tasks.workunit.client.0.smithi057.stdout:5/775: readlink d2/d12/d76/d7a/d95/db5/dcb/l48 0 2024-02-28T16:02:20.676 INFO:tasks.workunit.client.0.smithi057.stdout:5/776: fsync d2/f4a 0 2024-02-28T16:02:20.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:20 smithi057 ceph-mon[28763]: pgmap v42: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 71 MiB/s rd, 162 MiB/s wr, 452 op/s 2024-02-28T16:02:20.686 INFO:tasks.workunit.client.0.smithi057.stdout:6/811: fsync df/d10/d78/d5b/d7b/f88 0 2024-02-28T16:02:20.687 INFO:tasks.workunit.client.0.smithi057.stdout:0/863: getdents d6/d12/d5d/d71/daa 0 2024-02-28T16:02:20.691 INFO:tasks.workunit.client.0.smithi057.stdout:4/771: dread d1/d10/d12/d2c/d50/f6c [0,4194304] 0 2024-02-28T16:02:20.695 INFO:tasks.workunit.client.0.smithi057.stdout:9/814: dwrite d2/d24/d1d/d104/d65/d87/fd5 [0,4194304] 0 2024-02-28T16:02:20.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:20 smithi087 ceph-mon[37122]: pgmap v42: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 71 MiB/s rd, 162 MiB/s wr, 452 op/s 2024-02-28T16:02:20.721 INFO:tasks.workunit.client.0.smithi057.stdout:5/777: write d2/d19/d1c/f36 [2022815,89691] 0 2024-02-28T16:02:20.724 INFO:tasks.workunit.client.0.smithi057.stdout:4/772: readlink d1/d10/d12/d2c/l94 0 2024-02-28T16:02:20.726 INFO:tasks.workunit.client.0.smithi057.stdout:9/815: mknod d2/d62/c109 0 2024-02-28T16:02:20.726 INFO:tasks.workunit.client.0.smithi057.stdout:5/778: truncate d2/d15/d5e/d67/f107 1020738 0 2024-02-28T16:02:20.727 INFO:tasks.workunit.client.0.smithi057.stdout:0/864: symlink d6/d12/d5d/d71/d10a/l120 0 2024-02-28T16:02:20.730 INFO:tasks.workunit.client.0.smithi057.stdout:6/812: link df/d10/d78/dca/d15/d16/d39/d8d/le5 df/d10/d78/dca/d15/d16/d39/d92/da4/l107 0 2024-02-28T16:02:20.733 INFO:tasks.workunit.client.0.smithi057.stdout:4/773: rename d1/d10/d12/d2c/d37/c7a to d1/d10/d12/d2c/dd9/c106 0 2024-02-28T16:02:20.737 INFO:tasks.workunit.client.0.smithi057.stdout:0/865: link d6/d4e/f33 d6/d12/d5d/d71/d10a/f121 0 2024-02-28T16:02:20.738 INFO:tasks.workunit.client.0.smithi057.stdout:4/774: fsync d1/d10/d12/d2c/fbb 0 2024-02-28T16:02:20.741 INFO:tasks.workunit.client.0.smithi057.stdout:0/866: fsync d6/fa6 0 2024-02-28T16:02:20.746 INFO:tasks.workunit.client.0.smithi057.stdout:0/867: creat d6/d12/d17/d4b/f122 x:0 0 0 2024-02-28T16:02:20.757 INFO:tasks.workunit.client.0.smithi057.stdout:4/775: dwrite d1/d10/d31/d36/f47 [4194304,4194304] 0 2024-02-28T16:02:20.757 INFO:tasks.workunit.client.0.smithi057.stdout:5/779: truncate d2/d12/d5f/d77/f93 1893927 0 2024-02-28T16:02:20.757 INFO:tasks.workunit.client.0.smithi057.stdout:6/813: dread df/d10/d78/dca/d15/d16/d39/d92/f93 [0,4194304] 0 2024-02-28T16:02:20.768 INFO:tasks.workunit.client.0.smithi057.stdout:6/814: creat df/d10/d13/f108 x:0 0 0 2024-02-28T16:02:20.775 INFO:tasks.workunit.client.0.smithi057.stdout:0/868: dread d6/d12/d38/fea [0,4194304] 0 2024-02-28T16:02:20.776 INFO:tasks.workunit.client.0.smithi057.stdout:4/776: link d1/d10/d12/d2c/c66 d1/d10/d12/d15/df2/c107 0 2024-02-28T16:02:20.777 INFO:tasks.workunit.client.0.smithi057.stdout:6/815: symlink df/d10/d78/d5b/d7b/l109 0 2024-02-28T16:02:20.781 INFO:tasks.workunit.client.0.smithi057.stdout:0/869: unlink d6/d12/d17/d34/f40 0 2024-02-28T16:02:20.782 INFO:tasks.workunit.client.0.smithi057.stdout:6/816: symlink df/d10/d78/dca/l10a 0 2024-02-28T16:02:20.786 INFO:tasks.workunit.client.0.smithi057.stdout:0/870: fdatasync d6/d12/d5d/fc0 0 2024-02-28T16:02:20.787 INFO:tasks.workunit.client.0.smithi057.stdout:8/718: sync 2024-02-28T16:02:20.802 INFO:tasks.workunit.client.0.smithi057.stdout:8/719: dread d5/de/d63/d70/f99 [0,4194304] 0 2024-02-28T16:02:20.803 INFO:tasks.workunit.client.0.smithi057.stdout:0/871: write d6/d12/d5d/d71/daa/db6/ff0 [120076,7462] 0 2024-02-28T16:02:20.807 INFO:tasks.workunit.client.0.smithi057.stdout:5/780: dwrite d2/d12/d3d/da4/fdb [0,4194304] 0 2024-02-28T16:02:20.812 INFO:tasks.workunit.client.0.smithi057.stdout:8/720: mkdir d5/df2 0 2024-02-28T16:02:20.812 INFO:tasks.workunit.client.0.smithi057.stdout:0/872: truncate d6/d12/d45/d78/fcf 4808482 0 2024-02-28T16:02:20.812 INFO:tasks.workunit.client.0.smithi057.stdout:5/781: mkdir d2/d15/d110 0 2024-02-28T16:02:20.812 INFO:tasks.workunit.client.0.smithi057.stdout:4/777: dwrite d1/d10/d12/d2c/d37/d46/f6a [0,4194304] 0 2024-02-28T16:02:20.813 INFO:tasks.workunit.client.0.smithi057.stdout:8/721: chown d5/d20/ddd/le4 2565 1 2024-02-28T16:02:20.813 INFO:tasks.workunit.client.0.smithi057.stdout:4/778: chown d1/d22/l51 3 1 2024-02-28T16:02:20.815 INFO:tasks.workunit.client.0.smithi057.stdout:0/873: creat d6/d12/d17/d4b/f123 x:0 0 0 2024-02-28T16:02:20.817 INFO:tasks.workunit.client.0.smithi057.stdout:8/722: symlink d5/d62/lf3 0 2024-02-28T16:02:20.822 INFO:tasks.workunit.client.0.smithi057.stdout:8/723: chown d5/de/d1b/d57/d85/lc9 236 1 2024-02-28T16:02:20.828 INFO:tasks.workunit.client.0.smithi057.stdout:6/817: dread df/d10/d78/dca/d15/d16/f56 [0,4194304] 0 2024-02-28T16:02:20.830 INFO:tasks.workunit.client.0.smithi057.stdout:6/818: chown df/d10/d78/dca/d15/d16 38 1 2024-02-28T16:02:20.835 INFO:tasks.workunit.client.0.smithi057.stdout:6/819: symlink df/d10/d78/dca/d15/d82/l10b 0 2024-02-28T16:02:20.837 INFO:tasks.workunit.client.0.smithi057.stdout:6/820: stat df/d61/d7c/c80 0 2024-02-28T16:02:20.840 INFO:tasks.workunit.client.0.smithi057.stdout:8/724: dwrite d5/de/d1b/d57/d9e/fe6 [0,4194304] 0 2024-02-28T16:02:20.842 INFO:tasks.workunit.client.0.smithi057.stdout:4/779: truncate d1/d10/d12/d2c/fe1 726285 0 2024-02-28T16:02:20.843 INFO:tasks.workunit.client.0.smithi057.stdout:8/725: readlink d5/d20/ddd/le4 0 2024-02-28T16:02:20.845 INFO:tasks.workunit.client.0.smithi057.stdout:6/821: mkdir df/d10/d10c 0 2024-02-28T16:02:20.848 INFO:tasks.workunit.client.0.smithi057.stdout:4/780: dread d1/d22/fa3 [0,4194304] 0 2024-02-28T16:02:20.851 INFO:tasks.workunit.client.0.smithi057.stdout:0/874: dwrite d6/d12/d17/d4b/f8f [0,4194304] 0 2024-02-28T16:02:20.852 INFO:tasks.workunit.client.0.smithi057.stdout:8/726: fdatasync d5/de/d1b/d57/f5e 0 2024-02-28T16:02:20.852 INFO:tasks.workunit.client.0.smithi057.stdout:6/822: mkdir df/d10/d78/dca/d15/d16/d10d 0 2024-02-28T16:02:20.857 INFO:tasks.workunit.client.0.smithi057.stdout:8/727: readlink d5/d20/d39/d59/l68 0 2024-02-28T16:02:20.860 INFO:tasks.workunit.client.0.smithi057.stdout:4/781: mkdir d1/d10/d108 0 2024-02-28T16:02:20.861 INFO:tasks.workunit.client.0.smithi057.stdout:8/728: fsync d5/de/d1b/f35 0 2024-02-28T16:02:20.865 INFO:tasks.workunit.client.0.smithi057.stdout:8/729: write d5/d20/d39/d49/d56/f98 [286545,117062] 0 2024-02-28T16:02:20.868 INFO:tasks.workunit.client.0.smithi057.stdout:8/730: dread - d5/d20/d39/d6e/fca zero size 2024-02-28T16:02:20.870 INFO:tasks.workunit.client.0.smithi057.stdout:4/782: rename d1/d10/d12/d2c/l104 to d1/d10/d12/d2c/d37/d46/dac/de9/d87/l109 0 2024-02-28T16:02:20.872 INFO:tasks.workunit.client.0.smithi057.stdout:4/783: chown d1/d10/d12/l16 243361 1 2024-02-28T16:02:20.875 INFO:tasks.workunit.client.0.smithi057.stdout:6/823: creat df/d10/d13/d4b/f10e x:0 0 0 2024-02-28T16:02:20.876 INFO:tasks.workunit.client.0.smithi057.stdout:0/875: write d6/d12/d17/d58/f84 [564386,20584] 0 2024-02-28T16:02:20.883 INFO:tasks.workunit.client.0.smithi057.stdout:8/731: write d5/d62/d9f/f7d [1631673,17948] 0 2024-02-28T16:02:20.887 INFO:tasks.workunit.client.0.smithi057.stdout:6/824: link df/d10/d13/d70/feb df/d10/d78/dca/dd0/df0/f10f 0 2024-02-28T16:02:20.890 INFO:tasks.workunit.client.0.smithi057.stdout:4/784: truncate d1/d22/f2a 3670088 0 2024-02-28T16:02:20.891 INFO:tasks.workunit.client.0.smithi057.stdout:8/732: symlink d5/de/d1b/d57/d91/de9/lf4 0 2024-02-28T16:02:20.900 INFO:tasks.workunit.client.0.smithi057.stdout:6/825: mknod df/d10/d78/dca/dd0/d103/c110 0 2024-02-28T16:02:20.904 INFO:tasks.workunit.client.0.smithi057.stdout:4/785: mkdir d1/d10/d12/d2c/d37/d10a 0 2024-02-28T16:02:20.907 INFO:tasks.workunit.client.0.smithi057.stdout:4/786: write d1/d10/d31/d86/dd1/d8c/fc0 [776436,81144] 0 2024-02-28T16:02:20.907 INFO:tasks.workunit.client.0.smithi057.stdout:0/876: dread d6/d12/d17/f3b [0,4194304] 0 2024-02-28T16:02:20.914 INFO:tasks.workunit.client.0.smithi057.stdout:0/877: rename d6/d12/d5d/d71/daa/db6/cdb to d6/d12/d45/c124 0 2024-02-28T16:02:20.917 INFO:tasks.workunit.client.0.smithi057.stdout:0/878: symlink d6/d12/d17/l125 0 2024-02-28T16:02:20.924 INFO:tasks.workunit.client.0.smithi057.stdout:8/733: dwrite d5/f2f [0,4194304] 0 2024-02-28T16:02:20.925 INFO:tasks.workunit.client.0.smithi057.stdout:6/826: dwrite df/d10/d78/dca/d15/d16/d39/d8d/dd9/fee [0,4194304] 0 2024-02-28T16:02:20.929 INFO:tasks.workunit.client.0.smithi057.stdout:8/734: symlink d5/d62/d9f/lf5 0 2024-02-28T16:02:20.936 INFO:tasks.workunit.client.0.smithi057.stdout:8/735: creat d5/d20/d39/d59/ff6 x:0 0 0 2024-02-28T16:02:20.941 INFO:tasks.workunit.client.0.smithi057.stdout:8/736: creat d5/de/d63/d70/d8e/ff7 x:0 0 0 2024-02-28T16:02:20.944 INFO:tasks.workunit.client.0.smithi057.stdout:8/737: readlink d5/de/l34 0 2024-02-28T16:02:20.948 INFO:tasks.workunit.client.0.smithi057.stdout:8/738: fsync d5/de/f10 0 2024-02-28T16:02:20.957 INFO:tasks.workunit.client.0.smithi057.stdout:8/739: unlink d5/d20/d39/d49/d56/l5f 0 2024-02-28T16:02:20.959 INFO:tasks.workunit.client.0.smithi057.stdout:8/740: chown d5/de/d1b/d57 522518767 1 2024-02-28T16:02:20.963 INFO:tasks.workunit.client.0.smithi057.stdout:6/827: dread df/d10/d78/d5b/f8f [0,4194304] 0 2024-02-28T16:02:20.964 INFO:tasks.workunit.client.0.smithi057.stdout:8/741: mkdir d5/d20/d39/d59/d67/da5/df8 0 2024-02-28T16:02:20.970 INFO:tasks.workunit.client.0.smithi057.stdout:8/742: read d5/d6/f36 [1965683,21488] 0 2024-02-28T16:02:20.975 INFO:tasks.workunit.client.0.smithi057.stdout:6/828: creat df/d10/d78/dca/d15/de9/f111 x:0 0 0 2024-02-28T16:02:20.982 INFO:tasks.workunit.client.0.smithi057.stdout:6/829: unlink df/d10/d13/f77 0 2024-02-28T16:02:20.984 INFO:tasks.workunit.client.0.smithi057.stdout:8/743: getdents d5/d20/d39 0 2024-02-28T16:02:20.991 INFO:tasks.workunit.client.0.smithi057.stdout:6/830: link df/d10/d78/dca/d15/d82/f95 df/d10/d78/dca/d15/d16/d39/f112 0 2024-02-28T16:02:21.009 INFO:tasks.workunit.client.0.smithi057.stdout:6/831: dwrite df/d10/d78/dca/d15/d16/f4a [4194304,4194304] 0 2024-02-28T16:02:21.016 INFO:tasks.workunit.client.0.smithi057.stdout:8/744: dwrite d5/de/d63/d70/f99 [0,4194304] 0 2024-02-28T16:02:21.018 INFO:tasks.workunit.client.0.smithi057.stdout:6/832: creat df/d10/d78/dca/d15/d16/d65/f113 x:0 0 0 2024-02-28T16:02:21.020 INFO:tasks.workunit.client.0.smithi057.stdout:8/745: getdents d5/df2 0 2024-02-28T16:02:21.032 INFO:tasks.workunit.client.0.smithi057.stdout:8/746: dread d5/d6/f3f [0,4194304] 0 2024-02-28T16:02:21.032 INFO:tasks.workunit.client.0.smithi057.stdout:6/833: truncate df/d10/d78/dca/d15/d16/f76 3263874 0 2024-02-28T16:02:21.036 INFO:tasks.workunit.client.0.smithi057.stdout:8/747: readlink d5/d20/d39/d59/db7/dcc/lda 0 2024-02-28T16:02:21.041 INFO:tasks.workunit.client.0.smithi057.stdout:6/834: dread df/d10/d13/f75 [0,4194304] 0 2024-02-28T16:02:21.044 INFO:tasks.workunit.client.0.smithi057.stdout:6/835: creat df/d61/dbb/f114 x:0 0 0 2024-02-28T16:02:21.046 INFO:tasks.workunit.client.0.smithi057.stdout:6/836: stat df/d10/d78/dca/d15/d16/f46 0 2024-02-28T16:02:21.047 INFO:tasks.workunit.client.0.smithi057.stdout:6/837: chown df/d10/fc8 48201 1 2024-02-28T16:02:21.057 INFO:tasks.workunit.client.0.smithi057.stdout:6/838: write df/d10/d78/dca/d15/d16/d39/fae [982053,33147] 0 2024-02-28T16:02:21.064 INFO:tasks.workunit.client.0.smithi057.stdout:8/748: dwrite d5/de/d1b/d57/f96 [0,4194304] 0 2024-02-28T16:02:21.066 INFO:tasks.workunit.client.0.smithi057.stdout:8/749: dread - d5/d20/d39/d59/d67/da5/fef zero size 2024-02-28T16:02:21.069 INFO:tasks.workunit.client.0.smithi057.stdout:8/750: mknod d5/d20/d39/d59/d67/da5/cf9 0 2024-02-28T16:02:21.073 INFO:tasks.workunit.client.0.smithi057.stdout:8/751: truncate d5/d6/f3f 555018 0 2024-02-28T16:02:21.090 INFO:tasks.workunit.client.0.smithi057.stdout:8/752: dwrite d5/f2f [0,4194304] 0 2024-02-28T16:02:21.095 INFO:tasks.workunit.client.0.smithi057.stdout:8/753: write d5/de/d1b/d57/f96 [2670512,95708] 0 2024-02-28T16:02:21.098 INFO:tasks.workunit.client.0.smithi057.stdout:8/754: stat d5/d20/d39/d8c/feb 0 2024-02-28T16:02:21.106 INFO:tasks.workunit.client.0.smithi057.stdout:8/755: symlink d5/d20/d39/d49/lfa 0 2024-02-28T16:02:21.108 INFO:tasks.workunit.client.0.smithi057.stdout:8/756: write d5/d20/da2/d8d/fd6 [761724,10534] 0 2024-02-28T16:02:21.128 INFO:tasks.workunit.client.0.smithi057.stdout:8/757: dwrite d5/de/d1b/faa [0,4194304] 0 2024-02-28T16:02:21.137 INFO:tasks.workunit.client.0.smithi057.stdout:8/758: truncate d5/d6/f2d 7583548 0 2024-02-28T16:02:21.143 INFO:tasks.workunit.client.0.smithi057.stdout:8/759: unlink d5/de/d1b/c28 0 2024-02-28T16:02:21.146 INFO:tasks.workunit.client.0.smithi057.stdout:8/760: creat d5/de/d1b/d45/d81/ffb x:0 0 0 2024-02-28T16:02:21.147 INFO:tasks.workunit.client.0.smithi057.stdout:8/761: stat d5/d62/d9f/le1 0 2024-02-28T16:02:21.148 INFO:tasks.workunit.client.0.smithi057.stdout:8/762: stat d5/d20/d39/d49/fcb 0 2024-02-28T16:02:21.175 INFO:tasks.workunit.client.0.smithi057.stdout:8/763: dread d5/de/d1b/d57/f78 [0,4194304] 0 2024-02-28T16:02:21.286 INFO:tasks.workunit.client.0.smithi057.stdout:8/764: rename d5/de/d63 to d5/d20/d39/d49/d56/d79/dfc 0 2024-02-28T16:02:21.299 INFO:tasks.workunit.client.0.smithi057.stdout:8/765: creat d5/d20/d39/d59/db7/dcc/ffd x:0 0 0 2024-02-28T16:02:21.318 INFO:tasks.workunit.client.0.smithi057.stdout:8/766: dread d5/d20/d39/d49/d56/d79/dfc/fad [0,4194304] 0 2024-02-28T16:02:21.353 INFO:tasks.workunit.client.0.smithi057.stdout:3/682: sync 2024-02-28T16:02:21.353 INFO:tasks.workunit.client.0.smithi057.stdout:1/843: sync 2024-02-28T16:02:21.355 INFO:tasks.workunit.client.0.smithi057.stdout:8/767: dwrite d5/de/d1b/d57/d9e/fe6 [0,4194304] 0 2024-02-28T16:02:21.389 INFO:tasks.workunit.client.0.smithi057.stdout:1/844: dwrite d1/d21/f52 [4194304,4194304] 0 2024-02-28T16:02:21.395 INFO:tasks.workunit.client.0.smithi057.stdout:1/845: chown d1/d21/d66/d53/d7d/cd2 1649266 1 2024-02-28T16:02:21.397 INFO:tasks.workunit.client.0.smithi057.stdout:8/768: unlink d5/de/d1b/d45/d81/ffb 0 2024-02-28T16:02:21.399 INFO:tasks.workunit.client.0.smithi057.stdout:1/846: write d1/d3/f109 [4147547,94252] 0 2024-02-28T16:02:21.401 INFO:tasks.workunit.client.0.smithi057.stdout:3/683: link d8/dd/d14/d2e/d30/d49/d51/c55 d8/dd/d14/d2e/d3b/d71/cea 0 2024-02-28T16:02:21.403 INFO:tasks.workunit.client.0.smithi057.stdout:8/769: stat d5/d20/d39/d49/d56/d79 0 2024-02-28T16:02:21.406 INFO:tasks.workunit.client.0.smithi057.stdout:1/847: chown d1/f34 12486966 1 2024-02-28T16:02:21.417 INFO:tasks.workunit.client.0.smithi057.stdout:1/848: link d1/d3/l7b d1/d21/d66/d44/d9f/l117 0 2024-02-28T16:02:21.420 INFO:tasks.workunit.client.0.smithi057.stdout:3/684: dread d8/dd/d14/d2e/d2f/f82 [0,4194304] 0 2024-02-28T16:02:21.424 INFO:tasks.workunit.client.0.smithi057.stdout:1/849: write d1/f7 [4554586,81166] 0 2024-02-28T16:02:21.426 INFO:tasks.workunit.client.0.smithi057.stdout:1/850: write d1/d3/f3b [6661600,61723] 0 2024-02-28T16:02:21.427 INFO:tasks.workunit.client.0.smithi057.stdout:8/770: dwrite d5/de/d1b/d57/fe0 [0,4194304] 0 2024-02-28T16:02:21.429 INFO:tasks.workunit.client.0.smithi057.stdout:3/685: creat d8/dd/d14/d2e/d76/da1/feb x:0 0 0 2024-02-28T16:02:21.430 INFO:tasks.workunit.client.0.smithi057.stdout:8/771: chown d5/d6/f19 19767 1 2024-02-28T16:02:21.435 INFO:tasks.workunit.client.0.smithi057.stdout:3/686: creat d8/dd/d14/d2e/d30/d49/fec x:0 0 0 2024-02-28T16:02:21.440 INFO:tasks.workunit.client.0.smithi057.stdout:1/851: write d1/d21/d66/d44/f58 [1301263,68354] 0 2024-02-28T16:02:21.445 INFO:tasks.workunit.client.0.smithi057.stdout:1/852: creat d1/d21/d66/d53/d7d/dfc/f118 x:0 0 0 2024-02-28T16:02:21.446 INFO:tasks.workunit.client.0.smithi057.stdout:1/853: readlink d1/d21/d66/la8 0 2024-02-28T16:02:21.449 INFO:tasks.workunit.client.0.smithi057.stdout:1/854: write d1/d21/d66/d44/fce [2739477,115370] 0 2024-02-28T16:02:21.470 INFO:tasks.workunit.client.0.smithi057.stdout:7/706: sync 2024-02-28T16:02:21.474 INFO:tasks.workunit.client.0.smithi057.stdout:1/855: mknod d1/d21/d66/d44/d9f/c119 0 2024-02-28T16:02:21.476 INFO:tasks.workunit.client.0.smithi057.stdout:7/707: mkdir d6/d26/df8 0 2024-02-28T16:02:21.477 INFO:tasks.workunit.client.0.smithi057.stdout:1/856: readlink d1/d21/d25/l7c 0 2024-02-28T16:02:21.480 INFO:tasks.workunit.client.0.smithi057.stdout:1/857: write d1/f45 [3845074,90747] 0 2024-02-28T16:02:21.484 INFO:tasks.workunit.client.0.smithi057.stdout:7/708: unlink d6/dc/d12/d1a/d4d/d5a/f7b 0 2024-02-28T16:02:21.486 INFO:tasks.workunit.client.0.smithi057.stdout:3/687: dread d8/dd/d14/d2e/d30/d5f/d6b/f83 [0,4194304] 0 2024-02-28T16:02:21.486 INFO:tasks.workunit.client.0.smithi057.stdout:1/858: fdatasync d1/d21/f5b 0 2024-02-28T16:02:21.489 INFO:tasks.workunit.client.0.smithi057.stdout:3/688: chown d8/dd/d14/d2e/d30/d5f/d6b/cad 124315 1 2024-02-28T16:02:21.493 INFO:tasks.workunit.client.0.smithi057.stdout:3/689: symlink d8/d94/led 0 2024-02-28T16:02:21.497 INFO:tasks.workunit.client.0.smithi057.stdout:7/709: write d6/dc/d12/f5c [2426850,95749] 0 2024-02-28T16:02:21.499 INFO:tasks.workunit.client.0.smithi057.stdout:3/690: getdents d8/dd/d14/d2e/d76/d89/de2 0 2024-02-28T16:02:21.500 INFO:tasks.workunit.client.0.smithi057.stdout:7/710: dread - d6/dc/d67/d9a/fe2 zero size 2024-02-28T16:02:21.503 INFO:tasks.workunit.client.0.smithi057.stdout:3/691: readlink d8/d4b/l97 0 2024-02-28T16:02:21.504 INFO:tasks.workunit.client.0.smithi057.stdout:1/859: dwrite d1/d21/d66/dc7/f10a [0,4194304] 0 2024-02-28T16:02:21.505 INFO:tasks.workunit.client.0.smithi057.stdout:1/860: fdatasync d1/f45 0 2024-02-28T16:02:21.506 INFO:tasks.workunit.client.0.smithi057.stdout:7/711: fsync d6/dc/d12/d1a/f37 0 2024-02-28T16:02:21.507 INFO:tasks.workunit.client.0.smithi057.stdout:3/692: dread - d8/f74 zero size 2024-02-28T16:02:21.509 INFO:tasks.workunit.client.0.smithi057.stdout:7/712: write d6/dc/d12/d1a/ff4 [909441,43550] 0 2024-02-28T16:02:21.509 INFO:tasks.workunit.client.0.smithi057.stdout:3/693: dread - d8/dd/d14/d2e/d2f/fe0 zero size 2024-02-28T16:02:21.517 INFO:tasks.workunit.client.0.smithi057.stdout:7/713: unlink d6/dc/d35/da6/lba 0 2024-02-28T16:02:21.523 INFO:tasks.workunit.client.0.smithi057.stdout:7/714: rename d6/dc/d12/d1a/f62 to d6/dc/dab/ff9 0 2024-02-28T16:02:21.526 INFO:tasks.workunit.client.0.smithi057.stdout:7/715: mknod d6/dc/d67/d9a/cfa 0 2024-02-28T16:02:21.526 INFO:tasks.workunit.client.0.smithi057.stdout:1/861: dread d1/d3/dc/d15/d4e/d5f/f85 [0,4194304] 0 2024-02-28T16:02:21.529 INFO:tasks.workunit.client.0.smithi057.stdout:7/716: symlink d6/dc/d12/d29/lfb 0 2024-02-28T16:02:21.530 INFO:tasks.workunit.client.0.smithi057.stdout:1/862: symlink d1/d21/d66/d44/d4c/l11a 0 2024-02-28T16:02:21.532 INFO:tasks.workunit.client.0.smithi057.stdout:7/717: write d6/dc/d12/d1a/ff4 [639121,7494] 0 2024-02-28T16:02:21.539 INFO:tasks.workunit.client.0.smithi057.stdout:1/863: rename d1/d3/dc/l24 to d1/d21/d66/d53/d7d/d65/l11b 0 2024-02-28T16:02:21.547 INFO:tasks.workunit.client.0.smithi057.stdout:7/718: write d6/dc/d35/d58/f9e [2176321,102177] 0 2024-02-28T16:02:21.549 INFO:tasks.workunit.client.0.smithi057.stdout:1/864: stat d1/d21/d66/d53/d7d/d65/l11b 0 2024-02-28T16:02:21.549 INFO:tasks.workunit.client.0.smithi057.stdout:3/694: dread d8/dd/d14/d2c/f53 [0,4194304] 0 2024-02-28T16:02:21.552 INFO:tasks.workunit.client.0.smithi057.stdout:7/719: mkdir d6/dc/d12/dc9/dce/dfc 0 2024-02-28T16:02:21.554 INFO:tasks.workunit.client.0.smithi057.stdout:1/865: symlink d1/l11c 0 2024-02-28T16:02:21.556 INFO:tasks.workunit.client.0.smithi057.stdout:3/695: truncate d8/dd/d14/d2e/d76/d89/d6c/fde 23577 0 2024-02-28T16:02:21.556 INFO:tasks.workunit.client.0.smithi057.stdout:7/720: mkdir d6/dc/d12/dc9/dce/dfc/dfd 0 2024-02-28T16:02:21.557 INFO:tasks.workunit.client.0.smithi057.stdout:1/866: write d1/d21/d66/d44/d4c/fe5 [4118859,119363] 0 2024-02-28T16:02:21.560 INFO:tasks.workunit.client.0.smithi057.stdout:3/696: creat d8/dd/d14/d2e/d30/d5f/fee x:0 0 0 2024-02-28T16:02:21.562 INFO:tasks.workunit.client.0.smithi057.stdout:3/697: stat d8/d26/f7e 0 2024-02-28T16:02:21.562 INFO:tasks.workunit.client.0.smithi057.stdout:7/721: unlink d6/dc/l1c 0 2024-02-28T16:02:21.564 INFO:tasks.workunit.client.0.smithi057.stdout:3/698: chown d8/dd/d14/d2e/d2f/da2/fcf 202710 1 2024-02-28T16:02:21.571 INFO:tasks.workunit.client.0.smithi057.stdout:2/795: sync 2024-02-28T16:02:21.572 INFO:tasks.workunit.client.0.smithi057.stdout:9/816: sync 2024-02-28T16:02:21.572 INFO:tasks.workunit.client.0.smithi057.stdout:0/879: sync 2024-02-28T16:02:21.572 INFO:tasks.workunit.client.0.smithi057.stdout:5/782: sync 2024-02-28T16:02:21.572 INFO:tasks.workunit.client.0.smithi057.stdout:4/787: sync 2024-02-28T16:02:21.572 INFO:tasks.workunit.client.0.smithi057.stdout:6/839: sync 2024-02-28T16:02:21.574 INFO:tasks.workunit.client.0.smithi057.stdout:0/880: chown d6/f2f 30624 1 2024-02-28T16:02:21.575 INFO:tasks.workunit.client.0.smithi057.stdout:1/867: dread d1/d3/dc/d15/f17 [0,4194304] 0 2024-02-28T16:02:21.575 INFO:tasks.workunit.client.0.smithi057.stdout:5/783: chown d2/d15/d63/fe6 1527 1 2024-02-28T16:02:21.577 INFO:tasks.workunit.client.0.smithi057.stdout:0/881: chown d6/d12/d45/d78/c8d 174270936 1 2024-02-28T16:02:21.578 INFO:tasks.workunit.client.0.smithi057.stdout:3/699: link d8/dd/d14/d2e/d30/d6a/c72 d8/dd/d19/d25/cef 0 2024-02-28T16:02:21.581 INFO:tasks.workunit.client.0.smithi057.stdout:9/817: write d2/d24/d1d/d104/f7c [864938,52703] 0 2024-02-28T16:02:21.585 INFO:tasks.workunit.client.0.smithi057.stdout:3/700: dread - d8/dd/d14/d2e/d30/d49/d51/d66/f79 zero size 2024-02-28T16:02:21.586 INFO:tasks.workunit.client.0.smithi057.stdout:2/796: creat d19/d2c/d48/da2/f110 x:0 0 0 2024-02-28T16:02:21.588 INFO:tasks.workunit.client.0.smithi057.stdout:1/868: chown d1/d3/dc/d15/d4e/d5f/dbe/le2 544217 1 2024-02-28T16:02:21.590 INFO:tasks.workunit.client.0.smithi057.stdout:5/784: symlink d2/d12/d76/d7b/d62/df4/l111 0 2024-02-28T16:02:21.597 INFO:tasks.workunit.client.0.smithi057.stdout:7/722: dwrite d6/dc/d12/d1a/d4c/f9d [0,4194304] 0 2024-02-28T16:02:21.606 INFO:tasks.workunit.client.0.smithi057.stdout:1/869: write d1/d3/dc/d15/f17 [3034048,44030] 0 2024-02-28T16:02:21.608 INFO:tasks.workunit.client.0.smithi057.stdout:2/797: write d19/d1d/d26/f61 [728514,79873] 0 2024-02-28T16:02:21.615 INFO:tasks.workunit.client.0.smithi057.stdout:3/701: write d8/dd/d19/f62 [2987345,65505] 0 2024-02-28T16:02:21.618 INFO:tasks.workunit.client.0.smithi057.stdout:0/882: dwrite d6/d12/d45/d55/f97 [0,4194304] 0 2024-02-28T16:02:21.621 INFO:tasks.workunit.client.0.smithi057.stdout:1/870: mknod d1/d21/d25/df7/c11d 0 2024-02-28T16:02:21.623 INFO:tasks.workunit.client.0.smithi057.stdout:6/840: dwrite df/d10/fb6 [0,4194304] 0 2024-02-28T16:02:21.623 INFO:tasks.workunit.client.0.smithi057.stdout:2/798: creat d19/d2c/f111 x:0 0 0 2024-02-28T16:02:21.625 INFO:tasks.workunit.client.0.smithi057.stdout:5/785: write d2/d12/d76/d7a/d95/db5/dcb/f2f [5235202,47668] 0 2024-02-28T16:02:21.628 INFO:tasks.workunit.client.0.smithi057.stdout:4/788: dread d1/d22/f35 [0,4194304] 0 2024-02-28T16:02:21.632 INFO:tasks.workunit.client.0.smithi057.stdout:9/818: dwrite d2/d24/d1d/d104/d65/f15 [0,4194304] 0 2024-02-28T16:02:21.635 INFO:tasks.workunit.client.0.smithi057.stdout:8/772: sync 2024-02-28T16:02:21.636 INFO:tasks.workunit.client.0.smithi057.stdout:0/883: chown d6/f41 61219 1 2024-02-28T16:02:21.640 INFO:tasks.workunit.client.0.smithi057.stdout:6/841: mknod df/d10/d78/dca/d15/d16/d10d/c115 0 2024-02-28T16:02:21.643 INFO:tasks.workunit.client.0.smithi057.stdout:5/786: creat d2/d15/d5e/f112 x:0 0 0 2024-02-28T16:02:21.644 INFO:tasks.workunit.client.0.smithi057.stdout:7/723: dwrite d6/dc/d12/d1a/d90/fae [0,4194304] 0 2024-02-28T16:02:21.654 INFO:tasks.workunit.client.0.smithi057.stdout:4/789: mknod d1/d10/d12/d39/db4/c10b 0 2024-02-28T16:02:21.655 INFO:tasks.workunit.client.0.smithi057.stdout:2/799: getdents d19/d1d/d2e/de2 0 2024-02-28T16:02:21.656 INFO:tasks.workunit.client.0.smithi057.stdout:4/790: chown d1/d10/d12/ce3 28603 1 2024-02-28T16:02:21.663 INFO:tasks.workunit.client.0.smithi057.stdout:3/702: getdents d8/dd/d14/d2e/d30/d49/d51/d66 0 2024-02-28T16:02:21.663 INFO:tasks.workunit.client.0.smithi057.stdout:1/871: dread d1/d21/d66/d44/f58 [0,4194304] 0 2024-02-28T16:02:21.663 INFO:tasks.workunit.client.0.smithi057.stdout:6/842: creat df/d10/d10c/f116 x:0 0 0 2024-02-28T16:02:21.663 INFO:tasks.workunit.client.0.smithi057.stdout:0/884: read d6/d12/d45/f9a [911337,81664] 0 2024-02-28T16:02:21.665 INFO:tasks.workunit.client.0.smithi057.stdout:7/724: symlink d6/dc/d35/d58/dd5/lfe 0 2024-02-28T16:02:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:2/800: unlink d19/d1d/d2e/d31/f40 0 2024-02-28T16:02:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:6/843: chown df/d10/d13/d4b/d4e/def 456 1 2024-02-28T16:02:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:7/725: chown f4 215958489 1 2024-02-28T16:02:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:9/819: write d2/d46/d67/d7d/fc2 [66935,80889] 0 2024-02-28T16:02:21.679 INFO:tasks.workunit.client.0.smithi057.stdout:9/820: creat d2/d5/d1b/d2e/d4c/f10a x:0 0 0 2024-02-28T16:02:21.679 INFO:tasks.workunit.client.0.smithi057.stdout:1/872: write d1/d3/dc/d15/d4e/d5f/dbe/dd3/ffe [401627,72901] 0 2024-02-28T16:02:21.680 INFO:tasks.workunit.client.0.smithi057.stdout:6/844: mkdir df/d10/d78/dca/d15/d16/d39/d92/da4/dad/d117 0 2024-02-28T16:02:21.680 INFO:tasks.workunit.client.0.smithi057.stdout:4/791: dread d1/d10/d12/d2c/d37/d46/dac/de9/d5e/f9f [0,4194304] 0 2024-02-28T16:02:21.683 INFO:tasks.workunit.client.0.smithi057.stdout:7/726: rename d6/dc/d35/f6a to d6/dc/d12/d1a/d4d/d56/db0/fff 0 2024-02-28T16:02:21.692 INFO:tasks.workunit.client.0.smithi057.stdout:0/885: creat d6/d12/d17/d34/de2/f126 x:0 0 0 2024-02-28T16:02:21.698 INFO:tasks.workunit.client.0.smithi057.stdout:4/792: write d1/d10/d12/d2c/dd9/ff9 [1225672,103910] 0 2024-02-28T16:02:21.700 INFO:tasks.workunit.client.0.smithi057.stdout:8/773: dwrite d5/de/f4d [0,4194304] 0 2024-02-28T16:02:21.700 INFO:tasks.workunit.client.0.smithi057.stdout:0/886: chown d6/d12/d17/c70 5 1 2024-02-28T16:02:21.705 INFO:tasks.workunit.client.0.smithi057.stdout:2/801: dwrite d19/f37 [0,4194304] 0 2024-02-28T16:02:21.708 INFO:tasks.workunit.client.0.smithi057.stdout:4/793: chown d1/d10/d12/d2c/dd9 7259 1 2024-02-28T16:02:21.711 INFO:tasks.workunit.client.0.smithi057.stdout:1/873: dwrite d1/d3/dc/d15/d4e/fdc [0,4194304] 0 2024-02-28T16:02:21.715 INFO:tasks.workunit.client.0.smithi057.stdout:1/874: write d1/d21/d66/d53/d7d/ffa [513318,48006] 0 2024-02-28T16:02:21.716 INFO:tasks.workunit.client.0.smithi057.stdout:3/703: dread d8/f18 [0,4194304] 0 2024-02-28T16:02:21.718 INFO:tasks.workunit.client.0.smithi057.stdout:1/875: fdatasync d1/d21/d25/f33 0 2024-02-28T16:02:21.721 INFO:tasks.workunit.client.0.smithi057.stdout:1/876: stat d1/d21/d66/d53/d7d/d67/f10d 0 2024-02-28T16:02:21.726 INFO:tasks.workunit.client.0.smithi057.stdout:1/877: write d1/d21/d66/d53/d7d/d67/d7a/d92/f9d [3988744,109767] 0 2024-02-28T16:02:21.731 INFO:tasks.workunit.client.0.smithi057.stdout:1/878: chown d1/d21/d66/d53/d7d/d67/d7a/d94/ff3 2310858 1 2024-02-28T16:02:21.735 INFO:tasks.workunit.client.0.smithi057.stdout:8/774: dwrite d5/d20/d39/d59/d67/fb5 [0,4194304] 0 2024-02-28T16:02:21.738 INFO:tasks.workunit.client.0.smithi057.stdout:0/887: dread d6/d12/d17/f10c [0,4194304] 0 2024-02-28T16:02:21.754 INFO:tasks.workunit.client.0.smithi057.stdout:9/821: rename d2/d24/d1d/fda to d2/d5/dd8/dea/f10b 0 2024-02-28T16:02:21.755 INFO:tasks.workunit.client.0.smithi057.stdout:8/775: dread d5/de/f7e [0,4194304] 0 2024-02-28T16:02:21.758 INFO:tasks.workunit.client.0.smithi057.stdout:2/802: read - d19/d43/d5a/fbe zero size 2024-02-28T16:02:21.761 INFO:tasks.workunit.client.0.smithi057.stdout:1/879: fsync d1/d3/f47 0 2024-02-28T16:02:21.769 INFO:tasks.workunit.client.0.smithi057.stdout:2/803: mknod d19/d1d/d2e/de2/c112 0 2024-02-28T16:02:21.775 INFO:tasks.workunit.client.0.smithi057.stdout:2/804: read d19/d1d/d2e/d3c/f3d [247902,117891] 0 2024-02-28T16:02:21.778 INFO:tasks.workunit.client.0.smithi057.stdout:2/805: chown d19/d2c/d48/lbf 3072 1 2024-02-28T16:02:21.780 INFO:tasks.workunit.client.0.smithi057.stdout:2/806: readlink d19/d2c/d65/lb7 0 2024-02-28T16:02:21.782 INFO:tasks.workunit.client.0.smithi057.stdout:1/880: dread d1/d21/d25/f3d [0,4194304] 0 2024-02-28T16:02:21.783 INFO:tasks.workunit.client.0.smithi057.stdout:8/776: creat d5/de/d1b/ffe x:0 0 0 2024-02-28T16:02:21.786 INFO:tasks.workunit.client.0.smithi057.stdout:2/807: chown d19/d2c/d48/da2/fca 7208653 1 2024-02-28T16:02:21.787 INFO:tasks.workunit.client.0.smithi057.stdout:9/822: dread d2/d5/d9/f54 [0,4194304] 0 2024-02-28T16:02:21.787 INFO:tasks.workunit.client.0.smithi057.stdout:2/808: fsync d19/d2c/d48/da2/f110 0 2024-02-28T16:02:21.789 INFO:tasks.workunit.client.0.smithi057.stdout:8/777: write d5/de/d1b/d4b/f5d [345435,86073] 0 2024-02-28T16:02:21.792 INFO:tasks.workunit.client.0.smithi057.stdout:8/778: mkdir d5/d6/dff 0 2024-02-28T16:02:21.795 INFO:tasks.workunit.client.0.smithi057.stdout:1/881: truncate d1/d21/d66/d53/d7d/d67/d6c/fad 1450773 0 2024-02-28T16:02:21.799 INFO:tasks.workunit.client.0.smithi057.stdout:2/809: truncate d19/d1d/d2e/d3c/dab/dfc/fef 1418366 0 2024-02-28T16:02:21.807 INFO:tasks.workunit.client.0.smithi057.stdout:6/845: dwrite df/d10/d4f/f71 [0,4194304] 0 2024-02-28T16:02:21.809 INFO:tasks.workunit.client.0.smithi057.stdout:8/779: getdents d5/de/d1b/d57/d85 0 2024-02-28T16:02:21.810 INFO:tasks.workunit.client.0.smithi057.stdout:6/846: chown df/d10/d10c 384275 1 2024-02-28T16:02:21.810 INFO:tasks.workunit.client.0.smithi057.stdout:1/882: dread d1/d21/d66/d53/d7d/d65/f5c [0,4194304] 0 2024-02-28T16:02:21.810 INFO:tasks.workunit.client.0.smithi057.stdout:6/847: stat l7 0 2024-02-28T16:02:21.814 INFO:tasks.workunit.client.0.smithi057.stdout:7/727: dwrite d6/dc/d12/d1a/d90/fca [0,4194304] 0 2024-02-28T16:02:21.816 INFO:tasks.workunit.client.0.smithi057.stdout:3/704: write d8/dd/f1f [1876420,112229] 0 2024-02-28T16:02:21.833 INFO:tasks.workunit.client.0.smithi057.stdout:0/888: truncate d6/d12/d17/d58/f84 284482 0 2024-02-28T16:02:21.834 INFO:tasks.workunit.client.0.smithi057.stdout:3/705: symlink d8/dd/d14/d2e/d30/d49/d51/d66/lf0 0 2024-02-28T16:02:21.834 INFO:tasks.workunit.client.0.smithi057.stdout:9/823: write d2/d62/fdb [645390,55647] 0 2024-02-28T16:02:21.835 INFO:tasks.workunit.client.0.smithi057.stdout:7/728: truncate d6/dc/d12/d1a/d4d/f69 462655 0 2024-02-28T16:02:21.837 INFO:tasks.workunit.client.0.smithi057.stdout:1/883: mkdir d1/d21/d66/d53/dca/d11e 0 2024-02-28T16:02:21.841 INFO:tasks.workunit.client.0.smithi057.stdout:6/848: creat df/d10/d13/f118 x:0 0 0 2024-02-28T16:02:21.843 INFO:tasks.workunit.client.0.smithi057.stdout:0/889: chown d6/d12/d5d/d71/cc1 90 1 2024-02-28T16:02:21.845 INFO:tasks.workunit.client.0.smithi057.stdout:2/810: write d19/d1d/d2e/f9f [1751813,828] 0 2024-02-28T16:02:21.847 INFO:tasks.workunit.client.0.smithi057.stdout:1/884: dread d1/d3/f59 [0,4194304] 0 2024-02-28T16:02:21.852 INFO:tasks.workunit.client.0.smithi057.stdout:2/811: symlink d19/d43/ddd/l113 0 2024-02-28T16:02:21.853 INFO:tasks.workunit.client.0.smithi057.stdout:0/890: truncate d6/d12/d45/f8e 4918804 0 2024-02-28T16:02:21.854 INFO:tasks.workunit.client.0.smithi057.stdout:7/729: rename d6/dc/l89 to d6/dc/d12/d1a/d4d/df0/l100 0 2024-02-28T16:02:21.857 INFO:tasks.workunit.client.0.smithi057.stdout:3/706: dread d8/dd/d14/d2e/fbe [0,4194304] 0 2024-02-28T16:02:21.859 INFO:tasks.workunit.client.0.smithi057.stdout:8/780: dwrite d5/f29 [0,4194304] 0 2024-02-28T16:02:21.862 INFO:tasks.workunit.client.0.smithi057.stdout:1/885: mknod d1/d21/d66/d44/c11f 0 2024-02-28T16:02:21.863 INFO:tasks.workunit.client.0.smithi057.stdout:8/781: stat d5/d20/d39/d8c/feb 0 2024-02-28T16:02:21.872 INFO:tasks.workunit.client.0.smithi057.stdout:9/824: getdents d2/d46 0 2024-02-28T16:02:21.873 INFO:tasks.workunit.client.0.smithi057.stdout:7/730: chown d6/dc/c1f 1 1 2024-02-28T16:02:21.876 INFO:tasks.workunit.client.0.smithi057.stdout:3/707: creat d8/d94/ff1 x:0 0 0 2024-02-28T16:02:21.877 INFO:tasks.workunit.client.0.smithi057.stdout:8/782: rmdir d5/de/d1b/d45/d81/dae 39 2024-02-28T16:02:21.880 INFO:tasks.workunit.client.0.smithi057.stdout:6/849: dread df/f48 [0,4194304] 0 2024-02-28T16:02:21.881 INFO:tasks.workunit.client.0.smithi057.stdout:2/812: dwrite d19/d1d/d2e/d3c/dab/f10c [0,4194304] 0 2024-02-28T16:02:21.893 INFO:tasks.workunit.client.0.smithi057.stdout:9/825: symlink d2/d5/d1b/d2e/d4c/da0/da7/l10c 0 2024-02-28T16:02:21.895 INFO:tasks.workunit.client.0.smithi057.stdout:2/813: rename d19/d34/f4b to d19/d2c/d65/dda/f114 0 2024-02-28T16:02:21.903 INFO:tasks.workunit.client.0.smithi057.stdout:7/731: dwrite d6/dc/d12/d1a/d4c/d63/f80 [0,4194304] 0 2024-02-28T16:02:21.905 INFO:tasks.workunit.client.0.smithi057.stdout:8/783: dwrite d5/d20/d39/d6e/fcf [0,4194304] 0 2024-02-28T16:02:21.908 INFO:tasks.workunit.client.0.smithi057.stdout:6/850: dwrite df/d10/d78/fbe [0,4194304] 0 2024-02-28T16:02:21.909 INFO:tasks.workunit.client.0.smithi057.stdout:2/814: creat d19/d1d/d89/f115 x:0 0 0 2024-02-28T16:02:21.912 INFO:tasks.workunit.client.0.smithi057.stdout:9/826: mkdir d2/d24/d1d/d104/dc3/d10d 0 2024-02-28T16:02:21.915 INFO:tasks.workunit.client.0.smithi057.stdout:3/708: dread d8/dd/d19/d25/fae [0,4194304] 0 2024-02-28T16:02:21.918 INFO:tasks.workunit.client.0.smithi057.stdout:6/851: mkdir df/d10/d13/d70/d119 0 2024-02-28T16:02:21.918 INFO:tasks.workunit.client.0.smithi057.stdout:2/815: rmdir d19/d1d/d22 39 2024-02-28T16:02:21.918 INFO:tasks.workunit.client.0.smithi057.stdout:8/784: creat d5/de/d1b/d57/d91/de9/f100 x:0 0 0 2024-02-28T16:02:21.928 INFO:tasks.workunit.client.0.smithi057.stdout:3/709: mkdir d8/dd/df2 0 2024-02-28T16:02:21.930 INFO:tasks.workunit.client.0.smithi057.stdout:2/816: write d19/d3a/fb0 [2134569,32604] 0 2024-02-28T16:02:21.940 INFO:tasks.workunit.client.0.smithi057.stdout:3/710: creat d8/dd/d14/d2e/d2f/ff3 x:0 0 0 2024-02-28T16:02:21.945 INFO:tasks.workunit.client.0.smithi057.stdout:9/827: getdents d2/d5/d1b/d2e/d77 0 2024-02-28T16:02:21.947 INFO:tasks.workunit.client.0.smithi057.stdout:8/785: dwrite d5/d20/d39/d49/d56/d84/fd0 [0,4194304] 0 2024-02-28T16:02:21.953 INFO:tasks.workunit.client.0.smithi057.stdout:3/711: dread d8/dd/d14/d2e/d3b/d54/f99 [0,4194304] 0 2024-02-28T16:02:21.955 INFO:tasks.workunit.client.0.smithi057.stdout:3/712: read - d8/dd/d14/d2c/db9/fc2 zero size 2024-02-28T16:02:21.956 INFO:tasks.workunit.client.0.smithi057.stdout:7/732: dread d6/dc/d67/d9a/da1/da8/fb9 [0,4194304] 0 2024-02-28T16:02:21.957 INFO:tasks.workunit.client.0.smithi057.stdout:9/828: mkdir d2/d24/d1d/d104/d65/d10e 0 2024-02-28T16:02:21.961 INFO:tasks.workunit.client.0.smithi057.stdout:3/713: rename d8/dd/d14/d2e/d30/d49/d51 to d8/dd/d14/d2e/d30/d49/d51/dc6/df4 22 2024-02-28T16:02:21.963 INFO:tasks.workunit.client.0.smithi057.stdout:7/733: fsync d6/dc/d12/d1a/f37 0 2024-02-28T16:02:21.964 INFO:tasks.workunit.client.0.smithi057.stdout:3/714: read d8/dd/d14/d2e/d30/d5f/d6b/f83 [2680153,42581] 0 2024-02-28T16:02:21.966 INFO:tasks.workunit.client.0.smithi057.stdout:9/829: unlink d2/d5/d9/f89 0 2024-02-28T16:02:21.971 INFO:tasks.workunit.client.0.smithi057.stdout:9/830: chown d2/cc 786908736 1 2024-02-28T16:02:21.972 INFO:tasks.workunit.client.0.smithi057.stdout:7/734: mkdir d6/dc/d101 0 2024-02-28T16:02:21.973 INFO:tasks.workunit.client.0.smithi057.stdout:9/831: write d2/d24/d1d/fa6 [222661,8430] 0 2024-02-28T16:02:21.974 INFO:tasks.workunit.client.0.smithi057.stdout:3/715: symlink d8/dd/d14/d2e/d30/d5f/dd9/lf5 0 2024-02-28T16:02:21.976 INFO:tasks.workunit.client.0.smithi057.stdout:3/716: dread - d8/d94/fda zero size 2024-02-28T16:02:21.979 INFO:tasks.workunit.client.0.smithi057.stdout:9/832: write d2/d46/d67/d7d/fc2 [515535,101769] 0 2024-02-28T16:02:21.982 INFO:tasks.workunit.client.0.smithi057.stdout:6/852: dwrite df/d61/f99 [0,4194304] 0 2024-02-28T16:02:21.983 INFO:tasks.workunit.client.0.smithi057.stdout:3/717: dread - d8/dd/d14/d2e/d2f/fb7 zero size 2024-02-28T16:02:21.985 INFO:tasks.workunit.client.0.smithi057.stdout:8/786: fdatasync d5/d20/d39/d49/d56/d84/fd0 0 2024-02-28T16:02:21.990 INFO:tasks.workunit.client.0.smithi057.stdout:3/718: chown d8/dd/d14/d2e/d30/d6a/fa7 21383 1 2024-02-28T16:02:21.992 INFO:tasks.workunit.client.0.smithi057.stdout:7/735: getdents d6/dc/d12/d1a/d4d/d56/db0 0 2024-02-28T16:02:21.994 INFO:tasks.workunit.client.0.smithi057.stdout:6/853: symlink df/d10/d78/d5b/l11a 0 2024-02-28T16:02:21.995 INFO:tasks.workunit.client.0.smithi057.stdout:3/719: fsync d8/dd/d14/d2e/d30/f8b 0 2024-02-28T16:02:22.003 INFO:tasks.workunit.client.0.smithi057.stdout:3/720: truncate d8/dd/d19/d25/f7a 4789925 0 2024-02-28T16:02:22.005 INFO:tasks.workunit.client.0.smithi057.stdout:6/854: link df/d10/d78/d5b/l11a df/d10/l11b 0 2024-02-28T16:02:22.006 INFO:tasks.workunit.client.0.smithi057.stdout:7/736: creat d6/dc/d12/d1a/d4c/d63/f102 x:0 0 0 2024-02-28T16:02:22.007 INFO:tasks.workunit.client.0.smithi057.stdout:7/737: fsync d6/f28 0 2024-02-28T16:02:22.009 INFO:tasks.workunit.client.0.smithi057.stdout:8/787: dwrite d5/de/d1b/d57/fe0 [0,4194304] 0 2024-02-28T16:02:22.012 INFO:tasks.workunit.client.0.smithi057.stdout:8/788: stat d5/d20/d39/d49/d56/d79/le8 0 2024-02-28T16:02:22.015 INFO:tasks.workunit.client.0.smithi057.stdout:7/738: write d6/dc/d67/f8a [3787713,42334] 0 2024-02-28T16:02:22.016 INFO:tasks.workunit.client.0.smithi057.stdout:6/855: mkdir df/d10/d78/dca/d15/d16/d39/d92/d11c 0 2024-02-28T16:02:22.024 INFO:tasks.workunit.client.0.smithi057.stdout:7/739: dread - d6/dc/d12/d29/f9c zero size 2024-02-28T16:02:22.024 INFO:tasks.workunit.client.0.smithi057.stdout:3/721: dwrite d8/d94/ff1 [0,4194304] 0 2024-02-28T16:02:22.039 INFO:tasks.workunit.client.0.smithi057.stdout:3/722: getdents d8/dd/d14/d2e/d30/d49/d51/dc6 0 2024-02-28T16:02:22.040 INFO:tasks.workunit.client.0.smithi057.stdout:6/856: getdents df/d10/d78/dca/dd0 0 2024-02-28T16:02:22.044 INFO:tasks.workunit.client.0.smithi057.stdout:6/857: write df/d61/dbb/fdb [36775,25045] 0 2024-02-28T16:02:22.044 INFO:tasks.workunit.client.0.smithi057.stdout:9/833: write d2/d5/d1b/d2e/d4c/da0/faa [1411703,55483] 0 2024-02-28T16:02:22.047 INFO:tasks.workunit.client.0.smithi057.stdout:3/723: mkdir d8/dd/d14/d2e/d2f/df6 0 2024-02-28T16:02:22.053 INFO:tasks.workunit.client.0.smithi057.stdout:6/858: dread df/d10/f5c [0,4194304] 0 2024-02-28T16:02:22.054 INFO:tasks.workunit.client.0.smithi057.stdout:9/834: symlink d2/d5/dd8/l10f 0 2024-02-28T16:02:22.056 INFO:tasks.workunit.client.0.smithi057.stdout:7/740: write d6/d38/f44 [5627266,8434] 0 2024-02-28T16:02:22.058 INFO:tasks.workunit.client.0.smithi057.stdout:3/724: creat d8/dd/d14/d2e/d76/ff7 x:0 0 0 2024-02-28T16:02:22.058 INFO:tasks.workunit.client.0.smithi057.stdout:9/835: chown d2/d24/d1d/lf5 6110059 1 2024-02-28T16:02:22.062 INFO:tasks.workunit.client.0.smithi057.stdout:9/836: write d2/d5/d9/f1c [1307345,64484] 0 2024-02-28T16:02:22.063 INFO:tasks.workunit.client.0.smithi057.stdout:7/741: truncate d6/dc/d67/d9a/da1/fec 588632 0 2024-02-28T16:02:22.063 INFO:tasks.workunit.client.0.smithi057.stdout:5/787: sync 2024-02-28T16:02:22.065 INFO:tasks.workunit.client.0.smithi057.stdout:8/789: dwrite d5/d20/d39/d59/db7/dcc/fe3 [0,4194304] 0 2024-02-28T16:02:22.068 INFO:tasks.workunit.client.0.smithi057.stdout:7/742: write d6/dc/d67/fbe [16592,114324] 0 2024-02-28T16:02:22.071 INFO:tasks.workunit.client.0.smithi057.stdout:8/790: fsync d5/d20/d39/d49/d56/f8f 0 2024-02-28T16:02:22.073 INFO:tasks.workunit.client.0.smithi057.stdout:3/725: mknod d8/dd/d14/d2e/d30/d5f/d6b/cf8 0 2024-02-28T16:02:22.076 INFO:tasks.workunit.client.0.smithi057.stdout:7/743: mknod d6/c103 0 2024-02-28T16:02:22.078 INFO:tasks.workunit.client.0.smithi057.stdout:8/791: write d5/de/d1b/d57/d9e/fe6 [661128,67446] 0 2024-02-28T16:02:22.080 INFO:tasks.workunit.client.0.smithi057.stdout:9/837: rename d2/d5/d1b/d2e/d4c/da0/ccd to d2/d24/d1d/d104/d65/c110 0 2024-02-28T16:02:22.080 INFO:tasks.workunit.client.0.smithi057.stdout:6/859: dwrite df/d61/f62 [0,4194304] 0 2024-02-28T16:02:22.085 INFO:tasks.workunit.client.0.smithi057.stdout:5/788: rename d2/d12/d76/d7a/d95/db5/dcb/dab/cb4 to d2/d3e/d5b/db0/c113 0 2024-02-28T16:02:22.091 INFO:tasks.workunit.client.0.smithi057.stdout:6/860: mknod df/d10/d78/dca/dd0/c11d 0 2024-02-28T16:02:22.092 INFO:tasks.workunit.client.0.smithi057.stdout:3/726: dread d8/dd/d14/d2e/d30/f8b [0,4194304] 0 2024-02-28T16:02:22.093 INFO:tasks.workunit.client.0.smithi057.stdout:7/744: creat d6/dc/d12/d1a/d4d/dd9/dde/f104 x:0 0 0 2024-02-28T16:02:22.098 INFO:tasks.workunit.client.0.smithi057.stdout:5/789: creat d2/d15/d5e/d9a/f114 x:0 0 0 2024-02-28T16:02:22.106 INFO:tasks.workunit.client.0.smithi057.stdout:3/727: unlink d8/dd/d14/d2e/d3b/d71/f77 0 2024-02-28T16:02:22.112 INFO:tasks.workunit.client.0.smithi057.stdout:3/728: creat d8/dd/d14/d2e/d3b/d54/ff9 x:0 0 0 2024-02-28T16:02:22.121 INFO:tasks.workunit.client.0.smithi057.stdout:3/729: write d8/dd/d19/f7d [75476,80007] 0 2024-02-28T16:02:22.122 INFO:tasks.workunit.client.0.smithi057.stdout:5/790: dwrite d2/d12/d76/d7b/f96 [0,4194304] 0 2024-02-28T16:02:22.125 INFO:tasks.workunit.client.0.smithi057.stdout:5/791: stat d2/d12/d76/d7b 0 2024-02-28T16:02:22.126 INFO:tasks.workunit.client.0.smithi057.stdout:8/792: dread d5/d6/fd [0,4194304] 0 2024-02-28T16:02:22.127 INFO:tasks.workunit.client.0.smithi057.stdout:9/838: dread d2/d24/f10 [0,4194304] 0 2024-02-28T16:02:22.130 INFO:tasks.workunit.client.0.smithi057.stdout:6/861: dwrite df/d10/d78/dca/d15/d16/d39/d92/da4/fa5 [0,4194304] 0 2024-02-28T16:02:22.132 INFO:tasks.workunit.client.0.smithi057.stdout:9/839: fdatasync d2/d5/d1b/d2e/d4c/da0/f108 0 2024-02-28T16:02:22.132 INFO:tasks.workunit.client.0.smithi057.stdout:7/745: dwrite d6/dc/d67/d9a/da1/da8/fb9 [0,4194304] 0 2024-02-28T16:02:22.135 INFO:tasks.workunit.client.0.smithi057.stdout:8/793: mknod d5/de/d1b/d45/c101 0 2024-02-28T16:02:22.137 INFO:tasks.workunit.client.0.smithi057.stdout:6/862: fsync df/d10/d78/d5b/f8f 0 2024-02-28T16:02:22.137 INFO:tasks.workunit.client.0.smithi057.stdout:5/792: readlink d2/d3e/lf0 0 2024-02-28T16:02:22.139 INFO:tasks.workunit.client.0.smithi057.stdout:7/746: stat d6/dc/d67/cc2 0 2024-02-28T16:02:22.139 INFO:tasks.workunit.client.0.smithi057.stdout:8/794: write d5/de/f10 [6199389,88119] 0 2024-02-28T16:02:22.139 INFO:tasks.workunit.client.0.smithi057.stdout:3/730: getdents d8/dd/d19/db1 0 2024-02-28T16:02:22.144 INFO:tasks.workunit.client.0.smithi057.stdout:5/793: dread - d2/d12/d76/d7a/d95/db5/dcb/dab/fea zero size 2024-02-28T16:02:22.145 INFO:tasks.workunit.client.0.smithi057.stdout:6/863: chown df/d61/cc7 32327685 1 2024-02-28T16:02:22.146 INFO:tasks.workunit.client.0.smithi057.stdout:3/731: dread - d8/dd/d14/d2e/d2f/fcb zero size 2024-02-28T16:02:22.150 INFO:tasks.workunit.client.0.smithi057.stdout:8/795: mkdir d5/d20/da2/d102 0 2024-02-28T16:02:22.150 INFO:tasks.workunit.client.0.smithi057.stdout:3/732: rmdir d8/dd/d19/d2a 39 2024-02-28T16:02:22.155 INFO:tasks.workunit.client.0.smithi057.stdout:5/794: unlink d2/dae/cbc 0 2024-02-28T16:02:22.157 INFO:tasks.workunit.client.0.smithi057.stdout:9/840: dread d2/d5/d1b/d2e/d44/f4f [0,4194304] 0 2024-02-28T16:02:22.159 INFO:tasks.workunit.client.0.smithi057.stdout:3/733: mknod d8/dd/d14/d2e/d76/d89/d6c/cfa 0 2024-02-28T16:02:22.160 INFO:tasks.workunit.client.0.smithi057.stdout:5/795: read d2/d15/f3c [292678,87255] 0 2024-02-28T16:02:22.162 INFO:tasks.workunit.client.0.smithi057.stdout:9/841: write d2/d5/d9/d5d/fed [774306,68895] 0 2024-02-28T16:02:22.162 INFO:tasks.workunit.client.0.smithi057.stdout:6/864: write df/d10/d78/dca/d15/d16/d39/d92/f93 [1008160,116769] 0 2024-02-28T16:02:22.165 INFO:tasks.workunit.client.0.smithi057.stdout:3/734: mkdir d8/d26/dfb 0 2024-02-28T16:02:22.166 INFO:tasks.workunit.client.0.smithi057.stdout:9/842: chown d2/d5/dd8/dea 52 1 2024-02-28T16:02:22.174 INFO:tasks.workunit.client.0.smithi057.stdout:3/735: rename d8/dd/d19/ca3 to d8/d26/cfc 0 2024-02-28T16:02:22.174 INFO:tasks.workunit.client.0.smithi057.stdout:8/796: link d5/de/d1b/d45/d81/dae/fc4 d5/d20/d39/d59/db7/dcc/f103 0 2024-02-28T16:02:22.180 INFO:tasks.workunit.client.0.smithi057.stdout:4/794: sync 2024-02-28T16:02:22.182 INFO:tasks.workunit.client.0.smithi057.stdout:7/747: dread d6/d26/f50 [0,4194304] 0 2024-02-28T16:02:22.183 INFO:tasks.workunit.client.0.smithi057.stdout:3/736: truncate d8/d94/f98 351696 0 2024-02-28T16:02:22.184 INFO:tasks.workunit.client.0.smithi057.stdout:9/843: creat d2/d24/f111 x:0 0 0 2024-02-28T16:02:22.185 INFO:tasks.workunit.client.0.smithi057.stdout:7/748: creat d6/dc/dab/f105 x:0 0 0 2024-02-28T16:02:22.188 INFO:tasks.workunit.client.0.smithi057.stdout:6/865: link df/d10/d78/dca/d15/d82/f95 df/d61/d66/f11e 0 2024-02-28T16:02:22.191 INFO:tasks.workunit.client.0.smithi057.stdout:3/737: read - d8/dd/d14/d2c/db9/fc2 zero size 2024-02-28T16:02:22.192 INFO:tasks.workunit.client.0.smithi057.stdout:6/866: stat df/d10/d78/dca/d15/d16/d39/fac 0 2024-02-28T16:02:22.195 INFO:tasks.workunit.client.0.smithi057.stdout:5/796: truncate d2/d15/d5e/d67/fd1 3645944 0 2024-02-28T16:02:22.198 INFO:tasks.workunit.client.0.smithi057.stdout:9/844: truncate d2/d5/dd3/d8b/f8d 4683997 0 2024-02-28T16:02:22.202 INFO:tasks.workunit.client.0.smithi057.stdout:6/867: unlink df/d10/d78/dca/dd0/df0/f10f 0 2024-02-28T16:02:22.203 INFO:tasks.workunit.client.0.smithi057.stdout:7/749: read d6/dc/fd [729847,98643] 0 2024-02-28T16:02:22.205 INFO:tasks.workunit.client.0.smithi057.stdout:9/845: rename d2/d5/d9/d5d/l7f to d2/d24/d9c/l112 0 2024-02-28T16:02:22.207 INFO:tasks.workunit.client.0.smithi057.stdout:5/797: dread d2/d12/fd6 [0,4194304] 0 2024-02-28T16:02:22.221 INFO:tasks.workunit.client.0.smithi057.stdout:5/798: mknod d2/d12/dd3/c115 0 2024-02-28T16:02:22.224 INFO:tasks.workunit.client.0.smithi057.stdout:8/797: dread d5/de/d1b/f35 [0,4194304] 0 2024-02-28T16:02:22.225 INFO:tasks.workunit.client.0.smithi057.stdout:5/799: fdatasync d2/d8/f16 0 2024-02-28T16:02:22.228 INFO:tasks.workunit.client.0.smithi057.stdout:3/738: link d8/c48 d8/dd/d14/d2e/d30/d6a/d8c/cfd 0 2024-02-28T16:02:22.229 INFO:tasks.workunit.client.0.smithi057.stdout:9/846: creat d2/d24/d1d/d104/f113 x:0 0 0 2024-02-28T16:02:22.234 INFO:tasks.workunit.client.0.smithi057.stdout:3/739: chown d8/dd/d19/d25/l5d 5585 1 2024-02-28T16:02:22.237 INFO:tasks.workunit.client.0.smithi057.stdout:7/750: dread d6/dc/d12/d1a/d4d/d56/db0/fff [0,4194304] 0 2024-02-28T16:02:22.239 INFO:tasks.workunit.client.0.smithi057.stdout:6/868: dwrite df/d10/d13/d4b/f51 [4194304,4194304] 0 2024-02-28T16:02:22.239 INFO:tasks.workunit.client.0.smithi057.stdout:8/798: rename d5/d20/d39/d49/d56/d79/dfc/d70/d8e/fa8 to d5/d20/da2/d102/f104 0 2024-02-28T16:02:22.248 INFO:tasks.workunit.client.0.smithi057.stdout:8/799: creat d5/f105 x:0 0 0 2024-02-28T16:02:22.251 INFO:tasks.workunit.client.0.smithi057.stdout:5/800: write d2/d3e/d5b/f94 [2759724,29438] 0 2024-02-28T16:02:22.253 INFO:tasks.workunit.client.0.smithi057.stdout:9/847: truncate d2/d62/fdb 455262 0 2024-02-28T16:02:22.256 INFO:tasks.workunit.client.0.smithi057.stdout:5/801: fdatasync d2/d15/fa1 0 2024-02-28T16:02:22.257 INFO:tasks.workunit.client.0.smithi057.stdout:7/751: write d6/dc/d12/d29/f9c [545575,124334] 0 2024-02-28T16:02:22.257 INFO:tasks.workunit.client.0.smithi057.stdout:9/848: mknod d2/d5/d9/d5d/d82/c114 0 2024-02-28T16:02:22.258 INFO:tasks.workunit.client.0.smithi057.stdout:5/802: chown d2/d15/d5e 1066404891 1 2024-02-28T16:02:22.261 INFO:tasks.workunit.client.0.smithi057.stdout:8/800: read d5/d20/d39/d49/d56/d79/dfc/d70/f99 [1485935,113318] 0 2024-02-28T16:02:22.263 INFO:tasks.workunit.client.0.smithi057.stdout:7/752: truncate d6/dc/d35/da6/faf 1132097 0 2024-02-28T16:02:22.263 INFO:tasks.workunit.client.0.smithi057.stdout:3/740: write d8/dd/d14/d2e/d76/d89/f87 [474628,116140] 0 2024-02-28T16:02:22.263 INFO:tasks.workunit.client.0.smithi057.stdout:9/849: mkdir d2/d92/d115 0 2024-02-28T16:02:22.265 INFO:tasks.workunit.client.0.smithi057.stdout:6/869: write df/d10/d13/d4b/f7d [1123540,664] 0 2024-02-28T16:02:22.269 INFO:tasks.workunit.client.0.smithi057.stdout:9/850: chown d2/d5/d1b/d2e/d77/c72 24 1 2024-02-28T16:02:22.269 INFO:tasks.workunit.client.0.smithi057.stdout:6/870: stat df/d10/d78/d5b 0 2024-02-28T16:02:22.271 INFO:tasks.workunit.client.0.smithi057.stdout:3/741: dread - d8/dd/d14/d2e/d30/d49/fec zero size 2024-02-28T16:02:22.272 INFO:tasks.workunit.client.0.smithi057.stdout:3/742: chown d8/dd/d14/d2e/d76 0 1 2024-02-28T16:02:22.274 INFO:tasks.workunit.client.0.smithi057.stdout:9/851: unlink d2/l69 0 2024-02-28T16:02:22.278 INFO:tasks.workunit.client.0.smithi057.stdout:6/871: fsync df/d10/d78/dca/d15/d16/fe8 0 2024-02-28T16:02:22.284 INFO:tasks.workunit.client.0.smithi057.stdout:3/743: getdents d8/dd/d14/d2e/d76/d89 0 2024-02-28T16:02:22.287 INFO:tasks.workunit.client.0.smithi057.stdout:6/872: mkdir df/d10/d13/d4b/dcc/d11f 0 2024-02-28T16:02:22.297 INFO:tasks.workunit.client.0.smithi057.stdout:3/744: getdents d8/dd/d14/d2e/d30 0 2024-02-28T16:02:22.297 INFO:tasks.workunit.client.0.smithi057.stdout:8/801: dwrite d5/d20/d39/d6e/daf/fdc [0,4194304] 0 2024-02-28T16:02:22.299 INFO:tasks.workunit.client.0.smithi057.stdout:7/753: dwrite d6/dc/f11 [0,4194304] 0 2024-02-28T16:02:22.303 INFO:tasks.workunit.client.0.smithi057.stdout:3/745: chown d8/d4b/f60 105708237 1 2024-02-28T16:02:22.303 INFO:tasks.workunit.client.0.smithi057.stdout:5/803: dread d2/d15/d5e/d67/fbe [0,4194304] 0 2024-02-28T16:02:22.303 INFO:tasks.workunit.client.0.smithi057.stdout:6/873: write df/d10/d78/dca/d15/d16/d39/d92/da4/fa5 [1485085,102658] 0 2024-02-28T16:02:22.313 INFO:tasks.workunit.client.0.smithi057.stdout:3/746: mknod d8/dd/d14/d2e/d30/d49/d86/cfe 0 2024-02-28T16:02:22.313 INFO:tasks.workunit.client.0.smithi057.stdout:8/802: getdents d5/d20/d39/d49 0 2024-02-28T16:02:22.323 INFO:tasks.workunit.client.0.smithi057.stdout:3/747: rmdir d8/dd/d14/d2e/d30/d5f 39 2024-02-28T16:02:22.329 INFO:tasks.workunit.client.0.smithi057.stdout:9/852: dread d2/d5/d1b/d2e/d77/fc0 [0,4194304] 0 2024-02-28T16:02:22.332 INFO:tasks.workunit.client.0.smithi057.stdout:3/748: write d8/dd/d14/d2e/d3b/f56 [2372213,111964] 0 2024-02-28T16:02:22.335 INFO:tasks.workunit.client.0.smithi057.stdout:9/853: truncate d2/d5/d9/f4b 3639657 0 2024-02-28T16:02:22.338 INFO:tasks.workunit.client.0.smithi057.stdout:9/854: mknod d2/d5/dd3/c116 0 2024-02-28T16:02:22.339 INFO:tasks.workunit.client.0.smithi057.stdout:3/749: stat d8/dd/d14/d2e/d3b/d54/f5b 0 2024-02-28T16:02:22.341 INFO:tasks.workunit.client.0.smithi057.stdout:9/855: chown d2/d5/d9 6 1 2024-02-28T16:02:22.343 INFO:tasks.workunit.client.0.smithi057.stdout:5/804: dwrite d2/d15/f43 [0,4194304] 0 2024-02-28T16:02:22.344 INFO:tasks.workunit.client.0.smithi057.stdout:9/856: fdatasync d2/d24/d1d/d104/f113 0 2024-02-28T16:02:22.344 INFO:tasks.workunit.client.0.smithi057.stdout:7/754: dread d6/dc/d12/f5c [0,4194304] 0 2024-02-28T16:02:22.348 INFO:tasks.workunit.client.0.smithi057.stdout:3/750: creat d8/dd/d14/d2e/d3b/d71/fff x:0 0 0 2024-02-28T16:02:22.349 INFO:tasks.workunit.client.0.smithi057.stdout:5/805: fdatasync d2/d15/d63/fe6 0 2024-02-28T16:02:22.353 INFO:tasks.workunit.client.0.smithi057.stdout:5/806: write d2/d19/d1c/f36 [5915528,104327] 0 2024-02-28T16:02:22.358 INFO:tasks.workunit.client.0.smithi057.stdout:8/803: dread d5/de/d1b/d57/f96 [0,4194304] 0 2024-02-28T16:02:22.358 INFO:tasks.workunit.client.0.smithi057.stdout:7/755: rmdir d6/dc/d12/d1a/d4d/d5a 0 2024-02-28T16:02:22.363 INFO:tasks.workunit.client.0.smithi057.stdout:8/804: mkdir d5/d20/d39/d59/d106 0 2024-02-28T16:02:22.366 INFO:tasks.workunit.client.0.smithi057.stdout:3/751: rmdir d8/dd/d14/d2e/d30/d49/d51/dc6 0 2024-02-28T16:02:22.370 INFO:tasks.workunit.client.0.smithi057.stdout:6/874: dread df/d10/d13/d4b/f9d [0,4194304] 0 2024-02-28T16:02:22.374 INFO:tasks.workunit.client.0.smithi057.stdout:6/875: readlink df/d10/d78/d5b/l7e 0 2024-02-28T16:02:22.376 INFO:tasks.workunit.client.0.smithi057.stdout:9/857: dwrite d2/d5/d9/f2a [0,4194304] 0 2024-02-28T16:02:22.381 INFO:tasks.workunit.client.0.smithi057.stdout:7/756: dwrite d6/dc/d67/d9a/fe3 [0,4194304] 0 2024-02-28T16:02:22.389 INFO:tasks.workunit.client.0.smithi057.stdout:6/876: rename df/d10/d78/l6d to df/d10/d13/d4b/dcc/d11f/l120 0 2024-02-28T16:02:22.389 INFO:tasks.workunit.client.0.smithi057.stdout:7/757: unlink d6/dc/d12/la0 0 2024-02-28T16:02:22.390 INFO:tasks.workunit.client.0.smithi057.stdout:3/752: dread d8/dd/d14/d2e/fbe [0,4194304] 0 2024-02-28T16:02:22.390 INFO:tasks.workunit.client.0.smithi057.stdout:8/805: dwrite d5/de/d1b/d4b/f7a [0,4194304] 0 2024-02-28T16:02:22.393 INFO:tasks.workunit.client.0.smithi057.stdout:9/858: rename d2/d24/d1d/d104/d65/d87 to d2/d5/d1b/d2e/d4c/da0/da7/d117 0 2024-02-28T16:02:22.395 INFO:tasks.workunit.client.0.smithi057.stdout:7/758: stat d6/dc/dab/ff9 0 2024-02-28T16:02:22.396 INFO:tasks.workunit.client.0.smithi057.stdout:9/859: rename d2/d5 to d2/d5/d9/d118 22 2024-02-28T16:02:22.397 INFO:tasks.workunit.client.0.smithi057.stdout:6/877: chown df/d10/d78/d5b/d7b/de3/ffb 3520521 1 2024-02-28T16:02:22.398 INFO:tasks.workunit.client.0.smithi057.stdout:8/806: mknod d5/de/c107 0 2024-02-28T16:02:22.399 INFO:tasks.workunit.client.0.smithi057.stdout:3/753: unlink d8/dd/d14/d2e/d30/d49/d86/cfe 0 2024-02-28T16:02:22.400 INFO:tasks.workunit.client.0.smithi057.stdout:7/759: getdents d6/d26/df8 0 2024-02-28T16:02:22.403 INFO:tasks.workunit.client.0.smithi057.stdout:8/807: write d5/d62/fb1 [408010,130185] 0 2024-02-28T16:02:22.404 INFO:tasks.workunit.client.0.smithi057.stdout:5/807: dread d2/d8/f9 [0,4194304] 0 2024-02-28T16:02:22.404 INFO:tasks.workunit.client.0.smithi057.stdout:0/891: sync 2024-02-28T16:02:22.404 INFO:tasks.workunit.client.0.smithi057.stdout:2/817: sync 2024-02-28T16:02:22.405 INFO:tasks.workunit.client.0.smithi057.stdout:6/878: dread df/d10/d13/f75 [0,4194304] 0 2024-02-28T16:02:22.405 INFO:tasks.workunit.client.0.smithi057.stdout:1/886: sync 2024-02-28T16:02:22.408 INFO:tasks.workunit.client.0.smithi057.stdout:3/754: fsync d8/dd/d14/d2e/d3b/d54/fa8 0 2024-02-28T16:02:22.413 INFO:tasks.workunit.client.0.smithi057.stdout:5/808: rmdir d2/d12/d76 39 2024-02-28T16:02:22.413 INFO:tasks.workunit.client.0.smithi057.stdout:0/892: readlink d6/d4e/l35 0 2024-02-28T16:02:22.415 INFO:tasks.workunit.client.0.smithi057.stdout:6/879: creat df/d10/d78/dca/d15/d16/d39/d92/f121 x:0 0 0 2024-02-28T16:02:22.415 INFO:tasks.workunit.client.0.smithi057.stdout:5/809: read - d2/d15/d63/f103 zero size 2024-02-28T16:02:22.417 INFO:tasks.workunit.client.0.smithi057.stdout:8/808: creat d5/d20/d39/d49/d56/d79/dfc/d70/d8e/f108 x:0 0 0 2024-02-28T16:02:22.419 INFO:tasks.workunit.client.0.smithi057.stdout:6/880: chown df/d10/d78/dca/d15/c90 1343 1 2024-02-28T16:02:22.420 INFO:tasks.workunit.client.0.smithi057.stdout:3/755: mknod d8/dd/d14/d2e/d30/d49/c100 0 2024-02-28T16:02:22.420 INFO:tasks.workunit.client.0.smithi057.stdout:8/809: chown d5/d20/d39/d49/d56/d79/dfc/ddb 13957241 1 2024-02-28T16:02:22.426 INFO:tasks.workunit.client.0.smithi057.stdout:0/893: link d6/d12/d17/d92/fd9 d6/d12/d17/d58/db8/f127 0 2024-02-28T16:02:22.429 INFO:tasks.workunit.client.0.smithi057.stdout:8/810: chown d5/de/c26 1184181 1 2024-02-28T16:02:22.433 INFO:tasks.workunit.client.0.smithi057.stdout:6/881: rename df/d61/dbb/ddc to df/d10/d78/dca/d15/d16/d122 0 2024-02-28T16:02:22.434 INFO:tasks.workunit.client.0.smithi057.stdout:0/894: chown d6/d12/d17/f3b 0 1 2024-02-28T16:02:22.437 INFO:tasks.workunit.client.0.smithi057.stdout:8/811: fdatasync d5/d20/d39/d8c/fb2 0 2024-02-28T16:02:22.441 INFO:tasks.workunit.client.0.smithi057.stdout:2/818: write d19/d57/f67 [708740,49774] 0 2024-02-28T16:02:22.441 INFO:tasks.workunit.client.0.smithi057.stdout:7/760: dwrite d6/dc/d12/d1a/d4c/d63/f80 [0,4194304] 0 2024-02-28T16:02:22.441 INFO:tasks.workunit.client.0.smithi057.stdout:3/756: link d8/dd/d14/d2c/db9/ld7 d8/d26/dfb/l101 0 2024-02-28T16:02:22.449 INFO:tasks.workunit.client.0.smithi057.stdout:3/757: chown d8/dd/d14/d2e/d2f 57 1 2024-02-28T16:02:22.449 INFO:tasks.workunit.client.0.smithi057.stdout:6/882: chown df/d10/d78/dca/d15/d16/d39/d92/c9c 1 1 2024-02-28T16:02:22.449 INFO:tasks.workunit.client.0.smithi057.stdout:7/761: write d6/dc/f34 [5126610,14299] 0 2024-02-28T16:02:22.452 INFO:tasks.workunit.client.0.smithi057.stdout:5/810: write d2/d12/d76/d7a/d95/db5/dcb/f59 [826057,90269] 0 2024-02-28T16:02:22.452 INFO:tasks.workunit.client.0.smithi057.stdout:9/860: dwrite d2/d5/d1b/d2e/f9d [0,4194304] 0 2024-02-28T16:02:22.457 INFO:tasks.workunit.client.0.smithi057.stdout:1/887: dread d1/d3/dc/d15/f3c [4194304,4194304] 0 2024-02-28T16:02:22.459 INFO:tasks.workunit.client.0.smithi057.stdout:0/895: write d6/d12/d17/f3b [2781210,119181] 0 2024-02-28T16:02:22.460 INFO:tasks.workunit.client.0.smithi057.stdout:5/811: fsync d2/d8/f57 0 2024-02-28T16:02:22.461 INFO:tasks.workunit.client.0.smithi057.stdout:1/888: chown d1/d21/fe0 32860801 1 2024-02-28T16:02:22.461 INFO:tasks.workunit.client.0.smithi057.stdout:8/812: rename d5/de/d1b/d45/d81/l90 to d5/d20/d39/d59/d67/da5/l109 0 2024-02-28T16:02:22.461 INFO:tasks.workunit.client.0.smithi057.stdout:7/762: creat d6/dc/d87/f106 x:0 0 0 2024-02-28T16:02:22.463 INFO:tasks.workunit.client.0.smithi057.stdout:2/819: creat d19/d1d/d2e/de2/d102/f116 x:0 0 0 2024-02-28T16:02:22.465 INFO:tasks.workunit.client.0.smithi057.stdout:4/795: sync 2024-02-28T16:02:22.471 INFO:tasks.workunit.client.0.smithi057.stdout:6/883: creat df/d10/f123 x:0 0 0 2024-02-28T16:02:22.473 INFO:tasks.workunit.client.0.smithi057.stdout:8/813: dread - d5/d20/d39/d59/fba zero size 2024-02-28T16:02:22.473 INFO:tasks.workunit.client.0.smithi057.stdout:7/763: mkdir d6/dc/dab/d107 0 2024-02-28T16:02:22.473 INFO:tasks.workunit.client.0.smithi057.stdout:1/889: symlink d1/d21/d66/l120 0 2024-02-28T16:02:22.474 INFO:tasks.workunit.client.0.smithi057.stdout:2/820: mkdir d19/d1d/d26/d117 0 2024-02-28T16:02:22.474 INFO:tasks.workunit.client.0.smithi057.stdout:4/796: rmdir d1/d10/d12/d2c/d50/dff/d103 39 2024-02-28T16:02:22.478 INFO:tasks.workunit.client.0.smithi057.stdout:5/812: mkdir d2/d12/d76/d7a/dad/d116 0 2024-02-28T16:02:22.480 INFO:tasks.workunit.client.0.smithi057.stdout:1/890: fdatasync d1/d21/d25/f64 0 2024-02-28T16:02:22.482 INFO:tasks.workunit.client.0.smithi057.stdout:7/764: mknod d6/dc/d12/d1a/d4d/df0/c108 0 2024-02-28T16:02:22.484 INFO:tasks.workunit.client.0.smithi057.stdout:6/884: rename df/d10/d78/dca/d15/d16/d65/c9b to df/d10/d78/dca/d15/d16/d122/c124 0 2024-02-28T16:02:22.484 INFO:tasks.workunit.client.0.smithi057.stdout:7/765: chown c3 0 1 2024-02-28T16:02:22.491 INFO:tasks.workunit.client.0.smithi057.stdout:4/797: mkdir d1/d10/d31/d86/dd1/d10c 0 2024-02-28T16:02:22.492 INFO:tasks.workunit.client.0.smithi057.stdout:0/896: getdents d6/d12/d45 0 2024-02-28T16:02:22.492 INFO:tasks.workunit.client.0.smithi057.stdout:1/891: read d1/f45 [2687819,105095] 0 2024-02-28T16:02:22.494 INFO:tasks.workunit.client.0.smithi057.stdout:5/813: mkdir d2/d15/d5e/d67/d117 0 2024-02-28T16:02:22.495 INFO:tasks.workunit.client.0.smithi057.stdout:8/814: rename d5/de/c107 to d5/d20/d39/d59/d67/da5/c10a 0 2024-02-28T16:02:22.499 INFO:tasks.workunit.client.0.smithi057.stdout:3/758: dwrite d8/d26/f7e [0,4194304] 0 2024-02-28T16:02:22.500 INFO:tasks.workunit.client.0.smithi057.stdout:6/885: symlink df/d10/d78/dca/d15/d16/d39/d92/da4/l125 0 2024-02-28T16:02:22.501 INFO:tasks.workunit.client.0.smithi057.stdout:9/861: dread d2/d5/f1a [0,4194304] 0 2024-02-28T16:02:22.505 INFO:tasks.workunit.client.0.smithi057.stdout:5/814: write d2/d15/f1f [1512930,15126] 0 2024-02-28T16:02:22.505 INFO:tasks.workunit.client.0.smithi057.stdout:8/815: chown d5/d20/d39/d49/d56/d79/dfc/fad 110521127 1 2024-02-28T16:02:22.507 INFO:tasks.workunit.client.0.smithi057.stdout:8/816: chown d5/de7 374742 1 2024-02-28T16:02:22.509 INFO:tasks.workunit.client.0.smithi057.stdout:4/798: creat d1/d10/d12/f10d x:0 0 0 2024-02-28T16:02:22.510 INFO:tasks.workunit.client.0.smithi057.stdout:2/821: dwrite d19/d1d/d2e/d3c/dab/dfc/f106 [0,4194304] 0 2024-02-28T16:02:22.517 INFO:tasks.workunit.client.0.smithi057.stdout:6/886: creat df/d10/d13/d70/d119/f126 x:0 0 0 2024-02-28T16:02:22.520 INFO:tasks.workunit.client.0.smithi057.stdout:9/862: rmdir d2/d5/d1b/d2e/d4c/da0/da7 39 2024-02-28T16:02:22.524 INFO:tasks.workunit.client.0.smithi057.stdout:8/817: creat d5/d20/d39/d49/d56/d84/f10b x:0 0 0 2024-02-28T16:02:22.525 INFO:tasks.workunit.client.0.smithi057.stdout:2/822: creat d19/d43/df2/f118 x:0 0 0 2024-02-28T16:02:22.525 INFO:tasks.workunit.client.0.smithi057.stdout:4/799: mknod d1/d10/d12/d2c/d37/d46/dac/de9/d87/c10e 0 2024-02-28T16:02:22.525 INFO:tasks.workunit.client.0.smithi057.stdout:0/897: dwrite d6/d12/d17/d4b/f7d [0,4194304] 0 2024-02-28T16:02:22.526 INFO:tasks.workunit.client.0.smithi057.stdout:3/759: creat d8/dd/d19/d2a/de3/f102 x:0 0 0 2024-02-28T16:02:22.526 INFO:tasks.workunit.client.0.smithi057.stdout:1/892: link d1/d21/d66/d44/d4c/lb8 d1/d3/dc/d15/d4e/d5f/dbe/l121 0 2024-02-28T16:02:22.528 INFO:tasks.workunit.client.0.smithi057.stdout:6/887: creat df/d10/d78/dca/d15/d16/d39/d8d/f127 x:0 0 0 2024-02-28T16:02:22.531 INFO:tasks.workunit.client.0.smithi057.stdout:2/823: creat d19/d34/f119 x:0 0 0 2024-02-28T16:02:22.533 INFO:tasks.workunit.client.0.smithi057.stdout:6/888: write df/d10/d78/d5b/d7b/f8c [685273,37308] 0 2024-02-28T16:02:22.533 INFO:tasks.workunit.client.0.smithi057.stdout:1/893: rmdir d1/d21 39 2024-02-28T16:02:22.534 INFO:tasks.workunit.client.0.smithi057.stdout:3/760: creat d8/dd/d19/d25/f103 x:0 0 0 2024-02-28T16:02:22.536 INFO:tasks.workunit.client.0.smithi057.stdout:9/863: readlink d2/d5/d1b/d2e/d44/d7e/lb1 0 2024-02-28T16:02:22.536 INFO:tasks.workunit.client.0.smithi057.stdout:5/815: link d2/d15/fa1 d2/d12/d76/d7a/d95/db5/dce/f118 0 2024-02-28T16:02:22.540 INFO:tasks.workunit.client.0.smithi057.stdout:0/898: symlink d6/d12/d5d/l128 0 2024-02-28T16:02:22.540 INFO:tasks.workunit.client.0.smithi057.stdout:6/889: read - df/d10/d4f/ded/f104 zero size 2024-02-28T16:02:22.541 INFO:tasks.workunit.client.0.smithi057.stdout:9/864: dread - d2/d62/f88 zero size 2024-02-28T16:02:22.541 INFO:tasks.workunit.client.0.smithi057.stdout:3/761: symlink d8/dd/d14/d2c/l104 0 2024-02-28T16:02:22.543 INFO:tasks.workunit.client.0.smithi057.stdout:8/818: getdents d5/d20/d39/d49/d56 0 2024-02-28T16:02:22.545 INFO:tasks.workunit.client.0.smithi057.stdout:2/824: link d19/d1d/d2e/de2/d102/f116 d19/d2c/d65/dda/f11a 0 2024-02-28T16:02:22.549 INFO:tasks.workunit.client.0.smithi057.stdout:8/819: truncate d5/fd2 5122029 0 2024-02-28T16:02:22.551 INFO:tasks.workunit.client.0.smithi057.stdout:2/825: read d19/d43/d5a/d9b/ff5 [936402,106463] 0 2024-02-28T16:02:22.552 INFO:tasks.workunit.client.0.smithi057.stdout:1/894: rename d1/d21/f63 to d1/d21/d66/d44/d4c/d75/f122 0 2024-02-28T16:02:22.552 INFO:tasks.workunit.client.0.smithi057.stdout:5/816: dread d2/d12/d76/d7a/d95/db5/dcb/f59 [0,4194304] 0 2024-02-28T16:02:22.553 INFO:tasks.workunit.client.0.smithi057.stdout:2/826: dread - d19/d2c/d65/dda/f11a zero size 2024-02-28T16:02:22.556 INFO:tasks.workunit.client.0.smithi057.stdout:6/890: creat df/d10/d13/d70/f128 x:0 0 0 2024-02-28T16:02:22.561 INFO:tasks.workunit.client.0.smithi057.stdout:3/762: mknod d8/dd/d14/d2e/d30/d49/c105 0 2024-02-28T16:02:22.574 INFO:tasks.workunit.client.0.smithi057.stdout:8/820: mkdir d5/d20/d39/d59/d67/da5/df8/d10c 0 2024-02-28T16:02:22.576 INFO:tasks.workunit.client.0.smithi057.stdout:1/895: write d1/d3/dc/d15/f3c [3263967,52463] 0 2024-02-28T16:02:22.578 INFO:tasks.workunit.client.0.smithi057.stdout:5/817: write d2/d19/fe9 [3479921,101283] 0 2024-02-28T16:02:22.578 INFO:tasks.workunit.client.0.smithi057.stdout:6/891: symlink df/d10/l129 0 2024-02-28T16:02:22.578 INFO:tasks.workunit.client.0.smithi057.stdout:0/899: dwrite d6/d12/d5d/de9/ff3 [0,4194304] 0 2024-02-28T16:02:22.582 INFO:tasks.workunit.client.0.smithi057.stdout:8/821: mknod d5/de/d1b/d57/d91/c10d 0 2024-02-28T16:02:22.586 INFO:tasks.workunit.client.0.smithi057.stdout:5/818: dread - d2/d19/d1c/f10f zero size 2024-02-28T16:02:22.587 INFO:tasks.workunit.client.0.smithi057.stdout:6/892: fdatasync df/d10/d13/d70/f128 0 2024-02-28T16:02:22.591 INFO:tasks.workunit.client.0.smithi057.stdout:8/822: readlink d5/d20/d39/d49/d56/d79/dfc/le2 0 2024-02-28T16:02:22.592 INFO:tasks.workunit.client.0.smithi057.stdout:9/865: dwrite d2/d5/f30 [0,4194304] 0 2024-02-28T16:02:22.597 INFO:tasks.workunit.client.0.smithi057.stdout:0/900: getdents d6/d12/d17/d34/de2 0 2024-02-28T16:02:22.605 INFO:tasks.workunit.client.0.smithi057.stdout:0/901: stat d6/d12/d5d/d7f/cac 0 2024-02-28T16:02:22.607 INFO:tasks.workunit.client.0.smithi057.stdout:9/866: mkdir d2/d24/d1d/d104/d119 0 2024-02-28T16:02:22.609 INFO:tasks.workunit.client.0.smithi057.stdout:6/893: rmdir df/d10/d13/d70/d119 39 2024-02-28T16:02:22.609 INFO:tasks.workunit.client.0.smithi057.stdout:2/827: dwrite d19/d43/df2/f108 [0,4194304] 0 2024-02-28T16:02:22.610 INFO:tasks.workunit.client.0.smithi057.stdout:0/902: write d6/d4e/fd3 [451762,27172] 0 2024-02-28T16:02:22.614 INFO:tasks.workunit.client.0.smithi057.stdout:3/763: dread d8/dd/d14/d2e/d2f/da2/fe1 [4194304,4194304] 0 2024-02-28T16:02:22.615 INFO:tasks.workunit.client.0.smithi057.stdout:1/896: truncate d1/d21/d66/d53/d62/fb2 2108102 0 2024-02-28T16:02:22.618 INFO:tasks.workunit.client.0.smithi057.stdout:6/894: symlink df/d10/d13/d4b/dcc/l12a 0 2024-02-28T16:02:22.619 INFO:tasks.workunit.client.0.smithi057.stdout:0/903: symlink d6/d12/d45/l129 0 2024-02-28T16:02:22.624 INFO:tasks.workunit.client.0.smithi057.stdout:8/823: rename d5/d20/d39/cf0 to d5/d62/c10e 0 2024-02-28T16:02:22.629 INFO:tasks.workunit.client.0.smithi057.stdout:8/824: truncate d5/d20/d39/d6e/fca 977395 0 2024-02-28T16:02:22.630 INFO:tasks.workunit.client.0.smithi057.stdout:9/867: fdatasync d2/d5/d9/d5d/d70/feb 0 2024-02-28T16:02:22.631 INFO:tasks.workunit.client.0.smithi057.stdout:5/819: dwrite d2/d12/d76/d7a/d95/db5/dcb/d91/fcc [0,4194304] 0 2024-02-28T16:02:22.632 INFO:tasks.workunit.client.0.smithi057.stdout:0/904: chown d6/d4e/cf5 34 1 2024-02-28T16:02:22.635 INFO:tasks.workunit.client.0.smithi057.stdout:3/764: rename d8/dd/d14/d2e/d3b/ccc to d8/dd/d19/d2a/c106 0 2024-02-28T16:02:22.639 INFO:tasks.workunit.client.0.smithi057.stdout:0/905: creat d6/d12/d17/d34/de2/f12a x:0 0 0 2024-02-28T16:02:22.640 INFO:tasks.workunit.client.0.smithi057.stdout:8/825: symlink d5/d20/d39/d59/d106/l10f 0 2024-02-28T16:02:22.643 INFO:tasks.workunit.client.0.smithi057.stdout:3/765: write d8/dd/d19/f7d [861766,73645] 0 2024-02-28T16:02:22.647 INFO:tasks.workunit.client.0.smithi057.stdout:5/820: symlink d2/d12/d76/d7b/d62/d74/l119 0 2024-02-28T16:02:22.647 INFO:tasks.workunit.client.0.smithi057.stdout:1/897: dwrite d1/d21/d25/df7/f111 [0,4194304] 0 2024-02-28T16:02:22.652 INFO:tasks.workunit.client.0.smithi057.stdout:2/828: truncate d19/f47 2800028 0 2024-02-28T16:02:22.655 INFO:tasks.workunit.client.0.smithi057.stdout:3/766: symlink d8/dd/d14/d2e/d30/d6a/l107 0 2024-02-28T16:02:22.659 INFO:tasks.workunit.client.0.smithi057.stdout:6/895: rename df/d10/d78/dca/d15/d16/d39/d8d/dd9 to df/d12b 0 2024-02-28T16:02:22.661 INFO:tasks.workunit.client.0.smithi057.stdout:6/896: readlink df/d10/d78/dca/d15/d82/l10b 0 2024-02-28T16:02:22.670 INFO:tasks.workunit.client.0.smithi057.stdout:5/821: symlink d2/d15/d63/l11a 0 2024-02-28T16:02:22.671 INFO:tasks.workunit.client.0.smithi057.stdout:1/898: creat d1/d3/d97/f123 x:0 0 0 2024-02-28T16:02:22.675 INFO:tasks.workunit.client.0.smithi057.stdout:2/829: truncate d19/d1d/d2e/d31/f50 848236 0 2024-02-28T16:02:22.675 INFO:tasks.workunit.client.0.smithi057.stdout:9/868: rename d2/d5/dd3/d8b/f8d to d2/d5/d9/d64/d78/f11a 0 2024-02-28T16:02:22.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:22 smithi057 ceph-mon[28763]: pgmap v43: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 53 MiB/s rd, 116 MiB/s wr, 304 op/s 2024-02-28T16:02:22.679 INFO:tasks.workunit.client.0.smithi057.stdout:9/869: chown d2/d5/d9/d5d/d82 414638294 1 2024-02-28T16:02:22.679 INFO:tasks.workunit.client.0.smithi057.stdout:5/822: rmdir d2/d15/d5e/d9a 39 2024-02-28T16:02:22.683 INFO:tasks.workunit.client.0.smithi057.stdout:0/906: getdents d6/d12/d17 0 2024-02-28T16:02:22.684 INFO:tasks.workunit.client.0.smithi057.stdout:1/899: mknod d1/d21/d66/d53/d7d/d67/d6c/d82/c124 0 2024-02-28T16:02:22.684 INFO:tasks.workunit.client.0.smithi057.stdout:3/767: dwrite d8/dd/d14/d2c/f4c [0,4194304] 0 2024-02-28T16:02:22.689 INFO:tasks.workunit.client.0.smithi057.stdout:9/870: mkdir d2/d62/d11b 0 2024-02-28T16:02:22.691 INFO:tasks.workunit.client.0.smithi057.stdout:3/768: write d8/dd/d14/d2e/d76/d89/f87 [5718105,39183] 0 2024-02-28T16:02:22.691 INFO:tasks.workunit.client.0.smithi057.stdout:2/830: rename d19/d1d/d2e/de2/d102 to d19/d43/ddd/d11b 0 2024-02-28T16:02:22.698 INFO:tasks.workunit.client.0.smithi057.stdout:0/907: mkdir d6/d12/d45/d78/d12b 0 2024-02-28T16:02:22.699 INFO:tasks.workunit.client.0.smithi057.stdout:9/871: mknod d2/d5/dd3/d8b/c11c 0 2024-02-28T16:02:22.702 INFO:tasks.workunit.client.0.smithi057.stdout:2/831: dread - d19/dc1/f109 zero size 2024-02-28T16:02:22.705 INFO:tasks.workunit.client.0.smithi057.stdout:8/826: dread d5/de/f4a [0,4194304] 0 2024-02-28T16:02:22.707 INFO:tasks.workunit.client.0.smithi057.stdout:8/827: stat d5/d20/d39/d49/cac 0 2024-02-28T16:02:22.707 INFO:tasks.workunit.client.0.smithi057.stdout:6/897: dread df/d10/d4f/ded/ffe [0,4194304] 0 2024-02-28T16:02:22.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:22 smithi087 ceph-mon[37122]: pgmap v43: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 53 MiB/s rd, 116 MiB/s wr, 304 op/s 2024-02-28T16:02:22.722 INFO:tasks.workunit.client.0.smithi057.stdout:3/769: creat d8/d4b/dd2/ddd/f108 x:0 0 0 2024-02-28T16:02:22.724 INFO:tasks.workunit.client.0.smithi057.stdout:2/832: symlink d19/d43/d5a/d70/l11c 0 2024-02-28T16:02:22.726 INFO:tasks.workunit.client.0.smithi057.stdout:6/898: rmdir df/d10/d4f 39 2024-02-28T16:02:22.728 INFO:tasks.workunit.client.0.smithi057.stdout:9/872: symlink d2/d5/dff/l11d 0 2024-02-28T16:02:22.729 INFO:tasks.workunit.client.0.smithi057.stdout:8/828: unlink d5/d20/d39/d49/cac 0 2024-02-28T16:02:22.732 INFO:tasks.workunit.client.0.smithi057.stdout:3/770: creat d8/dd/d14/d2e/d30/d49/d51/f109 x:0 0 0 2024-02-28T16:02:22.736 INFO:tasks.workunit.client.0.smithi057.stdout:8/829: rmdir d5/de/d1b/d57/d85 39 2024-02-28T16:02:22.738 INFO:tasks.workunit.client.0.smithi057.stdout:8/830: stat d5/de/d1b/d45/d81/dae 0 2024-02-28T16:02:22.738 INFO:tasks.workunit.client.0.smithi057.stdout:3/771: fsync d8/dd/d14/d2e/d3b/d54/fc3 0 2024-02-28T16:02:22.740 INFO:tasks.workunit.client.0.smithi057.stdout:3/772: stat d8/dd/d19/db1 0 2024-02-28T16:02:22.741 INFO:tasks.workunit.client.0.smithi057.stdout:8/831: chown d5/de/d1b/d45/c101 25 1 2024-02-28T16:02:22.745 INFO:tasks.workunit.client.0.smithi057.stdout:9/873: mknod d2/d24/c11e 0 2024-02-28T16:02:22.749 INFO:tasks.workunit.client.0.smithi057.stdout:8/832: rename d5/de/d1b/d45/d81/dae/fc4 to d5/d20/da2/f110 0 2024-02-28T16:02:22.750 INFO:tasks.workunit.client.0.smithi057.stdout:8/833: chown d5/de/d1b 864211 1 2024-02-28T16:02:22.751 INFO:tasks.workunit.client.0.smithi057.stdout:9/874: mknod d2/c11f 0 2024-02-28T16:02:22.751 INFO:tasks.workunit.client.0.smithi057.stdout:2/833: dread d19/d2c/d48/da2/fec [0,4194304] 0 2024-02-28T16:02:22.752 INFO:tasks.workunit.client.0.smithi057.stdout:1/900: truncate d1/d3/dc/d15/d4e/d5f/fa2 470002 0 2024-02-28T16:02:22.755 INFO:tasks.workunit.client.0.smithi057.stdout:1/901: write d1/d21/fe0 [7190017,53287] 0 2024-02-28T16:02:22.756 INFO:tasks.workunit.client.0.smithi057.stdout:2/834: rename d19/d2c/l69 to d19/d1d/d26/d117/l11d 0 2024-02-28T16:02:22.759 INFO:tasks.workunit.client.0.smithi057.stdout:1/902: creat d1/d21/d66/d44/d4c/f125 x:0 0 0 2024-02-28T16:02:22.761 INFO:tasks.workunit.client.0.smithi057.stdout:1/903: chown d1/d21/d66/d53/d7d 11749078 1 2024-02-28T16:02:22.761 INFO:tasks.workunit.client.0.smithi057.stdout:2/835: readlink d19/d1d/d22/l28 0 2024-02-28T16:02:22.763 INFO:tasks.workunit.client.0.smithi057.stdout:2/836: getdents d19/d2c/d65/dcf 0 2024-02-28T16:02:22.768 INFO:tasks.workunit.client.0.smithi057.stdout:0/908: write d6/d12/d45/d55/f56 [12472,118855] 0 2024-02-28T16:02:22.775 INFO:tasks.workunit.client.0.smithi057.stdout:9/875: write d2/d24/d9c/fbb [3866602,112249] 0 2024-02-28T16:02:22.781 INFO:tasks.workunit.client.0.smithi057.stdout:9/876: unlink d2/d62/f88 0 2024-02-28T16:02:22.787 INFO:tasks.workunit.client.0.smithi057.stdout:6/899: dwrite df/d10/d78/dca/d15/d16/d39/f112 [0,4194304] 0 2024-02-28T16:02:22.788 INFO:tasks.workunit.client.0.smithi057.stdout:2/837: dwrite d19/d2c/d65/dda/f114 [4194304,4194304] 0 2024-02-28T16:02:22.791 INFO:tasks.workunit.client.0.smithi057.stdout:0/909: dwrite d6/d12/d45/ff8 [0,4194304] 0 2024-02-28T16:02:22.792 INFO:tasks.workunit.client.0.smithi057.stdout:9/877: write f0 [2722650,76518] 0 2024-02-28T16:02:22.797 INFO:tasks.workunit.client.0.smithi057.stdout:2/838: creat d19/d34/d78/f11e x:0 0 0 2024-02-28T16:02:22.805 INFO:tasks.workunit.client.0.smithi057.stdout:2/839: write d19/d1d/d26/fc0 [1170128,123268] 0 2024-02-28T16:02:22.816 INFO:tasks.workunit.client.0.smithi057.stdout:6/900: dwrite df/d10/d4f/ded/ffe [4194304,4194304] 0 2024-02-28T16:02:22.826 INFO:tasks.workunit.client.0.smithi057.stdout:9/878: dwrite d2/f4e [0,4194304] 0 2024-02-28T16:02:22.827 INFO:tasks.workunit.client.0.smithi057.stdout:0/910: dread d6/d12/d17/d34/f4d [0,4194304] 0 2024-02-28T16:02:22.834 INFO:tasks.workunit.client.0.smithi057.stdout:0/911: dread d6/d12/d45/f9a [0,4194304] 0 2024-02-28T16:02:22.835 INFO:tasks.workunit.client.0.smithi057.stdout:0/912: chown d6/d12/d17/d4b/f123 167 1 2024-02-28T16:02:22.898 INFO:tasks.workunit.client.0.smithi057.stdout:2/840: link d19/d1d/d2e/de2/c10a d19/d43/d5a/d9b/c11f 0 2024-02-28T16:02:22.901 INFO:tasks.workunit.client.0.smithi057.stdout:0/913: symlink d6/d12/d17/l12c 0 2024-02-28T16:02:22.908 INFO:tasks.workunit.client.0.smithi057.stdout:2/841: fdatasync d19/d3a/f46 0 2024-02-28T16:02:22.919 INFO:tasks.workunit.client.0.smithi057.stdout:2/842: write d19/d2c/f4f [163731,69267] 0 2024-02-28T16:02:22.924 INFO:tasks.workunit.client.0.smithi057.stdout:2/843: rmdir d19/d2c/d7b 39 2024-02-28T16:02:22.925 INFO:tasks.workunit.client.0.smithi057.stdout:6/901: dwrite df/d10/d78/d5b/d7b/f88 [0,4194304] 0 2024-02-28T16:02:22.931 INFO:tasks.workunit.client.0.smithi057.stdout:0/914: dread d6/d12/d45/d78/f90 [0,4194304] 0 2024-02-28T16:02:22.936 INFO:tasks.workunit.client.0.smithi057.stdout:9/879: dread d2/f20 [0,4194304] 0 2024-02-28T16:02:22.936 INFO:tasks.workunit.client.0.smithi057.stdout:2/844: rename d19/d2c/d48/da2/lea to d19/d2c/d65/l120 0 2024-02-28T16:02:22.941 INFO:tasks.workunit.client.0.smithi057.stdout:9/880: mkdir d2/d5/d9/d120 0 2024-02-28T16:02:22.947 INFO:tasks.workunit.client.0.smithi057.stdout:6/902: link df/d10/d13/d4b/fbf df/d10/d13/d4b/dcc/f12c 0 2024-02-28T16:02:22.949 INFO:tasks.workunit.client.0.smithi057.stdout:0/915: rmdir d6/d12/d5d/d71/d105 0 2024-02-28T16:02:22.952 INFO:tasks.workunit.client.0.smithi057.stdout:9/881: truncate d2/d24/d1d/d104/ff4 143449 0 2024-02-28T16:02:22.957 INFO:tasks.workunit.client.0.smithi057.stdout:6/903: read df/d10/d78/dca/d15/d16/f31 [282143,90445] 0 2024-02-28T16:02:22.962 INFO:tasks.workunit.client.0.smithi057.stdout:2/845: dread d19/d43/d5a/fdf [0,4194304] 0 2024-02-28T16:02:22.965 INFO:tasks.workunit.client.0.smithi057.stdout:9/882: creat d2/d5/d1b/d2e/d4c/da0/f121 x:0 0 0 2024-02-28T16:02:22.966 INFO:tasks.workunit.client.0.smithi057.stdout:2/846: write d19/d1d/d89/f10b [64295,127581] 0 2024-02-28T16:02:22.971 INFO:tasks.workunit.client.0.smithi057.stdout:2/847: write d19/d57/f67 [59590,114524] 0 2024-02-28T16:02:22.981 INFO:tasks.workunit.client.0.smithi057.stdout:0/916: dwrite d6/d12/d38/db4/ff7 [0,4194304] 0 2024-02-28T16:02:22.987 INFO:tasks.workunit.client.0.smithi057.stdout:0/917: chown d6/d12/d17/d58/d95/daf/fd6 46556156 1 2024-02-28T16:02:22.988 INFO:tasks.workunit.client.0.smithi057.stdout:6/904: dwrite df/d10/d4f/f71 [0,4194304] 0 2024-02-28T16:02:22.991 INFO:tasks.workunit.client.0.smithi057.stdout:2/848: getdents d19/d1d/d2e/d3c/dab/dfc 0 2024-02-28T16:02:22.992 INFO:tasks.workunit.client.0.smithi057.stdout:0/918: mkdir d6/d12/d5d/d71/d10a/d12d 0 2024-02-28T16:02:22.997 INFO:tasks.workunit.client.0.smithi057.stdout:9/883: dwrite d2/d5/d9/d64/d78/ff9 [0,4194304] 0 2024-02-28T16:02:22.998 INFO:tasks.workunit.client.0.smithi057.stdout:2/849: creat d19/d2c/d65/de9/f121 x:0 0 0 2024-02-28T16:02:23.002 INFO:tasks.workunit.client.0.smithi057.stdout:9/884: mknod d2/d24/d1d/d104/d65/d6e/c122 0 2024-02-28T16:02:23.004 INFO:tasks.workunit.client.0.smithi057.stdout:6/905: link df/d10/d78/dca/d15/d16/d39/d92/da4/fc6 df/d10/d78/dca/d15/d16/d122/f12d 0 2024-02-28T16:02:23.009 INFO:tasks.workunit.client.0.smithi057.stdout:0/919: write d6/d12/d17/d4b/f83 [399417,54626] 0 2024-02-28T16:02:23.011 INFO:tasks.workunit.client.0.smithi057.stdout:0/920: chown d6/d12/d17/l125 45272345 1 2024-02-28T16:02:23.016 INFO:tasks.workunit.client.0.smithi057.stdout:0/921: rename d6/d12/d45/ff8 to d6/d12/d5d/d71/f12e 0 2024-02-28T16:02:23.019 INFO:tasks.workunit.client.0.smithi057.stdout:9/885: dwrite d2/d92/fa5 [0,4194304] 0 2024-02-28T16:02:23.020 INFO:tasks.workunit.client.0.smithi057.stdout:0/922: truncate d6/d12/d38/f52 3487218 0 2024-02-28T16:02:23.034 INFO:tasks.workunit.client.0.smithi057.stdout:0/923: rename d6/d12/d38/d5e/c49 to d6/d12/d38/da3/c12f 0 2024-02-28T16:02:23.036 INFO:tasks.workunit.client.0.smithi057.stdout:9/886: creat d2/f123 x:0 0 0 2024-02-28T16:02:23.038 INFO:tasks.workunit.client.0.smithi057.stdout:2/850: dread d19/f47 [0,4194304] 0 2024-02-28T16:02:23.040 INFO:tasks.workunit.client.0.smithi057.stdout:0/924: write d6/d12/d17/f59 [3583969,101464] 0 2024-02-28T16:02:23.041 INFO:tasks.workunit.client.0.smithi057.stdout:7/766: sync 2024-02-28T16:02:23.053 INFO:tasks.workunit.client.0.smithi057.stdout:0/925: creat d6/d12/d17/d4b/f130 x:0 0 0 2024-02-28T16:02:23.054 INFO:tasks.workunit.client.0.smithi057.stdout:0/926: chown d6/d12/d17 1 1 2024-02-28T16:02:23.060 INFO:tasks.workunit.client.0.smithi057.stdout:7/767: creat d6/dc/d12/d1a/d4d/f109 x:0 0 0 2024-02-28T16:02:23.061 INFO:tasks.workunit.client.0.smithi057.stdout:0/927: readlink d6/d12/d45/dab/lf1 0 2024-02-28T16:02:23.066 INFO:tasks.workunit.client.0.smithi057.stdout:9/887: dwrite d2/d5/d9/f4b [0,4194304] 0 2024-02-28T16:02:23.069 INFO:tasks.workunit.client.0.smithi057.stdout:7/768: dread d6/dc/d67/d9a/da1/fa4 [0,4194304] 0 2024-02-28T16:02:23.072 INFO:tasks.workunit.client.0.smithi057.stdout:0/928: chown d6/d12/d38/l4c 82 1 2024-02-28T16:02:23.079 INFO:tasks.workunit.client.0.smithi057.stdout:9/888: truncate d2/d24/d1d/f23 4532365 0 2024-02-28T16:02:23.080 INFO:tasks.workunit.client.0.smithi057.stdout:7/769: creat d6/dc/d12/d29/f10a x:0 0 0 2024-02-28T16:02:23.082 INFO:tasks.workunit.client.0.smithi057.stdout:0/929: mknod d6/d12/d5d/d71/d10a/d12d/c131 0 2024-02-28T16:02:23.083 INFO:tasks.workunit.client.0.smithi057.stdout:2/851: dread d19/d2c/d48/f7d [0,4194304] 0 2024-02-28T16:02:23.086 INFO:tasks.workunit.client.0.smithi057.stdout:0/930: chown d6/d12/d17/f10c 371333346 1 2024-02-28T16:02:23.087 INFO:tasks.workunit.client.0.smithi057.stdout:9/889: rename d2/d24/c3b to d2/d5/d9/d5d/d70/c124 0 2024-02-28T16:02:23.095 INFO:tasks.workunit.client.0.smithi057.stdout:0/931: mkdir d6/d12/d45/d78/d12b/d132 0 2024-02-28T16:02:23.098 INFO:tasks.workunit.client.0.smithi057.stdout:9/890: getdents d2/d92 0 2024-02-28T16:02:23.099 INFO:tasks.workunit.client.0.smithi057.stdout:0/932: mkdir d6/d12/d17/d133 0 2024-02-28T16:02:23.100 INFO:tasks.workunit.client.0.smithi057.stdout:9/891: dread - d2/d24/f111 zero size 2024-02-28T16:02:23.103 INFO:tasks.workunit.client.0.smithi057.stdout:0/933: dread - d6/d12/d5d/d71/daa/db6/f11a zero size 2024-02-28T16:02:23.104 INFO:tasks.workunit.client.0.smithi057.stdout:2/852: truncate d19/d43/d5a/fdf 993792 0 2024-02-28T16:02:23.105 INFO:tasks.workunit.client.0.smithi057.stdout:2/853: chown d19/d2c/ffb 441357663 1 2024-02-28T16:02:23.107 INFO:tasks.workunit.client.0.smithi057.stdout:9/892: mknod d2/d46/d67/d7d/c125 0 2024-02-28T16:02:23.107 INFO:tasks.workunit.client.0.smithi057.stdout:0/934: rmdir d6/d12/d17/d34/db7 39 2024-02-28T16:02:23.108 INFO:tasks.workunit.client.0.smithi057.stdout:2/854: fsync d19/d1d/d2e/d3c/dab/dfc/ff1 0 2024-02-28T16:02:23.112 INFO:tasks.workunit.client.0.smithi057.stdout:2/855: unlink d19/d43/d5a/d9b/ff5 0 2024-02-28T16:02:23.114 INFO:tasks.workunit.client.0.smithi057.stdout:0/935: unlink d6/d12/d17/c70 0 2024-02-28T16:02:23.116 INFO:tasks.workunit.client.0.smithi057.stdout:2/856: mknod d19/d1d/d2e/d3c/c122 0 2024-02-28T16:02:23.118 INFO:tasks.workunit.client.0.smithi057.stdout:2/857: chown d19/d1d/d26/c60 268 1 2024-02-28T16:02:23.119 INFO:tasks.workunit.client.0.smithi057.stdout:0/936: truncate d6/d12/d38/d5e/f46 1541831 0 2024-02-28T16:02:23.134 INFO:tasks.workunit.client.0.smithi057.stdout:9/893: dread d2/d24/d1d/d104/d65/f28 [0,4194304] 0 2024-02-28T16:02:23.136 INFO:tasks.workunit.client.0.smithi057.stdout:9/894: stat d2/d5/d9/d5d/d70/cf1 0 2024-02-28T16:02:23.137 INFO:tasks.workunit.client.0.smithi057.stdout:9/895: readlink d2/d24/d1d/l42 0 2024-02-28T16:02:23.139 INFO:tasks.workunit.client.0.smithi057.stdout:9/896: mkdir d2/d5/d9/d64/d126 0 2024-02-28T16:02:23.142 INFO:tasks.workunit.client.0.smithi057.stdout:9/897: truncate d2/d5/d9/f2a 4448634 0 2024-02-28T16:02:23.143 INFO:tasks.workunit.client.0.smithi057.stdout:2/858: dread d19/f37 [0,4194304] 0 2024-02-28T16:02:23.146 INFO:tasks.workunit.client.0.smithi057.stdout:9/898: symlink d2/d5/d1b/d2e/d4c/da0/da7/d117/l127 0 2024-02-28T16:02:23.147 INFO:tasks.workunit.client.0.smithi057.stdout:2/859: unlink d19/d34/d78/lbb 0 2024-02-28T16:02:23.149 INFO:tasks.workunit.client.0.smithi057.stdout:9/899: read d2/d5/d9/fb [2420696,1972] 0 2024-02-28T16:02:23.150 INFO:tasks.workunit.client.0.smithi057.stdout:9/900: write d2/d24/d1d/d104/f113 [329841,14308] 0 2024-02-28T16:02:23.152 INFO:tasks.workunit.client.0.smithi057.stdout:9/901: chown d2/d5/d9/d5d/d82/fab 427 1 2024-02-28T16:02:23.154 INFO:tasks.workunit.client.0.smithi057.stdout:9/902: mkdir d2/d5/dd8/d128 0 2024-02-28T16:02:23.157 INFO:tasks.workunit.client.0.smithi057.stdout:9/903: mkdir d2/d5/d9/d120/d129 0 2024-02-28T16:02:23.159 INFO:tasks.workunit.client.0.smithi057.stdout:9/904: fsync d2/d5/d9/d5d/d70/f84 0 2024-02-28T16:02:23.180 INFO:tasks.workunit.client.0.smithi057.stdout:9/905: dread d2/d5/fb7 [0,4194304] 0 2024-02-28T16:02:23.183 INFO:tasks.workunit.client.0.smithi057.stdout:9/906: fsync d2/d5/d9/d64/fde 0 2024-02-28T16:02:23.199 INFO:tasks.workunit.client.0.smithi057.stdout:9/907: dwrite d2/d62/fdb [0,4194304] 0 2024-02-28T16:02:23.236 INFO:tasks.workunit.client.0.smithi057.stdout:9/908: dread d2/d24/d1d/d104/d65/f15 [0,4194304] 0 2024-02-28T16:02:23.276 INFO:tasks.workunit.client.0.smithi057.stdout:9/909: mknod d2/d24/d1d/d104/d65/d6e/c12a 0 2024-02-28T16:02:23.278 INFO:tasks.workunit.client.0.smithi057.stdout:9/910: write d2/d24/d9c/ddd/f107 [767504,53337] 0 2024-02-28T16:02:23.293 INFO:tasks.workunit.client.0.smithi057.stdout:9/911: dread d2/d5/d9/f4b [0,4194304] 0 2024-02-28T16:02:23.297 INFO:tasks.workunit.client.0.smithi057.stdout:4/800: sync 2024-02-28T16:02:23.297 INFO:tasks.workunit.client.0.smithi057.stdout:5/823: sync 2024-02-28T16:02:23.297 INFO:tasks.workunit.client.0.smithi057.stdout:3/773: sync 2024-02-28T16:02:23.307 INFO:tasks.workunit.client.0.smithi057.stdout:3/774: mknod d8/dd/d19/c10a 0 2024-02-28T16:02:23.310 INFO:tasks.workunit.client.0.smithi057.stdout:5/824: link d2/d3e/d5b/db0/c113 d2/d19/c11b 0 2024-02-28T16:02:23.311 INFO:tasks.workunit.client.0.smithi057.stdout:3/775: creat d8/dd/d14/d2e/d2f/da2/f10b x:0 0 0 2024-02-28T16:02:23.316 INFO:tasks.workunit.client.0.smithi057.stdout:3/776: mkdir d8/dd/d14/d2e/d3b/d71/d10c 0 2024-02-28T16:02:23.325 INFO:tasks.workunit.client.0.smithi057.stdout:3/777: dread d8/dd/d14/d2e/d3b/d54/f99 [0,4194304] 0 2024-02-28T16:02:23.341 INFO:tasks.workunit.client.0.smithi057.stdout:3/778: dwrite d8/dd/d19/f62 [0,4194304] 0 2024-02-28T16:02:23.346 INFO:tasks.workunit.client.0.smithi057.stdout:3/779: creat d8/dd/d14/d2e/d30/d5f/f10d x:0 0 0 2024-02-28T16:02:23.349 INFO:tasks.workunit.client.0.smithi057.stdout:3/780: chown d8/dd/d19/d25/f2b 11 1 2024-02-28T16:02:23.356 INFO:tasks.workunit.client.0.smithi057.stdout:3/781: unlink d8/dd/d14/d2e/d30/d5f/fe9 0 2024-02-28T16:02:23.369 INFO:tasks.workunit.client.0.smithi057.stdout:5/825: creat d2/f11c x:0 0 0 2024-02-28T16:02:23.372 INFO:tasks.workunit.client.0.smithi057.stdout:4/801: dwrite d1/d3f/f5d [0,4194304] 0 2024-02-28T16:02:23.373 INFO:tasks.workunit.client.0.smithi057.stdout:3/782: dwrite d8/dd/d19/d25/f103 [0,4194304] 0 2024-02-28T16:02:23.376 INFO:tasks.workunit.client.0.smithi057.stdout:4/802: write d1/d10/d31/d36/f47 [8288098,118187] 0 2024-02-28T16:02:23.377 INFO:tasks.workunit.client.0.smithi057.stdout:9/912: rename d2/f75 to d2/d5/d9/d64/d78/f12b 0 2024-02-28T16:02:23.381 INFO:tasks.workunit.client.0.smithi057.stdout:5/826: rename d2/d12/d76/d7b/c65 to d2/d3e/d5b/c11d 0 2024-02-28T16:02:23.385 INFO:tasks.workunit.client.0.smithi057.stdout:3/783: mknod d8/dd/d14/d2e/d3b/d71/d10c/c10e 0 2024-02-28T16:02:23.389 INFO:tasks.workunit.client.0.smithi057.stdout:5/827: creat d2/d12/d5f/d77/f11e x:0 0 0 2024-02-28T16:02:23.389 INFO:tasks.workunit.client.0.smithi057.stdout:9/913: mknod d2/d24/d1d/d104/d119/c12c 0 2024-02-28T16:02:23.393 INFO:tasks.workunit.client.0.smithi057.stdout:3/784: mkdir d8/dd/d14/d2e/d2f/da2/d10f 0 2024-02-28T16:02:23.394 INFO:tasks.workunit.client.0.smithi057.stdout:5/828: rename d2/d8/c6f to d2/ddd/c11f 0 2024-02-28T16:02:23.395 INFO:tasks.workunit.client.0.smithi057.stdout:4/803: getdents d1/d3f/d5f 0 2024-02-28T16:02:23.396 INFO:tasks.workunit.client.0.smithi057.stdout:9/914: creat d2/d5/dd3/f12d x:0 0 0 2024-02-28T16:02:23.398 INFO:tasks.workunit.client.0.smithi057.stdout:4/804: read - d1/d10/fa6 zero size 2024-02-28T16:02:23.399 INFO:tasks.workunit.client.0.smithi057.stdout:3/785: symlink d8/dd/d14/d2e/d2f/da2/d10f/l110 0 2024-02-28T16:02:23.404 INFO:tasks.workunit.client.0.smithi057.stdout:3/786: chown d8/dd/d14/d2e/d30/d49/d51/d66/d7f 1707059882 1 2024-02-28T16:02:23.405 INFO:tasks.workunit.client.0.smithi057.stdout:8/834: sync 2024-02-28T16:02:23.408 INFO:tasks.workunit.client.0.smithi057.stdout:3/787: mknod d8/dd/d14/d2e/d2f/da2/d10f/c111 0 2024-02-28T16:02:23.416 INFO:tasks.workunit.client.0.smithi057.stdout:5/829: dwrite d2/d15/d5e/f10e [0,4194304] 0 2024-02-28T16:02:23.418 INFO:tasks.workunit.client.0.smithi057.stdout:9/915: dwrite d2/d92/f95 [0,4194304] 0 2024-02-28T16:02:23.421 INFO:tasks.workunit.client.0.smithi057.stdout:8/835: link d5/d20/da2/d8d/cde d5/d20/d39/d49/d56/c111 0 2024-02-28T16:02:23.421 INFO:tasks.workunit.client.0.smithi057.stdout:9/916: chown d2/d5/d9/d64/d126 45 1 2024-02-28T16:02:23.426 INFO:tasks.workunit.client.0.smithi057.stdout:8/836: write d5/d20/d39/d59/ff6 [980146,116742] 0 2024-02-28T16:02:23.427 INFO:tasks.workunit.client.0.smithi057.stdout:4/805: dwrite d1/d10/d12/d2c/d37/d46/dac/de9/fed [0,4194304] 0 2024-02-28T16:02:23.437 INFO:tasks.workunit.client.0.smithi057.stdout:3/788: dwrite d8/dd/d14/d2e/d30/d5f/f10d [0,4194304] 0 2024-02-28T16:02:23.437 INFO:tasks.workunit.client.0.smithi057.stdout:8/837: mknod d5/de/d1b/d45/d81/c112 0 2024-02-28T16:02:23.439 INFO:tasks.workunit.client.0.smithi057.stdout:4/806: symlink d1/d10/d12/d39/db4/de7/l10f 0 2024-02-28T16:02:23.439 INFO:tasks.workunit.client.0.smithi057.stdout:8/838: chown d5/d6/dff 30323 1 2024-02-28T16:02:23.442 INFO:tasks.workunit.client.0.smithi057.stdout:4/807: rmdir d1/d10/d12/d2c/d50 39 2024-02-28T16:02:23.449 INFO:tasks.workunit.client.0.smithi057.stdout:3/789: mkdir d8/dd/d14/d2e/d2f/da2/d10f/d112 0 2024-02-28T16:02:23.449 INFO:tasks.workunit.client.0.smithi057.stdout:6/906: sync 2024-02-28T16:02:23.449 INFO:tasks.workunit.client.0.smithi057.stdout:1/904: sync 2024-02-28T16:02:23.449 INFO:tasks.workunit.client.0.smithi057.stdout:0/937: sync 2024-02-28T16:02:23.450 INFO:tasks.workunit.client.0.smithi057.stdout:7/770: sync 2024-02-28T16:02:23.450 INFO:tasks.workunit.client.0.smithi057.stdout:2/860: sync 2024-02-28T16:02:23.451 INFO:tasks.workunit.client.0.smithi057.stdout:4/808: creat d1/d10/d12/d2c/d37/d46/f110 x:0 0 0 2024-02-28T16:02:23.454 INFO:tasks.workunit.client.0.smithi057.stdout:7/771: creat d6/d38/f10b x:0 0 0 2024-02-28T16:02:23.456 INFO:tasks.workunit.client.0.smithi057.stdout:6/907: fdatasync df/d10/d13/fec 0 2024-02-28T16:02:23.461 INFO:tasks.workunit.client.0.smithi057.stdout:7/772: chown d6/d26 43108 1 2024-02-28T16:02:23.468 INFO:tasks.workunit.client.0.smithi057.stdout:0/938: creat d6/d12/d5d/d71/d10a/f134 x:0 0 0 2024-02-28T16:02:23.468 INFO:tasks.workunit.client.0.smithi057.stdout:6/908: chown df/d10/d4f/ded 1499 1 2024-02-28T16:02:23.468 INFO:tasks.workunit.client.0.smithi057.stdout:2/861: unlink d19/d1d/d2e/d31/fb8 0 2024-02-28T16:02:23.468 INFO:tasks.workunit.client.0.smithi057.stdout:5/830: dwrite d2/d12/d76/d7b/f96 [4194304,4194304] 0 2024-02-28T16:02:23.469 INFO:tasks.workunit.client.0.smithi057.stdout:4/809: symlink d1/d10/d12/d2c/d37/d46/l111 0 2024-02-28T16:02:23.472 INFO:tasks.workunit.client.0.smithi057.stdout:1/905: write d1/d21/d66/f2f [4044784,112453] 0 2024-02-28T16:02:23.474 INFO:tasks.workunit.client.0.smithi057.stdout:7/773: rmdir d6/dc/d12/d1a/d4c/d63 39 2024-02-28T16:02:23.480 INFO:tasks.workunit.client.0.smithi057.stdout:5/831: chown d2/d12/d3d/da4/ld7 4 1 2024-02-28T16:02:23.480 INFO:tasks.workunit.client.0.smithi057.stdout:9/917: dwrite d2/d5/d1b/fcf [0,4194304] 0 2024-02-28T16:02:23.480 INFO:tasks.workunit.client.0.smithi057.stdout:6/909: fdatasync df/d10/d78/dca/d15/d16/d39/d92/f121 0 2024-02-28T16:02:23.485 INFO:tasks.workunit.client.0.smithi057.stdout:2/862: creat d19/d1d/d2e/de2/f123 x:0 0 0 2024-02-28T16:02:23.486 INFO:tasks.workunit.client.0.smithi057.stdout:6/910: chown df/d10/f7f 5391779 1 2024-02-28T16:02:23.487 INFO:tasks.workunit.client.0.smithi057.stdout:8/839: dread d5/d20/d39/d49/d56/d79/dfc/fad [0,4194304] 0 2024-02-28T16:02:23.490 INFO:tasks.workunit.client.0.smithi057.stdout:1/906: mkdir d1/d21/d66/d53/d7d/d67/d6c/d82/d112/d126 0 2024-02-28T16:02:23.491 INFO:tasks.workunit.client.0.smithi057.stdout:4/810: mknod d1/d10/d12/d2c/d37/d46/dac/de9/d5e/de8/c112 0 2024-02-28T16:02:23.492 INFO:tasks.workunit.client.0.smithi057.stdout:7/774: creat d6/dc/dab/d107/f10c x:0 0 0 2024-02-28T16:02:23.493 INFO:tasks.workunit.client.0.smithi057.stdout:6/911: creat df/d10/d78/dca/d15/d16/d39/d92/f12e x:0 0 0 2024-02-28T16:02:23.498 INFO:tasks.workunit.client.0.smithi057.stdout:7/775: fdatasync d6/dc/d12/f47 0 2024-02-28T16:02:23.500 INFO:tasks.workunit.client.0.smithi057.stdout:9/918: rename d2/d5/d9/f4b to d2/d24/d1d/d104/f12e 0 2024-02-28T16:02:23.504 INFO:tasks.workunit.client.0.smithi057.stdout:1/907: rmdir d1/d21/d66/d53/d7d/d67 39 2024-02-28T16:02:23.505 INFO:tasks.workunit.client.0.smithi057.stdout:9/919: stat d2/d24/d1d/lf5 0 2024-02-28T16:02:23.506 INFO:tasks.workunit.client.0.smithi057.stdout:4/811: rename d1/d10/d12/d39/db4/fd0 to d1/d10/d12/d2c/d37/dfe/f113 0 2024-02-28T16:02:23.508 INFO:tasks.workunit.client.0.smithi057.stdout:8/840: link d5/d20/d39/ca4 d5/d20/d39/dd9/c113 0 2024-02-28T16:02:23.511 INFO:tasks.workunit.client.0.smithi057.stdout:0/939: truncate d6/d12/d38/fea 3628299 0 2024-02-28T16:02:23.513 INFO:tasks.workunit.client.0.smithi057.stdout:9/920: write d2/d5/dd3/ffe [462400,56455] 0 2024-02-28T16:02:23.514 INFO:tasks.workunit.client.0.smithi057.stdout:1/908: creat d1/d3/d97/f127 x:0 0 0 2024-02-28T16:02:23.517 INFO:tasks.workunit.client.0.smithi057.stdout:2/863: dwrite d19/d1d/f3f [4194304,4194304] 0 2024-02-28T16:02:23.519 INFO:tasks.workunit.client.0.smithi057.stdout:8/841: truncate d5/de/d1b/d57/d91/de9/f100 728115 0 2024-02-28T16:02:23.519 INFO:tasks.workunit.client.0.smithi057.stdout:9/921: chown d2/d24/lf0 0 1 2024-02-28T16:02:23.521 INFO:tasks.workunit.client.0.smithi057.stdout:1/909: chown d1/d3/dc/d15/f10f 2818904 1 2024-02-28T16:02:23.527 INFO:tasks.workunit.client.0.smithi057.stdout:9/922: creat d2/d46/d67/d7d/f12f x:0 0 0 2024-02-28T16:02:23.527 INFO:tasks.workunit.client.0.smithi057.stdout:2/864: truncate d19/d1d/d2e/d31/fc6 427321 0 2024-02-28T16:02:23.527 INFO:tasks.workunit.client.0.smithi057.stdout:7/776: write d6/dc/d12/d1a/d4d/f94 [574720,99797] 0 2024-02-28T16:02:23.528 INFO:tasks.workunit.client.0.smithi057.stdout:8/842: dread d5/de/d1b/d57/f5e [0,4194304] 0 2024-02-28T16:02:23.534 INFO:tasks.workunit.client.0.smithi057.stdout:9/923: write d2/d5/f30 [820314,82549] 0 2024-02-28T16:02:23.536 INFO:tasks.workunit.client.0.smithi057.stdout:2/865: fsync d19/d2c/d65/de9/f121 0 2024-02-28T16:02:23.537 INFO:tasks.workunit.client.0.smithi057.stdout:4/812: write d1/d3f/d5f/fa5 [458712,99206] 0 2024-02-28T16:02:23.537 INFO:tasks.workunit.client.0.smithi057.stdout:0/940: write d6/d12/d45/f9a [1625295,28204] 0 2024-02-28T16:02:23.548 INFO:tasks.workunit.client.0.smithi057.stdout:5/832: dread d2/d12/d5f/f8d [0,4194304] 0 2024-02-28T16:02:23.550 INFO:tasks.workunit.client.0.smithi057.stdout:6/912: dwrite df/d10/d13/f41 [0,4194304] 0 2024-02-28T16:02:23.550 INFO:tasks.workunit.client.0.smithi057.stdout:9/924: write d2/d5/d1b/d2e/d44/f4f [1622878,5862] 0 2024-02-28T16:02:23.553 INFO:tasks.workunit.client.0.smithi057.stdout:6/913: chown ld 637778905 1 2024-02-28T16:02:23.561 INFO:tasks.workunit.client.0.smithi057.stdout:1/910: dread d1/d3/f3b [0,4194304] 0 2024-02-28T16:02:23.564 INFO:tasks.workunit.client.0.smithi057.stdout:0/941: rename d6/d12/d17/d58 to d6/d12/d5d/d71/d10a/d12d/d135 0 2024-02-28T16:02:23.564 INFO:tasks.workunit.client.0.smithi057.stdout:8/843: dwrite d5/de/d1b/faa [0,4194304] 0 2024-02-28T16:02:23.566 INFO:tasks.workunit.client.0.smithi057.stdout:0/942: chown d6/d12/d5d/d71/daa/ld1 244 1 2024-02-28T16:02:23.573 INFO:tasks.workunit.client.0.smithi057.stdout:4/813: dwrite d1/d10/d12/f10d [0,4194304] 0 2024-02-28T16:02:23.574 INFO:tasks.workunit.client.0.smithi057.stdout:7/777: getdents d6/dc 0 2024-02-28T16:02:23.579 INFO:tasks.workunit.client.0.smithi057.stdout:5/833: unlink d2/d15/d5e/d67/fd1 0 2024-02-28T16:02:23.580 INFO:tasks.workunit.client.0.smithi057.stdout:1/911: mknod d1/d3/dc/d15/d4e/d5f/dbe/dd3/c128 0 2024-02-28T16:02:23.586 INFO:tasks.workunit.client.0.smithi057.stdout:6/914: rename df/d10/d78/d5b/d7b/lb4 to df/d10/d13/d70/d119/l12f 0 2024-02-28T16:02:23.587 INFO:tasks.workunit.client.0.smithi057.stdout:4/814: fsync d1/d10/fa6 0 2024-02-28T16:02:23.588 INFO:tasks.workunit.client.0.smithi057.stdout:7/778: mkdir d6/dc/d12/d1a/d4d/d56/db0/d10d 0 2024-02-28T16:02:23.592 INFO:tasks.workunit.client.0.smithi057.stdout:9/925: dwrite d2/d5/d1b/d2e/d4c/f91 [0,4194304] 0 2024-02-28T16:02:23.593 INFO:tasks.workunit.client.0.smithi057.stdout:6/915: creat df/d12b/f130 x:0 0 0 2024-02-28T16:02:23.594 INFO:tasks.workunit.client.0.smithi057.stdout:8/844: link d5/f18 d5/d20/d39/dd9/f114 0 2024-02-28T16:02:23.596 INFO:tasks.workunit.client.0.smithi057.stdout:1/912: truncate d1/d21/d66/d53/d7d/d65/f5c 868482 0 2024-02-28T16:02:23.600 INFO:tasks.workunit.client.0.smithi057.stdout:6/916: fdatasync df/d10/d13/d4b/fbf 0 2024-02-28T16:02:23.602 INFO:tasks.workunit.client.0.smithi057.stdout:5/834: getdents d2/d12/d76 0 2024-02-28T16:02:23.604 INFO:tasks.workunit.client.0.smithi057.stdout:8/845: chown d5/de/d1b/d57/fe0 46 1 2024-02-28T16:02:23.604 INFO:tasks.workunit.client.0.smithi057.stdout:0/943: write d6/d12/d5d/d71/d10a/d12d/d135/d95/daf/fd6 [3934001,13089] 0 2024-02-28T16:02:23.608 INFO:tasks.workunit.client.0.smithi057.stdout:0/944: chown d6/fd7 57 1 2024-02-28T16:02:23.610 INFO:tasks.workunit.client.0.smithi057.stdout:8/846: chown d5/fd2 13 1 2024-02-28T16:02:23.611 INFO:tasks.workunit.client.0.smithi057.stdout:9/926: fdatasync d2/d24/d1d/d104/fb0 0 2024-02-28T16:02:23.612 INFO:tasks.workunit.client.0.smithi057.stdout:7/779: rename d6/dc/d12/d1a/d4c/f9d to d6/dc/d12/d1a/d4d/df0/f10e 0 2024-02-28T16:02:23.617 INFO:tasks.workunit.client.0.smithi057.stdout:2/866: dread d19/d2c/d65/dda/f114 [0,4194304] 0 2024-02-28T16:02:23.619 INFO:tasks.workunit.client.0.smithi057.stdout:6/917: symlink df/d10/d78/d5b/d7b/de3/l131 0 2024-02-28T16:02:23.620 INFO:tasks.workunit.client.0.smithi057.stdout:0/945: mknod d6/d12/d5d/d7f/c136 0 2024-02-28T16:02:23.623 INFO:tasks.workunit.client.0.smithi057.stdout:6/918: truncate df/d12b/ffa 184700 0 2024-02-28T16:02:23.625 INFO:tasks.workunit.client.0.smithi057.stdout:9/927: mknod d2/d46/d67/d7d/c130 0 2024-02-28T16:02:23.626 INFO:tasks.workunit.client.0.smithi057.stdout:0/946: chown d6/d12/d5d/d71/daa/db6/ff0 17040665 1 2024-02-28T16:02:23.630 INFO:tasks.workunit.client.0.smithi057.stdout:1/913: dwrite d1/d3/dc/d15/f17 [0,4194304] 0 2024-02-28T16:02:23.631 INFO:tasks.workunit.client.0.smithi057.stdout:6/919: unlink df/d61/f99 0 2024-02-28T16:02:23.632 INFO:tasks.workunit.client.0.smithi057.stdout:4/815: dread d1/d10/d31/d36/f47 [0,4194304] 0 2024-02-28T16:02:23.654 INFO:tasks.workunit.client.0.smithi057.stdout:6/920: mkdir df/d10/d10c/d132 0 2024-02-28T16:02:23.658 INFO:tasks.workunit.client.0.smithi057.stdout:5/835: truncate d2/d12/d76/d7a/d95/db5/dcb/d91/fcc 941682 0 2024-02-28T16:02:23.659 INFO:tasks.workunit.client.0.smithi057.stdout:3/790: sync 2024-02-28T16:02:23.665 INFO:tasks.workunit.client.0.smithi057.stdout:1/914: symlink d1/d3/l129 0 2024-02-28T16:02:23.672 INFO:tasks.workunit.client.0.smithi057.stdout:8/847: dread d5/d20/da2/f110 [0,4194304] 0 2024-02-28T16:02:23.672 INFO:tasks.workunit.client.0.smithi057.stdout:1/915: chown d1/d3/dc/d15/da3 3 1 2024-02-28T16:02:23.675 INFO:tasks.workunit.client.0.smithi057.stdout:0/947: dwrite d6/d12/d17/d4b/f122 [0,4194304] 0 2024-02-28T16:02:23.675 INFO:tasks.workunit.client.0.smithi057.stdout:9/928: dread d2/d24/d1d/d104/f7c [4194304,4194304] 0 2024-02-28T16:02:23.676 INFO:tasks.workunit.client.0.smithi057.stdout:6/921: write df/d10/d13/d4b/fbf [738808,109056] 0 2024-02-28T16:02:23.681 INFO:tasks.workunit.client.0.smithi057.stdout:7/780: dwrite d6/dc/fd [0,4194304] 0 2024-02-28T16:02:23.686 INFO:tasks.workunit.client.0.smithi057.stdout:4/816: dread d1/d22/f35 [0,4194304] 0 2024-02-28T16:02:23.691 INFO:tasks.workunit.client.0.smithi057.stdout:1/916: rmdir d1/d21/d66/d53 39 2024-02-28T16:02:23.696 INFO:tasks.workunit.client.0.smithi057.stdout:9/929: mkdir d2/d24/d9c/d131 0 2024-02-28T16:02:23.711 INFO:tasks.workunit.client.0.smithi057.stdout:7/781: fdatasync d6/dc/d12/f8c 0 2024-02-28T16:02:23.713 INFO:tasks.workunit.client.0.smithi057.stdout:0/948: mkdir d6/d12/d38/da3/d137 0 2024-02-28T16:02:23.714 INFO:tasks.workunit.client.0.smithi057.stdout:2/867: dwrite d19/d1d/d2e/d31/f50 [0,4194304] 0 2024-02-28T16:02:23.722 INFO:tasks.workunit.client.0.smithi057.stdout:4/817: write d1/d10/d31/d36/f47 [5559612,76959] 0 2024-02-28T16:02:23.724 INFO:tasks.workunit.client.0.smithi057.stdout:0/949: chown d6/d12/d45/lec 5956 1 2024-02-28T16:02:23.742 INFO:tasks.workunit.client.0.smithi057.stdout:1/917: creat d1/d21/d66/d44/d4c/d75/f12a x:0 0 0 2024-02-28T16:02:23.744 INFO:tasks.workunit.client.0.smithi057.stdout:5/836: dwrite d2/d15/d5e/d6d/fcf [0,4194304] 0 2024-02-28T16:02:23.745 INFO:tasks.workunit.client.0.smithi057.stdout:9/930: fsync d2/d24/d1d/d104/d65/d6e/fe9 0 2024-02-28T16:02:23.747 INFO:tasks.workunit.client.0.smithi057.stdout:8/848: dwrite d5/f31 [0,4194304] 0 2024-02-28T16:02:23.747 INFO:tasks.workunit.client.0.smithi057.stdout:7/782: truncate d6/dc/d67/d9a/da1/f75 344712 0 2024-02-28T16:02:23.756 INFO:tasks.workunit.client.0.smithi057.stdout:0/950: creat d6/d12/d5d/d71/daa/f138 x:0 0 0 2024-02-28T16:02:23.756 INFO:tasks.workunit.client.0.smithi057.stdout:2/868: mkdir d19/d1d/d2e/d124 0 2024-02-28T16:02:23.760 INFO:tasks.workunit.client.0.smithi057.stdout:4/818: dread d1/d3f/d5f/fa5 [0,4194304] 0 2024-02-28T16:02:23.771 INFO:tasks.workunit.client.0.smithi057.stdout:7/783: dread d6/dc/d67/d9a/da1/f73 [0,4194304] 0 2024-02-28T16:02:23.778 INFO:tasks.workunit.client.0.smithi057.stdout:2/869: chown d19/d3a/l74 1 1 2024-02-28T16:02:23.778 INFO:tasks.workunit.client.0.smithi057.stdout:6/922: dread df/d10/d78/dca/d15/d16/f76 [0,4194304] 0 2024-02-28T16:02:23.783 INFO:tasks.workunit.client.0.smithi057.stdout:8/849: mkdir d5/d62/d115 0 2024-02-28T16:02:23.783 INFO:tasks.workunit.client.0.smithi057.stdout:4/819: mkdir d1/d22/d114 0 2024-02-28T16:02:23.786 INFO:tasks.workunit.client.0.smithi057.stdout:8/850: stat d5/d62/d9f 0 2024-02-28T16:02:23.786 INFO:tasks.workunit.client.0.smithi057.stdout:5/837: write d2/d12/d5f/f8d [592915,28642] 0 2024-02-28T16:02:23.788 INFO:tasks.workunit.client.0.smithi057.stdout:6/923: dread - df/d10/d78/dca/d15/d16/d122/f12d zero size 2024-02-28T16:02:23.790 INFO:tasks.workunit.client.0.smithi057.stdout:9/931: write d2/d5/d9/d5d/d82/fab [300669,109503] 0 2024-02-28T16:02:23.791 INFO:tasks.workunit.client.0.smithi057.stdout:5/838: read - d2/f11c zero size 2024-02-28T16:02:23.796 INFO:tasks.workunit.client.0.smithi057.stdout:4/820: symlink d1/l115 0 2024-02-28T16:02:23.800 INFO:tasks.workunit.client.0.smithi057.stdout:8/851: mkdir d5/d6/dff/d116 0 2024-02-28T16:02:23.804 INFO:tasks.workunit.client.0.smithi057.stdout:7/784: dwrite d6/dc/d12/f47 [0,4194304] 0 2024-02-28T16:02:23.808 INFO:tasks.workunit.client.0.smithi057.stdout:1/918: dwrite d1/d21/d66/dc7/fe6 [0,4194304] 0 2024-02-28T16:02:23.816 INFO:tasks.workunit.client.0.smithi057.stdout:4/821: write d1/d10/d12/d2c/d37/d46/dac/de9/d5e/fc6 [5746026,60022] 0 2024-02-28T16:02:23.817 INFO:tasks.workunit.client.0.smithi057.stdout:0/951: dwrite d6/d4e/f33 [0,4194304] 0 2024-02-28T16:02:23.826 INFO:tasks.workunit.client.0.smithi057.stdout:2/870: dwrite d19/d43/d5a/d9b/da3/f8b [0,4194304] 0 2024-02-28T16:02:23.828 INFO:tasks.workunit.client.0.smithi057.stdout:1/919: creat d1/d21/d66/f12b x:0 0 0 2024-02-28T16:02:23.831 INFO:tasks.workunit.client.0.smithi057.stdout:6/924: link df/d10/d13/d4b/d4e/f86 df/d10/d13/d4b/f133 0 2024-02-28T16:02:23.832 INFO:tasks.workunit.client.0.smithi057.stdout:1/920: fdatasync d1/d3/fc6 0 2024-02-28T16:02:23.833 INFO:tasks.workunit.client.0.smithi057.stdout:1/921: chown d1/d21/d66/d44 947 1 2024-02-28T16:02:23.834 INFO:tasks.workunit.client.0.smithi057.stdout:2/871: fdatasync d19/d1d/d2e/d3c/dab/dfc/f106 0 2024-02-28T16:02:23.836 INFO:tasks.workunit.client.0.smithi057.stdout:6/925: mkdir df/d10/d78/dca/d15/d16/d39/d8d/d134 0 2024-02-28T16:02:23.843 INFO:tasks.workunit.client.0.smithi057.stdout:0/952: truncate d6/d12/d5d/d71/d10a/d12d/d135/db8/f127 837501 0 2024-02-28T16:02:23.847 INFO:tasks.workunit.client.0.smithi057.stdout:8/852: write d5/d20/f83 [3843956,70164] 0 2024-02-28T16:02:23.852 INFO:tasks.workunit.client.0.smithi057.stdout:0/953: mknod d6/d12/d5d/d71/d10a/d12d/d135/d95/c139 0 2024-02-28T16:02:23.857 INFO:tasks.workunit.client.0.smithi057.stdout:4/822: write d1/d10/f71 [573849,22903] 0 2024-02-28T16:02:23.859 INFO:tasks.workunit.client.0.smithi057.stdout:2/872: write d19/d1d/d2e/f90 [1481501,117552] 0 2024-02-28T16:02:23.863 INFO:tasks.workunit.client.0.smithi057.stdout:1/922: getdents d1/d21/d66/d53/d7d/d67/d6c/d82/d112 0 2024-02-28T16:02:23.864 INFO:tasks.workunit.client.0.smithi057.stdout:0/954: chown d6/d12/d5d/cba 0 1 2024-02-28T16:02:23.865 INFO:tasks.workunit.client.0.smithi057.stdout:8/853: symlink d5/de/d1b/d45/d81/dae/l117 0 2024-02-28T16:02:23.869 INFO:tasks.workunit.client.0.smithi057.stdout:9/932: dwrite d2/d5/d9/d64/d78/f12b [0,4194304] 0 2024-02-28T16:02:23.876 INFO:tasks.workunit.client.0.smithi057.stdout:6/926: dwrite df/d10/d78/d5b/d7b/f8c [0,4194304] 0 2024-02-28T16:02:23.919 INFO:tasks.workunit.client.0.smithi057.stdout:4/823: truncate d1/d10/fa4 216184 0 2024-02-28T16:02:23.925 INFO:tasks.workunit.client.0.smithi057.stdout:9/933: creat d2/d5/d9/d5d/dd7/f132 x:0 0 0 2024-02-28T16:02:23.926 INFO:tasks.workunit.client.0.smithi057.stdout:5/839: dwrite d2/d12/d76/d7a/d95/db5/dce/f118 [4194304,4194304] 0 2024-02-28T16:02:23.926 INFO:tasks.workunit.client.0.smithi057.stdout:6/927: read - df/d10/d13/d70/feb zero size 2024-02-28T16:02:23.938 INFO:tasks.workunit.client.0.smithi057.stdout:2/873: read d19/d1d/d2e/d3c/dab/faf [243701,77117] 0 2024-02-28T16:02:23.938 INFO:tasks.workunit.client.0.smithi057.stdout:9/934: readlink d2/d5/l52 0 2024-02-28T16:02:23.938 INFO:tasks.workunit.client.0.smithi057.stdout:4/824: mkdir d1/d10/d31/d86/dd1/d116 0 2024-02-28T16:02:23.940 INFO:tasks.workunit.client.0.smithi057.stdout:4/825: chown d1/d3f 7824 1 2024-02-28T16:02:23.943 INFO:tasks.workunit.client.0.smithi057.stdout:5/840: creat d2/d12/d76/d7a/d95/db5/f120 x:0 0 0 2024-02-28T16:02:23.944 INFO:tasks.workunit.client.0.smithi057.stdout:6/928: truncate df/d10/d78/d5b/d7b/de3/ffb 7346739 0 2024-02-28T16:02:23.945 INFO:tasks.workunit.client.0.smithi057.stdout:0/955: dwrite d6/fd7 [0,4194304] 0 2024-02-28T16:02:23.946 INFO:tasks.workunit.client.0.smithi057.stdout:2/874: mkdir d19/d43/ddd/d125 0 2024-02-28T16:02:23.950 INFO:tasks.workunit.client.0.smithi057.stdout:9/935: creat d2/d24/d1d/d104/d65/f133 x:0 0 0 2024-02-28T16:02:23.952 INFO:tasks.workunit.client.0.smithi057.stdout:0/956: write d6/d12/d17/d4b/f8f [303213,102863] 0 2024-02-28T16:02:23.952 INFO:tasks.workunit.client.0.smithi057.stdout:6/929: stat df/d10/d78/dca/d15/d82/l10b 0 2024-02-28T16:02:23.956 INFO:tasks.workunit.client.0.smithi057.stdout:4/826: creat d1/d10/d12/d2c/d37/f117 x:0 0 0 2024-02-28T16:02:23.958 INFO:tasks.workunit.client.0.smithi057.stdout:5/841: truncate d2/d12/d76/d7b/f10b 98184 0 2024-02-28T16:02:23.959 INFO:tasks.workunit.client.0.smithi057.stdout:8/854: dwrite d5/d20/d39/dd9/f114 [0,4194304] 0 2024-02-28T16:02:23.959 INFO:tasks.workunit.client.0.smithi057.stdout:9/936: write d2/d24/f111 [237694,3900] 0 2024-02-28T16:02:23.961 INFO:tasks.workunit.client.0.smithi057.stdout:6/930: chown df/d10/la9 1041 1 2024-02-28T16:02:23.972 INFO:tasks.workunit.client.0.smithi057.stdout:9/937: mknod d2/d62/d11b/c134 0 2024-02-28T16:02:23.973 INFO:tasks.workunit.client.0.smithi057.stdout:6/931: chown df/d10/d78/dca/dd0/c106 54232 1 2024-02-28T16:02:23.973 INFO:tasks.workunit.client.0.smithi057.stdout:8/855: write d5/d20/d39/fb9 [392074,87338] 0 2024-02-28T16:02:23.973 INFO:tasks.workunit.client.0.smithi057.stdout:0/957: creat d6/d12/d17/d34/db7/f13a x:0 0 0 2024-02-28T16:02:23.981 INFO:tasks.workunit.client.0.smithi057.stdout:0/958: fsync d6/d12/d17/d34/f63 0 2024-02-28T16:02:23.985 INFO:tasks.workunit.client.0.smithi057.stdout:6/932: fsync df/d10/d78/dca/f2d 0 2024-02-28T16:02:23.987 INFO:tasks.workunit.client.0.smithi057.stdout:9/938: getdents d2/d92/d115 0 2024-02-28T16:02:23.988 INFO:tasks.workunit.client.0.smithi057.stdout:5/842: dwrite d2/d15/d5e/d7f/f88 [0,4194304] 0 2024-02-28T16:02:23.992 INFO:tasks.workunit.client.0.smithi057.stdout:5/843: dread - d2/d12/fc4 zero size 2024-02-28T16:02:23.994 INFO:tasks.workunit.client.0.smithi057.stdout:0/959: rename d6/d12/d45/d78/f81 to d6/d12/d38/d5e/f13b 0 2024-02-28T16:02:24.000 INFO:tasks.workunit.client.0.smithi057.stdout:8/856: getdents d5/d20/d39/d59/d67 0 2024-02-28T16:02:24.000 INFO:tasks.workunit.client.0.smithi057.stdout:9/939: mknod d2/d5/d9/d120/c135 0 2024-02-28T16:02:24.000 INFO:tasks.workunit.client.0.smithi057.stdout:5/844: write d2/d15/d5e/d6d/fcf [2110752,66504] 0 2024-02-28T16:02:24.004 INFO:tasks.workunit.client.0.smithi057.stdout:8/857: dread - d5/d6/f88 zero size 2024-02-28T16:02:24.008 INFO:tasks.workunit.client.0.smithi057.stdout:0/960: truncate d6/d12/d17/d34/db7/f13a 803398 0 2024-02-28T16:02:24.008 INFO:tasks.workunit.client.0.smithi057.stdout:4/827: dwrite d1/d10/d12/d2c/d37/d46/dac/de9/d87/f98 [0,4194304] 0 2024-02-28T16:02:24.012 INFO:tasks.workunit.client.0.smithi057.stdout:2/875: dread d19/d2c/d48/f75 [0,4194304] 0 2024-02-28T16:02:24.012 INFO:tasks.workunit.client.0.smithi057.stdout:5/845: creat d2/d12/d76/d7b/d62/f121 x:0 0 0 2024-02-28T16:02:24.012 INFO:tasks.workunit.client.0.smithi057.stdout:4/828: read - d1/d10/d31/d86/dd1/ff3 zero size 2024-02-28T16:02:24.014 INFO:tasks.workunit.client.0.smithi057.stdout:9/940: creat d2/d24/d1d/d104/f136 x:0 0 0 2024-02-28T16:02:24.017 INFO:tasks.workunit.client.0.smithi057.stdout:0/961: creat d6/d12/d5d/d71/d10a/d12d/d135/d95/daf/f13c x:0 0 0 2024-02-28T16:02:24.018 INFO:tasks.workunit.client.0.smithi057.stdout:6/933: dread df/d10/d78/dca/d15/d16/f76 [0,4194304] 0 2024-02-28T16:02:24.019 INFO:tasks.workunit.client.0.smithi057.stdout:2/876: write d19/d2c/d48/fba [2692127,15964] 0 2024-02-28T16:02:24.021 INFO:tasks.workunit.client.0.smithi057.stdout:4/829: readlink d1/d10/d12/d2c/d37/d46/l111 0 2024-02-28T16:02:24.021 INFO:tasks.workunit.client.0.smithi057.stdout:3/791: sync 2024-02-28T16:02:24.023 INFO:tasks.workunit.client.0.smithi057.stdout:5/846: dread d2/d15/d5e/d67/f107 [0,4194304] 0 2024-02-28T16:02:24.023 INFO:tasks.workunit.client.0.smithi057.stdout:2/877: fsync d19/d1d/d2e/d3c/dab/f10c 0 2024-02-28T16:02:24.024 INFO:tasks.workunit.client.0.smithi057.stdout:9/941: chown d2/d5/d1b/d2e/d4c/da0/da7/d117 2469476 1 2024-02-28T16:02:24.024 INFO:tasks.workunit.client.0.smithi057.stdout:6/934: write df/d10/f123 [193236,94060] 0 2024-02-28T16:02:24.028 INFO:tasks.workunit.client.0.smithi057.stdout:3/792: chown d8/dd/d14/d2c/f53 278 1 2024-02-28T16:02:24.030 INFO:tasks.workunit.client.0.smithi057.stdout:3/793: dread - d8/d94/fda zero size 2024-02-28T16:02:24.031 INFO:tasks.workunit.client.0.smithi057.stdout:2/878: dread d19/d2c/d48/da2/fca [0,4194304] 0 2024-02-28T16:02:24.031 INFO:tasks.workunit.client.0.smithi057.stdout:0/962: truncate d6/d12/d38/f5c 2078116 0 2024-02-28T16:02:24.033 INFO:tasks.workunit.client.0.smithi057.stdout:9/942: write d2/d5/d9/d5d/d82/fab [1283701,98807] 0 2024-02-28T16:02:24.033 INFO:tasks.workunit.client.0.smithi057.stdout:3/794: write d8/dd/f1f [2912165,37623] 0 2024-02-28T16:02:24.035 INFO:tasks.workunit.client.0.smithi057.stdout:2/879: dread - d19/d34/f119 zero size 2024-02-28T16:02:24.036 INFO:tasks.workunit.client.0.smithi057.stdout:0/963: stat d6/d12/d45/d55/de3/l104 0 2024-02-28T16:02:24.037 INFO:tasks.workunit.client.0.smithi057.stdout:5/847: mknod d2/d12/d76/d7a/d95/db5/c122 0 2024-02-28T16:02:24.040 INFO:tasks.workunit.client.0.smithi057.stdout:5/848: chown d2/d12/d3d/da4/ld7 50184 1 2024-02-28T16:02:24.040 INFO:tasks.workunit.client.0.smithi057.stdout:2/880: write d19/d1d/d26/fc0 [3577620,31108] 0 2024-02-28T16:02:24.041 INFO:tasks.workunit.client.0.smithi057.stdout:8/858: write d5/de/d1b/f6f [4691034,105656] 0 2024-02-28T16:02:24.044 INFO:tasks.workunit.client.0.smithi057.stdout:3/795: truncate d8/dd/d14/d2e/d30/d49/d51/f109 776104 0 2024-02-28T16:02:24.046 INFO:tasks.workunit.client.0.smithi057.stdout:4/830: symlink d1/d10/d108/l118 0 2024-02-28T16:02:24.049 INFO:tasks.workunit.client.0.smithi057.stdout:2/881: unlink d19/d1d/d2e/de2/lf6 0 2024-02-28T16:02:24.054 INFO:tasks.workunit.client.0.smithi057.stdout:9/943: write d2/d24/d1d/d104/dc3/fd9 [640089,24610] 0 2024-02-28T16:02:24.056 INFO:tasks.workunit.client.0.smithi057.stdout:8/859: symlink d5/d20/d39/d49/d56/d79/dfc/d70/l118 0 2024-02-28T16:02:24.060 INFO:tasks.workunit.client.0.smithi057.stdout:5/849: rename d2/d12/dd3/c115 to d2/d15/d63/de7/c123 0 2024-02-28T16:02:24.060 INFO:tasks.workunit.client.0.smithi057.stdout:0/964: link d6/d12/d5d/c87 d6/d12/d17/d4b/de5/c13d 0 2024-02-28T16:02:24.063 INFO:tasks.workunit.client.0.smithi057.stdout:0/965: stat d6/d12/d17/d4b/d60/lca 0 2024-02-28T16:02:24.066 INFO:tasks.workunit.client.0.smithi057.stdout:8/860: mkdir d5/d20/d39/d59/d67/da5/df8/d10c/d119 0 2024-02-28T16:02:24.068 INFO:tasks.workunit.client.0.smithi057.stdout:4/831: getdents d1/d10/d12/d2c/d37/d46/dac 0 2024-02-28T16:02:24.069 INFO:tasks.workunit.client.0.smithi057.stdout:8/861: fdatasync d5/d20/d39/dd9/f114 0 2024-02-28T16:02:24.074 INFO:tasks.workunit.client.0.smithi057.stdout:5/850: creat d2/d15/d5e/d9a/dac/f124 x:0 0 0 2024-02-28T16:02:24.075 INFO:tasks.workunit.client.0.smithi057.stdout:9/944: dread d2/d24/d1d/d104/d65/f15 [0,4194304] 0 2024-02-28T16:02:24.077 INFO:tasks.workunit.client.0.smithi057.stdout:4/832: truncate d1/d22/fa3 36070 0 2024-02-28T16:02:24.080 INFO:tasks.workunit.client.0.smithi057.stdout:3/796: dread d8/dd/d14/d2c/f33 [0,4194304] 0 2024-02-28T16:02:24.084 INFO:tasks.workunit.client.0.smithi057.stdout:0/966: creat d6/d12/d17/d4b/d60/f13e x:0 0 0 2024-02-28T16:02:24.084 INFO:tasks.workunit.client.0.smithi057.stdout:9/945: dread d2/d24/d9c/ddd/f107 [0,4194304] 0 2024-02-28T16:02:24.084 INFO:tasks.workunit.client.0.smithi057.stdout:8/862: mkdir d5/d62/d11a 0 2024-02-28T16:02:24.086 INFO:tasks.workunit.client.0.smithi057.stdout:5/851: symlink d2/d15/d5e/l125 0 2024-02-28T16:02:24.086 INFO:tasks.workunit.client.0.smithi057.stdout:8/863: chown d5/de/d1b/d45/f4e 1507 1 2024-02-28T16:02:24.086 INFO:tasks.workunit.client.0.smithi057.stdout:9/946: write d2/d5/d9/d5d/dd7/f106 [998786,118559] 0 2024-02-28T16:02:24.087 INFO:tasks.workunit.client.0.smithi057.stdout:3/797: write d8/d4b/dd2/fdc [3999087,56733] 0 2024-02-28T16:02:24.092 INFO:tasks.workunit.client.0.smithi057.stdout:0/967: rename d6/d12/d38/f5c to d6/d12/d38/da3/d137/f13f 0 2024-02-28T16:02:24.093 INFO:tasks.workunit.client.0.smithi057.stdout:5/852: creat d2/d12/d76/d7b/d62/f126 x:0 0 0 2024-02-28T16:02:24.095 INFO:tasks.workunit.client.0.smithi057.stdout:3/798: fsync d8/dd/d14/d2e/d3b/d54/f99 0 2024-02-28T16:02:24.098 INFO:tasks.workunit.client.0.smithi057.stdout:0/968: symlink d6/d12/d5d/d71/d10a/d12d/d135/db8/l140 0 2024-02-28T16:02:24.101 INFO:tasks.workunit.client.0.smithi057.stdout:3/799: write d8/dd/d14/d2c/db9/fc2 [144763,117319] 0 2024-02-28T16:02:24.101 INFO:tasks.workunit.client.0.smithi057.stdout:8/864: rename d5/de/d1b/d57/d85/fd7 to d5/d20/d39/d49/f11b 0 2024-02-28T16:02:24.108 INFO:tasks.workunit.client.0.smithi057.stdout:5/853: link d2/d19/d1c/l9e d2/d12/d76/d7b/d62/l127 0 2024-02-28T16:02:24.109 INFO:tasks.workunit.client.0.smithi057.stdout:3/800: mknod d8/dd/c113 0 2024-02-28T16:02:24.111 INFO:tasks.workunit.client.0.smithi057.stdout:8/865: mkdir d5/d20/d39/d59/db7/dea/d11c 0 2024-02-28T16:02:24.114 INFO:tasks.workunit.client.0.smithi057.stdout:8/866: write d5/f105 [690746,125825] 0 2024-02-28T16:02:24.114 INFO:tasks.workunit.client.0.smithi057.stdout:5/854: creat d2/d12/d76/d7a/f128 x:0 0 0 2024-02-28T16:02:24.117 INFO:tasks.workunit.client.0.smithi057.stdout:9/947: dwrite d2/d5/dd3/ffe [0,4194304] 0 2024-02-28T16:02:24.120 INFO:tasks.workunit.client.0.smithi057.stdout:4/833: dread d1/d10/d31/f7e [0,4194304] 0 2024-02-28T16:02:24.127 INFO:tasks.workunit.client.0.smithi057.stdout:4/834: fsync d1/d10/d31/d86/dd1/ff3 0 2024-02-28T16:02:24.128 INFO:tasks.workunit.client.0.smithi057.stdout:3/801: write d8/f74 [801697,12587] 0 2024-02-28T16:02:24.128 INFO:tasks.workunit.client.0.smithi057.stdout:9/948: rmdir d2/d24/d1d/d104/d65 39 2024-02-28T16:02:24.135 INFO:tasks.workunit.client.0.smithi057.stdout:8/867: dread d5/d20/d39/d6e/fca [0,4194304] 0 2024-02-28T16:02:24.138 INFO:tasks.workunit.client.0.smithi057.stdout:9/949: stat d2/d5/l7 0 2024-02-28T16:02:24.142 INFO:tasks.workunit.client.0.smithi057.stdout:3/802: write d8/dd/d14/d2c/f4c [8890169,27405] 0 2024-02-28T16:02:24.143 INFO:tasks.workunit.client.0.smithi057.stdout:4/835: mknod d1/d10/d31/d36/c119 0 2024-02-28T16:02:24.143 INFO:tasks.workunit.client.0.smithi057.stdout:0/969: dwrite d6/d12/d38/d5e/f48 [4194304,4194304] 0 2024-02-28T16:02:24.143 INFO:tasks.workunit.client.0.smithi057.stdout:5/855: dwrite d2/d15/d5e/f112 [0,4194304] 0 2024-02-28T16:02:24.150 INFO:tasks.workunit.client.0.smithi057.stdout:3/803: mkdir d8/d4b/dd2/ddd/d114 0 2024-02-28T16:02:24.151 INFO:tasks.workunit.client.0.smithi057.stdout:5/856: symlink d2/d15/d5e/d7f/l129 0 2024-02-28T16:02:24.154 INFO:tasks.workunit.client.0.smithi057.stdout:5/857: chown d2/ddc/fe3 30 1 2024-02-28T16:02:24.161 INFO:tasks.workunit.client.0.smithi057.stdout:5/858: write d2/d12/d76/d7a/d95/db5/dce/f118 [3188005,44400] 0 2024-02-28T16:02:24.163 INFO:tasks.workunit.client.0.smithi057.stdout:8/868: link d5/d20/d39/d49/d56/d79/dfc/fad d5/d20/d39/d49/d56/d79/dfc/d70/f11d 0 2024-02-28T16:02:24.163 INFO:tasks.workunit.client.0.smithi057.stdout:7/785: sync 2024-02-28T16:02:24.164 INFO:tasks.workunit.client.0.smithi057.stdout:7/786: readlink d6/lb7 0 2024-02-28T16:02:24.168 INFO:tasks.workunit.client.0.smithi057.stdout:3/804: rename d8/d26/c4f to d8/dd/d14/d2e/d2f/da2/c115 0 2024-02-28T16:02:24.168 INFO:tasks.workunit.client.0.smithi057.stdout:5/859: write d2/d3e/d5b/f94 [255707,82945] 0 2024-02-28T16:02:24.168 INFO:tasks.workunit.client.0.smithi057.stdout:0/970: write d6/d12/d45/dab/fb9 [117386,33352] 0 2024-02-28T16:02:24.169 INFO:tasks.workunit.client.0.smithi057.stdout:9/950: dwrite d2/d46/d67/fdc [0,4194304] 0 2024-02-28T16:02:24.180 INFO:tasks.workunit.client.0.smithi057.stdout:3/805: dread - d8/dd/d14/d2e/d30/d49/fec zero size 2024-02-28T16:02:24.180 INFO:tasks.workunit.client.0.smithi057.stdout:4/836: rename d1/d10/d12/d2c/d50/d93/fa7 to d1/d10/d31/d86/dd1/d10c/f11a 0 2024-02-28T16:02:24.180 INFO:tasks.workunit.client.0.smithi057.stdout:4/837: stat d1/d10/d31/f6b 0 2024-02-28T16:02:24.185 INFO:tasks.workunit.client.0.smithi057.stdout:0/971: mknod d6/d12/d17/d34/de2/c141 0 2024-02-28T16:02:24.185 INFO:tasks.workunit.client.0.smithi057.stdout:5/860: creat d2/d12/d76/d7b/d62/da3/f12a x:0 0 0 2024-02-28T16:02:24.185 INFO:tasks.workunit.client.0.smithi057.stdout:9/951: creat d2/d5/dd3/f137 x:0 0 0 2024-02-28T16:02:24.188 INFO:tasks.workunit.client.0.smithi057.stdout:7/787: creat d6/dc/d35/d58/f10f x:0 0 0 2024-02-28T16:02:24.191 INFO:tasks.workunit.client.0.smithi057.stdout:0/972: unlink d6/d12/d5d/d7f/ca1 0 2024-02-28T16:02:24.197 INFO:tasks.workunit.client.0.smithi057.stdout:9/952: mkdir d2/d24/d1d/d138 0 2024-02-28T16:02:24.198 INFO:tasks.workunit.client.0.smithi057.stdout:3/806: creat d8/d4b/dd2/ddd/d114/f116 x:0 0 0 2024-02-28T16:02:24.199 INFO:tasks.workunit.client.0.smithi057.stdout:5/861: mkdir d2/d12/d3d/d8a/de1/d12b 0 2024-02-28T16:02:24.202 INFO:tasks.workunit.client.0.smithi057.stdout:9/953: fdatasync d2/d24/d1d/f7b 0 2024-02-28T16:02:24.205 INFO:tasks.workunit.client.0.smithi057.stdout:0/973: rename d6/d12/d17/d34/f8a to d6/d12/d5d/d7f/f142 0 2024-02-28T16:02:24.207 INFO:tasks.workunit.client.0.smithi057.stdout:3/807: creat d8/dd/d14/d2e/d2f/f117 x:0 0 0 2024-02-28T16:02:24.210 INFO:tasks.workunit.client.0.smithi057.stdout:3/808: symlink d8/d26/l118 0 2024-02-28T16:02:24.210 INFO:tasks.workunit.client.0.smithi057.stdout:0/974: chown d6/d12/d45/d78/f90 11911658 1 2024-02-28T16:02:24.211 INFO:tasks.workunit.client.0.smithi057.stdout:9/954: stat d2/d5/d9/d5d/d70/c124 0 2024-02-28T16:02:24.212 INFO:tasks.workunit.client.0.smithi057.stdout:7/788: dwrite d6/d38/ff1 [0,4194304] 0 2024-02-28T16:02:24.217 INFO:tasks.workunit.client.0.smithi057.stdout:5/862: rename d2/d12/d76/d7b to d2/d12/d76/d7a/d95/db5/dcb/dab/d12c 0 2024-02-28T16:02:24.218 INFO:tasks.workunit.client.0.smithi057.stdout:8/869: dread d5/de/d1b/d57/d91/de9/fed [0,4194304] 0 2024-02-28T16:02:24.219 INFO:tasks.workunit.client.0.smithi057.stdout:9/955: rmdir d2/d5/d1b/d2e/d77 39 2024-02-28T16:02:24.224 INFO:tasks.workunit.client.0.smithi057.stdout:8/870: write d5/de/f10 [8191133,101292] 0 2024-02-28T16:02:24.224 INFO:tasks.workunit.client.0.smithi057.stdout:0/975: unlink d6/d12/d45/d55/de3/f118 0 2024-02-28T16:02:24.230 INFO:tasks.workunit.client.0.smithi057.stdout:9/956: symlink d2/d5/dd8/l139 0 2024-02-28T16:02:24.236 INFO:tasks.workunit.client.0.smithi057.stdout:7/789: dwrite d6/dc/d67/f8a [0,4194304] 0 2024-02-28T16:02:24.238 INFO:tasks.workunit.client.0.smithi057.stdout:5/863: mkdir d2/d12d 0 2024-02-28T16:02:24.238 INFO:tasks.workunit.client.0.smithi057.stdout:7/790: fdatasync d6/d26/f50 0 2024-02-28T16:02:24.241 INFO:tasks.workunit.client.0.smithi057.stdout:9/957: creat d2/d5/dff/f13a x:0 0 0 2024-02-28T16:02:24.244 INFO:tasks.workunit.client.0.smithi057.stdout:9/958: dread - d2/d5/dd3/f137 zero size 2024-02-28T16:02:24.244 INFO:tasks.workunit.client.0.smithi057.stdout:3/809: link d8/dd/d19/c9b d8/dd/d14/d2e/d30/c119 0 2024-02-28T16:02:24.247 INFO:tasks.workunit.client.0.smithi057.stdout:5/864: truncate d2/d15/d5e/d6d/f81 3489575 0 2024-02-28T16:02:24.253 INFO:tasks.workunit.client.0.smithi057.stdout:3/810: unlink d8/dd/d14/d2e/d30/d5f/d6b/lab 0 2024-02-28T16:02:24.255 INFO:tasks.workunit.client.0.smithi057.stdout:9/959: chown d2/d24/d1d/d104/d65/d6e/c122 1294246006 1 2024-02-28T16:02:24.258 INFO:tasks.workunit.client.0.smithi057.stdout:8/871: link d5/d20/d39/d49/d56/d79/dfc/d70/l118 d5/d62/l11e 0 2024-02-28T16:02:24.261 INFO:tasks.workunit.client.0.smithi057.stdout:7/791: rename d6/dc/d12/d1a/d4d/d56/db0/fff to d6/dc/d12/d1a/d4c/d63/f110 0 2024-02-28T16:02:24.262 INFO:tasks.workunit.client.0.smithi057.stdout:9/960: fdatasync d2/d5/d1b/fba 0 2024-02-28T16:02:24.262 INFO:tasks.workunit.client.0.smithi057.stdout:0/976: dwrite d6/d12/d17/d34/de2/ff6 [0,4194304] 0 2024-02-28T16:02:24.267 INFO:tasks.workunit.client.0.smithi057.stdout:0/977: chown d6/d12/d17/f3b 385276 1 2024-02-28T16:02:24.274 INFO:tasks.workunit.client.0.smithi057.stdout:8/872: creat d5/de/d1b/d57/d9e/f11f x:0 0 0 2024-02-28T16:02:24.275 INFO:tasks.workunit.client.0.smithi057.stdout:7/792: truncate d6/f28 509921 0 2024-02-28T16:02:24.277 INFO:tasks.workunit.client.0.smithi057.stdout:9/961: mkdir d2/d13b 0 2024-02-28T16:02:24.283 INFO:tasks.workunit.client.0.smithi057.stdout:8/873: creat d5/d62/d115/f120 x:0 0 0 2024-02-28T16:02:24.288 INFO:tasks.workunit.client.0.smithi057.stdout:9/962: write d2/d24/d1d/d104/d65/f73 [4652602,89351] 0 2024-02-28T16:02:24.289 INFO:tasks.workunit.client.0.smithi057.stdout:7/793: mkdir d6/dc/d35/d58/d111 0 2024-02-28T16:02:24.289 INFO:tasks.workunit.client.0.smithi057.stdout:9/963: chown d2/d46/c6c 0 1 2024-02-28T16:02:24.289 INFO:tasks.workunit.client.0.smithi057.stdout:8/874: symlink d5/d20/l121 0 2024-02-28T16:02:24.293 INFO:tasks.workunit.client.0.smithi057.stdout:9/964: creat d2/d46/d67/f13c x:0 0 0 2024-02-28T16:02:24.296 INFO:tasks.workunit.client.0.smithi057.stdout:7/794: truncate d6/dc/d35/db2/fea 905786 0 2024-02-28T16:02:24.303 INFO:tasks.workunit.client.0.smithi057.stdout:7/795: unlink d6/dc/d12/d1a/d90/fc0 0 2024-02-28T16:02:24.304 INFO:tasks.workunit.client.0.smithi057.stdout:5/865: dwrite d2/ddc/feb [0,4194304] 0 2024-02-28T16:02:24.306 INFO:tasks.workunit.client.0.smithi057.stdout:3/811: dwrite d8/dd/d14/d2e/d30/d49/d51/d66/f79 [0,4194304] 0 2024-02-28T16:02:24.310 INFO:tasks.workunit.client.0.smithi057.stdout:9/965: write d2/d5/d1b/d2e/d4c/fe0 [786114,122844] 0 2024-02-28T16:02:24.314 INFO:tasks.workunit.client.0.smithi057.stdout:3/812: truncate d8/d94/fda 804547 0 2024-02-28T16:02:24.316 INFO:tasks.workunit.client.0.smithi057.stdout:8/875: dwrite d5/d20/d39/d6e/daf/fdc [0,4194304] 0 2024-02-28T16:02:24.318 INFO:tasks.workunit.client.0.smithi057.stdout:5/866: mknod d2/d12/d76/d7a/d95/db5/dcb/dab/d12c/d62/da3/c12e 0 2024-02-28T16:02:24.319 INFO:tasks.workunit.client.0.smithi057.stdout:7/796: dread d6/dc/d12/d1a/d90/fb4 [0,4194304] 0 2024-02-28T16:02:24.321 INFO:tasks.workunit.client.0.smithi057.stdout:9/966: fdatasync d2/d5/d9/d5d/d70/feb 0 2024-02-28T16:02:24.322 INFO:tasks.workunit.client.0.smithi057.stdout:3/813: mkdir d8/dd/d14/d2e/d30/d5f/d6b/d11a 0 2024-02-28T16:02:24.325 INFO:tasks.workunit.client.0.smithi057.stdout:5/867: creat d2/d15/d5e/d9a/dac/f12f x:0 0 0 2024-02-28T16:02:24.327 INFO:tasks.workunit.client.0.smithi057.stdout:3/814: chown d8/dd/d14/d2e/d2f/da2/fe1 14 1 2024-02-28T16:02:24.329 INFO:tasks.workunit.client.0.smithi057.stdout:8/876: creat d5/d20/dbe/f122 x:0 0 0 2024-02-28T16:02:24.337 INFO:tasks.workunit.client.0.smithi057.stdout:8/877: write d5/d20/da2/d8d/fd6 [1024501,26248] 0 2024-02-28T16:02:24.341 INFO:tasks.workunit.client.0.smithi057.stdout:8/878: read d5/f2f [162297,142] 0 2024-02-28T16:02:24.344 INFO:tasks.workunit.client.0.smithi057.stdout:6/935: sync 2024-02-28T16:02:24.344 INFO:tasks.workunit.client.0.smithi057.stdout:1/923: sync 2024-02-28T16:02:24.347 INFO:tasks.workunit.client.0.smithi057.stdout:8/879: stat d5/d20/d39/d59/db7/dcc/lda 0 2024-02-28T16:02:24.355 INFO:tasks.workunit.client.0.smithi057.stdout:1/924: write d1/f7 [3307818,1283] 0 2024-02-28T16:02:24.356 INFO:tasks.workunit.client.0.smithi057.stdout:3/815: dwrite d8/dd/d14/d2e/d30/d5f/fee [0,4194304] 0 2024-02-28T16:02:24.360 INFO:tasks.workunit.client.0.smithi057.stdout:6/936: truncate df/f12 2523093 0 2024-02-28T16:02:24.362 INFO:tasks.workunit.client.0.smithi057.stdout:3/816: dread - d8/dd/d14/d2e/d76/fe4 zero size 2024-02-28T16:02:24.373 INFO:tasks.workunit.client.0.smithi057.stdout:7/797: dread d6/dc/f34 [0,4194304] 0 2024-02-28T16:02:24.375 INFO:tasks.workunit.client.0.smithi057.stdout:6/937: chown df/f12 791258 1 2024-02-28T16:02:24.375 INFO:tasks.workunit.client.0.smithi057.stdout:3/817: stat d8/dd/d14/d2e/d30/d49/d51/d66/l81 0 2024-02-28T16:02:24.379 INFO:tasks.workunit.client.0.smithi057.stdout:7/798: fsync d6/dc/d35/da6/faf 0 2024-02-28T16:02:24.382 INFO:tasks.workunit.client.0.smithi057.stdout:5/868: dread d2/d8/f57 [0,4194304] 0 2024-02-28T16:02:24.384 INFO:tasks.workunit.client.0.smithi057.stdout:1/925: dread d1/d21/d66/d53/d7d/d65/f5c [0,4194304] 0 2024-02-28T16:02:24.386 INFO:tasks.workunit.client.0.smithi057.stdout:9/967: dwrite d2/d5/d9/d5d/d70/feb [0,4194304] 0 2024-02-28T16:02:24.387 INFO:tasks.workunit.client.0.smithi057.stdout:3/818: mknod d8/dd/d14/d2e/d2f/c11b 0 2024-02-28T16:02:24.390 INFO:tasks.workunit.client.0.smithi057.stdout:1/926: chown d1/d21/d66/d53/d7d/d67/d7a 1254531537 1 2024-02-28T16:02:24.391 INFO:tasks.workunit.client.0.smithi057.stdout:5/869: write d2/d15/f43 [1678945,58043] 0 2024-02-28T16:02:24.493 INFO:tasks.workunit.client.0.smithi057.stdout:6/938: rename df/d10/d13/l28 to df/d10/d78/dca/d15/d16/d39/d92/d11c/l135 0 2024-02-28T16:02:24.495 INFO:tasks.workunit.client.0.smithi057.stdout:9/968: dread - d2/d5/d1b/d2e/d4c/f10a zero size 2024-02-28T16:02:24.496 INFO:tasks.workunit.client.0.smithi057.stdout:3/819: creat d8/dd/d14/d2e/d30/d5f/d6b/f11c x:0 0 0 2024-02-28T16:02:24.499 INFO:tasks.workunit.client.0.smithi057.stdout:6/939: mkdir df/d61/dbb/d136 0 2024-02-28T16:02:24.501 INFO:tasks.workunit.client.0.smithi057.stdout:8/880: dread d5/d6/fd [0,4194304] 0 2024-02-28T16:02:24.506 INFO:tasks.workunit.client.0.smithi057.stdout:6/940: creat df/d10/d13/d4b/dcc/d11f/f137 x:0 0 0 2024-02-28T16:02:24.507 INFO:tasks.workunit.client.0.smithi057.stdout:5/870: truncate d2/d19/fe9 2917929 0 2024-02-28T16:02:24.510 INFO:tasks.workunit.client.0.smithi057.stdout:3/820: dread d8/dd/d14/d2e/d30/d5f/d6b/fd5 [0,4194304] 0 2024-02-28T16:02:24.514 INFO:tasks.workunit.client.0.smithi057.stdout:8/881: rename d5/d62/f76 to d5/d20/d39/d59/db7/f123 0 2024-02-28T16:02:24.519 INFO:tasks.workunit.client.0.smithi057.stdout:3/821: rmdir d8/dd/df2 0 2024-02-28T16:02:24.522 INFO:tasks.workunit.client.0.smithi057.stdout:3/822: stat d8/d26/l92 0 2024-02-28T16:02:24.525 INFO:tasks.workunit.client.0.smithi057.stdout:1/927: dread d1/d3/dc/d15/da3/fbd [0,4194304] 0 2024-02-28T16:02:24.525 INFO:tasks.workunit.client.0.smithi057.stdout:8/882: chown d5/d20/d39/d49/d56/d84/l86 0 1 2024-02-28T16:02:24.530 INFO:tasks.workunit.client.0.smithi057.stdout:6/941: dwrite df/d61/ff4 [0,4194304] 0 2024-02-28T16:02:24.531 INFO:tasks.workunit.client.0.smithi057.stdout:9/969: dread d2/d5/d1b/d2e/d77/f8e [0,4194304] 0 2024-02-28T16:02:24.534 INFO:tasks.workunit.client.0.smithi057.stdout:1/928: creat d1/d21/d66/d53/d7d/d67/d6c/d82/f12c x:0 0 0 2024-02-28T16:02:24.536 INFO:tasks.workunit.client.0.smithi057.stdout:3/823: truncate d8/d94/fda 319861 0 2024-02-28T16:02:24.538 INFO:tasks.workunit.client.0.smithi057.stdout:9/970: mknod d2/d24/d9c/d131/c13d 0 2024-02-28T16:02:24.539 INFO:tasks.workunit.client.0.smithi057.stdout:1/929: creat d1/d21/d25/df7/f12d x:0 0 0 2024-02-28T16:02:24.540 INFO:tasks.workunit.client.0.smithi057.stdout:8/883: getdents d5/d20/d39/d59/d67/da5 0 2024-02-28T16:02:24.540 INFO:tasks.workunit.client.0.smithi057.stdout:3/824: symlink d8/d94/l11d 0 2024-02-28T16:02:24.547 INFO:tasks.workunit.client.0.smithi057.stdout:1/930: getdents d1/d3/dc/d15/d4e/d57 0 2024-02-28T16:02:24.547 INFO:tasks.workunit.client.0.smithi057.stdout:3/825: dread - d8/dd/d14/d2e/d2f/ff3 zero size 2024-02-28T16:02:24.558 INFO:tasks.workunit.client.0.smithi057.stdout:3/826: getdents d8/dd/d14/d2e/d30/d49 0 2024-02-28T16:02:24.559 INFO:tasks.workunit.client.0.smithi057.stdout:8/884: write d5/d6/f2d [825897,119912] 0 2024-02-28T16:02:24.565 INFO:tasks.workunit.client.0.smithi057.stdout:9/971: dwrite d2/d5/d1b/d2e/f2f [4194304,4194304] 0 2024-02-28T16:02:24.569 INFO:tasks.workunit.client.0.smithi057.stdout:8/885: write d5/d20/d39/d6e/daf/fdc [2364274,69188] 0 2024-02-28T16:02:24.572 INFO:tasks.workunit.client.0.smithi057.stdout:9/972: creat d2/d46/f13e x:0 0 0 2024-02-28T16:02:24.572 INFO:tasks.workunit.client.0.smithi057.stdout:1/931: dwrite d1/d21/d66/d44/d4c/fe5 [0,4194304] 0 2024-02-28T16:02:24.573 INFO:tasks.workunit.client.0.smithi057.stdout:9/973: chown d2/d62 9 1 2024-02-28T16:02:24.575 INFO:tasks.workunit.client.0.smithi057.stdout:9/974: stat d2/d24/d1d 0 2024-02-28T16:02:24.580 INFO:tasks.workunit.client.0.smithi057.stdout:1/932: symlink d1/d21/d66/d53/d62/d73/l12e 0 2024-02-28T16:02:24.585 INFO:tasks.workunit.client.0.smithi057.stdout:2/882: sync 2024-02-28T16:02:24.585 INFO:tasks.workunit.client.0.smithi057.stdout:9/975: link d2/d5/d1b/d2e/d4c/da0/faa d2/d5/d1b/f13f 0 2024-02-28T16:02:24.588 INFO:tasks.workunit.client.0.smithi057.stdout:1/933: mknod d1/d21/d66/d53/dca/d11e/c12f 0 2024-02-28T16:02:24.589 INFO:tasks.workunit.client.0.smithi057.stdout:3/827: dwrite d8/dd/d14/d2c/f4c [4194304,4194304] 0 2024-02-28T16:02:24.590 INFO:tasks.workunit.client.0.smithi057.stdout:2/883: mkdir d19/d1d/d2e/d31/deb/d126 0 2024-02-28T16:02:24.590 INFO:tasks.workunit.client.0.smithi057.stdout:9/976: mkdir d2/d5/d9/d120/d129/d140 0 2024-02-28T16:02:24.592 INFO:tasks.workunit.client.0.smithi057.stdout:2/884: write d19/d43/df2/f118 [137272,68822] 0 2024-02-28T16:02:24.596 INFO:tasks.workunit.client.0.smithi057.stdout:9/977: mknod d2/c141 0 2024-02-28T16:02:24.603 INFO:tasks.workunit.client.0.smithi057.stdout:2/885: mkdir d19/d43/d127 0 2024-02-28T16:02:24.613 INFO:tasks.workunit.client.0.smithi057.stdout:1/934: dwrite d1/d21/d66/f12b [0,4194304] 0 2024-02-28T16:02:24.614 INFO:tasks.workunit.client.0.smithi057.stdout:9/978: dread d2/d5/d9/fc1 [0,4194304] 0 2024-02-28T16:02:24.618 INFO:tasks.workunit.client.0.smithi057.stdout:9/979: read d2/d5/d9/f54 [3804654,37551] 0 2024-02-28T16:02:24.619 INFO:tasks.workunit.client.0.smithi057.stdout:3/828: write d8/dd/d14/d2e/d30/d5f/d6b/fd5 [668559,104248] 0 2024-02-28T16:02:24.620 INFO:tasks.workunit.client.0.smithi057.stdout:1/935: symlink d1/d21/d66/d44/d4c/d75/l130 0 2024-02-28T16:02:24.622 INFO:tasks.workunit.client.0.smithi057.stdout:2/886: link d19/d1d/cbd d19/d43/df2/c128 0 2024-02-28T16:02:24.622 INFO:tasks.workunit.client.0.smithi057.stdout:1/936: chown d1/d21/c48 2143 1 2024-02-28T16:02:24.624 INFO:tasks.workunit.client.0.smithi057.stdout:3/829: chown d8/dd/d14/d2e/d30/d6a/lbb 24396525 1 2024-02-28T16:02:24.625 INFO:tasks.workunit.client.0.smithi057.stdout:9/980: creat d2/d5/d9/d5d/dd7/f142 x:0 0 0 2024-02-28T16:02:24.628 INFO:tasks.workunit.client.0.smithi057.stdout:9/981: chown d2/d5/d9/d5d/l7a 378 1 2024-02-28T16:02:24.634 INFO:tasks.workunit.client.0.smithi057.stdout:9/982: mknod d2/d5/d1b/d2e/d4c/da0/da7/d117/c143 0 2024-02-28T16:02:24.638 INFO:tasks.workunit.client.0.smithi057.stdout:1/937: truncate d1/d21/d66/f2f 2985502 0 2024-02-28T16:02:24.638 INFO:tasks.workunit.client.0.smithi057.stdout:9/983: readlink d2/d24/d9c/l112 0 2024-02-28T16:02:24.640 INFO:tasks.workunit.client.0.smithi057.stdout:1/938: chown d1/d3/dc/d15 1 1 2024-02-28T16:02:24.643 INFO:tasks.workunit.client.0.smithi057.stdout:2/887: dwrite d19/d2c/d65/de9/f121 [0,4194304] 0 2024-02-28T16:02:24.644 INFO:tasks.workunit.client.0.smithi057.stdout:9/984: symlink d2/d5/dd3/d8b/l144 0 2024-02-28T16:02:24.647 INFO:tasks.workunit.client.0.smithi057.stdout:2/888: chown d19/d43/d5a/d70/fb3 98208800 1 2024-02-28T16:02:24.650 INFO:tasks.workunit.client.0.smithi057.stdout:2/889: mknod d19/d2c/d65/c129 0 2024-02-28T16:02:24.653 INFO:tasks.workunit.client.0.smithi057.stdout:2/890: write d19/d1d/d26/f61 [1174708,31961] 0 2024-02-28T16:02:24.653 INFO:tasks.workunit.client.0.smithi057.stdout:9/985: getdents d2/d5/d9/d5d/dd7 0 2024-02-28T16:02:24.657 INFO:tasks.workunit.client.0.smithi057.stdout:9/986: read - d2/d5/dd8/dea/f10b zero size 2024-02-28T16:02:24.660 INFO:tasks.workunit.client.0.smithi057.stdout:2/891: link d19/d1d/d89/f93 d19/d1d/d2e/d3c/dab/dfc/f12a 0 2024-02-28T16:02:24.661 INFO:tasks.workunit.client.0.smithi057.stdout:9/987: creat d2/d5/d9/d5d/d70/dfb/f145 x:0 0 0 2024-02-28T16:02:24.665 INFO:tasks.workunit.client.0.smithi057.stdout:1/939: truncate d1/d21/d66/d53/d7d/d67/d7a/d94/ff3 445406 0 2024-02-28T16:02:24.665 INFO:tasks.workunit.client.0.smithi057.stdout:9/988: creat d2/d62/d11b/f146 x:0 0 0 2024-02-28T16:02:24.666 INFO:tasks.workunit.client.0.smithi057.stdout:1/940: chown d1/d3/c102 0 1 2024-02-28T16:02:24.669 INFO:tasks.workunit.client.0.smithi057.stdout:9/989: mknod d2/d46/d67/d7d/dd0/c147 0 2024-02-28T16:02:24.670 INFO:tasks.workunit.client.0.smithi057.stdout:1/941: mkdir d1/d21/d66/d44/d4c/d75/d131 0 2024-02-28T16:02:24.671 INFO:tasks.workunit.client.0.smithi057.stdout:2/892: write d19/d1d/f51 [2319994,88438] 0 2024-02-28T16:02:24.673 INFO:tasks.workunit.client.0.smithi057.stdout:2/893: chown d19/d1d/d2e/d31/f50 1892 1 2024-02-28T16:02:24.675 INFO:tasks.workunit.client.0.smithi057.stdout:9/990: rename d2/d5/d9/d120/c135 to d2/d24/d1d/d104/dc3/c148 0 2024-02-28T16:02:24.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:24 smithi057 ceph-mon[28763]: pgmap v44: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 78 MiB/s rd, 168 MiB/s wr, 454 op/s 2024-02-28T16:02:24.678 INFO:tasks.workunit.client.0.smithi057.stdout:1/942: rmdir d1/d21/d66/d53/d7d/d67/d7a/d94 39 2024-02-28T16:02:24.682 INFO:tasks.workunit.client.0.smithi057.stdout:9/991: dread d2/d24/d1d/d104/ff4 [0,4194304] 0 2024-02-28T16:02:24.684 INFO:tasks.workunit.client.0.smithi057.stdout:1/943: mkdir d1/d21/d66/d53/dca/d132 0 2024-02-28T16:02:24.687 INFO:tasks.workunit.client.0.smithi057.stdout:1/944: mknod d1/d21/d66/d53/dca/d11e/c133 0 2024-02-28T16:02:24.690 INFO:tasks.workunit.client.0.smithi057.stdout:1/945: symlink d1/d21/d66/d53/d62/d73/d10c/l134 0 2024-02-28T16:02:24.695 INFO:tasks.workunit.client.0.smithi057.stdout:1/946: mkdir d1/d21/d66/dd0/d135 0 2024-02-28T16:02:24.696 INFO:tasks.workunit.client.0.smithi057.stdout:1/947: truncate d1/d3/dc/d40/f113 348520 0 2024-02-28T16:02:24.702 INFO:tasks.workunit.client.0.smithi057.stdout:2/894: dread d19/d1d/d2e/f6c [4194304,4194304] 0 2024-02-28T16:02:24.704 INFO:tasks.workunit.client.0.smithi057.stdout:2/895: rmdir d19/d1d/d22 39 2024-02-28T16:02:24.706 INFO:tasks.workunit.client.0.smithi057.stdout:2/896: write d19/d1d/d89/f10b [738167,9162] 0 2024-02-28T16:02:24.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:24 smithi087 ceph-mon[37122]: pgmap v44: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 78 MiB/s rd, 168 MiB/s wr, 454 op/s 2024-02-28T16:02:24.814 INFO:tasks.workunit.client.0.smithi057.stdout:0/978: sync 2024-02-28T16:02:24.814 INFO:tasks.workunit.client.0.smithi057.stdout:4/838: sync 2024-02-28T16:02:24.822 INFO:tasks.workunit.client.0.smithi057.stdout:2/897: symlink d19/d3a/dfd/l12b 0 2024-02-28T16:02:24.843 INFO:tasks.workunit.client.0.smithi057.stdout:2/898: dwrite d19/d1d/d2e/f9f [0,4194304] 0 2024-02-28T16:02:24.847 INFO:tasks.workunit.client.0.smithi057.stdout:2/899: creat d19/d1d/d2e/de2/f12c x:0 0 0 2024-02-28T16:02:24.848 INFO:tasks.workunit.client.0.smithi057.stdout:2/900: dread - d19/d1d/d89/f115 zero size 2024-02-28T16:02:24.851 INFO:tasks.workunit.client.0.smithi057.stdout:2/901: dread - d19/d43/d5a/d70/fd3 zero size 2024-02-28T16:02:24.854 INFO:tasks.workunit.client.0.smithi057.stdout:2/902: chown d19/d43/d5a/cc5 2919 1 2024-02-28T16:02:24.855 INFO:tasks.workunit.client.0.smithi057.stdout:2/903: dread - d19/dc1/f109 zero size 2024-02-28T16:02:24.856 INFO:tasks.workunit.client.0.smithi057.stdout:4/839: write d1/d10/d12/d15/f99 [605646,92612] 0 2024-02-28T16:02:24.857 INFO:tasks.workunit.client.0.smithi057.stdout:0/979: write d6/d12/d17/d34/f76 [330032,26071] 0 2024-02-28T16:02:24.864 INFO:tasks.workunit.client.0.smithi057.stdout:4/840: rmdir d1/d10/d12/d15 39 2024-02-28T16:02:24.864 INFO:tasks.workunit.client.0.smithi057.stdout:4/841: read d1/d22/f35 [3333801,28051] 0 2024-02-28T16:02:24.866 INFO:tasks.workunit.client.0.smithi057.stdout:4/842: mkdir d1/d10/d12/d39/db4/d11b 0 2024-02-28T16:02:24.867 INFO:tasks.workunit.client.0.smithi057.stdout:0/980: write d6/d12/d17/f59 [775434,105665] 0 2024-02-28T16:02:24.873 INFO:tasks.workunit.client.0.smithi057.stdout:0/981: chown d6/d12/d5d/d71/d10a/l120 3992 1 2024-02-28T16:02:24.873 INFO:tasks.workunit.client.0.smithi057.stdout:4/843: unlink d1/d10/d12/d39/db4/cc3 0 2024-02-28T16:02:24.878 INFO:tasks.workunit.client.0.smithi057.stdout:4/844: chown d1/d10/d12/d2c/d50/dff/d103 497 1 2024-02-28T16:02:24.880 INFO:tasks.workunit.client.0.smithi057.stdout:2/904: dwrite d19/d34/d78/d95/f97 [0,4194304] 0 2024-02-28T16:02:24.882 INFO:tasks.workunit.client.0.smithi057.stdout:4/845: dread - d1/d10/d12/d2c/d37/f117 zero size 2024-02-28T16:02:24.882 INFO:tasks.workunit.client.0.smithi057.stdout:0/982: getdents d6/d12/d45/dab 0 2024-02-28T16:02:24.886 INFO:tasks.workunit.client.0.smithi057.stdout:0/983: read - d6/d12/d5d/d71/d10a/d12d/d135/f100 zero size 2024-02-28T16:02:24.887 INFO:tasks.workunit.client.0.smithi057.stdout:4/846: mkdir d1/d10/d31/d86/dd1/d10c/d11c 0 2024-02-28T16:02:24.888 INFO:tasks.workunit.client.0.smithi057.stdout:2/905: fsync d19/d1d/d2e/d3c/dab/dfc/fef 0 2024-02-28T16:02:24.892 INFO:tasks.workunit.client.0.smithi057.stdout:0/984: mknod d6/d12/d5d/de9/c143 0 2024-02-28T16:02:24.896 INFO:tasks.workunit.client.0.smithi057.stdout:2/906: creat d19/d43/ddd/f12d x:0 0 0 2024-02-28T16:02:24.898 INFO:tasks.workunit.client.0.smithi057.stdout:0/985: write d6/d12/d17/d34/db7/f13a [172506,109064] 0 2024-02-28T16:02:24.903 INFO:tasks.workunit.client.0.smithi057.stdout:4/847: write d1/d22/f24 [270022,27378] 0 2024-02-28T16:02:24.907 INFO:tasks.workunit.client.0.smithi057.stdout:4/848: creat d1/d10/d31/d36/f11d x:0 0 0 2024-02-28T16:02:24.915 INFO:tasks.workunit.client.0.smithi057.stdout:4/849: creat d1/d10/d31/d86/dd1/d8c/f11e x:0 0 0 2024-02-28T16:02:24.918 INFO:tasks.workunit.client.0.smithi057.stdout:4/850: chown d1/d10/d31/d36/c119 918 1 2024-02-28T16:02:24.923 INFO:tasks.workunit.client.0.smithi057.stdout:2/907: dwrite d19/d2c/d48/da2/fca [0,4194304] 0 2024-02-28T16:02:24.927 INFO:tasks.workunit.client.0.smithi057.stdout:2/908: mkdir d19/d1d/d2e/de2/d12e 0 2024-02-28T16:02:24.931 INFO:tasks.workunit.client.0.smithi057.stdout:0/986: dread d6/d12/d45/d78/f90 [0,4194304] 0 2024-02-28T16:02:24.933 INFO:tasks.workunit.client.0.smithi057.stdout:4/851: creat d1/d10/d31/f11f x:0 0 0 2024-02-28T16:02:24.934 INFO:tasks.workunit.client.0.smithi057.stdout:0/987: dread - d6/d12/da4/f112 zero size 2024-02-28T16:02:24.938 INFO:tasks.workunit.client.0.smithi057.stdout:7/799: sync 2024-02-28T16:02:24.939 INFO:tasks.workunit.client.0.smithi057.stdout:2/909: link d19/d43/df2/c128 d19/d1d/d2e/d3c/c12f 0 2024-02-28T16:02:24.947 INFO:tasks.workunit.client.0.smithi057.stdout:7/800: getdents d6/dc/d67/d9a/da1/da8 0 2024-02-28T16:02:24.951 INFO:tasks.workunit.client.0.smithi057.stdout:0/988: write d6/d12/d5d/d71/d10a/d12d/d135/db8/fff [2663698,106398] 0 2024-02-28T16:02:24.955 INFO:tasks.workunit.client.0.smithi057.stdout:7/801: dread d6/dc/d12/d1a/d4d/f94 [0,4194304] 0 2024-02-28T16:02:24.958 INFO:tasks.workunit.client.0.smithi057.stdout:0/989: fsync d6/d12/d45/d78/f9d 0 2024-02-28T16:02:24.960 INFO:tasks.workunit.client.0.smithi057.stdout:0/990: stat d6/f65 0 2024-02-28T16:02:24.962 INFO:tasks.workunit.client.0.smithi057.stdout:4/852: dwrite d1/d10/d12/f7f [0,4194304] 0 2024-02-28T16:02:24.963 INFO:tasks.workunit.client.0.smithi057.stdout:7/802: fdatasync d6/d26/f36 0 2024-02-28T16:02:24.963 INFO:tasks.workunit.client.0.smithi057.stdout:0/991: read d6/d4e/f33 [2651223,2945] 0 2024-02-28T16:02:24.967 INFO:tasks.workunit.client.0.smithi057.stdout:2/910: dwrite d19/d3a/f98 [0,4194304] 0 2024-02-28T16:02:24.970 INFO:tasks.workunit.client.0.smithi057.stdout:7/803: creat d6/dc/f112 x:0 0 0 2024-02-28T16:02:24.972 INFO:tasks.workunit.client.0.smithi057.stdout:4/853: symlink d1/d10/d108/l120 0 2024-02-28T16:02:24.972 INFO:tasks.workunit.client.0.smithi057.stdout:2/911: write d19/d34/f119 [900770,13097] 0 2024-02-28T16:02:24.980 INFO:tasks.workunit.client.0.smithi057.stdout:4/854: mkdir d1/d10/d31/d86/dd1/d116/d121 0 2024-02-28T16:02:24.982 INFO:tasks.workunit.client.0.smithi057.stdout:2/912: symlink d19/d1d/d2e/db6/l130 0 2024-02-28T16:02:24.984 INFO:tasks.workunit.client.0.smithi057.stdout:0/992: dread d6/d12/d45/f9a [0,4194304] 0 2024-02-28T16:02:24.984 INFO:tasks.workunit.client.0.smithi057.stdout:4/855: symlink d1/d10/d31/d86/dd1/d10c/l122 0 2024-02-28T16:02:24.989 INFO:tasks.workunit.client.0.smithi057.stdout:4/856: chown d1/d3f/d5f/cf1 237793583 1 2024-02-28T16:02:24.995 INFO:tasks.workunit.client.0.smithi057.stdout:0/993: mkdir d6/d12/d17/d34/d144 0 2024-02-28T16:02:24.996 INFO:tasks.workunit.client.0.smithi057.stdout:2/913: link d19/d1d/db2/cdc d19/d57/dc7/d105/c131 0 2024-02-28T16:02:24.996 INFO:tasks.workunit.client.0.smithi057.stdout:4/857: creat d1/d10/d31/d86/dd1/d9b/f123 x:0 0 0 2024-02-28T16:02:24.998 INFO:tasks.workunit.client.0.smithi057.stdout:7/804: write d6/dc/d12/fdb [600464,40251] 0 2024-02-28T16:02:25.001 INFO:tasks.workunit.client.0.smithi057.stdout:2/914: unlink d19/dc1/f109 0 2024-02-28T16:02:25.003 INFO:tasks.workunit.client.0.smithi057.stdout:4/858: fdatasync d1/d10/d12/d2c/d37/d46/dac/de9/d5e/fc6 0 2024-02-28T16:02:25.005 INFO:tasks.workunit.client.0.smithi057.stdout:2/915: write d19/d2c/f111 [373192,107888] 0 2024-02-28T16:02:25.006 INFO:tasks.workunit.client.0.smithi057.stdout:0/994: rmdir d6/d12/d5d/d71/d10a/d12d/d135/d95/daf 39 2024-02-28T16:02:25.008 INFO:tasks.workunit.client.0.smithi057.stdout:4/859: unlink d1/d10/d12/d2c/fad 0 2024-02-28T16:02:25.011 INFO:tasks.workunit.client.0.smithi057.stdout:5/871: sync 2024-02-28T16:02:25.012 INFO:tasks.workunit.client.0.smithi057.stdout:6/942: sync 2024-02-28T16:02:25.012 INFO:tasks.workunit.client.0.smithi057.stdout:2/916: dread - d19/d1d/d26/ff7 zero size 2024-02-28T16:02:25.012 INFO:tasks.workunit.client.0.smithi057.stdout:9/992: sync 2024-02-28T16:02:25.012 INFO:tasks.workunit.client.0.smithi057.stdout:8/886: sync 2024-02-28T16:02:25.012 INFO:tasks.workunit.client.0.smithi057.stdout:3/830: sync 2024-02-28T16:02:25.013 INFO:tasks.workunit.client.0.smithi057.stdout:0/995: chown d6/d12/d5d/d71/daa/db6/f11a 615503 1 2024-02-28T16:02:25.015 INFO:tasks.workunit.client.0.smithi057.stdout:7/805: link d6/dc/d12/d1a/d90/fca d6/d26/df8/f113 0 2024-02-28T16:02:25.018 INFO:tasks.workunit.client.0.smithi057.stdout:6/943: chown df/d10/d10c/d132 638 1 2024-02-28T16:02:25.018 INFO:tasks.workunit.client.0.smithi057.stdout:2/917: creat d19/dc1/f132 x:0 0 0 2024-02-28T16:02:25.020 INFO:tasks.workunit.client.0.smithi057.stdout:0/996: write d6/d12/d17/f59 [3872185,45875] 0 2024-02-28T16:02:25.020 INFO:tasks.workunit.client.0.smithi057.stdout:8/887: unlink d5/d6/d97/ld5 0 2024-02-28T16:02:25.028 INFO:tasks.workunit.client.0.smithi057.stdout:3/831: rename d8/dd/d14/d2e/d2f/df6 to d8/dd/d19/d2a/de3/d11e 0 2024-02-28T16:02:25.028 INFO:tasks.workunit.client.0.smithi057.stdout:2/918: symlink d19/d1d/d2e/db6/l133 0 2024-02-28T16:02:25.031 INFO:tasks.workunit.client.0.smithi057.stdout:4/860: creat d1/d10/d12/d2c/d37/d46/dac/de9/f124 x:0 0 0 2024-02-28T16:02:25.034 INFO:tasks.workunit.client.0.smithi057.stdout:8/888: symlink d5/de/d1b/d57/d9e/l124 0 2024-02-28T16:02:25.035 INFO:tasks.workunit.client.0.smithi057.stdout:4/861: chown d1/l30 275591210 1 2024-02-28T16:02:25.039 INFO:tasks.workunit.client.0.smithi057.stdout:0/997: creat d6/d12/d17/d133/f145 x:0 0 0 2024-02-28T16:02:25.042 INFO:tasks.workunit.client.0.smithi057.stdout:8/889: stat d5/d20/d39/d49/d56/d79/dfc/la9 0 2024-02-28T16:02:25.048 INFO:tasks.workunit.client.0.smithi057.stdout:0/998: symlink d6/d12/d45/d55/l146 0 2024-02-28T16:02:25.050 INFO:tasks.workunit.client.0.smithi057.stdout:5/872: getdents d2/d8 0 2024-02-28T16:02:25.051 INFO:tasks.workunit.client.0.smithi057.stdout:9/993: dwrite d2/d92/fa5 [0,4194304] 0 2024-02-28T16:02:25.054 INFO:tasks.workunit.client.0.smithi057.stdout:3/832: write d8/dd/d14/d2e/d30/d49/f63 [392097,105386] 0 2024-02-28T16:02:25.057 INFO:tasks.workunit.client.0.smithi057.stdout:5/873: readlink d2/d15/d63/la8 0 2024-02-28T16:02:25.058 INFO:tasks.workunit.client.0.smithi057.stdout:9/994: fsync d2/d62/fdb 0 2024-02-28T16:02:25.071 INFO:tasks.workunit.client.0.smithi057.stdout:7/806: dwrite d6/dc/d12/d1a/d4d/fc8 [4194304,4194304] 0 2024-02-28T16:02:25.080 INFO:tasks.workunit.client.0.smithi057.stdout:8/890: dwrite d5/de/d1b/d57/d9e/fe6 [0,4194304] 0 2024-02-28T16:02:25.080 INFO:tasks.workunit.client.0.smithi057.stdout:3/833: link d8/d4b/cdb d8/dd/d14/d2e/d76/d89/d6c/c11f 0 2024-02-28T16:02:25.081 INFO:tasks.workunit.client.0.smithi057.stdout:8/891: write d5/de/d1b/d57/d9e/fe6 [510054,65162] 0 2024-02-28T16:02:25.081 INFO:tasks.workunit.client.0.smithi057.stdout:3/834: fdatasync d8/dd/d19/f29 0 2024-02-28T16:02:25.091 INFO:tasks.workunit.client.0.smithi057.stdout:8/892: stat d5/d20/d39/d49/d56/d79/dfc/cd1 0 2024-02-28T16:02:25.091 INFO:tasks.workunit.client.0.smithi057.stdout:8/893: readlink d5/de/d1b/d57/la6 0 2024-02-28T16:02:25.094 INFO:tasks.workunit.client.0.smithi057.stdout:0/999: dwrite d6/d12/d38/db4/fd0 [4194304,4194304] 0 2024-02-28T16:02:25.095 INFO:tasks.workunit.client.0.smithi057.stdout:2/919: dread d19/d1d/d2e/d3c/dab/dfc/f106 [0,4194304] 0 2024-02-28T16:02:25.105 INFO:tasks.workunit.client.0.smithi057.stdout:6/944: dread df/d10/d78/d5b/d7b/fa1 [4194304,4194304] 0 2024-02-28T16:02:25.105 INFO:tasks.workunit.client.0.smithi057.stdout:8/894: mknod d5/c125 0 2024-02-28T16:02:25.111 INFO:tasks.workunit.client.0.smithi057.stdout:6/945: readlink df/d10/d78/dca/l10a 0 2024-02-28T16:02:25.118 INFO:tasks.workunit.client.0.smithi057.stdout:8/895: fdatasync d5/d20/d39/d59/db7/dcc/f103 0 2024-02-28T16:02:25.119 INFO:tasks.workunit.client.0.smithi057.stdout:2/920: link d19/d2c/f4f d19/d2c/d65/de9/f134 0 2024-02-28T16:02:25.128 INFO:tasks.workunit.client.0.smithi057.stdout:9/995: dwrite d2/d24/d9c/ddd/f107 [0,4194304] 0 2024-02-28T16:02:25.129 INFO:tasks.workunit.client.0.smithi057.stdout:2/921: chown d19/d43/d5a/d70/l11c 39056 1 2024-02-28T16:02:25.131 INFO:tasks.workunit.client.0.smithi057.stdout:7/807: dwrite d6/dc/f112 [0,4194304] 0 2024-02-28T16:02:25.135 INFO:tasks.workunit.client.0.smithi057.stdout:5/874: dread d2/d15/f43 [0,4194304] 0 2024-02-28T16:02:25.140 INFO:tasks.workunit.client.0.smithi057.stdout:9/996: stat d2/d46/d67/cb4 0 2024-02-28T16:02:25.142 INFO:tasks.workunit.client.0.smithi057.stdout:7/808: write d6/dc/d12/f8c [3621910,95597] 0 2024-02-28T16:02:25.144 INFO:tasks.workunit.client.0.smithi057.stdout:3/835: dwrite d8/dd/d14/d2c/fd8 [0,4194304] 0 2024-02-28T16:02:25.144 INFO:tasks.workunit.client.0.smithi057.stdout:5/875: chown d2/f4a 11118 1 2024-02-28T16:02:25.149 INFO:tasks.workunit.client.0.smithi057.stdout:7/809: chown d6/dc/d12/d29/f10a 5547 1 2024-02-28T16:02:25.154 INFO:tasks.workunit.client.0.smithi057.stdout:9/997: mknod d2/d5/d9/d5d/d70/c149 0 2024-02-28T16:02:25.159 INFO:tasks.workunit.client.0.smithi057.stdout:3/836: mknod d8/d4b/dd2/c120 0 2024-02-28T16:02:25.161 INFO:tasks.workunit.client.0.smithi057.stdout:5/876: mkdir d2/d12/d76/d7a/d95/db5/dcb/dab/d12c/d62/df4/d130 0 2024-02-28T16:02:25.162 INFO:tasks.workunit.client.0.smithi057.stdout:7/810: fsync d6/dc/d12/d1a/f37 0 2024-02-28T16:02:25.162 INFO:tasks.workunit.client.0.smithi057.stdout:8/896: write d5/de/f4a [3459495,95146] 0 2024-02-28T16:02:25.166 INFO:tasks.workunit.client.0.smithi057.stdout:5/877: dread - d2/d12/d76/d7a/d95/f10d zero size 2024-02-28T16:02:25.169 INFO:tasks.workunit.client.0.smithi057.stdout:3/837: creat d8/d4b/f121 x:0 0 0 2024-02-28T16:02:25.172 INFO:tasks.workunit.client.0.smithi057.stdout:7/811: creat d6/dc/d12/d1a/d90/f114 x:0 0 0 2024-02-28T16:02:25.177 INFO:tasks.workunit.client.0.smithi057.stdout:3/838: creat d8/dd/d14/d2e/d76/d89/d6c/f122 x:0 0 0 2024-02-28T16:02:25.177 INFO:tasks.workunit.client.0.smithi057.stdout:1/948: sync 2024-02-28T16:02:25.181 INFO:tasks.workunit.client.0.smithi057.stdout:9/998: truncate d2/d24/d1d/d104/d65/f73 3331626 0 2024-02-28T16:02:25.183 INFO:tasks.workunit.client.0.smithi057.stdout:5/878: write d2/d19/f29 [633806,32198] 0 2024-02-28T16:02:25.184 INFO:tasks.workunit.client.0.smithi057.stdout:7/812: symlink d6/dc/d12/d1a/d4d/df0/l115 0 2024-02-28T16:02:25.185 INFO:tasks.workunit.client.0.smithi057.stdout:6/946: dread df/d10/d13/d4b/f51 [4194304,4194304] 0 2024-02-28T16:02:25.186 INFO:tasks.workunit.client.0.smithi057.stdout:5/879: read - d2/d12/d5f/d77/f11e zero size 2024-02-28T16:02:25.191 INFO:tasks.workunit.client.0.smithi057.stdout:6/947: fsync df/d10/d13/f118 0 2024-02-28T16:02:25.191 INFO:tasks.workunit.client.0.smithi057.stdout:7/813: chown d6/dc/d12/d1a/d4d/fc8 0 1 2024-02-28T16:02:25.195 INFO:tasks.workunit.client.0.smithi057.stdout:3/839: creat d8/d4b/dd2/f123 x:0 0 0 2024-02-28T16:02:25.207 INFO:tasks.workunit.client.0.smithi057.stdout:8/897: dwrite d5/d20/d39/d49/d56/d84/f10b [0,4194304] 0 2024-02-28T16:02:25.207 INFO:tasks.workunit.client.0.smithi057.stdout:5/880: chown d2/l1e 3 1 2024-02-28T16:02:25.224 INFO:tasks.workunit.client.0.smithi057.stdout:8/898: read d5/d20/d39/d49/f54 [1369335,99885] 0 2024-02-28T16:02:25.226 INFO:tasks.workunit.client.0.smithi057.stdout:6/948: dwrite df/d10/d13/f108 [0,4194304] 0 2024-02-28T16:02:25.235 INFO:tasks.workunit.client.0.smithi057.stdout:1/949: dwrite d1/d3/dc/f69 [4194304,4194304] 0 2024-02-28T16:02:25.241 INFO:tasks.workunit.client.0.smithi057.stdout:9/999: chown d2/d24/d1d/d104/f7c 52586 1 2024-02-28T16:02:25.251 INFO:tasks.workunit.client.0.smithi057.stdout:5/881: creat d2/d15/d5e/d9a/f131 x:0 0 0 2024-02-28T16:02:25.254 INFO:tasks.workunit.client.0.smithi057.stdout:3/840: link d8/dd/d14/d2e/c47 d8/dd/d14/d2e/d76/d89/de2/c124 0 2024-02-28T16:02:25.257 INFO:tasks.workunit.client.0.smithi057.stdout:7/814: dread d6/dc/d35/d58/dd5/fe1 [0,4194304] 0 2024-02-28T16:02:25.260 INFO:tasks.workunit.client.0.smithi057.stdout:6/949: creat df/d10/d78/d5b/d7b/de3/f138 x:0 0 0 2024-02-28T16:02:25.261 INFO:tasks.workunit.client.0.smithi057.stdout:1/950: symlink d1/d21/d66/dc7/l136 0 2024-02-28T16:02:25.262 INFO:tasks.workunit.client.0.smithi057.stdout:7/815: symlink d6/dc/d12/d29/l116 0 2024-02-28T16:02:25.263 INFO:tasks.workunit.client.0.smithi057.stdout:5/882: chown d2/d12/d76/d7a/d95/db5/dcb/dab/lf8 285556373 1 2024-02-28T16:02:25.267 INFO:tasks.workunit.client.0.smithi057.stdout:7/816: write d6/dc/d12/d29/f9c [845168,123226] 0 2024-02-28T16:02:25.271 INFO:tasks.workunit.client.0.smithi057.stdout:4/862: sync 2024-02-28T16:02:25.271 INFO:tasks.workunit.client.0.smithi057.stdout:5/883: read d2/d19/d1c/fd9 [556478,57699] 0 2024-02-28T16:02:25.273 INFO:tasks.workunit.client.0.smithi057.stdout:1/951: mknod d1/d21/d25/df7/c137 0 2024-02-28T16:02:25.275 INFO:tasks.workunit.client.0.smithi057.stdout:8/899: write d5/de/d1b/d57/d91/de9/fed [1586709,59424] 0 2024-02-28T16:02:25.278 INFO:tasks.workunit.client.0.smithi057.stdout:4/863: truncate d1/d10/d31/f11f 660564 0 2024-02-28T16:02:25.278 INFO:tasks.workunit.client.0.smithi057.stdout:8/900: stat d5/d20/d39/d59/d67/cee 0 2024-02-28T16:02:25.281 INFO:tasks.workunit.client.0.smithi057.stdout:1/952: write d1/d3/dc/ff [2972157,6000] 0 2024-02-28T16:02:25.284 INFO:tasks.workunit.client.0.smithi057.stdout:4/864: dread - d1/d10/d31/d86/f105 zero size 2024-02-28T16:02:25.285 INFO:tasks.workunit.client.0.smithi057.stdout:7/817: stat d6/dc/d67/cc2 0 2024-02-28T16:02:25.287 INFO:tasks.workunit.client.0.smithi057.stdout:5/884: fdatasync d2/d8/f9 0 2024-02-28T16:02:25.288 INFO:tasks.workunit.client.0.smithi057.stdout:1/953: chown d1/d21/d66/d44/c60 0 1 2024-02-28T16:02:25.289 INFO:tasks.workunit.client.0.smithi057.stdout:8/901: chown d5/d20/d39/d6e/daf/fdc 908 1 2024-02-28T16:02:25.299 INFO:tasks.workunit.client.0.smithi057.stdout:4/865: chown d1/d10/d12/d2c/d50/d93/ld5 1408394 1 2024-02-28T16:02:25.303 INFO:tasks.workunit.client.0.smithi057.stdout:7/818: creat d6/dc/d12/d29/dcc/f117 x:0 0 0 2024-02-28T16:02:25.304 INFO:tasks.workunit.client.0.smithi057.stdout:8/902: creat d5/de/d1b/d57/d9e/f126 x:0 0 0 2024-02-28T16:02:25.308 INFO:tasks.workunit.client.0.smithi057.stdout:6/950: write df/d10/d78/dca/d15/d16/f49 [3166078,42192] 0 2024-02-28T16:02:25.308 INFO:tasks.workunit.client.0.smithi057.stdout:8/903: chown d5/d6/dff/d116 1127402 1 2024-02-28T16:02:25.311 INFO:tasks.workunit.client.0.smithi057.stdout:1/954: getdents d1/d21/d66/d44/d4c/d75/d131 0 2024-02-28T16:02:25.313 INFO:tasks.workunit.client.0.smithi057.stdout:2/922: sync 2024-02-28T16:02:25.316 INFO:tasks.workunit.client.0.smithi057.stdout:3/841: dread d8/d4b/f60 [0,4194304] 0 2024-02-28T16:02:25.320 INFO:tasks.workunit.client.0.smithi057.stdout:3/842: readlink d8/dd/d14/d2e/d30/d5f/dd9/lf5 0 2024-02-28T16:02:25.320 INFO:tasks.workunit.client.0.smithi057.stdout:8/904: creat d5/d62/d9f/f127 x:0 0 0 2024-02-28T16:02:25.323 INFO:tasks.workunit.client.0.smithi057.stdout:6/951: creat df/d61/dbb/f139 x:0 0 0 2024-02-28T16:02:25.325 INFO:tasks.workunit.client.0.smithi057.stdout:2/923: chown d19/d1d/d2e/l9d 1 1 2024-02-28T16:02:25.326 INFO:tasks.workunit.client.0.smithi057.stdout:4/866: dread d1/f28 [0,4194304] 0 2024-02-28T16:02:25.331 INFO:tasks.workunit.client.0.smithi057.stdout:5/885: truncate d2/d15/d63/f8f 3554847 0 2024-02-28T16:02:25.335 INFO:tasks.workunit.client.0.smithi057.stdout:1/955: mkdir d1/d21/d66/d53/d7d/dfc/d138 0 2024-02-28T16:02:25.337 INFO:tasks.workunit.client.0.smithi057.stdout:1/956: chown d1/d3/dc/f69 10566506 1 2024-02-28T16:02:25.339 INFO:tasks.workunit.client.0.smithi057.stdout:2/924: mkdir d19/d1d/d26/d117/d135 0 2024-02-28T16:02:25.341 INFO:tasks.workunit.client.0.smithi057.stdout:1/957: chown d1/d21/d66/d53/d62/d73/d10c 310 1 2024-02-28T16:02:25.343 INFO:tasks.workunit.client.0.smithi057.stdout:3/843: creat d8/dd/d14/d2c/db9/f125 x:0 0 0 2024-02-28T16:02:25.344 INFO:tasks.workunit.client.0.smithi057.stdout:8/905: truncate d5/d20/d39/d6e/fca 1465173 0 2024-02-28T16:02:25.348 INFO:tasks.workunit.client.0.smithi057.stdout:8/906: write d5/d62/d9f/f127 [322464,59894] 0 2024-02-28T16:02:25.350 INFO:tasks.workunit.client.0.smithi057.stdout:8/907: chown d5/d62/lf3 290849 1 2024-02-28T16:02:25.368 INFO:tasks.workunit.client.0.smithi057.stdout:4/867: dread d1/d10/d12/d2c/fe1 [0,4194304] 0 2024-02-28T16:02:25.373 INFO:tasks.workunit.client.0.smithi057.stdout:8/908: mknod d5/d6/d97/c128 0 2024-02-28T16:02:25.376 INFO:tasks.workunit.client.0.smithi057.stdout:5/886: link d2/d15/d5e/d9a/dac/f12f d2/dae/f132 0 2024-02-28T16:02:25.377 INFO:tasks.workunit.client.0.smithi057.stdout:7/819: dwrite d6/dc/dab/ff9 [0,4194304] 0 2024-02-28T16:02:25.384 INFO:tasks.workunit.client.0.smithi057.stdout:2/925: dwrite d19/d34/d78/d95/f97 [4194304,4194304] 0 2024-02-28T16:02:25.385 INFO:tasks.workunit.client.0.smithi057.stdout:6/952: getdents df/d10/d78/d5b/d7b 0 2024-02-28T16:02:25.389 INFO:tasks.workunit.client.0.smithi057.stdout:5/887: fdatasync d2/dae/f132 0 2024-02-28T16:02:25.390 INFO:tasks.workunit.client.0.smithi057.stdout:8/909: fsync d5/d20/d39/d49/d56/f8f 0 2024-02-28T16:02:25.390 INFO:tasks.workunit.client.0.smithi057.stdout:3/844: dwrite d8/dd/d19/d25/fae [0,4194304] 0 2024-02-28T16:02:25.394 INFO:tasks.workunit.client.0.smithi057.stdout:6/953: readlink df/d10/d78/dca/d15/d16/d39/d92/da4/l125 0 2024-02-28T16:02:25.399 INFO:tasks.workunit.client.0.smithi057.stdout:1/958: rename d1/d3/dc/ff to d1/d21/d66/d53/d7d/d67/d7a/f139 0 2024-02-28T16:02:25.400 INFO:tasks.workunit.client.0.smithi057.stdout:4/868: write d1/d22/f75 [159275,115495] 0 2024-02-28T16:02:25.404 INFO:tasks.workunit.client.0.smithi057.stdout:1/959: fsync d1/d21/fe0 0 2024-02-28T16:02:25.406 INFO:tasks.workunit.client.0.smithi057.stdout:4/869: chown d1/d10/d31/d86/dd1/d8c/le2 29291344 1 2024-02-28T16:02:25.411 INFO:tasks.workunit.client.0.smithi057.stdout:5/888: creat d2/d19/f133 x:0 0 0 2024-02-28T16:02:25.412 INFO:tasks.workunit.client.0.smithi057.stdout:7/820: dwrite d6/dc/d67/fbe [0,4194304] 0 2024-02-28T16:02:25.417 INFO:tasks.workunit.client.0.smithi057.stdout:4/870: chown d1/d10/d12/d2c/d37/d46/dac/de9/d87/f98 87563 1 2024-02-28T16:02:25.430 INFO:tasks.workunit.client.0.smithi057.stdout:7/821: symlink d6/dc/d67/d9a/da1/l118 0 2024-02-28T16:02:25.439 INFO:tasks.workunit.client.0.smithi057.stdout:8/910: creat d5/de/d1b/d57/d85/dbc/f129 x:0 0 0 2024-02-28T16:02:25.446 INFO:tasks.workunit.client.0.smithi057.stdout:6/954: dread df/d10/d13/f41 [0,4194304] 0 2024-02-28T16:02:25.453 INFO:tasks.workunit.client.0.smithi057.stdout:7/822: creat d6/dc/f119 x:0 0 0 2024-02-28T16:02:25.459 INFO:tasks.workunit.client.0.smithi057.stdout:3/845: dread d8/f18 [0,4194304] 0 2024-02-28T16:02:25.466 INFO:tasks.workunit.client.0.smithi057.stdout:1/960: write d1/d21/d66/d53/d7d/d65/f83 [762657,109112] 0 2024-02-28T16:02:25.469 INFO:tasks.workunit.client.0.smithi057.stdout:3/846: read - d8/dd/d14/d2e/d30/d6a/fb4 zero size 2024-02-28T16:02:25.475 INFO:tasks.workunit.client.0.smithi057.stdout:6/955: dwrite df/d10/d78/dca/d15/d16/fe8 [0,4194304] 0 2024-02-28T16:02:25.483 INFO:tasks.workunit.client.0.smithi057.stdout:6/956: write df/d10/d4f/f71 [4744700,41779] 0 2024-02-28T16:02:25.487 INFO:tasks.workunit.client.0.smithi057.stdout:3/847: write d8/dd/d14/d2e/d76/d89/d6c/f122 [784197,75723] 0 2024-02-28T16:02:25.496 INFO:tasks.workunit.client.0.smithi057.stdout:6/957: symlink df/d10/d78/dca/d15/de9/l13a 0 2024-02-28T16:02:25.498 INFO:tasks.workunit.client.0.smithi057.stdout:4/871: dwrite d1/d10/f78 [0,4194304] 0 2024-02-28T16:02:25.498 INFO:tasks.workunit.client.0.smithi057.stdout:8/911: dwrite d5/d20/d39/d49/d56/d79/dfc/d70/f11d [0,4194304] 0 2024-02-28T16:02:25.498 INFO:tasks.workunit.client.0.smithi057.stdout:1/961: write d1/d21/d66/d53/d7d/d65/fb5 [1033436,61529] 0 2024-02-28T16:02:25.501 INFO:tasks.workunit.client.0.smithi057.stdout:4/872: dread - d1/d22/f7d zero size 2024-02-28T16:02:25.502 INFO:tasks.workunit.client.0.smithi057.stdout:3/848: creat d8/dd/d14/d2e/d76/da1/f126 x:0 0 0 2024-02-28T16:02:25.503 INFO:tasks.workunit.client.0.smithi057.stdout:8/912: stat d5/d20/d39/dd9/f114 0 2024-02-28T16:02:25.505 INFO:tasks.workunit.client.0.smithi057.stdout:1/962: chown d1/d3/dc/c114 1709 1 2024-02-28T16:02:25.508 INFO:tasks.workunit.client.0.smithi057.stdout:4/873: fdatasync d1/d10/d12/f10d 0 2024-02-28T16:02:25.512 INFO:tasks.workunit.client.0.smithi057.stdout:1/963: stat d1/d3/dc/d15/d4e/d5f/c99 0 2024-02-28T16:02:25.512 INFO:tasks.workunit.client.0.smithi057.stdout:6/958: truncate df/d10/d78/dca/d15/d16/d39/d92/f12e 720169 0 2024-02-28T16:02:25.512 INFO:tasks.workunit.client.0.smithi057.stdout:8/913: write d5/d6/f3f [228563,34949] 0 2024-02-28T16:02:25.514 INFO:tasks.workunit.client.0.smithi057.stdout:8/914: chown d5/d20/d39/d59/l68 13383 1 2024-02-28T16:02:25.517 INFO:tasks.workunit.client.0.smithi057.stdout:7/823: dread d6/dc/d12/d1a/d90/fae [0,4194304] 0 2024-02-28T16:02:25.521 INFO:tasks.workunit.client.0.smithi057.stdout:1/964: mkdir d1/d21/d66/d13a 0 2024-02-28T16:02:25.521 INFO:tasks.workunit.client.0.smithi057.stdout:3/849: creat d8/dd/d14/d2e/f127 x:0 0 0 2024-02-28T16:02:25.529 INFO:tasks.workunit.client.0.smithi057.stdout:4/874: rename d1/d10/d12 to d1/d10/d31/d86/dd1/d10c/d125 0 2024-02-28T16:02:25.531 INFO:tasks.workunit.client.0.smithi057.stdout:7/824: fsync d6/dc/f18 0 2024-02-28T16:02:25.542 INFO:tasks.workunit.client.0.smithi057.stdout:7/825: symlink d6/dc/d12/d1a/d4d/d56/l11a 0 2024-02-28T16:02:25.542 INFO:tasks.workunit.client.0.smithi057.stdout:4/875: symlink d1/d10/d31/d86/dd1/l126 0 2024-02-28T16:02:25.548 INFO:tasks.workunit.client.0.smithi057.stdout:1/965: creat d1/d21/d66/d53/d7d/d67/f13b x:0 0 0 2024-02-28T16:02:25.549 INFO:tasks.workunit.client.0.smithi057.stdout:7/826: rmdir d6/dc/d12/d1a/d4d/d56/db0 39 2024-02-28T16:02:25.550 INFO:tasks.workunit.client.0.smithi057.stdout:3/850: write d8/dd/d14/d2c/f33 [3230829,67851] 0 2024-02-28T16:02:25.552 INFO:tasks.workunit.client.0.smithi057.stdout:6/959: dwrite df/d10/f5c [0,4194304] 0 2024-02-28T16:02:25.552 INFO:tasks.workunit.client.0.smithi057.stdout:8/915: truncate d5/de/d1b/d4b/f7a 12299392 0 2024-02-28T16:02:25.555 INFO:tasks.workunit.client.0.smithi057.stdout:1/966: creat d1/d21/d66/d53/d7d/dfc/f13c x:0 0 0 2024-02-28T16:02:25.557 INFO:tasks.workunit.client.0.smithi057.stdout:1/967: readlink d1/l11c 0 2024-02-28T16:02:25.557 INFO:tasks.workunit.client.0.smithi057.stdout:3/851: fsync d8/d4b/dd2/ddd/d114/f116 0 2024-02-28T16:02:25.558 INFO:tasks.workunit.client.0.smithi057.stdout:4/876: symlink d1/d10/d31/d86/dd1/d10c/d125/d39/db4/l127 0 2024-02-28T16:02:25.562 INFO:tasks.workunit.client.0.smithi057.stdout:4/877: stat d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/dfe 0 2024-02-28T16:02:25.564 INFO:tasks.workunit.client.0.smithi057.stdout:7/827: truncate d6/dc/d12/d1a/d4d/f109 517192 0 2024-02-28T16:02:25.565 INFO:tasks.workunit.client.0.smithi057.stdout:1/968: truncate d1/d21/d66/d53/d62/d73/fcd 402303 0 2024-02-28T16:02:25.569 INFO:tasks.workunit.client.0.smithi057.stdout:3/852: symlink d8/dd/d14/d2e/d30/d5f/dd9/l128 0 2024-02-28T16:02:25.570 INFO:tasks.workunit.client.0.smithi057.stdout:1/969: chown d1/d21/d66/d53/d7d/d65 0 1 2024-02-28T16:02:25.574 INFO:tasks.workunit.client.0.smithi057.stdout:4/878: rename d1/d10/d31/d86/dd1/fb6 to d1/d10/d31/d86/dd1/d10c/d11c/f128 0 2024-02-28T16:02:25.575 INFO:tasks.workunit.client.0.smithi057.stdout:7/828: mknod d6/c11b 0 2024-02-28T16:02:25.579 INFO:tasks.workunit.client.0.smithi057.stdout:4/879: fdatasync d1/d10/d31/d86/dd1/d10c/d125/d2c/ffa 0 2024-02-28T16:02:25.584 INFO:tasks.workunit.client.0.smithi057.stdout:8/916: dwrite d5/d20/d39/d49/d56/d84/fd0 [0,4194304] 0 2024-02-28T16:02:25.592 INFO:tasks.workunit.client.0.smithi057.stdout:4/880: mkdir d1/d10/d31/d86/dd1/d10c/d125/d39/db4/de7/dfd/d129 0 2024-02-28T16:02:25.593 INFO:tasks.workunit.client.0.smithi057.stdout:1/970: write d1/d21/d66/f110 [1262277,60900] 0 2024-02-28T16:02:25.593 INFO:tasks.workunit.client.0.smithi057.stdout:7/829: truncate d6/dc/f112 3749455 0 2024-02-28T16:02:25.598 INFO:tasks.workunit.client.0.smithi057.stdout:3/853: truncate d8/dd/d14/d2e/d30/d5f/d6b/fd5 169527 0 2024-02-28T16:02:25.599 INFO:tasks.workunit.client.0.smithi057.stdout:7/830: write d6/d38/f10b [490483,59577] 0 2024-02-28T16:02:25.599 INFO:tasks.workunit.client.0.smithi057.stdout:4/881: creat d1/d10/d31/d36/f12a x:0 0 0 2024-02-28T16:02:25.604 INFO:tasks.workunit.client.0.smithi057.stdout:1/971: creat d1/d21/d66/f13d x:0 0 0 2024-02-28T16:02:25.607 INFO:tasks.workunit.client.0.smithi057.stdout:3/854: read d8/dd/d14/d2e/d30/d49/d51/f109 [120274,13568] 0 2024-02-28T16:02:25.608 INFO:tasks.workunit.client.0.smithi057.stdout:7/831: symlink d6/dc/d12/d1a/d4c/l11c 0 2024-02-28T16:02:25.609 INFO:tasks.workunit.client.0.smithi057.stdout:8/917: dwrite d5/de/f4a [0,4194304] 0 2024-02-28T16:02:25.617 INFO:tasks.workunit.client.0.smithi057.stdout:4/882: link d1/d10/d31/d86/dd1/d10c/d125/d2c/d50/f100 d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/f12b 0 2024-02-28T16:02:25.620 INFO:tasks.workunit.client.0.smithi057.stdout:7/832: rename d6/dc/d35/cf5 to d6/dc/d12/dc9/dce/c11d 0 2024-02-28T16:02:25.620 INFO:tasks.workunit.client.0.smithi057.stdout:4/883: write d1/d10/d31/f11f [544687,88432] 0 2024-02-28T16:02:25.625 INFO:tasks.workunit.client.0.smithi057.stdout:1/972: getdents d1/d21/d66/d53/d7d/d67/d6c/d82 0 2024-02-28T16:02:25.625 INFO:tasks.workunit.client.0.smithi057.stdout:8/918: getdents d5/de/d1b/d57/d9e 0 2024-02-28T16:02:25.628 INFO:tasks.workunit.client.0.smithi057.stdout:4/884: mkdir d1/d10/d31/d86/dd1/d10c/d125/d39/db4/d12c 0 2024-02-28T16:02:25.629 INFO:tasks.workunit.client.0.smithi057.stdout:7/833: fdatasync d6/dc/d12/d1a/d4c/d63/f110 0 2024-02-28T16:02:25.631 INFO:tasks.workunit.client.0.smithi057.stdout:4/885: chown d1/d3f/f5d 498 1 2024-02-28T16:02:25.631 INFO:tasks.workunit.client.0.smithi057.stdout:8/919: creat d5/d20/d39/d59/d67/da5/f12a x:0 0 0 2024-02-28T16:02:25.635 INFO:tasks.workunit.client.0.smithi057.stdout:1/973: mkdir d1/d21/d66/d53/d7d/d67/d6c/d82/d112/d126/d13e 0 2024-02-28T16:02:25.636 INFO:tasks.workunit.client.0.smithi057.stdout:4/886: readlink d1/d10/d31/d86/dd1/d10c/d125/d2c/d50/dff/d103/lf5 0 2024-02-28T16:02:25.643 INFO:tasks.workunit.client.0.smithi057.stdout:8/920: link d5/d20/da2/d8d/l95 d5/d20/d39/d59/d106/l12b 0 2024-02-28T16:02:25.648 INFO:tasks.workunit.client.0.smithi057.stdout:4/887: getdents d1/d10 0 2024-02-28T16:02:25.655 INFO:tasks.workunit.client.0.smithi057.stdout:4/888: fdatasync d1/d10/f4d 0 2024-02-28T16:02:25.661 INFO:tasks.workunit.client.0.smithi057.stdout:8/921: write d5/f2f [617605,730] 0 2024-02-28T16:02:25.661 INFO:tasks.workunit.client.0.smithi057.stdout:3/855: dread d8/dd/f1f [0,4194304] 0 2024-02-28T16:02:25.664 INFO:tasks.workunit.client.0.smithi057.stdout:4/889: creat d1/db8/f12d x:0 0 0 2024-02-28T16:02:25.669 INFO:tasks.workunit.client.0.smithi057.stdout:7/834: dread d6/f23 [0,4194304] 0 2024-02-28T16:02:25.670 INFO:tasks.workunit.client.0.smithi057.stdout:4/890: creat d1/d10/d31/d86/dd1/d10c/d125/d2c/d50/ddc/f12e x:0 0 0 2024-02-28T16:02:25.674 INFO:tasks.workunit.client.0.smithi057.stdout:3/856: link d8/dd/d19/d2a/de3/f102 d8/dd/d14/d2e/d76/d89/de2/f129 0 2024-02-28T16:02:25.674 INFO:tasks.workunit.client.0.smithi057.stdout:7/835: unlink f4 0 2024-02-28T16:02:25.677 INFO:tasks.workunit.client.0.smithi057.stdout:7/836: write d6/dc/d12/d29/f88 [645514,103024] 0 2024-02-28T16:02:25.677 INFO:tasks.workunit.client.0.smithi057.stdout:3/857: readlink d8/dd/d14/lac 0 2024-02-28T16:02:25.679 INFO:tasks.workunit.client.0.smithi057.stdout:8/922: dread d5/d20/d39/d49/d56/d84/fd0 [0,4194304] 0 2024-02-28T16:02:25.681 INFO:tasks.workunit.client.0.smithi057.stdout:4/891: getdents d1/d10/d31/d86/dd1/d10c/d125/d2c/d50/dff 0 2024-02-28T16:02:25.682 INFO:tasks.workunit.client.0.smithi057.stdout:3/858: mknod d8/dd/d14/d2c/c12a 0 2024-02-28T16:02:25.684 INFO:tasks.workunit.client.0.smithi057.stdout:7/837: fdatasync d6/dc/d12/d1a/d4d/dd9/dde/fe4 0 2024-02-28T16:02:25.687 INFO:tasks.workunit.client.0.smithi057.stdout:7/838: read d6/dc/d12/d1a/d4d/f109 [115613,17049] 0 2024-02-28T16:02:25.690 INFO:tasks.workunit.client.0.smithi057.stdout:3/859: fsync d8/dd/d14/d2e/fbe 0 2024-02-28T16:02:25.694 INFO:tasks.workunit.client.0.smithi057.stdout:4/892: fsync d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/d87/fce 0 2024-02-28T16:02:25.697 INFO:tasks.workunit.client.0.smithi057.stdout:3/860: truncate d8/dd/d14/d2e/d76/fe4 598783 0 2024-02-28T16:02:25.704 INFO:tasks.workunit.client.0.smithi057.stdout:3/861: fsync d8/dd/d14/d2e/d2f/ff3 0 2024-02-28T16:02:25.707 INFO:tasks.workunit.client.0.smithi057.stdout:3/862: write d8/d4b/dd2/ddd/f108 [868621,90307] 0 2024-02-28T16:02:25.710 INFO:tasks.workunit.client.0.smithi057.stdout:4/893: write d1/d10/d31/d86/f33 [5753103,69202] 0 2024-02-28T16:02:25.723 INFO:tasks.workunit.client.0.smithi057.stdout:3/863: creat d8/dd/d14/d2e/d30/d49/d86/f12b x:0 0 0 2024-02-28T16:02:25.723 INFO:tasks.workunit.client.0.smithi057.stdout:4/894: chown d1/d22/cb5 5890448 1 2024-02-28T16:02:25.728 INFO:tasks.workunit.client.0.smithi057.stdout:7/839: dwrite d6/dc/dab/d107/f10c [0,4194304] 0 2024-02-28T16:02:25.729 INFO:tasks.workunit.client.0.smithi057.stdout:8/923: dread d5/d20/d39/d49/d56/f51 [0,4194304] 0 2024-02-28T16:02:25.749 INFO:tasks.workunit.client.0.smithi057.stdout:3/864: creat d8/dd/d14/d2e/d30/d6a/f12c x:0 0 0 2024-02-28T16:02:25.751 INFO:tasks.workunit.client.0.smithi057.stdout:4/895: write d1/d10/d31/d86/dd1/d10c/d125/d2c/fe5 [769339,59116] 0 2024-02-28T16:02:25.751 INFO:tasks.workunit.client.0.smithi057.stdout:3/865: fsync d8/d94/ff1 0 2024-02-28T16:02:25.757 INFO:tasks.workunit.client.0.smithi057.stdout:4/896: symlink d1/d3f/d5f/l12f 0 2024-02-28T16:02:25.762 INFO:tasks.workunit.client.0.smithi057.stdout:3/866: link d8/dd/d14/d2e/d30/d49/c100 d8/d26/c12d 0 2024-02-28T16:02:25.762 INFO:tasks.workunit.client.0.smithi057.stdout:8/924: dread d5/de/f10 [4194304,4194304] 0 2024-02-28T16:02:25.763 INFO:tasks.workunit.client.0.smithi057.stdout:3/867: fdatasync d8/d94/ff1 0 2024-02-28T16:02:25.764 INFO:tasks.workunit.client.0.smithi057.stdout:8/925: dread - d5/d20/d39/d8c/fb2 zero size 2024-02-28T16:02:25.769 INFO:tasks.workunit.client.0.smithi057.stdout:3/868: creat d8/dd/d14/d2e/d30/d6a/f12e x:0 0 0 2024-02-28T16:02:25.777 INFO:tasks.workunit.client.0.smithi057.stdout:4/897: dwrite d1/d3f/f89 [4194304,4194304] 0 2024-02-28T16:02:25.778 INFO:tasks.workunit.client.0.smithi057.stdout:3/869: unlink c6 0 2024-02-28T16:02:25.787 INFO:tasks.workunit.client.0.smithi057.stdout:8/926: dwrite d5/d20/d39/d49/d56/d79/dfc/d70/d8e/ff7 [0,4194304] 0 2024-02-28T16:02:25.789 INFO:tasks.workunit.client.0.smithi057.stdout:3/870: truncate d8/dd/d14/d2e/d30/d6a/fb4 450123 0 2024-02-28T16:02:25.792 INFO:tasks.workunit.client.0.smithi057.stdout:7/840: write d6/dc/d12/f2d [7433299,12960] 0 2024-02-28T16:02:25.795 INFO:tasks.workunit.client.0.smithi057.stdout:8/927: mknod d5/d62/d9f/c12c 0 2024-02-28T16:02:25.799 INFO:tasks.workunit.client.0.smithi057.stdout:3/871: mknod d8/d4b/dd2/c12f 0 2024-02-28T16:02:25.801 INFO:tasks.workunit.client.0.smithi057.stdout:7/841: mkdir d6/dc/dab/d11e 0 2024-02-28T16:02:25.802 INFO:tasks.workunit.client.0.smithi057.stdout:3/872: stat d8/dd/d14/d2e/d30/d49/f63 0 2024-02-28T16:02:25.804 INFO:tasks.workunit.client.0.smithi057.stdout:8/928: chown d5/d20/d39/d49/d56/c111 427999361 1 2024-02-28T16:02:25.804 INFO:tasks.workunit.client.0.smithi057.stdout:7/842: chown d6/dc/d35/ldf 3232930 1 2024-02-28T16:02:25.806 INFO:tasks.workunit.client.0.smithi057.stdout:8/929: fsync d5/de/d1b/d57/d9e/f11f 0 2024-02-28T16:02:25.806 INFO:tasks.workunit.client.0.smithi057.stdout:4/898: rename d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/dfe/f113 to d1/d10/d31/d86/dd1/d10c/d125/d15/f130 0 2024-02-28T16:02:25.810 INFO:tasks.workunit.client.0.smithi057.stdout:3/873: chown d8/dd/d14/d2c/db9/ld7 39 1 2024-02-28T16:02:25.812 INFO:tasks.workunit.client.0.smithi057.stdout:4/899: mknod d1/d10/d31/d86/dd1/d10c/d125/d2c/d50/d93/c131 0 2024-02-28T16:02:25.816 INFO:tasks.workunit.client.0.smithi057.stdout:7/843: creat d6/dc/d12/d1a/d4d/d56/f11f x:0 0 0 2024-02-28T16:02:25.821 INFO:tasks.workunit.client.0.smithi057.stdout:7/844: creat d6/dc/d12/d1a/d4d/df0/f120 x:0 0 0 2024-02-28T16:02:25.821 INFO:tasks.workunit.client.0.smithi057.stdout:8/930: write d5/d6/f19 [1772804,45231] 0 2024-02-28T16:02:25.823 INFO:tasks.workunit.client.0.smithi057.stdout:7/845: stat d6/dc/d35/f39 0 2024-02-28T16:02:25.824 INFO:tasks.workunit.client.0.smithi057.stdout:4/900: write d1/d10/d31/d86/dd1/d10c/d125/d2c/d50/f6c [79600,130053] 0 2024-02-28T16:02:25.827 INFO:tasks.workunit.client.0.smithi057.stdout:8/931: mknod d5/de/d1b/d57/d85/c12d 0 2024-02-28T16:02:25.832 INFO:tasks.workunit.client.0.smithi057.stdout:8/932: write d5/d6/f19 [4131863,19005] 0 2024-02-28T16:02:25.832 INFO:tasks.workunit.client.0.smithi057.stdout:7/846: chown d6/dc/d12/d1a/d4d/d56/f81 10805943 1 2024-02-28T16:02:25.835 INFO:tasks.workunit.client.0.smithi057.stdout:3/874: dwrite d8/dd/d19/f29 [0,4194304] 0 2024-02-28T16:02:25.839 INFO:tasks.workunit.client.0.smithi057.stdout:4/901: unlink d1/d10/d31/d86/dd1/d10c/f11a 0 2024-02-28T16:02:25.841 INFO:tasks.workunit.client.0.smithi057.stdout:8/933: symlink d5/d6/dff/d116/l12e 0 2024-02-28T16:02:25.848 INFO:tasks.workunit.client.0.smithi057.stdout:8/934: creat d5/d6/dff/f12f x:0 0 0 2024-02-28T16:02:25.849 INFO:tasks.workunit.client.0.smithi057.stdout:3/875: write d8/dd/d14/d2e/d30/d6a/f93 [766007,77557] 0 2024-02-28T16:02:25.853 INFO:tasks.workunit.client.0.smithi057.stdout:3/876: read - d8/dd/d14/d2e/d3b/d71/fff zero size 2024-02-28T16:02:25.853 INFO:tasks.workunit.client.0.smithi057.stdout:4/902: truncate d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/d5e/f9f 921907 0 2024-02-28T16:02:25.854 INFO:tasks.workunit.client.0.smithi057.stdout:8/935: symlink d5/d20/d39/d49/d56/d79/dfc/d70/l130 0 2024-02-28T16:02:25.855 INFO:tasks.workunit.client.0.smithi057.stdout:3/877: write d8/d94/ff1 [1364169,82042] 0 2024-02-28T16:02:25.856 INFO:tasks.workunit.client.0.smithi057.stdout:4/903: fsync d1/d22/f35 0 2024-02-28T16:02:25.863 INFO:tasks.workunit.client.0.smithi057.stdout:4/904: mkdir d1/d10/d31/d86/dd1/d116/d121/d132 0 2024-02-28T16:02:25.864 INFO:tasks.workunit.client.0.smithi057.stdout:8/936: link d5/de/d1b/cbd d5/d20/d39/d49/d56/c131 0 2024-02-28T16:02:25.865 INFO:tasks.workunit.client.0.smithi057.stdout:8/937: chown d5/d20/da2/d8d 14 1 2024-02-28T16:02:25.865 INFO:tasks.workunit.client.0.smithi057.stdout:4/905: truncate d1/d10/d31/f11f 1380536 0 2024-02-28T16:02:25.866 INFO:tasks.workunit.client.0.smithi057.stdout:8/938: chown d5/d62 9173404 1 2024-02-28T16:02:25.868 INFO:tasks.workunit.client.0.smithi057.stdout:8/939: mknod d5/d20/da2/c132 0 2024-02-28T16:02:25.869 INFO:tasks.workunit.client.0.smithi057.stdout:4/906: symlink d1/d10/d31/d86/dd1/d10c/d125/d39/de4/l133 0 2024-02-28T16:02:25.872 INFO:tasks.workunit.client.0.smithi057.stdout:4/907: mkdir d1/d10/d31/d86/dd1/d10c/d125/d134 0 2024-02-28T16:02:25.872 INFO:tasks.workunit.client.0.smithi057.stdout:8/940: truncate d5/de/d1b/d57/d85/dbc/f129 455451 0 2024-02-28T16:02:25.878 INFO:tasks.workunit.client.0.smithi057.stdout:4/908: getdents d1/d10/d31/d86/dd1/d10c/d125/d2c/d50 0 2024-02-28T16:02:25.884 INFO:tasks.workunit.client.0.smithi057.stdout:4/909: rename d1/d22/cb5 to d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d10a/c135 0 2024-02-28T16:02:25.886 INFO:tasks.workunit.client.0.smithi057.stdout:4/910: write d1/d10/d31/d86/dd1/d10c/d125/d15/f99 [248781,103183] 0 2024-02-28T16:02:25.896 INFO:tasks.workunit.client.0.smithi057.stdout:8/941: dread d5/f18 [0,4194304] 0 2024-02-28T16:02:25.901 INFO:tasks.workunit.client.0.smithi057.stdout:4/911: truncate d1/d10/d31/d36/f47 1171699 0 2024-02-28T16:02:25.903 INFO:tasks.workunit.client.0.smithi057.stdout:8/942: rename d5/d20/d39/ca4 to d5/d20/d39/d49/c133 0 2024-02-28T16:02:25.905 INFO:tasks.workunit.client.0.smithi057.stdout:4/912: rmdir d1/d10/d31/d86/dd1/d10c/d125/d2c/d37 39 2024-02-28T16:02:25.906 INFO:tasks.workunit.client.0.smithi057.stdout:8/943: truncate d5/d20/d39/f42 4883942 0 2024-02-28T16:02:25.908 INFO:tasks.workunit.client.0.smithi057.stdout:4/913: mkdir d1/d10/d31/d86/dd1/d10c/d125/d2c/d136 0 2024-02-28T16:02:25.909 INFO:tasks.workunit.client.0.smithi057.stdout:8/944: fsync d5/d20/f9a 0 2024-02-28T16:02:25.909 INFO:tasks.workunit.client.0.smithi057.stdout:4/914: chown d1/d10/c29 2461 1 2024-02-28T16:02:25.933 INFO:tasks.workunit.client.0.smithi057.stdout:4/915: dwrite d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/fed [4194304,4194304] 0 2024-02-28T16:02:25.938 INFO:tasks.workunit.client.0.smithi057.stdout:4/916: read d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/fb2 [149617,91630] 0 2024-02-28T16:02:25.947 INFO:tasks.workunit.client.0.smithi057.stdout:4/917: rename d1/d10/d31/d86/dd1/d116/d121 to d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/d5e/d137 0 2024-02-28T16:02:25.948 INFO:tasks.workunit.client.0.smithi057.stdout:4/918: write d1/d22/f24 [1830708,76176] 0 2024-02-28T16:02:25.953 INFO:tasks.workunit.client.0.smithi057.stdout:4/919: fsync d1/d10/d31/d86/dd1/d9b/f9e 0 2024-02-28T16:02:25.959 INFO:tasks.workunit.client.0.smithi057.stdout:4/920: truncate d1/d10/d31/d86/f23 1203674 0 2024-02-28T16:02:25.964 INFO:tasks.workunit.client.0.smithi057.stdout:4/921: rmdir d1/d10/d31/d86/dd1/d116 0 2024-02-28T16:02:25.968 INFO:tasks.workunit.client.0.smithi057.stdout:4/922: dread - d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/fc7 zero size 2024-02-28T16:02:25.971 INFO:tasks.workunit.client.0.smithi057.stdout:4/923: chown d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/d5e/fc6 596807 1 2024-02-28T16:02:25.974 INFO:tasks.workunit.client.0.smithi057.stdout:4/924: creat d1/d10/d31/d86/dd1/d10c/d125/d39/db4/f138 x:0 0 0 2024-02-28T16:02:25.978 INFO:tasks.workunit.client.0.smithi057.stdout:4/925: rename d1/d3f/d5f/lb9 to d1/d10/l139 0 2024-02-28T16:02:26.000 INFO:tasks.workunit.client.0.smithi057.stdout:4/926: write d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/fef [767172,86215] 0 2024-02-28T16:02:26.019 INFO:tasks.workunit.client.0.smithi057.stdout:4/927: dwrite d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/d87/fce [0,4194304] 0 2024-02-28T16:02:26.033 INFO:tasks.workunit.client.0.smithi057.stdout:4/928: rename d1/d22/f35 to d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/f13a 0 2024-02-28T16:02:26.034 INFO:tasks.workunit.client.0.smithi057.stdout:4/929: fdatasync d1/d22/f5c 0 2024-02-28T16:02:26.041 INFO:tasks.workunit.client.0.smithi057.stdout:4/930: creat d1/d10/d31/d86/dd1/d10c/d125/f13b x:0 0 0 2024-02-28T16:02:26.048 INFO:tasks.workunit.client.0.smithi057.stdout:4/931: rename d1/d10/c4f to d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/c13c 0 2024-02-28T16:02:26.057 INFO:tasks.workunit.client.0.smithi057.stdout:4/932: rename d1/db8 to d1/d10/d31/d86/dd1/d10c/d11c/d13d 0 2024-02-28T16:02:26.060 INFO:tasks.workunit.client.0.smithi057.stdout:4/933: creat d1/d22/d114/f13e x:0 0 0 2024-02-28T16:02:26.061 INFO:tasks.workunit.client.0.smithi057.stdout:4/934: truncate d1/d22/f75 1972710 0 2024-02-28T16:02:26.062 INFO:tasks.workunit.client.0.smithi057.stdout:4/935: readlink d1/d3f/lfc 0 2024-02-28T16:02:26.067 INFO:tasks.workunit.client.0.smithi057.stdout:4/936: link d1/d10/d31/d86/dd1/d8c/fa9 d1/f13f 0 2024-02-28T16:02:26.070 INFO:tasks.workunit.client.0.smithi057.stdout:4/937: read d1/d10/d31/d86/f1b [999601,28912] 0 2024-02-28T16:02:26.077 INFO:tasks.workunit.client.0.smithi057.stdout:4/938: dread d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/fb2 [0,4194304] 0 2024-02-28T16:02:26.091 INFO:tasks.workunit.client.0.smithi057.stdout:2/926: sync 2024-02-28T16:02:26.097 INFO:tasks.workunit.client.0.smithi057.stdout:2/927: creat d19/d57/dc7/f136 x:0 0 0 2024-02-28T16:02:26.124 INFO:tasks.workunit.client.0.smithi057.stdout:2/928: dread d19/f37 [0,4194304] 0 2024-02-28T16:02:26.125 INFO:tasks.workunit.client.0.smithi057.stdout:2/929: dread - d19/d1d/d26/ff7 zero size 2024-02-28T16:02:26.129 INFO:tasks.workunit.client.0.smithi057.stdout:2/930: creat d19/d43/ddd/d125/f137 x:0 0 0 2024-02-28T16:02:26.134 INFO:tasks.workunit.client.0.smithi057.stdout:2/931: creat d19/d1d/d26/f138 x:0 0 0 2024-02-28T16:02:26.137 INFO:tasks.workunit.client.0.smithi057.stdout:2/932: chown d19/d2c/d65/de9/f121 545194637 1 2024-02-28T16:02:26.143 INFO:tasks.workunit.client.0.smithi057.stdout:2/933: rename d19/d3a/fb0 to d19/d101/f139 0 2024-02-28T16:02:26.170 INFO:tasks.workunit.client.0.smithi057.stdout:2/934: dwrite d19/d1d/d2e/d31/f50 [4194304,4194304] 0 2024-02-28T16:02:26.180 INFO:tasks.workunit.client.0.smithi057.stdout:2/935: link fe d19/d1d/d26/d117/d135/f13a 0 2024-02-28T16:02:26.201 INFO:tasks.workunit.client.0.smithi057.stdout:2/936: dread d19/d2c/d48/da2/fec [0,4194304] 0 2024-02-28T16:02:26.223 INFO:tasks.workunit.client.0.smithi057.stdout:2/937: dwrite d19/d1d/d2e/f90 [0,4194304] 0 2024-02-28T16:02:26.242 INFO:tasks.workunit.client.0.smithi057.stdout:2/938: link c11 d19/d1d/d26/c13b 0 2024-02-28T16:02:26.246 INFO:tasks.workunit.client.0.smithi057.stdout:2/939: read d19/d1d/f3f [5617350,78898] 0 2024-02-28T16:02:26.248 INFO:tasks.workunit.client.0.smithi057.stdout:2/940: readlink d19/d57/lc8 0 2024-02-28T16:02:26.263 INFO:tasks.workunit.client.0.smithi057.stdout:2/941: truncate d19/d57/fd8 3527977 0 2024-02-28T16:02:26.273 INFO:tasks.workunit.client.0.smithi057.stdout:2/942: rename d19/d2c/l36 to d19/d1d/d22/l13c 0 2024-02-28T16:02:26.294 INFO:tasks.workunit.client.0.smithi057.stdout:2/943: dwrite d19/d1d/f51 [4194304,4194304] 0 2024-02-28T16:02:26.304 INFO:tasks.workunit.client.0.smithi057.stdout:5/889: sync 2024-02-28T16:02:26.305 INFO:tasks.workunit.client.0.smithi057.stdout:6/960: sync 2024-02-28T16:02:26.315 INFO:tasks.workunit.client.0.smithi057.stdout:5/890: creat d2/d12/dd3/f134 x:0 0 0 2024-02-28T16:02:26.322 INFO:tasks.workunit.client.0.smithi057.stdout:6/961: rename df/d10/d78/dca/d15/d16/d39/d8d/ld8 to df/d10/d78/dca/d15/d82/dd7/l13b 0 2024-02-28T16:02:26.331 INFO:tasks.workunit.client.0.smithi057.stdout:5/891: read d2/d12/d76/d7a/d95/db5/dcb/f3a [2600414,43646] 0 2024-02-28T16:02:26.334 INFO:tasks.workunit.client.0.smithi057.stdout:6/962: creat df/d10/d78/dca/d15/d16/d39/d92/da4/f13c x:0 0 0 2024-02-28T16:02:26.339 INFO:tasks.workunit.client.0.smithi057.stdout:2/944: dwrite d19/d1d/d2e/d31/fc6 [0,4194304] 0 2024-02-28T16:02:26.340 INFO:tasks.workunit.client.0.smithi057.stdout:6/963: write df/d10/d78/d5b/d7b/de3/f138 [547333,106265] 0 2024-02-28T16:02:26.348 INFO:tasks.workunit.client.0.smithi057.stdout:6/964: read df/d10/d78/dca/d15/d16/f76 [2391164,102488] 0 2024-02-28T16:02:26.350 INFO:tasks.workunit.client.0.smithi057.stdout:5/892: truncate d2/d15/d5e/d6d/f81 4493744 0 2024-02-28T16:02:26.357 INFO:tasks.workunit.client.0.smithi057.stdout:5/893: mkdir d2/d3e/d5b/db0/d135 0 2024-02-28T16:02:26.357 INFO:tasks.workunit.client.0.smithi057.stdout:3/878: sync 2024-02-28T16:02:26.358 INFO:tasks.workunit.client.0.smithi057.stdout:4/939: sync 2024-02-28T16:02:26.359 INFO:tasks.workunit.client.0.smithi057.stdout:8/945: sync 2024-02-28T16:02:26.359 INFO:tasks.workunit.client.0.smithi057.stdout:7/847: sync 2024-02-28T16:02:26.359 INFO:tasks.workunit.client.0.smithi057.stdout:1/974: sync 2024-02-28T16:02:26.360 INFO:tasks.workunit.client.0.smithi057.stdout:2/945: getdents d19/d2c/d48/da2 0 2024-02-28T16:02:26.364 INFO:tasks.workunit.client.0.smithi057.stdout:8/946: fdatasync d5/d62/d9f/f127 0 2024-02-28T16:02:26.366 INFO:tasks.workunit.client.0.smithi057.stdout:7/848: read d6/dc/d12/f47 [2592147,114915] 0 2024-02-28T16:02:26.368 INFO:tasks.workunit.client.0.smithi057.stdout:2/946: creat d19/d34/d78/f13d x:0 0 0 2024-02-28T16:02:26.369 INFO:tasks.workunit.client.0.smithi057.stdout:7/849: readlink d6/dc/d12/d29/l30 0 2024-02-28T16:02:26.372 INFO:tasks.workunit.client.0.smithi057.stdout:5/894: mkdir d2/d15/d110/d136 0 2024-02-28T16:02:26.375 INFO:tasks.workunit.client.0.smithi057.stdout:5/895: read - d2/d15/d5e/d9a/f114 zero size 2024-02-28T16:02:26.375 INFO:tasks.workunit.client.0.smithi057.stdout:3/879: unlink d8/dd/d19/d25/f7a 0 2024-02-28T16:02:26.376 INFO:tasks.workunit.client.0.smithi057.stdout:1/975: symlink d1/d21/d66/d53/d7d/l13f 0 2024-02-28T16:02:26.377 INFO:tasks.workunit.client.0.smithi057.stdout:8/947: creat d5/d6/dff/f134 x:0 0 0 2024-02-28T16:02:26.380 INFO:tasks.workunit.client.0.smithi057.stdout:1/976: stat d1/d21/d66/d53/ff0 0 2024-02-28T16:02:26.381 INFO:tasks.workunit.client.0.smithi057.stdout:7/850: link d6/dc/d12/d29/f10a d6/dc/d12/dc9/dce/dfc/dfd/f121 0 2024-02-28T16:02:26.381 INFO:tasks.workunit.client.0.smithi057.stdout:3/880: chown d8/dd/d19/d25/fae 129438 1 2024-02-28T16:02:26.383 INFO:tasks.workunit.client.0.smithi057.stdout:5/896: truncate d2/d8/f46 273641 0 2024-02-28T16:02:26.385 INFO:tasks.workunit.client.0.smithi057.stdout:2/947: getdents d19/d1d/d2e/d31/db1 0 2024-02-28T16:02:26.385 INFO:tasks.workunit.client.0.smithi057.stdout:6/965: dwrite df/d10/d78/dca/f43 [0,4194304] 0 2024-02-28T16:02:26.387 INFO:tasks.workunit.client.0.smithi057.stdout:8/948: mkdir d5/de/d1b/d45/d135 0 2024-02-28T16:02:26.393 INFO:tasks.workunit.client.0.smithi057.stdout:3/881: mknod d8/dd/d14/d2e/d30/d49/d86/c130 0 2024-02-28T16:02:26.394 INFO:tasks.workunit.client.0.smithi057.stdout:2/948: dread - d19/d34/d78/d95/f100 zero size 2024-02-28T16:02:26.395 INFO:tasks.workunit.client.0.smithi057.stdout:6/966: write df/d10/d78/dca/d15/d82/fd1 [1621028,51798] 0 2024-02-28T16:02:26.398 INFO:tasks.workunit.client.0.smithi057.stdout:1/977: rename d1/d3/l7b to d1/d3/dc/d15/d4e/d5f/dbe/dd3/l140 0 2024-02-28T16:02:26.399 INFO:tasks.workunit.client.0.smithi057.stdout:8/949: mkdir d5/de/d1b/d45/d135/d136 0 2024-02-28T16:02:26.399 INFO:tasks.workunit.client.0.smithi057.stdout:6/967: write df/d10/d13/f118 [389893,81159] 0 2024-02-28T16:02:26.403 INFO:tasks.workunit.client.0.smithi057.stdout:2/949: rename d19/d43/d5a/fe4 to d19/d2c/d65/de9/f13e 0 2024-02-28T16:02:26.407 INFO:tasks.workunit.client.0.smithi057.stdout:8/950: creat d5/d20/d39/d59/d67/da5/df8/d10c/f137 x:0 0 0 2024-02-28T16:02:26.408 INFO:tasks.workunit.client.0.smithi057.stdout:7/851: dwrite d6/dc/d12/d1a/ff4 [0,4194304] 0 2024-02-28T16:02:26.409 INFO:tasks.workunit.client.0.smithi057.stdout:6/968: creat df/d10/d78/dca/d15/d82/dd7/f13d x:0 0 0 2024-02-28T16:02:26.413 INFO:tasks.workunit.client.0.smithi057.stdout:6/969: chown df/d10/d13/f75 496409320 1 2024-02-28T16:02:26.417 INFO:tasks.workunit.client.0.smithi057.stdout:7/852: getdents d6/dc/d35/db2 0 2024-02-28T16:02:26.424 INFO:tasks.workunit.client.0.smithi057.stdout:8/951: dwrite d5/d20/d39/d59/d67/fb5 [4194304,4194304] 0 2024-02-28T16:02:26.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:26 smithi057 ceph-mon[28763]: pgmap v45: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 52 MiB/s rd, 118 MiB/s wr, 328 op/s 2024-02-28T16:02:26.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:26.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:26 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:26.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:26 smithi057 ceph-mon[28763]: Reconfiguring prometheus.smithi057 (dependencies changed)... 2024-02-28T16:02:26.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:26 smithi057 ceph-mon[28763]: Reconfiguring daemon prometheus.smithi057 on smithi057 2024-02-28T16:02:26.431 INFO:tasks.workunit.client.0.smithi057.stdout:5/897: dread d2/d15/d63/de7/fe8 [0,4194304] 0 2024-02-28T16:02:26.431 INFO:tasks.workunit.client.0.smithi057.stdout:8/952: rmdir d5/d20/d39/d8c 39 2024-02-28T16:02:26.435 INFO:tasks.workunit.client.0.smithi057.stdout:7/853: getdents d6/dc/d35 0 2024-02-28T16:02:26.437 INFO:tasks.workunit.client.0.smithi057.stdout:8/953: symlink d5/d62/d9f/l138 0 2024-02-28T16:02:26.439 INFO:tasks.workunit.client.0.smithi057.stdout:5/898: creat d2/d12/d3d/d8a/f137 x:0 0 0 2024-02-28T16:02:26.440 INFO:tasks.workunit.client.0.smithi057.stdout:5/899: readlink d2/d19/l9f 0 2024-02-28T16:02:26.441 INFO:tasks.workunit.client.0.smithi057.stdout:7/854: symlink d6/dc/d35/d58/dd5/l122 0 2024-02-28T16:02:26.443 INFO:tasks.workunit.client.0.smithi057.stdout:1/978: write d1/d3/dc/d15/da3/fef [891855,79446] 0 2024-02-28T16:02:26.443 INFO:tasks.workunit.client.0.smithi057.stdout:5/900: symlink d2/d15/l138 0 2024-02-28T16:02:26.450 INFO:tasks.workunit.client.0.smithi057.stdout:8/954: creat d5/f139 x:0 0 0 2024-02-28T16:02:26.459 INFO:tasks.workunit.client.0.smithi057.stdout:1/979: rename d1/d21/d66/d53/d7d/d67/d7a to d1/d21/d66/d53/d62/d73/d10c/d141 0 2024-02-28T16:02:26.459 INFO:tasks.workunit.client.0.smithi057.stdout:6/970: dwrite df/f12 [0,4194304] 0 2024-02-28T16:02:26.459 INFO:tasks.workunit.client.0.smithi057.stdout:7/855: dread d6/dc/d35/d58/dd5/fe1 [0,4194304] 0 2024-02-28T16:02:26.463 INFO:tasks.workunit.client.0.smithi057.stdout:7/856: chown d6/dc/d12/d1a/d4d/df0/f120 12393 1 2024-02-28T16:02:26.464 INFO:tasks.workunit.client.0.smithi057.stdout:1/980: creat d1/d21/d66/d53/d62/d73/d10c/d141/d92/f142 x:0 0 0 2024-02-28T16:02:26.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:26 smithi087 ceph-mon[37122]: pgmap v45: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 52 MiB/s rd, 118 MiB/s wr, 328 op/s 2024-02-28T16:02:26.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:26.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:26 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:26.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:26 smithi087 ceph-mon[37122]: Reconfiguring prometheus.smithi057 (dependencies changed)... 2024-02-28T16:02:26.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:26 smithi087 ceph-mon[37122]: Reconfiguring daemon prometheus.smithi057 on smithi057 2024-02-28T16:02:26.466 INFO:tasks.workunit.client.0.smithi057.stdout:8/955: link d5/d20/da2/d102/f104 d5/d20/d39/d49/d56/d79/dfc/d70/f13a 0 2024-02-28T16:02:26.467 INFO:tasks.workunit.client.0.smithi057.stdout:1/981: chown d1/d21/d66/d44/c4d 16 1 2024-02-28T16:02:26.470 INFO:tasks.workunit.client.0.smithi057.stdout:5/901: dwrite d2/d12/d76/d7a/d95/db5/dcb/dab/d12c/d62/da3/fe2 [0,4194304] 0 2024-02-28T16:02:26.473 INFO:tasks.workunit.client.0.smithi057.stdout:8/956: unlink d5/d20/d39/d49/d56/d79/dfc/la9 0 2024-02-28T16:02:26.481 INFO:tasks.workunit.client.0.smithi057.stdout:7/857: dread d6/dc/d35/d58/dd5/fe1 [0,4194304] 0 2024-02-28T16:02:26.485 INFO:tasks.workunit.client.0.smithi057.stdout:6/971: dwrite df/d10/d78/f91 [0,4194304] 0 2024-02-28T16:02:26.488 INFO:tasks.workunit.client.0.smithi057.stdout:1/982: dwrite d1/d21/d25/f64 [0,4194304] 0 2024-02-28T16:02:26.488 INFO:tasks.workunit.client.0.smithi057.stdout:6/972: write df/d61/d66/f11e [2979515,54759] 0 2024-02-28T16:02:26.492 INFO:tasks.workunit.client.0.smithi057.stdout:8/957: write d5/de/f7e [4995694,65765] 0 2024-02-28T16:02:26.492 INFO:tasks.workunit.client.0.smithi057.stdout:7/858: write d6/d26/df8/f113 [1041276,91516] 0 2024-02-28T16:02:26.497 INFO:tasks.workunit.client.0.smithi057.stdout:8/958: creat d5/d62/d115/f13b x:0 0 0 2024-02-28T16:02:26.497 INFO:tasks.workunit.client.0.smithi057.stdout:1/983: mknod d1/d3/dc/d15/d4e/d5f/dbe/dd3/c143 0 2024-02-28T16:02:26.503 INFO:tasks.workunit.client.0.smithi057.stdout:8/959: mkdir d5/d20/d39/d6e/daf/d13c 0 2024-02-28T16:02:26.503 INFO:tasks.workunit.client.0.smithi057.stdout:7/859: mknod d6/dc/d12/d1a/d4d/d56/db0/d10d/c123 0 2024-02-28T16:02:26.509 INFO:tasks.workunit.client.0.smithi057.stdout:8/960: mkdir d5/df2/d13d 0 2024-02-28T16:02:26.512 INFO:tasks.workunit.client.0.smithi057.stdout:8/961: write d5/de/d1b/d57/d91/de9/fed [2326748,56166] 0 2024-02-28T16:02:26.520 INFO:tasks.workunit.client.0.smithi057.stdout:6/973: dwrite df/d10/d78/dca/d15/d16/d39/fae [0,4194304] 0 2024-02-28T16:02:26.524 INFO:tasks.workunit.client.0.smithi057.stdout:7/860: dwrite d6/dc/d67/f8a [0,4194304] 0 2024-02-28T16:02:26.526 INFO:tasks.workunit.client.0.smithi057.stdout:7/861: fdatasync d6/dc/d67/d9a/fe3 0 2024-02-28T16:02:26.529 INFO:tasks.workunit.client.0.smithi057.stdout:8/962: rename d5/de/d1b/d45 to d5/de/d1b/d57/d13e 0 2024-02-28T16:02:26.539 INFO:tasks.workunit.client.0.smithi057.stdout:6/974: rename df/d10/d13/d4b/dcc/d11f/f137 to df/d10/d78/dca/d15/d16/d39/d92/d11c/f13e 0 2024-02-28T16:02:26.540 INFO:tasks.workunit.client.0.smithi057.stdout:7/862: unlink d6/dc/f11 0 2024-02-28T16:02:26.543 INFO:tasks.workunit.client.0.smithi057.stdout:8/963: creat d5/d20/d39/d6e/daf/f13f x:0 0 0 2024-02-28T16:02:26.544 INFO:tasks.workunit.client.0.smithi057.stdout:8/964: chown d5/de/d1b 1267 1 2024-02-28T16:02:26.545 INFO:tasks.workunit.client.0.smithi057.stdout:1/984: dread d1/d3/f3b [4194304,4194304] 0 2024-02-28T16:02:26.548 INFO:tasks.workunit.client.0.smithi057.stdout:1/985: stat d1/d21/d66/d53/d62/d73/fcd 0 2024-02-28T16:02:26.551 INFO:tasks.workunit.client.0.smithi057.stdout:7/863: mknod d6/dc/d12/d29/c124 0 2024-02-28T16:02:26.556 INFO:tasks.workunit.client.0.smithi057.stdout:7/864: chown d6/dc/d12/d1a/d4d/f109 3 1 2024-02-28T16:02:26.557 INFO:tasks.workunit.client.0.smithi057.stdout:8/965: rename d5/l9d to d5/l140 0 2024-02-28T16:02:26.564 INFO:tasks.workunit.client.0.smithi057.stdout:6/975: dwrite df/d61/dbb/f114 [0,4194304] 0 2024-02-28T16:02:26.565 INFO:tasks.workunit.client.0.smithi057.stdout:6/976: chown df/d61 16037576 1 2024-02-28T16:02:26.566 INFO:tasks.workunit.client.0.smithi057.stdout:7/865: unlink d6/dc/d12/d1a/ff4 0 2024-02-28T16:02:26.574 INFO:tasks.workunit.client.0.smithi057.stdout:8/966: creat d5/d20/d39/d49/d56/d79/f141 x:0 0 0 2024-02-28T16:02:26.578 INFO:tasks.workunit.client.0.smithi057.stdout:6/977: creat df/d10/d13/d4b/f13f x:0 0 0 2024-02-28T16:02:26.578 INFO:tasks.workunit.client.0.smithi057.stdout:8/967: rmdir d5/de/d1b/d4b 39 2024-02-28T16:02:26.581 INFO:tasks.workunit.client.0.smithi057.stdout:1/986: dread d1/d3/dc/f12 [0,4194304] 0 2024-02-28T16:02:26.582 INFO:tasks.workunit.client.0.smithi057.stdout:8/968: chown d5/d20/l69 89 1 2024-02-28T16:02:26.589 INFO:tasks.workunit.client.0.smithi057.stdout:7/866: write d6/dc/d12/dc9/dce/fd3 [961871,32412] 0 2024-02-28T16:02:26.591 INFO:tasks.workunit.client.0.smithi057.stdout:1/987: write d1/d21/d25/fc5 [735511,79373] 0 2024-02-28T16:02:26.594 INFO:tasks.workunit.client.0.smithi057.stdout:7/867: readlink d6/dc/d35/d58/l71 0 2024-02-28T16:02:26.596 INFO:tasks.workunit.client.0.smithi057.stdout:8/969: dread d5/d20/d39/dd9/f114 [0,4194304] 0 2024-02-28T16:02:26.596 INFO:tasks.workunit.client.0.smithi057.stdout:1/988: creat d1/d21/d66/d53/dca/d11e/f144 x:0 0 0 2024-02-28T16:02:26.598 INFO:tasks.workunit.client.0.smithi057.stdout:7/868: creat d6/dc/d35/db2/f125 x:0 0 0 2024-02-28T16:02:26.600 INFO:tasks.workunit.client.0.smithi057.stdout:7/869: chown d6/dc/dab/ff9 120396343 1 2024-02-28T16:02:26.602 INFO:tasks.workunit.client.0.smithi057.stdout:7/870: chown d6/dc/d67/d9a/da1/fbb 1227 1 2024-02-28T16:02:26.603 INFO:tasks.workunit.client.0.smithi057.stdout:8/970: rename d5/de/d1b/f35 to d5/d20/d39/d59/db7/dcc/f142 0 2024-02-28T16:02:26.605 INFO:tasks.workunit.client.0.smithi057.stdout:1/989: getdents d1/d21/d66/d53/d62/d73/d10c/d141/d94 0 2024-02-28T16:02:26.608 INFO:tasks.workunit.client.0.smithi057.stdout:8/971: write d5/d20/d39/d49/d56/f51 [3378392,124938] 0 2024-02-28T16:02:26.609 INFO:tasks.workunit.client.0.smithi057.stdout:1/990: rmdir d1/d21/d66/d53/d7d/d67/d6c/d82 39 2024-02-28T16:02:26.611 INFO:tasks.workunit.client.0.smithi057.stdout:6/978: dread df/d10/d78/dca/d15/d16/d39/d92/f93 [4194304,4194304] 0 2024-02-28T16:02:26.612 INFO:tasks.workunit.client.0.smithi057.stdout:7/871: write d6/dc/f43 [907191,41663] 0 2024-02-28T16:02:26.617 INFO:tasks.workunit.client.0.smithi057.stdout:6/979: symlink df/d10/d13/d70/l140 0 2024-02-28T16:02:26.618 INFO:tasks.workunit.client.0.smithi057.stdout:7/872: readlink d6/dc/d12/d1a/d4d/df0/l100 0 2024-02-28T16:02:26.618 INFO:tasks.workunit.client.0.smithi057.stdout:8/972: link d5/de/d1b/d57/d13e/d81/c112 d5/c143 0 2024-02-28T16:02:26.621 INFO:tasks.workunit.client.0.smithi057.stdout:6/980: creat df/d10/d78/d5b/d7b/f141 x:0 0 0 2024-02-28T16:02:26.621 INFO:tasks.workunit.client.0.smithi057.stdout:7/873: write d6/dc/d67/fbe [565152,63368] 0 2024-02-28T16:02:26.626 INFO:tasks.workunit.client.0.smithi057.stdout:6/981: symlink df/d10/d13/d70/d119/l142 0 2024-02-28T16:02:26.626 INFO:tasks.workunit.client.0.smithi057.stdout:7/874: symlink d6/dc/d35/db2/l126 0 2024-02-28T16:02:26.630 INFO:tasks.workunit.client.0.smithi057.stdout:1/991: dwrite d1/d21/d25/df7/f12d [0,4194304] 0 2024-02-28T16:02:26.631 INFO:tasks.workunit.client.0.smithi057.stdout:4/940: sync 2024-02-28T16:02:26.636 INFO:tasks.workunit.client.0.smithi057.stdout:8/973: dread d5/d6/f36 [0,4194304] 0 2024-02-28T16:02:26.639 INFO:tasks.workunit.client.0.smithi057.stdout:6/982: rename df/d10/d78/dca/d15/d16/d39/d92/da4/l125 to df/d61/l143 0 2024-02-28T16:02:26.641 INFO:tasks.workunit.client.0.smithi057.stdout:8/974: creat d5/de/d1b/d57/d13e/f144 x:0 0 0 2024-02-28T16:02:26.644 INFO:tasks.workunit.client.0.smithi057.stdout:6/983: symlink df/d10/d78/dca/d15/d16/d39/d92/da4/l144 0 2024-02-28T16:02:26.646 INFO:tasks.workunit.client.0.smithi057.stdout:8/975: unlink d5/de/f4a 0 2024-02-28T16:02:26.647 INFO:tasks.workunit.client.0.smithi057.stdout:6/984: mknod df/d10/d78/dd6/c145 0 2024-02-28T16:02:26.653 INFO:tasks.workunit.client.0.smithi057.stdout:6/985: read df/d61/fba [813829,53676] 0 2024-02-28T16:02:26.653 INFO:tasks.workunit.client.0.smithi057.stdout:1/992: dwrite d1/d21/d66/d44/d4c/d75/fed [0,4194304] 0 2024-02-28T16:02:26.655 INFO:tasks.workunit.client.0.smithi057.stdout:8/976: link d5/d20/d39/d49/f54 d5/d20/d39/d6e/daf/f145 0 2024-02-28T16:02:26.659 INFO:tasks.workunit.client.0.smithi057.stdout:7/875: dwrite d6/dc/d12/d1a/d4c/d63/f80 [0,4194304] 0 2024-02-28T16:02:26.664 INFO:tasks.workunit.client.0.smithi057.stdout:8/977: symlink d5/de/d1b/l146 0 2024-02-28T16:02:26.669 INFO:tasks.workunit.client.0.smithi057.stdout:6/986: rename df/d10/d78/dca/d15/d16/d39/d92/da4/dad/f9a to df/d10/d78/dca/d15/d82/dd7/f146 0 2024-02-28T16:02:26.673 INFO:tasks.workunit.client.0.smithi057.stdout:1/993: creat d1/d21/d66/d53/d7d/d67/f145 x:0 0 0 2024-02-28T16:02:26.674 INFO:tasks.workunit.client.0.smithi057.stdout:7/876: creat d6/dc/d35/d58/f127 x:0 0 0 2024-02-28T16:02:26.676 INFO:tasks.workunit.client.0.smithi057.stdout:8/978: rename d5/d20/d39/d49/d56/d79/dfc/d70/l118 to d5/df2/l147 0 2024-02-28T16:02:26.677 INFO:tasks.workunit.client.0.smithi057.stdout:6/987: mkdir df/d10/d78/dca/dd0/d103/d147 0 2024-02-28T16:02:26.677 INFO:tasks.workunit.client.0.smithi057.stdout:8/979: dread - d5/f139 zero size 2024-02-28T16:02:26.679 INFO:tasks.workunit.client.0.smithi057.stdout:8/980: chown d5/d20/d39/d59/d67/da5/df8/d10c 595093597 1 2024-02-28T16:02:26.679 INFO:tasks.workunit.client.0.smithi057.stdout:1/994: fsync d1/d21/d66/d53/fbc 0 2024-02-28T16:02:26.687 INFO:tasks.workunit.client.0.smithi057.stdout:6/988: creat df/d10/d78/dca/d15/d16/d10d/f148 x:0 0 0 2024-02-28T16:02:26.688 INFO:tasks.workunit.client.0.smithi057.stdout:8/981: mknod d5/d20/d39/d59/c148 0 2024-02-28T16:02:26.688 INFO:tasks.workunit.client.0.smithi057.stdout:6/989: stat df/d10/d78/f91 0 2024-02-28T16:02:26.689 INFO:tasks.workunit.client.0.smithi057.stdout:4/941: dread d1/d3f/d5f/f83 [0,4194304] 0 2024-02-28T16:02:26.693 INFO:tasks.workunit.client.0.smithi057.stdout:4/942: chown d1/d10/d31/d86/dd1/d10c/d125/d2c/d50/dff/d103/lf5 5314291 1 2024-02-28T16:02:26.697 INFO:tasks.workunit.client.0.smithi057.stdout:1/995: creat d1/d21/d66/d53/d7d/d67/d6c/d82/d112/d126/d13e/f146 x:0 0 0 2024-02-28T16:02:26.698 INFO:tasks.workunit.client.0.smithi057.stdout:6/990: mknod df/d10/d78/dca/dd0/d103/d147/c149 0 2024-02-28T16:02:26.699 INFO:tasks.workunit.client.0.smithi057.stdout:6/991: read df/f12 [4112261,36174] 0 2024-02-28T16:02:26.699 INFO:tasks.workunit.client.0.smithi057.stdout:4/943: symlink d1/d10/d31/d86/dd1/d10c/l140 0 2024-02-28T16:02:26.700 INFO:tasks.workunit.client.0.smithi057.stdout:7/877: write d6/dc/f112 [1671724,35173] 0 2024-02-28T16:02:26.703 INFO:tasks.workunit.client.0.smithi057.stdout:1/996: creat d1/d21/d66/d53/d62/d73/d10c/f147 x:0 0 0 2024-02-28T16:02:26.706 INFO:tasks.workunit.client.0.smithi057.stdout:8/982: write d5/de/d1b/f25 [3809746,119580] 0 2024-02-28T16:02:26.713 INFO:tasks.workunit.client.0.smithi057.stdout:7/878: getdents d6/dc/d12 0 2024-02-28T16:02:26.714 INFO:tasks.workunit.client.0.smithi057.stdout:8/983: creat d5/d20/d39/d59/db7/dea/d11c/f149 x:0 0 0 2024-02-28T16:02:26.715 INFO:tasks.workunit.client.0.smithi057.stdout:4/944: creat d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/f141 x:0 0 0 2024-02-28T16:02:26.719 INFO:tasks.workunit.client.0.smithi057.stdout:8/984: unlink d5/d20/d39/d59/ff6 0 2024-02-28T16:02:26.728 INFO:tasks.workunit.client.0.smithi057.stdout:1/997: dwrite d1/d21/d66/d53/d62/d73/d10c/f147 [0,4194304] 0 2024-02-28T16:02:26.731 INFO:tasks.workunit.client.0.smithi057.stdout:1/998: write d1/d21/d66/f110 [256331,50823] 0 2024-02-28T16:02:26.736 INFO:tasks.workunit.client.0.smithi057.stdout:7/879: dwrite d6/dc/d35/d58/f9e [0,4194304] 0 2024-02-28T16:02:26.746 INFO:tasks.workunit.client.0.smithi057.stdout:4/945: dwrite d1/d10/d31/d86/dd1/d10c/d125/d2c/fe1 [0,4194304] 0 2024-02-28T16:02:26.752 INFO:tasks.workunit.client.0.smithi057.stdout:4/946: chown d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/df4 3 1 2024-02-28T16:02:26.752 INFO:tasks.workunit.client.0.smithi057.stdout:7/880: dread d6/dc/d35/da6/faf [0,4194304] 0 2024-02-28T16:02:26.762 INFO:tasks.workunit.client.0.smithi057.stdout:7/881: chown d6/dc/c33 44899 1 2024-02-28T16:02:26.762 INFO:tasks.workunit.client.0.smithi057.stdout:4/947: truncate d1/d10/d31/d86/dd1/d10c/d125/d2c/d50/dff/d103/fd3 1520193 0 2024-02-28T16:02:26.768 INFO:tasks.workunit.client.0.smithi057.stdout:7/882: rename d6/dc/d35/l7d to d6/dc/d35/da6/l128 0 2024-02-28T16:02:26.769 INFO:tasks.workunit.client.0.smithi057.stdout:4/948: mkdir d1/d10/d31/d86/dd1/d10c/d125/d39/db4/d142 0 2024-02-28T16:02:26.770 INFO:tasks.workunit.client.0.smithi057.stdout:4/949: readlink d1/d22/l51 0 2024-02-28T16:02:26.772 INFO:tasks.workunit.client.0.smithi057.stdout:7/883: write d6/dc/fd [1148659,27802] 0 2024-02-28T16:02:26.775 INFO:tasks.workunit.client.0.smithi057.stdout:7/884: fsync d6/d26/f36 0 2024-02-28T16:02:26.779 INFO:tasks.workunit.client.0.smithi057.stdout:7/885: dread - d6/dc/d12/d1a/d4d/dd9/dde/fe4 zero size 2024-02-28T16:02:26.783 INFO:tasks.workunit.client.0.smithi057.stdout:7/886: truncate d6/f23 204735 0 2024-02-28T16:02:26.785 INFO:tasks.workunit.client.0.smithi057.stdout:7/887: truncate d6/dc/d12/f47 4672992 0 2024-02-28T16:02:26.791 INFO:tasks.workunit.client.0.smithi057.stdout:1/999: dread d1/d21/d66/d53/fcf [0,4194304] 0 2024-02-28T16:02:26.793 INFO:tasks.workunit.client.0.smithi057.stdout:7/888: rename d6/dc/d12/d1a/d90 to d6/dc/d67/d9a/da1/d129 0 2024-02-28T16:02:26.798 INFO:tasks.workunit.client.0.smithi057.stdout:8/985: dwrite d5/d20/d39/d6e/daf/f145 [0,4194304] 0 2024-02-28T16:02:26.798 INFO:tasks.workunit.client.0.smithi057.stdout:7/889: chown d6/dc/d67/d9a/da1/l118 7 1 2024-02-28T16:02:26.800 INFO:tasks.workunit.client.0.smithi057.stdout:4/950: dwrite d1/d10/d31/d86/dd1/d10c/d125/d15/f5b [0,4194304] 0 2024-02-28T16:02:26.801 INFO:tasks.workunit.client.0.smithi057.stdout:7/890: write d6/d38/f44 [2626235,26998] 0 2024-02-28T16:02:26.805 INFO:tasks.workunit.client.0.smithi057.stdout:8/986: mkdir d5/d20/d39/d59/d106/d14a 0 2024-02-28T16:02:26.806 INFO:tasks.workunit.client.0.smithi057.stdout:4/951: truncate d1/d10/d31/d36/f11d 857424 0 2024-02-28T16:02:26.806 INFO:tasks.workunit.client.0.smithi057.stdout:7/891: chown d6/dc/d35/db2/f125 33253731 1 2024-02-28T16:02:26.807 INFO:tasks.workunit.client.0.smithi057.stdout:8/987: dread - d5/d6/dff/f12f zero size 2024-02-28T16:02:26.810 INFO:tasks.workunit.client.0.smithi057.stdout:7/892: mknod d6/dc/d12/dc9/dce/dfc/c12a 0 2024-02-28T16:02:26.816 INFO:tasks.workunit.client.0.smithi057.stdout:4/952: creat d1/d10/d31/d86/dd1/d10c/d125/d39/db4/de7/dfd/f143 x:0 0 0 2024-02-28T16:02:26.816 INFO:tasks.workunit.client.0.smithi057.stdout:7/893: symlink d6/dc/dab/dcf/l12b 0 2024-02-28T16:02:26.822 INFO:tasks.workunit.client.0.smithi057.stdout:7/894: rename d6/d26/l77 to d6/dc/d35/db2/l12c 0 2024-02-28T16:02:26.827 INFO:tasks.workunit.client.0.smithi057.stdout:8/988: dwrite d5/d20/d39/d49/d56/d84/f10b [0,4194304] 0 2024-02-28T16:02:26.829 INFO:tasks.workunit.client.0.smithi057.stdout:8/989: readlink d5/de/l34 0 2024-02-28T16:02:26.830 INFO:tasks.workunit.client.0.smithi057.stdout:4/953: dread d1/d10/d31/d86/dd1/d10c/d125/d2c/dd9/ff9 [0,4194304] 0 2024-02-28T16:02:26.830 INFO:tasks.workunit.client.0.smithi057.stdout:7/895: getdents d6/dc/d12/d1a/d4d/dd9 0 2024-02-28T16:02:26.832 INFO:tasks.workunit.client.0.smithi057.stdout:7/896: readlink d6/dc/d67/d9a/da1/d129/lbd 0 2024-02-28T16:02:26.835 INFO:tasks.workunit.client.0.smithi057.stdout:7/897: creat d6/d38/f12d x:0 0 0 2024-02-28T16:02:26.837 INFO:tasks.workunit.client.0.smithi057.stdout:7/898: dread - d6/dc/d35/f84 zero size 2024-02-28T16:02:26.839 INFO:tasks.workunit.client.0.smithi057.stdout:4/954: truncate d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/d87/fce 4900314 0 2024-02-28T16:02:26.841 INFO:tasks.workunit.client.0.smithi057.stdout:7/899: creat d6/dc/dab/d11e/f12e x:0 0 0 2024-02-28T16:02:26.846 INFO:tasks.workunit.client.0.smithi057.stdout:8/990: truncate d5/de/d1b/d4b/f5d 93618 0 2024-02-28T16:02:26.847 INFO:tasks.workunit.client.0.smithi057.stdout:4/955: symlink d1/d10/d31/d86/dd1/d10c/d125/d39/db4/de7/l144 0 2024-02-28T16:02:26.851 INFO:tasks.workunit.client.0.smithi057.stdout:8/991: getdents d5/d20/da2/d8d 0 2024-02-28T16:02:26.852 INFO:tasks.workunit.client.0.smithi057.stdout:7/900: dread d6/dc/d12/d1a/d4d/f69 [0,4194304] 0 2024-02-28T16:02:26.854 INFO:tasks.workunit.client.0.smithi057.stdout:4/956: rename d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac to d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/d87/d145 22 2024-02-28T16:02:26.858 INFO:tasks.workunit.client.0.smithi057.stdout:7/901: dread d6/dc/d67/d9a/da1/fec [0,4194304] 0 2024-02-28T16:02:26.859 INFO:tasks.workunit.client.0.smithi057.stdout:7/902: readlink d6/l9 0 2024-02-28T16:02:26.862 INFO:tasks.workunit.client.0.smithi057.stdout:7/903: write d6/dc/d12/d1a/d4d/dd9/dde/f104 [351369,6982] 0 2024-02-28T16:02:26.865 INFO:tasks.workunit.client.0.smithi057.stdout:7/904: chown d6/dc/d35/d58/f10f 26206867 1 2024-02-28T16:02:26.867 INFO:tasks.workunit.client.0.smithi057.stdout:8/992: dread d5/d20/d39/d49/d56/d79/dfc/d70/f11d [0,4194304] 0 2024-02-28T16:02:26.868 INFO:tasks.workunit.client.0.smithi057.stdout:7/905: write d6/dc/d12/d1a/d4d/df0/f120 [238143,119301] 0 2024-02-28T16:02:26.871 INFO:tasks.workunit.client.0.smithi057.stdout:8/993: creat d5/de/d1b/d57/d91/f14b x:0 0 0 2024-02-28T16:02:26.872 INFO:tasks.workunit.client.0.smithi057.stdout:7/906: creat d6/dc/dab/d107/f12f x:0 0 0 2024-02-28T16:02:26.873 INFO:tasks.workunit.client.0.smithi057.stdout:8/994: fdatasync d5/d20/d39/d49/f54 0 2024-02-28T16:02:26.876 INFO:tasks.workunit.client.0.smithi057.stdout:7/907: creat d6/dc/d67/d9a/f130 x:0 0 0 2024-02-28T16:02:26.881 INFO:tasks.workunit.client.0.smithi057.stdout:8/995: write d5/d20/d39/d59/db7/dcc/f103 [1645480,95000] 0 2024-02-28T16:02:26.882 INFO:tasks.workunit.client.0.smithi057.stdout:4/957: dread d1/d3f/d5f/f72 [0,4194304] 0 2024-02-28T16:02:26.883 INFO:tasks.workunit.client.0.smithi057.stdout:8/996: fdatasync d5/de/f4d 0 2024-02-28T16:02:26.887 INFO:tasks.workunit.client.0.smithi057.stdout:4/958: rmdir d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d10a 39 2024-02-28T16:02:26.888 INFO:tasks.workunit.client.0.smithi057.stdout:4/959: chown d1/l30 3 1 2024-02-28T16:02:26.889 INFO:tasks.workunit.client.0.smithi057.stdout:8/997: creat d5/d20/d39/d49/d56/d79/f14c x:0 0 0 2024-02-28T16:02:26.892 INFO:tasks.workunit.client.0.smithi057.stdout:8/998: chown d5/de/d1b/d57/d85/lc9 82896095 1 2024-02-28T16:02:26.892 INFO:tasks.workunit.client.0.smithi057.stdout:7/908: dwrite d6/dc/d67/d9a/fe3 [0,4194304] 0 2024-02-28T16:02:26.898 INFO:tasks.workunit.client.0.smithi057.stdout:4/960: write d1/d3f/d5f/fec [785566,110522] 0 2024-02-28T16:02:26.910 INFO:tasks.workunit.client.0.smithi057.stdout:8/999: dwrite d5/de/d1b/d57/f5e [0,4194304] 0 2024-02-28T16:02:26.931 INFO:tasks.workunit.client.0.smithi057.stdout:4/961: dread d1/d22/f24 [0,4194304] 0 2024-02-28T16:02:26.933 INFO:tasks.workunit.client.0.smithi057.stdout:4/962: truncate d1/d22/d114/f13e 675387 0 2024-02-28T16:02:26.937 INFO:tasks.workunit.client.0.smithi057.stdout:4/963: creat d1/d10/d31/d86/dd1/d10c/d125/d39/db4/de7/f146 x:0 0 0 2024-02-28T16:02:26.938 INFO:tasks.workunit.client.0.smithi057.stdout:4/964: fsync d1/d22/f5c 0 2024-02-28T16:02:26.941 INFO:tasks.workunit.client.0.smithi057.stdout:4/965: fdatasync d1/d10/f8e 0 2024-02-28T16:02:26.948 INFO:tasks.workunit.client.0.smithi057.stdout:4/966: rename d1/d10/d31/d86/dd1/d10c/d11c/f128 to d1/d10/d31/d86/dd1/d10c/d125/d39/db4/d11b/f147 0 2024-02-28T16:02:26.957 INFO:tasks.workunit.client.0.smithi057.stdout:4/967: dread d1/d10/d31/d86/dd1/d10c/d125/d39/db4/d11b/f147 [0,4194304] 0 2024-02-28T16:02:26.983 INFO:tasks.workunit.client.0.smithi057.stdout:4/968: dread d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/f2b [0,4194304] 0 2024-02-28T16:02:26.988 INFO:tasks.workunit.client.0.smithi057.stdout:4/969: creat d1/d10/d31/d86/dd1/d10c/d125/f148 x:0 0 0 2024-02-28T16:02:26.993 INFO:tasks.workunit.client.0.smithi057.stdout:4/970: creat d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/f149 x:0 0 0 2024-02-28T16:02:27.017 INFO:tasks.workunit.client.0.smithi057.stdout:4/971: dwrite d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/f12b [0,4194304] 0 2024-02-28T16:02:27.025 INFO:tasks.workunit.client.0.smithi057.stdout:4/972: write d1/d10/d31/f60 [5161605,47440] 0 2024-02-28T16:02:27.032 INFO:tasks.workunit.client.0.smithi057.stdout:4/973: write d1/d10/d31/d86/dd1/d10c/d125/d15/f130 [1013363,107711] 0 2024-02-28T16:02:27.037 INFO:tasks.workunit.client.0.smithi057.stdout:4/974: write d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/f149 [926476,8296] 0 2024-02-28T16:02:27.054 INFO:tasks.workunit.client.0.smithi057.stdout:4/975: dwrite d1/d10/d31/d86/f33 [4194304,4194304] 0 2024-02-28T16:02:27.057 INFO:tasks.workunit.client.0.smithi057.stdout:3/882: sync 2024-02-28T16:02:27.061 INFO:tasks.workunit.client.0.smithi057.stdout:4/976: fdatasync d1/d22/f2a 0 2024-02-28T16:02:27.064 INFO:tasks.workunit.client.0.smithi057.stdout:3/883: unlink d8/dd/cb2 0 2024-02-28T16:02:27.069 INFO:tasks.workunit.client.0.smithi057.stdout:3/884: symlink d8/dd/d19/d2a/de3/d11e/l131 0 2024-02-28T16:02:27.070 INFO:tasks.workunit.client.0.smithi057.stdout:4/977: dread d1/f28 [0,4194304] 0 2024-02-28T16:02:27.072 INFO:tasks.workunit.client.0.smithi057.stdout:3/885: symlink d8/d4b/dd2/l132 0 2024-02-28T16:02:27.082 INFO:tasks.workunit.client.0.smithi057.stdout:3/886: rename d8/dd/d19 to d8/dd/d14/d2c/db9/d133 0 2024-02-28T16:02:27.083 INFO:tasks.workunit.client.0.smithi057.stdout:3/887: chown d8/d26/dfb 612292 1 2024-02-28T16:02:27.087 INFO:tasks.workunit.client.0.smithi057.stdout:4/978: dwrite d1/d10/d31/d86/dd1/d10c/d125/d2c/d50/f6c [0,4194304] 0 2024-02-28T16:02:27.088 INFO:tasks.workunit.client.0.smithi057.stdout:3/888: truncate d8/dd/d14/d2e/d2f/ff3 121199 0 2024-02-28T16:02:27.096 INFO:tasks.workunit.client.0.smithi057.stdout:4/979: creat d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/d5e/f14a x:0 0 0 2024-02-28T16:02:27.099 INFO:tasks.workunit.client.0.smithi057.stdout:4/980: write d1/d22/d114/f13e [679743,61788] 0 2024-02-28T16:02:27.101 INFO:tasks.workunit.client.0.smithi057.stdout:2/950: sync 2024-02-28T16:02:27.101 INFO:tasks.workunit.client.0.smithi057.stdout:6/992: sync 2024-02-28T16:02:27.101 INFO:tasks.workunit.client.0.smithi057.stdout:5/902: sync 2024-02-28T16:02:27.103 INFO:tasks.workunit.client.0.smithi057.stdout:2/951: fsync d19/d57/dc7/f136 0 2024-02-28T16:02:27.105 INFO:tasks.workunit.client.0.smithi057.stdout:5/903: symlink d2/d19/l139 0 2024-02-28T16:02:27.108 INFO:tasks.workunit.client.0.smithi057.stdout:6/993: creat df/d10/d78/dca/dd0/d103/d147/f14a x:0 0 0 2024-02-28T16:02:27.111 INFO:tasks.workunit.client.0.smithi057.stdout:3/889: dwrite d8/dd/d14/d2e/d76/d89/de2/f129 [0,4194304] 0 2024-02-28T16:02:27.112 INFO:tasks.workunit.client.0.smithi057.stdout:4/981: mkdir d1/d10/d31/d86/dd1/d10c/d125/d39/db4/d12c/d14b 0 2024-02-28T16:02:27.112 INFO:tasks.workunit.client.0.smithi057.stdout:2/952: creat d19/d43/df2/f13f x:0 0 0 2024-02-28T16:02:27.113 INFO:tasks.workunit.client.0.smithi057.stdout:5/904: rename d2/l6 to d2/d15/d101/l13a 0 2024-02-28T16:02:27.115 INFO:tasks.workunit.client.0.smithi057.stdout:4/982: stat d1/d10/d31/d86/dd1/d8c 0 2024-02-28T16:02:27.117 INFO:tasks.workunit.client.0.smithi057.stdout:3/890: mknod d8/dd/d14/d2e/d76/da1/c134 0 2024-02-28T16:02:27.118 INFO:tasks.workunit.client.0.smithi057.stdout:5/905: write d2/d19/d1c/f36 [3928835,86961] 0 2024-02-28T16:02:27.119 INFO:tasks.workunit.client.0.smithi057.stdout:6/994: mkdir df/d10/d78/dca/d15/d16/d39/d92/d11c/d14b 0 2024-02-28T16:02:27.120 INFO:tasks.workunit.client.0.smithi057.stdout:2/953: truncate d19/d43/d5a/f96 3122449 0 2024-02-28T16:02:27.123 INFO:tasks.workunit.client.0.smithi057.stdout:3/891: write d8/dd/d14/d2e/f127 [94360,107033] 0 2024-02-28T16:02:27.125 INFO:tasks.workunit.client.0.smithi057.stdout:4/983: mkdir d1/d10/d31/d86/dd1/d10c/d125/d14c 0 2024-02-28T16:02:27.128 INFO:tasks.workunit.client.0.smithi057.stdout:6/995: getdents df/d10/d78/dca/dd0 0 2024-02-28T16:02:27.134 INFO:tasks.workunit.client.0.smithi057.stdout:4/984: creat d1/d10/d31/d86/dd1/d10c/d125/f14d x:0 0 0 2024-02-28T16:02:27.134 INFO:tasks.workunit.client.0.smithi057.stdout:3/892: write d8/dd/d14/d2e/d30/d49/f63 [1685171,73343] 0 2024-02-28T16:02:27.136 INFO:tasks.workunit.client.0.smithi057.stdout:6/996: truncate df/d10/d13/d4b/f10e 974434 0 2024-02-28T16:02:27.138 INFO:tasks.workunit.client.0.smithi057.stdout:4/985: dread - d1/d10/d31/d86/dd1/d10c/d125/f14d zero size 2024-02-28T16:02:27.148 INFO:tasks.workunit.client.0.smithi057.stdout:6/997: dread df/d10/d78/dca/d15/d16/d39/d92/fcb [0,4194304] 0 2024-02-28T16:02:27.148 INFO:tasks.workunit.client.0.smithi057.stdout:4/986: mknod d1/c14e 0 2024-02-28T16:02:27.148 INFO:tasks.workunit.client.0.smithi057.stdout:4/987: stat d1/lb 0 2024-02-28T16:02:27.148 INFO:tasks.workunit.client.0.smithi057.stdout:2/954: truncate d19/d34/d78/d95/f97 4123286 0 2024-02-28T16:02:27.149 INFO:tasks.workunit.client.0.smithi057.stdout:5/906: dread d2/d12/d3d/f61 [0,4194304] 0 2024-02-28T16:02:27.150 INFO:tasks.workunit.client.0.smithi057.stdout:6/998: mkdir df/d10/d78/d5b/d14c 0 2024-02-28T16:02:27.151 INFO:tasks.workunit.client.0.smithi057.stdout:3/893: truncate d8/dd/f1f 607172 0 2024-02-28T16:02:27.153 INFO:tasks.workunit.client.0.smithi057.stdout:5/907: read d2/d19/d1c/fd9 [601048,91768] 0 2024-02-28T16:02:27.156 INFO:tasks.workunit.client.0.smithi057.stdout:6/999: creat df/d10/d13/d4b/dcc/d11f/f14d x:0 0 0 2024-02-28T16:02:27.157 INFO:tasks.workunit.client.0.smithi057.stdout:5/908: write d2/d15/d5e/d67/fbe [3018869,75256] 0 2024-02-28T16:02:27.157 INFO:tasks.workunit.client.0.smithi057.stdout:3/894: readlink d8/dd/d14/d2e/l75 0 2024-02-28T16:02:27.159 INFO:tasks.workunit.client.0.smithi057.stdout:4/988: mknod d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/d5e/d137/d132/c14f 0 2024-02-28T16:02:27.169 INFO:tasks.workunit.client.0.smithi057.stdout:4/989: mknod d1/d10/d31/d86/dd1/d10c/d125/d39/db4/d142/c150 0 2024-02-28T16:02:27.171 INFO:tasks.workunit.client.0.smithi057.stdout:2/955: write d19/f29 [3882026,106240] 0 2024-02-28T16:02:27.173 INFO:tasks.workunit.client.0.smithi057.stdout:3/895: dread d8/dd/d14/d2e/d30/d5f/f85 [0,4194304] 0 2024-02-28T16:02:27.175 INFO:tasks.workunit.client.0.smithi057.stdout:4/990: fdatasync d1/f28 0 2024-02-28T16:02:27.176 INFO:tasks.workunit.client.0.smithi057.stdout:2/956: write d19/f29 [5461779,62260] 0 2024-02-28T16:02:27.182 INFO:tasks.workunit.client.0.smithi057.stdout:7/909: sync 2024-02-28T16:02:27.185 INFO:tasks.workunit.client.0.smithi057.stdout:2/957: truncate d19/f37 4053584 0 2024-02-28T16:02:27.185 INFO:tasks.workunit.client.0.smithi057.stdout:7/910: chown d6/dc/d35 28 1 2024-02-28T16:02:27.187 INFO:tasks.workunit.client.0.smithi057.stdout:5/909: dwrite d2/d15/f3c [0,4194304] 0 2024-02-28T16:02:27.192 INFO:tasks.workunit.client.0.smithi057.stdout:4/991: unlink d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/fef 0 2024-02-28T16:02:27.194 INFO:tasks.workunit.client.0.smithi057.stdout:7/911: rmdir d6 39 2024-02-28T16:02:27.196 INFO:tasks.workunit.client.0.smithi057.stdout:4/992: read d1/d10/d31/d86/dd1/d10c/d125/d15/f5b [2995040,67484] 0 2024-02-28T16:02:27.200 INFO:tasks.workunit.client.0.smithi057.stdout:5/910: creat d2/d12/d76/d7a/d95/db5/dcb/dab/f13b x:0 0 0 2024-02-28T16:02:27.203 INFO:tasks.workunit.client.0.smithi057.stdout:7/912: chown d6/dc/d67/d9a/da1/fa4 8 1 2024-02-28T16:02:27.205 INFO:tasks.workunit.client.0.smithi057.stdout:7/913: write d6/dc/dab/d107/f12f [651400,67713] 0 2024-02-28T16:02:27.206 INFO:tasks.workunit.client.0.smithi057.stdout:4/993: chown d1/d10/d31/d86/dd1/d10c/d125/d2c/d50/c3c 260932067 1 2024-02-28T16:02:27.212 INFO:tasks.workunit.client.0.smithi057.stdout:5/911: symlink d2/d3e/d5b/db0/l13c 0 2024-02-28T16:02:27.215 INFO:tasks.workunit.client.0.smithi057.stdout:7/914: read d6/dc/d67/d9a/da1/d129/fae [1452074,59387] 0 2024-02-28T16:02:27.217 INFO:tasks.workunit.client.0.smithi057.stdout:4/994: getdents d1/d10 0 2024-02-28T16:02:27.217 INFO:tasks.workunit.client.0.smithi057.stdout:5/912: mknod d2/ddd/c13d 0 2024-02-28T16:02:27.227 INFO:tasks.workunit.client.0.smithi057.stdout:7/915: creat d6/dc/d12/dc9/dce/dfc/dfd/f131 x:0 0 0 2024-02-28T16:02:27.237 INFO:tasks.workunit.client.0.smithi057.stdout:7/916: creat d6/dc/d12/d29/f132 x:0 0 0 2024-02-28T16:02:27.240 INFO:tasks.workunit.client.0.smithi057.stdout:2/958: dwrite d19/d34/d78/d95/f100 [0,4194304] 0 2024-02-28T16:02:27.242 INFO:tasks.workunit.client.0.smithi057.stdout:7/917: write d6/dc/dab/f105 [875152,27402] 0 2024-02-28T16:02:27.247 INFO:tasks.workunit.client.0.smithi057.stdout:3/896: dread d8/dd/d14/d2e/d30/d49/d51/d66/f79 [0,4194304] 0 2024-02-28T16:02:27.253 INFO:tasks.workunit.client.0.smithi057.stdout:2/959: creat d19/d2c/d65/dcf/f140 x:0 0 0 2024-02-28T16:02:27.256 INFO:tasks.workunit.client.0.smithi057.stdout:7/918: rename d6/dc/d12/d29/c124 to d6/dc/d35/db2/c133 0 2024-02-28T16:02:27.260 INFO:tasks.workunit.client.0.smithi057.stdout:3/897: mknod d8/dd/d14/d2e/d3b/d71/c135 0 2024-02-28T16:02:27.263 INFO:tasks.workunit.client.0.smithi057.stdout:2/960: symlink d19/d2c/d65/dcf/l141 0 2024-02-28T16:02:27.265 INFO:tasks.workunit.client.0.smithi057.stdout:7/919: symlink d6/dc/d67/l134 0 2024-02-28T16:02:27.276 INFO:tasks.workunit.client.0.smithi057.stdout:3/898: getdents d8/dd/d14/d2e/d30/d5f/dd9 0 2024-02-28T16:02:27.278 INFO:tasks.workunit.client.0.smithi057.stdout:4/995: dwrite d1/d22/f7d [0,4194304] 0 2024-02-28T16:02:27.281 INFO:tasks.workunit.client.0.smithi057.stdout:4/996: chown d1/d3f/lbf 44265224 1 2024-02-28T16:02:27.286 INFO:tasks.workunit.client.0.smithi057.stdout:7/920: link d6/dc/d67/d9a/da1/lf2 d6/dc/d35/d58/dd5/l135 0 2024-02-28T16:02:27.289 INFO:tasks.workunit.client.0.smithi057.stdout:4/997: chown d1/d10/d31/d86/dd1/d10c/d125/d2c/d37/d46/dac/de9/d87/c10e 254084 1 2024-02-28T16:02:27.292 INFO:tasks.workunit.client.0.smithi057.stdout:3/899: truncate d8/dd/d14/d2e/d30/d49/d51/d66/d7f/f8a 1424676 0 2024-02-28T16:02:27.295 INFO:tasks.workunit.client.0.smithi057.stdout:7/921: creat d6/dc/d12/d1a/d4c/d63/f136 x:0 0 0 2024-02-28T16:02:27.296 INFO:tasks.workunit.client.0.smithi057.stdout:3/900: mknod d8/d4b/dd2/c136 0 2024-02-28T16:02:27.300 INFO:tasks.workunit.client.0.smithi057.stdout:7/922: readlink d6/dc/d35/d58/dd5/lfe 0 2024-02-28T16:02:27.305 INFO:tasks.workunit.client.0.smithi057.stdout:4/998: creat d1/d10/d31/d86/dd1/d10c/d125/d2c/f151 x:0 0 0 2024-02-28T16:02:27.310 INFO:tasks.workunit.client.0.smithi057.stdout:7/923: creat d6/dc/d12/d1a/d4d/d56/db0/f137 x:0 0 0 2024-02-28T16:02:27.310 INFO:tasks.workunit.client.0.smithi057.stdout:2/961: dread d19/d2c/d65/f8d [0,4194304] 0 2024-02-28T16:02:27.314 INFO:tasks.workunit.client.0.smithi057.stdout:3/901: unlink d8/dd/d14/d2e/d30/d49/d51/c55 0 2024-02-28T16:02:27.316 INFO:tasks.workunit.client.0.smithi057.stdout:3/902: chown d8/d4b/f9f 379034 1 2024-02-28T16:02:27.320 INFO:tasks.workunit.client.0.smithi057.stdout:2/962: rename d19/d1d/d2e/d3c/l103 to d19/d34/l142 0 2024-02-28T16:02:27.329 INFO:tasks.workunit.client.0.smithi057.stdout:4/999: rename d1/d10/d31/d86/dd1/d10c/d125/d15/f5b to d1/d10/d31/d86/dd1/d10c/d125/d39/db4/de7/dfd/d129/f152 0 2024-02-28T16:02:27.345 INFO:tasks.workunit.client.0.smithi057.stdout:3/903: write d8/dd/d14/f50 [2720435,42442] 0 2024-02-28T16:02:27.348 INFO:tasks.workunit.client.0.smithi057.stdout:3/904: chown d8/dd/d14/d2e/d76/d89/de2 124607185 1 2024-02-28T16:02:27.353 INFO:tasks.workunit.client.0.smithi057.stdout:2/963: dread d19/d2c/f4f [0,4194304] 0 2024-02-28T16:02:27.353 INFO:tasks.workunit.client.0.smithi057.stdout:2/964: write d19/d2c/d65/de9/f121 [1653674,4154] 0 2024-02-28T16:02:27.354 INFO:tasks.workunit.client.0.smithi057.stdout:3/905: rmdir d8/dd/d14/d2e/d30/d5f/dd9 39 2024-02-28T16:02:27.361 INFO:tasks.workunit.client.0.smithi057.stdout:3/906: creat d8/dd/d14/d2e/f137 x:0 0 0 2024-02-28T16:02:27.365 INFO:tasks.workunit.client.0.smithi057.stdout:3/907: truncate d8/dd/d14/d2e/d76/da1/f126 299416 0 2024-02-28T16:02:27.367 INFO:tasks.workunit.client.0.smithi057.stdout:3/908: write d8/d4b/dd2/fdc [49894,27852] 0 2024-02-28T16:02:27.369 INFO:tasks.workunit.client.0.smithi057.stdout:2/965: dwrite d19/d2c/ffb [0,4194304] 0 2024-02-28T16:02:27.373 INFO:tasks.workunit.client.0.smithi057.stdout:2/966: mknod d19/c143 0 2024-02-28T16:02:27.375 INFO:tasks.workunit.client.0.smithi057.stdout:3/909: unlink d8/dd/d14/d2e/d3b/d71/cea 0 2024-02-28T16:02:27.377 INFO:tasks.workunit.client.0.smithi057.stdout:2/967: chown d19/d1d/d22/l13c 76581 1 2024-02-28T16:02:27.378 INFO:tasks.workunit.client.0.smithi057.stdout:2/968: fdatasync d19/d1d/d2e/d31/f50 0 2024-02-28T16:02:27.382 INFO:tasks.workunit.client.0.smithi057.stdout:2/969: symlink d19/d57/dc7/l144 0 2024-02-28T16:02:27.384 INFO:tasks.workunit.client.0.smithi057.stdout:2/970: mknod d19/d1d/d22/c145 0 2024-02-28T16:02:27.387 INFO:tasks.workunit.client.0.smithi057.stdout:2/971: mknod d19/d43/d5a/d70/c146 0 2024-02-28T16:02:27.389 INFO:tasks.workunit.client.0.smithi057.stdout:2/972: symlink d19/d43/l147 0 2024-02-28T16:02:27.390 INFO:tasks.workunit.client.0.smithi057.stdout:3/910: dwrite d8/dd/d14/d2c/db9/d133/f62 [0,4194304] 0 2024-02-28T16:02:27.390 INFO:tasks.workunit.client.0.smithi057.stdout:2/973: readlink d19/d2c/d48/lbf 0 2024-02-28T16:02:27.394 INFO:tasks.workunit.client.0.smithi057.stdout:2/974: symlink d19/d2c/d48/da2/l148 0 2024-02-28T16:02:27.404 INFO:tasks.workunit.client.0.smithi057.stdout:2/975: getdents d19/d1d/d2e/de2 0 2024-02-28T16:02:27.408 INFO:tasks.workunit.client.0.smithi057.stdout:2/976: mkdir d19/d101/d10d/d149 0 2024-02-28T16:02:27.409 INFO:tasks.workunit.client.0.smithi057.stdout:3/911: dwrite d8/f74 [0,4194304] 0 2024-02-28T16:02:27.411 INFO:tasks.workunit.client.0.smithi057.stdout:2/977: mkdir d19/d3a/d14a 0 2024-02-28T16:02:27.414 INFO:tasks.workunit.client.0.smithi057.stdout:2/978: symlink d19/d43/d5a/d9b/da3/l14b 0 2024-02-28T16:02:27.423 INFO:tasks.workunit.client.0.smithi057.stdout:3/912: truncate d8/dd/d14/d2e/d30/d49/d51/d66/f79 987330 0 2024-02-28T16:02:27.424 INFO:tasks.workunit.client.0.smithi057.stdout:2/979: write d19/d57/dc7/fd5 [154831,12184] 0 2024-02-28T16:02:27.426 INFO:tasks.workunit.client.0.smithi057.stdout:2/980: write d19/d57/dc7/f136 [491221,120000] 0 2024-02-28T16:02:27.429 INFO:tasks.workunit.client.0.smithi057.stdout:2/981: mkdir d19/d2c/d65/dda/d14c 0 2024-02-28T16:02:27.432 INFO:tasks.workunit.client.0.smithi057.stdout:2/982: unlink d19/f29 0 2024-02-28T16:02:27.435 INFO:tasks.workunit.client.0.smithi057.stdout:2/983: write d19/d2c/f111 [404806,104439] 0 2024-02-28T16:02:27.440 INFO:tasks.workunit.client.0.smithi057.stdout:2/984: unlink d19/d1d/d22/ce3 0 2024-02-28T16:02:27.441 INFO:tasks.workunit.client.0.smithi057.stdout:3/913: dwrite d8/dd/d14/d2e/d2f/fb7 [0,4194304] 0 2024-02-28T16:02:27.443 INFO:tasks.workunit.client.0.smithi057.stdout:2/985: write d19/d34/d78/d95/f100 [4608931,93648] 0 2024-02-28T16:02:27.449 INFO:tasks.workunit.client.0.smithi057.stdout:3/914: dread d8/dd/d14/d2e/d76/fe4 [0,4194304] 0 2024-02-28T16:02:27.456 INFO:tasks.workunit.client.0.smithi057.stdout:3/915: chown d8/dd/d14/d2e/d3b/d71/d10c/c10e 1032887 1 2024-02-28T16:02:27.458 INFO:tasks.workunit.client.0.smithi057.stdout:3/916: chown d8/dd/d14/d2e/d2f/da2/d10f/c111 157303 1 2024-02-28T16:02:27.459 INFO:tasks.workunit.client.0.smithi057.stdout:2/986: link d19/d1d/c8a d19/d2c/d65/dda/c14d 0 2024-02-28T16:02:27.461 INFO:tasks.workunit.client.0.smithi057.stdout:2/987: creat d19/d1d/d2e/d31/f14e x:0 0 0 2024-02-28T16:02:27.463 INFO:tasks.workunit.client.0.smithi057.stdout:2/988: write d19/d1d/d2e/de2/f12c [732222,18046] 0 2024-02-28T16:02:27.480 INFO:tasks.workunit.client.0.smithi057.stdout:3/917: dread d8/dd/d14/d2e/d3b/d54/fb6 [0,4194304] 0 2024-02-28T16:02:27.481 INFO:tasks.workunit.client.0.smithi057.stdout:3/918: chown d8/dd/d14/d2c/db9/d133/c84 867181 1 2024-02-28T16:02:27.486 INFO:tasks.workunit.client.0.smithi057.stdout:3/919: symlink d8/dd/d14/d2e/d30/d5f/l138 0 2024-02-28T16:02:27.486 INFO:tasks.workunit.client.0.smithi057.stdout:2/989: dread d19/d2c/d65/de9/f121 [0,4194304] 0 2024-02-28T16:02:27.489 INFO:tasks.workunit.client.0.smithi057.stdout:3/920: chown d8/dd/d14/d2e/d76/d89/de2/c124 124074215 1 2024-02-28T16:02:27.489 INFO:tasks.workunit.client.0.smithi057.stdout:2/990: fsync d19/d2c/d48/f7d 0 2024-02-28T16:02:27.492 INFO:tasks.workunit.client.0.smithi057.stdout:2/991: creat d19/d1d/db2/f14f x:0 0 0 2024-02-28T16:02:27.493 INFO:tasks.workunit.client.0.smithi057.stdout:2/992: readlink d19/d34/ldb 0 2024-02-28T16:02:27.494 INFO:tasks.workunit.client.0.smithi057.stdout:2/993: chown d19/d43/ddd/fe0 80529897 1 2024-02-28T16:02:27.496 INFO:tasks.workunit.client.0.smithi057.stdout:2/994: mkdir d19/d1d/d2e/de2/d12e/d150 0 2024-02-28T16:02:27.498 INFO:tasks.workunit.client.0.smithi057.stdout:2/995: rmdir d19/d2c/d48 39 2024-02-28T16:02:27.501 INFO:tasks.workunit.client.0.smithi057.stdout:2/996: mknod d19/d43/d5a/d9b/c151 0 2024-02-28T16:02:27.503 INFO:tasks.workunit.client.0.smithi057.stdout:7/924: sync 2024-02-28T16:02:27.503 INFO:tasks.workunit.client.0.smithi057.stdout:5/913: sync 2024-02-28T16:02:27.505 INFO:tasks.workunit.client.0.smithi057.stdout:3/921: dwrite d8/dd/d14/d2e/d76/da1/f126 [0,4194304] 0 2024-02-28T16:02:27.509 INFO:tasks.workunit.client.0.smithi057.stdout:3/922: write d8/dd/d14/d2c/f33 [3681221,127365] 0 2024-02-28T16:02:27.509 INFO:tasks.workunit.client.0.smithi057.stdout:7/925: creat d6/dc/d67/f138 x:0 0 0 2024-02-28T16:02:27.510 INFO:tasks.workunit.client.0.smithi057.stdout:5/914: mkdir d2/d12/d76/d7a/d95/db5/d13e 0 2024-02-28T16:02:27.513 INFO:tasks.workunit.client.0.smithi057.stdout:5/915: chown d2/d12/d76/d7a/lc6 44 1 2024-02-28T16:02:27.515 INFO:tasks.workunit.client.0.smithi057.stdout:7/926: creat d6/dc/d12/d29/f139 x:0 0 0 2024-02-28T16:02:27.515 INFO:tasks.workunit.client.0.smithi057.stdout:2/997: write d19/d2c/d65/de9/f13e [992362,49809] 0 2024-02-28T16:02:27.516 INFO:tasks.workunit.client.0.smithi057.stdout:5/916: stat d2/d8/cc3 0 2024-02-28T16:02:27.516 INFO:tasks.workunit.client.0.smithi057.stdout:3/923: symlink d8/dd/d14/d2e/d30/d5f/d6b/d11a/l139 0 2024-02-28T16:02:27.519 INFO:tasks.workunit.client.0.smithi057.stdout:2/998: mknod d19/d1d/d2e/de2/d12e/c152 0 2024-02-28T16:02:27.521 INFO:tasks.workunit.client.0.smithi057.stdout:3/924: mknod d8/c13a 0 2024-02-28T16:02:27.521 INFO:tasks.workunit.client.0.smithi057.stdout:5/917: read d2/d12/d76/d7a/d95/db5/dce/f118 [7279142,64541] 0 2024-02-28T16:02:27.525 INFO:tasks.workunit.client.0.smithi057.stdout:7/927: rename d6/dc/d12/d1a/d4d/f109 to d6/dc/f13a 0 2024-02-28T16:02:27.526 INFO:tasks.workunit.client.0.smithi057.stdout:2/999: mknod d19/d1d/d2e/d31/db1/dfe/c153 0 2024-02-28T16:02:27.528 INFO:tasks.workunit.client.0.smithi057.stdout:7/928: mkdir d6/dc/d12/d29/d13b 0 2024-02-28T16:02:27.528 INFO:tasks.workunit.client.0.smithi057.stdout:5/918: write d2/d12/d76/d7a/d95/db5/dce/f118 [8099100,125952] 0 2024-02-28T16:02:27.540 INFO:tasks.workunit.client.0.smithi057.stdout:7/929: write d6/dc/d35/f84 [932140,7325] 0 2024-02-28T16:02:27.540 INFO:tasks.workunit.client.0.smithi057.stdout:3/925: dwrite d8/dd/d14/d2e/d2f/f5a [4194304,4194304] 0 2024-02-28T16:02:27.541 INFO:tasks.workunit.client.0.smithi057.stdout:3/926: chown d8/d26/dfb 244 1 2024-02-28T16:02:27.543 INFO:tasks.workunit.client.0.smithi057.stdout:7/930: fsync d6/dc/d12/f47 0 2024-02-28T16:02:27.547 INFO:tasks.workunit.client.0.smithi057.stdout:3/927: write d8/dd/d14/d2e/d30/d5f/fee [4095955,45720] 0 2024-02-28T16:02:27.548 INFO:tasks.workunit.client.0.smithi057.stdout:7/931: mknod d6/dc/d12/d1a/d4d/c13c 0 2024-02-28T16:02:27.550 INFO:tasks.workunit.client.0.smithi057.stdout:5/919: dwrite d2/d12/d76/f87 [0,4194304] 0 2024-02-28T16:02:27.556 INFO:tasks.workunit.client.0.smithi057.stdout:5/920: rmdir d2/d3e/d5b 39 2024-02-28T16:02:27.556 INFO:tasks.workunit.client.0.smithi057.stdout:3/928: write d8/dd/d14/d2e/d3b/d54/f99 [1310925,32867] 0 2024-02-28T16:02:27.556 INFO:tasks.workunit.client.0.smithi057.stdout:7/932: symlink d6/dc/d12/d1a/d4d/d56/l13d 0 2024-02-28T16:02:27.561 INFO:tasks.workunit.client.0.smithi057.stdout:3/929: mknod d8/dd/d14/c13b 0 2024-02-28T16:02:27.563 INFO:tasks.workunit.client.0.smithi057.stdout:7/933: creat d6/dc/d35/d58/dd5/f13e x:0 0 0 2024-02-28T16:02:27.565 INFO:tasks.workunit.client.0.smithi057.stdout:5/921: creat d2/d12/d76/d7a/d95/db5/dcb/f13f x:0 0 0 2024-02-28T16:02:27.566 INFO:tasks.workunit.client.0.smithi057.stdout:5/922: dread - d2/d15/d5e/d9a/f131 zero size 2024-02-28T16:02:27.570 INFO:tasks.workunit.client.0.smithi057.stdout:5/923: mkdir d2/d12/d76/d7a/d95/db5/dcb/dab/d12c/d62/d74/d140 0 2024-02-28T16:02:27.572 INFO:tasks.workunit.client.0.smithi057.stdout:5/924: stat d2/d12/d76/c98 0 2024-02-28T16:02:27.578 INFO:tasks.workunit.client.0.smithi057.stdout:5/925: dread d2/d15/d63/f9b [0,4194304] 0 2024-02-28T16:02:27.579 INFO:tasks.workunit.client.0.smithi057.stdout:5/926: chown d2/d3e 807 1 2024-02-28T16:02:27.579 INFO:tasks.workunit.client.0.smithi057.stdout:3/930: dwrite d8/dd/d14/d2e/d76/d89/d6c/fde [0,4194304] 0 2024-02-28T16:02:27.581 INFO:tasks.workunit.client.0.smithi057.stdout:5/927: chown d2/d19/d1c/fd9 3281 1 2024-02-28T16:02:27.582 INFO:tasks.workunit.client.0.smithi057.stdout:3/931: fsync d8/dd/d14/d2e/d2f/fcb 0 2024-02-28T16:02:27.591 INFO:tasks.workunit.client.0.smithi057.stdout:5/928: unlink d2/d15/d63/f8f 0 2024-02-28T16:02:27.597 INFO:tasks.workunit.client.0.smithi057.stdout:7/934: dread d6/f14 [0,4194304] 0 2024-02-28T16:02:27.603 INFO:tasks.workunit.client.0.smithi057.stdout:7/935: unlink d6/dc/d67/f138 0 2024-02-28T16:02:27.604 INFO:tasks.workunit.client.0.smithi057.stdout:3/932: dwrite d8/dd/d14/d2e/d30/d5f/fee [4194304,4194304] 0 2024-02-28T16:02:27.613 INFO:tasks.workunit.client.0.smithi057.stdout:3/933: symlink d8/dd/d14/d2e/d3b/d71/d10c/l13c 0 2024-02-28T16:02:27.621 INFO:tasks.workunit.client.0.smithi057.stdout:7/936: link d6/dc/d35/db2/ff7 d6/dc/d87/f13f 0 2024-02-28T16:02:27.621 INFO:tasks.workunit.client.0.smithi057.stdout:5/929: dwrite d2/d15/d5e/d67/f107 [0,4194304] 0 2024-02-28T16:02:27.644 INFO:tasks.workunit.client.0.smithi057.stdout:3/934: truncate d8/dd/d14/d2c/db9/d133/f29 1844666 0 2024-02-28T16:02:27.644 INFO:tasks.workunit.client.0.smithi057.stdout:5/930: write d2/d12/d3d/da4/fdb [2270448,123041] 0 2024-02-28T16:02:27.648 INFO:tasks.workunit.client.0.smithi057.stdout:3/935: chown d8/dd/d14/d2e/d76/d89/de2/f129 19576 1 2024-02-28T16:02:27.651 INFO:tasks.workunit.client.0.smithi057.stdout:7/937: dwrite d6/dc/d67/ff3 [0,4194304] 0 2024-02-28T16:02:27.652 INFO:tasks.workunit.client.0.smithi057.stdout:5/931: rmdir d2 39 2024-02-28T16:02:27.653 INFO:tasks.workunit.client.0.smithi057.stdout:7/938: stat d6/dc/d12/dc9/dce/dfc/c12a 0 2024-02-28T16:02:27.655 INFO:tasks.workunit.client.0.smithi057.stdout:3/936: symlink d8/dd/d14/d2e/d76/d89/l13d 0 2024-02-28T16:02:27.658 INFO:tasks.workunit.client.0.smithi057.stdout:7/939: readlink d6/dc/d12/d1a/d4c/l8f 0 2024-02-28T16:02:27.662 INFO:tasks.workunit.client.0.smithi057.stdout:7/940: write d6/dc/d12/d29/f52 [13510290,83914] 0 2024-02-28T16:02:27.669 INFO:tasks.workunit.client.0.smithi057.stdout:7/941: write d6/dc/d12/d1a/d4d/df0/f120 [342800,113492] 0 2024-02-28T16:02:27.672 INFO:tasks.workunit.client.0.smithi057.stdout:7/942: dread - d6/dc/d67/d9a/da1/d129/f114 zero size 2024-02-28T16:02:27.674 INFO:tasks.workunit.client.0.smithi057.stdout:5/932: dwrite d2/f22 [4194304,4194304] 0 2024-02-28T16:02:27.675 INFO:tasks.workunit.client.0.smithi057.stdout:7/943: write d6/dc/d12/d1a/d4d/fc8 [6457234,66996] 0 2024-02-28T16:02:27.678 INFO:tasks.workunit.client.0.smithi057.stdout:5/933: write d2/d15/fa1 [2329549,51343] 0 2024-02-28T16:02:27.685 INFO:tasks.workunit.client.0.smithi057.stdout:5/934: write d2/d12/d3d/fc5 [271749,126522] 0 2024-02-28T16:02:27.686 INFO:tasks.workunit.client.0.smithi057.stdout:3/937: dwrite d8/dd/d14/d2e/d76/d89/de2/f129 [0,4194304] 0 2024-02-28T16:02:27.687 INFO:tasks.workunit.client.0.smithi057.stdout:7/944: truncate d6/dc/d12/d1a/d4d/dd9/dde/fe4 267189 0 2024-02-28T16:02:27.688 INFO:tasks.workunit.client.0.smithi057.stdout:5/935: chown d2/d15/d63/de7/fe8 10201615 1 2024-02-28T16:02:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:7/945: unlink d6/dc/dab/le6 0 2024-02-28T16:02:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:5/936: creat d2/ddd/f141 x:0 0 0 2024-02-28T16:02:27.700 INFO:tasks.workunit.client.0.smithi057.stdout:5/937: symlink d2/d12/d5f/l142 0 2024-02-28T16:02:27.702 INFO:tasks.workunit.client.0.smithi057.stdout:5/938: fsync d2/d19/f29 0 2024-02-28T16:02:27.707 INFO:tasks.workunit.client.0.smithi057.stdout:3/938: dread d8/dd/d14/d2e/d76/da1/f126 [0,4194304] 0 2024-02-28T16:02:27.710 INFO:tasks.workunit.client.0.smithi057.stdout:5/939: mknod d2/d12/d76/d7a/d95/db5/dcb/dab/d12c/d62/da3/c143 0 2024-02-28T16:02:27.712 INFO:tasks.workunit.client.0.smithi057.stdout:3/939: creat d8/dd/d14/d2e/d30/d5f/d6b/d11a/f13e x:0 0 0 2024-02-28T16:02:27.713 INFO:tasks.workunit.client.0.smithi057.stdout:5/940: mknod d2/d19/c144 0 2024-02-28T16:02:27.715 INFO:tasks.workunit.client.0.smithi057.stdout:3/940: mkdir d8/d26/d13f 0 2024-02-28T16:02:27.717 INFO:tasks.workunit.client.0.smithi057.stdout:7/946: dread d6/dc/d35/d58/dd5/fe1 [0,4194304] 0 2024-02-28T16:02:27.720 INFO:tasks.workunit.client.0.smithi057.stdout:5/941: getdents d2/d12 0 2024-02-28T16:02:27.724 INFO:tasks.workunit.client.0.smithi057.stdout:5/942: mkdir d2/d3e/d5b/db0/d135/d145 0 2024-02-28T16:02:27.734 INFO:tasks.workunit.client.0.smithi057.stdout:5/943: write d2/d12/d76/f87 [4356301,63520] 0 2024-02-28T16:02:27.739 INFO:tasks.workunit.client.0.smithi057.stdout:5/944: chown d2/d12/d3d/da4/ld7 1 1 2024-02-28T16:02:27.741 INFO:tasks.workunit.client.0.smithi057.stdout:3/941: dwrite d8/dd/d14/d2c/fd8 [0,4194304] 0 2024-02-28T16:02:27.745 INFO:tasks.workunit.client.0.smithi057.stdout:7/947: dwrite d6/dc/d12/dc9/dce/dfc/dfd/f131 [0,4194304] 0 2024-02-28T16:02:27.747 INFO:tasks.workunit.client.0.smithi057.stdout:7/948: readlink d6/dc/dab/dcf/l12b 0 2024-02-28T16:02:27.763 INFO:tasks.workunit.client.0.smithi057.stdout:3/942: dwrite d8/dd/d14/d2e/d2f/ff3 [0,4194304] 0 2024-02-28T16:02:27.770 INFO:tasks.workunit.client.0.smithi057.stdout:7/949: dwrite d6/d26/df8/f113 [4194304,4194304] 0 2024-02-28T16:02:27.803 INFO:tasks.workunit.client.0.smithi057.stdout:3/943: truncate d8/dd/d14/d2e/d30/d6a/f93 2034690 0 2024-02-28T16:02:27.809 INFO:tasks.workunit.client.0.smithi057.stdout:5/945: dwrite d2/d12/d76/d7a/d95/db5/dcb/f4e [0,4194304] 0 2024-02-28T16:02:27.812 INFO:tasks.workunit.client.0.smithi057.stdout:7/950: dwrite d6/f14 [0,4194304] 0 2024-02-28T16:02:27.814 INFO:tasks.workunit.client.0.smithi057.stdout:3/944: mknod d8/dd/d14/d2e/d30/d6a/d8c/c140 0 2024-02-28T16:02:27.819 INFO:tasks.workunit.client.0.smithi057.stdout:7/951: rename d6/f14 to d6/f140 0 2024-02-28T16:02:27.823 INFO:tasks.workunit.client.0.smithi057.stdout:5/946: write d2/d12/d5f/d77/f93 [749856,106424] 0 2024-02-28T16:02:27.826 INFO:tasks.workunit.client.0.smithi057.stdout:3/945: getdents d8/dd/d14/d2e 0 2024-02-28T16:02:27.829 INFO:tasks.workunit.client.0.smithi057.stdout:3/946: read - d8/dd/d14/d2e/d3b/d54/fa8 zero size 2024-02-28T16:02:27.833 INFO:tasks.workunit.client.0.smithi057.stdout:5/947: rename d2/d12/d76/d7a/d95/db5/c122 to d2/d15/d5e/d9a/dac/c146 0 2024-02-28T16:02:27.840 INFO:tasks.workunit.client.0.smithi057.stdout:3/947: getdents d8/dd/d14/d2e/d30/d5f 0 2024-02-28T16:02:27.841 INFO:tasks.workunit.client.0.smithi057.stdout:5/948: creat d2/d12/d5f/d77/ddf/f147 x:0 0 0 2024-02-28T16:02:27.855 INFO:tasks.workunit.client.0.smithi057.stdout:7/952: dread d6/dc/d12/d29/f3e [0,4194304] 0 2024-02-28T16:02:27.857 INFO:tasks.workunit.client.0.smithi057.stdout:5/949: dwrite d2/d12/d76/d7a/d95/db5/dcb/f4e [0,4194304] 0 2024-02-28T16:02:27.860 INFO:tasks.workunit.client.0.smithi057.stdout:5/950: chown d2/dae/ced 2 1 2024-02-28T16:02:27.862 INFO:tasks.workunit.client.0.smithi057.stdout:5/951: chown d2/d8/f16 7201 1 2024-02-28T16:02:27.863 INFO:tasks.workunit.client.0.smithi057.stdout:3/948: dwrite d8/dd/d14/d2e/d76/d89/d6c/f122 [0,4194304] 0 2024-02-28T16:02:27.869 INFO:tasks.workunit.client.0.smithi057.stdout:5/952: rename d2/d3e/d5b/lf7 to d2/d15/d5e/d7f/l148 0 2024-02-28T16:02:27.870 INFO:tasks.workunit.client.0.smithi057.stdout:3/949: mkdir d8/dd/d14/d2c/db9/d133/d2a/d141 0 2024-02-28T16:02:27.873 INFO:tasks.workunit.client.0.smithi057.stdout:7/953: dwrite d6/dc/d67/fbe [4194304,4194304] 0 2024-02-28T16:02:27.875 INFO:tasks.workunit.client.0.smithi057.stdout:5/953: write d2/d12/d76/d7a/d95/db5/dcb/f4e [1534939,95735] 0 2024-02-28T16:02:27.876 INFO:tasks.workunit.client.0.smithi057.stdout:7/954: fsync d6/dc/d67/f8a 0 2024-02-28T16:02:27.877 INFO:tasks.workunit.client.0.smithi057.stdout:3/950: symlink d8/dd/d14/d2c/db9/d133/d25/l142 0 2024-02-28T16:02:27.879 INFO:tasks.workunit.client.0.smithi057.stdout:5/954: symlink d2/d12/d76/l149 0 2024-02-28T16:02:27.881 INFO:tasks.workunit.client.0.smithi057.stdout:3/951: mknod d8/dd/d14/d2e/d3b/d71/c143 0 2024-02-28T16:02:27.883 INFO:tasks.workunit.client.0.smithi057.stdout:7/955: truncate d6/dc/d12/dc9/dce/dfc/dfd/f121 166220 0 2024-02-28T16:02:27.884 INFO:tasks.workunit.client.0.smithi057.stdout:3/952: stat d8/dd/d14/d2e/f137 0 2024-02-28T16:02:27.884 INFO:tasks.workunit.client.0.smithi057.stdout:7/956: stat d6/dc/d12/f2d 0 2024-02-28T16:02:27.900 INFO:tasks.workunit.client.0.smithi057.stdout:3/953: dread d8/dd/d14/d2c/db9/d133/d25/f2b [0,4194304] 0 2024-02-28T16:02:27.903 INFO:tasks.workunit.client.0.smithi057.stdout:5/955: dwrite d2/d12/d76/d7a/d95/f10d [0,4194304] 0 2024-02-28T16:02:27.906 INFO:tasks.workunit.client.0.smithi057.stdout:5/956: write d2/d19/f29 [1657233,17652] 0 2024-02-28T16:02:27.907 INFO:tasks.workunit.client.0.smithi057.stdout:3/954: truncate d8/d94/f98 1352786 0 2024-02-28T16:02:27.911 INFO:tasks.workunit.client.0.smithi057.stdout:5/957: truncate d2/d15/d5e/d9a/f131 141680 0 2024-02-28T16:02:27.917 INFO:tasks.workunit.client.0.smithi057.stdout:7/957: dwrite d6/dc/d12/d29/f10a [0,4194304] 0 2024-02-28T16:02:27.936 INFO:tasks.workunit.client.0.smithi057.stdout:5/958: dwrite d2/d12/d5f/fc7 [0,4194304] 0 2024-02-28T16:02:27.939 INFO:tasks.workunit.client.0.smithi057.stdout:5/959: chown d2/d15/d5e/l64 88 1 2024-02-28T16:02:27.946 INFO:tasks.workunit.client.0.smithi057.stdout:7/958: dwrite d6/d38/ff1 [0,4194304] 0 2024-02-28T16:02:27.947 INFO:tasks.workunit.client.0.smithi057.stdout:5/960: rmdir d2/d12/d76/d7a/d95/db5/d13e 0 2024-02-28T16:02:27.951 INFO:tasks.workunit.client.0.smithi057.stdout:5/961: creat d2/d12/d76/d7a/f14a x:0 0 0 2024-02-28T16:02:27.953 INFO:tasks.workunit.client.0.smithi057.stdout:5/962: chown d2/d15/d5e/l64 7723921 1 2024-02-28T16:02:27.956 INFO:tasks.workunit.client.0.smithi057.stdout:5/963: write d2/d12/d3d/da4/ffb [1278769,86382] 0 2024-02-28T16:02:27.959 INFO:tasks.workunit.client.0.smithi057.stdout:5/964: dread - d2/d12/d3d/d8a/f137 zero size 2024-02-28T16:02:27.963 INFO:tasks.workunit.client.0.smithi057.stdout:7/959: dwrite d6/dc/d12/d1a/d4d/f94 [0,4194304] 0 2024-02-28T16:02:27.966 INFO:tasks.workunit.client.0.smithi057.stdout:7/960: write d6/dc/d12/d29/f139 [129979,78528] 0 2024-02-28T16:02:27.967 INFO:tasks.workunit.client.0.smithi057.stdout:5/965: getdents d2/d12/d76/d7a 0 2024-02-28T16:02:27.971 INFO:tasks.workunit.client.0.smithi057.stdout:7/961: mknod d6/dc/d12/d1a/d4d/d56/db0/d10d/c141 0 2024-02-28T16:02:27.972 INFO:tasks.workunit.client.0.smithi057.stdout:5/966: symlink d2/d12/d76/d7a/d95/db5/dcb/dab/d12c/d62/df4/d130/l14b 0 2024-02-28T16:02:27.974 INFO:tasks.workunit.client.0.smithi057.stdout:5/967: dread - d2/d12/d3d/d8a/f137 zero size 2024-02-28T16:02:27.975 INFO:tasks.workunit.client.0.smithi057.stdout:5/968: stat d2/dae/le5 0 2024-02-28T16:02:27.985 INFO:tasks.workunit.client.0.smithi057.stdout:5/969: write d2/d12/d76/d7a/d95/db5/dcb/dab/fea [620212,30799] 0 2024-02-28T16:02:28.002 INFO:tasks.workunit.client.0.smithi057.stdout:5/970: dread d2/d15/f99 [0,4194304] 0 2024-02-28T16:02:28.006 INFO:tasks.workunit.client.0.smithi057.stdout:5/971: creat d2/d12/d76/d7a/d95/db5/dcb/dab/d12c/d62/df4/f14c x:0 0 0 2024-02-28T16:02:28.009 INFO:tasks.workunit.client.0.smithi057.stdout:5/972: chown d2/d12/d76/d7a/d95/db5/dcb/d91 19296 1 2024-02-28T16:02:28.009 INFO:tasks.workunit.client.0.smithi057.stdout:5/973: stat d2/d15/f3c 0 2024-02-28T16:02:28.010 INFO:tasks.workunit.client.0.smithi057.stdout:5/974: dread - d2/d15/d5e/d9a/f114 zero size 2024-02-28T16:02:28.012 INFO:tasks.workunit.client.0.smithi057.stdout:5/975: creat d2/dae/f14d x:0 0 0 2024-02-28T16:02:28.014 INFO:tasks.workunit.client.0.smithi057.stdout:5/976: chown d2/l2a 122 1 2024-02-28T16:02:28.016 INFO:tasks.workunit.client.0.smithi057.stdout:5/977: creat d2/d12/d76/d7a/f14e x:0 0 0 2024-02-28T16:02:28.022 INFO:tasks.workunit.client.0.smithi057.stdout:5/978: rename d2/d12/d76/d7a/d95/db5/dcb/f59 to d2/d12/d76/d7a/d95/db5/dcb/d91/f14f 0 2024-02-28T16:02:28.024 INFO:tasks.workunit.client.0.smithi057.stdout:5/979: readlink d2/d12/d76/d7a/d95/db5/dcb/l48 0 2024-02-28T16:02:28.030 INFO:tasks.workunit.client.0.smithi057.stdout:5/980: write d2/d15/d5e/d6d/f102 [999402,89114] 0 2024-02-28T16:02:28.033 INFO:tasks.workunit.client.0.smithi057.stdout:5/981: creat d2/d12/d76/d7a/f150 x:0 0 0 2024-02-28T16:02:28.038 INFO:tasks.workunit.client.0.smithi057.stdout:5/982: rename d2/d12/d3d/d8a/f137 to d2/d12/d76/f151 0 2024-02-28T16:02:28.042 INFO:tasks.workunit.client.0.smithi057.stdout:5/983: rename d2/c18 to d2/d12/d3d/da4/c152 0 2024-02-28T16:02:28.060 INFO:tasks.workunit.client.0.smithi057.stdout:5/984: dwrite d2/d15/d63/de7/fe8 [0,4194304] 0 2024-02-28T16:02:28.064 INFO:tasks.workunit.client.0.smithi057.stdout:5/985: creat d2/d15/d5e/d7f/f153 x:0 0 0 2024-02-28T16:02:28.070 INFO:tasks.workunit.client.0.smithi057.stdout:5/986: fdatasync d2/d15/d5e/fff 0 2024-02-28T16:02:28.074 INFO:tasks.workunit.client.0.smithi057.stdout:5/987: fsync d2/ddc/fe3 0 2024-02-28T16:02:28.092 INFO:tasks.workunit.client.0.smithi057.stdout:5/988: dwrite d2/d12/d76/d7a/d95/db5/dcb/dab/df9/ffc [0,4194304] 0 2024-02-28T16:02:28.097 INFO:tasks.workunit.client.0.smithi057.stdout:5/989: creat d2/ddd/f154 x:0 0 0 2024-02-28T16:02:28.100 INFO:tasks.workunit.client.0.smithi057.stdout:5/990: fdatasync d2/d15/f99 0 2024-02-28T16:02:28.106 INFO:tasks.workunit.client.0.smithi057.stdout:5/991: rename d2/d12/d3d/c42 to d2/d19/c155 0 2024-02-28T16:02:28.110 INFO:tasks.workunit.client.0.smithi057.stdout:5/992: mknod d2/d12/d76/d7a/c156 0 2024-02-28T16:02:28.111 INFO:tasks.workunit.client.0.smithi057.stdout:5/993: readlink d2/l2a 0 2024-02-28T16:02:28.126 INFO:tasks.workunit.client.0.smithi057.stdout:5/994: dread d2/d12/d3d/da4/fdb [0,4194304] 0 2024-02-28T16:02:28.130 INFO:tasks.workunit.client.0.smithi057.stdout:5/995: stat d2/d12/d5f/l7e 0 2024-02-28T16:02:28.131 INFO:tasks.workunit.client.0.smithi057.stdout:5/996: read - d2/d12/fc4 zero size 2024-02-28T16:02:28.135 INFO:tasks.workunit.client.0.smithi057.stdout:5/997: dread - d2/d19/d1c/f10f zero size 2024-02-28T16:02:28.137 INFO:tasks.workunit.client.0.smithi057.stdout:5/998: dread - d2/d15/d5e/d9a/f114 zero size 2024-02-28T16:02:28.145 INFO:tasks.workunit.client.0.smithi057.stdout:5/999: rmdir d2/d12/d76/d7a/dad/d116 0 2024-02-28T16:02:28.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:28 smithi057 ceph-mon[28763]: pgmap v46: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 69 MiB/s rd, 148 MiB/s wr, 454 op/s 2024-02-28T16:02:28.415 INFO:tasks.workunit.client.0.smithi057.stdout:3/955: sync 2024-02-28T16:02:28.416 INFO:tasks.workunit.client.0.smithi057.stdout:7/962: sync 2024-02-28T16:02:28.419 INFO:tasks.workunit.client.0.smithi057.stdout:3/956: readlink d8/dd/d14/d2e/d30/d5f/dd9/l128 0 2024-02-28T16:02:28.422 INFO:tasks.workunit.client.0.smithi057.stdout:7/963: write d6/dc/d12/dc9/dce/dfc/dfd/f131 [1654855,103558] 0 2024-02-28T16:02:28.429 INFO:tasks.workunit.client.0.smithi057.stdout:3/957: rename d8/dd/d14/d2e/c3d to d8/dd/d14/d2e/d76/da1/c144 0 2024-02-28T16:02:28.439 INFO:tasks.workunit.client.0.smithi057.stdout:3/958: chown d8/dd/d14/d2e/d76/d89/d6c/c11f 2185 1 2024-02-28T16:02:28.442 INFO:tasks.workunit.client.0.smithi057.stdout:3/959: fdatasync d8/d4b/f9f 0 2024-02-28T16:02:28.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:28 smithi087 ceph-mon[37122]: pgmap v46: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 69 MiB/s rd, 148 MiB/s wr, 454 op/s 2024-02-28T16:02:28.467 INFO:tasks.workunit.client.0.smithi057.stdout:3/960: dwrite d8/dd/f1f [0,4194304] 0 2024-02-28T16:02:28.481 INFO:tasks.workunit.client.0.smithi057.stdout:3/961: mkdir d8/dd/d14/d2e/d3b/d71/d145 0 2024-02-28T16:02:28.508 INFO:tasks.workunit.client.0.smithi057.stdout:3/962: dwrite d8/dd/d14/d2e/d30/d5f/d6b/fd5 [0,4194304] 0 2024-02-28T16:02:28.512 INFO:tasks.workunit.client.0.smithi057.stdout:3/963: chown d8/dd/d14/d2e/d30/d6a/d8c/cfd 2126357 1 2024-02-28T16:02:28.516 INFO:tasks.workunit.client.0.smithi057.stdout:3/964: write d8/dd/d14/d2e/d76/da1/f126 [901172,81560] 0 2024-02-28T16:02:28.520 INFO:tasks.workunit.client.0.smithi057.stdout:3/965: symlink d8/dd/d14/d2e/d30/d49/l146 0 2024-02-28T16:02:28.522 INFO:tasks.workunit.client.0.smithi057.stdout:3/966: read - d8/dd/d14/d2c/fa5 zero size 2024-02-28T16:02:28.526 INFO:tasks.workunit.client.0.smithi057.stdout:3/967: unlink d8/dd/d14/d2e/f137 0 2024-02-28T16:02:28.558 INFO:tasks.workunit.client.0.smithi057.stdout:3/968: dread d8/dd/d14/d2e/d30/fc0 [0,4194304] 0 2024-02-28T16:02:28.563 INFO:tasks.workunit.client.0.smithi057.stdout:3/969: rename d8/dd/d14/d2c/db9 to d8/d4b/dd2/ddd/d114/d147 0 2024-02-28T16:02:28.586 INFO:tasks.workunit.client.0.smithi057.stdout:3/970: dread d8/d4b/f60 [0,4194304] 0 2024-02-28T16:02:28.590 INFO:tasks.workunit.client.0.smithi057.stdout:3/971: chown d8/dd/d14/d2e/d76/da1/c134 8940044 1 2024-02-28T16:02:28.595 INFO:tasks.workunit.client.0.smithi057.stdout:3/972: mkdir d8/dd/d14/d2e/d3b/d54/d148 0 2024-02-28T16:02:28.599 INFO:tasks.workunit.client.0.smithi057.stdout:3/973: symlink d8/dd/d14/d2e/d2f/da2/d10f/l149 0 2024-02-28T16:02:28.603 INFO:tasks.workunit.client.0.smithi057.stdout:3/974: mkdir d8/dd/d14/d2e/d30/d5f/dd9/d14a 0 2024-02-28T16:02:28.607 INFO:tasks.workunit.client.0.smithi057.stdout:3/975: creat d8/dd/d14/d2e/d30/d5f/f14b x:0 0 0 2024-02-28T16:02:28.610 INFO:tasks.workunit.client.0.smithi057.stdout:3/976: creat d8/dd/d14/d2e/d2f/da2/f14c x:0 0 0 2024-02-28T16:02:28.612 INFO:tasks.workunit.client.0.smithi057.stdout:3/977: fdatasync d8/dd/d14/f20 0 2024-02-28T16:02:28.626 INFO:tasks.workunit.client.0.smithi057.stdout:3/978: write d8/dd/d14/d2e/d30/d49/fb5 [2958386,36463] 0 2024-02-28T16:02:28.635 INFO:tasks.workunit.client.0.smithi057.stdout:3/979: mkdir d8/dd/d14/d2e/d30/d5f/dd9/d14d 0 2024-02-28T16:02:28.638 INFO:tasks.workunit.client.0.smithi057.stdout:3/980: readlink d8/dd/d14/d2e/d30/ld4 0 2024-02-28T16:02:28.660 INFO:tasks.workunit.client.0.smithi057.stdout:3/981: dread d8/dd/d14/d2e/fbe [0,4194304] 0 2024-02-28T16:02:28.663 INFO:tasks.workunit.client.0.smithi057.stdout:3/982: chown d8/dd/d14/d2e/d2f/c36 6479207 1 2024-02-28T16:02:28.675 INFO:tasks.workunit.client.0.smithi057.stdout:7/964: sync 2024-02-28T16:02:28.681 INFO:tasks.workunit.client.0.smithi057.stdout:7/965: symlink d6/dc/d12/d1a/d4d/d56/l142 0 2024-02-28T16:02:28.688 INFO:tasks.workunit.client.0.smithi057.stdout:3/983: dwrite d8/d4b/f9f [0,4194304] 0 2024-02-28T16:02:28.694 INFO:tasks.workunit.client.0.smithi057.stdout:7/966: write d6/dc/d67/d9a/da1/f75 [896822,76566] 0 2024-02-28T16:02:28.701 INFO:tasks.workunit.client.0.smithi057.stdout:3/984: truncate d8/dd/d14/f20 4180597 0 2024-02-28T16:02:28.703 INFO:tasks.workunit.client.0.smithi057.stdout:7/967: creat d6/dc/d12/d1a/d4d/df0/f143 x:0 0 0 2024-02-28T16:02:28.706 INFO:tasks.workunit.client.0.smithi057.stdout:7/968: write d6/f140 [2833391,49206] 0 2024-02-28T16:02:28.707 INFO:tasks.workunit.client.0.smithi057.stdout:3/985: getdents d8/dd/d14/d2e/d3b/d54/d148 0 2024-02-28T16:02:28.709 INFO:tasks.workunit.client.0.smithi057.stdout:7/969: write d6/d38/f12d [642591,78266] 0 2024-02-28T16:02:28.712 INFO:tasks.workunit.client.0.smithi057.stdout:3/986: mkdir d8/dd/d14/d2e/d30/d6a/d8c/d14e 0 2024-02-28T16:02:28.713 INFO:tasks.workunit.client.0.smithi057.stdout:7/970: fsync d6/dc/d67/fc7 0 2024-02-28T16:02:28.718 INFO:tasks.workunit.client.0.smithi057.stdout:7/971: mknod d6/dc/d67/d9a/da1/c144 0 2024-02-28T16:02:28.722 INFO:tasks.workunit.client.0.smithi057.stdout:7/972: chown d6/dc/d12/dc9/dce/ce0 222 1 2024-02-28T16:02:28.725 INFO:tasks.workunit.client.0.smithi057.stdout:3/987: write d8/dd/d14/d2e/d30/d6a/fb4 [23048,650] 0 2024-02-28T16:02:28.731 INFO:tasks.workunit.client.0.smithi057.stdout:3/988: read d8/d94/fda [185188,13841] 0 2024-02-28T16:02:28.737 INFO:tasks.workunit.client.0.smithi057.stdout:3/989: symlink d8/dd/d14/d2e/l14f 0 2024-02-28T16:02:28.745 INFO:tasks.workunit.client.0.smithi057.stdout:7/973: dwrite d6/dc/d35/d58/f10f [0,4194304] 0 2024-02-28T16:02:28.764 INFO:tasks.workunit.client.0.smithi057.stdout:7/974: dread - d6/dc/d87/f13f zero size 2024-02-28T16:02:28.766 INFO:tasks.workunit.client.0.smithi057.stdout:7/975: chown d6/dc/d12/d1a/d4d 1 1 2024-02-28T16:02:28.766 INFO:tasks.workunit.client.0.smithi057.stdout:3/990: truncate d8/dd/d14/d2e/d3b/d71/fff 284729 0 2024-02-28T16:02:28.770 INFO:tasks.workunit.client.0.smithi057.stdout:7/976: creat d6/dc/d12/d1a/d4d/d56/db0/f145 x:0 0 0 2024-02-28T16:02:28.775 INFO:tasks.workunit.client.0.smithi057.stdout:3/991: rename d8/dd/d14/d2e/d3b/d71/d145 to d8/d4b/dd2/ddd/d114/d147/d133/d150 0 2024-02-28T16:02:28.776 INFO:tasks.workunit.client.0.smithi057.stdout:7/977: creat d6/dc/d12/d1a/d4d/dd9/f146 x:0 0 0 2024-02-28T16:02:28.778 INFO:tasks.workunit.client.0.smithi057.stdout:3/992: chown d8/dd/d14/d2e/d76/da1/c134 467 1 2024-02-28T16:02:28.780 INFO:tasks.workunit.client.0.smithi057.stdout:7/978: symlink d6/dc/d12/dc9/l147 0 2024-02-28T16:02:28.784 INFO:tasks.workunit.client.0.smithi057.stdout:3/993: unlink d8/dd/d14/d2e/d30/d5f/c7c 0 2024-02-28T16:02:28.785 INFO:tasks.workunit.client.0.smithi057.stdout:7/979: symlink d6/dc/d12/d29/dcc/l148 0 2024-02-28T16:02:28.786 INFO:tasks.workunit.client.0.smithi057.stdout:3/994: chown d8/d4b/dd2/ddd/d114/d147/d133/d25 27564 1 2024-02-28T16:02:28.789 INFO:tasks.workunit.client.0.smithi057.stdout:7/980: rmdir d6/dc/d12/dc9/dce/dfc/dfd 39 2024-02-28T16:02:28.794 INFO:tasks.workunit.client.0.smithi057.stdout:7/981: symlink d6/dc/d101/l149 0 2024-02-28T16:02:28.796 INFO:tasks.workunit.client.0.smithi057.stdout:7/982: read d6/dc/dab/f105 [718160,90571] 0 2024-02-28T16:02:28.799 INFO:tasks.workunit.client.0.smithi057.stdout:7/983: chown d6/dc/d12/d1a/d4d/f92 1542 1 2024-02-28T16:02:28.799 INFO:tasks.workunit.client.0.smithi057.stdout:3/995: dread d8/dd/d14/d2e/fbe [0,4194304] 0 2024-02-28T16:02:28.803 INFO:tasks.workunit.client.0.smithi057.stdout:3/996: readlink d8/d4b/dd2/ddd/d114/d147/d133/d2a/de3/d11e/l131 0 2024-02-28T16:02:28.809 INFO:tasks.workunit.client.0.smithi057.stdout:3/997: rename d8/dd/d14/d2e/d30/ld4 to d8/d4b/dd2/ddd/d114/l151 0 2024-02-28T16:02:28.817 INFO:tasks.workunit.client.0.smithi057.stdout:3/998: write d8/dd/d14/d2e/d30/f3f [658109,65187] 0 2024-02-28T16:02:28.819 INFO:tasks.workunit.client.0.smithi057.stdout:7/984: dwrite d6/f23 [0,4194304] 0 2024-02-28T16:02:28.822 INFO:tasks.workunit.client.0.smithi057.stdout:7/985: chown d6/dc/d12/d29/f3e 50 1 2024-02-28T16:02:28.823 INFO:tasks.workunit.client.0.smithi057.stdout:3/999: dread d8/dd/d14/d2e/f127 [0,4194304] 0 2024-02-28T16:02:28.824 INFO:tasks.workunit.client.0.smithi057.stdout:7/986: mknod d6/d38/c14a 0 2024-02-28T16:02:28.832 INFO:tasks.workunit.client.0.smithi057.stdout:7/987: write d6/dc/d12/d1a/d4d/f92 [768712,3190] 0 2024-02-28T16:02:28.838 INFO:tasks.workunit.client.0.smithi057.stdout:7/988: link d6/dc/d35/d58/l71 d6/dc/d12/d1a/d4c/l14b 0 2024-02-28T16:02:28.840 INFO:tasks.workunit.client.0.smithi057.stdout:7/989: dread - d6/dc/d87/f13f zero size 2024-02-28T16:02:28.852 INFO:tasks.workunit.client.0.smithi057.stdout:7/990: dwrite d6/dc/d35/f83 [0,4194304] 0 2024-02-28T16:02:28.856 INFO:tasks.workunit.client.0.smithi057.stdout:7/991: rmdir d6/dc/d12/d1a/d4d/df0 39 2024-02-28T16:02:28.860 INFO:tasks.workunit.client.0.smithi057.stdout:7/992: creat d6/dc/d67/f14c x:0 0 0 2024-02-28T16:02:28.877 INFO:tasks.workunit.client.0.smithi057.stdout:7/993: dwrite d6/dc/d67/f8a [0,4194304] 0 2024-02-28T16:02:28.884 INFO:tasks.workunit.client.0.smithi057.stdout:7/994: write d6/dc/d12/d1a/d4c/d63/f110 [1265655,72084] 0 2024-02-28T16:02:28.910 INFO:tasks.workunit.client.0.smithi057.stdout:7/995: dread d6/dc/d12/d1a/d4c/d63/f110 [0,4194304] 0 2024-02-28T16:02:28.913 INFO:tasks.workunit.client.0.smithi057.stdout:7/996: mknod d6/d26/c14d 0 2024-02-28T16:02:28.916 INFO:tasks.workunit.client.0.smithi057.stdout:7/997: creat d6/dc/d35/d58/dd5/f14e x:0 0 0 2024-02-28T16:02:28.918 INFO:tasks.workunit.client.0.smithi057.stdout:7/998: chown d6/d38/f10b 23523 1 2024-02-28T16:02:28.919 INFO:tasks.workunit.client.0.smithi057.stdout:7/999: readlink d6/dc/d12/lc5 0 2024-02-28T16:02:28.929 INFO:tasks.workunit.client.0.smithi057.stderr:+ rm -rf -- ./tmp.GX0gvmrELa 2024-02-28T16:02:30.053 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:30 smithi057 ceph-mon[28763]: pgmap v47: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 62 MiB/s rd, 126 MiB/s wr, 355 op/s 2024-02-28T16:02:30.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:30 smithi087 ceph-mon[37122]: pgmap v47: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 62 MiB/s rd, 126 MiB/s wr, 355 op/s 2024-02-28T16:02:31.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:31 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:02:31.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:31 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:02:32.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:32 smithi057 ceph-mon[28763]: pgmap v48: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 52 MiB/s rd, 101 MiB/s wr, 320 op/s 2024-02-28T16:02:32.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:32 smithi087 ceph-mon[37122]: pgmap v48: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 52 MiB/s rd, 101 MiB/s wr, 320 op/s 2024-02-28T16:02:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:34 smithi057 ceph-mon[28763]: pgmap v49: 65 pgs: 65 active+clean; 2.7 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 57 MiB/s rd, 116 MiB/s wr, 408 op/s 2024-02-28T16:02:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:34 smithi057 ceph-mon[28763]: mgrmap e26: smithi087.ewrszc(active, since 92s), standbys: smithi057.upqerc 2024-02-28T16:02:34.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:34 smithi087 ceph-mon[37122]: pgmap v49: 65 pgs: 65 active+clean; 2.7 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 57 MiB/s rd, 116 MiB/s wr, 408 op/s 2024-02-28T16:02:34.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:34 smithi087 ceph-mon[37122]: mgrmap e26: smithi087.ewrszc(active, since 92s), standbys: smithi057.upqerc 2024-02-28T16:02:35.169 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-28T16:02:35.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-28T16:02:35.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:35 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:35.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:35 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:35.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:35 smithi057 ceph-mon[28763]: Reconfiguring node-exporter.smithi087 (dependencies changed)... 2024-02-28T16:02:35.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:35 smithi057 ceph-mon[28763]: Reconfiguring daemon node-exporter.smithi087 on smithi087 2024-02-28T16:02:35.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:35 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:35.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:35 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:35.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:35 smithi087 ceph-mon[37122]: Reconfiguring node-exporter.smithi087 (dependencies changed)... 2024-02-28T16:02:35.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:35 smithi087 ceph-mon[37122]: Reconfiguring daemon node-exporter.smithi087 on smithi087 2024-02-28T16:02:36.642 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:36 smithi087 ceph-mon[37122]: pgmap v50: 65 pgs: 65 active+clean; 2.7 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 32 MiB/s rd, 64 MiB/s wr, 258 op/s 2024-02-28T16:02:36.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:36 smithi057 ceph-mon[28763]: pgmap v50: 65 pgs: 65 active+clean; 2.7 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 32 MiB/s rd, 64 MiB/s wr, 258 op/s 2024-02-28T16:02:38.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:38 smithi087 ceph-mon[37122]: pgmap v51: 65 pgs: 65 active+clean; 2.1 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 33 MiB/s rd, 64 MiB/s wr, 306 op/s 2024-02-28T16:02:38.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:38 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:38.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:38 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:38.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:38 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:02:38.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:38 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:02:38.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:38 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:02:38.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:38 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:02:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:38 smithi057 ceph-mon[28763]: pgmap v51: 65 pgs: 65 active+clean; 2.1 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 33 MiB/s rd, 64 MiB/s wr, 306 op/s 2024-02-28T16:02:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:38 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:38 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:38 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:02:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:38 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:02:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:38 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:02:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:38 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:02:39.567 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:39 smithi057 ceph-mon[28763]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:02:39.567 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:39 smithi057 ceph-mon[28763]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:02:39.567 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:39 smithi057 ceph-mon[28763]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:02:39.568 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:39 smithi057 ceph-mon[28763]: Upgrade: Need to upgrade myself (mgr.smithi087.ewrszc) 2024-02-28T16:02:39.568 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:39 smithi057 ceph-mon[28763]: Upgrade: Need to upgrade myself (mgr.smithi087.ewrszc) 2024-02-28T16:02:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:39 smithi087 ceph-mon[37122]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:02:39.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:39 smithi087 ceph-mon[37122]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:02:39.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:39 smithi087 ceph-mon[37122]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:02:39.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:39 smithi087 ceph-mon[37122]: Upgrade: Need to upgrade myself (mgr.smithi087.ewrszc) 2024-02-28T16:02:39.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:39 smithi087 ceph-mon[37122]: Upgrade: Need to upgrade myself (mgr.smithi087.ewrszc) 2024-02-28T16:02:40.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:40 smithi087 ceph-mon[37122]: pgmap v52: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 16 MiB/s rd, 34 MiB/s wr, 201 op/s 2024-02-28T16:02:40.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:40 smithi057 ceph-mon[28763]: pgmap v52: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 16 MiB/s rd, 34 MiB/s wr, 201 op/s 2024-02-28T16:02:41.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:41 smithi087 ceph-mon[37122]: Upgrade: Updating mgr.smithi057.upqerc 2024-02-28T16:02:41.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:41 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:41.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:41 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi057.upqerc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:02:41.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:41 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi057.upqerc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:02:41.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:41 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:02:41.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:41 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:02:41.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:41 smithi087 ceph-mon[37122]: Deploying daemon mgr.smithi057.upqerc on smithi057 2024-02-28T16:02:41.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:41 smithi087 ceph-mon[37122]: pgmap v53: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 5.3 MiB/s rd, 16 MiB/s wr, 157 op/s 2024-02-28T16:02:42.049 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:41 smithi057 ceph-mon[28763]: Upgrade: Updating mgr.smithi057.upqerc 2024-02-28T16:02:42.049 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:41 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:42.049 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:41 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi057.upqerc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:02:42.049 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:41 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi057.upqerc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:02:42.049 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:41 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:02:42.049 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:41 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:02:42.049 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:41 smithi057 ceph-mon[28763]: Deploying daemon mgr.smithi057.upqerc on smithi057 2024-02-28T16:02:42.049 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:41 smithi057 ceph-mon[28763]: pgmap v53: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 5.3 MiB/s rd, 16 MiB/s wr, 157 op/s 2024-02-28T16:02:44.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:44 smithi057 ceph-mon[28763]: pgmap v54: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 5.7 MiB/s rd, 16 MiB/s wr, 219 op/s 2024-02-28T16:02:44.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:44 smithi087 ceph-mon[37122]: pgmap v54: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 5.7 MiB/s rd, 16 MiB/s wr, 219 op/s 2024-02-28T16:02:44.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.946+0000 7efde3000700 1 -- 172.21.15.57:0/2677251236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efddc0fcef0 msgr2=0x7efddc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:44.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.946+0000 7efde3000700 1 --2- 172.21.15.57:0/2677251236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efddc0fcef0 0x7efddc0fd320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efdcc004970 tx=0x7efdcc009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:44.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.946+0000 7efde3000700 1 -- 172.21.15.57:0/2677251236 shutdown_connections 2024-02-28T16:02:44.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.946+0000 7efde3000700 1 --2- 172.21.15.57:0/2677251236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efddc0fe0e0 0x7efddc0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:44.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.946+0000 7efde3000700 1 --2- 172.21.15.57:0/2677251236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efddc0fcef0 0x7efddc0fd320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:44.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.946+0000 7efde3000700 1 -- 172.21.15.57:0/2677251236 >> 172.21.15.57:0/2677251236 conn(0x7efddc0f8620 msgr2=0x7efddc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:44.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.947+0000 7efde3000700 1 -- 172.21.15.57:0/2677251236 shutdown_connections 2024-02-28T16:02:44.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.947+0000 7efde3000700 1 -- 172.21.15.57:0/2677251236 wait complete. 2024-02-28T16:02:44.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.948+0000 7efde3000700 1 Processor -- start 2024-02-28T16:02:44.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.949+0000 7efde3000700 1 -- start start 2024-02-28T16:02:44.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.949+0000 7efde3000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efddc0fcef0 0x7efddc10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:44.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.949+0000 7efde3000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efddc0fe0e0 0x7efddc10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:44.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.949+0000 7efde3000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc10e470 con 0x7efddc0fe0e0 2024-02-28T16:02:44.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.949+0000 7efde3000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc10ed10 con 0x7efddc0fcef0 2024-02-28T16:02:44.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.950+0000 7efddbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efddc0fcef0 0x7efddc10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:44.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.950+0000 7efddbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efddc0fcef0 0x7efddc10d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:43022/0 (socket says 172.21.15.57:43022) 2024-02-28T16:02:44.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.950+0000 7efddbe00700 1 -- 172.21.15.57:0/3238437507 learned_addr learned my addr 172.21.15.57:0/3238437507 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:44.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.950+0000 7efddb400700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efddc0fe0e0 0x7efddc10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:44.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.951+0000 7efddb400700 1 -- 172.21.15.57:0/3238437507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efddc0fcef0 msgr2=0x7efddc10d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:44.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.951+0000 7efddb400700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efddc0fcef0 0x7efddc10d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:44.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.951+0000 7efddb400700 1 -- 172.21.15.57:0/3238437507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc005040 con 0x7efddc0fe0e0 2024-02-28T16:02:44.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.952+0000 7efddb400700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efddc0fe0e0 0x7efddc10de70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009fd0 tx=0x7efdc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:44.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.952+0000 7efdd3e00700 1 -- 172.21.15.57:0/3238437507 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc8004e90 con 0x7efddc0fe0e0 2024-02-28T16:02:44.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.952+0000 7efdd3e00700 1 -- 172.21.15.57:0/3238437507 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdc800f040 con 0x7efddc0fe0e0 2024-02-28T16:02:44.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.952+0000 7efde3000700 1 -- 172.21.15.57:0/3238437507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc10ef90 con 0x7efddc0fe0e0 2024-02-28T16:02:44.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.953+0000 7efde3000700 1 -- 172.21.15.57:0/3238437507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc10f4d0 con 0x7efddc0fe0e0 2024-02-28T16:02:44.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.953+0000 7efdd3e00700 1 -- 172.21.15.57:0/3238437507 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc800ca50 con 0x7efddc0fe0e0 2024-02-28T16:02:44.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.954+0000 7efde3000700 1 -- 172.21.15.57:0/3238437507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc0052e0 con 0x7efddc0fe0e0 2024-02-28T16:02:44.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.956+0000 7efdd3e00700 1 -- 172.21.15.57:0/3238437507 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 88910+0+0 (secure 0 0 0) 0x7efdc8007cc0 con 0x7efddc0fe0e0 2024-02-28T16:02:44.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.958+0000 7efdd3e00700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7efdc006b1d0 0x7efdc006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:44.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.958+0000 7efdd3e00700 1 -- 172.21.15.57:0/3238437507 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7efdc8089420 con 0x7efddc0fe0e0 2024-02-28T16:02:44.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.958+0000 7efddbe00700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7efdc006b1d0 0x7efdc006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:44.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.959+0000 7efddbe00700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7efdc006b1d0 0x7efdc006d680 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efdcc004e30 tx=0x7efdcc009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:44.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:44.968+0000 7efdd3e00700 1 -- 172.21.15.57:0/3238437507 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efdc804f620 con 0x7efddc0fe0e0 2024-02-28T16:02:45.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.252+0000 7efde3000700 1 -- 172.21.15.57:0/3238437507 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdbc000bf0 con 0x7efdc006b1d0 2024-02-28T16:02:45.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.255+0000 7efdd3e00700 1 -- 172.21.15.57:0/3238437507 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7efdbc000bf0 con 0x7efdc006b1d0 2024-02-28T16:02:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.257+0000 7efde3000700 1 -- 172.21.15.57:0/3238437507 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7efdc006b1d0 msgr2=0x7efdc006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.257+0000 7efde3000700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7efdc006b1d0 0x7efdc006d680 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efdcc004e30 tx=0x7efdcc009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.257+0000 7efde3000700 1 -- 172.21.15.57:0/3238437507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efddc0fe0e0 msgr2=0x7efddc10de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.257+0000 7efde3000700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efddc0fe0e0 0x7efddc10de70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009fd0 tx=0x7efdc800b040 comp rx=0 tx=0).stop 2024-02-28T16:02:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.257+0000 7efde3000700 1 -- 172.21.15.57:0/3238437507 shutdown_connections 2024-02-28T16:02:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.257+0000 7efde3000700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7efdc006b1d0 0x7efdc006d680 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.257+0000 7efde3000700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efddc0fcef0 0x7efddc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.257+0000 7efde3000700 1 --2- 172.21.15.57:0/3238437507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efddc0fe0e0 0x7efddc10de70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.257+0000 7efde3000700 1 -- 172.21.15.57:0/3238437507 >> 172.21.15.57:0/3238437507 conn(0x7efddc0f8620 msgr2=0x7efddc1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.258+0000 7efde3000700 1 -- 172.21.15.57:0/3238437507 shutdown_connections 2024-02-28T16:02:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.258+0000 7efde3000700 1 -- 172.21.15.57:0/3238437507 wait complete. 2024-02-28T16:02:45.265 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:02:45.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.428+0000 7f720c400700 1 -- 172.21.15.57:0/3906693474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7204071eb0 msgr2=0x7f7204070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:45.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.428+0000 7f720c400700 1 --2- 172.21.15.57:0/3906693474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7204071eb0 0x7f7204070320 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f71f8004940 tx=0x7f71f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:45.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.428+0000 7f720c400700 1 -- 172.21.15.57:0/3906693474 shutdown_connections 2024-02-28T16:02:45.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.428+0000 7f720c400700 1 --2- 172.21.15.57:0/3906693474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204070860 0x7f7204070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.428+0000 7f720c400700 1 --2- 172.21.15.57:0/3906693474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7204071eb0 0x7f7204070320 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.428+0000 7f720c400700 1 -- 172.21.15.57:0/3906693474 >> 172.21.15.57:0/3906693474 conn(0x7f72040f8620 msgr2=0x7f72040faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:45.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.428+0000 7f720c400700 1 -- 172.21.15.57:0/3906693474 shutdown_connections 2024-02-28T16:02:45.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.428+0000 7f720c400700 1 -- 172.21.15.57:0/3906693474 wait complete. 2024-02-28T16:02:45.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.429+0000 7f720c400700 1 Processor -- start 2024-02-28T16:02:45.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.429+0000 7f720c400700 1 -- start start 2024-02-28T16:02:45.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f720c400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7204070860 0x7f720410fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:45.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f720c400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204071eb0 0x7f7204110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:45.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f720c400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7204110600 con 0x7f7204070860 2024-02-28T16:02:45.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f720c400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7204110ea0 con 0x7f7204071eb0 2024-02-28T16:02:45.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f7209a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7204070860 0x7f720410fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:45.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f7209a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7204070860 0x7f720410fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57424/0 (socket says 172.21.15.57:57424) 2024-02-28T16:02:45.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f7209a00700 1 -- 172.21.15.57:0/3924193770 learned_addr learned my addr 172.21.15.57:0/3924193770 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:45.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f7209000700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204071eb0 0x7f7204110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:45.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f7209a00700 1 -- 172.21.15.57:0/3924193770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204071eb0 msgr2=0x7f7204110000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:45.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f7209a00700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204071eb0 0x7f7204110000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.430+0000 7f7209a00700 1 -- 172.21.15.57:0/3924193770 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f8005040 con 0x7f7204070860 2024-02-28T16:02:45.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.431+0000 7f7209a00700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7204070860 0x7f720410fac0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009fd0 tx=0x7f71f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:45.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.431+0000 7f7201600700 1 -- 172.21.15.57:0/3924193770 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71f8021070 con 0x7f7204070860 2024-02-28T16:02:45.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.431+0000 7f7201600700 1 -- 172.21.15.57:0/3924193770 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71f801c400 con 0x7f7204070860 2024-02-28T16:02:45.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.431+0000 7f7201600700 1 -- 172.21.15.57:0/3924193770 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71f800e070 con 0x7f7204070860 2024-02-28T16:02:45.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.431+0000 7f720c400700 1 -- 172.21.15.57:0/3924193770 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7204111120 con 0x7f7204070860 2024-02-28T16:02:45.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.431+0000 7f720c400700 1 -- 172.21.15.57:0/3924193770 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7204111600 con 0x7f7204070860 2024-02-28T16:02:45.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.433+0000 7f720c400700 1 -- 172.21.15.57:0/3924193770 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720404bed0 con 0x7f7204070860 2024-02-28T16:02:45.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.434+0000 7f7201600700 1 -- 172.21.15.57:0/3924193770 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 88910+0+0 (secure 0 0 0) 0x7f71f801c570 con 0x7f7204070860 2024-02-28T16:02:45.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.434+0000 7f7201600700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f71ec06b1d0 0x7f71ec06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:45.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.435+0000 7f7201600700 1 -- 172.21.15.57:0/3924193770 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f71f808ae30 con 0x7f7204070860 2024-02-28T16:02:45.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.435+0000 7f7209000700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f71ec06b1d0 0x7f71ec06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:45.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.436+0000 7f7209000700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f71ec06b1d0 0x7f71ec06d680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71f0004600 tx=0x7f71f000b040 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:45.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.440+0000 7f7201600700 1 -- 172.21.15.57:0/3924193770 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f71f8058bc0 con 0x7f7204070860 2024-02-28T16:02:45.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.724+0000 7f720c400700 1 -- 172.21.15.57:0/3924193770 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7204104550 con 0x7f71ec06b1d0 2024-02-28T16:02:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.726+0000 7f7201600700 1 -- 172.21.15.57:0/3924193770 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f7204104550 con 0x7f71ec06b1d0 2024-02-28T16:02:45.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.729+0000 7f720c400700 1 -- 172.21.15.57:0/3924193770 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f71ec06b1d0 msgr2=0x7f71ec06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:45.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.729+0000 7f720c400700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f71ec06b1d0 0x7f71ec06d680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71f0004600 tx=0x7f71f000b040 comp rx=0 tx=0).stop 2024-02-28T16:02:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.729+0000 7f720c400700 1 -- 172.21.15.57:0/3924193770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7204070860 msgr2=0x7f720410fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.729+0000 7f720c400700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7204070860 0x7f720410fac0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009fd0 tx=0x7f71f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.730+0000 7f720c400700 1 -- 172.21.15.57:0/3924193770 shutdown_connections 2024-02-28T16:02:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.730+0000 7f720c400700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f71ec06b1d0 0x7f71ec06d680 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.730+0000 7f720c400700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7204070860 0x7f720410fac0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.730+0000 7f720c400700 1 --2- 172.21.15.57:0/3924193770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204071eb0 0x7f7204110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.730+0000 7f720c400700 1 -- 172.21.15.57:0/3924193770 >> 172.21.15.57:0/3924193770 conn(0x7f72040f8620 msgr2=0x7f7204102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:45.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.730+0000 7f720c400700 1 -- 172.21.15.57:0/3924193770 shutdown_connections 2024-02-28T16:02:45.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.730+0000 7f720c400700 1 -- 172.21.15.57:0/3924193770 wait complete. 2024-02-28T16:02:45.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.905+0000 7f589c600700 1 -- 172.21.15.57:0/2029104987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58940708c0 msgr2=0x7f5894070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:45.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.905+0000 7f589c600700 1 --2- 172.21.15.57:0/2029104987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58940708c0 0x7f5894070d10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5880004940 tx=0x7f5880009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:45.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.905+0000 7f589c600700 1 -- 172.21.15.57:0/2029104987 shutdown_connections 2024-02-28T16:02:45.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.905+0000 7f589c600700 1 --2- 172.21.15.57:0/2029104987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58940708c0 0x7f5894070d10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.905+0000 7f589c600700 1 --2- 172.21.15.57:0/2029104987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5894071f10 0x7f5894070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.905+0000 7f589c600700 1 -- 172.21.15.57:0/2029104987 >> 172.21.15.57:0/2029104987 conn(0x7f58940f8620 msgr2=0x7f58940faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:45.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.905+0000 7f589c600700 1 -- 172.21.15.57:0/2029104987 shutdown_connections 2024-02-28T16:02:45.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.905+0000 7f589c600700 1 -- 172.21.15.57:0/2029104987 wait complete. 2024-02-28T16:02:45.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.906+0000 7f589c600700 1 Processor -- start 2024-02-28T16:02:45.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.906+0000 7f589c600700 1 -- start start 2024-02-28T16:02:45.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.906+0000 7f589c600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58940708c0 0x7f589410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:45.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.906+0000 7f589c600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5894071f10 0x7f58941100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:45.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.906+0000 7f589c600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58941106b0 con 0x7f5894071f10 2024-02-28T16:02:45.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.906+0000 7f589c600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5894110f50 con 0x7f58940708c0 2024-02-28T16:02:45.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.907+0000 7f5899200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5894071f10 0x7f58941100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:45.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.907+0000 7f5899200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5894071f10 0x7f58941100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57432/0 (socket says 172.21.15.57:57432) 2024-02-28T16:02:45.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.907+0000 7f5899200700 1 -- 172.21.15.57:0/596379972 learned_addr learned my addr 172.21.15.57:0/596379972 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:45.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.907+0000 7f5899c00700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58940708c0 0x7f589410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:45.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.907+0000 7f5899200700 1 -- 172.21.15.57:0/596379972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58940708c0 msgr2=0x7f589410fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:45.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.907+0000 7f5899200700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58940708c0 0x7f589410fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:45.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.907+0000 7f5899200700 1 -- 172.21.15.57:0/596379972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880005040 con 0x7f5894071f10 2024-02-28T16:02:45.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.907+0000 7f5899200700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5894071f10 0x7f58941100b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5880009fd0 tx=0x7f5880009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:45.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.908+0000 7f5891600700 1 -- 172.21.15.57:0/596379972 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f588000e040 con 0x7f5894071f10 2024-02-28T16:02:45.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.908+0000 7f5891600700 1 -- 172.21.15.57:0/596379972 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5880004290 con 0x7f5894071f10 2024-02-28T16:02:45.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.908+0000 7f5891600700 1 -- 172.21.15.57:0/596379972 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f588001c630 con 0x7f5894071f10 2024-02-28T16:02:45.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.908+0000 7f589c600700 1 -- 172.21.15.57:0/596379972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58941111d0 con 0x7f5894071f10 2024-02-28T16:02:45.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.908+0000 7f589c600700 1 -- 172.21.15.57:0/596379972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5894111710 con 0x7f5894071f10 2024-02-28T16:02:45.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.909+0000 7f589c600700 1 -- 172.21.15.57:0/596379972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589404bed0 con 0x7f5894071f10 2024-02-28T16:02:45.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.911+0000 7f5891600700 1 -- 172.21.15.57:0/596379972 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 88910+0+0 (secure 0 0 0) 0x7f588000bb90 con 0x7f5894071f10 2024-02-28T16:02:45.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.912+0000 7f5891600700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f587c06b1d0 0x7f587c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:45.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.912+0000 7f5891600700 1 -- 172.21.15.57:0/596379972 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f588008af70 con 0x7f5894071f10 2024-02-28T16:02:45.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.913+0000 7f5899c00700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f587c06b1d0 0x7f587c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:45.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.914+0000 7f5899c00700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f587c06b1d0 0x7f587c06d680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58880041d0 tx=0x7f58880043c0 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:45.917+0000 7f5891600700 1 -- 172.21.15.57:0/596379972 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5880058c80 con 0x7f5894071f10 2024-02-28T16:02:46.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.209+0000 7f589c600700 1 -- 172.21.15.57:0/596379972 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5894111ba0 con 0x7f587c06b1d0 2024-02-28T16:02:46.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.237+0000 7f5891600700 1 -- 172.21.15.57:0/596379972 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5894111ba0 con 0x7f587c06b1d0 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 starting - - - - 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (12m) 88s ago 12m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (10m) 92s ago 10m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 starting - - - - 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (4m) 88s ago 4m 75.1M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (4m) 88s ago 4m 44.2M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (4m) 92s ago 4m 104M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (4m) 92s ago 4m 50.2M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:9283 running (13m) 88s ago 13m 339M - 17.2.7-535-gc0f02e60 1c37ed371348 2db340312662 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283 running (2m) 92s ago 10m 490M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 83ce464fbb4f 2024-02-28T16:02:46.231 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (13m) 88s ago 13m 47.2M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T16:02:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (10m) 92s ago 10m 36.8M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T16:02:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 starting - - - - 2024-02-28T16:02:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 starting - - - - 2024-02-28T16:02:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (9m) 88s ago 9m 91.3M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:02:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (8m) 88s ago 8m 97.9M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:02:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (8m) 88s ago 8m 83.3M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:02:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (7m) 92s ago 7m 99.7M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:02:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (7m) 92s ago 7m 94.7M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:02:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (6m) 92s ago 6m 89.1M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:02:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 starting - - - - 2024-02-28T16:02:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.240+0000 7f589c600700 1 -- 172.21.15.57:0/596379972 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f587c06b1d0 msgr2=0x7f587c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.240+0000 7f589c600700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f587c06b1d0 0x7f587c06d680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58880041d0 tx=0x7f58880043c0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.240+0000 7f589c600700 1 -- 172.21.15.57:0/596379972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5894071f10 msgr2=0x7f58941100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.240+0000 7f589c600700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5894071f10 0x7f58941100b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5880009fd0 tx=0x7f5880009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.240+0000 7f589c600700 1 -- 172.21.15.57:0/596379972 shutdown_connections 2024-02-28T16:02:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.240+0000 7f589c600700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f587c06b1d0 0x7f587c06d680 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.240+0000 7f589c600700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58940708c0 0x7f589410fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.240+0000 7f589c600700 1 --2- 172.21.15.57:0/596379972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5894071f10 0x7f58941100b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.240+0000 7f589c600700 1 -- 172.21.15.57:0/596379972 >> 172.21.15.57:0/596379972 conn(0x7f58940f8620 msgr2=0x7f5894102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.241+0000 7f589c600700 1 -- 172.21.15.57:0/596379972 shutdown_connections 2024-02-28T16:02:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.241+0000 7f589c600700 1 -- 172.21.15.57:0/596379972 wait complete. 2024-02-28T16:02:46.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:46 smithi057 ceph-mon[28763]: pgmap v55: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 762 KiB/s rd, 779 KiB/s wr, 130 op/s 2024-02-28T16:02:46.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:46 smithi057 ceph-mon[28763]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:46.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:46 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:02:46.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.437+0000 7fa097e00700 1 -- 172.21.15.57:0/1216797769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0980fefb0 msgr2=0x7fa0980ff3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:46.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.437+0000 7fa097e00700 1 --2- 172.21.15.57:0/1216797769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0980fefb0 0x7fa0980ff3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa088004880 tx=0x7fa088009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:46.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.437+0000 7fa097e00700 1 -- 172.21.15.57:0/1216797769 shutdown_connections 2024-02-28T16:02:46.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.437+0000 7fa097e00700 1 --2- 172.21.15.57:0/1216797769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981001c0 0x7fa098100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.437+0000 7fa097e00700 1 --2- 172.21.15.57:0/1216797769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0980fefb0 0x7fa0980ff3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.437+0000 7fa097e00700 1 -- 172.21.15.57:0/1216797769 >> 172.21.15.57:0/1216797769 conn(0x7fa0980fa760 msgr2=0x7fa0980fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:46.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.437+0000 7fa097e00700 1 -- 172.21.15.57:0/1216797769 shutdown_connections 2024-02-28T16:02:46.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.437+0000 7fa097e00700 1 -- 172.21.15.57:0/1216797769 wait complete. 2024-02-28T16:02:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.438+0000 7fa097e00700 1 Processor -- start 2024-02-28T16:02:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.438+0000 7fa097e00700 1 -- start start 2024-02-28T16:02:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.438+0000 7fa097e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0980fefb0 0x7fa09806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.438+0000 7fa097e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981001c0 0x7fa09806f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.438+0000 7fa097e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09806fae0 con 0x7fa0981001c0 2024-02-28T16:02:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.438+0000 7fa097e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0981195a0 con 0x7fa0980fefb0 2024-02-28T16:02:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.439+0000 7fa096000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981001c0 0x7fa09806f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.439+0000 7fa096a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0980fefb0 0x7fa09806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.439+0000 7fa096000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981001c0 0x7fa09806f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57448/0 (socket says 172.21.15.57:57448) 2024-02-28T16:02:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.439+0000 7fa096000700 1 -- 172.21.15.57:0/2055920926 learned_addr learned my addr 172.21.15.57:0/2055920926 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.439+0000 7fa096000700 1 -- 172.21.15.57:0/2055920926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0980fefb0 msgr2=0x7fa09806efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.439+0000 7fa096000700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0980fefb0 0x7fa09806efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.439+0000 7fa096000700 1 -- 172.21.15.57:0/2055920926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa084005040 con 0x7fa0981001c0 2024-02-28T16:02:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.439+0000 7fa096a00700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0980fefb0 0x7fa09806efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:02:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.440+0000 7fa096000700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981001c0 0x7fa09806f4e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa0840096b0 tx=0x7fa084009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.440+0000 7fa08ea00700 1 -- 172.21.15.57:0/2055920926 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa084017070 con 0x7fa0981001c0 2024-02-28T16:02:46.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.440+0000 7fa097e00700 1 -- 172.21.15.57:0/2055920926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa088005040 con 0x7fa0981001c0 2024-02-28T16:02:46.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.440+0000 7fa08ea00700 1 -- 172.21.15.57:0/2055920926 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa08400f040 con 0x7fa0981001c0 2024-02-28T16:02:46.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.440+0000 7fa08ea00700 1 -- 172.21.15.57:0/2055920926 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa084013be0 con 0x7fa0981001c0 2024-02-28T16:02:46.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.440+0000 7fa097e00700 1 -- 172.21.15.57:0/2055920926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa098119c50 con 0x7fa0981001c0 2024-02-28T16:02:46.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.441+0000 7fa097e00700 1 -- 172.21.15.57:0/2055920926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09804bed0 con 0x7fa0981001c0 2024-02-28T16:02:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.442+0000 7fa08ea00700 1 -- 172.21.15.57:0/2055920926 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 88910+0+0 (secure 0 0 0) 0x7fa08400e840 con 0x7fa0981001c0 2024-02-28T16:02:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.443+0000 7fa08ea00700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa07c06b1c0 0x7fa07c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.443+0000 7fa08ea00700 1 -- 172.21.15.57:0/2055920926 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fa084089640 con 0x7fa0981001c0 2024-02-28T16:02:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.444+0000 7fa096a00700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa07c06b1c0 0x7fa07c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.445+0000 7fa096a00700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa07c06b1c0 0x7fa07c06d670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa088009fd0 tx=0x7fa088009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:46.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.451+0000 7fa08ea00700 1 -- 172.21.15.57:0/2055920926 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa084057370 con 0x7fa0981001c0 2024-02-28T16:02:46.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:46 smithi087 ceph-mon[37122]: pgmap v55: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 762 KiB/s rd, 779 KiB/s wr, 130 op/s 2024-02-28T16:02:46.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:46 smithi087 ceph-mon[37122]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:46.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:46 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:02:46.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.818+0000 7fa097e00700 1 -- 172.21.15.57:0/2055920926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa098107a90 con 0x7fa0981001c0 2024-02-28T16:02:46.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.818+0000 7fa08ea00700 1 -- 172.21.15.57:0/2055920926 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fa084056f00 con 0x7fa0981001c0 2024-02-28T16:02:46.812 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:02:46.812 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:02:46.812 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:02:46.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:02:46.812 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:02:46.812 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:02:46.812 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:02:46.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:02:46.812 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:02:46.812 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:02:46.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:02:46.813 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:02:46.813 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:02:46.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:02:46.813 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:02:46.813 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 13, 2024-02-28T16:02:46.813 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:02:46.813 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:02:46.813 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:02:46.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.821+0000 7fa097e00700 1 -- 172.21.15.57:0/2055920926 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa07c06b1c0 msgr2=0x7fa07c06d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:46.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.821+0000 7fa097e00700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa07c06b1c0 0x7fa07c06d670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa088009fd0 tx=0x7fa088009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:46.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.821+0000 7fa097e00700 1 -- 172.21.15.57:0/2055920926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981001c0 msgr2=0x7fa09806f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:46.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.821+0000 7fa097e00700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981001c0 0x7fa09806f4e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa0840096b0 tx=0x7fa084009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:46.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.821+0000 7fa097e00700 1 -- 172.21.15.57:0/2055920926 shutdown_connections 2024-02-28T16:02:46.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.821+0000 7fa097e00700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7fa07c06b1c0 0x7fa07c06d670 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.821+0000 7fa097e00700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0980fefb0 0x7fa09806efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.821+0000 7fa097e00700 1 --2- 172.21.15.57:0/2055920926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981001c0 0x7fa09806f4e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.821+0000 7fa097e00700 1 -- 172.21.15.57:0/2055920926 >> 172.21.15.57:0/2055920926 conn(0x7fa0980fa760 msgr2=0x7fa0981033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:46.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.821+0000 7fa097e00700 1 -- 172.21.15.57:0/2055920926 shutdown_connections 2024-02-28T16:02:46.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.822+0000 7fa097e00700 1 -- 172.21.15.57:0/2055920926 wait complete. 2024-02-28T16:02:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.996+0000 7f4866e00700 1 -- 172.21.15.57:0/672068074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4860104760 msgr2=0x7f4860104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.996+0000 7f4866e00700 1 --2- 172.21.15.57:0/672068074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4860104760 0x7f4860104bb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4848004940 tx=0x7f4848009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.997+0000 7f4866e00700 1 -- 172.21.15.57:0/672068074 shutdown_connections 2024-02-28T16:02:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.997+0000 7f4866e00700 1 --2- 172.21.15.57:0/672068074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4860104760 0x7f4860104bb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.997+0000 7f4866e00700 1 --2- 172.21.15.57:0/672068074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48601035a0 0x7f48601039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.997+0000 7f4866e00700 1 -- 172.21.15.57:0/672068074 >> 172.21.15.57:0/672068074 conn(0x7f48600668f0 msgr2=0x7f4860066d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:46.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.997+0000 7f4866e00700 1 -- 172.21.15.57:0/672068074 shutdown_connections 2024-02-28T16:02:46.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.997+0000 7f4866e00700 1 -- 172.21.15.57:0/672068074 wait complete. 2024-02-28T16:02:46.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.998+0000 7f4866e00700 1 Processor -- start 2024-02-28T16:02:46.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.999+0000 7f4866e00700 1 -- start start 2024-02-28T16:02:46.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.999+0000 7f4866e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48601035a0 0x7f4860113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:46.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.999+0000 7f4866e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4860104760 0x7f48601144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:46.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.999+0000 7f4866e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4860114b30 con 0x7f4860104760 2024-02-28T16:02:46.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:46.999+0000 7f4866e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4860115370 con 0x7f48601035a0 2024-02-28T16:02:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.000+0000 7f4857e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4860104760 0x7f48601144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.000+0000 7f4857e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4860104760 0x7f48601144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57486/0 (socket says 172.21.15.57:57486) 2024-02-28T16:02:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.000+0000 7f4857e00700 1 -- 172.21.15.57:0/314367462 learned_addr learned my addr 172.21.15.57:0/314367462 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.000+0000 7f485fe00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48601035a0 0x7f4860113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.000+0000 7f4857e00700 1 -- 172.21.15.57:0/314367462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48601035a0 msgr2=0x7f4860113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.000+0000 7f4857e00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48601035a0 0x7f4860113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.000+0000 7f4857e00700 1 -- 172.21.15.57:0/314367462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4848005040 con 0x7f4860104760 2024-02-28T16:02:46.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.001+0000 7f4857e00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4860104760 0x7f48601144a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f484800b3b0 tx=0x7f4848009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:46.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.001+0000 7f485cc00700 1 -- 172.21.15.57:0/314367462 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f484800e030 con 0x7f4860104760 2024-02-28T16:02:46.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.001+0000 7f4866e00700 1 -- 172.21.15.57:0/314367462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48601155f0 con 0x7f4860104760 2024-02-28T16:02:46.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.001+0000 7f485cc00700 1 -- 172.21.15.57:0/314367462 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4848004290 con 0x7f4860104760 2024-02-28T16:02:46.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.001+0000 7f4866e00700 1 -- 172.21.15.57:0/314367462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4860115ad0 con 0x7f4860104760 2024-02-28T16:02:46.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.002+0000 7f485cc00700 1 -- 172.21.15.57:0/314367462 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4848013420 con 0x7f4860104760 2024-02-28T16:02:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.003+0000 7f4866e00700 1 -- 172.21.15.57:0/314367462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c0052e0 con 0x7f4860104760 2024-02-28T16:02:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.005+0000 7f485cc00700 1 -- 172.21.15.57:0/314367462 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 88910+0+0 (secure 0 0 0) 0x7f484800bbf0 con 0x7f4860104760 2024-02-28T16:02:47.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.007+0000 7f485cc00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f484406b220 0x7f484406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:47.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.007+0000 7f485cc00700 1 -- 172.21.15.57:0/314367462 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f484808bb40 con 0x7f4860104760 2024-02-28T16:02:47.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.008+0000 7f485fe00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f484406b220 0x7f484406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:47.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.010+0000 7f485cc00700 1 -- 172.21.15.57:0/314367462 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4848059990 con 0x7f4860104760 2024-02-28T16:02:47.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.010+0000 7f485fe00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f484406b220 0x7f484406d6d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48601045c0 tx=0x7f4850009780 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:47.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.382+0000 7f4866e00700 1 -- 172.21.15.57:0/314367462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f483c005860 con 0x7f4860104760 2024-02-28T16:02:47.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.382+0000 7f485cc00700 1 -- 172.21.15.57:0/314367462 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1859 (secure 0 0 0) 0x7f484800bea0 con 0x7f4860104760 2024-02-28T16:02:47.376 INFO:teuthology.orchestra.run.smithi057.stdout:e16 2024-02-28T16:02:47.376 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:02:47.376 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:02:47.376 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:02:47.376 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:02:47.376 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:02:47.376 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 16 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:02:07.353165+0000 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:02:47.377 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:02:47.378 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:02:47.379 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:02:47.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.386+0000 7f4866e00700 1 -- 172.21.15.57:0/314367462 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f484406b220 msgr2=0x7f484406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:47.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.386+0000 7f4866e00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f484406b220 0x7f484406d6d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48601045c0 tx=0x7f4850009780 comp rx=0 tx=0).stop 2024-02-28T16:02:47.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.386+0000 7f4866e00700 1 -- 172.21.15.57:0/314367462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4860104760 msgr2=0x7f48601144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:47.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.386+0000 7f4866e00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4860104760 0x7f48601144a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f484800b3b0 tx=0x7f4848009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.386+0000 7f4866e00700 1 -- 172.21.15.57:0/314367462 shutdown_connections 2024-02-28T16:02:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.386+0000 7f4866e00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f484406b220 0x7f484406d6d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.386+0000 7f4866e00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48601035a0 0x7f4860113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.386+0000 7f4866e00700 1 --2- 172.21.15.57:0/314367462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4860104760 0x7f48601144a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.386+0000 7f4866e00700 1 -- 172.21.15.57:0/314367462 >> 172.21.15.57:0/314367462 conn(0x7f48600668f0 msgr2=0x7f4860107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.386+0000 7f4866e00700 1 -- 172.21.15.57:0/314367462 shutdown_connections 2024-02-28T16:02:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.387+0000 7f4866e00700 1 -- 172.21.15.57:0/314367462 wait complete. 2024-02-28T16:02:47.383 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2024-02-28T16:02:47.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.574+0000 7f26efc00700 1 -- 172.21.15.57:0/2681717121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e80708c0 msgr2=0x7f26e8070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:47.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.574+0000 7f26efc00700 1 --2- 172.21.15.57:0/2681717121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e80708c0 0x7f26e8070d10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f26d4004880 tx=0x7f26d4009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:47.568 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:47 smithi057 ceph-mon[28763]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:47.568 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:47 smithi057 ceph-mon[28763]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:47.568 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:47 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2055920926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:02:47.568 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:47 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:47.568 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:47 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:47.568 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:47 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:02:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.574+0000 7f26efc00700 1 -- 172.21.15.57:0/2681717121 shutdown_connections 2024-02-28T16:02:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.574+0000 7f26efc00700 1 --2- 172.21.15.57:0/2681717121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e80708c0 0x7f26e8070d10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.574+0000 7f26efc00700 1 --2- 172.21.15.57:0/2681717121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26e8071f10 0x7f26e8070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.574+0000 7f26efc00700 1 -- 172.21.15.57:0/2681717121 >> 172.21.15.57:0/2681717121 conn(0x7f26e80f8620 msgr2=0x7f26e80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.576+0000 7f26efc00700 1 -- 172.21.15.57:0/2681717121 shutdown_connections 2024-02-28T16:02:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.576+0000 7f26efc00700 1 -- 172.21.15.57:0/2681717121 wait complete. 2024-02-28T16:02:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.577+0000 7f26efc00700 1 Processor -- start 2024-02-28T16:02:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.577+0000 7f26efc00700 1 -- start start 2024-02-28T16:02:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.577+0000 7f26efc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26e80708c0 0x7f26e810fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.577+0000 7f26efc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e8071f10 0x7f26e8110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.577+0000 7f26efc00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e8110810 con 0x7f26e8071f10 2024-02-28T16:02:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.577+0000 7f26efc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e8110fa0 con 0x7f26e80708c0 2024-02-28T16:02:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.578+0000 7f26e7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e8071f10 0x7f26e8110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.578+0000 7f26e7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e8071f10 0x7f26e8110210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57510/0 (socket says 172.21.15.57:57510) 2024-02-28T16:02:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.578+0000 7f26e7e00700 1 -- 172.21.15.57:0/2013230201 learned_addr learned my addr 172.21.15.57:0/2013230201 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.578+0000 7f26ed200700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26e80708c0 0x7f26e810fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:47.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.578+0000 7f26e7e00700 1 -- 172.21.15.57:0/2013230201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26e80708c0 msgr2=0x7f26e810fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:47.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.578+0000 7f26e7e00700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26e80708c0 0x7f26e810fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:47.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.578+0000 7f26e7e00700 1 -- 172.21.15.57:0/2013230201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d4005040 con 0x7f26e8071f10 2024-02-28T16:02:47.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.579+0000 7f26e7e00700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e8071f10 0x7f26e8110210 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f26d4008f80 tx=0x7f26d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:47.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.579+0000 7f26e4c00700 1 -- 172.21.15.57:0/2013230201 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d400e030 con 0x7f26e8071f10 2024-02-28T16:02:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.579+0000 7f26efc00700 1 -- 172.21.15.57:0/2013230201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e8111220 con 0x7f26e8071f10 2024-02-28T16:02:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.579+0000 7f26efc00700 1 -- 172.21.15.57:0/2013230201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e8111760 con 0x7f26e8071f10 2024-02-28T16:02:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.580+0000 7f26e4c00700 1 -- 172.21.15.57:0/2013230201 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f26d4013b70 con 0x7f26e8071f10 2024-02-28T16:02:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.580+0000 7f26e4c00700 1 -- 172.21.15.57:0/2013230201 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d40123c0 con 0x7f26e8071f10 2024-02-28T16:02:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.581+0000 7f26efc00700 1 -- 172.21.15.57:0/2013230201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c80052e0 con 0x7f26e8071f10 2024-02-28T16:02:47.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.583+0000 7f26e4c00700 1 -- 172.21.15.57:0/2013230201 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 88910+0+0 (secure 0 0 0) 0x7f26d4013ce0 con 0x7f26e8071f10 2024-02-28T16:02:47.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.585+0000 7f26e4c00700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f26d006b1d0 0x7f26d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:47.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.586+0000 7f26e4c00700 1 -- 172.21.15.57:0/2013230201 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f26d408b3f0 con 0x7f26e8071f10 2024-02-28T16:02:47.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.586+0000 7f26ed200700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f26d006b1d0 0x7f26d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:47.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.588+0000 7f26ed200700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f26d006b1d0 0x7f26d006d680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0046c0 tx=0x7f26dc00b040 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:47.581 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:47 smithi087 ceph-mon[37122]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:47.582 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:47 smithi087 ceph-mon[37122]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:47.582 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:47 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2055920926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:02:47.582 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:47 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:47.582 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:47 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:47.582 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:47 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:02:47.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.590+0000 7f26e4c00700 1 -- 172.21.15.57:0/2013230201 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f26d40592a0 con 0x7f26e8071f10 2024-02-28T16:02:47.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.878+0000 7f26efc00700 1 -- 172.21.15.57:0/2013230201 --> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26c8000bf0 con 0x7f26d006b1d0 2024-02-28T16:02:47.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.880+0000 7f26e4c00700 1 -- 172.21.15.57:0/2013230201 <== mgr.24421 v2:172.21.15.87:6828/3858637717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f26c8000bf0 con 0x7f26d006b1d0 2024-02-28T16:02:47.873 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:02:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:02:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:02:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:02:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [], 2024-02-28T16:02:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "", 2024-02-28T16:02:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T16:02:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:02:47.873 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:02:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.882+0000 7f26efc00700 1 -- 172.21.15.57:0/2013230201 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f26d006b1d0 msgr2=0x7f26d006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.882+0000 7f26efc00700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f26d006b1d0 0x7f26d006d680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0046c0 tx=0x7f26dc00b040 comp rx=0 tx=0).stop 2024-02-28T16:02:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.882+0000 7f26efc00700 1 -- 172.21.15.57:0/2013230201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e8071f10 msgr2=0x7f26e8110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.882+0000 7f26efc00700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e8071f10 0x7f26e8110210 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f26d4008f80 tx=0x7f26d4009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.883+0000 7f26efc00700 1 -- 172.21.15.57:0/2013230201 shutdown_connections 2024-02-28T16:02:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.883+0000 7f26efc00700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f26d006b1d0 0x7f26d006d680 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.883+0000 7f26efc00700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26e80708c0 0x7f26e810fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.883+0000 7f26efc00700 1 --2- 172.21.15.57:0/2013230201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e8071f10 0x7f26e8110210 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.883+0000 7f26efc00700 1 -- 172.21.15.57:0/2013230201 >> 172.21.15.57:0/2013230201 conn(0x7f26e80f8620 msgr2=0x7f26e8102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.883+0000 7f26efc00700 1 -- 172.21.15.57:0/2013230201 shutdown_connections 2024-02-28T16:02:47.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:47.883+0000 7f26efc00700 1 -- 172.21.15.57:0/2013230201 wait complete. 2024-02-28T16:02:48.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.083+0000 7f2603800700 1 -- 172.21.15.57:0/71394675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25fc1003a0 msgr2=0x7f25fc102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:48.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.083+0000 7f2603800700 1 --2- 172.21.15.57:0/71394675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25fc1003a0 0x7f25fc102780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f25f0004940 tx=0x7f25f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:48.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.083+0000 7f2603800700 1 -- 172.21.15.57:0/71394675 shutdown_connections 2024-02-28T16:02:48.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.083+0000 7f2603800700 1 --2- 172.21.15.57:0/71394675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25fc1003a0 0x7f25fc102780 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:48.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.083+0000 7f2603800700 1 --2- 172.21.15.57:0/71394675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25fc0fda80 0x7f25fc0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:48.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.083+0000 7f2603800700 1 -- 172.21.15.57:0/71394675 >> 172.21.15.57:0/71394675 conn(0x7f25fc0f74e0 msgr2=0x7f25fc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:48.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.083+0000 7f2603800700 1 -- 172.21.15.57:0/71394675 shutdown_connections 2024-02-28T16:02:48.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.083+0000 7f2603800700 1 -- 172.21.15.57:0/71394675 wait complete. 2024-02-28T16:02:48.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.084+0000 7f2603800700 1 Processor -- start 2024-02-28T16:02:48.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.085+0000 7f2603800700 1 -- start start 2024-02-28T16:02:48.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.085+0000 7f2603800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25fc0fda80 0x7f25fc10d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:48.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.085+0000 7f2603800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25fc1003a0 0x7f25fc10df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:48.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.085+0000 7f2603800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc10e590 con 0x7f25fc1003a0 2024-02-28T16:02:48.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.085+0000 7f2603800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc10edd0 con 0x7f25fc0fda80 2024-02-28T16:02:48.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.086+0000 7f25fbe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25fc1003a0 0x7f25fc10df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:48.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.086+0000 7f2600e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25fc0fda80 0x7f25fc10d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:48.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.086+0000 7f2600e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25fc0fda80 0x7f25fc10d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:43146/0 (socket says 172.21.15.57:43146) 2024-02-28T16:02:48.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.086+0000 7f2600e00700 1 -- 172.21.15.57:0/1253089986 learned_addr learned my addr 172.21.15.57:0/1253089986 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:02:48.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.086+0000 7f25fbe00700 1 -- 172.21.15.57:0/1253089986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25fc0fda80 msgr2=0x7f25fc10d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:48.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.086+0000 7f25fbe00700 1 --2- 172.21.15.57:0/1253089986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25fc0fda80 0x7f25fc10d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:48.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.086+0000 7f25fbe00700 1 -- 172.21.15.57:0/1253089986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0005040 con 0x7f25fc1003a0 2024-02-28T16:02:48.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.087+0000 7f25fbe00700 1 --2- 172.21.15.57:0/1253089986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25fc1003a0 0x7f25fc10df00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:48.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.087+0000 7f25f8c00700 1 -- 172.21.15.57:0/1253089986 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f000e030 con 0x7f25fc1003a0 2024-02-28T16:02:48.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.088+0000 7f25f8c00700 1 -- 172.21.15.57:0/1253089986 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25f0013420 con 0x7f25fc1003a0 2024-02-28T16:02:48.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.088+0000 7f25f8c00700 1 -- 172.21.15.57:0/1253089986 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f000bee0 con 0x7f25fc1003a0 2024-02-28T16:02:48.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.088+0000 7f2603800700 1 -- 172.21.15.57:0/1253089986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25fc10f050 con 0x7f25fc1003a0 2024-02-28T16:02:48.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.088+0000 7f2603800700 1 -- 172.21.15.57:0/1253089986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25fc10f590 con 0x7f25fc1003a0 2024-02-28T16:02:48.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.090+0000 7f25ee000700 1 -- 172.21.15.57:0/1253089986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d80052b0 con 0x7f25fc1003a0 2024-02-28T16:02:48.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.091+0000 7f25f8c00700 1 -- 172.21.15.57:0/1253089986 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 88910+0+0 (secure 0 0 0) 0x7f25f001c710 con 0x7f25fc1003a0 2024-02-28T16:02:48.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.093+0000 7f25f8c00700 1 --2- 172.21.15.57:0/1253089986 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f25e406b2a0 0x7f25e406d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:02:48.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.093+0000 7f25f8c00700 1 -- 172.21.15.57:0/1253089986 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f25f008b4f0 con 0x7f25fc1003a0 2024-02-28T16:02:48.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.094+0000 7f2600e00700 1 --2- 172.21.15.57:0/1253089986 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f25e406b2a0 0x7f25e406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:02:48.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.095+0000 7f2600e00700 1 --2- 172.21.15.57:0/1253089986 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f25e406b2a0 0x7f25e406d750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009b80 tx=0x7f25e80091a0 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:02:48.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.099+0000 7f25f8c00700 1 -- 172.21.15.57:0/1253089986 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f25f0059280 con 0x7f25fc1003a0 2024-02-28T16:02:48.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.577+0000 7f25ee000700 1 -- 172.21.15.57:0/1253089986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f25d8005560 con 0x7f25fc1003a0 2024-02-28T16:02:48.572 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:48 smithi057 ceph-mon[28763]: pgmap v56: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 185 op/s 2024-02-28T16:02:48.572 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:48 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/314367462' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:02:48.572 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:48 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:48.572 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:48 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:48.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.578+0000 7f25f8c00700 1 -- 172.21.15.57:0/1253089986 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f25f0058e10 con 0x7f25fc1003a0 2024-02-28T16:02:48.572 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:02:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.581+0000 7f25ee000700 1 -- 172.21.15.57:0/1253089986 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f25e406b2a0 msgr2=0x7f25e406d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.581+0000 7f25ee000700 1 --2- 172.21.15.57:0/1253089986 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f25e406b2a0 0x7f25e406d750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009b80 tx=0x7f25e80091a0 comp rx=0 tx=0).stop 2024-02-28T16:02:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.581+0000 7f25ee000700 1 -- 172.21.15.57:0/1253089986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25fc1003a0 msgr2=0x7f25fc10df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:02:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.581+0000 7f25ee000700 1 --2- 172.21.15.57:0/1253089986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25fc1003a0 0x7f25fc10df00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:02:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.582+0000 7f25ee000700 1 -- 172.21.15.57:0/1253089986 shutdown_connections 2024-02-28T16:02:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.582+0000 7f25ee000700 1 --2- 172.21.15.57:0/1253089986 >> [v2:172.21.15.87:6828/3858637717,v1:172.21.15.87:6829/3858637717] conn(0x7f25e406b2a0 0x7f25e406d750 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.582+0000 7f25ee000700 1 --2- 172.21.15.57:0/1253089986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25fc0fda80 0x7f25fc10d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.582+0000 7f25ee000700 1 --2- 172.21.15.57:0/1253089986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25fc1003a0 0x7f25fc10df00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:02:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.582+0000 7f25ee000700 1 -- 172.21.15.57:0/1253089986 >> 172.21.15.57:0/1253089986 conn(0x7f25fc0f74e0 msgr2=0x7f25fc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:02:48.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.582+0000 7f25ee000700 1 -- 172.21.15.57:0/1253089986 shutdown_connections 2024-02-28T16:02:48.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:02:48.582+0000 7f25ee000700 1 -- 172.21.15.57:0/1253089986 wait complete. 2024-02-28T16:02:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:48 smithi087 ceph-mon[37122]: pgmap v56: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 185 op/s 2024-02-28T16:02:48.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:48 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/314367462' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:02:48.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:48 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:48.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:48 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:49.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:49 smithi057 ceph-mon[28763]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:49.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:49 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1253089986' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:02:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:49 smithi087 ceph-mon[37122]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:02:49.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:49 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1253089986' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:02:50.623 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:50 smithi057 ceph-mon[28763]: pgmap v57: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-02-28T16:02:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:50 smithi087 ceph-mon[37122]: pgmap v57: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-02-28T16:02:52.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:52 smithi057 ceph-mon[28763]: pgmap v58: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 123 op/s 2024-02-28T16:02:52.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:52 smithi087 ceph-mon[37122]: pgmap v58: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 123 op/s 2024-02-28T16:02:54.627 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-28T16:02:54.627 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-28T16:02:54.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:54 smithi057 ceph-mon[28763]: pgmap v59: 65 pgs: 65 active+clean; 742 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-02-28T16:02:54.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:54 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:54.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:54 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:54.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:54 smithi087 ceph-mon[37122]: pgmap v59: 65 pgs: 65 active+clean; 742 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-02-28T16:02:54.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:54 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:54.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:54 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:02:56.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:56 smithi057 ceph-mon[28763]: pgmap v60: 65 pgs: 65 active+clean; 742 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-02-28T16:02:56.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:56 smithi087 ceph-mon[37122]: pgmap v60: 65 pgs: 65 active+clean; 742 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-02-28T16:02:58.653 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:58 smithi057 ceph-mon[28763]: pgmap v61: 65 pgs: 65 active+clean; 358 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 234 op/s 2024-02-28T16:02:58.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:58 smithi087 ceph-mon[37122]: pgmap v61: 65 pgs: 65 active+clean; 358 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 234 op/s 2024-02-28T16:02:59.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:59 smithi057 ceph-mon[28763]: Standby manager daemon smithi057.upqerc restarted 2024-02-28T16:02:59.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:59 smithi057 ceph-mon[28763]: Standby manager daemon smithi057.upqerc started 2024-02-28T16:02:59.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:59 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi057.upqerc/crt"}]: dispatch 2024-02-28T16:02:59.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:59 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:02:59.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:59 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi057.upqerc/key"}]: dispatch 2024-02-28T16:02:59.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:02:59 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:02:59.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:59 smithi087 ceph-mon[37122]: Standby manager daemon smithi057.upqerc restarted 2024-02-28T16:02:59.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:59 smithi087 ceph-mon[37122]: Standby manager daemon smithi057.upqerc started 2024-02-28T16:02:59.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:59 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi057.upqerc/crt"}]: dispatch 2024-02-28T16:02:59.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:59 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:02:59.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:59 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi057.upqerc/key"}]: dispatch 2024-02-28T16:02:59.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:02:59 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:03:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:00 smithi057 ceph-mon[28763]: pgmap v62: 65 pgs: 65 active+clean; 296 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 934 KiB/s rd, 934 KiB/s wr, 196 op/s 2024-02-28T16:03:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:00 smithi057 ceph-mon[28763]: mgrmap e27: smithi087.ewrszc(active, since 118s), standbys: smithi057.upqerc 2024-02-28T16:03:00.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:00 smithi087 ceph-mon[37122]: pgmap v62: 65 pgs: 65 active+clean; 296 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 934 KiB/s rd, 934 KiB/s wr, 196 op/s 2024-02-28T16:03:00.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:00 smithi087 ceph-mon[37122]: mgrmap e27: smithi087.ewrszc(active, since 118s), standbys: smithi057.upqerc 2024-02-28T16:03:01.654 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:01 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:03:01.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:01 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:03:02.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:02 smithi057 ceph-mon[28763]: pgmap v63: 65 pgs: 65 active+clean; 296 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 934 KiB/s rd, 927 KiB/s wr, 189 op/s 2024-02-28T16:03:02.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:02 smithi087 ceph-mon[37122]: pgmap v63: 65 pgs: 65 active+clean; 296 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 934 KiB/s rd, 927 KiB/s wr, 189 op/s 2024-02-28T16:03:03.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:03 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:03.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:03 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:03.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:03 smithi087 ceph-mon[37122]: pgmap v64: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 321 op/s 2024-02-28T16:03:04.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:03 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:04.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:03 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:04.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:03 smithi057 ceph-mon[28763]: pgmap v64: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 321 op/s 2024-02-28T16:03:06.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:06 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:06.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:06 smithi057 ceph-mon[28763]: pgmap v65: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 927 KiB/s rd, 952 KiB/s wr, 238 op/s 2024-02-28T16:03:06.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:06 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:06.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:06 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:06.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:06 smithi087 ceph-mon[37122]: pgmap v65: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 927 KiB/s rd, 952 KiB/s wr, 238 op/s 2024-02-28T16:03:06.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:06 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:08.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:08 smithi057 ceph-mon[28763]: pgmap v66: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 355 op/s 2024-02-28T16:03:08.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:08 smithi087 ceph-mon[37122]: pgmap v66: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 355 op/s 2024-02-28T16:03:10.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:10 smithi057 ceph-mon[28763]: pgmap v67: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 284 op/s 2024-02-28T16:03:10.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:10 smithi087 ceph-mon[37122]: pgmap v67: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 284 op/s 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: pgmap v68: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 962 KiB/s rd, 1010 KiB/s wr, 267 op/s 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mgr fail", "who": "smithi087.ewrszc"}]: dispatch 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mgr fail", "who": "smithi087.ewrszc"}]: dispatch 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T16:03:12.509 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd='[{"prefix": "mgr fail", "who": "smithi087.ewrszc"}]': finished 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: mgrmap e28: smithi057.upqerc(active, starting, since 0.00923932s) 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:03:12.510 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:03:12.511 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:03:12.511 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:03:12.511 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:12 smithi057 ceph-mon[28763]: Manager daemon smithi057.upqerc is now available 2024-02-28T16:03:12.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: pgmap v68: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 962 KiB/s rd, 1010 KiB/s wr, 267 op/s 2024-02-28T16:03:12.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:12.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:12.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:03:12.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:03:12.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.24421 172.21.15.87:0/2926672719' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mgr fail", "who": "smithi087.ewrszc"}]: dispatch 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "mgr fail", "who": "smithi087.ewrszc"}]: dispatch 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.24421 ' entity='mgr.smithi087.ewrszc' cmd='[{"prefix": "mgr fail", "who": "smithi087.ewrszc"}]': finished 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: mgrmap e28: smithi057.upqerc(active, starting, since 0.00923932s) 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T16:03:12.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:03:12.650 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:03:12.650 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:03:12.650 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:03:12.650 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:03:12.650 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:03:12.650 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:03:12.650 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:03:12.650 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:03:12.650 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:12 smithi087 ceph-mon[37122]: Manager daemon smithi057.upqerc is now available 2024-02-28T16:03:13.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:13 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:03:13.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:13 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:03:13.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:13 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:03:13.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:13 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:03:13.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:13 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:03:13.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:13 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T16:03:13.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:13 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T16:03:13.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:13 smithi057 ceph-mon[28763]: mgrmap e29: smithi057.upqerc(active, since 1.01088s) 2024-02-28T16:03:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:13 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:03:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:13 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:03:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:13 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:03:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:13 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:03:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:13 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:03:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:13 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T16:03:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:13 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T16:03:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:13 smithi087 ceph-mon[37122]: mgrmap e29: smithi057.upqerc(active, since 1.01088s) 2024-02-28T16:03:14.416 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:14 smithi057 ceph-mon[28763]: [28/Feb/2024:16:03:12] ENGINE Bus STARTING 2024-02-28T16:03:14.416 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:14 smithi057 ceph-mon[28763]: [28/Feb/2024:16:03:13] ENGINE Serving on http://172.21.15.57:8765 2024-02-28T16:03:14.416 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:14 smithi057 ceph-mon[28763]: [28/Feb/2024:16:03:13] ENGINE Serving on https://172.21.15.57:7150 2024-02-28T16:03:14.416 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:14 smithi057 ceph-mon[28763]: [28/Feb/2024:16:03:13] ENGINE Bus STARTED 2024-02-28T16:03:14.417 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:14 smithi057 ceph-mon[28763]: pgmap v3: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:03:14.549 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:14 smithi087 ceph-mon[37122]: [28/Feb/2024:16:03:12] ENGINE Bus STARTING 2024-02-28T16:03:14.550 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:14 smithi087 ceph-mon[37122]: [28/Feb/2024:16:03:13] ENGINE Serving on http://172.21.15.57:8765 2024-02-28T16:03:14.550 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:14 smithi087 ceph-mon[37122]: [28/Feb/2024:16:03:13] ENGINE Serving on https://172.21.15.57:7150 2024-02-28T16:03:14.550 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:14 smithi087 ceph-mon[37122]: [28/Feb/2024:16:03:13] ENGINE Bus STARTED 2024-02-28T16:03:14.550 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:14 smithi087 ceph-mon[37122]: pgmap v3: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:03:15.498 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:15 smithi087 ceph-mon[37122]: pgmap v4: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:03:15.663 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:15 smithi057 ceph-mon[28763]: pgmap v4: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:03:16.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:16 smithi087 ceph-mon[37122]: mgrmap e30: smithi057.upqerc(active, since 3s) 2024-02-28T16:03:16.582 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:16 smithi057 ceph-mon[28763]: mgrmap e30: smithi057.upqerc(active, since 3s) 2024-02-28T16:03:17.552 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:17 smithi057 ceph-mon[28763]: pgmap v5: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:03:17.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:17 smithi087 ceph-mon[37122]: pgmap v5: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:03:18.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.801+0000 7fe3eac00700 1 -- 172.21.15.57:0/303284718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e40ff150 msgr2=0x7fe3e40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:18.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.801+0000 7fe3eac00700 1 --2- 172.21.15.57:0/303284718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e40ff150 0x7fe3e40ff560 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4004940 tx=0x7fe3d4009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:18.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.801+0000 7fe3eac00700 1 -- 172.21.15.57:0/303284718 shutdown_connections 2024-02-28T16:03:18.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.801+0000 7fe3eac00700 1 --2- 172.21.15.57:0/303284718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e4100360 0x7fe3e41007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:18.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.801+0000 7fe3eac00700 1 --2- 172.21.15.57:0/303284718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e40ff150 0x7fe3e40ff560 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:18.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.801+0000 7fe3eac00700 1 -- 172.21.15.57:0/303284718 >> 172.21.15.57:0/303284718 conn(0x7fe3e40fa920 msgr2=0x7fe3e40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:18.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.802+0000 7fe3eac00700 1 -- 172.21.15.57:0/303284718 shutdown_connections 2024-02-28T16:03:18.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.802+0000 7fe3eac00700 1 -- 172.21.15.57:0/303284718 wait complete. 2024-02-28T16:03:18.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.803+0000 7fe3eac00700 1 Processor -- start 2024-02-28T16:03:18.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.804+0000 7fe3eac00700 1 -- start start 2024-02-28T16:03:18.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.804+0000 7fe3eac00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e4100360 0x7fe3e410fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.804+0000 7fe3eac00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e41102c0 0x7fe3e41110b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.804+0000 7fe3eac00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e4110780 con 0x7fe3e41102c0 2024-02-28T16:03:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.804+0000 7fe3eac00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e41108c0 con 0x7fe3e4100360 2024-02-28T16:03:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.805+0000 7fe3e3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e4100360 0x7fe3e410fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.805+0000 7fe3e3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e4100360 0x7fe3e410fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:54002/0 (socket says 172.21.15.57:54002) 2024-02-28T16:03:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.805+0000 7fe3e3e00700 1 -- 172.21.15.57:0/2707487035 learned_addr learned my addr 172.21.15.57:0/2707487035 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.805+0000 7fe3e3e00700 1 -- 172.21.15.57:0/2707487035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e41102c0 msgr2=0x7fe3e41110b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.805+0000 7fe3e3e00700 1 --2- 172.21.15.57:0/2707487035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e41102c0 0x7fe3e41110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.805+0000 7fe3e3e00700 1 -- 172.21.15.57:0/2707487035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4005040 con 0x7fe3e4100360 2024-02-28T16:03:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.806+0000 7fe3e3e00700 1 --2- 172.21.15.57:0/2707487035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e4100360 0x7fe3e410fd80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009fd0 tx=0x7fe3d4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:18.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.806+0000 7fe3dbe00700 1 -- 172.21.15.57:0/2707487035 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3d4021070 con 0x7fe3e4100360 2024-02-28T16:03:18.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.806+0000 7fe3dbe00700 1 -- 172.21.15.57:0/2707487035 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3d4009430 con 0x7fe3e4100360 2024-02-28T16:03:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.806+0000 7fe3dbe00700 1 -- 172.21.15.57:0/2707487035 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3d400e070 con 0x7fe3e4100360 2024-02-28T16:03:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.807+0000 7fe3eac00700 1 -- 172.21.15.57:0/2707487035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e41116e0 con 0x7fe3e4100360 2024-02-28T16:03:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.807+0000 7fe3eac00700 1 -- 172.21.15.57:0/2707487035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e4111b60 con 0x7fe3e4100360 2024-02-28T16:03:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.809+0000 7fe3dbe00700 1 -- 172.21.15.57:0/2707487035 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 30) v1 ==== 45928+0+0 (secure 0 0 0) 0x7fe3d401c400 con 0x7fe3e4100360 2024-02-28T16:03:18.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.809+0000 7fe3dbe00700 1 --2- 172.21.15.57:0/2707487035 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fe3c8038a60 0x7fe3c803af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:18.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.809+0000 7fe3eac00700 1 -- 172.21.15.57:0/2707487035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e4109c70 con 0x7fe3e4100360 2024-02-28T16:03:18.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.809+0000 7fe3dbe00700 1 -- 172.21.15.57:0/2707487035 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fe3d404d800 con 0x7fe3e4100360 2024-02-28T16:03:18.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.810+0000 7fe3e3400700 1 --2- 172.21.15.57:0/2707487035 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fe3c8038a60 0x7fe3c803af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:18.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.811+0000 7fe3e3400700 1 --2- 172.21.15.57:0/2707487035 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fe3c8038a60 0x7fe3c803af10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009fd0 tx=0x7fe3d000b040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:18.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:18.818+0000 7fe3dbe00700 1 -- 172.21.15.57:0/2707487035 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe3d4011e00 con 0x7fe3e4100360 2024-02-28T16:03:19.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:18 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:19.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:18 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:19.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:18 smithi057 ceph-mon[28763]: pgmap v6: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 632 KiB/s rd, 754 KiB/s wr, 157 op/s 2024-02-28T16:03:19.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.190+0000 7fe3eac00700 1 -- 172.21.15.57:0/2707487035 --> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3e405e3d0 con 0x7fe3c8038a60 2024-02-28T16:03:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.191+0000 7fe3dbe00700 1 -- 172.21.15.57:0/2707487035 <== mgr.14742 v2:172.21.15.57:6800/3297260515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fe3e405e3d0 con 0x7fe3c8038a60 2024-02-28T16:03:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.194+0000 7fe3eac00700 1 -- 172.21.15.57:0/2707487035 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fe3c8038a60 msgr2=0x7fe3c803af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.194+0000 7fe3eac00700 1 --2- 172.21.15.57:0/2707487035 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fe3c8038a60 0x7fe3c803af10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009fd0 tx=0x7fe3d000b040 comp rx=0 tx=0).stop 2024-02-28T16:03:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.194+0000 7fe3eac00700 1 -- 172.21.15.57:0/2707487035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e4100360 msgr2=0x7fe3e410fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.194+0000 7fe3eac00700 1 --2- 172.21.15.57:0/2707487035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e4100360 0x7fe3e410fd80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009fd0 tx=0x7fe3d4009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.195+0000 7fe3eac00700 1 -- 172.21.15.57:0/2707487035 shutdown_connections 2024-02-28T16:03:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.195+0000 7fe3eac00700 1 --2- 172.21.15.57:0/2707487035 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fe3c8038a60 0x7fe3c803af10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.195+0000 7fe3eac00700 1 --2- 172.21.15.57:0/2707487035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e4100360 0x7fe3e410fd80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.195+0000 7fe3eac00700 1 --2- 172.21.15.57:0/2707487035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e41102c0 0x7fe3e41110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.195+0000 7fe3eac00700 1 -- 172.21.15.57:0/2707487035 >> 172.21.15.57:0/2707487035 conn(0x7fe3e40fa920 msgr2=0x7fe3e40fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.195+0000 7fe3eac00700 1 -- 172.21.15.57:0/2707487035 shutdown_connections 2024-02-28T16:03:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.195+0000 7fe3eac00700 1 -- 172.21.15.57:0/2707487035 wait complete. 2024-02-28T16:03:19.207 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:03:19.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:18 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:19.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:18 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:19.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:18 smithi087 ceph-mon[37122]: pgmap v6: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 632 KiB/s rd, 754 KiB/s wr, 157 op/s 2024-02-28T16:03:19.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.390+0000 7ff287c00700 1 -- 172.21.15.57:0/3346941101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2800fda80 msgr2=0x7ff2800ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:19.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.390+0000 7ff287c00700 1 --2- 172.21.15.57:0/3346941101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2800fda80 0x7ff2800ffe60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff274004880 tx=0x7ff274009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:19.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.390+0000 7ff287c00700 1 -- 172.21.15.57:0/3346941101 shutdown_connections 2024-02-28T16:03:19.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.390+0000 7ff287c00700 1 --2- 172.21.15.57:0/3346941101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2801003a0 0x7ff280102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.390+0000 7ff287c00700 1 --2- 172.21.15.57:0/3346941101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2800fda80 0x7ff2800ffe60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.390+0000 7ff287c00700 1 -- 172.21.15.57:0/3346941101 >> 172.21.15.57:0/3346941101 conn(0x7ff2800f74e0 msgr2=0x7ff2800f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:19.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.390+0000 7ff287c00700 1 -- 172.21.15.57:0/3346941101 shutdown_connections 2024-02-28T16:03:19.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.390+0000 7ff287c00700 1 -- 172.21.15.57:0/3346941101 wait complete. 2024-02-28T16:03:19.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.391+0000 7ff287c00700 1 Processor -- start 2024-02-28T16:03:19.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.391+0000 7ff287c00700 1 -- start start 2024-02-28T16:03:19.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.392+0000 7ff287c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2800fda80 0x7ff2800fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:19.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.392+0000 7ff287c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2801003a0 0x7ff2800fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:19.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.392+0000 7ff287c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2800fbf90 con 0x7ff2801003a0 2024-02-28T16:03:19.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.392+0000 7ff287c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2800fc100 con 0x7ff2800fda80 2024-02-28T16:03:19.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.392+0000 7ff27fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2801003a0 0x7ff2800fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:19.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.392+0000 7ff27fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2801003a0 0x7ff2800fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47972/0 (socket says 172.21.15.57:47972) 2024-02-28T16:03:19.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.392+0000 7ff27fe00700 1 -- 172.21.15.57:0/3601857719 learned_addr learned my addr 172.21.15.57:0/3601857719 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:19.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.392+0000 7ff285200700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2800fda80 0x7ff2800fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:19.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.393+0000 7ff27fe00700 1 -- 172.21.15.57:0/3601857719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2800fda80 msgr2=0x7ff2800fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:19.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.393+0000 7ff27fe00700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2800fda80 0x7ff2800fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.393+0000 7ff27fe00700 1 -- 172.21.15.57:0/3601857719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c005040 con 0x7ff2801003a0 2024-02-28T16:03:19.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.393+0000 7ff27fe00700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2801003a0 0x7ff2800fb990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0096b0 tx=0x7ff26c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.393+0000 7ff27cc00700 1 -- 172.21.15.57:0/3601857719 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff26c017070 con 0x7ff2801003a0 2024-02-28T16:03:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.393+0000 7ff27cc00700 1 -- 172.21.15.57:0/3601857719 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff26c00f040 con 0x7ff2801003a0 2024-02-28T16:03:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.393+0000 7ff287c00700 1 -- 172.21.15.57:0/3601857719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff274005040 con 0x7ff2801003a0 2024-02-28T16:03:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.393+0000 7ff27cc00700 1 -- 172.21.15.57:0/3601857719 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff26c013c20 con 0x7ff2801003a0 2024-02-28T16:03:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.394+0000 7ff287c00700 1 -- 172.21.15.57:0/3601857719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2800fc730 con 0x7ff2801003a0 2024-02-28T16:03:19.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.395+0000 7ff287c00700 1 -- 172.21.15.57:0/3601857719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28004bed0 con 0x7ff2801003a0 2024-02-28T16:03:19.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.395+0000 7ff27cc00700 1 -- 172.21.15.57:0/3601857719 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 30) v1 ==== 45928+0+0 (secure 0 0 0) 0x7ff26c01c410 con 0x7ff2801003a0 2024-02-28T16:03:19.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.396+0000 7ff27cc00700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7ff268038a70 0x7ff26803af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:19.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.396+0000 7ff27cc00700 1 -- 172.21.15.57:0/3601857719 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7ff26c04c6b0 con 0x7ff2801003a0 2024-02-28T16:03:19.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.397+0000 7ff285200700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7ff268038a70 0x7ff26803af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:19.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.397+0000 7ff285200700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7ff268038a70 0x7ff26803af20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff274009fd0 tx=0x7ff274009e30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:19.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.402+0000 7ff27cc00700 1 -- 172.21.15.57:0/3601857719 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ff26c019be0 con 0x7ff2801003a0 2024-02-28T16:03:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.697+0000 7ff287c00700 1 -- 172.21.15.57:0/3601857719 --> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff280101000 con 0x7ff268038a70 2024-02-28T16:03:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.698+0000 7ff27cc00700 1 -- 172.21.15.57:0/3601857719 <== mgr.14742 v2:172.21.15.57:6800/3297260515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7ff280101000 con 0x7ff268038a70 2024-02-28T16:03:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.701+0000 7ff287c00700 1 -- 172.21.15.57:0/3601857719 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7ff268038a70 msgr2=0x7ff26803af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.701+0000 7ff287c00700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7ff268038a70 0x7ff26803af20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff274009fd0 tx=0x7ff274009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.701+0000 7ff287c00700 1 -- 172.21.15.57:0/3601857719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2801003a0 msgr2=0x7ff2800fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.701+0000 7ff287c00700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2801003a0 0x7ff2800fb990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0096b0 tx=0x7ff26c009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.701+0000 7ff287c00700 1 -- 172.21.15.57:0/3601857719 shutdown_connections 2024-02-28T16:03:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.701+0000 7ff287c00700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7ff268038a70 0x7ff26803af20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.701+0000 7ff287c00700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2800fda80 0x7ff2800fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.701+0000 7ff287c00700 1 --2- 172.21.15.57:0/3601857719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2801003a0 0x7ff2800fb990 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.701+0000 7ff287c00700 1 -- 172.21.15.57:0/3601857719 >> 172.21.15.57:0/3601857719 conn(0x7ff2800f74e0 msgr2=0x7ff2800f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.702+0000 7ff287c00700 1 -- 172.21.15.57:0/3601857719 shutdown_connections 2024-02-28T16:03:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.702+0000 7ff287c00700 1 -- 172.21.15.57:0/3601857719 wait complete. 2024-02-28T16:03:19.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.864+0000 7f535d200700 1 -- 172.21.15.57:0/617847321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5358100360 msgr2=0x7f53581007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:19.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.864+0000 7f535d200700 1 --2- 172.21.15.57:0/617847321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5358100360 0x7f53581007b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5340004940 tx=0x7f5340009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:19.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.865+0000 7f535d200700 1 -- 172.21.15.57:0/617847321 shutdown_connections 2024-02-28T16:03:19.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.865+0000 7f535d200700 1 --2- 172.21.15.57:0/617847321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5358100360 0x7f53581007b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.865+0000 7f535d200700 1 --2- 172.21.15.57:0/617847321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53580ff150 0x7f53580ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.865+0000 7f535d200700 1 -- 172.21.15.57:0/617847321 >> 172.21.15.57:0/617847321 conn(0x7f53580fa920 msgr2=0x7f53580fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:19.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.868+0000 7f535d200700 1 -- 172.21.15.57:0/617847321 shutdown_connections 2024-02-28T16:03:19.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.868+0000 7f535d200700 1 -- 172.21.15.57:0/617847321 wait complete. 2024-02-28T16:03:19.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.869+0000 7f535d200700 1 Processor -- start 2024-02-28T16:03:19.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.871+0000 7f535d200700 1 -- start start 2024-02-28T16:03:19.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.871+0000 7f535d200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53580ff150 0x7f535810e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:19.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.871+0000 7f535d200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5358100360 0x7f535810cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:19.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.871+0000 7f535d200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535810e6e0 con 0x7f53580ff150 2024-02-28T16:03:19.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.871+0000 7f535d200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535810d100 con 0x7f5358100360 2024-02-28T16:03:19.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.872+0000 7f5355400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5358100360 0x7f535810cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:19.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.872+0000 7f5355400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5358100360 0x7f535810cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:54038/0 (socket says 172.21.15.57:54038) 2024-02-28T16:03:19.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.872+0000 7f5355400700 1 -- 172.21.15.57:0/2734855882 learned_addr learned my addr 172.21.15.57:0/2734855882 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:19.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.873+0000 7f5355400700 1 -- 172.21.15.57:0/2734855882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53580ff150 msgr2=0x7f535810e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:19.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.873+0000 7f5355400700 1 --2- 172.21.15.57:0/2734855882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53580ff150 0x7f535810e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:19.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.873+0000 7f5355400700 1 -- 172.21.15.57:0/2734855882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5340005040 con 0x7f5358100360 2024-02-28T16:03:19.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.874+0000 7f5355400700 1 --2- 172.21.15.57:0/2734855882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5358100360 0x7f535810cbc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5340009360 tx=0x7f5340009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:19.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.876+0000 7f534e000700 1 -- 172.21.15.57:0/2734855882 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f534000e040 con 0x7f5358100360 2024-02-28T16:03:19.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.876+0000 7f534e000700 1 -- 172.21.15.57:0/2734855882 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f534000bcc0 con 0x7f5358100360 2024-02-28T16:03:19.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.876+0000 7f534e000700 1 -- 172.21.15.57:0/2734855882 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f534001c630 con 0x7f5358100360 2024-02-28T16:03:19.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.876+0000 7f535d200700 1 -- 172.21.15.57:0/2734855882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535810d380 con 0x7f5358100360 2024-02-28T16:03:19.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.876+0000 7f535d200700 1 -- 172.21.15.57:0/2734855882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535810d8c0 con 0x7f5358100360 2024-02-28T16:03:19.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.878+0000 7f535d200700 1 -- 172.21.15.57:0/2734855882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535804bed0 con 0x7f5358100360 2024-02-28T16:03:19.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.878+0000 7f534e000700 1 -- 172.21.15.57:0/2734855882 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 30) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f53400139f0 con 0x7f5358100360 2024-02-28T16:03:19.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.879+0000 7f534e000700 1 --2- 172.21.15.57:0/2734855882 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f533c038ab0 0x7f533c03af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:19.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.879+0000 7f534e000700 1 -- 172.21.15.57:0/2734855882 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f534004d650 con 0x7f5358100360 2024-02-28T16:03:19.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.880+0000 7f5355e00700 1 --2- 172.21.15.57:0/2734855882 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f533c038ab0 0x7f533c03af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:19.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.881+0000 7f5355e00700 1 --2- 172.21.15.57:0/2734855882 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f533c038ab0 0x7f533c03af60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f535810de20 tx=0x7f5350009ce0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:19.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:19.889+0000 7f534e000700 1 -- 172.21.15.57:0/2734855882 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5340011960 con 0x7f5358100360 2024-02-28T16:03:19.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:19 smithi087 ceph-mon[37122]: from='client.24569 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:20.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:19 smithi057 ceph-mon[28763]: from='client.24569 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:20.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:19 smithi057 ceph-mon[28763]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:20.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:19 smithi087 ceph-mon[37122]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:20.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.243+0000 7f535d200700 1 -- 172.21.15.57:0/2734855882 --> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f53580fdb80 con 0x7f533c038ab0 2024-02-28T16:03:20.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.261+0000 7f534e000700 1 -- 172.21.15.57:0/2734855882 <== mgr.14742 v2:172.21.15.57:6800/3297260515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f53580fdb80 con 0x7f533c038ab0 2024-02-28T16:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (101s) 17s ago 12m 15.1M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (12m) 17s ago 12m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T16:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (11m) 2s ago 11m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T16:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (59s) 17s ago 12m 74.8M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (5m) 17s ago 5m 211M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (5m) 17s ago 5m 124M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (5m) 2s ago 5m 140M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (4m) 2s ago 4m 73.7M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (33s) 17s ago 14m 64.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283 running (2m) 2s ago 10m 75.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 83ce464fbb4f 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (14m) 17s ago 14m 49.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (10m) 2s ago 10m 42.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (110s) 17s ago 12m 7419k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (42s) 2s ago 11m 7654k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (9m) 17s ago 9m 184M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (9m) 17s ago 9m 207M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (8m) 17s ago 8m 163M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (8m) 2s ago 8m 238M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (7m) 2s ago 7m 212M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (6m) 2s ago 6m 209M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (46s) 17s ago 11m 37.2M - 2.43.0 a07b618ecd1d 7a4108120827 2024-02-28T16:03:20.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.264+0000 7f535d200700 1 -- 172.21.15.57:0/2734855882 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f533c038ab0 msgr2=0x7f533c03af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:20.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.264+0000 7f535d200700 1 --2- 172.21.15.57:0/2734855882 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f533c038ab0 0x7f533c03af60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f535810de20 tx=0x7f5350009ce0 comp rx=0 tx=0).stop 2024-02-28T16:03:20.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.264+0000 7f535d200700 1 -- 172.21.15.57:0/2734855882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5358100360 msgr2=0x7f535810cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:20.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.264+0000 7f535d200700 1 --2- 172.21.15.57:0/2734855882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5358100360 0x7f535810cbc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5340009360 tx=0x7f5340009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:20.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.265+0000 7f535d200700 1 -- 172.21.15.57:0/2734855882 shutdown_connections 2024-02-28T16:03:20.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.265+0000 7f535d200700 1 --2- 172.21.15.57:0/2734855882 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f533c038ab0 0x7f533c03af60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:20.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.265+0000 7f535d200700 1 --2- 172.21.15.57:0/2734855882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53580ff150 0x7f535810e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:20.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.265+0000 7f535d200700 1 --2- 172.21.15.57:0/2734855882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5358100360 0x7f535810cbc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:20.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.265+0000 7f535d200700 1 -- 172.21.15.57:0/2734855882 >> 172.21.15.57:0/2734855882 conn(0x7f53580fa920 msgr2=0x7f53580fbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:20.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.266+0000 7f535d200700 1 -- 172.21.15.57:0/2734855882 shutdown_connections 2024-02-28T16:03:20.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.266+0000 7f535d200700 1 -- 172.21.15.57:0/2734855882 wait complete. 2024-02-28T16:03:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.451+0000 7f0af6000700 1 -- 172.21.15.57:0/3340014941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0af00fe1d0 msgr2=0x7f0af0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.451+0000 7f0af6000700 1 --2- 172.21.15.57:0/3340014941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0af00fe1d0 0x7f0af0100650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0adc004940 tx=0x7f0adc009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.452+0000 7f0af6000700 1 -- 172.21.15.57:0/3340014941 shutdown_connections 2024-02-28T16:03:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.452+0000 7f0af6000700 1 --2- 172.21.15.57:0/3340014941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0af00fe1d0 0x7f0af0100650 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.452+0000 7f0af6000700 1 --2- 172.21.15.57:0/3340014941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af00fb870 0x7f0af00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.452+0000 7f0af6000700 1 -- 172.21.15.57:0/3340014941 >> 172.21.15.57:0/3340014941 conn(0x7f0af00f74e0 msgr2=0x7f0af00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.452+0000 7f0af6000700 1 -- 172.21.15.57:0/3340014941 shutdown_connections 2024-02-28T16:03:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.452+0000 7f0af6000700 1 -- 172.21.15.57:0/3340014941 wait complete. 2024-02-28T16:03:20.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.453+0000 7f0af6000700 1 Processor -- start 2024-02-28T16:03:20.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.453+0000 7f0af6000700 1 -- start start 2024-02-28T16:03:20.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.453+0000 7f0af6000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af00fb870 0x7f0af0113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:20.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.453+0000 7f0af6000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0af00fe1d0 0x7f0af0114410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:20.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.453+0000 7f0af6000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0114a10 con 0x7f0af00fe1d0 2024-02-28T16:03:20.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.453+0000 7f0af6000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af01152b0 con 0x7f0af00fb870 2024-02-28T16:03:20.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.453+0000 7f0aeea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0af00fe1d0 0x7f0af0114410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:20.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.454+0000 7f0aeea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0af00fe1d0 0x7f0af0114410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48016/0 (socket says 172.21.15.57:48016) 2024-02-28T16:03:20.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.454+0000 7f0aeea00700 1 -- 172.21.15.57:0/208086794 learned_addr learned my addr 172.21.15.57:0/208086794 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:20.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.454+0000 7f0aeea00700 1 -- 172.21.15.57:0/208086794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af00fb870 msgr2=0x7f0af0113ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:20.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.454+0000 7f0aeea00700 1 --2- 172.21.15.57:0/208086794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af00fb870 0x7f0af0113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:20.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.454+0000 7f0aeea00700 1 -- 172.21.15.57:0/208086794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc005040 con 0x7f0af00fe1d0 2024-02-28T16:03:20.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.454+0000 7f0aeea00700 1 --2- 172.21.15.57:0/208086794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0af00fe1d0 0x7f0af0114410 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009fd0 tx=0x7f0adc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:20.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.455+0000 7f0ae7400700 1 -- 172.21.15.57:0/208086794 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0adc021070 con 0x7f0af00fe1d0 2024-02-28T16:03:20.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.455+0000 7f0ae7400700 1 -- 172.21.15.57:0/208086794 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0adc01c400 con 0x7f0af00fe1d0 2024-02-28T16:03:20.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.455+0000 7f0ae7400700 1 -- 172.21.15.57:0/208086794 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0adc00e070 con 0x7f0af00fe1d0 2024-02-28T16:03:20.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.455+0000 7f0af6000700 1 -- 172.21.15.57:0/208086794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af0115530 con 0x7f0af00fe1d0 2024-02-28T16:03:20.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.455+0000 7f0af6000700 1 -- 172.21.15.57:0/208086794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af0115a20 con 0x7f0af00fe1d0 2024-02-28T16:03:20.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.456+0000 7f0af6000700 1 -- 172.21.15.57:0/208086794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af004bed0 con 0x7f0af00fe1d0 2024-02-28T16:03:20.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.457+0000 7f0ae7400700 1 -- 172.21.15.57:0/208086794 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 30) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f0adc01c570 con 0x7f0af00fe1d0 2024-02-28T16:03:20.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.457+0000 7f0ae7400700 1 --2- 172.21.15.57:0/208086794 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f0ad4038a70 0x7f0ad403af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:20.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.457+0000 7f0ae7400700 1 -- 172.21.15.57:0/208086794 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f0adc04d950 con 0x7f0af00fe1d0 2024-02-28T16:03:20.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.459+0000 7f0aef400700 1 --2- 172.21.15.57:0/208086794 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f0ad4038a70 0x7f0ad403af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:20.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.460+0000 7f0aef400700 1 --2- 172.21.15.57:0/208086794 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f0ad4038a70 0x7f0ad403af20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009fd0 tx=0x7f0ae000b040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:20.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.467+0000 7f0ae7400700 1 -- 172.21.15.57:0/208086794 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0adc024720 con 0x7f0af00fe1d0 2024-02-28T16:03:20.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.851+0000 7f0af6000700 1 -- 172.21.15.57:0/208086794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0af0115d50 con 0x7f0af00fe1d0 2024-02-28T16:03:20.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.851+0000 7f0ae7400700 1 -- 172.21.15.57:0/208086794 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f0adc025370 con 0x7f0af00fe1d0 2024-02-28T16:03:20.844 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:03:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:03:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:03:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:03:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:03:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:03:20.846 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:03:20.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.855+0000 7f0af6000700 1 -- 172.21.15.57:0/208086794 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f0ad4038a70 msgr2=0x7f0ad403af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:20.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.855+0000 7f0af6000700 1 --2- 172.21.15.57:0/208086794 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f0ad4038a70 0x7f0ad403af20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009fd0 tx=0x7f0ae000b040 comp rx=0 tx=0).stop 2024-02-28T16:03:20.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.855+0000 7f0af6000700 1 -- 172.21.15.57:0/208086794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0af00fe1d0 msgr2=0x7f0af0114410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:20.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.855+0000 7f0af6000700 1 --2- 172.21.15.57:0/208086794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0af00fe1d0 0x7f0af0114410 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009fd0 tx=0x7f0adc009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:20.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.855+0000 7f0af6000700 1 -- 172.21.15.57:0/208086794 shutdown_connections 2024-02-28T16:03:20.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.855+0000 7f0af6000700 1 --2- 172.21.15.57:0/208086794 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f0ad4038a70 0x7f0ad403af20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:20.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.855+0000 7f0af6000700 1 --2- 172.21.15.57:0/208086794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af00fb870 0x7f0af0113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:20.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.855+0000 7f0af6000700 1 --2- 172.21.15.57:0/208086794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0af00fe1d0 0x7f0af0114410 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:20.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.855+0000 7f0af6000700 1 -- 172.21.15.57:0/208086794 >> 172.21.15.57:0/208086794 conn(0x7f0af00f74e0 msgr2=0x7f0af00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:20.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.856+0000 7f0af6000700 1 -- 172.21.15.57:0/208086794 shutdown_connections 2024-02-28T16:03:20.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:20.856+0000 7f0af6000700 1 -- 172.21.15.57:0/208086794 wait complete. 2024-02-28T16:03:21.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.088+0000 7f77dda00700 1 -- 172.21.15.57:0/1967665750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77d80649e0 msgr2=0x7f77d80fcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:21.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.088+0000 7f77dda00700 1 --2- 172.21.15.57:0/1967665750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77d80649e0 0x7f77d80fcc20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f77c8004940 tx=0x7f77c8009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.088+0000 7f77dda00700 1 -- 172.21.15.57:0/1967665750 shutdown_connections 2024-02-28T16:03:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.088+0000 7f77dda00700 1 --2- 172.21.15.57:0/1967665750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77d80649e0 0x7f77d80fcc20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.088+0000 7f77dda00700 1 --2- 172.21.15.57:0/1967665750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77d80fb180 0x7f77d80fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.089+0000 7f77dda00700 1 -- 172.21.15.57:0/1967665750 >> 172.21.15.57:0/1967665750 conn(0x7f77d80f6840 msgr2=0x7f77d80f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.089+0000 7f77dda00700 1 -- 172.21.15.57:0/1967665750 shutdown_connections 2024-02-28T16:03:21.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.089+0000 7f77dda00700 1 -- 172.21.15.57:0/1967665750 wait complete. 2024-02-28T16:03:21.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.091+0000 7f77dda00700 1 Processor -- start 2024-02-28T16:03:21.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.091+0000 7f77dda00700 1 -- start start 2024-02-28T16:03:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.092+0000 7f77dda00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77d80649e0 0x7f77d806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.093+0000 7f77dda00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77d80fb180 0x7f77d806f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:21.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.094+0000 7f77dda00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d806faf0 con 0x7f77d80649e0 2024-02-28T16:03:21.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.094+0000 7f77dda00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8117530 con 0x7f77d80fb180 2024-02-28T16:03:21.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.095+0000 7f77d6000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77d80fb180 0x7f77d806f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:21.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.095+0000 7f77d6000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77d80fb180 0x7f77d806f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:54060/0 (socket says 172.21.15.57:54060) 2024-02-28T16:03:21.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.095+0000 7f77d6000700 1 -- 172.21.15.57:0/1051560602 learned_addr learned my addr 172.21.15.57:0/1051560602 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.096+0000 7f77d6000700 1 -- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77d80649e0 msgr2=0x7f77d806ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.096+0000 7f77d6a00700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77d80649e0 0x7f77d806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.096+0000 7f77d6000700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77d80649e0 0x7f77d806ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.096+0000 7f77d6000700 1 -- 172.21.15.57:0/1051560602 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c8005040 con 0x7f77d80fb180 2024-02-28T16:03:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.096+0000 7f77d6a00700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77d80649e0 0x7f77d806ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:03:21.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.097+0000 7f77d6000700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77d80fb180 0x7f77d806f4a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f77c800b3b0 tx=0x7f77c8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:21.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.097+0000 7f77cea00700 1 -- 172.21.15.57:0/1051560602 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c800e040 con 0x7f77d80fb180 2024-02-28T16:03:21.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.098+0000 7f77dda00700 1 -- 172.21.15.57:0/1051560602 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d81177b0 con 0x7f77d80fb180 2024-02-28T16:03:21.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.098+0000 7f77dda00700 1 -- 172.21.15.57:0/1051560602 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d8117cf0 con 0x7f77d80fb180 2024-02-28T16:03:21.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.099+0000 7f77cea00700 1 -- 172.21.15.57:0/1051560602 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77c8004db0 con 0x7f77d80fb180 2024-02-28T16:03:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.099+0000 7f77cea00700 1 -- 172.21.15.57:0/1051560602 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c801c3f0 con 0x7f77d80fb180 2024-02-28T16:03:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.100+0000 7f77dda00700 1 -- 172.21.15.57:0/1051560602 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b80052e0 con 0x7f77d80fb180 2024-02-28T16:03:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.101+0000 7f77cea00700 1 -- 172.21.15.57:0/1051560602 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 30) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f77c801c5f0 con 0x7f77d80fb180 2024-02-28T16:03:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.101+0000 7f77cea00700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f77bc038ab0 0x7f77bc03af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.101+0000 7f77cea00700 1 -- 172.21.15.57:0/1051560602 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f77c804db30 con 0x7f77d80fb180 2024-02-28T16:03:21.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.102+0000 7f77d6a00700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f77bc038ab0 0x7f77bc03af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:21.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.106+0000 7f77d6a00700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f77bc038ab0 0x7f77bc03af60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f77d80fc1f0 tx=0x7f77d0009040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:21.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.118+0000 7f77cea00700 1 -- 172.21.15.57:0/1051560602 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f77c8011960 con 0x7f77d80fb180 2024-02-28T16:03:21.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:21 smithi057 ceph-mon[28763]: pgmap v7: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 345 op/s 2024-02-28T16:03:21.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:21 smithi057 ceph-mon[28763]: from='client.24577 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:21.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:21 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:21.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:21 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:21.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:21 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:21.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:21 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:21.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:21 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/208086794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:03:21.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.492+0000 7f77dda00700 1 -- 172.21.15.57:0/1051560602 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f77b8005860 con 0x7f77d80fb180 2024-02-28T16:03:21.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.493+0000 7f77cea00700 1 -- 172.21.15.57:0/1051560602 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1859 (secure 0 0 0) 0x7f77c8023560 con 0x7f77d80fb180 2024-02-28T16:03:21.486 INFO:teuthology.orchestra.run.smithi057.stdout:e16 2024-02-28T16:03:21.486 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:03:21.486 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 16 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:02:07.353165+0000 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:03:21.487 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:03:21.488 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:03:21.489 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:03:21.489 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:03:21.489 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:03:21.489 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:03:21.489 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:03:21.489 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:03:21.489 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:03:21.489 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:03:21.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.497+0000 7f77dda00700 1 -- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f77bc038ab0 msgr2=0x7f77bc03af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:21.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.497+0000 7f77dda00700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f77bc038ab0 0x7f77bc03af60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f77d80fc1f0 tx=0x7f77d0009040 comp rx=0 tx=0).stop 2024-02-28T16:03:21.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.497+0000 7f77dda00700 1 -- 172.21.15.57:0/1051560602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77d80fb180 msgr2=0x7f77d806f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:21.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.497+0000 7f77dda00700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77d80fb180 0x7f77d806f4a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f77c800b3b0 tx=0x7f77c8009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:21.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.497+0000 7f77dda00700 1 -- 172.21.15.57:0/1051560602 shutdown_connections 2024-02-28T16:03:21.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.497+0000 7f77dda00700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f77bc038ab0 0x7f77bc03af60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:21.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.498+0000 7f77dda00700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77d80649e0 0x7f77d806ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:21.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.498+0000 7f77dda00700 1 --2- 172.21.15.57:0/1051560602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77d80fb180 0x7f77d806f4a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:21.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.498+0000 7f77dda00700 1 -- 172.21.15.57:0/1051560602 >> 172.21.15.57:0/1051560602 conn(0x7f77d80f6840 msgr2=0x7f77d80ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:21.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.498+0000 7f77dda00700 1 -- 172.21.15.57:0/1051560602 shutdown_connections 2024-02-28T16:03:21.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.498+0000 7f77dda00700 1 -- 172.21.15.57:0/1051560602 wait complete. 2024-02-28T16:03:21.491 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2024-02-28T16:03:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.663+0000 7fd2c9800700 1 -- 172.21.15.57:0/4206447206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c4071f10 msgr2=0x7fd2c4070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.663+0000 7fd2c9800700 1 --2- 172.21.15.57:0/4206447206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c4071f10 0x7fd2c4070380 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4004940 tx=0x7fd2b4009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.663+0000 7fd2c9800700 1 -- 172.21.15.57:0/4206447206 shutdown_connections 2024-02-28T16:03:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.663+0000 7fd2c9800700 1 --2- 172.21.15.57:0/4206447206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40708c0 0x7fd2c4070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.663+0000 7fd2c9800700 1 --2- 172.21.15.57:0/4206447206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c4071f10 0x7fd2c4070380 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.663+0000 7fd2c9800700 1 -- 172.21.15.57:0/4206447206 >> 172.21.15.57:0/4206447206 conn(0x7fd2c40f8620 msgr2=0x7fd2c40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.664+0000 7fd2c9800700 1 -- 172.21.15.57:0/4206447206 shutdown_connections 2024-02-28T16:03:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.664+0000 7fd2c9800700 1 -- 172.21.15.57:0/4206447206 wait complete. 2024-02-28T16:03:21.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.665+0000 7fd2c9800700 1 Processor -- start 2024-02-28T16:03:21.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.665+0000 7fd2c9800700 1 -- start start 2024-02-28T16:03:21.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c9800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c40708c0 0x7fd2c410fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c9800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c4071f10 0x7fd2c41100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c9800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c41106e0 con 0x7fd2c40708c0 2024-02-28T16:03:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c9800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4110f80 con 0x7fd2c4071f10 2024-02-28T16:03:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c2a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c40708c0 0x7fd2c410fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c2000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c4071f10 0x7fd2c41100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c2a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c40708c0 0x7fd2c410fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48042/0 (socket says 172.21.15.57:48042) 2024-02-28T16:03:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c2a00700 1 -- 172.21.15.57:0/684539276 learned_addr learned my addr 172.21.15.57:0/684539276 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:21.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c2a00700 1 -- 172.21.15.57:0/684539276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c4071f10 msgr2=0x7fd2c41100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:21.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c2a00700 1 --2- 172.21.15.57:0/684539276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c4071f10 0x7fd2c41100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:21.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.666+0000 7fd2c2a00700 1 -- 172.21.15.57:0/684539276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4005040 con 0x7fd2c40708c0 2024-02-28T16:03:21.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.667+0000 7fd2c2a00700 1 --2- 172.21.15.57:0/684539276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c40708c0 0x7fd2c410fba0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009380 tx=0x7fd2b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:21.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.667+0000 7fd2baa00700 1 -- 172.21.15.57:0/684539276 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b400e040 con 0x7fd2c40708c0 2024-02-28T16:03:21.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.667+0000 7fd2baa00700 1 -- 172.21.15.57:0/684539276 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2b400bb90 con 0x7fd2c40708c0 2024-02-28T16:03:21.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.667+0000 7fd2c9800700 1 -- 172.21.15.57:0/684539276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c4111200 con 0x7fd2c40708c0 2024-02-28T16:03:21.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.667+0000 7fd2c9800700 1 -- 172.21.15.57:0/684539276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c4111740 con 0x7fd2c40708c0 2024-02-28T16:03:21.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.668+0000 7fd2baa00700 1 -- 172.21.15.57:0/684539276 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b401c630 con 0x7fd2c40708c0 2024-02-28T16:03:21.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.669+0000 7fd2c9800700 1 -- 172.21.15.57:0/684539276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a40052e0 con 0x7fd2c40708c0 2024-02-28T16:03:21.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.669+0000 7fd2baa00700 1 -- 172.21.15.57:0/684539276 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 30) v1 ==== 45928+0+0 (secure 0 0 0) 0x7fd2b400bd00 con 0x7fd2c40708c0 2024-02-28T16:03:21.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.670+0000 7fd2baa00700 1 --2- 172.21.15.57:0/684539276 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd2a8038ab0 0x7fd2a803af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:21.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.670+0000 7fd2baa00700 1 -- 172.21.15.57:0/684539276 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fd2b404d920 con 0x7fd2c40708c0 2024-02-28T16:03:21.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.670+0000 7fd2c2000700 1 --2- 172.21.15.57:0/684539276 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd2a8038ab0 0x7fd2a803af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:21.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.671+0000 7fd2c2000700 1 --2- 172.21.15.57:0/684539276 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd2a8038ab0 0x7fd2a803af60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0004f40 tx=0x7fd2b000b040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:21.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:21.675+0000 7fd2baa00700 1 -- 172.21.15.57:0/684539276 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd2b4011960 con 0x7fd2c40708c0 2024-02-28T16:03:21.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:21 smithi087 ceph-mon[37122]: pgmap v7: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 345 op/s 2024-02-28T16:03:21.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:21 smithi087 ceph-mon[37122]: from='client.24577 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:21.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:21 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:21.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:21 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:21.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:21 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:21.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:21 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:21.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:21 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/208086794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:03:22.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.028+0000 7fd2c9800700 1 -- 172.21.15.57:0/684539276 --> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2a4000bf0 con 0x7fd2a8038ab0 2024-02-28T16:03:22.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.031+0000 7fd2baa00700 1 -- 172.21.15.57:0/684539276 <== mgr.14742 v2:172.21.15.57:6800/3297260515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fd2a4000bf0 con 0x7fd2a8038ab0 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr" 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "2/21 daemons upgraded", 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "", 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:03:22.027 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:03:22.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 -- 172.21.15.57:0/684539276 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd2a8038ab0 msgr2=0x7fd2a803af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:22.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 --2- 172.21.15.57:0/684539276 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd2a8038ab0 0x7fd2a803af60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0004f40 tx=0x7fd2b000b040 comp rx=0 tx=0).stop 2024-02-28T16:03:22.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 -- 172.21.15.57:0/684539276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c40708c0 msgr2=0x7fd2c410fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:22.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 --2- 172.21.15.57:0/684539276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c40708c0 0x7fd2c410fba0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009380 tx=0x7fd2b4009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:22.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 -- 172.21.15.57:0/684539276 shutdown_connections 2024-02-28T16:03:22.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 --2- 172.21.15.57:0/684539276 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd2a8038ab0 0x7fd2a803af60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:22.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 --2- 172.21.15.57:0/684539276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c40708c0 0x7fd2c410fba0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:22.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 --2- 172.21.15.57:0/684539276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c4071f10 0x7fd2c41100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:22.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 -- 172.21.15.57:0/684539276 >> 172.21.15.57:0/684539276 conn(0x7fd2c40f8620 msgr2=0x7fd2c4102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:22.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 -- 172.21.15.57:0/684539276 shutdown_connections 2024-02-28T16:03:22.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.038+0000 7fd2c9800700 1 -- 172.21.15.57:0/684539276 wait complete. 2024-02-28T16:03:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.251+0000 7fa42f200700 1 -- 172.21.15.57:0/3413655817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4300663e0 msgr2=0x7fa4300ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.251+0000 7fa42f200700 1 --2- 172.21.15.57:0/3413655817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4300663e0 0x7fa4300ff8f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa420004940 tx=0x7fa420009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.252+0000 7fa42f200700 1 -- 172.21.15.57:0/3413655817 shutdown_connections 2024-02-28T16:03:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.252+0000 7fa42f200700 1 --2- 172.21.15.57:0/3413655817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4300ffec0 0x7fa430102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.252+0000 7fa42f200700 1 --2- 172.21.15.57:0/3413655817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4300663e0 0x7fa4300ff8f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.252+0000 7fa42f200700 1 -- 172.21.15.57:0/3413655817 >> 172.21.15.57:0/3413655817 conn(0x7fa4300f72c0 msgr2=0x7fa4300f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:22.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.253+0000 7fa42f200700 1 -- 172.21.15.57:0/3413655817 shutdown_connections 2024-02-28T16:03:22.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.253+0000 7fa42f200700 1 -- 172.21.15.57:0/3413655817 wait complete. 2024-02-28T16:03:22.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.253+0000 7fa42f200700 1 Processor -- start 2024-02-28T16:03:22.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.254+0000 7fa42f200700 1 -- start start 2024-02-28T16:03:22.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.254+0000 7fa42f200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4300663e0 0x7fa43010f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:22.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.254+0000 7fa42f200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4300ffec0 0x7fa43010fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:22.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.254+0000 7fa42f200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa430110450 con 0x7fa4300663e0 2024-02-28T16:03:22.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.254+0000 7fa42f200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa430110cf0 con 0x7fa4300ffec0 2024-02-28T16:03:22.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.254+0000 7fa42de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4300663e0 0x7fa43010f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:22.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.254+0000 7fa42de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4300663e0 0x7fa43010f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56974/0 (socket says 172.21.15.57:56974) 2024-02-28T16:03:22.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.254+0000 7fa42de00700 1 -- 172.21.15.57:0/858930158 learned_addr learned my addr 172.21.15.57:0/858930158 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:22.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.254+0000 7fa42d400700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4300ffec0 0x7fa43010fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:22.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.255+0000 7fa42d400700 1 -- 172.21.15.57:0/858930158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4300663e0 msgr2=0x7fa43010f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:22.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.255+0000 7fa42d400700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4300663e0 0x7fa43010f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:22.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.255+0000 7fa42d400700 1 -- 172.21.15.57:0/858930158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420005040 con 0x7fa4300ffec0 2024-02-28T16:03:22.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.255+0000 7fa42de00700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4300663e0 0x7fa43010f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:03:22.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.256+0000 7fa42d400700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4300ffec0 0x7fa43010fe50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa41c002840 tx=0x7fa41c004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:22.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.256+0000 7fa426000700 1 -- 172.21.15.57:0/858930158 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa41c007cc0 con 0x7fa4300ffec0 2024-02-28T16:03:22.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.257+0000 7fa42f200700 1 -- 172.21.15.57:0/858930158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa430110f50 con 0x7fa4300ffec0 2024-02-28T16:03:22.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.257+0000 7fa426000700 1 -- 172.21.15.57:0/858930158 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa41c00f040 con 0x7fa4300ffec0 2024-02-28T16:03:22.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.257+0000 7fa426000700 1 -- 172.21.15.57:0/858930158 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa41c013a10 con 0x7fa4300ffec0 2024-02-28T16:03:22.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.257+0000 7fa42f200700 1 -- 172.21.15.57:0/858930158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa430111510 con 0x7fa4300ffec0 2024-02-28T16:03:22.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.260+0000 7fa426000700 1 -- 172.21.15.57:0/858930158 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 30) v1 ==== 45928+0+0 (secure 0 0 0) 0x7fa41c01c400 con 0x7fa4300ffec0 2024-02-28T16:03:22.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.260+0000 7fa42f200700 1 -- 172.21.15.57:0/858930158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4100052e0 con 0x7fa4300ffec0 2024-02-28T16:03:22.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.261+0000 7fa426000700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fa414038a70 0x7fa41403af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:22.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.261+0000 7fa426000700 1 -- 172.21.15.57:0/858930158 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fa41c04bbe0 con 0x7fa4300ffec0 2024-02-28T16:03:22.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.262+0000 7fa42de00700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fa414038a70 0x7fa41403af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:22.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.263+0000 7fa42de00700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fa414038a70 0x7fa41403af20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa420009fd0 tx=0x7fa420009e30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:22.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.275+0000 7fa426000700 1 -- 172.21.15.57:0/858930158 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa41c01aba0 con 0x7fa4300ffec0 2024-02-28T16:03:22.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:22 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/1051560602' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:03:22.606 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:22 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1051560602' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:03:22.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.649+0000 7fa42f200700 1 -- 172.21.15.57:0/858930158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa410005860 con 0x7fa4300ffec0 2024-02-28T16:03:22.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.650+0000 7fa426000700 1 -- 172.21.15.57:0/858930158 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa41c01aba0 con 0x7fa4300ffec0 2024-02-28T16:03:22.642 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:03:22.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.652+0000 7fa42f200700 1 -- 172.21.15.57:0/858930158 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fa414038a70 msgr2=0x7fa41403af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.652+0000 7fa42f200700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fa414038a70 0x7fa41403af20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa420009fd0 tx=0x7fa420009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.652+0000 7fa42f200700 1 -- 172.21.15.57:0/858930158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4300ffec0 msgr2=0x7fa43010fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.652+0000 7fa42f200700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4300ffec0 0x7fa43010fe50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa41c002840 tx=0x7fa41c004570 comp rx=0 tx=0).stop 2024-02-28T16:03:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.653+0000 7fa42f200700 1 -- 172.21.15.57:0/858930158 shutdown_connections 2024-02-28T16:03:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.653+0000 7fa42f200700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fa414038a70 0x7fa41403af20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.653+0000 7fa42f200700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4300663e0 0x7fa43010f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.653+0000 7fa42f200700 1 --2- 172.21.15.57:0/858930158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4300ffec0 0x7fa43010fe50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.653+0000 7fa42f200700 1 -- 172.21.15.57:0/858930158 >> 172.21.15.57:0/858930158 conn(0x7fa4300f72c0 msgr2=0x7fa430100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.653+0000 7fa42f200700 1 -- 172.21.15.57:0/858930158 shutdown_connections 2024-02-28T16:03:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:22.653+0000 7fa42f200700 1 -- 172.21.15.57:0/858930158 wait complete. 2024-02-28T16:03:23.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:23 smithi057 ceph-mon[28763]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:23.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:23 smithi057 ceph-mon[28763]: pgmap v8: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 963 KiB/s rd, 946 KiB/s wr, 268 op/s 2024-02-28T16:03:23.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:23 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/858930158' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:03:23.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:23 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:23.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:23 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:23.651 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:23 smithi087 ceph-mon[37122]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:23.651 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:23 smithi087 ceph-mon[37122]: pgmap v8: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 963 KiB/s rd, 946 KiB/s wr, 268 op/s 2024-02-28T16:03:23.651 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:23 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/858930158' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:03:23.651 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:23 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:23.651 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:23 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:24.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:24 smithi057 ceph-mon[28763]: Standby manager daemon smithi087.ewrszc started 2024-02-28T16:03:24.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:24 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/2204767569' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/crt"}]: dispatch 2024-02-28T16:03:24.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:24 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/2204767569' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:03:24.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:24 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/2204767569' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/key"}]: dispatch 2024-02-28T16:03:24.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:24 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/2204767569' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:03:24.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:24 smithi087 ceph-mon[37122]: Standby manager daemon smithi087.ewrszc started 2024-02-28T16:03:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:24 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2204767569' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/crt"}]: dispatch 2024-02-28T16:03:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:24 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2204767569' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:03:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:24 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2204767569' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/key"}]: dispatch 2024-02-28T16:03:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:24 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2204767569' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:03:25.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:25 smithi057 ceph-mon[28763]: pgmap v9: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 386 op/s 2024-02-28T16:03:25.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:25 smithi057 ceph-mon[28763]: mgrmap e31: smithi057.upqerc(active, since 12s), standbys: smithi087.ewrszc 2024-02-28T16:03:25.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:25 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi087.ewrszc", "id": "smithi087.ewrszc"}]: dispatch 2024-02-28T16:03:25.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:25 smithi087 ceph-mon[37122]: pgmap v9: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 386 op/s 2024-02-28T16:03:25.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:25 smithi087 ceph-mon[37122]: mgrmap e31: smithi057.upqerc(active, since 12s), standbys: smithi087.ewrszc 2024-02-28T16:03:25.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:25 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi087.ewrszc", "id": "smithi087.ewrszc"}]: dispatch 2024-02-28T16:03:27.585 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:27 smithi087 ceph-mon[37122]: pgmap v10: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 354 op/s 2024-02-28T16:03:27.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:27 smithi057 ceph-mon[28763]: pgmap v10: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 354 op/s 2024-02-28T16:03:28.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:28 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:03:28.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:28 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:03:29.559 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:29 smithi057 ceph-mon[28763]: pgmap v11: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 406 op/s 2024-02-28T16:03:29.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:29 smithi087 ceph-mon[37122]: pgmap v11: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 406 op/s 2024-02-28T16:03:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:30 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:30 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:30 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:03:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:30 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:03:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:30 smithi057 ceph-mon[28763]: Updating smithi057:/etc/ceph/ceph.conf 2024-02-28T16:03:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:30 smithi057 ceph-mon[28763]: Updating smithi087:/etc/ceph/ceph.conf 2024-02-28T16:03:30.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:30 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:30.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:30 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:30.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:30 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:03:30.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:30 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:03:30.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:30 smithi087 ceph-mon[37122]: Updating smithi057:/etc/ceph/ceph.conf 2024-02-28T16:03:30.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:30 smithi087 ceph-mon[37122]: Updating smithi087:/etc/ceph/ceph.conf 2024-02-28T16:03:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:31 smithi057 ceph-mon[28763]: pgmap v12: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 439 op/s 2024-02-28T16:03:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:31 smithi057 ceph-mon[28763]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:03:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:31 smithi057 ceph-mon[28763]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:03:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:31 smithi087 ceph-mon[37122]: pgmap v12: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 439 op/s 2024-02-28T16:03:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:31 smithi087 ceph-mon[37122]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:03:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:31 smithi087 ceph-mon[37122]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:03:32.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:32 smithi057 ceph-mon[28763]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:03:32.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:32 smithi057 ceph-mon[28763]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:03:32.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:32 smithi057 ceph-mon[28763]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:03:32.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:32 smithi057 ceph-mon[28763]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:03:32.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:32 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:32.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:32 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:32.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:32 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:32.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:32 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:32.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:32 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:32.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:32 smithi087 ceph-mon[37122]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:03:32.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:32 smithi087 ceph-mon[37122]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:03:32.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:32 smithi087 ceph-mon[37122]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:03:32.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:32 smithi087 ceph-mon[37122]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:03:32.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:32 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:32.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:32 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:32.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:32 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:32.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:32 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:32.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:32 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:33.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:33 smithi057 ceph-mon[28763]: pgmap v13: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 303 op/s 2024-02-28T16:03:33.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:33 smithi057 ceph-mon[28763]: Reconfiguring prometheus.smithi057 (dependencies changed)... 2024-02-28T16:03:33.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:33 smithi087 ceph-mon[37122]: pgmap v13: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 303 op/s 2024-02-28T16:03:33.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:33 smithi087 ceph-mon[37122]: Reconfiguring prometheus.smithi057 (dependencies changed)... 2024-02-28T16:03:34.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:34 smithi057 ceph-mon[28763]: Reconfiguring daemon prometheus.smithi057 on smithi057 2024-02-28T16:03:34.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:34 smithi087 ceph-mon[37122]: Reconfiguring daemon prometheus.smithi057 on smithi057 2024-02-28T16:03:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:35 smithi057 ceph-mon[28763]: pgmap v14: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 463 op/s 2024-02-28T16:03:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:35 smithi087 ceph-mon[37122]: pgmap v14: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 463 op/s 2024-02-28T16:03:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:37 smithi057 ceph-mon[28763]: pgmap v15: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 310 op/s 2024-02-28T16:03:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:37 smithi087 ceph-mon[37122]: pgmap v15: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 310 op/s 2024-02-28T16:03:39.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:39 smithi087 ceph-mon[37122]: pgmap v16: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 310 op/s 2024-02-28T16:03:40.081 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:39 smithi057 ceph-mon[28763]: pgmap v16: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 310 op/s 2024-02-28T16:03:41.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:41 smithi057 ceph-mon[28763]: pgmap v17: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 393 op/s 2024-02-28T16:03:41.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:41 smithi087 ceph-mon[37122]: pgmap v17: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 393 op/s 2024-02-28T16:03:42.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:42 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:03:43.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:42 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:03:43.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:43 smithi087 ceph-mon[37122]: pgmap v18: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 295 op/s 2024-02-28T16:03:44.126 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:43 smithi057 ceph-mon[28763]: pgmap v18: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 295 op/s 2024-02-28T16:03:45.857 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:45 smithi057 ceph-mon[28763]: pgmap v19: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 407 op/s 2024-02-28T16:03:45.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:45 smithi087 ceph-mon[37122]: pgmap v19: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 407 op/s 2024-02-28T16:03:47.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:47 smithi087 ceph-mon[37122]: pgmap v20: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 802 KiB/s rd, 803 KiB/s wr, 247 op/s 2024-02-28T16:03:47.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:47 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:47.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:47 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:47.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:47 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:03:47.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:47 smithi087 ceph-mon[37122]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:03:47.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:47 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:03:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:47 smithi057 ceph-mon[28763]: pgmap v20: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 802 KiB/s rd, 803 KiB/s wr, 247 op/s 2024-02-28T16:03:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:47 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:47 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:47 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:03:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:47 smithi057 ceph-mon[28763]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:03:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:47 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:03:49.809 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:49 smithi087 ceph-mon[37122]: pgmap v21: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 802 KiB/s rd, 803 KiB/s wr, 247 op/s 2024-02-28T16:03:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:49 smithi057 ceph-mon[28763]: pgmap v21: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 802 KiB/s rd, 803 KiB/s wr, 247 op/s 2024-02-28T16:03:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:51 smithi057 ceph-mon[28763]: pgmap v22: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-02-28T16:03:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:51 smithi057 ceph-mon[28763]: Upgrade: Updating mgr.smithi087.ewrszc 2024-02-28T16:03:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:51 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:03:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:51 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:03:51.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:51 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:03:51.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:51 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:03:51.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:51 smithi057 ceph-mon[28763]: Deploying daemon mgr.smithi087.ewrszc on smithi087 2024-02-28T16:03:51.768 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:51 smithi087 ceph-mon[37122]: pgmap v22: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-02-28T16:03:51.768 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:51 smithi087 ceph-mon[37122]: Upgrade: Updating mgr.smithi087.ewrszc 2024-02-28T16:03:51.768 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:51 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:03:51.768 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:51 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:03:51.768 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:51 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:03:51.768 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:51 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:03:51.768 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:51 smithi087 ceph-mon[37122]: Deploying daemon mgr.smithi087.ewrszc on smithi087 2024-02-28T16:03:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.870+0000 7f8936200700 1 -- 172.21.15.57:0/1943207075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89300663a0 msgr2=0x7f89300ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.870+0000 7f8936200700 1 --2- 172.21.15.57:0/1943207075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89300663a0 0x7f89300ffb30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8920004940 tx=0x7f8920009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.870+0000 7f8936200700 1 -- 172.21.15.57:0/1943207075 shutdown_connections 2024-02-28T16:03:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.870+0000 7f8936200700 1 --2- 172.21.15.57:0/1943207075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8930100100 0x7f8930102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.870+0000 7f8936200700 1 --2- 172.21.15.57:0/1943207075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89300663a0 0x7f89300ffb30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.870+0000 7f8936200700 1 -- 172.21.15.57:0/1943207075 >> 172.21.15.57:0/1943207075 conn(0x7f89300f74e0 msgr2=0x7f89300f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.871+0000 7f8936200700 1 -- 172.21.15.57:0/1943207075 shutdown_connections 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.871+0000 7f8936200700 1 -- 172.21.15.57:0/1943207075 wait complete. 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.872+0000 7f8936200700 1 Processor -- start 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.872+0000 7f8936200700 1 -- start start 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.873+0000 7f8936200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89300663a0 0x7f893010b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.873+0000 7f8936200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8930100100 0x7f893010bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.873+0000 7f8936200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893010c2f0 con 0x7f8930100100 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.873+0000 7f8936200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893010cb90 con 0x7f89300663a0 2024-02-28T16:03:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.873+0000 7f892f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89300663a0 0x7f893010b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.873+0000 7f892f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89300663a0 0x7f893010b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:37920/0 (socket says 172.21.15.57:37920) 2024-02-28T16:03:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.873+0000 7f892f400700 1 -- 172.21.15.57:0/3715634479 learned_addr learned my addr 172.21.15.57:0/3715634479 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.873+0000 7f892ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8930100100 0x7f893010bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.874+0000 7f892f400700 1 -- 172.21.15.57:0/3715634479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8930100100 msgr2=0x7f893010bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.874+0000 7f892f400700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8930100100 0x7f893010bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.874+0000 7f892f400700 1 -- 172.21.15.57:0/3715634479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8920005040 con 0x7f89300663a0 2024-02-28T16:03:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.874+0000 7f892ea00700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8930100100 0x7f893010bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:03:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.875+0000 7f892f400700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89300663a0 0x7f893010b760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f892000b3b0 tx=0x7f8920009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.875+0000 7f8927400700 1 -- 172.21.15.57:0/3715634479 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f892000e040 con 0x7f89300663a0 2024-02-28T16:03:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.875+0000 7f8927400700 1 -- 172.21.15.57:0/3715634479 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f892000bd90 con 0x7f89300663a0 2024-02-28T16:03:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.875+0000 7f8927400700 1 -- 172.21.15.57:0/3715634479 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f892001c630 con 0x7f89300663a0 2024-02-28T16:03:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.875+0000 7f8936200700 1 -- 172.21.15.57:0/3715634479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893010ce10 con 0x7f89300663a0 2024-02-28T16:03:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.876+0000 7f8936200700 1 -- 172.21.15.57:0/3715634479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893010d350 con 0x7f89300663a0 2024-02-28T16:03:52.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.877+0000 7f8936200700 1 -- 172.21.15.57:0/3715634479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893004bed0 con 0x7f89300663a0 2024-02-28T16:03:52.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.879+0000 7f8927400700 1 -- 172.21.15.57:0/3715634479 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 31) v1 ==== 91301+0+0 (secure 0 0 0) 0x7f8920013980 con 0x7f89300663a0 2024-02-28T16:03:52.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.880+0000 7f8927400700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f891406d2d0 0x7f891406f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:52.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.880+0000 7f8927400700 1 -- 172.21.15.57:0/3715634479 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f892008db90 con 0x7f89300663a0 2024-02-28T16:03:52.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.880+0000 7f892ea00700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f891406d2d0 0x7f891406f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:52.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.881+0000 7f892ea00700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f891406d2d0 0x7f891406f780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89300660e0 tx=0x7f891c00b040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:52.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:52.888+0000 7f8927400700 1 -- 172.21.15.57:0/3715634479 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8920057ad0 con 0x7f89300663a0 2024-02-28T16:03:53.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.215+0000 7f8936200700 1 -- 172.21.15.57:0/3715634479 --> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89300fc020 con 0x7f891406d2d0 2024-02-28T16:03:53.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.217+0000 7f8927400700 1 -- 172.21.15.57:0/3715634479 <== mgr.14742 v2:172.21.15.57:6800/3297260515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f89300fc020 con 0x7f891406d2d0 2024-02-28T16:03:53.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 -- 172.21.15.57:0/3715634479 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f891406d2d0 msgr2=0x7f891406f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:53.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f891406d2d0 0x7f891406f780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89300660e0 tx=0x7f891c00b040 comp rx=0 tx=0).stop 2024-02-28T16:03:53.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 -- 172.21.15.57:0/3715634479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89300663a0 msgr2=0x7f893010b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:53.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89300663a0 0x7f893010b760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f892000b3b0 tx=0x7f8920009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:53.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 -- 172.21.15.57:0/3715634479 shutdown_connections 2024-02-28T16:03:53.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f891406d2d0 0x7f891406f780 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89300663a0 0x7f893010b760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 --2- 172.21.15.57:0/3715634479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8930100100 0x7f893010bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 -- 172.21.15.57:0/3715634479 >> 172.21.15.57:0/3715634479 conn(0x7f89300f74e0 msgr2=0x7f89300fb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:53.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 -- 172.21.15.57:0/3715634479 shutdown_connections 2024-02-28T16:03:53.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.220+0000 7f8936200700 1 -- 172.21.15.57:0/3715634479 wait complete. 2024-02-28T16:03:53.230 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:03:53.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.428+0000 7f7727200700 1 -- 172.21.15.57:0/84064932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7720102450 msgr2=0x7f7720104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:53.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.428+0000 7f7727200700 1 --2- 172.21.15.57:0/84064932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7720102450 0x7f7720104830 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f770c004880 tx=0x7f770c009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:53.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.428+0000 7f7727200700 1 -- 172.21.15.57:0/84064932 shutdown_connections 2024-02-28T16:03:53.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.428+0000 7f7727200700 1 --2- 172.21.15.57:0/84064932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7720102450 0x7f7720104830 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.428+0000 7f7727200700 1 --2- 172.21.15.57:0/84064932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77200663c0 0x7f7720101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.428+0000 7f7727200700 1 -- 172.21.15.57:0/84064932 >> 172.21.15.57:0/84064932 conn(0x7f77200f74e0 msgr2=0x7f77200f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:53.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.428+0000 7f7727200700 1 -- 172.21.15.57:0/84064932 shutdown_connections 2024-02-28T16:03:53.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.429+0000 7f7727200700 1 -- 172.21.15.57:0/84064932 wait complete. 2024-02-28T16:03:53.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.430+0000 7f7727200700 1 Processor -- start 2024-02-28T16:03:53.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.430+0000 7f7727200700 1 -- start start 2024-02-28T16:03:53.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.430+0000 7f7727200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77200663c0 0x7f7720113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:53.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.430+0000 7f7727200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7720102450 0x7f7720114530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:53.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.431+0000 7f7727200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7720114b30 con 0x7f77200663c0 2024-02-28T16:03:53.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.431+0000 7f7727200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77201153d0 con 0x7f7720102450 2024-02-28T16:03:53.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.431+0000 7f771fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77200663c0 0x7f7720113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:53.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.431+0000 7f771fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77200663c0 0x7f7720113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46088/0 (socket says 172.21.15.57:46088) 2024-02-28T16:03:53.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.431+0000 7f771fe00700 1 -- 172.21.15.57:0/1015996718 learned_addr learned my addr 172.21.15.57:0/1015996718 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.431+0000 7f771f400700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7720102450 0x7f7720114530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.432+0000 7f771fe00700 1 -- 172.21.15.57:0/1015996718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7720102450 msgr2=0x7f7720114530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.432+0000 7f771fe00700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7720102450 0x7f7720114530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.432+0000 7f771fe00700 1 -- 172.21.15.57:0/1015996718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710005040 con 0x7f77200663c0 2024-02-28T16:03:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.433+0000 7f771fe00700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77200663c0 0x7f7720113ff0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f77100096b0 tx=0x7f7710009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.433+0000 7f7717e00700 1 -- 172.21.15.57:0/1015996718 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7710017070 con 0x7f77200663c0 2024-02-28T16:03:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.433+0000 7f7717e00700 1 -- 172.21.15.57:0/1015996718 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f771000f040 con 0x7f77200663c0 2024-02-28T16:03:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.433+0000 7f7717e00700 1 -- 172.21.15.57:0/1015996718 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7710013be0 con 0x7f77200663c0 2024-02-28T16:03:53.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.433+0000 7f7727200700 1 -- 172.21.15.57:0/1015996718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c005040 con 0x7f77200663c0 2024-02-28T16:03:53.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.433+0000 7f7727200700 1 -- 172.21.15.57:0/1015996718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7720115a00 con 0x7f77200663c0 2024-02-28T16:03:53.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.434+0000 7f7727200700 1 -- 172.21.15.57:0/1015996718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77200ff260 con 0x7f77200663c0 2024-02-28T16:03:53.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.436+0000 7f7717e00700 1 -- 172.21.15.57:0/1015996718 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 31) v1 ==== 91301+0+0 (secure 0 0 0) 0x7f7710013400 con 0x7f77200663c0 2024-02-28T16:03:53.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.438+0000 7f7717e00700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f770406d200 0x7f770406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:53.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.438+0000 7f7717e00700 1 -- 172.21.15.57:0/1015996718 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f771008c4b0 con 0x7f77200663c0 2024-02-28T16:03:53.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.438+0000 7f771f400700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f770406d200 0x7f770406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:53.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.440+0000 7f771f400700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f770406d200 0x7f770406f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f770c013720 tx=0x7f770c009e30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:53.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.443+0000 7f7717e00700 1 -- 172.21.15.57:0/1015996718 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f7710059f40 con 0x7f77200663c0 2024-02-28T16:03:53.477 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:53 smithi057 ceph-mon[28763]: pgmap v23: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 848 KiB/s rd, 889 KiB/s wr, 242 op/s 2024-02-28T16:03:53.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.801+0000 7f7727200700 1 -- 172.21.15.57:0/1015996718 --> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f772002b3b0 con 0x7f770406d200 2024-02-28T16:03:53.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.803+0000 7f7717e00700 1 -- 172.21.15.57:0/1015996718 <== mgr.14742 v2:172.21.15.57:6800/3297260515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f772002b3b0 con 0x7f770406d200 2024-02-28T16:03:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 -- 172.21.15.57:0/1015996718 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f770406d200 msgr2=0x7f770406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f770406d200 0x7f770406f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f770c013720 tx=0x7f770c009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 -- 172.21.15.57:0/1015996718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77200663c0 msgr2=0x7f7720113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77200663c0 0x7f7720113ff0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f77100096b0 tx=0x7f7710009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 -- 172.21.15.57:0/1015996718 shutdown_connections 2024-02-28T16:03:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f770406d200 0x7f770406f6b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77200663c0 0x7f7720113ff0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 --2- 172.21.15.57:0/1015996718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7720102450 0x7f7720114530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 -- 172.21.15.57:0/1015996718 >> 172.21.15.57:0/1015996718 conn(0x7f77200f74e0 msgr2=0x7f77200f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:53.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 -- 172.21.15.57:0/1015996718 shutdown_connections 2024-02-28T16:03:53.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.806+0000 7f7727200700 1 -- 172.21.15.57:0/1015996718 wait complete. 2024-02-28T16:03:53.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:53 smithi087 ceph-mon[37122]: pgmap v23: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 848 KiB/s rd, 889 KiB/s wr, 242 op/s 2024-02-28T16:03:53.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.998+0000 7f383fc00700 1 -- 172.21.15.57:0/2625040942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38380fe1d0 msgr2=0x7f3838100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:53.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.998+0000 7f383fc00700 1 --2- 172.21.15.57:0/2625040942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38380fe1d0 0x7f3838100650 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3824004940 tx=0x7f3824009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:53.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.998+0000 7f383fc00700 1 -- 172.21.15.57:0/2625040942 shutdown_connections 2024-02-28T16:03:53.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.998+0000 7f383fc00700 1 --2- 172.21.15.57:0/2625040942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38380fe1d0 0x7f3838100650 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.998+0000 7f383fc00700 1 --2- 172.21.15.57:0/2625040942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38380fb870 0x7f38380fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.998+0000 7f383fc00700 1 -- 172.21.15.57:0/2625040942 >> 172.21.15.57:0/2625040942 conn(0x7f38380f74e0 msgr2=0x7f38380f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:53.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.998+0000 7f383fc00700 1 -- 172.21.15.57:0/2625040942 shutdown_connections 2024-02-28T16:03:53.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.998+0000 7f383fc00700 1 -- 172.21.15.57:0/2625040942 wait complete. 2024-02-28T16:03:53.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.999+0000 7f383fc00700 1 Processor -- start 2024-02-28T16:03:53.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.999+0000 7f383fc00700 1 -- start start 2024-02-28T16:03:53.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.999+0000 7f383fc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38380fb870 0x7f3838113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:53.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.999+0000 7f383fc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38380fe1d0 0x7f3838114460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:53.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.999+0000 7f383fc00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3838114a60 con 0x7f38380fe1d0 2024-02-28T16:03:53.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:53.999+0000 7f383fc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3838115300 con 0x7f38380fb870 2024-02-28T16:03:53.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.000+0000 7f3837e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38380fe1d0 0x7f3838114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:53.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.000+0000 7f3837e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38380fe1d0 0x7f3838114460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46104/0 (socket says 172.21.15.57:46104) 2024-02-28T16:03:53.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.000+0000 7f3837e00700 1 -- 172.21.15.57:0/427371386 learned_addr learned my addr 172.21.15.57:0/427371386 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:53.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.000+0000 7f383d200700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38380fb870 0x7f3838113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:53.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.000+0000 7f3837e00700 1 -- 172.21.15.57:0/427371386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38380fb870 msgr2=0x7f3838113f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:53.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.000+0000 7f3837e00700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38380fb870 0x7f3838113f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:53.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.000+0000 7f3837e00700 1 -- 172.21.15.57:0/427371386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824005040 con 0x7f38380fe1d0 2024-02-28T16:03:53.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.001+0000 7f3837e00700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38380fe1d0 0x7f3838114460 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3824009fd0 tx=0x7f3824009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:53.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.001+0000 7f3834c00700 1 -- 172.21.15.57:0/427371386 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3824021070 con 0x7f38380fe1d0 2024-02-28T16:03:53.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.001+0000 7f3834c00700 1 -- 172.21.15.57:0/427371386 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3824013de0 con 0x7f38380fe1d0 2024-02-28T16:03:53.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.001+0000 7f3834c00700 1 -- 172.21.15.57:0/427371386 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382400e070 con 0x7f38380fe1d0 2024-02-28T16:03:53.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.001+0000 7f383fc00700 1 -- 172.21.15.57:0/427371386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3838115580 con 0x7f38380fe1d0 2024-02-28T16:03:53.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.002+0000 7f383fc00700 1 -- 172.21.15.57:0/427371386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3838115ac0 con 0x7f38380fe1d0 2024-02-28T16:03:53.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.003+0000 7f383fc00700 1 -- 172.21.15.57:0/427371386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383804bed0 con 0x7f38380fe1d0 2024-02-28T16:03:53.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.005+0000 7f3834c00700 1 -- 172.21.15.57:0/427371386 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 31) v1 ==== 91301+0+0 (secure 0 0 0) 0x7f382401c690 con 0x7f38380fe1d0 2024-02-28T16:03:54.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.007+0000 7f3834c00700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f382006d200 0x7f382006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:54.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.007+0000 7f3834c00700 1 -- 172.21.15.57:0/427371386 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f382408da80 con 0x7f38380fe1d0 2024-02-28T16:03:54.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.008+0000 7f383d200700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f382006d200 0x7f382006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:54.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.009+0000 7f383d200700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f382006d200 0x7f382006f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f382c009b80 tx=0x7f382c00b040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:54.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.012+0000 7f3834c00700 1 -- 172.21.15.57:0/427371386 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f382405b4f0 con 0x7f38380fe1d0 2024-02-28T16:03:54.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.349+0000 7f383fc00700 1 -- 172.21.15.57:0/427371386 --> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3838115fe0 con 0x7f382006d200 2024-02-28T16:03:54.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.368+0000 7f3834c00700 1 -- 172.21.15.57:0/427371386 <== mgr.14742 v2:172.21.15.57:6800/3297260515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3838115fe0 con 0x7f382006d200 2024-02-28T16:03:54.362 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:03:54.362 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (2m) 33s ago 12m 15.1M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:03:54.362 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (13m) 33s ago 13m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T16:03:54.362 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (11m) 36s ago 11m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T16:03:54.362 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (93s) 33s ago 12m 76.0M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:03:54.362 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (5m) 33s ago 5m 165M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:03:54.362 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (5m) 33s ago 5m 96.2M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:03:54.362 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (5m) 36s ago 5m 140M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (5m) 36s ago 5m 73.7M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (68s) 33s ago 14m 475M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283 running (3m) 36s ago 11m 75.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 83ce464fbb4f 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (14m) 33s ago 14m 51.2M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (11m) 36s ago 11m 42.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (2m) 33s ago 13m 7490k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (76s) 36s ago 11m 7654k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (10m) 33s ago 10m 190M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (9m) 33s ago 9m 210M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (9m) 33s ago 9m 170M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:03:54.363 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (8m) 36s ago 8m 238M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:03:54.364 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (8m) 36s ago 8m 212M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:03:54.364 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (7m) 36s ago 7m 209M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:03:54.364 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 starting - - - - 2024-02-28T16:03:54.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.374+0000 7f383fc00700 1 -- 172.21.15.57:0/427371386 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f382006d200 msgr2=0x7f382006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:54.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.374+0000 7f383fc00700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f382006d200 0x7f382006f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f382c009b80 tx=0x7f382c00b040 comp rx=0 tx=0).stop 2024-02-28T16:03:54.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.374+0000 7f383fc00700 1 -- 172.21.15.57:0/427371386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38380fe1d0 msgr2=0x7f3838114460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:54.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.374+0000 7f383fc00700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38380fe1d0 0x7f3838114460 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3824009fd0 tx=0x7f3824009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:54.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.374+0000 7f383fc00700 1 -- 172.21.15.57:0/427371386 shutdown_connections 2024-02-28T16:03:54.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.374+0000 7f383fc00700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f382006d200 0x7f382006f6b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:54.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.374+0000 7f383fc00700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38380fb870 0x7f3838113f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:54.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.374+0000 7f383fc00700 1 --2- 172.21.15.57:0/427371386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38380fe1d0 0x7f3838114460 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:54.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.374+0000 7f383fc00700 1 -- 172.21.15.57:0/427371386 >> 172.21.15.57:0/427371386 conn(0x7f38380f74e0 msgr2=0x7f38380f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:54.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.374+0000 7f383fc00700 1 -- 172.21.15.57:0/427371386 shutdown_connections 2024-02-28T16:03:54.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.375+0000 7f383fc00700 1 -- 172.21.15.57:0/427371386 wait complete. 2024-02-28T16:03:54.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.551+0000 7fd400e00700 1 -- 172.21.15.57:0/86348382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc066340 msgr2=0x7fd3fc0ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:54.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.551+0000 7fd400e00700 1 --2- 172.21.15.57:0/86348382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc066340 0x7fd3fc0ffb20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec004940 tx=0x7fd3ec009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:54.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.552+0000 7fd400e00700 1 -- 172.21.15.57:0/86348382 shutdown_connections 2024-02-28T16:03:54.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.552+0000 7fd400e00700 1 --2- 172.21.15.57:0/86348382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc100060 0x7fd3fc102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:54.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.552+0000 7fd400e00700 1 --2- 172.21.15.57:0/86348382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc066340 0x7fd3fc0ffb20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:54.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.552+0000 7fd400e00700 1 -- 172.21.15.57:0/86348382 >> 172.21.15.57:0/86348382 conn(0x7fd3fc0f7530 msgr2=0x7fd3fc0f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:54.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.552+0000 7fd400e00700 1 -- 172.21.15.57:0/86348382 shutdown_connections 2024-02-28T16:03:54.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.552+0000 7fd400e00700 1 -- 172.21.15.57:0/86348382 wait complete. 2024-02-28T16:03:54.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.553+0000 7fd400e00700 1 Processor -- start 2024-02-28T16:03:54.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.553+0000 7fd400e00700 1 -- start start 2024-02-28T16:03:54.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.553+0000 7fd400e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc066340 0x7fd3fc0fd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:54.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.553+0000 7fd400e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc100060 0x7fd3fc0fba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:54.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.553+0000 7fd400e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc0fc020 con 0x7fd3fc100060 2024-02-28T16:03:54.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.553+0000 7fd400e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc0fc190 con 0x7fd3fc066340 2024-02-28T16:03:54.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.554+0000 7fd3f9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc100060 0x7fd3fc0fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:54.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.554+0000 7fd3f9e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc066340 0x7fd3fc0fd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:54.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.554+0000 7fd3f9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc100060 0x7fd3fc0fba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46124/0 (socket says 172.21.15.57:46124) 2024-02-28T16:03:54.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.554+0000 7fd3f9400700 1 -- 172.21.15.57:0/529407307 learned_addr learned my addr 172.21.15.57:0/529407307 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.554+0000 7fd3f9400700 1 -- 172.21.15.57:0/529407307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc066340 msgr2=0x7fd3fc0fd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.554+0000 7fd3f9400700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc066340 0x7fd3fc0fd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.554+0000 7fd3f9400700 1 -- 172.21.15.57:0/529407307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec005040 con 0x7fd3fc100060 2024-02-28T16:03:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.554+0000 7fd3f9e00700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc066340 0x7fd3fc0fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:03:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.555+0000 7fd3f9400700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc100060 0x7fd3fc0fba20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800eb40 tx=0x7fd3e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.555+0000 7fd3f2000700 1 -- 172.21.15.57:0/529407307 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e8007cc0 con 0x7fd3fc100060 2024-02-28T16:03:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.555+0000 7fd3f2000700 1 -- 172.21.15.57:0/529407307 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3e800f040 con 0x7fd3fc100060 2024-02-28T16:03:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.555+0000 7fd3f2000700 1 -- 172.21.15.57:0/529407307 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e800ca10 con 0x7fd3fc100060 2024-02-28T16:03:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.555+0000 7fd400e00700 1 -- 172.21.15.57:0/529407307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc0fc410 con 0x7fd3fc100060 2024-02-28T16:03:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.555+0000 7fd400e00700 1 -- 172.21.15.57:0/529407307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc115830 con 0x7fd3fc100060 2024-02-28T16:03:54.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.558+0000 7fd400e00700 1 -- 172.21.15.57:0/529407307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc1079f0 con 0x7fd3fc100060 2024-02-28T16:03:54.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.558+0000 7fd3f2000700 1 -- 172.21.15.57:0/529407307 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 31) v1 ==== 91301+0+0 (secure 0 0 0) 0x7fd3e800cc80 con 0x7fd3fc100060 2024-02-28T16:03:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.559+0000 7fd3f2000700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd3e006d200 0x7fd3e006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.559+0000 7fd3f2000700 1 -- 172.21.15.57:0/529407307 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fd3e808c320 con 0x7fd3fc100060 2024-02-28T16:03:54.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.560+0000 7fd3f9e00700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd3e006d200 0x7fd3e006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:54.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.561+0000 7fd3f9e00700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd3e006d200 0x7fd3e006f6b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec013740 tx=0x7fd3ec009e30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:54.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:54.565+0000 7fd3f2000700 1 -- 172.21.15.57:0/529407307 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd3e8059de0 con 0x7fd3fc100060 2024-02-28T16:03:54.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:54 smithi057 ceph-mon[28763]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:54.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:54 smithi057 ceph-mon[28763]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:54.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:54 smithi087 ceph-mon[37122]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:54.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:54 smithi087 ceph-mon[37122]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:55.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.014+0000 7fd400e00700 1 -- 172.21.15.57:0/529407307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd3fc1059b0 con 0x7fd3fc100060 2024-02-28T16:03:55.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.014+0000 7fd3f2000700 1 -- 172.21.15.57:0/529407307 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fd3e8059970 con 0x7fd3fc100060 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:03:55.008 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:03:55.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:03:55.009 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:03:55.009 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:03:55.009 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:03:55.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:03:55.009 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:03:55.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.017+0000 7fd400e00700 1 -- 172.21.15.57:0/529407307 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd3e006d200 msgr2=0x7fd3e006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:55.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.017+0000 7fd400e00700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd3e006d200 0x7fd3e006f6b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec013740 tx=0x7fd3ec009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:55.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.017+0000 7fd400e00700 1 -- 172.21.15.57:0/529407307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc100060 msgr2=0x7fd3fc0fba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:55.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.017+0000 7fd400e00700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc100060 0x7fd3fc0fba20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800eb40 tx=0x7fd3e800b040 comp rx=0 tx=0).stop 2024-02-28T16:03:55.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.018+0000 7fd400e00700 1 -- 172.21.15.57:0/529407307 shutdown_connections 2024-02-28T16:03:55.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.018+0000 7fd400e00700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fd3e006d200 0x7fd3e006f6b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.018+0000 7fd400e00700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc066340 0x7fd3fc0fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.018+0000 7fd400e00700 1 --2- 172.21.15.57:0/529407307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc100060 0x7fd3fc0fba20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.018+0000 7fd400e00700 1 -- 172.21.15.57:0/529407307 >> 172.21.15.57:0/529407307 conn(0x7fd3fc0f7530 msgr2=0x7fd3fc0f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:55.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.018+0000 7fd400e00700 1 -- 172.21.15.57:0/529407307 shutdown_connections 2024-02-28T16:03:55.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.018+0000 7fd400e00700 1 -- 172.21.15.57:0/529407307 wait complete. 2024-02-28T16:03:55.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.182+0000 7fc364a00700 1 -- 172.21.15.57:0/3522364936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3600708c0 msgr2=0x7fc360070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:55.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.182+0000 7fc364a00700 1 --2- 172.21.15.57:0/3522364936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3600708c0 0x7fc360070d10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc34c004940 tx=0x7fc34c009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:55.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.182+0000 7fc364a00700 1 -- 172.21.15.57:0/3522364936 shutdown_connections 2024-02-28T16:03:55.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.182+0000 7fc364a00700 1 --2- 172.21.15.57:0/3522364936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3600708c0 0x7fc360070d10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.182+0000 7fc364a00700 1 --2- 172.21.15.57:0/3522364936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360071f10 0x7fc360070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.182+0000 7fc364a00700 1 -- 172.21.15.57:0/3522364936 >> 172.21.15.57:0/3522364936 conn(0x7fc3600f8620 msgr2=0x7fc3600faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:55.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.182+0000 7fc364a00700 1 -- 172.21.15.57:0/3522364936 shutdown_connections 2024-02-28T16:03:55.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.182+0000 7fc364a00700 1 -- 172.21.15.57:0/3522364936 wait complete. 2024-02-28T16:03:55.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.183+0000 7fc364a00700 1 Processor -- start 2024-02-28T16:03:55.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.183+0000 7fc364a00700 1 -- start start 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.184+0000 7fc364a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3600708c0 0x7fc36010fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.184+0000 7fc364a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc360071f10 0x7fc3601100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.184+0000 7fc364a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3601106b0 con 0x7fc360071f10 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.184+0000 7fc364a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc360110f50 con 0x7fc3600708c0 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.184+0000 7fc35d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc360071f10 0x7fc3601100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.184+0000 7fc35d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc360071f10 0x7fc3601100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46148/0 (socket says 172.21.15.57:46148) 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.184+0000 7fc35d400700 1 -- 172.21.15.57:0/536382650 learned_addr learned my addr 172.21.15.57:0/536382650 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.184+0000 7fc35de00700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3600708c0 0x7fc36010fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.185+0000 7fc35d400700 1 -- 172.21.15.57:0/536382650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3600708c0 msgr2=0x7fc36010fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.185+0000 7fc35d400700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3600708c0 0x7fc36010fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.185+0000 7fc35d400700 1 -- 172.21.15.57:0/536382650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c005040 con 0x7fc360071f10 2024-02-28T16:03:55.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.185+0000 7fc35d400700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc360071f10 0x7fc3601100b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc34c000c00 tx=0x7fc34c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:55.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.186+0000 7fc356000700 1 -- 172.21.15.57:0/536382650 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc34c00e040 con 0x7fc360071f10 2024-02-28T16:03:55.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.186+0000 7fc356000700 1 -- 172.21.15.57:0/536382650 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc34c004290 con 0x7fc360071f10 2024-02-28T16:03:55.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.186+0000 7fc364a00700 1 -- 172.21.15.57:0/536382650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3601111d0 con 0x7fc360071f10 2024-02-28T16:03:55.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.186+0000 7fc356000700 1 -- 172.21.15.57:0/536382650 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc34c01c3f0 con 0x7fc360071f10 2024-02-28T16:03:55.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.186+0000 7fc364a00700 1 -- 172.21.15.57:0/536382650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc360111710 con 0x7fc360071f10 2024-02-28T16:03:55.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.187+0000 7fc364a00700 1 -- 172.21.15.57:0/536382650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36004bed0 con 0x7fc360071f10 2024-02-28T16:03:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.189+0000 7fc356000700 1 -- 172.21.15.57:0/536382650 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 31) v1 ==== 91301+0+0 (secure 0 0 0) 0x7fc34c013420 con 0x7fc360071f10 2024-02-28T16:03:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.190+0000 7fc356000700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fc34406d200 0x7fc34406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.190+0000 7fc356000700 1 -- 172.21.15.57:0/536382650 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fc34c08db50 con 0x7fc360071f10 2024-02-28T16:03:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.190+0000 7fc35de00700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fc34406d200 0x7fc34406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.191+0000 7fc35de00700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fc34406d200 0x7fc34406f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc350007fd0 tx=0x7fc350009040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:55.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.198+0000 7fc356000700 1 -- 172.21.15.57:0/536382650 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc34c05b4c0 con 0x7fc360071f10 2024-02-28T16:03:55.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.570+0000 7fc364a00700 1 -- 172.21.15.57:0/536382650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc360107c10 con 0x7fc360071f10 2024-02-28T16:03:55.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.570+0000 7fc356000700 1 -- 172.21.15.57:0/536382650 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1859 (secure 0 0 0) 0x7fc34c05b050 con 0x7fc360071f10 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:e16 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 16 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:02:07.353165+0000 2024-02-28T16:03:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:03:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:03:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:03:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.573+0000 7fc364a00700 1 -- 172.21.15.57:0/536382650 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fc34406d200 msgr2=0x7fc34406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.573+0000 7fc364a00700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fc34406d200 0x7fc34406f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc350007fd0 tx=0x7fc350009040 comp rx=0 tx=0).stop 2024-02-28T16:03:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.573+0000 7fc364a00700 1 -- 172.21.15.57:0/536382650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc360071f10 msgr2=0x7fc3601100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.573+0000 7fc364a00700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc360071f10 0x7fc3601100b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc34c000c00 tx=0x7fc34c009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.574+0000 7fc364a00700 1 -- 172.21.15.57:0/536382650 shutdown_connections 2024-02-28T16:03:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.574+0000 7fc364a00700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fc34406d200 0x7fc34406f6b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.574+0000 7fc364a00700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3600708c0 0x7fc36010fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.574+0000 7fc364a00700 1 --2- 172.21.15.57:0/536382650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc360071f10 0x7fc3601100b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.574+0000 7fc364a00700 1 -- 172.21.15.57:0/536382650 >> 172.21.15.57:0/536382650 conn(0x7fc3600f8620 msgr2=0x7fc360102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:55.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.574+0000 7fc364a00700 1 -- 172.21.15.57:0/536382650 shutdown_connections 2024-02-28T16:03:55.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.574+0000 7fc364a00700 1 -- 172.21.15.57:0/536382650 wait complete. 2024-02-28T16:03:55.568 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2024-02-28T16:03:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.777+0000 7f5a9ce00700 1 -- 172.21.15.57:0/2617397966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980fe1e0 msgr2=0x7f5a98100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.777+0000 7f5a9ce00700 1 --2- 172.21.15.57:0/2617397966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980fe1e0 0x7f5a98100660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5a88004880 tx=0x7f5a88009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:55.770 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:55 smithi057 ceph-mon[28763]: pgmap v24: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 367 op/s 2024-02-28T16:03:55.770 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:55 smithi057 ceph-mon[28763]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:55.770 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:55 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/529407307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:03:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.777+0000 7f5a9ce00700 1 -- 172.21.15.57:0/2617397966 shutdown_connections 2024-02-28T16:03:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.777+0000 7f5a9ce00700 1 --2- 172.21.15.57:0/2617397966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980fe1e0 0x7f5a98100660 secure :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5a88004880 tx=0x7f5a88009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.777+0000 7f5a9ce00700 1 --2- 172.21.15.57:0/2617397966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980fb880 0x7f5a980fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.777+0000 7f5a9ce00700 1 -- 172.21.15.57:0/2617397966 >> 172.21.15.57:0/2617397966 conn(0x7f5a980f7510 msgr2=0x7f5a980f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:55.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.779+0000 7f5a9ce00700 1 -- 172.21.15.57:0/2617397966 shutdown_connections 2024-02-28T16:03:55.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.779+0000 7f5a9ce00700 1 -- 172.21.15.57:0/2617397966 wait complete. 2024-02-28T16:03:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.780+0000 7f5a9ce00700 1 Processor -- start 2024-02-28T16:03:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.780+0000 7f5a9ce00700 1 -- start start 2024-02-28T16:03:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.782+0000 7f5a9ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980fb880 0x7f5a981140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.782+0000 7f5a9ce00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a98114600 0x7f5a981154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.782+0000 7f5a9ce00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98114ac0 con 0x7f5a98114600 2024-02-28T16:03:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.782+0000 7f5a9ce00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98114c00 con 0x7f5a980fb880 2024-02-28T16:03:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.783+0000 7f5a95e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980fb880 0x7f5a981140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.783+0000 7f5a95e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980fb880 0x7f5a981140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:38018/0 (socket says 172.21.15.57:38018) 2024-02-28T16:03:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.783+0000 7f5a95e00700 1 -- 172.21.15.57:0/1934547729 learned_addr learned my addr 172.21.15.57:0/1934547729 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.783+0000 7f5a95400700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a98114600 0x7f5a981154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.784+0000 7f5a95e00700 1 -- 172.21.15.57:0/1934547729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a98114600 msgr2=0x7f5a981154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.784+0000 7f5a95e00700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a98114600 0x7f5a981154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.784+0000 7f5a95e00700 1 -- 172.21.15.57:0/1934547729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a84005040 con 0x7f5a980fb880 2024-02-28T16:03:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.785+0000 7f5a95e00700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980fb880 0x7f5a981140c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a840096b0 tx=0x7f5a84009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.786+0000 7f5a8e000700 1 -- 172.21.15.57:0/1934547729 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a84017070 con 0x7f5a980fb880 2024-02-28T16:03:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.786+0000 7f5a9ce00700 1 -- 172.21.15.57:0/1934547729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a88005040 con 0x7f5a980fb880 2024-02-28T16:03:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.786+0000 7f5a9ce00700 1 -- 172.21.15.57:0/1934547729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a98115e20 con 0x7f5a980fb880 2024-02-28T16:03:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.787+0000 7f5a8e000700 1 -- 172.21.15.57:0/1934547729 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a8400f040 con 0x7f5a980fb880 2024-02-28T16:03:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.787+0000 7f5a8e000700 1 -- 172.21.15.57:0/1934547729 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a84013be0 con 0x7f5a980fb880 2024-02-28T16:03:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.790+0000 7f5a9ce00700 1 -- 172.21.15.57:0/1934547729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a780052e0 con 0x7f5a980fb880 2024-02-28T16:03:55.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.791+0000 7f5a8e000700 1 -- 172.21.15.57:0/1934547729 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 31) v1 ==== 91301+0+0 (secure 0 0 0) 0x7f5a8401c410 con 0x7f5a980fb880 2024-02-28T16:03:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.793+0000 7f5a8e000700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f5a7c06d2d0 0x7f5a7c06f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:55.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.793+0000 7f5a8e000700 1 -- 172.21.15.57:0/1934547729 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f5a8408c580 con 0x7f5a980fb880 2024-02-28T16:03:55.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.794+0000 7f5a95400700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f5a7c06d2d0 0x7f5a7c06f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:55.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.796+0000 7f5a95400700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f5a7c06d2d0 0x7f5a7c06f780 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009fd0 tx=0x7f5a88009e30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:55.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:55.801+0000 7f5a8e000700 1 -- 172.21.15.57:0/1934547729 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5a84059f70 con 0x7f5a980fb880 2024-02-28T16:03:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:55 smithi087 ceph-mon[37122]: pgmap v24: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 367 op/s 2024-02-28T16:03:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:55 smithi087 ceph-mon[37122]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:55 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/529407307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:03:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.109+0000 7f5a9ce00700 1 -- 172.21.15.57:0/1934547729 --> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a78000bf0 con 0x7f5a7c06d2d0 2024-02-28T16:03:56.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.111+0000 7f5a8e000700 1 -- 172.21.15.57:0/1934547729 <== mgr.14742 v2:172.21.15.57:6800/3297260515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f5a78000bf0 con 0x7f5a7c06d2d0 2024-02-28T16:03:56.108 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:03:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:03:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:03:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:03:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:03:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr" 2024-02-28T16:03:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:03:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "2/21 daemons upgraded", 2024-02-28T16:03:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T16:03:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:03:56.109 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:03:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.114+0000 7f5a9ce00700 1 -- 172.21.15.57:0/1934547729 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f5a7c06d2d0 msgr2=0x7f5a7c06f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.114+0000 7f5a9ce00700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f5a7c06d2d0 0x7f5a7c06f780 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009fd0 tx=0x7f5a88009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.114+0000 7f5a9ce00700 1 -- 172.21.15.57:0/1934547729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980fb880 msgr2=0x7f5a981140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.114+0000 7f5a9ce00700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980fb880 0x7f5a981140c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a840096b0 tx=0x7f5a84009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.114+0000 7f5a9ce00700 1 -- 172.21.15.57:0/1934547729 shutdown_connections 2024-02-28T16:03:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.114+0000 7f5a9ce00700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7f5a7c06d2d0 0x7f5a7c06f780 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.114+0000 7f5a9ce00700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980fb880 0x7f5a981140c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.114+0000 7f5a9ce00700 1 --2- 172.21.15.57:0/1934547729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a98114600 0x7f5a981154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.114+0000 7f5a9ce00700 1 -- 172.21.15.57:0/1934547729 >> 172.21.15.57:0/1934547729 conn(0x7f5a980f7510 msgr2=0x7f5a980f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.115+0000 7f5a9ce00700 1 -- 172.21.15.57:0/1934547729 shutdown_connections 2024-02-28T16:03:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.115+0000 7f5a9ce00700 1 -- 172.21.15.57:0/1934547729 wait complete. 2024-02-28T16:03:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.276+0000 7fb293200700 1 -- 172.21.15.57:0/3664109807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb28c0fb870 msgr2=0x7fb28c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.276+0000 7fb293200700 1 --2- 172.21.15.57:0/3664109807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb28c0fb870 0x7fb28c0fdc90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb27c004940 tx=0x7fb27c009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.276+0000 7fb293200700 1 -- 172.21.15.57:0/3664109807 shutdown_connections 2024-02-28T16:03:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.276+0000 7fb293200700 1 --2- 172.21.15.57:0/3664109807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28c0fe1d0 0x7fb28c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.276+0000 7fb293200700 1 --2- 172.21.15.57:0/3664109807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb28c0fb870 0x7fb28c0fdc90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.276+0000 7fb293200700 1 -- 172.21.15.57:0/3664109807 >> 172.21.15.57:0/3664109807 conn(0x7fb28c0f74e0 msgr2=0x7fb28c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.276+0000 7fb293200700 1 -- 172.21.15.57:0/3664109807 shutdown_connections 2024-02-28T16:03:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.276+0000 7fb293200700 1 -- 172.21.15.57:0/3664109807 wait complete. 2024-02-28T16:03:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.277+0000 7fb293200700 1 Processor -- start 2024-02-28T16:03:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.277+0000 7fb293200700 1 -- start start 2024-02-28T16:03:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.278+0000 7fb293200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28c0fb870 0x7fb28c113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.278+0000 7fb293200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb28c0fe1d0 0x7fb28c114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.278+0000 7fb293200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c114a90 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.278+0000 7fb293200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c115330 con 0x7fb28c0fb870 2024-02-28T16:03:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.278+0000 7fb28b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb28c0fe1d0 0x7fb28c114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.278+0000 7fb28b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb28c0fe1d0 0x7fb28c114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46182/0 (socket says 172.21.15.57:46182) 2024-02-28T16:03:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.278+0000 7fb28b400700 1 -- 172.21.15.57:0/2071371396 learned_addr learned my addr 172.21.15.57:0/2071371396 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:03:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.278+0000 7fb28be00700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28c0fb870 0x7fb28c113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.279+0000 7fb28b400700 1 -- 172.21.15.57:0/2071371396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28c0fb870 msgr2=0x7fb28c113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.279+0000 7fb28b400700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28c0fb870 0x7fb28c113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.279+0000 7fb28b400700 1 -- 172.21.15.57:0/2071371396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c005040 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.279+0000 7fb28b400700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb28c0fe1d0 0x7fb28c114490 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb278002a50 tx=0x7fb2780046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.279+0000 7fb283e00700 1 -- 172.21.15.57:0/2071371396 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb278007cc0 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.279+0000 7fb293200700 1 -- 172.21.15.57:0/2071371396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28c115610 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.279+0000 7fb283e00700 1 -- 172.21.15.57:0/2071371396 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb27800f040 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.280+0000 7fb283e00700 1 -- 172.21.15.57:0/2071371396 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb27800da30 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.280+0000 7fb293200700 1 -- 172.21.15.57:0/2071371396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c115b50 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.281+0000 7fb293200700 1 -- 172.21.15.57:0/2071371396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c0052e0 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.282+0000 7fb283e00700 1 -- 172.21.15.57:0/2071371396 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 31) v1 ==== 91301+0+0 (secure 0 0 0) 0x7fb27800db90 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.284+0000 7fb283e00700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fb27006d200 0x7fb27006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:03:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.284+0000 7fb283e00700 1 -- 172.21.15.57:0/2071371396 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb27808c3d0 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.284+0000 7fb28be00700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fb27006d200 0x7fb27006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:03:56.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.285+0000 7fb28be00700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fb27006d200 0x7fb27006f6b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0043d0 tx=0x7fb27c009e30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:03:56.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.289+0000 7fb283e00700 1 -- 172.21.15.57:0/2071371396 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb278059e60 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:56 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/536382650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:03:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.783+0000 7fb293200700 1 -- 172.21.15.57:0/2071371396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb26c005860 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.776 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:56 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/536382650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:03:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.783+0000 7fb283e00700 1 -- 172.21.15.57:0/2071371396 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb2780599f0 con 0x7fb28c0fe1d0 2024-02-28T16:03:56.777 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:03:56.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.786+0000 7fb293200700 1 -- 172.21.15.57:0/2071371396 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fb27006d200 msgr2=0x7fb27006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:56.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.786+0000 7fb293200700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fb27006d200 0x7fb27006f6b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0043d0 tx=0x7fb27c009e30 comp rx=0 tx=0).stop 2024-02-28T16:03:56.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.786+0000 7fb293200700 1 -- 172.21.15.57:0/2071371396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb28c0fe1d0 msgr2=0x7fb28c114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:03:56.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.786+0000 7fb293200700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb28c0fe1d0 0x7fb28c114490 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb278002a50 tx=0x7fb2780046b0 comp rx=0 tx=0).stop 2024-02-28T16:03:56.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.787+0000 7fb293200700 1 -- 172.21.15.57:0/2071371396 shutdown_connections 2024-02-28T16:03:56.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.787+0000 7fb293200700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fb27006d200 0x7fb27006f6b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:56.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.787+0000 7fb293200700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28c0fb870 0x7fb28c113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:56.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.787+0000 7fb293200700 1 --2- 172.21.15.57:0/2071371396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb28c0fe1d0 0x7fb28c114490 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:03:56.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.787+0000 7fb293200700 1 -- 172.21.15.57:0/2071371396 >> 172.21.15.57:0/2071371396 conn(0x7fb28c0f74e0 msgr2=0x7fb28c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:03:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.787+0000 7fb293200700 1 -- 172.21.15.57:0/2071371396 shutdown_connections 2024-02-28T16:03:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:03:56.787+0000 7fb293200700 1 -- 172.21.15.57:0/2071371396 wait complete. 2024-02-28T16:03:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:57 smithi057 ceph-mon[28763]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:57 smithi057 ceph-mon[28763]: pgmap v25: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 911 KiB/s rd, 930 KiB/s wr, 254 op/s 2024-02-28T16:03:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:57 smithi057 ceph-mon[28763]: from='client.? 172.21.15.57:0/2071371396' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:03:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:57 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:03:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:57 smithi087 ceph-mon[37122]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:03:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:57 smithi087 ceph-mon[37122]: pgmap v25: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 911 KiB/s rd, 930 KiB/s wr, 254 op/s 2024-02-28T16:03:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:57 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/2071371396' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:03:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:57 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:03:58.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:58 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:58.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:58 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:58.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:58 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:03:59.020 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-28T16:03:59.021 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-28T16:03:59.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:58 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:59.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:58 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:03:59.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:58 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:03:59.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:03:59 smithi087 ceph-mon[37122]: pgmap v26: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 298 op/s 2024-02-28T16:03:59.976 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:03:59 smithi057 ceph-mon[28763]: pgmap v26: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 298 op/s 2024-02-28T16:04:00.252 DEBUG:teuthology.parallel:result is None 2024-02-28T16:04:02.141 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:01 smithi057 ceph-mon[28763]: pgmap v27: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 392 op/s 2024-02-28T16:04:02.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:01 smithi087 ceph-mon[37122]: pgmap v27: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 392 op/s 2024-02-28T16:04:03.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:03 smithi087 ceph-mon[37122]: pgmap v28: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 941 KiB/s rd, 976 KiB/s wr, 262 op/s 2024-02-28T16:04:03.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:03 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:03.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:03 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:04.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:03 smithi057 ceph-mon[28763]: pgmap v28: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 941 KiB/s rd, 976 KiB/s wr, 262 op/s 2024-02-28T16:04:04.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:03 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:04.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:03 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:06.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:05 smithi057 ceph-mon[28763]: pgmap v29: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 377 op/s 2024-02-28T16:04:06.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:05 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:06.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:05 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:06.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:05 smithi087 ceph-mon[37122]: pgmap v29: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 377 op/s 2024-02-28T16:04:06.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:05 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:06.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:05 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:08.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:07 smithi057 ceph-mon[28763]: pgmap v30: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 751 KiB/s rd, 781 KiB/s wr, 252 op/s 2024-02-28T16:04:08.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:07 smithi087 ceph-mon[37122]: pgmap v30: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 751 KiB/s rd, 781 KiB/s wr, 252 op/s 2024-02-28T16:04:08.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:08 smithi057 ceph-mon[28763]: Standby manager daemon smithi087.ewrszc restarted 2024-02-28T16:04:08.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:08 smithi057 ceph-mon[28763]: Standby manager daemon smithi087.ewrszc started 2024-02-28T16:04:08.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:08 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/1019649690' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/crt"}]: dispatch 2024-02-28T16:04:08.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:08 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/1019649690' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:04:08.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:08 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/1019649690' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/key"}]: dispatch 2024-02-28T16:04:08.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:08 smithi057 ceph-mon[28763]: from='mgr.? 172.21.15.87:0/1019649690' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:04:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:08 smithi087 ceph-mon[37122]: Standby manager daemon smithi087.ewrszc restarted 2024-02-28T16:04:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:08 smithi087 ceph-mon[37122]: Standby manager daemon smithi087.ewrszc started 2024-02-28T16:04:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:08 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/1019649690' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/crt"}]: dispatch 2024-02-28T16:04:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:08 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/1019649690' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:04:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:08 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/1019649690' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/key"}]: dispatch 2024-02-28T16:04:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:08 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/1019649690' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:04:10.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:09 smithi057 ceph-mon[28763]: pgmap v31: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 751 KiB/s rd, 781 KiB/s wr, 268 op/s 2024-02-28T16:04:10.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:09 smithi057 ceph-mon[28763]: mgrmap e32: smithi057.upqerc(active, since 56s), standbys: smithi087.ewrszc 2024-02-28T16:04:10.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:09 smithi087 ceph-mon[37122]: pgmap v31: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 751 KiB/s rd, 781 KiB/s wr, 268 op/s 2024-02-28T16:04:10.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:09 smithi087 ceph-mon[37122]: mgrmap e32: smithi057.upqerc(active, since 56s), standbys: smithi087.ewrszc 2024-02-28T16:04:11.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:11 smithi057 ceph-mon[28763]: pgmap v32: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 680 KiB/s rd, 703 KiB/s wr, 270 op/s 2024-02-28T16:04:11.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:11 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:11.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:11 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:11.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:11 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:11.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:11 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:11.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:11 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:04:11.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:11 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:04:11.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:11 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:11.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:11 smithi087 ceph-mon[37122]: pgmap v32: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 680 KiB/s rd, 703 KiB/s wr, 270 op/s 2024-02-28T16:04:11.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:11 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:11.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:11 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:11.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:11 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:11.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:11 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:11.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:11 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:04:11.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:11 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:04:11.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:11 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:12.594 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:04:12.594 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:04:12.594 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: Upgrade: Setting container_image for all mgr 2024-02-28T16:04:12.594 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:12.595 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi057.upqerc"}]: dispatch 2024-02-28T16:04:12.595 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi057.upqerc"}]: dispatch 2024-02-28T16:04:12.595 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi057.upqerc"}]': finished 2024-02-28T16:04:12.595 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi087.ewrszc"}]: dispatch 2024-02-28T16:04:12.595 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi087.ewrszc"}]: dispatch 2024-02-28T16:04:12.595 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi087.ewrszc"}]': finished 2024-02-28T16:04:12.595 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:04:12.595 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:12 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:04:12.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: Upgrade: Setting container_image for all mgr 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi057.upqerc"}]: dispatch 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi057.upqerc"}]: dispatch 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi057.upqerc"}]': finished 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi087.ewrszc"}]: dispatch 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi087.ewrszc"}]: dispatch 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi087.ewrszc"}]': finished 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:04:12.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:12 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:04:13.866 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:13 smithi057 ceph-mon[28763]: pgmap v33: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 480 KiB/s rd, 458 KiB/s wr, 177 op/s 2024-02-28T16:04:13.869 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-28T16:04:13.869 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-28T16:04:13.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:13 smithi087 ceph-mon[37122]: pgmap v33: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 480 KiB/s rd, 458 KiB/s wr, 177 op/s 2024-02-28T16:04:15.103 DEBUG:teuthology.parallel:result is None 2024-02-28T16:04:15.104 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-28T16:04:15.192 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-28T16:04:15.193 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-28T16:04:15.298 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-28T16:04:15.298 DEBUG:teuthology.parallel:result is None 2024-02-28T16:04:15.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:15 smithi057 ceph-mon[28763]: pgmap v34: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 727 KiB/s rd, 702 KiB/s wr, 235 op/s 2024-02-28T16:04:15.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:15 smithi057 ceph-mon[28763]: Upgrade: Updating mon.smithi057 2024-02-28T16:04:15.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:15 smithi057 ceph-mon[28763]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:15.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:15 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:04:15.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:15 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:04:15.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:15 smithi057 ceph-mon[28763]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:04:15.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:15 smithi057 ceph-mon[28763]: Deploying daemon mon.smithi057 on smithi057 2024-02-28T16:04:15.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:15 smithi087 ceph-mon[37122]: pgmap v34: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 727 KiB/s rd, 702 KiB/s wr, 235 op/s 2024-02-28T16:04:15.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:15 smithi087 ceph-mon[37122]: Upgrade: Updating mon.smithi057 2024-02-28T16:04:15.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:15 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:15 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:04:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:15 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:04:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:15 smithi087 ceph-mon[37122]: from='mgr.14742 172.21.15.57:0/3651852193' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:04:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:15 smithi087 ceph-mon[37122]: Deploying daemon mon.smithi057 on smithi057 2024-02-28T16:04:17.444 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:17 smithi057 systemd[1]: Stopping Ceph mon.smithi057 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:04:17.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:17 smithi087 ceph-mon[37122]: pgmap v35: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 433 KiB/s rd, 430 KiB/s wr, 120 op/s 2024-02-28T16:04:17.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:17 smithi057 ceph-mon[28763]: pgmap v35: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 433 KiB/s rd, 430 KiB/s wr, 120 op/s 2024-02-28T16:04:17.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:17 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057[28759]: 2024-02-28T16:04:17.626+0000 7fd227000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi057 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:04:17.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:17 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057[28759]: 2024-02-28T16:04:17.626+0000 7fd227000700 -1 mon.smithi057@0(leader) e2 *** Got Signal Terminated *** 2024-02-28T16:04:17.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:17 smithi057 podman[93059]: 2024-02-28 16:04:17.698519063 +0000 UTC m=+0.227660346 container died 65a85703c36b0620b7086f65f5400683baf23c8c9e5f1ff394949767d8fff145 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c0f02e6, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-28T16:04:19.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:19 smithi057 podman[93059]: 2024-02-28 16:04:19.394057798 +0000 UTC m=+1.923199104 container cleanup 65a85703c36b0620b7086f65f5400683baf23c8c9e5f1ff394949767d8fff145 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, org.label-schema.vendor=CentOS, RELEASE=quincy-c0f02e6, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-02-28T16:04:19.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:19 smithi057 bash[93059]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057 2024-02-28T16:04:19.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:19 smithi057 podman[93073]: 2024-02-28 16:04:19.586915437 +0000 UTC m=+1.874629926 container remove 65a85703c36b0620b7086f65f5400683baf23c8c9e5f1ff394949767d8fff145 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=quincy-c0f02e6, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, ceph=True) 2024-02-28T16:04:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:20 smithi057 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057.service: Deactivated successfully. 2024-02-28T16:04:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:20 smithi057 systemd[1]: Stopped Ceph mon.smithi057 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:04:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:20 smithi057 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057.service: Consumed 26.459s CPU time. 2024-02-28T16:04:20.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:20 smithi057 systemd[1]: Starting Ceph mon.smithi057 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:04:21.123 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:20 smithi057 podman[93200]: 2024-02-28 16:04:20.803568466 +0000 UTC m=+0.033220922 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:04:21.124 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:20 smithi057 podman[93200]: 2024-02-28 16:04:20.921268073 +0000 UTC m=+0.150920545 container create 90fe3fb47dc2e3657bc6faa93ce13f8882378bfb8e84d314a12b88ff59c731ea (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-28T16:04:21.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 podman[93200]: 2024-02-28 16:04:21.250608631 +0000 UTC m=+0.480261125 container init 90fe3fb47dc2e3657bc6faa93ce13f8882378bfb8e84d314a12b88ff59c731ea (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 podman[93200]: 2024-02-28 16:04:21.262674789 +0000 UTC m=+0.492327254 container start 90fe3fb47dc2e3657bc6faa93ce13f8882378bfb8e84d314a12b88ff59c731ea (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev), process ceph-mon, pid 2 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: pidfile_write: ignore empty --pid-file 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: load: jerasure load: lrc 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: RocksDB version: 7.9.2 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Git sha 0 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Compile date 2024-02-23 16:20:17 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: DB SUMMARY 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: DB Session ID: XLXG3Z6225PTW5OORICW 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: CURRENT file: CURRENT 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T16:04:21.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1165 Bytes 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi057/store.db dir, Total Num: 1, files: 000033.sst 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi057/store.db: 000031.log size: 2599895 ; 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.error_if_exists: 0 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.create_if_missing: 0 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.paranoid_checks: 1 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.env: 0x55e676535b20 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.info_log: 0x55e6788437c0 2024-02-28T16:04:21.681 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.statistics: (nil) 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.use_fsync: 0 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_log_file_size: 0 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.allow_fallocate: 1 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.use_direct_reads: 0 2024-02-28T16:04:21.682 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.db_log_dir: 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.wal_dir: 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.write_buffer_manager: 0x55e678817400 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T16:04:21.683 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.unordered_write: 0 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T16:04:21.684 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T16:04:21.685 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.row_cache: None 2024-02-28T16:04:21.685 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.wal_filter: None 2024-02-28T16:04:21.685 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T16:04:21.685 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T16:04:21.685 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.two_write_queues: 0 2024-02-28T16:04:21.685 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T16:04:21.685 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.wal_compression: 0 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.atomic_flush: 0 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.log_readahead_size: 0 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T16:04:21.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_background_jobs: 2 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_background_compactions: -1 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_subcompactions: 1 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_open_files: -1 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T16:04:21.687 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_background_flushes: -1 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Compression algorithms supported: 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: kZSTD supported: 0 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: kXpressCompression supported: 0 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: kZlibCompression supported: 1 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: kSnappyCompression supported: 1 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: kLZ4Compression supported: 1 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: kBZip2Compression supported: 0 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T16:04:21.688 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi057/store.db/MANIFEST-000015 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.merge_operator: 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_filter: None 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e6788438e0) 2024-02-28T16:04:21.689 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: cache_index_and_filter_blocks: 1 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: pin_top_level_index_and_filter: 1 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: index_type: 0 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: data_block_index_type: 0 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: index_shortening: 1 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: checksum: 4 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: no_block_cache: 0 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_cache: 0x55e678847090 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_cache_name: BinnedLRUCache 2024-02-28T16:04:21.690 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_cache_options: 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: capacity : 536870912 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: num_shard_bits : 4 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: strict_capacity_limit : 0 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: high_pri_pool_ratio: 0.000 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_cache_compressed: (nil) 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: persistent_cache: (nil) 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_size: 4096 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_size_deviation: 10 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_restart_interval: 16 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: index_block_restart_interval: 1 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: metadata_block_size: 4096 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: partition_filters: 0 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: use_delta_encoding: 1 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: filter_policy: bloomfilter 2024-02-28T16:04:21.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: whole_key_filtering: 1 2024-02-28T16:04:21.692 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: verify_compression: 0 2024-02-28T16:04:21.692 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: read_amp_bytes_per_bit: 0 2024-02-28T16:04:21.692 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: format_version: 5 2024-02-28T16:04:21.692 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: enable_index_compression: 1 2024-02-28T16:04:21.692 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: block_align: 0 2024-02-28T16:04:21.692 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: max_auto_readahead_size: 262144 2024-02-28T16:04:21.692 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: prepopulate_block_cache: 0 2024-02-28T16:04:21.692 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: initial_auto_readahead_size: 8192 2024-02-28T16:04:21.692 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T16:04:21.693 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T16:04:21.693 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T16:04:21.694 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compression: NoCompression 2024-02-28T16:04:21.694 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T16:04:21.694 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T16:04:21.694 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T16:04:21.694 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.num_levels: 7 2024-02-28T16:04:21.694 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T16:04:21.695 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T16:04:21.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T16:04:21.697 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.table_properties_collectors: 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.inplace_update_support: 0 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T16:04:21.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.bloom_locality: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.max_successive_merges: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.ttl: 2592000 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.enable_blob_files: false 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.min_blob_size: 0 2024-02-28T16:04:21.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi057/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 13483, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9ff9d74d-3e18-40bd-821f-47e14441b7b1 2024-02-28T16:04:21.700 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136261321647, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136261334641, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 2384022, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13484, "largest_seqno": 15130, "table_properties": {"data_size": 2377024, "index_size": 3929, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2053, "raw_key_size": 17073, "raw_average_key_size": 20, "raw_value_size": 2361546, "raw_average_value_size": 2883, "num_data_blocks": 180, "num_entries": 819, "num_filter_entries": 819, "num_deletions": 253, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709136261, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9ff9d74d-3e18-40bd-821f-47e14441b7b1", "db_session_id": "XLXG3Z6225PTW5OORICW", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136261334820, "job": 1, "event": "recovery_finished"} 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi057/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e678936000 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: DB pointer 0x55e678922000 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** DB Stats ** 2024-02-28T16:04:21.701 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** Compaction Stats [default] ** 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: L0 1/0 2.27 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 419.9 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: L6 1/0 5.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Sum 2/0 8.04 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 419.9 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T16:04:21.702 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 419.9 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** Compaction Stats [default] ** 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 419.9 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:04:21.703 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:04:21.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Cumulative compaction: 0.00 GB write, 107.95 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:04:21.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Interval compaction: 0.00 GB write, 107.95 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:04:21.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:04:21.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Block cache BinnedLRUCache@0x55e678847090#2 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.3e-05 secs_since: 0 2024-02-28T16:04:21.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-02-28T16:04:21.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T16:04:21.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:04:21.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: starting mon.smithi057 rank 0 at public addrs [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] at bind addrs [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi057 fsid bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T16:04:21.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: mon.smithi057@-1(???) e2 preinit fsid bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T16:04:21.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: mon.smithi057@-1(???).mds e16 new map 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: mon.smithi057@-1(???).mds e16 print_map 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: e16 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: legacy client fscid: 1 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: Filesystem 'cephfs' (1) 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: fs_name cephfs 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: epoch 16 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: modified 2024-02-28T16:02:07.353165+0000 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: tableserver 0 2024-02-28T16:04:21.705 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: root 0 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: session_timeout 60 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: session_autoclose 300 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: max_file_size 1099511627776 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: max_xattr_size 65536 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: required_client_features {} 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: last_failure 0 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: last_failure_osd_epoch 0 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: max_mds 2 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: in 0,1 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: up {0=14452,1=24281} 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: failed 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: damaged 2024-02-28T16:04:21.706 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: stopped 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: data_pools [3] 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: metadata_pool 2 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: inline_data disabled 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: balancer 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: bal_rank_mask -1 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: standby_count_wanted 1 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: [mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: [mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: [mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: [mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout: 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: mon.smithi057@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-28T16:04:21.707 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: mon.smithi057@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:04:21.708 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: mon.smithi057@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:04:21.708 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: mon.smithi057@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:04:21.708 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 ceph-mon[93219]: mon.smithi057@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-02-28T16:04:21.708 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 bash[93200]: 90fe3fb47dc2e3657bc6faa93ce13f8882378bfb8e84d314a12b88ff59c731ea 2024-02-28T16:04:21.708 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:21 smithi057 systemd[1]: Started Ceph mon.smithi057 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:04:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: pgmap v36: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 433 KiB/s rd, 430 KiB/s wr, 136 op/s 2024-02-28T16:04:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: pgmap v37: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 485 KiB/s rd, 479 KiB/s wr, 148 op/s 2024-02-28T16:04:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: pgmap v38: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 300 KiB/s rd, 293 KiB/s wr, 101 op/s 2024-02-28T16:04:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: mon.smithi057 calling monitor election 2024-02-28T16:04:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: mon.smithi057 is new leader, mons smithi057,smithi087 in quorum (ranks 0,1) 2024-02-28T16:04:24.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: monmap e2: 2 mons at {smithi057=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:04:24.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:04:24.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T16:04:24.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: mgrmap e32: smithi057.upqerc(active, since 72s), standbys: smithi087.ewrszc 2024-02-28T16:04:24.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: overall HEALTH_OK 2024-02-28T16:04:24.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: from='mgr.14742 ' entity='' 2024-02-28T16:04:24.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:24 smithi087 ceph-mon[37122]: mgrmap e33: smithi057.upqerc(active, since 72s), standbys: smithi087.ewrszc 2024-02-28T16:04:24.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: pgmap v36: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 433 KiB/s rd, 430 KiB/s wr, 136 op/s 2024-02-28T16:04:24.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: pgmap v37: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 485 KiB/s rd, 479 KiB/s wr, 148 op/s 2024-02-28T16:04:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: pgmap v38: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 300 KiB/s rd, 293 KiB/s wr, 101 op/s 2024-02-28T16:04:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: mon.smithi057 calling monitor election 2024-02-28T16:04:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: mon.smithi057 is new leader, mons smithi057,smithi087 in quorum (ranks 0,1) 2024-02-28T16:04:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: monmap e2: 2 mons at {smithi057=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:04:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:04:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T16:04:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: mgrmap e32: smithi057.upqerc(active, since 72s), standbys: smithi087.ewrszc 2024-02-28T16:04:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: overall HEALTH_OK 2024-02-28T16:04:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: from='mgr.14742 ' entity='' 2024-02-28T16:04:24.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:24 smithi057 ceph-mon[93219]: mgrmap e33: smithi057.upqerc(active, since 72s), standbys: smithi087.ewrszc 2024-02-28T16:04:26.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.961+0000 7fbb73800700 1 -- 172.21.15.57:0/829080242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c100360 msgr2=0x7fbb6c1007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.961+0000 7fbb73800700 1 --2- 172.21.15.57:0/829080242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c100360 0x7fbb6c1007b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbb58004940 tx=0x7fbb58009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.961+0000 7fbb73800700 1 -- 172.21.15.57:0/829080242 shutdown_connections 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.961+0000 7fbb73800700 1 --2- 172.21.15.57:0/829080242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c100360 0x7fbb6c1007b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.961+0000 7fbb73800700 1 --2- 172.21.15.57:0/829080242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb6c0ff150 0x7fbb6c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.961+0000 7fbb73800700 1 -- 172.21.15.57:0/829080242 >> 172.21.15.57:0/829080242 conn(0x7fbb6c0fa920 msgr2=0x7fbb6c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.962+0000 7fbb73800700 1 -- 172.21.15.57:0/829080242 shutdown_connections 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.962+0000 7fbb73800700 1 -- 172.21.15.57:0/829080242 wait complete. 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.962+0000 7fbb73800700 1 Processor -- start 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.963+0000 7fbb73800700 1 -- start start 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.963+0000 7fbb73800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0ff150 0x7fbb6c10fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.963+0000 7fbb73800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb6c100360 0x7fbb6c110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:26.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.963+0000 7fbb73800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c110730 con 0x7fbb6c0ff150 2024-02-28T16:04:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.963+0000 7fbb73800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c110fd0 con 0x7fbb6c100360 2024-02-28T16:04:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.963+0000 7fbb70e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0ff150 0x7fbb6c10fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.963+0000 7fbb70e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0ff150 0x7fbb6c10fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37368/0 (socket says 172.21.15.57:37368) 2024-02-28T16:04:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.963+0000 7fbb70e00700 1 -- 172.21.15.57:0/1296907281 learned_addr learned my addr 172.21.15.57:0/1296907281 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:04:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.964+0000 7fbb6be00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb6c100360 0x7fbb6c110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.964+0000 7fbb70e00700 1 -- 172.21.15.57:0/1296907281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb6c100360 msgr2=0x7fbb6c110130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.964+0000 7fbb70e00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb6c100360 0x7fbb6c110130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.964+0000 7fbb70e00700 1 -- 172.21.15.57:0/1296907281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58005040 con 0x7fbb6c0ff150 2024-02-28T16:04:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.964+0000 7fbb70e00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0ff150 0x7fbb6c10fbf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbb60002a80 tx=0x7fbb60004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.964+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb60007cc0 con 0x7fbb6c0ff150 2024-02-28T16:04:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.964+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb6000f040 con 0x7fbb6c0ff150 2024-02-28T16:04:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.964+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb6000dad0 con 0x7fbb6c0ff150 2024-02-28T16:04:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.964+0000 7fbb73800700 1 -- 172.21.15.57:0/1296907281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6c1112b0 con 0x7fbb6c0ff150 2024-02-28T16:04:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.965+0000 7fbb73800700 1 -- 172.21.15.57:0/1296907281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6c1117f0 con 0x7fbb6c0ff150 2024-02-28T16:04:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.966+0000 7fbb73800700 1 -- 172.21.15.57:0/1296907281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6c04bed0 con 0x7fbb6c0ff150 2024-02-28T16:04:26.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.968+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 33) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fbb6000dc30 con 0x7fbb6c0ff150 2024-02-28T16:04:26.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.969+0000 7fbb68c00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 0x7fbb5406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:26.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.969+0000 7fbb6be00700 1 -- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 msgr2=0x7fbb5406fdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3297260515 2024-02-28T16:04:26.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.969+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fbb6008cce0 con 0x7fbb6c0ff150 2024-02-28T16:04:26.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.969+0000 7fbb6be00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 0x7fbb5406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:04:26.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:26.975+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbb60059fd0 con 0x7fbb6c0ff150 2024-02-28T16:04:27.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:27.170+0000 7fbb6be00700 1 -- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 msgr2=0x7fbb5406fdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3297260515 2024-02-28T16:04:27.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:27.170+0000 7fbb6be00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 0x7fbb5406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:04:27.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:27.214+0000 7fbb73800700 1 -- 172.21.15.57:0/1296907281 --> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb6c104cb0 con 0x7fbb5406d900 2024-02-28T16:04:27.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:27.571+0000 7fbb6be00700 1 -- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 msgr2=0x7fbb5406fdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3297260515 2024-02-28T16:04:27.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:27.571+0000 7fbb6be00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 0x7fbb5406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-28T16:04:28.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:28.372+0000 7fbb6be00700 1 -- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 msgr2=0x7fbb5406fdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3297260515 2024-02-28T16:04:28.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:28.372+0000 7fbb6be00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 0x7fbb5406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-28T16:04:29.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:29.973+0000 7fbb6be00700 1 -- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 msgr2=0x7fbb5406fdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3297260515 2024-02-28T16:04:29.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:29.973+0000 7fbb6be00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 0x7fbb5406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-28T16:04:33.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:33.177+0000 7fbb6be00700 1 -- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 msgr2=0x7fbb5406fdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3297260515 2024-02-28T16:04:33.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:33.177+0000 7fbb6be00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 0x7fbb5406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-28T16:04:33.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:33.306+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 34) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fbb60011d60 con 0x7fbb6c0ff150 2024-02-28T16:04:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:33 smithi057 ceph-mon[93219]: Standby manager daemon smithi087.ewrszc restarted 2024-02-28T16:04:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:33 smithi057 ceph-mon[93219]: Standby manager daemon smithi087.ewrszc started 2024-02-28T16:04:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:33 smithi057 ceph-mon[93219]: from='mgr.? 172.21.15.87:0/2180558532' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/crt"}]: dispatch 2024-02-28T16:04:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:33 smithi057 ceph-mon[93219]: from='mgr.? 172.21.15.87:0/2180558532' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:04:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:33 smithi057 ceph-mon[93219]: from='mgr.? 172.21.15.87:0/2180558532' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/key"}]: dispatch 2024-02-28T16:04:33.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:33 smithi057 ceph-mon[93219]: from='mgr.? 172.21.15.87:0/2180558532' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:04:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:33.682+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mgrmap(e 35) v1 ==== 91110+0+0 (secure 0 0 0) 0x7fbb60056870 con 0x7fbb6c0ff150 2024-02-28T16:04:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:33.683+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 msgr2=0x7fbb5406fdb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:04:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:33.683+0000 7fbb68c00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 0x7fbb5406fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:33.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:33 smithi087 ceph-mon[37122]: Standby manager daemon smithi087.ewrszc restarted 2024-02-28T16:04:33.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:33 smithi087 ceph-mon[37122]: Standby manager daemon smithi087.ewrszc started 2024-02-28T16:04:33.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:33 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2180558532' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/crt"}]: dispatch 2024-02-28T16:04:33.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:33 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2180558532' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:04:33.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:33 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2180558532' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.ewrszc/key"}]: dispatch 2024-02-28T16:04:33.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:33 smithi087 ceph-mon[37122]: from='mgr.? 172.21.15.87:0/2180558532' entity='mgr.smithi087.ewrszc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:04:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: mgrmap e34: smithi057.upqerc(active, since 81s), standbys: smithi087.ewrszc 2024-02-28T16:04:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: Active manager daemon smithi057.upqerc restarted 2024-02-28T16:04:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: Activating manager daemon smithi057.upqerc 2024-02-28T16:04:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:04:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: mgrmap e35: smithi057.upqerc(active, starting, since 0.0149557s), standbys: smithi087.ewrszc 2024-02-28T16:04:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T16:04:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi087.ewrszc", "id": "smithi087.ewrszc"}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:04:34.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:04:34.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: Manager daemon smithi057.upqerc is now available 2024-02-28T16:04:34.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:04:34.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:04:34.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:04:34.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:04:34.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T16:04:34.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.693+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 <== mon.0 v2:172.21.15.57:3300/0 9 ==== mgrmap(e 36) v1 ==== 91237+0+0 (secure 0 0 0) 0x7fbb60057140 con 0x7fbb6c0ff150 2024-02-28T16:04:34.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.694+0000 7fbb68c00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbb540288e0 0x7fbb54028cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:34.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.695+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb6c104cb0 con 0x7fbb540288e0 2024-02-28T16:04:34.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.695+0000 7fbb6be00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbb540288e0 0x7fbb54028cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:34.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.698+0000 7fbb6be00700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbb540288e0 0x7fbb54028cb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbb58000c00 tx=0x7fbb58009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:34.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.705+0000 7fbb68c00700 1 -- 172.21.15.57:0/1296907281 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fbb6c104cb0 con 0x7fbb540288e0 2024-02-28T16:04:34.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.710+0000 7fbb73800700 1 -- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbb540288e0 msgr2=0x7fbb54028cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:34.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.710+0000 7fbb73800700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbb540288e0 0x7fbb54028cb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbb58000c00 tx=0x7fbb58009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:34.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.710+0000 7fbb73800700 1 -- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0ff150 msgr2=0x7fbb6c10fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:34.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.710+0000 7fbb73800700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0ff150 0x7fbb6c10fbf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbb60002a80 tx=0x7fbb60004600 comp rx=0 tx=0).stop 2024-02-28T16:04:34.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.711+0000 7fbb73800700 1 -- 172.21.15.57:0/1296907281 shutdown_connections 2024-02-28T16:04:34.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.711+0000 7fbb73800700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbb540288e0 0x7fbb54028cb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:34.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.711+0000 7fbb73800700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:6800/3297260515,v1:172.21.15.57:6801/3297260515] conn(0x7fbb5406d900 0x7fbb5406fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:34.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.711+0000 7fbb73800700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0ff150 0x7fbb6c10fbf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:34.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.711+0000 7fbb73800700 1 --2- 172.21.15.57:0/1296907281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb6c100360 0x7fbb6c110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:34.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.711+0000 7fbb73800700 1 -- 172.21.15.57:0/1296907281 >> 172.21.15.57:0/1296907281 conn(0x7fbb6c0fa920 msgr2=0x7fbb6c103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:34.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.711+0000 7fbb73800700 1 -- 172.21.15.57:0/1296907281 shutdown_connections 2024-02-28T16:04:34.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.712+0000 7fbb73800700 1 -- 172.21.15.57:0/1296907281 wait complete. 2024-02-28T16:04:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: mgrmap e34: smithi057.upqerc(active, since 81s), standbys: smithi087.ewrszc 2024-02-28T16:04:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: Active manager daemon smithi057.upqerc restarted 2024-02-28T16:04:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: Activating manager daemon smithi057.upqerc 2024-02-28T16:04:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:04:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: mgrmap e35: smithi057.upqerc(active, starting, since 0.0149557s), standbys: smithi087.ewrszc 2024-02-28T16:04:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T16:04:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T16:04:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:04:34.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi057.upqerc", "id": "smithi057.upqerc"}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr metadata", "who": "smithi087.ewrszc", "id": "smithi087.ewrszc"}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:04:34.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:04:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: Manager daemon smithi057.upqerc is now available 2024-02-28T16:04:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:04:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:04:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:04:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:04:34.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:34 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi057.upqerc/trash_purge_schedule"}]: dispatch 2024-02-28T16:04:34.720 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:04:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.865+0000 7fe700e00700 1 -- 172.21.15.57:0/1600286866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc100380 msgr2=0x7fe6fc1007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.865+0000 7fe700e00700 1 --2- 172.21.15.57:0/1600286866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc100380 0x7fe6fc1007d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8004940 tx=0x7fe6e8009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.865+0000 7fe700e00700 1 -- 172.21.15.57:0/1600286866 shutdown_connections 2024-02-28T16:04:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.865+0000 7fe700e00700 1 --2- 172.21.15.57:0/1600286866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc100380 0x7fe6fc1007d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.865+0000 7fe700e00700 1 --2- 172.21.15.57:0/1600286866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ff170 0x7fe6fc0ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.865+0000 7fe700e00700 1 -- 172.21.15.57:0/1600286866 >> 172.21.15.57:0/1600286866 conn(0x7fe6fc0fa920 msgr2=0x7fe6fc0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.865+0000 7fe700e00700 1 -- 172.21.15.57:0/1600286866 shutdown_connections 2024-02-28T16:04:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.865+0000 7fe700e00700 1 -- 172.21.15.57:0/1600286866 wait complete. 2024-02-28T16:04:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.866+0000 7fe700e00700 1 Processor -- start 2024-02-28T16:04:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.866+0000 7fe700e00700 1 -- start start 2024-02-28T16:04:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.866+0000 7fe700e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ff170 0x7fe6fc10fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.866+0000 7fe700e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc100380 0x7fe6fc110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.866+0000 7fe700e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc110650 con 0x7fe6fc100380 2024-02-28T16:04:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.866+0000 7fe700e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc110ef0 con 0x7fe6fc0ff170 2024-02-28T16:04:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.867+0000 7fe6f9e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ff170 0x7fe6fc10fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.867+0000 7fe6f9e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ff170 0x7fe6fc10fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:56700/0 (socket says 172.21.15.57:56700) 2024-02-28T16:04:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.867+0000 7fe6f9e00700 1 -- 172.21.15.57:0/3436540266 learned_addr learned my addr 172.21.15.57:0/3436540266 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:04:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.867+0000 7fe6f9400700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc100380 0x7fe6fc110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:34.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.867+0000 7fe6f9e00700 1 -- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc100380 msgr2=0x7fe6fc110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:34.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.867+0000 7fe6f9e00700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc100380 0x7fe6fc110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:34.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.867+0000 7fe6f9e00700 1 -- 172.21.15.57:0/3436540266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8005040 con 0x7fe6fc0ff170 2024-02-28T16:04:34.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.867+0000 7fe6f9400700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc100380 0x7fe6fc110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:04:34.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.868+0000 7fe6f9e00700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ff170 0x7fe6fc10fb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00eb70 tx=0x7fe6ec00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:34.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.868+0000 7fe6f2000700 1 -- 172.21.15.57:0/3436540266 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ec007cc0 con 0x7fe6fc0ff170 2024-02-28T16:04:34.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.868+0000 7fe700e00700 1 -- 172.21.15.57:0/3436540266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc111170 con 0x7fe6fc0ff170 2024-02-28T16:04:34.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.868+0000 7fe6f2000700 1 -- 172.21.15.57:0/3436540266 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6ec00f040 con 0x7fe6fc0ff170 2024-02-28T16:04:34.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.868+0000 7fe6f2000700 1 -- 172.21.15.57:0/3436540266 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ec00cb50 con 0x7fe6fc0ff170 2024-02-28T16:04:34.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.868+0000 7fe700e00700 1 -- 172.21.15.57:0/3436540266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc1116b0 con 0x7fe6fc0ff170 2024-02-28T16:04:34.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.869+0000 7fe700e00700 1 -- 172.21.15.57:0/3436540266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc04bed0 con 0x7fe6fc0ff170 2024-02-28T16:04:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.870+0000 7fe6f2000700 1 -- 172.21.15.57:0/3436540266 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 36) v1 ==== 91229+0+0 (secure 0 0 0) 0x7fe6ec00ccb0 con 0x7fe6fc0ff170 2024-02-28T16:04:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.872+0000 7fe6f2000700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe6e006d4e0 0x7fe6e006f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:34.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.872+0000 7fe6f2000700 1 -- 172.21.15.57:0/3436540266 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe6ec08c4a0 con 0x7fe6fc0ff170 2024-02-28T16:04:34.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.872+0000 7fe6f9400700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe6e006d4e0 0x7fe6e006f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:34.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.873+0000 7fe6f9400700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe6e006d4e0 0x7fe6e006f990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8013740 tx=0x7fe6e8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:34.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:34.877+0000 7fe6f2000700 1 -- 172.21.15.57:0/3436540266 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe6ec055fd0 con 0x7fe6fc0ff170 2024-02-28T16:04:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.144+0000 7fe700e00700 1 -- 172.21.15.57:0/3436540266 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6fc111b00 con 0x7fe6e006d4e0 2024-02-28T16:04:35.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.146+0000 7fe6f2000700 1 -- 172.21.15.57:0/3436540266 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fe6fc111b00 con 0x7fe6e006d4e0 2024-02-28T16:04:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.148+0000 7fe700e00700 1 -- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe6e006d4e0 msgr2=0x7fe6e006f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.148+0000 7fe700e00700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe6e006d4e0 0x7fe6e006f990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8013740 tx=0x7fe6e8009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.148+0000 7fe700e00700 1 -- 172.21.15.57:0/3436540266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ff170 msgr2=0x7fe6fc10fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.148+0000 7fe700e00700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ff170 0x7fe6fc10fb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00eb70 tx=0x7fe6ec00b040 comp rx=0 tx=0).stop 2024-02-28T16:04:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.148+0000 7fe700e00700 1 -- 172.21.15.57:0/3436540266 shutdown_connections 2024-02-28T16:04:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.148+0000 7fe700e00700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe6e006d4e0 0x7fe6e006f990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.148+0000 7fe700e00700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ff170 0x7fe6fc10fb10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.148+0000 7fe700e00700 1 --2- 172.21.15.57:0/3436540266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc100380 0x7fe6fc110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.148+0000 7fe700e00700 1 -- 172.21.15.57:0/3436540266 >> 172.21.15.57:0/3436540266 conn(0x7fe6fc0fa920 msgr2=0x7fe6fc1035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:35.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.149+0000 7fe700e00700 1 -- 172.21.15.57:0/3436540266 shutdown_connections 2024-02-28T16:04:35.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.149+0000 7fe700e00700 1 -- 172.21.15.57:0/3436540266 wait complete. 2024-02-28T16:04:35.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.301+0000 7f8bd9800700 1 -- 172.21.15.57:0/1298736987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd4104750 msgr2=0x7f8bd4104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:35.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.301+0000 7f8bd9800700 1 --2- 172.21.15.57:0/1298736987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd4104750 0x7f8bd4104ba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0004940 tx=0x7f8bc0009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:35.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.301+0000 7f8bd9800700 1 -- 172.21.15.57:0/1298736987 shutdown_connections 2024-02-28T16:04:35.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.301+0000 7f8bd9800700 1 --2- 172.21.15.57:0/1298736987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd4104750 0x7f8bd4104ba0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.301+0000 7f8bd9800700 1 --2- 172.21.15.57:0/1298736987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bd4103540 0x7f8bd4103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.301+0000 7f8bd9800700 1 -- 172.21.15.57:0/1298736987 >> 172.21.15.57:0/1298736987 conn(0x7f8bd40727d0 msgr2=0x7f8bd4074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:35.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.301+0000 7f8bd9800700 1 -- 172.21.15.57:0/1298736987 shutdown_connections 2024-02-28T16:04:35.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.301+0000 7f8bd9800700 1 -- 172.21.15.57:0/1298736987 wait complete. 2024-02-28T16:04:35.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.302+0000 7f8bd9800700 1 Processor -- start 2024-02-28T16:04:35.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.302+0000 7f8bd9800700 1 -- start start 2024-02-28T16:04:35.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd9800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd4103540 0x7f8bd4113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:35.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd9800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bd4104750 0x7f8bd41144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd9800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4114aa0 con 0x7f8bd4103540 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd9800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4115340 con 0x7f8bd4104750 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd2a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd4103540 0x7f8bd4113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd2a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd4103540 0x7f8bd4113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55988/0 (socket says 172.21.15.57:55988) 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd2a00700 1 -- 172.21.15.57:0/4289665249 learned_addr learned my addr 172.21.15.57:0/4289665249 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd2000700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bd4104750 0x7f8bd41144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd2a00700 1 -- 172.21.15.57:0/4289665249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bd4104750 msgr2=0x7f8bd41144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd2a00700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bd4104750 0x7f8bd41144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.303+0000 7f8bd2a00700 1 -- 172.21.15.57:0/4289665249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0005040 con 0x7f8bd4103540 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.304+0000 7f8bd2a00700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd4103540 0x7f8bd4113f60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4002a80 tx=0x7f8bc4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.304+0000 7f8bcaa00700 1 -- 172.21.15.57:0/4289665249 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc4007cc0 con 0x7f8bd4103540 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.304+0000 7f8bcaa00700 1 -- 172.21.15.57:0/4289665249 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8bc400f040 con 0x7f8bd4103540 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.304+0000 7f8bd9800700 1 -- 172.21.15.57:0/4289665249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd4115620 con 0x7f8bd4103540 2024-02-28T16:04:35.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.304+0000 7f8bcaa00700 1 -- 172.21.15.57:0/4289665249 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc400dad0 con 0x7f8bd4103540 2024-02-28T16:04:35.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.304+0000 7f8bd9800700 1 -- 172.21.15.57:0/4289665249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd4115b60 con 0x7f8bd4103540 2024-02-28T16:04:35.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.305+0000 7f8bd9800700 1 -- 172.21.15.57:0/4289665249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd404bed0 con 0x7f8bd4103540 2024-02-28T16:04:35.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.306+0000 7f8bcaa00700 1 -- 172.21.15.57:0/4289665249 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 36) v1 ==== 91237+0+0 (secure 0 0 0) 0x7f8bc400dc30 con 0x7f8bd4103540 2024-02-28T16:04:35.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.307+0000 7f8bcaa00700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8bb806d4e0 0x7f8bb806f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:35.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.307+0000 7f8bcaa00700 1 -- 172.21.15.57:0/4289665249 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8bc408c700 con 0x7f8bd4103540 2024-02-28T16:04:35.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.308+0000 7f8bd2000700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8bb806d4e0 0x7f8bb806f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:35.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.308+0000 7f8bd2000700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8bb806d4e0 0x7f8bb806f990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000b3b0 tx=0x7f8bc0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:35.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.313+0000 7f8bcaa00700 1 -- 172.21.15.57:0/4289665249 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8bc4056200 con 0x7f8bd4103540 2024-02-28T16:04:35.391 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:35 smithi057 ceph-mon[93219]: [28/Feb/2024:16:04:34] ENGINE Bus STARTING 2024-02-28T16:04:35.391 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:35 smithi057 ceph-mon[93219]: [28/Feb/2024:16:04:34] ENGINE Serving on https://172.21.15.57:7150 2024-02-28T16:04:35.391 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:35 smithi057 ceph-mon[93219]: [28/Feb/2024:16:04:34] ENGINE Serving on http://172.21.15.57:8765 2024-02-28T16:04:35.391 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:35 smithi057 ceph-mon[93219]: [28/Feb/2024:16:04:34] ENGINE Bus STARTED 2024-02-28T16:04:35.391 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:35 smithi057 ceph-mon[93219]: mgrmap e36: smithi057.upqerc(active, since 1.02796s), standbys: smithi087.ewrszc 2024-02-28T16:04:35.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.553+0000 7f8bd9800700 1 -- 172.21.15.57:0/4289665249 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bd4116000 con 0x7f8bb806d4e0 2024-02-28T16:04:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.569+0000 7f8bcaa00700 1 -- 172.21.15.57:0/4289665249 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8bd4116000 con 0x7f8bb806d4e0 2024-02-28T16:04:35.561 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:04:35.561 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (2m) 25s ago 13m 14.8M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (13m) 25s ago 13m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (12m) 31s ago 12m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (2m) 25s ago 13m 76.1M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (6m) 25s ago 6m 141M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (6m) 25s ago 6m 78.1M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (6m) 31s ago 6m 119M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (6m) 31s ago 6m 58.6M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (109s) 25s ago 15m 491M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (38s) 31s ago 12m 64.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (15m) 25s ago 15m 51.3M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 65a85703c36b 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (12m) 31s ago 12m 42.7M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 5b73e8cf88cd 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (3m) 25s ago 13m 7558k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (118s) 31s ago 12m 7763k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:04:35.562 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (11m) 25s ago 11m 209M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:04:35.563 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (10m) 25s ago 10m 228M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:04:35.563 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (9m) 25s ago 9m 189M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:04:35.563 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (9m) 31s ago 9m 253M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:04:35.563 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (8m) 31s ago 8m 233M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:04:35.563 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (8m) 31s ago 8m 218M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:04:35.563 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (49s) 25s ago 12m 37.5M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:04:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.573+0000 7f8bd9800700 1 -- 172.21.15.57:0/4289665249 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8bb806d4e0 msgr2=0x7f8bb806f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.573+0000 7f8bd9800700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8bb806d4e0 0x7f8bb806f990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000b3b0 tx=0x7f8bc0009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.573+0000 7f8bd9800700 1 -- 172.21.15.57:0/4289665249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd4103540 msgr2=0x7f8bd4113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.573+0000 7f8bd9800700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd4103540 0x7f8bd4113f60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4002a80 tx=0x7f8bc4004600 comp rx=0 tx=0).stop 2024-02-28T16:04:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.574+0000 7f8bd9800700 1 -- 172.21.15.57:0/4289665249 shutdown_connections 2024-02-28T16:04:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.574+0000 7f8bd9800700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8bb806d4e0 0x7f8bb806f990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.574+0000 7f8bd9800700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd4103540 0x7f8bd4113f60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.574+0000 7f8bd9800700 1 --2- 172.21.15.57:0/4289665249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bd4104750 0x7f8bd41144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.574+0000 7f8bd9800700 1 -- 172.21.15.57:0/4289665249 >> 172.21.15.57:0/4289665249 conn(0x7f8bd40727d0 msgr2=0x7f8bd4107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.574+0000 7f8bd9800700 1 -- 172.21.15.57:0/4289665249 shutdown_connections 2024-02-28T16:04:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.574+0000 7f8bd9800700 1 -- 172.21.15.57:0/4289665249 wait complete. 2024-02-28T16:04:35.619 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:35 smithi087 ceph-mon[37122]: [28/Feb/2024:16:04:34] ENGINE Bus STARTING 2024-02-28T16:04:35.619 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:35 smithi087 ceph-mon[37122]: [28/Feb/2024:16:04:34] ENGINE Serving on https://172.21.15.57:7150 2024-02-28T16:04:35.619 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:35 smithi087 ceph-mon[37122]: [28/Feb/2024:16:04:34] ENGINE Serving on http://172.21.15.57:8765 2024-02-28T16:04:35.619 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:35 smithi087 ceph-mon[37122]: [28/Feb/2024:16:04:34] ENGINE Bus STARTED 2024-02-28T16:04:35.619 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:35 smithi087 ceph-mon[37122]: mgrmap e36: smithi057.upqerc(active, since 1.02796s), standbys: smithi087.ewrszc 2024-02-28T16:04:35.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.728+0000 7f4dc4600700 1 -- 172.21.15.57:0/4018604210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dbc071eb0 msgr2=0x7f4dbc070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:35.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.728+0000 7f4dc4600700 1 --2- 172.21.15.57:0/4018604210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dbc071eb0 0x7f4dbc070320 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4db0004940 tx=0x7f4db0009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:35.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.728+0000 7f4dc4600700 1 -- 172.21.15.57:0/4018604210 shutdown_connections 2024-02-28T16:04:35.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.728+0000 7f4dc4600700 1 --2- 172.21.15.57:0/4018604210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dbc070860 0x7f4dbc070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.728+0000 7f4dc4600700 1 --2- 172.21.15.57:0/4018604210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dbc071eb0 0x7f4dbc070320 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.728+0000 7f4dc4600700 1 -- 172.21.15.57:0/4018604210 >> 172.21.15.57:0/4018604210 conn(0x7f4dbc0f8620 msgr2=0x7f4dbc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:35.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.728+0000 7f4dc4600700 1 -- 172.21.15.57:0/4018604210 shutdown_connections 2024-02-28T16:04:35.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.728+0000 7f4dc4600700 1 -- 172.21.15.57:0/4018604210 wait complete. 2024-02-28T16:04:35.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.729+0000 7f4dc4600700 1 Processor -- start 2024-02-28T16:04:35.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.729+0000 7f4dc4600700 1 -- start start 2024-02-28T16:04:35.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.729+0000 7f4dc4600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dbc070860 0x7f4dbc10fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:35.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.729+0000 7f4dc4600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dbc071eb0 0x7f4dbc110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:35.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.729+0000 7f4dc4600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc110640 con 0x7f4dbc071eb0 2024-02-28T16:04:35.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.729+0000 7f4dc4600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc110ee0 con 0x7f4dbc070860 2024-02-28T16:04:35.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.730+0000 7f4dc1200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dbc071eb0 0x7f4dbc110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:35.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.730+0000 7f4dc1200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dbc071eb0 0x7f4dbc110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56000/0 (socket says 172.21.15.57:56000) 2024-02-28T16:04:35.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.730+0000 7f4dc1200700 1 -- 172.21.15.57:0/1250114045 learned_addr learned my addr 172.21.15.57:0/1250114045 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:04:35.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.730+0000 7f4dc1c00700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dbc070860 0x7f4dbc10fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:35.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.730+0000 7f4dc1200700 1 -- 172.21.15.57:0/1250114045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dbc070860 msgr2=0x7f4dbc10fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:35.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.730+0000 7f4dc1200700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dbc070860 0x7f4dbc10fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:35.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.730+0000 7f4dc1200700 1 -- 172.21.15.57:0/1250114045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0005040 con 0x7f4dbc071eb0 2024-02-28T16:04:35.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.731+0000 7f4dc1200700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dbc071eb0 0x7f4dbc110040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4da800eb70 tx=0x7f4da800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:35.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.731+0000 7f4db9600700 1 -- 172.21.15.57:0/1250114045 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4da8007cc0 con 0x7f4dbc071eb0 2024-02-28T16:04:35.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.731+0000 7f4db9600700 1 -- 172.21.15.57:0/1250114045 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4da800f040 con 0x7f4dbc071eb0 2024-02-28T16:04:35.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.731+0000 7f4db9600700 1 -- 172.21.15.57:0/1250114045 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4da800cb20 con 0x7f4dbc071eb0 2024-02-28T16:04:35.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.731+0000 7f4dc4600700 1 -- 172.21.15.57:0/1250114045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc111160 con 0x7f4dbc071eb0 2024-02-28T16:04:35.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.731+0000 7f4dc4600700 1 -- 172.21.15.57:0/1250114045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc1116a0 con 0x7f4dbc071eb0 2024-02-28T16:04:35.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.732+0000 7f4dc4600700 1 -- 172.21.15.57:0/1250114045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc04bed0 con 0x7f4dbc071eb0 2024-02-28T16:04:35.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.734+0000 7f4db9600700 1 -- 172.21.15.57:0/1250114045 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 36) v1 ==== 91237+0+0 (secure 0 0 0) 0x7f4da800cc80 con 0x7f4dbc071eb0 2024-02-28T16:04:35.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.735+0000 7f4db9600700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4da406d540 0x7f4da406f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:35.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.736+0000 7f4db9600700 1 -- 172.21.15.57:0/1250114045 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4da808c3c0 con 0x7f4dbc071eb0 2024-02-28T16:04:35.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.736+0000 7f4dc1c00700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4da406d540 0x7f4da406f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:35.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.737+0000 7f4dc1c00700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4da406d540 0x7f4da406f9f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4db000b0d0 tx=0x7f4db0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:35.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:35.741+0000 7f4db9600700 1 -- 172.21.15.57:0/1250114045 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4da8055ec0 con 0x7f4dbc071eb0 2024-02-28T16:04:36.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.103+0000 7f4dc4600700 1 -- 172.21.15.57:0/1250114045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4dbc107c20 con 0x7f4dbc071eb0 2024-02-28T16:04:36.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.104+0000 7f4db9600700 1 -- 172.21.15.57:0/1250114045 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f4da8059580 con 0x7f4dbc071eb0 2024-02-28T16:04:36.097 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:04:36.097 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:04:36.097 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:04:36.097 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:04:36.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:04:36.097 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:04:36.098 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:04:36.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:04:36.098 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:04:36.098 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:04:36.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:04:36.098 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:04:36.099 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:04:36.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:04:36.099 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:04:36.099 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 11, 2024-02-28T16:04:36.099 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T16:04:36.099 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:04:36.099 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:04:36.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.108+0000 7f4dc4600700 1 -- 172.21.15.57:0/1250114045 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4da406d540 msgr2=0x7f4da406f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:36.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.108+0000 7f4dc4600700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4da406d540 0x7f4da406f9f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4db000b0d0 tx=0x7f4db0009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:36.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.109+0000 7f4dc4600700 1 -- 172.21.15.57:0/1250114045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dbc071eb0 msgr2=0x7f4dbc110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:36.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.109+0000 7f4dc4600700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dbc071eb0 0x7f4dbc110040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4da800eb70 tx=0x7f4da800b040 comp rx=0 tx=0).stop 2024-02-28T16:04:36.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.109+0000 7f4dc4600700 1 -- 172.21.15.57:0/1250114045 shutdown_connections 2024-02-28T16:04:36.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.109+0000 7f4dc4600700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4da406d540 0x7f4da406f9f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.109+0000 7f4dc4600700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dbc070860 0x7f4dbc10fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.109+0000 7f4dc4600700 1 --2- 172.21.15.57:0/1250114045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dbc071eb0 0x7f4dbc110040 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.109+0000 7f4dc4600700 1 -- 172.21.15.57:0/1250114045 >> 172.21.15.57:0/1250114045 conn(0x7f4dbc0f8620 msgr2=0x7f4dbc102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:36.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.109+0000 7f4dc4600700 1 -- 172.21.15.57:0/1250114045 shutdown_connections 2024-02-28T16:04:36.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.109+0000 7f4dc4600700 1 -- 172.21.15.57:0/1250114045 wait complete. 2024-02-28T16:04:36.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.268+0000 7f128c600700 1 -- 172.21.15.57:0/3113473451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1284071f10 msgr2=0x7f1284070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:36.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.268+0000 7f128c600700 1 --2- 172.21.15.57:0/3113473451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1284071f10 0x7f1284070380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1278004940 tx=0x7f1278009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:36.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.268+0000 7f128c600700 1 -- 172.21.15.57:0/3113473451 shutdown_connections 2024-02-28T16:04:36.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.268+0000 7f128c600700 1 --2- 172.21.15.57:0/3113473451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12840708c0 0x7f1284070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.268+0000 7f128c600700 1 --2- 172.21.15.57:0/3113473451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1284071f10 0x7f1284070380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.268+0000 7f128c600700 1 -- 172.21.15.57:0/3113473451 >> 172.21.15.57:0/3113473451 conn(0x7f12840f8620 msgr2=0x7f12840faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:36.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.268+0000 7f128c600700 1 -- 172.21.15.57:0/3113473451 shutdown_connections 2024-02-28T16:04:36.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.268+0000 7f128c600700 1 -- 172.21.15.57:0/3113473451 wait complete. 2024-02-28T16:04:36.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.269+0000 7f128c600700 1 Processor -- start 2024-02-28T16:04:36.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.269+0000 7f128c600700 1 -- start start 2024-02-28T16:04:36.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.269+0000 7f128c600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840708c0 0x7f128410fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:36.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.269+0000 7f128c600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1284071f10 0x7f1284110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:36.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.269+0000 7f128c600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1284110720 con 0x7f12840708c0 2024-02-28T16:04:36.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.269+0000 7f128c600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1284110fc0 con 0x7f1284071f10 2024-02-28T16:04:36.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.270+0000 7f1289c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840708c0 0x7f128410fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:36.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.270+0000 7f1289c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840708c0 0x7f128410fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56038/0 (socket says 172.21.15.57:56038) 2024-02-28T16:04:36.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.270+0000 7f1289c00700 1 -- 172.21.15.57:0/1764632486 learned_addr learned my addr 172.21.15.57:0/1764632486 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:04:36.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.270+0000 7f1289200700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1284071f10 0x7f1284110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:36.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.270+0000 7f1289c00700 1 -- 172.21.15.57:0/1764632486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1284071f10 msgr2=0x7f1284110120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:36.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.270+0000 7f1289c00700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1284071f10 0x7f1284110120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.270+0000 7f1289c00700 1 -- 172.21.15.57:0/1764632486 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278005040 con 0x7f12840708c0 2024-02-28T16:04:36.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.270+0000 7f1289c00700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840708c0 0x7f128410fbe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1278009fd0 tx=0x7f1278009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:36.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.271+0000 7f1281600700 1 -- 172.21.15.57:0/1764632486 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127800e040 con 0x7f12840708c0 2024-02-28T16:04:36.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.271+0000 7f1281600700 1 -- 172.21.15.57:0/1764632486 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1278004290 con 0x7f12840708c0 2024-02-28T16:04:36.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.271+0000 7f1281600700 1 -- 172.21.15.57:0/1764632486 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127801c630 con 0x7f12840708c0 2024-02-28T16:04:36.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.271+0000 7f128c600700 1 -- 172.21.15.57:0/1764632486 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1284111240 con 0x7f12840708c0 2024-02-28T16:04:36.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.271+0000 7f128c600700 1 -- 172.21.15.57:0/1764632486 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1284111780 con 0x7f12840708c0 2024-02-28T16:04:36.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.272+0000 7f128c600700 1 -- 172.21.15.57:0/1764632486 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1284109c50 con 0x7f12840708c0 2024-02-28T16:04:36.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.273+0000 7f1281600700 1 -- 172.21.15.57:0/1764632486 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 36) v1 ==== 91237+0+0 (secure 0 0 0) 0x7f127800bc60 con 0x7f12840708c0 2024-02-28T16:04:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.274+0000 7f1281600700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126c06d4e0 0x7f126c06f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.274+0000 7f1281600700 1 -- 172.21.15.57:0/1764632486 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f127808dde0 con 0x7f12840708c0 2024-02-28T16:04:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.275+0000 7f1289200700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126c06d4e0 0x7f126c06f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:36.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.275+0000 7f1289200700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126c06d4e0 0x7f126c06f990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1270004990 tx=0x7f1270009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:36.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.279+0000 7f1281600700 1 -- 172.21.15.57:0/1764632486 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f12780578e0 con 0x7f12840708c0 2024-02-28T16:04:36.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.343+0000 7f1281600700 1 -- 172.21.15.57:0/1764632486 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 37) v1 ==== 91531+0+0 (secure 0 0 0) 0x7f1278057cb0 con 0x7f12840708c0 2024-02-28T16:04:36.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:36 smithi057 ceph-mon[93219]: from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:04:36.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:36 smithi057 ceph-mon[93219]: pgmap v3: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:04:36.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:36 smithi057 ceph-mon[93219]: from='client.24643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:04:36.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:36 smithi057 ceph-mon[93219]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:04:36.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:36 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1250114045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:04:36.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.558+0000 7f128c600700 1 -- 172.21.15.57:0/1764632486 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1284111ab0 con 0x7f12840708c0 2024-02-28T16:04:36.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.559+0000 7f1281600700 1 -- 172.21.15.57:0/1764632486 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1897 (secure 0 0 0) 0x7f1278045510 con 0x7f12840708c0 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:e16 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 16 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:02:07.353165+0000 2024-02-28T16:04:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:04:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:04:36.554 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:04:36.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.562+0000 7f128c600700 1 -- 172.21.15.57:0/1764632486 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126c06d4e0 msgr2=0x7f126c06f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:36.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.562+0000 7f128c600700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126c06d4e0 0x7f126c06f990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1270004990 tx=0x7f1270009ee0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.562+0000 7f128c600700 1 -- 172.21.15.57:0/1764632486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840708c0 msgr2=0x7f128410fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:36.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.562+0000 7f128c600700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840708c0 0x7f128410fbe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1278009fd0 tx=0x7f1278009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:36.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.562+0000 7f128c600700 1 -- 172.21.15.57:0/1764632486 shutdown_connections 2024-02-28T16:04:36.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.562+0000 7f128c600700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126c06d4e0 0x7f126c06f990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.562+0000 7f128c600700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840708c0 0x7f128410fbe0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.562+0000 7f128c600700 1 --2- 172.21.15.57:0/1764632486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1284071f10 0x7f1284110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.562+0000 7f128c600700 1 -- 172.21.15.57:0/1764632486 >> 172.21.15.57:0/1764632486 conn(0x7f12840f8620 msgr2=0x7f12840fa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:36.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.563+0000 7f128c600700 1 -- 172.21.15.57:0/1764632486 shutdown_connections 2024-02-28T16:04:36.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.563+0000 7f128c600700 1 -- 172.21.15.57:0/1764632486 wait complete. 2024-02-28T16:04:36.556 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2024-02-28T16:04:36.684 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:36 smithi087 ceph-mon[37122]: from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:04:36.684 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:36 smithi087 ceph-mon[37122]: pgmap v3: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:04:36.685 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:36 smithi087 ceph-mon[37122]: from='client.24643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:04:36.685 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:36 smithi087 ceph-mon[37122]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:04:36.685 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:36 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1250114045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:04:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.715+0000 7f3592800700 1 -- 172.21.15.57:0/1801720667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f358c0fcef0 msgr2=0x7f358c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.715+0000 7f3592800700 1 --2- 172.21.15.57:0/1801720667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f358c0fcef0 0x7f358c0fd320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f357c004940 tx=0x7f357c009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.715+0000 7f3592800700 1 -- 172.21.15.57:0/1801720667 shutdown_connections 2024-02-28T16:04:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.715+0000 7f3592800700 1 --2- 172.21.15.57:0/1801720667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f358c0fe0e0 0x7f358c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.715+0000 7f3592800700 1 --2- 172.21.15.57:0/1801720667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f358c0fcef0 0x7f358c0fd320 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.715+0000 7f3592800700 1 -- 172.21.15.57:0/1801720667 >> 172.21.15.57:0/1801720667 conn(0x7f358c0f8620 msgr2=0x7f358c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:36.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.715+0000 7f3592800700 1 -- 172.21.15.57:0/1801720667 shutdown_connections 2024-02-28T16:04:36.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.715+0000 7f3592800700 1 -- 172.21.15.57:0/1801720667 wait complete. 2024-02-28T16:04:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.716+0000 7f3592800700 1 Processor -- start 2024-02-28T16:04:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.716+0000 7f3592800700 1 -- start start 2024-02-28T16:04:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.716+0000 7f3592800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f358c0fcef0 0x7f358c10fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.716+0000 7f3592800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f358c0fe0e0 0x7f358c1100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.716+0000 7f3592800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c110730 con 0x7f358c0fcef0 2024-02-28T16:04:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.716+0000 7f3592800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c110f70 con 0x7f358c0fe0e0 2024-02-28T16:04:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.717+0000 7f358b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f358c0fcef0 0x7f358c10fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.717+0000 7f358b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f358c0fcef0 0x7f358c10fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56050/0 (socket says 172.21.15.57:56050) 2024-02-28T16:04:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.717+0000 7f358b400700 1 -- 172.21.15.57:0/3302683719 learned_addr learned my addr 172.21.15.57:0/3302683719 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:04:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.717+0000 7f358aa00700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f358c0fe0e0 0x7f358c1100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:36.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.717+0000 7f358b400700 1 -- 172.21.15.57:0/3302683719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f358c0fe0e0 msgr2=0x7f358c1100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:36.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.717+0000 7f358b400700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f358c0fe0e0 0x7f358c1100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.717+0000 7f358b400700 1 -- 172.21.15.57:0/3302683719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c005040 con 0x7f358c0fcef0 2024-02-28T16:04:36.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.718+0000 7f358b400700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f358c0fcef0 0x7f358c10fb60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f357c000c00 tx=0x7f357c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:36.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.718+0000 7f3583400700 1 -- 172.21.15.57:0/3302683719 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f357c00e040 con 0x7f358c0fcef0 2024-02-28T16:04:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.718+0000 7f3583400700 1 -- 172.21.15.57:0/3302683719 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f357c00bcc0 con 0x7f358c0fcef0 2024-02-28T16:04:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.718+0000 7f3583400700 1 -- 172.21.15.57:0/3302683719 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f357c013ea0 con 0x7f358c0fcef0 2024-02-28T16:04:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.718+0000 7f3592800700 1 -- 172.21.15.57:0/3302683719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c1111f0 con 0x7f358c0fcef0 2024-02-28T16:04:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.718+0000 7f3592800700 1 -- 172.21.15.57:0/3302683719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c111730 con 0x7f358c0fcef0 2024-02-28T16:04:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.719+0000 7f3592800700 1 -- 172.21.15.57:0/3302683719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c102210 con 0x7f358c0fcef0 2024-02-28T16:04:36.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.720+0000 7f3583400700 1 -- 172.21.15.57:0/3302683719 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 37) v1 ==== 91531+0+0 (secure 0 0 0) 0x7f357c013420 con 0x7f358c0fcef0 2024-02-28T16:04:36.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.722+0000 7f3583400700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f357006d880 0x7f357006fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.722+0000 7f3583400700 1 -- 172.21.15.57:0/3302683719 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f357c08e400 con 0x7f358c0fcef0 2024-02-28T16:04:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.722+0000 7f358aa00700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f357006d880 0x7f357006fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.723+0000 7f358aa00700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f357006d880 0x7f357006fd30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3578006fd0 tx=0x7f3578008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:36.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.727+0000 7f3583400700 1 -- 172.21.15.57:0/3302683719 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f357c05b5d0 con 0x7f358c0fcef0 2024-02-28T16:04:36.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.978+0000 7f3592800700 1 -- 172.21.15.57:0/3302683719 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f358c02b390 con 0x7f357006d880 2024-02-28T16:04:36.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.981+0000 7f3583400700 1 -- 172.21.15.57:0/3302683719 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f358c02b390 con 0x7f357006d880 2024-02-28T16:04:36.972 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:04:36.973 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:04:36.973 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:04:36.973 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:04:36.973 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:04:36.973 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr" 2024-02-28T16:04:36.973 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:04:36.973 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "2/21 daemons upgraded", 2024-02-28T16:04:36.973 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "", 2024-02-28T16:04:36.973 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:04:36.973 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:04:36.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.983+0000 7f3592800700 1 -- 172.21.15.57:0/3302683719 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f357006d880 msgr2=0x7f357006fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:36.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.983+0000 7f3592800700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f357006d880 0x7f357006fd30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3578006fd0 tx=0x7f3578008040 comp rx=0 tx=0).stop 2024-02-28T16:04:36.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.983+0000 7f3592800700 1 -- 172.21.15.57:0/3302683719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f358c0fcef0 msgr2=0x7f358c10fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:36.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.983+0000 7f3592800700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f358c0fcef0 0x7f358c10fb60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f357c000c00 tx=0x7f357c009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:36.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.983+0000 7f3592800700 1 -- 172.21.15.57:0/3302683719 shutdown_connections 2024-02-28T16:04:36.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.983+0000 7f3592800700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f357006d880 0x7f357006fd30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.983+0000 7f3592800700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f358c0fcef0 0x7f358c10fb60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.983+0000 7f3592800700 1 --2- 172.21.15.57:0/3302683719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f358c0fe0e0 0x7f358c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:36.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.983+0000 7f3592800700 1 -- 172.21.15.57:0/3302683719 >> 172.21.15.57:0/3302683719 conn(0x7f358c0f8620 msgr2=0x7f358c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:36.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.983+0000 7f3592800700 1 -- 172.21.15.57:0/3302683719 shutdown_connections 2024-02-28T16:04:36.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:36.984+0000 7f3592800700 1 -- 172.21.15.57:0/3302683719 wait complete. 2024-02-28T16:04:37.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.148+0000 7f161ce00700 1 -- 172.21.15.57:0/2167918679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16180fbce0 msgr2=0x7f1618102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:37.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.148+0000 7f161ce00700 1 --2- 172.21.15.57:0/2167918679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16180fbce0 0x7f1618102560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1604004940 tx=0x7f1604009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:37.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.149+0000 7f161ce00700 1 -- 172.21.15.57:0/2167918679 shutdown_connections 2024-02-28T16:04:37.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.149+0000 7f161ce00700 1 --2- 172.21.15.57:0/2167918679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16180fbce0 0x7f1618102560 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:37.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.149+0000 7f161ce00700 1 --2- 172.21.15.57:0/2167918679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16180fb300 0x7f16180fb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:37.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.149+0000 7f161ce00700 1 -- 172.21.15.57:0/2167918679 >> 172.21.15.57:0/2167918679 conn(0x7f16180f6ca0 msgr2=0x7f16180f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:37.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.149+0000 7f161ce00700 1 -- 172.21.15.57:0/2167918679 shutdown_connections 2024-02-28T16:04:37.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.149+0000 7f161ce00700 1 -- 172.21.15.57:0/2167918679 wait complete. 2024-02-28T16:04:37.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.149+0000 7f161ce00700 1 Processor -- start 2024-02-28T16:04:37.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.150+0000 7f161ce00700 1 -- start start 2024-02-28T16:04:37.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.150+0000 7f161ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16180fb300 0x7f161810fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:37.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.150+0000 7f161ce00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16181100c0 0x7f1618110f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:37.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.150+0000 7f161ce00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618110580 con 0x7f16181100c0 2024-02-28T16:04:37.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.150+0000 7f161ce00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16181106c0 con 0x7f16180fb300 2024-02-28T16:04:37.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.150+0000 7f1615400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16181100c0 0x7f1618110f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:37.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.150+0000 7f1615400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16181100c0 0x7f1618110f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56070/0 (socket says 172.21.15.57:56070) 2024-02-28T16:04:37.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.150+0000 7f1615400700 1 -- 172.21.15.57:0/3589754818 learned_addr learned my addr 172.21.15.57:0/3589754818 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:04:37.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.151+0000 7f1615e00700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16180fb300 0x7f161810fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:37.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.151+0000 7f1615400700 1 -- 172.21.15.57:0/3589754818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16180fb300 msgr2=0x7f161810fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:37.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.151+0000 7f1615400700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16180fb300 0x7f161810fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:37.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.151+0000 7f1615400700 1 -- 172.21.15.57:0/3589754818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1604005040 con 0x7f16181100c0 2024-02-28T16:04:37.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.151+0000 7f1615400700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16181100c0 0x7f1618110f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1604009380 tx=0x7f1604009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:37.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.151+0000 7f160e000700 1 -- 172.21.15.57:0/3589754818 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f160400e040 con 0x7f16181100c0 2024-02-28T16:04:37.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.152+0000 7f160e000700 1 -- 172.21.15.57:0/3589754818 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f160400bbf0 con 0x7f16181100c0 2024-02-28T16:04:37.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.152+0000 7f160e000700 1 -- 172.21.15.57:0/3589754818 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f160401c3f0 con 0x7f16181100c0 2024-02-28T16:04:37.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.152+0000 7f161ce00700 1 -- 172.21.15.57:0/3589754818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618111560 con 0x7f16181100c0 2024-02-28T16:04:37.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.152+0000 7f161ce00700 1 -- 172.21.15.57:0/3589754818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1618111a70 con 0x7f16181100c0 2024-02-28T16:04:37.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.153+0000 7f161ce00700 1 -- 172.21.15.57:0/3589754818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1618101c10 con 0x7f16181100c0 2024-02-28T16:04:37.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.154+0000 7f160e000700 1 -- 172.21.15.57:0/3589754818 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 37) v1 ==== 91531+0+0 (secure 0 0 0) 0x7f160400bd60 con 0x7f16181100c0 2024-02-28T16:04:37.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.155+0000 7f160e000700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15fc06d880 0x7f15fc06fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:04:37.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.155+0000 7f160e000700 1 -- 172.21.15.57:0/3589754818 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f160408e2b0 con 0x7f16181100c0 2024-02-28T16:04:37.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.155+0000 7f1615e00700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15fc06d880 0x7f15fc06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:04:37.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.156+0000 7f1615e00700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15fc06d880 0x7f15fc06fd30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1608009fd0 tx=0x7f160800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:04:37.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.160+0000 7f160e000700 1 -- 172.21.15.57:0/3589754818 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f160405b500 con 0x7f16181100c0 2024-02-28T16:04:37.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.480+0000 7f161ce00700 1 -- 172.21.15.57:0/3589754818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1618105b90 con 0x7f16181100c0 2024-02-28T16:04:37.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.480+0000 7f160e000700 1 -- 172.21.15.57:0/3589754818 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f160405b090 con 0x7f16181100c0 2024-02-28T16:04:37.472 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:04:37.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.483+0000 7f161ce00700 1 -- 172.21.15.57:0/3589754818 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15fc06d880 msgr2=0x7f15fc06fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:37.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.483+0000 7f161ce00700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15fc06d880 0x7f15fc06fd30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1608009fd0 tx=0x7f160800b040 comp rx=0 tx=0).stop 2024-02-28T16:04:37.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.483+0000 7f161ce00700 1 -- 172.21.15.57:0/3589754818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16181100c0 msgr2=0x7f1618110f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:04:37.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.483+0000 7f161ce00700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16181100c0 0x7f1618110f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1604009380 tx=0x7f1604009e30 comp rx=0 tx=0).stop 2024-02-28T16:04:37.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.483+0000 7f161ce00700 1 -- 172.21.15.57:0/3589754818 shutdown_connections 2024-02-28T16:04:37.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.483+0000 7f161ce00700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15fc06d880 0x7f15fc06fd30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:37.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.483+0000 7f161ce00700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16180fb300 0x7f161810fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:37.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.483+0000 7f161ce00700 1 --2- 172.21.15.57:0/3589754818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16181100c0 0x7f1618110f60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:04:37.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.483+0000 7f161ce00700 1 -- 172.21.15.57:0/3589754818 >> 172.21.15.57:0/3589754818 conn(0x7f16180f6ca0 msgr2=0x7f16180fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:04:37.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.483+0000 7f161ce00700 1 -- 172.21.15.57:0/3589754818 shutdown_connections 2024-02-28T16:04:37.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:04:37.484+0000 7f161ce00700 1 -- 172.21.15.57:0/3589754818 wait complete. 2024-02-28T16:04:37.596 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:37 smithi057 ceph-mon[93219]: pgmap v4: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:04:37.596 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:37 smithi057 ceph-mon[93219]: mgrmap e37: smithi057.upqerc(active, since 2s), standbys: smithi087.ewrszc 2024-02-28T16:04:37.596 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:37 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1764632486' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:04:37.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:37 smithi087 ceph-mon[37122]: pgmap v4: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:04:37.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:37 smithi087 ceph-mon[37122]: mgrmap e37: smithi057.upqerc(active, since 2s), standbys: smithi087.ewrszc 2024-02-28T16:04:37.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:37 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/1764632486' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:04:38.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:38 smithi057 ceph-mon[93219]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:04:38.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:38 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3589754818' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:04:38.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:38 smithi087 ceph-mon[37122]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:04:38.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:38 smithi087 ceph-mon[37122]: from='client.? 172.21.15.57:0/3589754818' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:04:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:39 smithi057 ceph-mon[93219]: pgmap v5: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:04:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:39 smithi057 ceph-mon[93219]: mgrmap e38: smithi057.upqerc(active, since 4s), standbys: smithi087.ewrszc 2024-02-28T16:04:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:39 smithi087 ceph-mon[37122]: pgmap v5: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:04:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:39 smithi087 ceph-mon[37122]: mgrmap e38: smithi057.upqerc(active, since 4s), standbys: smithi087.ewrszc 2024-02-28T16:04:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:39 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:39 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:41.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:41 smithi057 ceph-mon[93219]: pgmap v6: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:04:41.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:41.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:41.710 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:41 smithi087 ceph-mon[37122]: pgmap v6: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:04:41.710 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:41 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:41.710 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:41 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:42.612 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:42 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:42.613 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:42 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:42.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:42 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:42.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:42 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:43.766 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:43 smithi087 ceph-mon[37122]: pgmap v7: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-28T16:04:43.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:43 smithi057 ceph-mon[93219]: pgmap v7: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-28T16:04:44.827 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:44 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:44.827 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:44 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:44.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:44.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:45.544 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:45 smithi087 ceph-mon[37122]: pgmap v8: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-28T16:04:45.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:45 smithi057 ceph-mon[93219]: pgmap v8: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-28T16:04:47.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:47 smithi057 ceph-mon[93219]: pgmap v9: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-28T16:04:47.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:47.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:47.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:04:47.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:04:47.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:47 smithi057 ceph-mon[93219]: Updating smithi057:/etc/ceph/ceph.conf 2024-02-28T16:04:47.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:47 smithi057 ceph-mon[93219]: Updating smithi087:/etc/ceph/ceph.conf 2024-02-28T16:04:47.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:47 smithi087 ceph-mon[37122]: pgmap v9: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-28T16:04:47.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:47 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:47.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:47 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:47.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:47 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:04:47.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:47 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:04:47.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:47 smithi087 ceph-mon[37122]: Updating smithi057:/etc/ceph/ceph.conf 2024-02-28T16:04:47.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:47 smithi087 ceph-mon[37122]: Updating smithi087:/etc/ceph/ceph.conf 2024-02-28T16:04:48.653 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:48 smithi057 ceph-mon[93219]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:04:48.653 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:48 smithi057 ceph-mon[93219]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:04:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:48 smithi087 ceph-mon[37122]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:04:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:48 smithi087 ceph-mon[37122]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:04:49.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:49 smithi057 ceph-mon[93219]: pgmap v10: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-28T16:04:49.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:49 smithi057 ceph-mon[93219]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:04:49.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:49 smithi057 ceph-mon[93219]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:04:49.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:04:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:49 smithi087 ceph-mon[37122]: pgmap v10: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-28T16:04:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:49 smithi087 ceph-mon[37122]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:04:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:49 smithi087 ceph-mon[37122]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:04:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:49 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:04:50.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:50 smithi057 ceph-mon[93219]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:04:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:50 smithi057 ceph-mon[93219]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:04:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:50 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:50 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:50 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:50 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:50 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:50 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:04:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:50 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:04:50.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:50 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:04:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:50 smithi087 ceph-mon[37122]: Updating smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:04:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:50 smithi087 ceph-mon[37122]: Updating smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:04:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:50 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:50 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:50 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:50 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:50 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:50 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:04:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:50 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:04:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:50 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:04:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:51 smithi057 ceph-mon[93219]: pgmap v11: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-28T16:04:51.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:51 smithi087 ceph-mon[37122]: pgmap v11: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-28T16:04:53.537 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:53 smithi087 ceph-mon[37122]: pgmap v12: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-28T16:04:53.538 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:53 smithi087 ceph-mon[37122]: Upgrade: Updating mon.smithi087 2024-02-28T16:04:53.538 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:53 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:53.538 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:53 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:04:53.538 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:53 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:04:53.538 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:53 smithi087 ceph-mon[37122]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:04:53.538 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:53 smithi087 ceph-mon[37122]: Deploying daemon mon.smithi087 on smithi087 2024-02-28T16:04:53.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:53 smithi057 ceph-mon[93219]: pgmap v12: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-28T16:04:53.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:53 smithi057 ceph-mon[93219]: Upgrade: Updating mon.smithi087 2024-02-28T16:04:53.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:53 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:04:53.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:53 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:04:53.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:53 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:04:53.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:53 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:04:53.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:53 smithi057 ceph-mon[93219]: Deploying daemon mon.smithi087 on smithi087 2024-02-28T16:04:55.386 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:55 smithi087 systemd[1]: Stopping Ceph mon.smithi087 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:04:55.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:04:55 smithi057 ceph-mon[93219]: pgmap v13: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:04:55.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:55 smithi087 ceph-mon[37122]: pgmap v13: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:04:55.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:55 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087[37094]: 2024-02-28T16:04:55.494+0000 7f067f800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi087 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:04:55.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:55 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087[37094]: 2024-02-28T16:04:55.494+0000 7f067f800700 -1 mon.smithi087@1(peon) e2 *** Got Signal Terminated *** 2024-02-28T16:04:56.035 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:55 smithi087 podman[82468]: 2024-02-28 16:04:55.783441554 +0000 UTC m=+0.459696563 container died 5b73e8cf88cdd565834f15c7184d5b9d35a974dbe5afb299fb279043a205f8bc (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=quincy-c0f02e6, org.label-schema.license=GPLv2) 2024-02-28T16:04:56.381 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:56 smithi087 podman[82468]: 2024-02-28 16:04:56.213709729 +0000 UTC m=+0.889964734 container cleanup 5b73e8cf88cdd565834f15c7184d5b9d35a974dbe5afb299fb279043a205f8bc (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=quincy-c0f02e6) 2024-02-28T16:04:56.382 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:56 smithi087 bash[82468]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087 2024-02-28T16:04:56.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:56 smithi087 podman[82482]: 2024-02-28 16:04:56.389679387 +0000 UTC m=+0.589972212 container remove 5b73e8cf88cdd565834f15c7184d5b9d35a974dbe5afb299fb279043a205f8bc (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=quincy-c0f02e6, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:04:57.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:56 smithi087 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi087.service: Deactivated successfully. 2024-02-28T16:04:57.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:56 smithi087 systemd[1]: Stopped Ceph mon.smithi087 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:04:57.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:56 smithi087 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi087.service: Consumed 15.649s CPU time. 2024-02-28T16:04:57.614 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 systemd[1]: Starting Ceph mon.smithi087 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:04:57.920 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 podman[82609]: 2024-02-28 16:04:57.524780476 +0000 UTC m=+0.034579612 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:04:57.920 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 podman[82609]: 2024-02-28 16:04:57.674502668 +0000 UTC m=+0.184301823 container create d7f0d6f21c997fbee8eced862489d673fdf262cb07c9aff39dde719bff0347a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-28T16:04:57.920 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 podman[82609]: 2024-02-28 16:04:57.927918821 +0000 UTC m=+0.437717994 container init d7f0d6f21c997fbee8eced862489d673fdf262cb07c9aff39dde719bff0347a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-28T16:04:58.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 podman[82609]: 2024-02-28 16:04:57.937366335 +0000 UTC m=+0.447165508 container start d7f0d6f21c997fbee8eced862489d673fdf262cb07c9aff39dde719bff0347a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222) 2024-02-28T16:04:58.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T16:04:58.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev), process ceph-mon, pid 2 2024-02-28T16:04:58.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: pidfile_write: ignore empty --pid-file 2024-02-28T16:04:58.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: load: jerasure load: lrc 2024-02-28T16:04:58.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: RocksDB version: 7.9.2 2024-02-28T16:04:58.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Git sha 0 2024-02-28T16:04:58.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Compile date 2024-02-23 16:20:17 2024-02-28T16:04:58.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: DB SUMMARY 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: DB Session ID: ZCTYEF38ELQ59ZDA4GME 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: CURRENT file: CURRENT 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1090 Bytes 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi087/store.db dir, Total Num: 1, files: 000027.sst 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi087/store.db: 000025.log size: 6788171 ; 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.error_if_exists: 0 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.create_if_missing: 0 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.paranoid_checks: 1 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.env: 0x5600bf134b20 2024-02-28T16:04:58.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T16:04:58.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.info_log: 0x5600c17b77c0 2024-02-28T16:04:58.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T16:04:58.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.statistics: (nil) 2024-02-28T16:04:58.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.use_fsync: 0 2024-02-28T16:04:58.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_log_file_size: 0 2024-02-28T16:04:58.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T16:04:58.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T16:04:58.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T16:04:58.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T16:04:58.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.allow_fallocate: 1 2024-02-28T16:04:58.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T16:04:58.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T16:04:58.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.use_direct_reads: 0 2024-02-28T16:04:58.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T16:04:58.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T16:04:58.220 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.db_log_dir: 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.wal_dir: 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.write_buffer_manager: 0x5600c178b400 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T16:04:58.221 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.unordered_write: 0 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.row_cache: None 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.wal_filter: None 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T16:04:58.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.two_write_queues: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.wal_compression: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.atomic_flush: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.log_readahead_size: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T16:04:58.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_background_jobs: 2 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_background_compactions: -1 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_subcompactions: 1 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_open_files: -1 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T16:04:58.224 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_background_flushes: -1 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Compression algorithms supported: 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: kZSTD supported: 0 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: kXpressCompression supported: 0 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: kZlibCompression supported: 1 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: kSnappyCompression supported: 1 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: kLZ4Compression supported: 1 2024-02-28T16:04:58.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: kBZip2Compression supported: 0 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi087/store.db/MANIFEST-000009 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.merge_operator: 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_filter: None 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T16:04:58.226 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5600c17b78e0) 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: cache_index_and_filter_blocks: 1 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: pin_top_level_index_and_filter: 1 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_type: 0 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: data_block_index_type: 0 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_shortening: 1 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: checksum: 4 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: no_block_cache: 0 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache: 0x5600c17bb090 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_name: BinnedLRUCache 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_options: 2024-02-28T16:04:58.227 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: capacity : 536870912 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: num_shard_bits : 4 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: strict_capacity_limit : 0 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: high_pri_pool_ratio: 0.000 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_compressed: (nil) 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: persistent_cache: (nil) 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_size: 4096 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_size_deviation: 10 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_restart_interval: 16 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_block_restart_interval: 1 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: metadata_block_size: 4096 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: partition_filters: 0 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: use_delta_encoding: 1 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: filter_policy: bloomfilter 2024-02-28T16:04:58.228 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: whole_key_filtering: 1 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: verify_compression: 0 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: read_amp_bytes_per_bit: 0 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: format_version: 5 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: enable_index_compression: 1 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_align: 0 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: max_auto_readahead_size: 262144 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: prepopulate_block_cache: 0 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: initial_auto_readahead_size: 8192 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compression: NoCompression 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T16:04:58.229 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T16:04:58.230 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.num_levels: 7 2024-02-28T16:04:58.230 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:04:58.231 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T16:04:58.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T16:04:58.233 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.table_properties_collectors: 2024-02-28T16:04:58.234 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.inplace_update_support: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.bloom_locality: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.max_successive_merges: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.ttl: 2592000 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T16:04:58.235 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.enable_blob_files: false 2024-02-28T16:04:58.236 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.min_blob_size: 0 2024-02-28T16:04:58.236 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T16:04:58.236 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T16:04:58.236 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T16:04:58.236 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T16:04:58.236 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T16:04:58.236 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T16:04:58.236 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T16:04:58.236 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi087/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 13566, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c0285d63-bb73-4eba-a7c6-892f61a19f02 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136297994251, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:57 smithi087 ceph-mon[82628]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136298020249, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4111636, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13571, "largest_seqno": 15937, "table_properties": {"data_size": 4102417, "index_size": 5574, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2629, "raw_key_size": 22324, "raw_average_key_size": 21, "raw_value_size": 4082126, "raw_average_value_size": 3891, "num_data_blocks": 254, "num_entries": 1049, "num_filter_entries": 1049, "num_deletions": 253, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709136298, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c0285d63-bb73-4eba-a7c6-892f61a19f02", "db_session_id": "ZCTYEF38ELQ59ZDA4GME", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136298020709, "job": 1, "event": "recovery_finished"} 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi087/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5600c18aa000 2024-02-28T16:04:58.237 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: rocksdb: DB pointer 0x5600c1896000 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** DB Stats ** 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:04:58.238 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: L0 1/0 3.92 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 419.5 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: L6 1/0 5.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Sum 2/0 9.69 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 419.5 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 419.5 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 419.5 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-02-28T16:04:58.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:04:58.240 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:04:58.240 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:04:58.240 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:04:58.240 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative compaction: 0.00 GB write, 120.90 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:04:58.240 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval compaction: 0.00 GB write, 120.90 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:04:58.240 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:04:58.240 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Block cache BinnedLRUCache@0x5600c17bb090#2 capacity: 512.00 MB usage: 8.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-02-28T16:04:58.240 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.78 KB,0.000530481%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: starting mon.smithi087 rank 1 at public addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] at bind addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi087 fsid bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: mon.smithi087@-1(???) e2 preinit fsid bf04dacc-d650-11ee-95c3-87774f69a715 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: mon.smithi087@-1(???).mds e16 new map 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: mon.smithi087@-1(???).mds e16 print_map 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: e16 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: legacy client fscid: 1 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Filesystem 'cephfs' (1) 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: fs_name cephfs 2024-02-28T16:04:58.241 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: epoch 16 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: modified 2024-02-28T16:02:07.353165+0000 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: tableserver 0 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: root 0 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: session_timeout 60 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: session_autoclose 300 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: max_file_size 1099511627776 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: max_xattr_size 65536 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: required_client_features {} 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: last_failure 0 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: last_failure_osd_epoch 0 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: max_mds 2 2024-02-28T16:04:58.242 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: in 0,1 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: up {0=14452,1=24281} 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: failed 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: damaged 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: stopped 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: data_pools [3] 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: metadata_pool 2 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: inline_data disabled 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: balancer 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: bal_rank_mask -1 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: standby_count_wanted 1 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: [mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: [mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: [mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:58.243 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: [mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:04:58.244 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T16:04:58.244 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-02-28T16:04:58.244 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: mon.smithi087@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-28T16:04:58.244 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: mon.smithi087@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:04:58.244 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: mon.smithi087@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:04:58.244 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: mon.smithi087@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:04:58.244 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 ceph-mon[82628]: mon.smithi087@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-02-28T16:04:58.244 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 bash[82609]: d7f0d6f21c997fbee8eced862489d673fdf262cb07c9aff39dde719bff0347a9 2024-02-28T16:04:58.244 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:04:58 smithi087 systemd[1]: Started Ceph mon.smithi087 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:05:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T16:05:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: mon.smithi057 calling monitor election 2024-02-28T16:05:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: mon.smithi087 calling monitor election 2024-02-28T16:05:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T16:05:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: mon.smithi057 is new leader, mons smithi057,smithi087 in quorum (ranks 0,1) 2024-02-28T16:05:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: monmap e3: 2 mons at {smithi057=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:05:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:05:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:05:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: mgrmap e38: smithi057.upqerc(active, since 25s), standbys: smithi087.ewrszc 2024-02-28T16:05:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: overall HEALTH_OK 2024-02-28T16:05:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:05:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi057"}]: dispatch 2024-02-28T16:05:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: mon.smithi057 calling monitor election 2024-02-28T16:05:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: mon.smithi087 calling monitor election 2024-02-28T16:05:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-02-28T16:05:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: mon.smithi057 is new leader, mons smithi057,smithi087 in quorum (ranks 0,1) 2024-02-28T16:05:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: monmap e3: 2 mons at {smithi057=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:05:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:05:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:05:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: mgrmap e38: smithi057.upqerc(active, since 25s), standbys: smithi087.ewrszc 2024-02-28T16:05:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: overall HEALTH_OK 2024-02-28T16:05:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:05:01.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:01 smithi087 ceph-mon[82628]: pgmap v16: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:01.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:01 smithi057 ceph-mon[93219]: pgmap v16: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:03.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:03 smithi057 ceph-mon[93219]: pgmap v17: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:03.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:03 smithi087 ceph-mon[82628]: pgmap v17: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:04.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:05:04.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:04.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:04.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:05:04.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:04.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:05.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:05 smithi057 ceph-mon[93219]: pgmap v18: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:05.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:05 smithi087 ceph-mon[82628]: pgmap v18: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:07.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:07 smithi087 ceph-mon[82628]: pgmap v19: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:07.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:07.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:07 smithi057 ceph-mon[93219]: pgmap v19: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:07.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.655+0000 7fc0f1200700 1 -- 172.21.15.57:0/1915817032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0ec100360 msgr2=0x7fc0ec1007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.655+0000 7fc0f1200700 1 --2- 172.21.15.57:0/1915817032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0ec100360 0x7fc0ec1007b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8004940 tx=0x7fc0d8009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.656+0000 7fc0f1200700 1 -- 172.21.15.57:0/1915817032 shutdown_connections 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.656+0000 7fc0f1200700 1 --2- 172.21.15.57:0/1915817032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0ec100360 0x7fc0ec1007b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.656+0000 7fc0f1200700 1 --2- 172.21.15.57:0/1915817032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec0ff150 0x7fc0ec0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.656+0000 7fc0f1200700 1 -- 172.21.15.57:0/1915817032 >> 172.21.15.57:0/1915817032 conn(0x7fc0ec0fa920 msgr2=0x7fc0ec0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.656+0000 7fc0f1200700 1 -- 172.21.15.57:0/1915817032 shutdown_connections 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.656+0000 7fc0f1200700 1 -- 172.21.15.57:0/1915817032 wait complete. 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.656+0000 7fc0f1200700 1 Processor -- start 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.657+0000 7fc0f1200700 1 -- start start 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.657+0000 7fc0f1200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec0ff150 0x7fc0ec10fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.657+0000 7fc0f1200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0ec100360 0x7fc0ec1100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.657+0000 7fc0f1200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec1106b0 con 0x7fc0ec100360 2024-02-28T16:05:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.657+0000 7fc0f1200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec110f50 con 0x7fc0ec0ff150 2024-02-28T16:05:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.657+0000 7fc0e9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0ec100360 0x7fc0ec1100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.657+0000 7fc0e9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0ec100360 0x7fc0ec1100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59808/0 (socket says 172.21.15.57:59808) 2024-02-28T16:05:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.657+0000 7fc0e9400700 1 -- 172.21.15.57:0/472192227 learned_addr learned my addr 172.21.15.57:0/472192227 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.658+0000 7fc0e9e00700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec0ff150 0x7fc0ec10fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.658+0000 7fc0e9400700 1 -- 172.21.15.57:0/472192227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec0ff150 msgr2=0x7fc0ec10fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.658+0000 7fc0e9400700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec0ff150 0x7fc0ec10fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.658+0000 7fc0e9400700 1 -- 172.21.15.57:0/472192227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8005040 con 0x7fc0ec100360 2024-02-28T16:05:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.658+0000 7fc0e9e00700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec0ff150 0x7fc0ec10fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:05:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.658+0000 7fc0e9400700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0ec100360 0x7fc0ec1100b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800b3b0 tx=0x7fc0d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.658+0000 7fc0e2000700 1 -- 172.21.15.57:0/472192227 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0d800e040 con 0x7fc0ec100360 2024-02-28T16:05:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.658+0000 7fc0e2000700 1 -- 172.21.15.57:0/472192227 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0d800bd90 con 0x7fc0ec100360 2024-02-28T16:05:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.659+0000 7fc0f1200700 1 -- 172.21.15.57:0/472192227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ec1111d0 con 0x7fc0ec100360 2024-02-28T16:05:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.659+0000 7fc0e2000700 1 -- 172.21.15.57:0/472192227 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0d801c630 con 0x7fc0ec100360 2024-02-28T16:05:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.659+0000 7fc0f1200700 1 -- 172.21.15.57:0/472192227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ec111710 con 0x7fc0ec100360 2024-02-28T16:05:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.660+0000 7fc0f1200700 1 -- 172.21.15.57:0/472192227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ec04bed0 con 0x7fc0ec100360 2024-02-28T16:05:07.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.661+0000 7fc0e2000700 1 -- 172.21.15.57:0/472192227 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fc0d80139f0 con 0x7fc0ec100360 2024-02-28T16:05:07.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.662+0000 7fc0e2000700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0d006d900 0x7fc0d006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:07.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.662+0000 7fc0e2000700 1 -- 172.21.15.57:0/472192227 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc0d808e5f0 con 0x7fc0ec100360 2024-02-28T16:05:07.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.662+0000 7fc0e9e00700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0d006d900 0x7fc0d006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:07.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.663+0000 7fc0e9e00700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0d006d900 0x7fc0d006fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009fd0 tx=0x7fc0dc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:07.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.668+0000 7fc0e2000700 1 -- 172.21.15.57:0/472192227 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc0d805b800 con 0x7fc0ec100360 2024-02-28T16:05:07.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.920+0000 7fc0f1200700 1 -- 172.21.15.57:0/472192227 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0ec111bb0 con 0x7fc0d006d900 2024-02-28T16:05:07.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.923+0000 7fc0e2000700 1 -- 172.21.15.57:0/472192227 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fc0ec111bb0 con 0x7fc0d006d900 2024-02-28T16:05:07.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.926+0000 7fc0f1200700 1 -- 172.21.15.57:0/472192227 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0d006d900 msgr2=0x7fc0d006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.926+0000 7fc0f1200700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0d006d900 0x7fc0d006fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009fd0 tx=0x7fc0dc00b040 comp rx=0 tx=0).stop 2024-02-28T16:05:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.926+0000 7fc0f1200700 1 -- 172.21.15.57:0/472192227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0ec100360 msgr2=0x7fc0ec1100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.926+0000 7fc0f1200700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0ec100360 0x7fc0ec1100b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800b3b0 tx=0x7fc0d8009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.927+0000 7fc0f1200700 1 -- 172.21.15.57:0/472192227 shutdown_connections 2024-02-28T16:05:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.927+0000 7fc0f1200700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0d006d900 0x7fc0d006fdb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.927+0000 7fc0f1200700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec0ff150 0x7fc0ec10fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.927+0000 7fc0f1200700 1 --2- 172.21.15.57:0/472192227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0ec100360 0x7fc0ec1100b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.927+0000 7fc0f1200700 1 -- 172.21.15.57:0/472192227 >> 172.21.15.57:0/472192227 conn(0x7fc0ec0fa920 msgr2=0x7fc0ec103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:07.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.927+0000 7fc0f1200700 1 -- 172.21.15.57:0/472192227 shutdown_connections 2024-02-28T16:05:07.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:07.927+0000 7fc0f1200700 1 -- 172.21.15.57:0/472192227 wait complete. 2024-02-28T16:05:07.936 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:05:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.091+0000 7f191e200700 1 -- 172.21.15.57:0/3839156859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918070860 msgr2=0x7f1918070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.091+0000 7f191e200700 1 --2- 172.21.15.57:0/3839156859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918070860 0x7f1918070cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1904004940 tx=0x7f1904009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.092+0000 7f191e200700 1 -- 172.21.15.57:0/3839156859 shutdown_connections 2024-02-28T16:05:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.092+0000 7f191e200700 1 --2- 172.21.15.57:0/3839156859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918070860 0x7f1918070cd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.092+0000 7f191e200700 1 --2- 172.21.15.57:0/3839156859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1918071eb0 0x7f1918070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.092+0000 7f191e200700 1 -- 172.21.15.57:0/3839156859 >> 172.21.15.57:0/3839156859 conn(0x7f19180f8620 msgr2=0x7f19180faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.092+0000 7f191e200700 1 -- 172.21.15.57:0/3839156859 shutdown_connections 2024-02-28T16:05:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.092+0000 7f191e200700 1 -- 172.21.15.57:0/3839156859 wait complete. 2024-02-28T16:05:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.093+0000 7f191e200700 1 Processor -- start 2024-02-28T16:05:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.093+0000 7f191e200700 1 -- start start 2024-02-28T16:05:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f191e200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1918070860 0x7f191810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f191e200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918071eb0 0x7f1918110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f191e200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918110680 con 0x7f1918071eb0 2024-02-28T16:05:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f191e200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918110f20 con 0x7f1918070860 2024-02-28T16:05:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f1916a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918071eb0 0x7f1918110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f1916a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918071eb0 0x7f1918110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59820/0 (socket says 172.21.15.57:59820) 2024-02-28T16:05:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f1916a00700 1 -- 172.21.15.57:0/670619620 learned_addr learned my addr 172.21.15.57:0/670619620 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f1917400700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1918070860 0x7f191810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f1916a00700 1 -- 172.21.15.57:0/670619620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1918070860 msgr2=0x7f191810fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f1916a00700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1918070860 0x7f191810fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.094+0000 7f1916a00700 1 -- 172.21.15.57:0/670619620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1904005040 con 0x7f1918071eb0 2024-02-28T16:05:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.095+0000 7f1916a00700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918071eb0 0x7f1918110080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f190400b3b0 tx=0x7f1904009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.095+0000 7f190f400700 1 -- 172.21.15.57:0/670619620 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190400e040 con 0x7f1918071eb0 2024-02-28T16:05:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.095+0000 7f190f400700 1 -- 172.21.15.57:0/670619620 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f190400bd90 con 0x7f1918071eb0 2024-02-28T16:05:08.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.095+0000 7f191e200700 1 -- 172.21.15.57:0/670619620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19181111a0 con 0x7f1918071eb0 2024-02-28T16:05:08.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.095+0000 7f190f400700 1 -- 172.21.15.57:0/670619620 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190401c630 con 0x7f1918071eb0 2024-02-28T16:05:08.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.095+0000 7f191e200700 1 -- 172.21.15.57:0/670619620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19181116e0 con 0x7f1918071eb0 2024-02-28T16:05:08.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.096+0000 7f191e200700 1 -- 172.21.15.57:0/670619620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191804bed0 con 0x7f1918071eb0 2024-02-28T16:05:08.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.098+0000 7f190f400700 1 -- 172.21.15.57:0/670619620 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f19040139f0 con 0x7f1918071eb0 2024-02-28T16:05:08.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.099+0000 7f190f400700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f18fc06d900 0x7f18fc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:08.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.099+0000 7f190f400700 1 -- 172.21.15.57:0/670619620 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f190408e5f0 con 0x7f1918071eb0 2024-02-28T16:05:08.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.099+0000 7f1917400700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f18fc06d900 0x7f18fc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:08.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.100+0000 7f1917400700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f18fc06d900 0x7f18fc06fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1908004990 tx=0x7f1908009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:08.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.103+0000 7f190f400700 1 -- 172.21.15.57:0/670619620 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f190405b800 con 0x7f1918071eb0 2024-02-28T16:05:08.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.350+0000 7f191e200700 1 -- 172.21.15.57:0/670619620 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1918104550 con 0x7f18fc06d900 2024-02-28T16:05:08.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.353+0000 7f190f400700 1 -- 172.21.15.57:0/670619620 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1918104550 con 0x7f18fc06d900 2024-02-28T16:05:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 -- 172.21.15.57:0/670619620 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f18fc06d900 msgr2=0x7f18fc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f18fc06d900 0x7f18fc06fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1908004990 tx=0x7f1908009ee0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 -- 172.21.15.57:0/670619620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918071eb0 msgr2=0x7f1918110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918071eb0 0x7f1918110080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f190400b3b0 tx=0x7f1904009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 -- 172.21.15.57:0/670619620 shutdown_connections 2024-02-28T16:05:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f18fc06d900 0x7f18fc06fdb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1918070860 0x7f191810fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 --2- 172.21.15.57:0/670619620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1918071eb0 0x7f1918110080 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 -- 172.21.15.57:0/670619620 >> 172.21.15.57:0/670619620 conn(0x7f19180f8620 msgr2=0x7f1918102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 -- 172.21.15.57:0/670619620 shutdown_connections 2024-02-28T16:05:08.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.356+0000 7f191e200700 1 -- 172.21.15.57:0/670619620 wait complete. 2024-02-28T16:05:08.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.512+0000 7f7d65000700 1 -- 172.21.15.57:0/616665767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d600ff150 msgr2=0x7f7d600ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:08.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.512+0000 7f7d65000700 1 --2- 172.21.15.57:0/616665767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d600ff150 0x7f7d600ff560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d50004940 tx=0x7f7d50009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:08.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.512+0000 7f7d65000700 1 -- 172.21.15.57:0/616665767 shutdown_connections 2024-02-28T16:05:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.512+0000 7f7d65000700 1 --2- 172.21.15.57:0/616665767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d60100360 0x7f7d601007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.512+0000 7f7d65000700 1 --2- 172.21.15.57:0/616665767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d600ff150 0x7f7d600ff560 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.512+0000 7f7d65000700 1 -- 172.21.15.57:0/616665767 >> 172.21.15.57:0/616665767 conn(0x7f7d600fa920 msgr2=0x7f7d600fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.512+0000 7f7d65000700 1 -- 172.21.15.57:0/616665767 shutdown_connections 2024-02-28T16:05:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.513+0000 7f7d65000700 1 -- 172.21.15.57:0/616665767 wait complete. 2024-02-28T16:05:08.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.513+0000 7f7d65000700 1 Processor -- start 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.514+0000 7f7d65000700 1 -- start start 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.514+0000 7f7d65000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d600ff150 0x7f7d6010faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.514+0000 7f7d65000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d60100360 0x7f7d60110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.514+0000 7f7d65000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d60110630 con 0x7f7d60100360 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.514+0000 7f7d65000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d60110ed0 con 0x7f7d600ff150 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.514+0000 7f7d5d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d60100360 0x7f7d60110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.514+0000 7f7d5d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d60100360 0x7f7d60110030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59850/0 (socket says 172.21.15.57:59850) 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.514+0000 7f7d5d400700 1 -- 172.21.15.57:0/3731925217 learned_addr learned my addr 172.21.15.57:0/3731925217 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.514+0000 7f7d5de00700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d600ff150 0x7f7d6010faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.515+0000 7f7d5de00700 1 -- 172.21.15.57:0/3731925217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d60100360 msgr2=0x7f7d60110030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.515+0000 7f7d5de00700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d60100360 0x7f7d60110030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.515+0000 7f7d5de00700 1 -- 172.21.15.57:0/3731925217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d50005040 con 0x7f7d600ff150 2024-02-28T16:05:08.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.515+0000 7f7d5d400700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d60100360 0x7f7d60110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:05:08.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.515+0000 7f7d5de00700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d600ff150 0x7f7d6010faf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d50000c00 tx=0x7f7d50009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:08.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.515+0000 7f7d56000700 1 -- 172.21.15.57:0/3731925217 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d5000e070 con 0x7f7d600ff150 2024-02-28T16:05:08.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.515+0000 7f7d65000700 1 -- 172.21.15.57:0/3731925217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d60111150 con 0x7f7d600ff150 2024-02-28T16:05:08.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.516+0000 7f7d65000700 1 -- 172.21.15.57:0/3731925217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d60111630 con 0x7f7d600ff150 2024-02-28T16:05:08.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.516+0000 7f7d56000700 1 -- 172.21.15.57:0/3731925217 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d50026460 con 0x7f7d600ff150 2024-02-28T16:05:08.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.516+0000 7f7d56000700 1 -- 172.21.15.57:0/3731925217 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d5001c620 con 0x7f7d600ff150 2024-02-28T16:05:08.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.517+0000 7f7d65000700 1 -- 172.21.15.57:0/3731925217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6004bed0 con 0x7f7d600ff150 2024-02-28T16:05:08.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.518+0000 7f7d56000700 1 -- 172.21.15.57:0/3731925217 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f7d50026a60 con 0x7f7d600ff150 2024-02-28T16:05:08.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.519+0000 7f7d56000700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7d4406d900 0x7f7d4406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:08.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.519+0000 7f7d56000700 1 -- 172.21.15.57:0/3731925217 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7d5008f200 con 0x7f7d600ff150 2024-02-28T16:05:08.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.519+0000 7f7d5d400700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7d4406d900 0x7f7d4406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:08.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.520+0000 7f7d5d400700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7d4406d900 0x7f7d4406fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0041d0 tx=0x7f7d4c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:08.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.542+0000 7f7d56000700 1 -- 172.21.15.57:0/3731925217 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7d5005c5f0 con 0x7f7d600ff150 2024-02-28T16:05:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.782+0000 7f7d65000700 1 -- 172.21.15.57:0/3731925217 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d60111a70 con 0x7f7d4406d900 2024-02-28T16:05:08.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.801+0000 7f7d56000700 1 -- 172.21.15.57:0/3731925217 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7d60111a70 con 0x7f7d4406d900 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (3m) 27s ago 14m 14.8M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (14m) 27s ago 14m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (13m) 4s ago 13m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (2m) 27s ago 13m 76.0M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (7m) 27s ago 7m 127M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (6m) 27s ago 6m 68.2M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (6m) 4s ago 6m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (6m) 4s ago 6m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (2m) 27s ago 15m 477M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (71s) 4s ago 12m 448M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (47s) 27s ago 16m 31.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:05:08.795 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (11s) 4s ago 12m 22.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:05:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (3m) 27s ago 14m 7746k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:05:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (2m) 4s ago 12m 7726k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:05:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (11m) 27s ago 11m 213M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:05:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (11m) 27s ago 11m 233M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:05:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (10m) 27s ago 10m 192M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:05:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (9m) 4s ago 9m 260M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:05:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (9m) 4s ago 9m 236M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:05:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (8m) 4s ago 8m 219M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:05:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (83s) 27s ago 13m 42.6M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:05:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 -- 172.21.15.57:0/3731925217 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7d4406d900 msgr2=0x7f7d4406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7d4406d900 0x7f7d4406fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0041d0 tx=0x7f7d4c00b040 comp rx=0 tx=0).stop 2024-02-28T16:05:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 -- 172.21.15.57:0/3731925217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d600ff150 msgr2=0x7f7d6010faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d600ff150 0x7f7d6010faf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d50000c00 tx=0x7f7d50009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 -- 172.21.15.57:0/3731925217 shutdown_connections 2024-02-28T16:05:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7d4406d900 0x7f7d4406fdb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d600ff150 0x7f7d6010faf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 --2- 172.21.15.57:0/3731925217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d60100360 0x7f7d60110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 -- 172.21.15.57:0/3731925217 >> 172.21.15.57:0/3731925217 conn(0x7f7d600fa920 msgr2=0x7f7d60103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:08.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 -- 172.21.15.57:0/3731925217 shutdown_connections 2024-02-28T16:05:08.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.804+0000 7f7d65000700 1 -- 172.21.15.57:0/3731925217 wait complete. 2024-02-28T16:05:08.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.965+0000 7f19ad600700 1 -- 172.21.15.57:0/1773422933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19a8104750 msgr2=0x7f19a8104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:08.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.965+0000 7f19ad600700 1 --2- 172.21.15.57:0/1773422933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19a8104750 0x7f19a8104ba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1990004940 tx=0x7f1990009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:08.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.965+0000 7f19ad600700 1 -- 172.21.15.57:0/1773422933 shutdown_connections 2024-02-28T16:05:08.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.965+0000 7f19ad600700 1 --2- 172.21.15.57:0/1773422933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19a8104750 0x7f19a8104ba0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.965+0000 7f19ad600700 1 --2- 172.21.15.57:0/1773422933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a8103540 0x7f19a8103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.965+0000 7f19ad600700 1 -- 172.21.15.57:0/1773422933 >> 172.21.15.57:0/1773422933 conn(0x7f19a80727d0 msgr2=0x7f19a8074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:08.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.965+0000 7f19ad600700 1 -- 172.21.15.57:0/1773422933 shutdown_connections 2024-02-28T16:05:08.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.965+0000 7f19ad600700 1 -- 172.21.15.57:0/1773422933 wait complete. 2024-02-28T16:05:08.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.966+0000 7f19ad600700 1 Processor -- start 2024-02-28T16:05:08.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.966+0000 7f19ad600700 1 -- start start 2024-02-28T16:05:08.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f19ad600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a8103540 0x7f19a8113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:08.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f19ad600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19a8104750 0x7f19a81144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:08.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f19ad600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a8114aa0 con 0x7f19a8104750 2024-02-28T16:05:08.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f19ad600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a8115340 con 0x7f19a8103540 2024-02-28T16:05:08.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f199fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19a8104750 0x7f19a81144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f199fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19a8104750 0x7f19a81144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59856/0 (socket says 172.21.15.57:59856) 2024-02-28T16:05:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f199fe00700 1 -- 172.21.15.57:0/2885028311 learned_addr learned my addr 172.21.15.57:0/2885028311 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f19a6a00700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a8103540 0x7f19a8113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f199fe00700 1 -- 172.21.15.57:0/2885028311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a8103540 msgr2=0x7f19a8113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f199fe00700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a8103540 0x7f19a8113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.967+0000 7f199fe00700 1 -- 172.21.15.57:0/2885028311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1990005040 con 0x7f19a8104750 2024-02-28T16:05:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.968+0000 7f199fe00700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19a8104750 0x7f19a81144a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19900093b0 tx=0x7f1990009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:08.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.968+0000 7f199ea00700 1 -- 172.21.15.57:0/2885028311 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f199000e040 con 0x7f19a8104750 2024-02-28T16:05:08.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.968+0000 7f199ea00700 1 -- 172.21.15.57:0/2885028311 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f199000bcc0 con 0x7f19a8104750 2024-02-28T16:05:08.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.968+0000 7f199ea00700 1 -- 172.21.15.57:0/2885028311 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f199001c630 con 0x7f19a8104750 2024-02-28T16:05:08.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.968+0000 7f19ad600700 1 -- 172.21.15.57:0/2885028311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a81155c0 con 0x7f19a8104750 2024-02-28T16:05:08.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.968+0000 7f19ad600700 1 -- 172.21.15.57:0/2885028311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a8115ab0 con 0x7f19a8104750 2024-02-28T16:05:08.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.970+0000 7f19ad600700 1 -- 172.21.15.57:0/2885028311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a804bed0 con 0x7f19a8104750 2024-02-28T16:05:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.971+0000 7f199ea00700 1 -- 172.21.15.57:0/2885028311 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f19900139f0 con 0x7f19a8104750 2024-02-28T16:05:08.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.972+0000 7f199ea00700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f198c06d900 0x7f198c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:08.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.972+0000 7f199ea00700 1 -- 172.21.15.57:0/2885028311 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f199008e5f0 con 0x7f19a8104750 2024-02-28T16:05:08.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.972+0000 7f19a6a00700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f198c06d900 0x7f198c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:08.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.973+0000 7f19a6a00700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f198c06d900 0x7f198c06fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1998009fd0 tx=0x7f1998009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:08.977+0000 7f199ea00700 1 -- 172.21.15.57:0/2885028311 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f199005b780 con 0x7f19a8104750 2024-02-28T16:05:09.148 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:09 smithi087 ceph-mon[82628]: pgmap v20: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:09.148 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:09 smithi087 ceph-mon[82628]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:09.148 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:09 smithi087 ceph-mon[82628]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.291+0000 7f19ad600700 1 -- 172.21.15.57:0/2885028311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19a810c020 con 0x7f19a8104750 2024-02-28T16:05:09.285 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:09 smithi057 ceph-mon[93219]: pgmap v20: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:09.285 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:09 smithi057 ceph-mon[93219]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:09.285 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:09 smithi057 ceph-mon[93219]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:09.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.292+0000 7f199ea00700 1 -- 172.21.15.57:0/2885028311 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f199005b310 con 0x7f19a8104750 2024-02-28T16:05:09.286 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:05:09.286 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:05:09.286 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:05:09.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:05:09.286 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:05:09.286 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:05:09.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:05:09.287 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:05:09.287 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:05:09.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:05:09.287 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:05:09.287 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:05:09.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:05:09.287 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:05:09.287 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 10, 2024-02-28T16:05:09.287 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:05:09.287 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:05:09.288 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.295+0000 7f19ad600700 1 -- 172.21.15.57:0/2885028311 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f198c06d900 msgr2=0x7f198c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.295+0000 7f19ad600700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f198c06d900 0x7f198c06fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1998009fd0 tx=0x7f1998009f00 comp rx=0 tx=0).stop 2024-02-28T16:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.295+0000 7f19ad600700 1 -- 172.21.15.57:0/2885028311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19a8104750 msgr2=0x7f19a81144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.295+0000 7f19ad600700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19a8104750 0x7f19a81144a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19900093b0 tx=0x7f1990009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.296+0000 7f19ad600700 1 -- 172.21.15.57:0/2885028311 shutdown_connections 2024-02-28T16:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.296+0000 7f19ad600700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f198c06d900 0x7f198c06fdb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.296+0000 7f19ad600700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a8103540 0x7f19a8113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.296+0000 7f19ad600700 1 --2- 172.21.15.57:0/2885028311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19a8104750 0x7f19a81144a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.296+0000 7f19ad600700 1 -- 172.21.15.57:0/2885028311 >> 172.21.15.57:0/2885028311 conn(0x7f19a80727d0 msgr2=0x7f19a8107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.296+0000 7f19ad600700 1 -- 172.21.15.57:0/2885028311 shutdown_connections 2024-02-28T16:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.296+0000 7f19ad600700 1 -- 172.21.15.57:0/2885028311 wait complete. 2024-02-28T16:05:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.449+0000 7f9ba1000700 1 -- 172.21.15.57:0/774822257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b9c070840 msgr2=0x7f9b9c070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.449+0000 7f9ba1000700 1 --2- 172.21.15.57:0/774822257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b9c070840 0x7f9b9c070cb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b88004940 tx=0x7f9b88009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.450+0000 7f9ba1000700 1 -- 172.21.15.57:0/774822257 shutdown_connections 2024-02-28T16:05:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.450+0000 7f9ba1000700 1 --2- 172.21.15.57:0/774822257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b9c070840 0x7f9b9c070cb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.450+0000 7f9ba1000700 1 --2- 172.21.15.57:0/774822257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b9c071e90 0x7f9b9c070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.450+0000 7f9ba1000700 1 -- 172.21.15.57:0/774822257 >> 172.21.15.57:0/774822257 conn(0x7f9b9c0f8620 msgr2=0x7f9b9c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:09.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.450+0000 7f9ba1000700 1 -- 172.21.15.57:0/774822257 shutdown_connections 2024-02-28T16:05:09.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.450+0000 7f9ba1000700 1 -- 172.21.15.57:0/774822257 wait complete. 2024-02-28T16:05:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.451+0000 7f9ba1000700 1 Processor -- start 2024-02-28T16:05:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.451+0000 7f9ba1000700 1 -- start start 2024-02-28T16:05:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.451+0000 7f9ba1000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b9c070840 0x7f9b9c10fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.451+0000 7f9ba1000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b9c071e90 0x7f9b9c110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.451+0000 7f9ba1000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c110680 con 0x7f9b9c070840 2024-02-28T16:05:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.451+0000 7f9ba1000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c110f20 con 0x7f9b9c071e90 2024-02-28T16:05:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.452+0000 7f9b99e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b9c070840 0x7f9b9c10fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.452+0000 7f9b99e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b9c070840 0x7f9b9c10fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59868/0 (socket says 172.21.15.57:59868) 2024-02-28T16:05:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.452+0000 7f9b99e00700 1 -- 172.21.15.57:0/4032011959 learned_addr learned my addr 172.21.15.57:0/4032011959 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.452+0000 7f9b99400700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b9c071e90 0x7f9b9c110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.452+0000 7f9b99e00700 1 -- 172.21.15.57:0/4032011959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b9c071e90 msgr2=0x7f9b9c110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.452+0000 7f9b99e00700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b9c071e90 0x7f9b9c110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.452+0000 7f9b99e00700 1 -- 172.21.15.57:0/4032011959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88005040 con 0x7f9b9c070840 2024-02-28T16:05:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.452+0000 7f9b99e00700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b9c070840 0x7f9b9c10fb40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c002a50 tx=0x7f9b8c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:09.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.453+0000 7f9b92000700 1 -- 172.21.15.57:0/4032011959 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b8c007cc0 con 0x7f9b9c070840 2024-02-28T16:05:09.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.453+0000 7f9b92000700 1 -- 172.21.15.57:0/4032011959 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b8c00f040 con 0x7f9b9c070840 2024-02-28T16:05:09.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.453+0000 7f9b92000700 1 -- 172.21.15.57:0/4032011959 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b8c00da30 con 0x7f9b9c070840 2024-02-28T16:05:09.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.453+0000 7f9ba1000700 1 -- 172.21.15.57:0/4032011959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9c111200 con 0x7f9b9c070840 2024-02-28T16:05:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.453+0000 7f9ba1000700 1 -- 172.21.15.57:0/4032011959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c111740 con 0x7f9b9c070840 2024-02-28T16:05:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.454+0000 7f9ba1000700 1 -- 172.21.15.57:0/4032011959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c04bed0 con 0x7f9b9c070840 2024-02-28T16:05:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.455+0000 7f9b92000700 1 -- 172.21.15.57:0/4032011959 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f9b8c00db90 con 0x7f9b9c070840 2024-02-28T16:05:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.457+0000 7f9b92000700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9b8006d900 0x7f9b8006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.457+0000 7f9b92000700 1 -- 172.21.15.57:0/4032011959 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9b8c08ce30 con 0x7f9b9c070840 2024-02-28T16:05:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.457+0000 7f9b99400700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9b8006d900 0x7f9b8006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.458+0000 7f9b99400700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9b8006d900 0x7f9b8006fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800b7a0 tx=0x7f9b88009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:09.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.462+0000 7f9b92000700 1 -- 172.21.15.57:0/4032011959 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9b8c059fc0 con 0x7f9b9c070840 2024-02-28T16:05:09.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.729+0000 7f9ba1000700 1 -- 172.21.15.57:0/4032011959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9b9c111b40 con 0x7f9b9c070840 2024-02-28T16:05:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.730+0000 7f9b92000700 1 -- 172.21.15.57:0/4032011959 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1897 (secure 0 0 0) 0x7f9b8c059b50 con 0x7f9b9c070840 2024-02-28T16:05:09.723 INFO:teuthology.orchestra.run.smithi057.stdout:e16 2024-02-28T16:05:09.723 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:05:09.723 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 16 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:02:07.353165+0000 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:05:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:05:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:05:09.726 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:05:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 -- 172.21.15.57:0/4032011959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9b8006d900 msgr2=0x7f9b8006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9b8006d900 0x7f9b8006fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800b7a0 tx=0x7f9b88009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 -- 172.21.15.57:0/4032011959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b9c070840 msgr2=0x7f9b9c10fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b9c070840 0x7f9b9c10fb40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c002a50 tx=0x7f9b8c0046b0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 -- 172.21.15.57:0/4032011959 shutdown_connections 2024-02-28T16:05:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9b8006d900 0x7f9b8006fdb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b9c070840 0x7f9b9c10fb40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 --2- 172.21.15.57:0/4032011959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b9c071e90 0x7f9b9c110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 -- 172.21.15.57:0/4032011959 >> 172.21.15.57:0/4032011959 conn(0x7f9b9c0f8620 msgr2=0x7f9b9c102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 -- 172.21.15.57:0/4032011959 shutdown_connections 2024-02-28T16:05:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.734+0000 7f9ba1000700 1 -- 172.21.15.57:0/4032011959 wait complete. 2024-02-28T16:05:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2024-02-28T16:05:09.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.890+0000 7fb1a6600700 1 -- 172.21.15.57:0/28375543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a00fda80 msgr2=0x7fb1a00ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:09.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.890+0000 7fb1a6600700 1 --2- 172.21.15.57:0/28375543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a00fda80 0x7fb1a00ffe60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb190004940 tx=0x7fb190009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:09.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.890+0000 7fb1a6600700 1 -- 172.21.15.57:0/28375543 shutdown_connections 2024-02-28T16:05:09.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.890+0000 7fb1a6600700 1 --2- 172.21.15.57:0/28375543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1a01003a0 0x7fb1a0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.890+0000 7fb1a6600700 1 --2- 172.21.15.57:0/28375543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a00fda80 0x7fb1a00ffe60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.890+0000 7fb1a6600700 1 -- 172.21.15.57:0/28375543 >> 172.21.15.57:0/28375543 conn(0x7fb1a00f74e0 msgr2=0x7fb1a00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:09.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.890+0000 7fb1a6600700 1 -- 172.21.15.57:0/28375543 shutdown_connections 2024-02-28T16:05:09.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.891+0000 7fb1a6600700 1 -- 172.21.15.57:0/28375543 wait complete. 2024-02-28T16:05:09.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.891+0000 7fb1a6600700 1 Processor -- start 2024-02-28T16:05:09.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.892+0000 7fb1a6600700 1 -- start start 2024-02-28T16:05:09.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.892+0000 7fb1a6600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a00fda80 0x7fb1a010fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.892+0000 7fb1a6600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1a01003a0 0x7fb1a0110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.892+0000 7fb1a6600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a0110670 con 0x7fb1a00fda80 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.892+0000 7fb1a6600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a0110f10 con 0x7fb1a01003a0 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.892+0000 7fb19f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a00fda80 0x7fb1a010fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.892+0000 7fb19f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a00fda80 0x7fb1a010fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59880/0 (socket says 172.21.15.57:59880) 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.892+0000 7fb19f400700 1 -- 172.21.15.57:0/3243830144 learned_addr learned my addr 172.21.15.57:0/3243830144 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.892+0000 7fb19ea00700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1a01003a0 0x7fb1a0110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.893+0000 7fb19f400700 1 -- 172.21.15.57:0/3243830144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1a01003a0 msgr2=0x7fb1a0110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.893+0000 7fb19f400700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1a01003a0 0x7fb1a0110070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.893+0000 7fb19f400700 1 -- 172.21.15.57:0/3243830144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190005040 con 0x7fb1a00fda80 2024-02-28T16:05:09.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.893+0000 7fb19ea00700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1a01003a0 0x7fb1a0110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:05:09.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.893+0000 7fb19f400700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a00fda80 0x7fb1a010fb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb190009fd0 tx=0x7fb190009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:09.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.893+0000 7fb197400700 1 -- 172.21.15.57:0/3243830144 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb19000e040 con 0x7fb1a00fda80 2024-02-28T16:05:09.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.893+0000 7fb197400700 1 -- 172.21.15.57:0/3243830144 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb19000bcc0 con 0x7fb1a00fda80 2024-02-28T16:05:09.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.893+0000 7fb1a6600700 1 -- 172.21.15.57:0/3243830144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a0111190 con 0x7fb1a00fda80 2024-02-28T16:05:09.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.894+0000 7fb197400700 1 -- 172.21.15.57:0/3243830144 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb19001c630 con 0x7fb1a00fda80 2024-02-28T16:05:09.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.894+0000 7fb1a6600700 1 -- 172.21.15.57:0/3243830144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a01116d0 con 0x7fb1a00fda80 2024-02-28T16:05:09.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.895+0000 7fb1a6600700 1 -- 172.21.15.57:0/3243830144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a004bed0 con 0x7fb1a00fda80 2024-02-28T16:05:09.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.896+0000 7fb197400700 1 -- 172.21.15.57:0/3243830144 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fb190013980 con 0x7fb1a00fda80 2024-02-28T16:05:09.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.896+0000 7fb197400700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb18406d900 0x7fb18406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:09.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.897+0000 7fb197400700 1 -- 172.21.15.57:0/3243830144 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb19008e650 con 0x7fb1a00fda80 2024-02-28T16:05:09.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.897+0000 7fb19ea00700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb18406d900 0x7fb18406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:09.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.898+0000 7fb19ea00700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb18406d900 0x7fb18406fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb18c007fd0 tx=0x7fb18c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:09.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:09.901+0000 7fb197400700 1 -- 172.21.15.57:0/3243830144 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb19005b7e0 con 0x7fb1a00fda80 2024-02-28T16:05:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.145+0000 7fb1a6600700 1 -- 172.21.15.57:0/3243830144 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1a00fbf80 con 0x7fb18406d900 2024-02-28T16:05:10.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.147+0000 7fb197400700 1 -- 172.21.15.57:0/3243830144 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb1a00fbf80 con 0x7fb18406d900 2024-02-28T16:05:10.140 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:05:10.140 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:05:10.140 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:05:10.140 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:05:10.140 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:05:10.140 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:05:10.140 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr" 2024-02-28T16:05:10.141 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:05:10.141 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "4/21 daemons upgraded", 2024-02-28T16:05:10.141 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading mon daemons", 2024-02-28T16:05:10.141 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:05:10.141 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:05:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.151+0000 7fb1a6600700 1 -- 172.21.15.57:0/3243830144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb18406d900 msgr2=0x7fb18406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.151+0000 7fb1a6600700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb18406d900 0x7fb18406fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb18c007fd0 tx=0x7fb18c009040 comp rx=0 tx=0).stop 2024-02-28T16:05:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.151+0000 7fb1a6600700 1 -- 172.21.15.57:0/3243830144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a00fda80 msgr2=0x7fb1a010fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.151+0000 7fb1a6600700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a00fda80 0x7fb1a010fb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb190009fd0 tx=0x7fb190009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.151+0000 7fb1a6600700 1 -- 172.21.15.57:0/3243830144 shutdown_connections 2024-02-28T16:05:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.151+0000 7fb1a6600700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb18406d900 0x7fb18406fdb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.151+0000 7fb1a6600700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a00fda80 0x7fb1a010fb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.151+0000 7fb1a6600700 1 --2- 172.21.15.57:0/3243830144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1a01003a0 0x7fb1a0110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.151+0000 7fb1a6600700 1 -- 172.21.15.57:0/3243830144 >> 172.21.15.57:0/3243830144 conn(0x7fb1a00f74e0 msgr2=0x7fb1a00fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.152+0000 7fb1a6600700 1 -- 172.21.15.57:0/3243830144 shutdown_connections 2024-02-28T16:05:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.152+0000 7fb1a6600700 1 -- 172.21.15.57:0/3243830144 wait complete. 2024-02-28T16:05:10.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.312+0000 7f593ba00700 1 -- 172.21.15.57:0/3976848166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59340663e0 msgr2=0x7f59340ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:10.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.312+0000 7f593ba00700 1 --2- 172.21.15.57:0/3976848166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59340663e0 0x7f59340ffaf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5928004940 tx=0x7f5928009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:10.306 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:10 smithi057 ceph-mon[93219]: from='client.44107 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:10.306 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:10 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2885028311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:05:10.306 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:10 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/4032011959' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:05:10.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.313+0000 7f593ba00700 1 -- 172.21.15.57:0/3976848166 shutdown_connections 2024-02-28T16:05:10.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.313+0000 7f593ba00700 1 --2- 172.21.15.57:0/3976848166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59341000c0 0x7f5934102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:10.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.313+0000 7f593ba00700 1 --2- 172.21.15.57:0/3976848166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59340663e0 0x7f59340ffaf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:10.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.313+0000 7f593ba00700 1 -- 172.21.15.57:0/3976848166 >> 172.21.15.57:0/3976848166 conn(0x7f59340f74e0 msgr2=0x7f59340f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:10.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.313+0000 7f593ba00700 1 -- 172.21.15.57:0/3976848166 shutdown_connections 2024-02-28T16:05:10.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.313+0000 7f593ba00700 1 -- 172.21.15.57:0/3976848166 wait complete. 2024-02-28T16:05:10.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.314+0000 7f593ba00700 1 Processor -- start 2024-02-28T16:05:10.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.314+0000 7f593ba00700 1 -- start start 2024-02-28T16:05:10.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.315+0000 7f593ba00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59340663e0 0x7f593410d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:10.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.315+0000 7f593ba00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59341000c0 0x7f593410def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:10.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.315+0000 7f593ba00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593410e4f0 con 0x7f59340663e0 2024-02-28T16:05:10.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.315+0000 7f593ba00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593410ed90 con 0x7f59341000c0 2024-02-28T16:05:10.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.315+0000 7f5939000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59340663e0 0x7f593410d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:10.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.315+0000 7f5939000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59340663e0 0x7f593410d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59890/0 (socket says 172.21.15.57:59890) 2024-02-28T16:05:10.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.315+0000 7f5939000700 1 -- 172.21.15.57:0/2604215783 learned_addr learned my addr 172.21.15.57:0/2604215783 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:10.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.315+0000 7f5933e00700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59341000c0 0x7f593410def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:10.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.316+0000 7f5939000700 1 -- 172.21.15.57:0/2604215783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59341000c0 msgr2=0x7f593410def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.316+0000 7f5939000700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59341000c0 0x7f593410def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.316+0000 7f5939000700 1 -- 172.21.15.57:0/2604215783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928005040 con 0x7f59340663e0 2024-02-28T16:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.316+0000 7f5933e00700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59341000c0 0x7f593410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.316+0000 7f5939000700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59340663e0 0x7f593410d9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5928009fd0 tx=0x7f5928009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.316+0000 7f5930c00700 1 -- 172.21.15.57:0/2604215783 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f592800e040 con 0x7f59340663e0 2024-02-28T16:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.316+0000 7f5930c00700 1 -- 172.21.15.57:0/2604215783 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f592800bcc0 con 0x7f59340663e0 2024-02-28T16:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.316+0000 7f5930c00700 1 -- 172.21.15.57:0/2604215783 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f592801c630 con 0x7f59340663e0 2024-02-28T16:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.317+0000 7f593ba00700 1 -- 172.21.15.57:0/2604215783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593410f010 con 0x7f59340663e0 2024-02-28T16:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.317+0000 7f593ba00700 1 -- 172.21.15.57:0/2604215783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593410f550 con 0x7f59340663e0 2024-02-28T16:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.318+0000 7f593ba00700 1 -- 172.21.15.57:0/2604215783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5934107a70 con 0x7f59340663e0 2024-02-28T16:05:10.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.319+0000 7f5930c00700 1 -- 172.21.15.57:0/2604215783 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f5928013980 con 0x7f59340663e0 2024-02-28T16:05:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.320+0000 7f5930c00700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f591c06d900 0x7f591c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.320+0000 7f5930c00700 1 -- 172.21.15.57:0/2604215783 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f592808e580 con 0x7f59340663e0 2024-02-28T16:05:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.320+0000 7f5933e00700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f591c06d900 0x7f591c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.321+0000 7f5933e00700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f591c06d900 0x7f591c06fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5920007fd0 tx=0x7f5920009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.325+0000 7f5930c00700 1 -- 172.21.15.57:0/2604215783 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f592805b790 con 0x7f59340663e0 2024-02-28T16:05:10.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:10 smithi087 ceph-mon[82628]: from='client.44107 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:10.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:10 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2885028311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:05:10.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:10 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/4032011959' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:05:10.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.639+0000 7f593ba00700 1 -- 172.21.15.57:0/2604215783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5934105a30 con 0x7f59340663e0 2024-02-28T16:05:10.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.640+0000 7f5930c00700 1 -- 172.21.15.57:0/2604215783 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f592805b320 con 0x7f59340663e0 2024-02-28T16:05:10.633 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:05:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.643+0000 7f593ba00700 1 -- 172.21.15.57:0/2604215783 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f591c06d900 msgr2=0x7f591c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.643+0000 7f593ba00700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f591c06d900 0x7f591c06fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5920007fd0 tx=0x7f5920009040 comp rx=0 tx=0).stop 2024-02-28T16:05:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.643+0000 7f593ba00700 1 -- 172.21.15.57:0/2604215783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59340663e0 msgr2=0x7f593410d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.643+0000 7f593ba00700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59340663e0 0x7f593410d9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5928009fd0 tx=0x7f5928009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.643+0000 7f593ba00700 1 -- 172.21.15.57:0/2604215783 shutdown_connections 2024-02-28T16:05:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.643+0000 7f593ba00700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f591c06d900 0x7f591c06fdb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:10.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.643+0000 7f593ba00700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59340663e0 0x7f593410d9b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:10.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.643+0000 7f593ba00700 1 --2- 172.21.15.57:0/2604215783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59341000c0 0x7f593410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:10.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.643+0000 7f593ba00700 1 -- 172.21.15.57:0/2604215783 >> 172.21.15.57:0/2604215783 conn(0x7f59340f74e0 msgr2=0x7f59340f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:10.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.643+0000 7f593ba00700 1 -- 172.21.15.57:0/2604215783 shutdown_connections 2024-02-28T16:05:10.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:10.644+0000 7f593ba00700 1 -- 172.21.15.57:0/2604215783 wait complete. 2024-02-28T16:05:11.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:11 smithi087 ceph-mon[82628]: pgmap v21: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:11.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:11 smithi087 ceph-mon[82628]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:11 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2604215783' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:05:11.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:11 smithi057 ceph-mon[93219]: pgmap v21: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:11.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:11 smithi057 ceph-mon[93219]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:11.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:11 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2604215783' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: pgmap v22: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: Reconfiguring mon.smithi057 (monmap changed)... 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:12.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:12 smithi087 ceph-mon[82628]: Reconfiguring daemon mon.smithi057 on smithi057 2024-02-28T16:05:13.101 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: pgmap v22: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:13.101 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:13.101 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:13.101 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:13.101 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:05:13.101 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:13.102 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: Reconfiguring mon.smithi057 (monmap changed)... 2024-02-28T16:05:13.102 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:05:13.102 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:05:13.102 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:13.102 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:12 smithi057 ceph-mon[93219]: Reconfiguring daemon mon.smithi057 on smithi057 2024-02-28T16:05:15.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:15 smithi057 ceph-mon[93219]: pgmap v23: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:15.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:15 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:15.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:15 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:15.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:15 smithi057 ceph-mon[93219]: Reconfiguring mgr.smithi057.upqerc (monmap changed)... 2024-02-28T16:05:15.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:15 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi057.upqerc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:05:15.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:15 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:05:15.698 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:15 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:15.699 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:15 smithi057 ceph-mon[93219]: Reconfiguring daemon mgr.smithi057.upqerc on smithi057 2024-02-28T16:05:15.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:15 smithi087 ceph-mon[82628]: pgmap v23: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:15 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:15 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:15 smithi087 ceph-mon[82628]: Reconfiguring mgr.smithi057.upqerc (monmap changed)... 2024-02-28T16:05:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:15 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi057.upqerc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:05:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:15 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:05:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:15 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:15.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:15 smithi087 ceph-mon[82628]: Reconfiguring daemon mgr.smithi057.upqerc on smithi057 2024-02-28T16:05:17.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:17 smithi087 ceph-mon[82628]: pgmap v24: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:17.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:17 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:17.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:17 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:17.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:17 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi057", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:05:17.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:17 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:17.855 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:17 smithi057 ceph-mon[93219]: pgmap v24: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:17.855 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:17 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:17.855 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:17 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:17.855 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:17 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi057", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:05:17.856 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:17 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:18.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:18 smithi087 ceph-mon[82628]: Reconfiguring crash.smithi057 (monmap changed)... 2024-02-28T16:05:18.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:18 smithi087 ceph-mon[82628]: Reconfiguring daemon crash.smithi057 on smithi057 2024-02-28T16:05:18.725 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:18 smithi057 ceph-mon[93219]: Reconfiguring crash.smithi057 (monmap changed)... 2024-02-28T16:05:18.725 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:18 smithi057 ceph-mon[93219]: Reconfiguring daemon crash.smithi057 on smithi057 2024-02-28T16:05:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:19 smithi057 ceph-mon[93219]: pgmap v25: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:05:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:05:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:19 smithi087 ceph-mon[82628]: pgmap v25: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:05:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:19.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:05:19.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:20.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:20 smithi057 ceph-mon[93219]: Reconfiguring osd.0 (monmap changed)... 2024-02-28T16:05:20.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:20 smithi057 ceph-mon[93219]: Reconfiguring daemon osd.0 on smithi057 2024-02-28T16:05:20.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:20 smithi087 ceph-mon[82628]: Reconfiguring osd.0 (monmap changed)... 2024-02-28T16:05:20.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:20 smithi087 ceph-mon[82628]: Reconfiguring daemon osd.0 on smithi057 2024-02-28T16:05:21.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:21 smithi057 ceph-mon[93219]: pgmap v26: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:05:21.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:21 smithi087 ceph-mon[82628]: pgmap v26: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:05:22.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:22.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:22.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:22 smithi057 ceph-mon[93219]: Reconfiguring osd.1 (monmap changed)... 2024-02-28T16:05:22.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:05:22.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:22.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:22 smithi057 ceph-mon[93219]: Reconfiguring daemon osd.1 on smithi057 2024-02-28T16:05:22.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:22 smithi057 ceph-mon[93219]: pgmap v27: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:22.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:22.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:22.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:22 smithi087 ceph-mon[82628]: Reconfiguring osd.1 (monmap changed)... 2024-02-28T16:05:22.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:05:22.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:22.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:22 smithi087 ceph-mon[82628]: Reconfiguring daemon osd.1 on smithi057 2024-02-28T16:05:22.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:22 smithi087 ceph-mon[82628]: pgmap v27: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:25.381 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:25 smithi057 ceph-mon[93219]: pgmap v28: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:25.381 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:25.381 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:25.381 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:25 smithi057 ceph-mon[93219]: Reconfiguring osd.2 (monmap changed)... 2024-02-28T16:05:25.381 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:05:25.381 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:25.381 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:25 smithi057 ceph-mon[93219]: Reconfiguring daemon osd.2 on smithi057 2024-02-28T16:05:25.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:25 smithi087 ceph-mon[82628]: pgmap v28: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:25.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:25.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:25.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:25 smithi087 ceph-mon[82628]: Reconfiguring osd.2 (monmap changed)... 2024-02-28T16:05:25.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:05:25.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:25.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:25 smithi087 ceph-mon[82628]: Reconfiguring daemon osd.2 on smithi057 2024-02-28T16:05:27.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:27 smithi057 ceph-mon[93219]: pgmap v29: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:27.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:27.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:27.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.eztwsd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:05:27.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:27 smithi087 ceph-mon[82628]: pgmap v29: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.eztwsd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:05:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:28.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:28 smithi057 ceph-mon[93219]: Reconfiguring mds.cephfs.smithi057.eztwsd (monmap changed)... 2024-02-28T16:05:28.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:28 smithi057 ceph-mon[93219]: Reconfiguring daemon mds.cephfs.smithi057.eztwsd on smithi057 2024-02-28T16:05:28.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:28 smithi087 ceph-mon[82628]: Reconfiguring mds.cephfs.smithi057.eztwsd (monmap changed)... 2024-02-28T16:05:28.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:28 smithi087 ceph-mon[82628]: Reconfiguring daemon mds.cephfs.smithi057.eztwsd on smithi057 2024-02-28T16:05:29.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:29 smithi057 ceph-mon[93219]: pgmap v30: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:29.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:29 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:29.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:29 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:29.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:29 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.qwatmu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:05:29.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:29 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:29.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:29 smithi087 ceph-mon[82628]: pgmap v30: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:29.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:29 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:29.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:29 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:29.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:29 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.qwatmu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:05:29.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:29 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:30.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:30 smithi057 ceph-mon[93219]: Reconfiguring mds.cephfs.smithi057.qwatmu (monmap changed)... 2024-02-28T16:05:30.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:30 smithi057 ceph-mon[93219]: Reconfiguring daemon mds.cephfs.smithi057.qwatmu on smithi057 2024-02-28T16:05:30.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:30 smithi087 ceph-mon[82628]: Reconfiguring mds.cephfs.smithi057.qwatmu (monmap changed)... 2024-02-28T16:05:30.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:30 smithi087 ceph-mon[82628]: Reconfiguring daemon mds.cephfs.smithi057.qwatmu on smithi057 2024-02-28T16:05:31.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:31 smithi057 ceph-mon[93219]: pgmap v31: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:31.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:31 smithi087 ceph-mon[82628]: pgmap v31: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:32.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:32 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:32.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:32 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:32.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:32 smithi087 ceph-mon[82628]: Reconfiguring crash.smithi087 (monmap changed)... 2024-02-28T16:05:32.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:32 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:05:32.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:32 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:32.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:32 smithi087 ceph-mon[82628]: Reconfiguring daemon crash.smithi087 on smithi087 2024-02-28T16:05:32.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:32 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:32.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:32 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:32.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:32 smithi057 ceph-mon[93219]: Reconfiguring crash.smithi087 (monmap changed)... 2024-02-28T16:05:32.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:32 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:05:32.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:32 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:32.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:32 smithi057 ceph-mon[93219]: Reconfiguring daemon crash.smithi087 on smithi087 2024-02-28T16:05:33.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:33 smithi057 ceph-mon[93219]: pgmap v32: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:05:33.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:33 smithi087 ceph-mon[82628]: pgmap v32: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:05:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:05:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:05:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:05:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:34.687 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:05:34.687 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:34.687 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:34.687 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.ewrszc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:05:34.687 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:05:34.687 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:35.397 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:35 smithi087 ceph-mon[82628]: pgmap v33: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:35.398 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:35 smithi087 ceph-mon[82628]: Reconfiguring mgr.smithi087.ewrszc (monmap changed)... 2024-02-28T16:05:35.398 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:35 smithi087 ceph-mon[82628]: Reconfiguring daemon mgr.smithi087.ewrszc on smithi087 2024-02-28T16:05:35.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:35 smithi057 ceph-mon[93219]: pgmap v33: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:35.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:35 smithi057 ceph-mon[93219]: Reconfiguring mgr.smithi087.ewrszc (monmap changed)... 2024-02-28T16:05:35.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:35 smithi057 ceph-mon[93219]: Reconfiguring daemon mgr.smithi087.ewrszc on smithi087 2024-02-28T16:05:37.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:37 smithi057 ceph-mon[93219]: pgmap v34: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:37.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:37.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:37.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:37 smithi057 ceph-mon[93219]: Reconfiguring mon.smithi087 (monmap changed)... 2024-02-28T16:05:37.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:05:37.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:05:37.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:37.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:37 smithi057 ceph-mon[93219]: Reconfiguring daemon mon.smithi087 on smithi087 2024-02-28T16:05:37.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:37 smithi087 ceph-mon[82628]: pgmap v34: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:37.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:37.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:37.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:37 smithi087 ceph-mon[82628]: Reconfiguring mon.smithi087 (monmap changed)... 2024-02-28T16:05:37.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:05:37.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:05:37.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:37.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:37 smithi087 ceph-mon[82628]: Reconfiguring daemon mon.smithi087 on smithi087 2024-02-28T16:05:39.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:39 smithi057 ceph-mon[93219]: pgmap v35: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:39.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:39.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:39.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:05:39.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:39 smithi087 ceph-mon[82628]: pgmap v35: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:05:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:40.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:40 smithi057 ceph-mon[93219]: Reconfiguring osd.3 (monmap changed)... 2024-02-28T16:05:40.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:40 smithi057 ceph-mon[93219]: Reconfiguring daemon osd.3 on smithi087 2024-02-28T16:05:40.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:40 smithi087 ceph-mon[82628]: Reconfiguring osd.3 (monmap changed)... 2024-02-28T16:05:40.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:40 smithi087 ceph-mon[82628]: Reconfiguring daemon osd.3 on smithi087 2024-02-28T16:05:40.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.821+0000 7fdc83e00700 1 -- 172.21.15.57:0/4198583125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7c104760 msgr2=0x7fdc7c104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:40.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.821+0000 7fdc83e00700 1 --2- 172.21.15.57:0/4198583125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7c104760 0x7fdc7c104bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc68004940 tx=0x7fdc68009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:40.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.821+0000 7fdc83e00700 1 -- 172.21.15.57:0/4198583125 shutdown_connections 2024-02-28T16:05:40.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.821+0000 7fdc83e00700 1 --2- 172.21.15.57:0/4198583125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7c104760 0x7fdc7c104bb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:40.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.821+0000 7fdc83e00700 1 --2- 172.21.15.57:0/4198583125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc7c1035a0 0x7fdc7c1039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:40.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.821+0000 7fdc83e00700 1 -- 172.21.15.57:0/4198583125 >> 172.21.15.57:0/4198583125 conn(0x7fdc7c072690 msgr2=0x7fdc7c074ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:40.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.821+0000 7fdc83e00700 1 -- 172.21.15.57:0/4198583125 shutdown_connections 2024-02-28T16:05:40.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.821+0000 7fdc83e00700 1 -- 172.21.15.57:0/4198583125 wait complete. 2024-02-28T16:05:40.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.822+0000 7fdc83e00700 1 Processor -- start 2024-02-28T16:05:40.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.822+0000 7fdc83e00700 1 -- start start 2024-02-28T16:05:40.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.823+0000 7fdc83e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc7c1035a0 0x7fdc7c113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:40.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.823+0000 7fdc83e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7c104760 0x7fdc7c1144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:40.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.823+0000 7fdc83e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c114ab0 con 0x7fdc7c104760 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.823+0000 7fdc83e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c115350 con 0x7fdc7c1035a0 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.823+0000 7fdc80a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7c104760 0x7fdc7c1144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.823+0000 7fdc80a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7c104760 0x7fdc7c1144b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39100/0 (socket says 172.21.15.57:39100) 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.823+0000 7fdc80a00700 1 -- 172.21.15.57:0/3043078450 learned_addr learned my addr 172.21.15.57:0/3043078450 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.823+0000 7fdc81400700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc7c1035a0 0x7fdc7c113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.824+0000 7fdc80a00700 1 -- 172.21.15.57:0/3043078450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc7c1035a0 msgr2=0x7fdc7c113f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.824+0000 7fdc80a00700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc7c1035a0 0x7fdc7c113f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.824+0000 7fdc80a00700 1 -- 172.21.15.57:0/3043078450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc68005040 con 0x7fdc7c104760 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.824+0000 7fdc80a00700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7c104760 0x7fdc7c1144b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800b3b0 tx=0x7fdc68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.824+0000 7fdc79600700 1 -- 172.21.15.57:0/3043078450 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6800e040 con 0x7fdc7c104760 2024-02-28T16:05:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.824+0000 7fdc83e00700 1 -- 172.21.15.57:0/3043078450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c1155d0 con 0x7fdc7c104760 2024-02-28T16:05:40.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.824+0000 7fdc79600700 1 -- 172.21.15.57:0/3043078450 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc6800bd90 con 0x7fdc7c104760 2024-02-28T16:05:40.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.824+0000 7fdc79600700 1 -- 172.21.15.57:0/3043078450 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6801c630 con 0x7fdc7c104760 2024-02-28T16:05:40.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.825+0000 7fdc83e00700 1 -- 172.21.15.57:0/3043078450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c115b10 con 0x7fdc7c104760 2024-02-28T16:05:40.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.826+0000 7fdc83e00700 1 -- 172.21.15.57:0/3043078450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c04bed0 con 0x7fdc7c104760 2024-02-28T16:05:40.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.827+0000 7fdc79600700 1 -- 172.21.15.57:0/3043078450 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fdc680139f0 con 0x7fdc7c104760 2024-02-28T16:05:40.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.828+0000 7fdc79600700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc6406d900 0x7fdc6406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:40.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.828+0000 7fdc79600700 1 -- 172.21.15.57:0/3043078450 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fdc6808e6c0 con 0x7fdc7c104760 2024-02-28T16:05:40.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.829+0000 7fdc81400700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc6406d900 0x7fdc6406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:40.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.829+0000 7fdc81400700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc6406d900 0x7fdc6406fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009fd0 tx=0x7fdc70009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:40.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:40.833+0000 7fdc79600700 1 -- 172.21.15.57:0/3043078450 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdc6805b850 con 0x7fdc7c104760 2024-02-28T16:05:41.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.089+0000 7fdc83e00700 1 -- 172.21.15.57:0/3043078450 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc7c1090b0 con 0x7fdc6406d900 2024-02-28T16:05:41.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.092+0000 7fdc79600700 1 -- 172.21.15.57:0/3043078450 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fdc7c1090b0 con 0x7fdc6406d900 2024-02-28T16:05:41.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 -- 172.21.15.57:0/3043078450 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc6406d900 msgr2=0x7fdc6406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:41.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc6406d900 0x7fdc6406fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009fd0 tx=0x7fdc70009f00 comp rx=0 tx=0).stop 2024-02-28T16:05:41.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 -- 172.21.15.57:0/3043078450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7c104760 msgr2=0x7fdc7c1144b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:41.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7c104760 0x7fdc7c1144b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800b3b0 tx=0x7fdc68009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:41.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 -- 172.21.15.57:0/3043078450 shutdown_connections 2024-02-28T16:05:41.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc6406d900 0x7fdc6406fdb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc7c1035a0 0x7fdc7c113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 --2- 172.21.15.57:0/3043078450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7c104760 0x7fdc7c1144b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 -- 172.21.15.57:0/3043078450 >> 172.21.15.57:0/3043078450 conn(0x7fdc7c072690 msgr2=0x7fdc7c107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:41.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 -- 172.21.15.57:0/3043078450 shutdown_connections 2024-02-28T16:05:41.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.095+0000 7fdc83e00700 1 -- 172.21.15.57:0/3043078450 wait complete. 2024-02-28T16:05:41.104 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:05:41.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.256+0000 7f237e400700 1 -- 172.21.15.57:0/3409730268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2378103540 msgr2=0x7f2378103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:41.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.256+0000 7f237e400700 1 --2- 172.21.15.57:0/3409730268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2378103540 0x7f2378103950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2368004940 tx=0x7f2368009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:41.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.256+0000 7f237e400700 1 -- 172.21.15.57:0/3409730268 shutdown_connections 2024-02-28T16:05:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.256+0000 7f237e400700 1 --2- 172.21.15.57:0/3409730268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378104750 0x7f2378104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.256+0000 7f237e400700 1 --2- 172.21.15.57:0/3409730268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2378103540 0x7f2378103950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.256+0000 7f237e400700 1 -- 172.21.15.57:0/3409730268 >> 172.21.15.57:0/3409730268 conn(0x7f23780727d0 msgr2=0x7f2378074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.256+0000 7f237e400700 1 -- 172.21.15.57:0/3409730268 shutdown_connections 2024-02-28T16:05:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.256+0000 7f237e400700 1 -- 172.21.15.57:0/3409730268 wait complete. 2024-02-28T16:05:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.257+0000 7f237e400700 1 Processor -- start 2024-02-28T16:05:41.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.257+0000 7f237e400700 1 -- start start 2024-02-28T16:05:41.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.257+0000 7f237e400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2378103540 0x7f2378113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.257+0000 7f237e400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378104750 0x7f23781144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.257+0000 7f237e400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2378114aa0 con 0x7f2378103540 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.257+0000 7f237e400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2378115340 con 0x7f2378104750 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.258+0000 7f2377400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2378103540 0x7f2378113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.258+0000 7f2377400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2378103540 0x7f2378113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39114/0 (socket says 172.21.15.57:39114) 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.258+0000 7f2377400700 1 -- 172.21.15.57:0/2516469632 learned_addr learned my addr 172.21.15.57:0/2516469632 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.258+0000 7f2376a00700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378104750 0x7f23781144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.258+0000 7f2377400700 1 -- 172.21.15.57:0/2516469632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378104750 msgr2=0x7f23781144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.258+0000 7f2377400700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378104750 0x7f23781144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.258+0000 7f2377400700 1 -- 172.21.15.57:0/2516469632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2368005040 con 0x7f2378103540 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.258+0000 7f2377400700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2378103540 0x7f2378113f60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2368000c00 tx=0x7f2368009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.259+0000 7f236f400700 1 -- 172.21.15.57:0/2516469632 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f236800e040 con 0x7f2378103540 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.259+0000 7f236f400700 1 -- 172.21.15.57:0/2516469632 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f236800bcc0 con 0x7f2378103540 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.259+0000 7f237e400700 1 -- 172.21.15.57:0/2516469632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23781155c0 con 0x7f2378103540 2024-02-28T16:05:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.259+0000 7f236f400700 1 -- 172.21.15.57:0/2516469632 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2368013ea0 con 0x7f2378103540 2024-02-28T16:05:41.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.259+0000 7f237e400700 1 -- 172.21.15.57:0/2516469632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2378115b00 con 0x7f2378103540 2024-02-28T16:05:41.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.260+0000 7f237e400700 1 -- 172.21.15.57:0/2516469632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237804bed0 con 0x7f2378103540 2024-02-28T16:05:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.261+0000 7f236f400700 1 -- 172.21.15.57:0/2516469632 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f2368013420 con 0x7f2378103540 2024-02-28T16:05:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.262+0000 7f236f400700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f235c06d900 0x7f235c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.262+0000 7f236f400700 1 -- 172.21.15.57:0/2516469632 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f236808e3a0 con 0x7f2378103540 2024-02-28T16:05:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.263+0000 7f2376a00700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f235c06d900 0x7f235c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.263+0000 7f2376a00700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f235c06d900 0x7f235c06fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2364007fd0 tx=0x7f2364009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.268+0000 7f236f400700 1 -- 172.21.15.57:0/2516469632 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f236805b5d0 con 0x7f2378103540 2024-02-28T16:05:41.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:41 smithi087 ceph-mon[82628]: pgmap v36: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:41.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.524+0000 7f237e400700 1 -- 172.21.15.57:0/2516469632 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23781090a0 con 0x7f235c06d900 2024-02-28T16:05:41.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.525+0000 7f236f400700 1 -- 172.21.15.57:0/2516469632 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f23781090a0 con 0x7f235c06d900 2024-02-28T16:05:41.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.528+0000 7f237e400700 1 -- 172.21.15.57:0/2516469632 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f235c06d900 msgr2=0x7f235c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.528+0000 7f237e400700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f235c06d900 0x7f235c06fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2364007fd0 tx=0x7f2364009040 comp rx=0 tx=0).stop 2024-02-28T16:05:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.528+0000 7f237e400700 1 -- 172.21.15.57:0/2516469632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2378103540 msgr2=0x7f2378113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.528+0000 7f237e400700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2378103540 0x7f2378113f60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2368000c00 tx=0x7f2368009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.529+0000 7f237e400700 1 -- 172.21.15.57:0/2516469632 shutdown_connections 2024-02-28T16:05:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.529+0000 7f237e400700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f235c06d900 0x7f235c06fdb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.529+0000 7f237e400700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2378103540 0x7f2378113f60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.529+0000 7f237e400700 1 --2- 172.21.15.57:0/2516469632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378104750 0x7f23781144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.529+0000 7f237e400700 1 -- 172.21.15.57:0/2516469632 >> 172.21.15.57:0/2516469632 conn(0x7f23780727d0 msgr2=0x7f2378107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.529+0000 7f237e400700 1 -- 172.21.15.57:0/2516469632 shutdown_connections 2024-02-28T16:05:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.529+0000 7f237e400700 1 -- 172.21.15.57:0/2516469632 wait complete. 2024-02-28T16:05:41.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:41 smithi057 ceph-mon[93219]: pgmap v36: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:41.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.689+0000 7f806a000700 1 -- 172.21.15.57:0/1418264490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8064070840 msgr2=0x7f8064070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:41.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.689+0000 7f806a000700 1 --2- 172.21.15.57:0/1418264490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8064070840 0x7f8064070cb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8050004940 tx=0x7f8050009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:41.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.690+0000 7f806a000700 1 -- 172.21.15.57:0/1418264490 shutdown_connections 2024-02-28T16:05:41.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.690+0000 7f806a000700 1 --2- 172.21.15.57:0/1418264490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8064070840 0x7f8064070cb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.690+0000 7f806a000700 1 --2- 172.21.15.57:0/1418264490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8064071e90 0x7f8064070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.690+0000 7f806a000700 1 -- 172.21.15.57:0/1418264490 >> 172.21.15.57:0/1418264490 conn(0x7f80640f8620 msgr2=0x7f80640faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:41.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.690+0000 7f806a000700 1 -- 172.21.15.57:0/1418264490 shutdown_connections 2024-02-28T16:05:41.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.690+0000 7f806a000700 1 -- 172.21.15.57:0/1418264490 wait complete. 2024-02-28T16:05:41.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.691+0000 7f806a000700 1 Processor -- start 2024-02-28T16:05:41.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.691+0000 7f806a000700 1 -- start start 2024-02-28T16:05:41.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f806a000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8064070840 0x7f806410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f806a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8064071e90 0x7f8064110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f806a000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064110680 con 0x7f8064071e90 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f806a000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064110f20 con 0x7f8064070840 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f8062a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8064071e90 0x7f8064110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f8062a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8064071e90 0x7f8064110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39138/0 (socket says 172.21.15.57:39138) 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f8062a00700 1 -- 172.21.15.57:0/3559257684 learned_addr learned my addr 172.21.15.57:0/3559257684 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f8063400700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8064070840 0x7f806410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f8062a00700 1 -- 172.21.15.57:0/3559257684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8064070840 msgr2=0x7f806410fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f8062a00700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8064070840 0x7f806410fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.692+0000 7f8062a00700 1 -- 172.21.15.57:0/3559257684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8050005040 con 0x7f8064071e90 2024-02-28T16:05:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.693+0000 7f8062a00700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8064071e90 0x7f8064110080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8050009fd0 tx=0x7f8050009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:41.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.693+0000 7f805b400700 1 -- 172.21.15.57:0/3559257684 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f805000e040 con 0x7f8064071e90 2024-02-28T16:05:41.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.693+0000 7f805b400700 1 -- 172.21.15.57:0/3559257684 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f805000bcc0 con 0x7f8064071e90 2024-02-28T16:05:41.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.693+0000 7f806a000700 1 -- 172.21.15.57:0/3559257684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80641111a0 con 0x7f8064071e90 2024-02-28T16:05:41.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.693+0000 7f806a000700 1 -- 172.21.15.57:0/3559257684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80641116e0 con 0x7f8064071e90 2024-02-28T16:05:41.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.694+0000 7f805b400700 1 -- 172.21.15.57:0/3559257684 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f805001c630 con 0x7f8064071e90 2024-02-28T16:05:41.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.695+0000 7f806a000700 1 -- 172.21.15.57:0/3559257684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806404bed0 con 0x7f8064071e90 2024-02-28T16:05:41.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.696+0000 7f805b400700 1 -- 172.21.15.57:0/3559257684 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f8050013420 con 0x7f8064071e90 2024-02-28T16:05:41.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.697+0000 7f805b400700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f804806d900 0x7f804806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:41.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.697+0000 7f805b400700 1 -- 172.21.15.57:0/3559257684 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f805008e5e0 con 0x7f8064071e90 2024-02-28T16:05:41.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.697+0000 7f8063400700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f804806d900 0x7f804806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.698+0000 7f8063400700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f804806d900 0x7f804806fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f80540041d0 tx=0x7f80540043c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:41.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.702+0000 7f805b400700 1 -- 172.21.15.57:0/3559257684 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f805005b770 con 0x7f8064071e90 2024-02-28T16:05:41.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.939+0000 7f806a000700 1 -- 172.21.15.57:0/3559257684 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8064111bc0 con 0x7f804806d900 2024-02-28T16:05:41.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.951+0000 7f805b400700 1 -- 172.21.15.57:0/3559257684 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8064111bc0 con 0x7f804806d900 2024-02-28T16:05:41.943 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:05:41.943 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (4m) 60s ago 14m 14.8M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:05:41.943 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (15m) 60s ago 15m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 8e0b8d22ba90 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (13m) 38s ago 13m 6660k - 17.2.7-535-gc0f02e60 1c37ed371348 445ea8389701 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (3m) 60s ago 14m 76.0M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (7m) 60s ago 7m 127M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (7m) 60s ago 7m 68.2M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (7m) 38s ago 7m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (7m) 38s ago 7m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (2m) 60s ago 16m 477M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (104s) 38s ago 13m 448M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (81s) 60s ago 16m 31.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (44s) 38s ago 13m 22.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (4m) 60s ago 14m 7746k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (3m) 38s ago 13m 7726k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:05:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (12m) 60s ago 12m 213M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:05:41.945 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (11m) 60s ago 11m 233M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:05:41.945 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (11m) 60s ago 11m 192M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:05:41.945 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (10m) 38s ago 10m 260M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:05:41.945 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (9m) 38s ago 9m 236M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:05:41.945 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (9m) 38s ago 9m 219M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:05:41.945 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (116s) 60s ago 14m 42.6M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:05:41.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.955+0000 7f806a000700 1 -- 172.21.15.57:0/3559257684 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f804806d900 msgr2=0x7f804806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:41.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.955+0000 7f806a000700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f804806d900 0x7f804806fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f80540041d0 tx=0x7f80540043c0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.955+0000 7f806a000700 1 -- 172.21.15.57:0/3559257684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8064071e90 msgr2=0x7f8064110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:41.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.955+0000 7f806a000700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8064071e90 0x7f8064110080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8050009fd0 tx=0x7f8050009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:41.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.955+0000 7f806a000700 1 -- 172.21.15.57:0/3559257684 shutdown_connections 2024-02-28T16:05:41.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.955+0000 7f806a000700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f804806d900 0x7f804806fdb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.955+0000 7f806a000700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8064070840 0x7f806410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.955+0000 7f806a000700 1 --2- 172.21.15.57:0/3559257684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8064071e90 0x7f8064110080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:41.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.955+0000 7f806a000700 1 -- 172.21.15.57:0/3559257684 >> 172.21.15.57:0/3559257684 conn(0x7f80640f8620 msgr2=0x7f8064102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:41.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.956+0000 7f806a000700 1 -- 172.21.15.57:0/3559257684 shutdown_connections 2024-02-28T16:05:41.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:41.956+0000 7f806a000700 1 -- 172.21.15.57:0/3559257684 wait complete. 2024-02-28T16:05:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.110+0000 7fc3a2400700 1 -- 172.21.15.57:0/4040838478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc39c0708c0 msgr2=0x7fc39c070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.110+0000 7fc3a2400700 1 --2- 172.21.15.57:0/4040838478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc39c0708c0 0x7fc39c070d10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc388004940 tx=0x7fc388009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.111+0000 7fc3a2400700 1 -- 172.21.15.57:0/4040838478 shutdown_connections 2024-02-28T16:05:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.111+0000 7fc3a2400700 1 --2- 172.21.15.57:0/4040838478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc39c0708c0 0x7fc39c070d10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.111+0000 7fc3a2400700 1 --2- 172.21.15.57:0/4040838478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39c071f10 0x7fc39c070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.111+0000 7fc3a2400700 1 -- 172.21.15.57:0/4040838478 >> 172.21.15.57:0/4040838478 conn(0x7fc39c0f8620 msgr2=0x7fc39c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.111+0000 7fc3a2400700 1 -- 172.21.15.57:0/4040838478 shutdown_connections 2024-02-28T16:05:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.111+0000 7fc3a2400700 1 -- 172.21.15.57:0/4040838478 wait complete. 2024-02-28T16:05:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.112+0000 7fc3a2400700 1 Processor -- start 2024-02-28T16:05:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.112+0000 7fc3a2400700 1 -- start start 2024-02-28T16:05:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.112+0000 7fc3a2400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39c0708c0 0x7fc39c10fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.112+0000 7fc3a2400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc39c071f10 0x7fc39c1100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.112+0000 7fc3a2400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c1106b0 con 0x7fc39c071f10 2024-02-28T16:05:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.112+0000 7fc3a2400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c110f50 con 0x7fc39c0708c0 2024-02-28T16:05:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.112+0000 7fc39aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc39c071f10 0x7fc39c1100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.113+0000 7fc39aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc39c071f10 0x7fc39c1100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60656/0 (socket says 172.21.15.57:60656) 2024-02-28T16:05:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.113+0000 7fc39aa00700 1 -- 172.21.15.57:0/50431237 learned_addr learned my addr 172.21.15.57:0/50431237 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.113+0000 7fc39b400700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39c0708c0 0x7fc39c10fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.113+0000 7fc39aa00700 1 -- 172.21.15.57:0/50431237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39c0708c0 msgr2=0x7fc39c10fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.113+0000 7fc39aa00700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39c0708c0 0x7fc39c10fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.113+0000 7fc39aa00700 1 -- 172.21.15.57:0/50431237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388005040 con 0x7fc39c071f10 2024-02-28T16:05:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.113+0000 7fc39b400700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39c0708c0 0x7fc39c10fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:05:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.113+0000 7fc39aa00700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc39c071f10 0x7fc39c1100b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc388000c00 tx=0x7fc388009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.114+0000 7fc393400700 1 -- 172.21.15.57:0/50431237 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38800e040 con 0x7fc39c071f10 2024-02-28T16:05:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.114+0000 7fc393400700 1 -- 172.21.15.57:0/50431237 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc388004290 con 0x7fc39c071f10 2024-02-28T16:05:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.114+0000 7fc393400700 1 -- 172.21.15.57:0/50431237 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38801c630 con 0x7fc39c071f10 2024-02-28T16:05:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.114+0000 7fc3a2400700 1 -- 172.21.15.57:0/50431237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c1111d0 con 0x7fc39c071f10 2024-02-28T16:05:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.114+0000 7fc3a2400700 1 -- 172.21.15.57:0/50431237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c111710 con 0x7fc39c071f10 2024-02-28T16:05:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.115+0000 7fc3a2400700 1 -- 172.21.15.57:0/50431237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c04bed0 con 0x7fc39c071f10 2024-02-28T16:05:42.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.116+0000 7fc393400700 1 -- 172.21.15.57:0/50431237 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fc38800bc60 con 0x7fc39c071f10 2024-02-28T16:05:42.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.117+0000 7fc393400700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc38006d900 0x7fc38006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:42.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.117+0000 7fc393400700 1 -- 172.21.15.57:0/50431237 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc38808e4b0 con 0x7fc39c071f10 2024-02-28T16:05:42.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.117+0000 7fc39b400700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc38006d900 0x7fc38006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:42.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.118+0000 7fc39b400700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc38006d900 0x7fc38006fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc38c007fd0 tx=0x7fc38c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:42.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.122+0000 7fc393400700 1 -- 172.21.15.57:0/50431237 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc38805b6c0 con 0x7fc39c071f10 2024-02-28T16:05:42.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.449+0000 7fc3a2400700 1 -- 172.21.15.57:0/50431237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc39c107c10 con 0x7fc39c071f10 2024-02-28T16:05:42.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.450+0000 7fc393400700 1 -- 172.21.15.57:0/50431237 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fc38805b250 con 0x7fc39c071f10 2024-02-28T16:05:42.442 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:05:42.443 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:05:42.444 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 10, 2024-02-28T16:05:42.444 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:05:42.444 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:05:42.444 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:05:42.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.454+0000 7fc3a2400700 1 -- 172.21.15.57:0/50431237 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc38006d900 msgr2=0x7fc38006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:42.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.454+0000 7fc3a2400700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc38006d900 0x7fc38006fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc38c007fd0 tx=0x7fc38c009040 comp rx=0 tx=0).stop 2024-02-28T16:05:42.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.454+0000 7fc3a2400700 1 -- 172.21.15.57:0/50431237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc39c071f10 msgr2=0x7fc39c1100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:42.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.454+0000 7fc3a2400700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc39c071f10 0x7fc39c1100b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc388000c00 tx=0x7fc388009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:42.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.454+0000 7fc3a2400700 1 -- 172.21.15.57:0/50431237 shutdown_connections 2024-02-28T16:05:42.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.454+0000 7fc3a2400700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc38006d900 0x7fc38006fdb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.454+0000 7fc3a2400700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39c0708c0 0x7fc39c10fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.454+0000 7fc3a2400700 1 --2- 172.21.15.57:0/50431237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc39c071f10 0x7fc39c1100b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.454+0000 7fc3a2400700 1 -- 172.21.15.57:0/50431237 >> 172.21.15.57:0/50431237 conn(0x7fc39c0f8620 msgr2=0x7fc39c102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:42.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.455+0000 7fc3a2400700 1 -- 172.21.15.57:0/50431237 shutdown_connections 2024-02-28T16:05:42.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.455+0000 7fc3a2400700 1 -- 172.21.15.57:0/50431237 wait complete. 2024-02-28T16:05:42.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.618+0000 7fb038400700 1 -- 172.21.15.57:0/1581521959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb030104750 msgr2=0x7fb030104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:42.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.618+0000 7fb038400700 1 --2- 172.21.15.57:0/1581521959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb030104750 0x7fb030104ba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb01c004940 tx=0x7fb01c009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:42.611 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:42 smithi057 ceph-mon[93219]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:42.611 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:42 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:42.611 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:42 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:42.611 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:42 smithi057 ceph-mon[93219]: Reconfiguring osd.4 (monmap changed)... 2024-02-28T16:05:42.611 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:42 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:05:42.611 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:42 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:42.611 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:42 smithi057 ceph-mon[93219]: Reconfiguring daemon osd.4 on smithi087 2024-02-28T16:05:42.611 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:42 smithi057 ceph-mon[93219]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:42.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.619+0000 7fb038400700 1 -- 172.21.15.57:0/1581521959 shutdown_connections 2024-02-28T16:05:42.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.619+0000 7fb038400700 1 --2- 172.21.15.57:0/1581521959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb030104750 0x7fb030104ba0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.619+0000 7fb038400700 1 --2- 172.21.15.57:0/1581521959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb030103540 0x7fb030103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.619+0000 7fb038400700 1 -- 172.21.15.57:0/1581521959 >> 172.21.15.57:0/1581521959 conn(0x7fb0300727d0 msgr2=0x7fb030074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:42.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.619+0000 7fb038400700 1 -- 172.21.15.57:0/1581521959 shutdown_connections 2024-02-28T16:05:42.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.619+0000 7fb038400700 1 -- 172.21.15.57:0/1581521959 wait complete. 2024-02-28T16:05:42.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.620+0000 7fb038400700 1 Processor -- start 2024-02-28T16:05:42.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.620+0000 7fb038400700 1 -- start start 2024-02-28T16:05:42.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.620+0000 7fb038400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb030103540 0x7fb030113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:42.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.620+0000 7fb038400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb030104750 0x7fb0301143d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:42.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.620+0000 7fb038400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0301149d0 con 0x7fb030104750 2024-02-28T16:05:42.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.620+0000 7fb038400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb030115270 con 0x7fb030103540 2024-02-28T16:05:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.621+0000 7fb035000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb030104750 0x7fb0301143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.621+0000 7fb035000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb030104750 0x7fb0301143d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60682/0 (socket says 172.21.15.57:60682) 2024-02-28T16:05:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.621+0000 7fb035000700 1 -- 172.21.15.57:0/1215144906 learned_addr learned my addr 172.21.15.57:0/1215144906 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.621+0000 7fb035a00700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb030103540 0x7fb030113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.621+0000 7fb035000700 1 -- 172.21.15.57:0/1215144906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb030103540 msgr2=0x7fb030113e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.621+0000 7fb035000700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb030103540 0x7fb030113e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.621+0000 7fb035000700 1 -- 172.21.15.57:0/1215144906 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c005040 con 0x7fb030104750 2024-02-28T16:05:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.622+0000 7fb035000700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb030104750 0x7fb0301143d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009fd0 tx=0x7fb01c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.622+0000 7fb02d600700 1 -- 172.21.15.57:0/1215144906 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01c021070 con 0x7fb030104750 2024-02-28T16:05:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.622+0000 7fb02d600700 1 -- 172.21.15.57:0/1215144906 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb01c01c400 con 0x7fb030104750 2024-02-28T16:05:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.622+0000 7fb038400700 1 -- 172.21.15.57:0/1215144906 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0301154f0 con 0x7fb030104750 2024-02-28T16:05:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.623+0000 7fb038400700 1 -- 172.21.15.57:0/1215144906 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0301159d0 con 0x7fb030104750 2024-02-28T16:05:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.623+0000 7fb02d600700 1 -- 172.21.15.57:0/1215144906 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01c00e070 con 0x7fb030104750 2024-02-28T16:05:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.624+0000 7fb038400700 1 -- 172.21.15.57:0/1215144906 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03004bed0 con 0x7fb030104750 2024-02-28T16:05:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.625+0000 7fb02d600700 1 -- 172.21.15.57:0/1215144906 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fb01c01ca50 con 0x7fb030104750 2024-02-28T16:05:42.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.626+0000 7fb02d600700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb01806d900 0x7fb01806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:42.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.626+0000 7fb02d600700 1 -- 172.21.15.57:0/1215144906 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb01c08e190 con 0x7fb030104750 2024-02-28T16:05:42.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.626+0000 7fb035a00700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb01806d900 0x7fb01806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:42.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.627+0000 7fb035a00700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb01806d900 0x7fb01806fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb024009b80 tx=0x7fb02400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.631+0000 7fb02d600700 1 -- 172.21.15.57:0/1215144906 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb01c05b460 con 0x7fb030104750 2024-02-28T16:05:42.625 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:42 smithi087 ceph-mon[82628]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:42.625 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:42 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:42.625 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:42 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:42.625 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:42 smithi087 ceph-mon[82628]: Reconfiguring osd.4 (monmap changed)... 2024-02-28T16:05:42.625 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:42 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:05:42.626 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:42 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:42.626 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:42 smithi087 ceph-mon[82628]: Reconfiguring daemon osd.4 on smithi087 2024-02-28T16:05:42.626 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:42 smithi087 ceph-mon[82628]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:42.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.891+0000 7fb038400700 1 -- 172.21.15.57:0/1215144906 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb03010c020 con 0x7fb030104750 2024-02-28T16:05:42.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.892+0000 7fb02d600700 1 -- 172.21.15.57:0/1215144906 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1897 (secure 0 0 0) 0x7fb01c05aff0 con 0x7fb030104750 2024-02-28T16:05:42.884 INFO:teuthology.orchestra.run.smithi057.stdout:e16 2024-02-28T16:05:42.884 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:05:42.884 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:05:42.884 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:05:42.884 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:05:42.884 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:05:42.884 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:05:42.884 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 16 2024-02-28T16:05:42.884 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:05:42.884 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:02:07.353165+0000 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:05:42.885 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:05:42.886 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:05:42.887 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.894+0000 7fb038400700 1 -- 172.21.15.57:0/1215144906 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb01806d900 msgr2=0x7fb01806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.894+0000 7fb038400700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb01806d900 0x7fb01806fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb024009b80 tx=0x7fb02400b040 comp rx=0 tx=0).stop 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.894+0000 7fb038400700 1 -- 172.21.15.57:0/1215144906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb030104750 msgr2=0x7fb0301143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.894+0000 7fb038400700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb030104750 0x7fb0301143d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009fd0 tx=0x7fb01c009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.894+0000 7fb038400700 1 -- 172.21.15.57:0/1215144906 shutdown_connections 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.894+0000 7fb038400700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb01806d900 0x7fb01806fdb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.894+0000 7fb038400700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb030103540 0x7fb030113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.894+0000 7fb038400700 1 --2- 172.21.15.57:0/1215144906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb030104750 0x7fb0301143d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.894+0000 7fb038400700 1 -- 172.21.15.57:0/1215144906 >> 172.21.15.57:0/1215144906 conn(0x7fb0300727d0 msgr2=0x7fb030107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.895+0000 7fb038400700 1 -- 172.21.15.57:0/1215144906 shutdown_connections 2024-02-28T16:05:42.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:42.895+0000 7fb038400700 1 -- 172.21.15.57:0/1215144906 wait complete. 2024-02-28T16:05:42.889 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2024-02-28T16:05:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.040+0000 7f3574600700 1 -- 172.21.15.57:0/1938609430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0fe0e0 msgr2=0x7f356c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.040+0000 7f3574600700 1 --2- 172.21.15.57:0/1938609430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0fe0e0 0x7f356c0fe550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3558004940 tx=0x7f3558009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.041+0000 7f3574600700 1 -- 172.21.15.57:0/1938609430 shutdown_connections 2024-02-28T16:05:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.041+0000 7f3574600700 1 --2- 172.21.15.57:0/1938609430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0fe0e0 0x7f356c0fe550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.041+0000 7f3574600700 1 --2- 172.21.15.57:0/1938609430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c0fcef0 0x7f356c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.041+0000 7f3574600700 1 -- 172.21.15.57:0/1938609430 >> 172.21.15.57:0/1938609430 conn(0x7f356c0f8620 msgr2=0x7f356c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.041+0000 7f3574600700 1 -- 172.21.15.57:0/1938609430 shutdown_connections 2024-02-28T16:05:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.041+0000 7f3574600700 1 -- 172.21.15.57:0/1938609430 wait complete. 2024-02-28T16:05:43.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.042+0000 7f3574600700 1 Processor -- start 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.042+0000 7f3574600700 1 -- start start 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.042+0000 7f3574600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c0fcef0 0x7f356c10fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.042+0000 7f3574600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0fe0e0 0x7f356c1100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.042+0000 7f3574600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1106a0 con 0x7f356c0fe0e0 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.042+0000 7f3574600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c110f40 con 0x7f356c0fcef0 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.042+0000 7f3571200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0fe0e0 0x7f356c1100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.042+0000 7f3571200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0fe0e0 0x7f356c1100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60694/0 (socket says 172.21.15.57:60694) 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.042+0000 7f3571200700 1 -- 172.21.15.57:0/879236705 learned_addr learned my addr 172.21.15.57:0/879236705 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.043+0000 7f3571c00700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c0fcef0 0x7f356c10fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.043+0000 7f3571200700 1 -- 172.21.15.57:0/879236705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c0fcef0 msgr2=0x7f356c10fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.043+0000 7f3571200700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c0fcef0 0x7f356c10fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.043+0000 7f3571200700 1 -- 172.21.15.57:0/879236705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558005040 con 0x7f356c0fe0e0 2024-02-28T16:05:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.043+0000 7f3571200700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0fe0e0 0x7f356c1100a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f355800b3b0 tx=0x7f3558009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.044+0000 7f3569600700 1 -- 172.21.15.57:0/879236705 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f355800e040 con 0x7f356c0fe0e0 2024-02-28T16:05:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.044+0000 7f3569600700 1 -- 172.21.15.57:0/879236705 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f355800bd90 con 0x7f356c0fe0e0 2024-02-28T16:05:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.044+0000 7f3569600700 1 -- 172.21.15.57:0/879236705 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f355801c630 con 0x7f356c0fe0e0 2024-02-28T16:05:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.044+0000 7f3574600700 1 -- 172.21.15.57:0/879236705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c1111c0 con 0x7f356c0fe0e0 2024-02-28T16:05:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.044+0000 7f3574600700 1 -- 172.21.15.57:0/879236705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c111700 con 0x7f356c0fe0e0 2024-02-28T16:05:43.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.045+0000 7f3574600700 1 -- 172.21.15.57:0/879236705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c102210 con 0x7f356c0fe0e0 2024-02-28T16:05:43.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.046+0000 7f3569600700 1 -- 172.21.15.57:0/879236705 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f35580139f0 con 0x7f356c0fe0e0 2024-02-28T16:05:43.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.047+0000 7f3569600700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f355406d900 0x7f355406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:43.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.047+0000 7f3569600700 1 -- 172.21.15.57:0/879236705 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f355808e5f0 con 0x7f356c0fe0e0 2024-02-28T16:05:43.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.048+0000 7f3571c00700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f355406d900 0x7f355406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:43.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.048+0000 7f3571c00700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f355406d900 0x7f355406fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3560009fd0 tx=0x7f3560009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:43.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.052+0000 7f3569600700 1 -- 172.21.15.57:0/879236705 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f355805b800 con 0x7f356c0fe0e0 2024-02-28T16:05:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.298+0000 7f3574600700 1 -- 172.21.15.57:0/879236705 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f356c111a30 con 0x7f355406d900 2024-02-28T16:05:43.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.300+0000 7f3569600700 1 -- 172.21.15.57:0/879236705 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f356c111a30 con 0x7f355406d900 2024-02-28T16:05:43.292 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:05:43.292 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:05:43.292 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:05:43.292 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:05:43.292 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:05:43.293 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:05:43.293 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr" 2024-02-28T16:05:43.293 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:05:43.293 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "4/21 daemons upgraded", 2024-02-28T16:05:43.293 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading mon daemons", 2024-02-28T16:05:43.293 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:05:43.293 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:05:43.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 -- 172.21.15.57:0/879236705 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f355406d900 msgr2=0x7f355406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:43.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f355406d900 0x7f355406fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3560009fd0 tx=0x7f3560009f00 comp rx=0 tx=0).stop 2024-02-28T16:05:43.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 -- 172.21.15.57:0/879236705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0fe0e0 msgr2=0x7f356c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:43.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0fe0e0 0x7f356c1100a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f355800b3b0 tx=0x7f3558009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:43.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 -- 172.21.15.57:0/879236705 shutdown_connections 2024-02-28T16:05:43.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f355406d900 0x7f355406fdb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c0fcef0 0x7f356c10fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 --2- 172.21.15.57:0/879236705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0fe0e0 0x7f356c1100a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 -- 172.21.15.57:0/879236705 >> 172.21.15.57:0/879236705 conn(0x7f356c0f8620 msgr2=0x7f356c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:43.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 -- 172.21.15.57:0/879236705 shutdown_connections 2024-02-28T16:05:43.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.303+0000 7f3574600700 1 -- 172.21.15.57:0/879236705 wait complete. 2024-02-28T16:05:43.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.444+0000 7f42e5000700 1 -- 172.21.15.57:0/652182120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00fe0e0 msgr2=0x7f42e00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:43.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.444+0000 7f42e5000700 1 --2- 172.21.15.57:0/652182120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00fe0e0 0x7f42e00fe550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42cc004940 tx=0x7f42cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:43.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.444+0000 7f42e5000700 1 -- 172.21.15.57:0/652182120 shutdown_connections 2024-02-28T16:05:43.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.444+0000 7f42e5000700 1 --2- 172.21.15.57:0/652182120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00fe0e0 0x7f42e00fe550 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.444+0000 7f42e5000700 1 --2- 172.21.15.57:0/652182120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42e00fcef0 0x7f42e00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.444+0000 7f42e5000700 1 -- 172.21.15.57:0/652182120 >> 172.21.15.57:0/652182120 conn(0x7f42e00f8620 msgr2=0x7f42e00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:43.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.444+0000 7f42e5000700 1 -- 172.21.15.57:0/652182120 shutdown_connections 2024-02-28T16:05:43.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.444+0000 7f42e5000700 1 -- 172.21.15.57:0/652182120 wait complete. 2024-02-28T16:05:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.445+0000 7f42e5000700 1 Processor -- start 2024-02-28T16:05:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.445+0000 7f42e5000700 1 -- start start 2024-02-28T16:05:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42e5000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00fcef0 0x7f42e010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42e5000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42e00fe0e0 0x7f42e01100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42e5000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01106a0 con 0x7f42e00fcef0 2024-02-28T16:05:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42e5000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0110f40 con 0x7f42e00fe0e0 2024-02-28T16:05:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42dde00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00fcef0 0x7f42e010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42dde00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00fcef0 0x7f42e010fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60704/0 (socket says 172.21.15.57:60704) 2024-02-28T16:05:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42dde00700 1 -- 172.21.15.57:0/2912818054 learned_addr learned my addr 172.21.15.57:0/2912818054 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:05:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42dd400700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42e00fe0e0 0x7f42e01100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:43.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42dde00700 1 -- 172.21.15.57:0/2912818054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42e00fe0e0 msgr2=0x7f42e01100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:43.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42dde00700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42e00fe0e0 0x7f42e01100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.446+0000 7f42dde00700 1 -- 172.21.15.57:0/2912818054 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc005040 con 0x7f42e00fcef0 2024-02-28T16:05:43.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.447+0000 7f42dde00700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00fcef0 0x7f42e010fb60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f42d000c8e0 tx=0x7f42d00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:43.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.447+0000 7f42d6000700 1 -- 172.21.15.57:0/2912818054 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42d000a940 con 0x7f42e00fcef0 2024-02-28T16:05:43.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.447+0000 7f42d6000700 1 -- 172.21.15.57:0/2912818054 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42d000ce80 con 0x7f42e00fcef0 2024-02-28T16:05:43.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.447+0000 7f42d6000700 1 -- 172.21.15.57:0/2912818054 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42d00113a0 con 0x7f42e00fcef0 2024-02-28T16:05:43.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.447+0000 7f42e5000700 1 -- 172.21.15.57:0/2912818054 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e0111220 con 0x7f42e00fcef0 2024-02-28T16:05:43.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.447+0000 7f42e5000700 1 -- 172.21.15.57:0/2912818054 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e0111760 con 0x7f42e00fcef0 2024-02-28T16:05:43.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.448+0000 7f42e5000700 1 -- 172.21.15.57:0/2912818054 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e0102210 con 0x7f42e00fcef0 2024-02-28T16:05:43.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.449+0000 7f42d6000700 1 -- 172.21.15.57:0/2912818054 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 38) v1 ==== 91587+0+0 (secure 0 0 0) 0x7f42d0012400 con 0x7f42e00fcef0 2024-02-28T16:05:43.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.450+0000 7f42d6000700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f42c406d900 0x7f42c406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:05:43.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.450+0000 7f42d6000700 1 -- 172.21.15.57:0/2912818054 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f42d008cfa0 con 0x7f42e00fcef0 2024-02-28T16:05:43.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.451+0000 7f42dd400700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f42c406d900 0x7f42c406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:05:43.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.451+0000 7f42dd400700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f42c406d900 0x7f42c406fdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00b840 tx=0x7f42cc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:05:43.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.455+0000 7f42d6000700 1 -- 172.21.15.57:0/2912818054 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f42d005a380 con 0x7f42e00fcef0 2024-02-28T16:05:43.640 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:43 smithi087 ceph-mon[82628]: pgmap v37: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:43.640 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:43 smithi087 ceph-mon[82628]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:43.640 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:43 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/50431237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:05:43.640 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:43 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1215144906' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:05:43.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:43 smithi057 ceph-mon[93219]: pgmap v37: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:43.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:43 smithi057 ceph-mon[93219]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:43.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:43 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/50431237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:05:43.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:43 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1215144906' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:05:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.759+0000 7f42e5000700 1 -- 172.21.15.57:0/2912818054 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f42e004bed0 con 0x7f42e00fcef0 2024-02-28T16:05:43.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.760+0000 7f42d6000700 1 -- 172.21.15.57:0/2912818054 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f42d0059f10 con 0x7f42e00fcef0 2024-02-28T16:05:43.752 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:05:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.762+0000 7f42e5000700 1 -- 172.21.15.57:0/2912818054 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f42c406d900 msgr2=0x7f42c406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.762+0000 7f42e5000700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f42c406d900 0x7f42c406fdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00b840 tx=0x7f42cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:05:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.762+0000 7f42e5000700 1 -- 172.21.15.57:0/2912818054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00fcef0 msgr2=0x7f42e010fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:05:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.762+0000 7f42e5000700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00fcef0 0x7f42e010fb60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f42d000c8e0 tx=0x7f42d00044c0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.763+0000 7f42e5000700 1 -- 172.21.15.57:0/2912818054 shutdown_connections 2024-02-28T16:05:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.763+0000 7f42e5000700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f42c406d900 0x7f42c406fdb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.763+0000 7f42e5000700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00fcef0 0x7f42e010fb60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.763+0000 7f42e5000700 1 --2- 172.21.15.57:0/2912818054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42e00fe0e0 0x7f42e01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:05:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.763+0000 7f42e5000700 1 -- 172.21.15.57:0/2912818054 >> 172.21.15.57:0/2912818054 conn(0x7f42e00f8620 msgr2=0x7f42e00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:05:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.763+0000 7f42e5000700 1 -- 172.21.15.57:0/2912818054 shutdown_connections 2024-02-28T16:05:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:05:43.763+0000 7f42e5000700 1 -- 172.21.15.57:0/2912818054 wait complete. 2024-02-28T16:05:44.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:44 smithi087 ceph-mon[82628]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:44.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:44 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2912818054' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:05:44.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:44.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:44.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:05:44.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:44.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:44 smithi057 ceph-mon[93219]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:05:44.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:44 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2912818054' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:05:44.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:44.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:44.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:05:44.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:45.736 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:45 smithi087 ceph-mon[82628]: pgmap v38: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:45.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:45 smithi087 ceph-mon[82628]: Reconfiguring osd.5 (monmap changed)... 2024-02-28T16:05:45.737 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:45 smithi087 ceph-mon[82628]: Reconfiguring daemon osd.5 on smithi087 2024-02-28T16:05:45.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:45 smithi057 ceph-mon[93219]: pgmap v38: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:45.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:45 smithi057 ceph-mon[93219]: Reconfiguring osd.5 (monmap changed)... 2024-02-28T16:05:45.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:45 smithi057 ceph-mon[93219]: Reconfiguring daemon osd.5 on smithi087 2024-02-28T16:05:47.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:47 smithi087 ceph-mon[82628]: pgmap v39: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:47.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:47.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:47.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.fzjgef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:05:47.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:47 smithi057 ceph-mon[93219]: pgmap v39: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.fzjgef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:05:47.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:48.846 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:48 smithi087 ceph-mon[82628]: Reconfiguring mds.cephfs.smithi087.fzjgef (monmap changed)... 2024-02-28T16:05:48.846 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:48 smithi087 ceph-mon[82628]: Reconfiguring daemon mds.cephfs.smithi087.fzjgef on smithi087 2024-02-28T16:05:48.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:48 smithi057 ceph-mon[93219]: Reconfiguring mds.cephfs.smithi087.fzjgef (monmap changed)... 2024-02-28T16:05:48.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:48 smithi057 ceph-mon[93219]: Reconfiguring daemon mds.cephfs.smithi087.fzjgef on smithi087 2024-02-28T16:05:49.910 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:49 smithi087 ceph-mon[82628]: pgmap v40: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:49.910 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:05:49.910 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:49.910 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:49.910 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.whebmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:05:49.910 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:49 smithi057 ceph-mon[93219]: pgmap v40: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:05:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.whebmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:05:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:50.826 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:50 smithi087 ceph-mon[82628]: Reconfiguring mds.cephfs.smithi087.whebmo (monmap changed)... 2024-02-28T16:05:50.826 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:50 smithi087 ceph-mon[82628]: Reconfiguring daemon mds.cephfs.smithi087.whebmo on smithi087 2024-02-28T16:05:50.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:50 smithi057 ceph-mon[93219]: Reconfiguring mds.cephfs.smithi087.whebmo (monmap changed)... 2024-02-28T16:05:50.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:50 smithi057 ceph-mon[93219]: Reconfiguring daemon mds.cephfs.smithi087.whebmo on smithi087 2024-02-28T16:05:51.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: pgmap v41: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:51.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:51.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:51.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:05:51.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:05:51.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:05:51.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:51.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi057"}]: dispatch 2024-02-28T16:05:51.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi057"}]': finished 2024-02-28T16:05:51.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi087"}]: dispatch 2024-02-28T16:05:51.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi087"}]': finished 2024-02-28T16:05:51.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: pgmap v41: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:51.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:51.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:51.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:05:51.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:05:51.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:05:51.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:51.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi057"}]: dispatch 2024-02-28T16:05:51.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi057"}]': finished 2024-02-28T16:05:51.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi087"}]: dispatch 2024-02-28T16:05:51.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi087"}]': finished 2024-02-28T16:05:52.674 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:52 smithi057 ceph-mon[93219]: Upgrade: Setting container_image for all mon 2024-02-28T16:05:52.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:52 smithi087 ceph-mon[82628]: Upgrade: Setting container_image for all mon 2024-02-28T16:05:53.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:53 smithi057 ceph-mon[93219]: pgmap v42: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:53.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:53 smithi087 ceph-mon[82628]: pgmap v42: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:54.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:54 smithi057 ceph-mon[93219]: pgmap v43: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:54.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:54 smithi057 ceph-mon[93219]: Upgrade: Updating crash.smithi057 (1/2) 2024-02-28T16:05:54.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:54 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:54.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:54 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi057", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:05:54.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:54 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:54.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:54 smithi057 ceph-mon[93219]: Deploying daemon crash.smithi057 on smithi057 2024-02-28T16:05:55.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:54 smithi087 ceph-mon[82628]: pgmap v43: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:55.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:54 smithi087 ceph-mon[82628]: Upgrade: Updating crash.smithi057 (1/2) 2024-02-28T16:05:55.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:54 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:05:55.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:54 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi057", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:05:55.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:54 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:05:55.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:54 smithi087 ceph-mon[82628]: Deploying daemon crash.smithi057 on smithi057 2024-02-28T16:05:56.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:56 smithi057 ceph-mon[93219]: pgmap v44: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:57.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:56 smithi087 ceph-mon[82628]: pgmap v44: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:05:58.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:05:58 smithi057 ceph-mon[93219]: pgmap v45: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:05:59.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:05:58 smithi087 ceph-mon[82628]: pgmap v45: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:00.375 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:00.375 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:00.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:00.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:01.437 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:01 smithi087 ceph-mon[82628]: pgmap v46: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:06:01.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:01 smithi057 ceph-mon[93219]: pgmap v46: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:06:02.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:02 smithi087 ceph-mon[82628]: Upgrade: Updating crash.smithi087 (2/2) 2024-02-28T16:06:02.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:02 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:02.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:02 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:06:02.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:02 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:06:02.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:02 smithi087 ceph-mon[82628]: Deploying daemon crash.smithi087 on smithi087 2024-02-28T16:06:02.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:02 smithi057 ceph-mon[93219]: Upgrade: Updating crash.smithi087 (2/2) 2024-02-28T16:06:02.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:02 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:02.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:02 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:06:02.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:02 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:06:02.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:02 smithi057 ceph-mon[93219]: Deploying daemon crash.smithi087 on smithi087 2024-02-28T16:06:03.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:03 smithi087 ceph-mon[82628]: pgmap v47: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:03.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:03 smithi057 ceph-mon[93219]: pgmap v47: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:04.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:06:04.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:06:05.923 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:05 smithi057 ceph-mon[93219]: pgmap v48: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:05.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:05 smithi087 ceph-mon[82628]: pgmap v48: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:07.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:07 smithi057 ceph-mon[93219]: pgmap v49: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-28T16:06:07.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:07 smithi057 ceph-mon[93219]: mgrmap e39: smithi057.upqerc(active, since 92s), standbys: smithi087.ewrszc 2024-02-28T16:06:07.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:07.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:07.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:06:07.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:07 smithi087 ceph-mon[82628]: pgmap v49: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-28T16:06:07.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:07 smithi087 ceph-mon[82628]: mgrmap e39: smithi057.upqerc(active, since 92s), standbys: smithi087.ewrszc 2024-02-28T16:06:07.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:07.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:07.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:06:09.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:09 smithi087 ceph-mon[82628]: pgmap v50: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-28T16:06:09.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:09 smithi057 ceph-mon[93219]: pgmap v50: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-28T16:06:10.829 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:10 smithi057 ceph-mon[93219]: pgmap v51: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-28T16:06:10.968 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:10 smithi087 ceph-mon[82628]: pgmap v51: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-28T16:06:12.494 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:12.495 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:12.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:12.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:13.648 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:13 smithi057 ceph-mon[93219]: pgmap v52: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-28T16:06:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:13 smithi087 ceph-mon[82628]: pgmap v52: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-28T16:06:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.931+0000 7fde22e00700 1 -- 172.21.15.57:0/2910282679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde1c071f10 msgr2=0x7fde1c070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.931+0000 7fde22e00700 1 --2- 172.21.15.57:0/2910282679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde1c071f10 0x7fde1c070380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde0c004940 tx=0x7fde0c009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.931+0000 7fde22e00700 1 -- 172.21.15.57:0/2910282679 shutdown_connections 2024-02-28T16:06:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.931+0000 7fde22e00700 1 --2- 172.21.15.57:0/2910282679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde1c0708c0 0x7fde1c070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.931+0000 7fde22e00700 1 --2- 172.21.15.57:0/2910282679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde1c071f10 0x7fde1c070380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.931+0000 7fde22e00700 1 -- 172.21.15.57:0/2910282679 >> 172.21.15.57:0/2910282679 conn(0x7fde1c0f8620 msgr2=0x7fde1c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.932+0000 7fde22e00700 1 -- 172.21.15.57:0/2910282679 shutdown_connections 2024-02-28T16:06:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.932+0000 7fde22e00700 1 -- 172.21.15.57:0/2910282679 wait complete. 2024-02-28T16:06:13.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.932+0000 7fde22e00700 1 Processor -- start 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.933+0000 7fde22e00700 1 -- start start 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.933+0000 7fde22e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde1c0708c0 0x7fde1c10fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.933+0000 7fde22e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde1c071f10 0x7fde1c1100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.933+0000 7fde22e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c1106e0 con 0x7fde1c0708c0 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.933+0000 7fde22e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c110f80 con 0x7fde1c071f10 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.933+0000 7fde1be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde1c0708c0 0x7fde1c10fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.933+0000 7fde1be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde1c0708c0 0x7fde1c10fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40092/0 (socket says 172.21.15.57:40092) 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.933+0000 7fde1be00700 1 -- 172.21.15.57:0/2265986534 learned_addr learned my addr 172.21.15.57:0/2265986534 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.934+0000 7fde1b400700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde1c071f10 0x7fde1c1100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.934+0000 7fde1be00700 1 -- 172.21.15.57:0/2265986534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde1c071f10 msgr2=0x7fde1c1100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.934+0000 7fde1be00700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde1c071f10 0x7fde1c1100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.934+0000 7fde1be00700 1 -- 172.21.15.57:0/2265986534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c005040 con 0x7fde1c0708c0 2024-02-28T16:06:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.934+0000 7fde1be00700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde1c0708c0 0x7fde1c10fba0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde0c000c00 tx=0x7fde0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:13.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.934+0000 7fde13e00700 1 -- 172.21.15.57:0/2265986534 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde0c00e040 con 0x7fde1c0708c0 2024-02-28T16:06:13.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.934+0000 7fde13e00700 1 -- 172.21.15.57:0/2265986534 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde0c004290 con 0x7fde1c0708c0 2024-02-28T16:06:13.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.935+0000 7fde22e00700 1 -- 172.21.15.57:0/2265986534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1c111200 con 0x7fde1c0708c0 2024-02-28T16:06:13.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.935+0000 7fde13e00700 1 -- 172.21.15.57:0/2265986534 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde0c01c630 con 0x7fde1c0708c0 2024-02-28T16:06:13.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.935+0000 7fde22e00700 1 -- 172.21.15.57:0/2265986534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c111740 con 0x7fde1c0708c0 2024-02-28T16:06:13.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.936+0000 7fde22e00700 1 -- 172.21.15.57:0/2265986534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c04bed0 con 0x7fde1c0708c0 2024-02-28T16:06:13.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.937+0000 7fde13e00700 1 -- 172.21.15.57:0/2265986534 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fde0c00bc60 con 0x7fde1c0708c0 2024-02-28T16:06:13.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.938+0000 7fde13e00700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde0006d7e0 0x7fde0006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.938+0000 7fde13e00700 1 -- 172.21.15.57:0/2265986534 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fde0c08e300 con 0x7fde1c0708c0 2024-02-28T16:06:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.938+0000 7fde1b400700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde0006d7e0 0x7fde0006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.939+0000 7fde1b400700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde0006d7e0 0x7fde0006fc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde08004990 tx=0x7fde08009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:13.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:13.943+0000 7fde13e00700 1 -- 172.21.15.57:0/2265986534 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fde0c05b6b0 con 0x7fde1c0708c0 2024-02-28T16:06:14.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.204+0000 7fde22e00700 1 -- 172.21.15.57:0/2265986534 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde1c111db0 con 0x7fde0006d7e0 2024-02-28T16:06:14.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.206+0000 7fde13e00700 1 -- 172.21.15.57:0/2265986534 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fde1c111db0 con 0x7fde0006d7e0 2024-02-28T16:06:14.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 -- 172.21.15.57:0/2265986534 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde0006d7e0 msgr2=0x7fde0006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:14.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde0006d7e0 0x7fde0006fc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde08004990 tx=0x7fde08009ee0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 -- 172.21.15.57:0/2265986534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde1c0708c0 msgr2=0x7fde1c10fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:14.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde1c0708c0 0x7fde1c10fba0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde0c000c00 tx=0x7fde0c009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:14.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 -- 172.21.15.57:0/2265986534 shutdown_connections 2024-02-28T16:06:14.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde0006d7e0 0x7fde0006fc90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde1c0708c0 0x7fde1c10fba0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 --2- 172.21.15.57:0/2265986534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde1c071f10 0x7fde1c1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 -- 172.21.15.57:0/2265986534 >> 172.21.15.57:0/2265986534 conn(0x7fde1c0f8620 msgr2=0x7fde1c102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:14.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 -- 172.21.15.57:0/2265986534 shutdown_connections 2024-02-28T16:06:14.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.209+0000 7fde22e00700 1 -- 172.21.15.57:0/2265986534 wait complete. 2024-02-28T16:06:14.219 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:06:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.377+0000 7f880fa00700 1 -- 172.21.15.57:0/2276689000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88080fe2b0 msgr2=0x7f88080fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.377+0000 7f880fa00700 1 --2- 172.21.15.57:0/2276689000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88080fe2b0 0x7f88080fe700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87f4004940 tx=0x7f87f4009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.378+0000 7f880fa00700 1 -- 172.21.15.57:0/2276689000 shutdown_connections 2024-02-28T16:06:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.378+0000 7f880fa00700 1 --2- 172.21.15.57:0/2276689000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88080fe2b0 0x7f88080fe700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.378+0000 7f880fa00700 1 --2- 172.21.15.57:0/2276689000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88080fb220 0x7f88080fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.378+0000 7f880fa00700 1 -- 172.21.15.57:0/2276689000 >> 172.21.15.57:0/2276689000 conn(0x7f88080f6ca0 msgr2=0x7f88080f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.378+0000 7f880fa00700 1 -- 172.21.15.57:0/2276689000 shutdown_connections 2024-02-28T16:06:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.378+0000 7f880fa00700 1 -- 172.21.15.57:0/2276689000 wait complete. 2024-02-28T16:06:14.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.379+0000 7f880fa00700 1 Processor -- start 2024-02-28T16:06:14.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.379+0000 7f880fa00700 1 -- start start 2024-02-28T16:06:14.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.380+0000 7f880fa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88080fb220 0x7f880810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:14.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.380+0000 7f880fa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88080fe2b0 0x7f880810df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:14.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.380+0000 7f880fa00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880810e550 con 0x7f88080fe2b0 2024-02-28T16:06:14.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.380+0000 7f880fa00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880810edf0 con 0x7f88080fb220 2024-02-28T16:06:14.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.380+0000 7f8807e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88080fe2b0 0x7f880810df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:14.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.380+0000 7f8807e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88080fe2b0 0x7f880810df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40118/0 (socket says 172.21.15.57:40118) 2024-02-28T16:06:14.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.380+0000 7f8807e00700 1 -- 172.21.15.57:0/1675189092 learned_addr learned my addr 172.21.15.57:0/1675189092 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:14.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.381+0000 7f880d000700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88080fb220 0x7f880810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:14.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.381+0000 7f8807e00700 1 -- 172.21.15.57:0/1675189092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88080fb220 msgr2=0x7f880810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:14.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.381+0000 7f8807e00700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88080fb220 0x7f880810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.381+0000 7f8807e00700 1 -- 172.21.15.57:0/1675189092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4005040 con 0x7f88080fe2b0 2024-02-28T16:06:14.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.381+0000 7f8807e00700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88080fe2b0 0x7f880810df50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009fd0 tx=0x7f87f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:14.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.382+0000 7f8804c00700 1 -- 172.21.15.57:0/1675189092 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f400e040 con 0x7f88080fe2b0 2024-02-28T16:06:14.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.382+0000 7f8804c00700 1 -- 172.21.15.57:0/1675189092 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87f400bbf0 con 0x7f88080fe2b0 2024-02-28T16:06:14.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.382+0000 7f8804c00700 1 -- 172.21.15.57:0/1675189092 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f401c630 con 0x7f88080fe2b0 2024-02-28T16:06:14.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.382+0000 7f880fa00700 1 -- 172.21.15.57:0/1675189092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880810f070 con 0x7f88080fe2b0 2024-02-28T16:06:14.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.382+0000 7f880fa00700 1 -- 172.21.15.57:0/1675189092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880810f5b0 con 0x7f88080fe2b0 2024-02-28T16:06:14.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.383+0000 7f880fa00700 1 -- 172.21.15.57:0/1675189092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880804bed0 con 0x7f88080fe2b0 2024-02-28T16:06:14.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.385+0000 7f8804c00700 1 -- 172.21.15.57:0/1675189092 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f87f4013980 con 0x7f88080fe2b0 2024-02-28T16:06:14.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.386+0000 7f8804c00700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87f006d7f0 0x7f87f006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:14.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.386+0000 7f8804c00700 1 -- 172.21.15.57:0/1675189092 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f87f408e220 con 0x7f88080fe2b0 2024-02-28T16:06:14.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.387+0000 7f880d000700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87f006d7f0 0x7f87f006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:14.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.387+0000 7f880d000700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87f006d7f0 0x7f87f006fca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009fd0 tx=0x7f87fc009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:14.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.394+0000 7f8804c00700 1 -- 172.21.15.57:0/1675189092 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f87f405b650 con 0x7f88080fe2b0 2024-02-28T16:06:14.600 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:14 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:14.600 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:14 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:14.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.652+0000 7f880fa00700 1 -- 172.21.15.57:0/1675189092 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f880810fa20 con 0x7f87f006d7f0 2024-02-28T16:06:14.646 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:14 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:14.646 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:14 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:14.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.654+0000 7f8804c00700 1 -- 172.21.15.57:0/1675189092 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f880810fa20 con 0x7f87f006d7f0 2024-02-28T16:06:14.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.656+0000 7f880fa00700 1 -- 172.21.15.57:0/1675189092 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87f006d7f0 msgr2=0x7f87f006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:14.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.656+0000 7f880fa00700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87f006d7f0 0x7f87f006fca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009fd0 tx=0x7f87fc009f00 comp rx=0 tx=0).stop 2024-02-28T16:06:14.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.656+0000 7f880fa00700 1 -- 172.21.15.57:0/1675189092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88080fe2b0 msgr2=0x7f880810df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:14.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.656+0000 7f880fa00700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88080fe2b0 0x7f880810df50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009fd0 tx=0x7f87f4009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:14.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.657+0000 7f880fa00700 1 -- 172.21.15.57:0/1675189092 shutdown_connections 2024-02-28T16:06:14.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.657+0000 7f880fa00700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87f006d7f0 0x7f87f006fca0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.657+0000 7f880fa00700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88080fb220 0x7f880810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.657+0000 7f880fa00700 1 --2- 172.21.15.57:0/1675189092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88080fe2b0 0x7f880810df50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.657+0000 7f880fa00700 1 -- 172.21.15.57:0/1675189092 >> 172.21.15.57:0/1675189092 conn(0x7f88080f6ca0 msgr2=0x7f88081014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:14.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.657+0000 7f880fa00700 1 -- 172.21.15.57:0/1675189092 shutdown_connections 2024-02-28T16:06:14.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.657+0000 7f880fa00700 1 -- 172.21.15.57:0/1675189092 wait complete. 2024-02-28T16:06:14.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.808+0000 7f7de0e00700 1 -- 172.21.15.57:0/791686249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0fe1d0 msgr2=0x7f7ddc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:14.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.808+0000 7f7de0e00700 1 --2- 172.21.15.57:0/791686249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0fe1d0 0x7f7ddc100650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8004940 tx=0x7f7dc8009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:14.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.808+0000 7f7de0e00700 1 -- 172.21.15.57:0/791686249 shutdown_connections 2024-02-28T16:06:14.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.808+0000 7f7de0e00700 1 --2- 172.21.15.57:0/791686249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0fe1d0 0x7f7ddc100650 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.808+0000 7f7de0e00700 1 --2- 172.21.15.57:0/791686249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ddc0fb870 0x7f7ddc0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.808+0000 7f7de0e00700 1 -- 172.21.15.57:0/791686249 >> 172.21.15.57:0/791686249 conn(0x7f7ddc0f74e0 msgr2=0x7f7ddc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:14.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.808+0000 7f7de0e00700 1 -- 172.21.15.57:0/791686249 shutdown_connections 2024-02-28T16:06:14.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.808+0000 7f7de0e00700 1 -- 172.21.15.57:0/791686249 wait complete. 2024-02-28T16:06:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.809+0000 7f7de0e00700 1 Processor -- start 2024-02-28T16:06:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.809+0000 7f7de0e00700 1 -- start start 2024-02-28T16:06:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.810+0000 7f7de0e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ddc0fb870 0x7f7ddc113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.810+0000 7f7de0e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0fe1d0 0x7f7ddc114470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.810+0000 7f7de0e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc114b00 con 0x7f7ddc0fe1d0 2024-02-28T16:06:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.810+0000 7f7de0e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc115340 con 0x7f7ddc0fb870 2024-02-28T16:06:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.810+0000 7f7dd9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0fe1d0 0x7f7ddc114470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.810+0000 7f7dd9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0fe1d0 0x7f7ddc114470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40138/0 (socket says 172.21.15.57:40138) 2024-02-28T16:06:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.810+0000 7f7dd9400700 1 -- 172.21.15.57:0/3692362711 learned_addr learned my addr 172.21.15.57:0/3692362711 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.810+0000 7f7dd9e00700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ddc0fb870 0x7f7ddc113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.810+0000 7f7dd9400700 1 -- 172.21.15.57:0/3692362711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ddc0fb870 msgr2=0x7f7ddc113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.811+0000 7f7dd9400700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ddc0fb870 0x7f7ddc113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.811+0000 7f7dd9400700 1 -- 172.21.15.57:0/3692362711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8005040 con 0x7f7ddc0fe1d0 2024-02-28T16:06:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.811+0000 7f7dd9400700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0fe1d0 0x7f7ddc114470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800b3b0 tx=0x7f7dc8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.811+0000 7f7dd2000700 1 -- 172.21.15.57:0/3692362711 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dc800e040 con 0x7f7ddc0fe1d0 2024-02-28T16:06:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.811+0000 7f7dd2000700 1 -- 172.21.15.57:0/3692362711 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7dc800bd90 con 0x7f7ddc0fe1d0 2024-02-28T16:06:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.811+0000 7f7de0e00700 1 -- 172.21.15.57:0/3692362711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc1155c0 con 0x7f7ddc0fe1d0 2024-02-28T16:06:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.811+0000 7f7dd2000700 1 -- 172.21.15.57:0/3692362711 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dc801c630 con 0x7f7ddc0fe1d0 2024-02-28T16:06:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.811+0000 7f7de0e00700 1 -- 172.21.15.57:0/3692362711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc115b00 con 0x7f7ddc0fe1d0 2024-02-28T16:06:14.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.812+0000 7f7de0e00700 1 -- 172.21.15.57:0/3692362711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc04bed0 con 0x7f7ddc0fe1d0 2024-02-28T16:06:14.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.814+0000 7f7dd2000700 1 -- 172.21.15.57:0/3692362711 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f7dc80139f0 con 0x7f7ddc0fe1d0 2024-02-28T16:06:14.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.815+0000 7f7dd2000700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dc006d7f0 0x7f7dc006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:14.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.815+0000 7f7dd2000700 1 -- 172.21.15.57:0/3692362711 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7dc808e430 con 0x7f7ddc0fe1d0 2024-02-28T16:06:14.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.815+0000 7f7dd9e00700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dc006d7f0 0x7f7dc006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:14.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.816+0000 7f7dd9e00700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dc006d7f0 0x7f7dc006fca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc006fd0 tx=0x7f7dcc008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:14.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:14.820+0000 7f7dd2000700 1 -- 172.21.15.57:0/3692362711 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7dc805b7e0 con 0x7f7ddc0fe1d0 2024-02-28T16:06:15.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.056+0000 7f7de0e00700 1 -- 172.21.15.57:0/3692362711 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ddc116050 con 0x7f7dc006d7f0 2024-02-28T16:06:15.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.070+0000 7f7dd2000700 1 -- 172.21.15.57:0/3692362711 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7ddc116050 con 0x7f7dc006d7f0 2024-02-28T16:06:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:06:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (4m) 0s ago 15m 14.0M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:06:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (16s) 0s ago 15m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:06:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (8s) 3s ago 14m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:06:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (3m) 0s ago 14m 74.8M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:06:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (8m) 0s ago 8m 125M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:06:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (7m) 0s ago 7m 68.1M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:06:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (8m) 3s ago 8m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:06:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (7m) 3s ago 7m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:06:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (3m) 0s ago 17m 496M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (2m) 3s ago 13m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (114s) 0s ago 17m 42.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (77s) 3s ago 13m 35.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (4m) 0s ago 15m 8024k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (3m) 3s ago 13m 7852k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (12m) 0s ago 12m 213M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 e62180e2f232 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (12m) 0s ago 12m 234M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (11m) 0s ago 11m 192M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (11m) 3s ago 11m 261M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (10m) 3s ago 10m 236M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (9m) 3s ago 9m 220M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:06:15.065 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (2m) 0s ago 14m 48.3M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:06:15.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 -- 172.21.15.57:0/3692362711 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dc006d7f0 msgr2=0x7f7dc006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:15.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dc006d7f0 0x7f7dc006fca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc006fd0 tx=0x7f7dcc008040 comp rx=0 tx=0).stop 2024-02-28T16:06:15.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 -- 172.21.15.57:0/3692362711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0fe1d0 msgr2=0x7f7ddc114470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:15.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0fe1d0 0x7f7ddc114470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800b3b0 tx=0x7f7dc8009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:15.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 -- 172.21.15.57:0/3692362711 shutdown_connections 2024-02-28T16:06:15.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dc006d7f0 0x7f7dc006fca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ddc0fb870 0x7f7ddc113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 --2- 172.21.15.57:0/3692362711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0fe1d0 0x7f7ddc114470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 -- 172.21.15.57:0/3692362711 >> 172.21.15.57:0/3692362711 conn(0x7f7ddc0f74e0 msgr2=0x7f7ddc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:15.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 -- 172.21.15.57:0/3692362711 shutdown_connections 2024-02-28T16:06:15.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.073+0000 7f7de0e00700 1 -- 172.21.15.57:0/3692362711 wait complete. 2024-02-28T16:06:15.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.220+0000 7f0022600700 1 -- 172.21.15.57:0/1886875080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c0fe0e0 msgr2=0x7f001c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:15.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.220+0000 7f0022600700 1 --2- 172.21.15.57:0/1886875080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c0fe0e0 0x7f001c0fe550 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0008004940 tx=0x7f0008009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:15.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.220+0000 7f0022600700 1 -- 172.21.15.57:0/1886875080 shutdown_connections 2024-02-28T16:06:15.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.220+0000 7f0022600700 1 --2- 172.21.15.57:0/1886875080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c0fe0e0 0x7f001c0fe550 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.220+0000 7f0022600700 1 --2- 172.21.15.57:0/1886875080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c0fcef0 0x7f001c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.220+0000 7f0022600700 1 -- 172.21.15.57:0/1886875080 >> 172.21.15.57:0/1886875080 conn(0x7f001c0f8620 msgr2=0x7f001c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:15.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.220+0000 7f0022600700 1 -- 172.21.15.57:0/1886875080 shutdown_connections 2024-02-28T16:06:15.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.220+0000 7f0022600700 1 -- 172.21.15.57:0/1886875080 wait complete. 2024-02-28T16:06:15.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.221+0000 7f0022600700 1 Processor -- start 2024-02-28T16:06:15.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.221+0000 7f0022600700 1 -- start start 2024-02-28T16:06:15.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.222+0000 7f0022600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c0fcef0 0x7f001c10d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:15.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.222+0000 7f0022600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c0fe0e0 0x7f001c10de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:15.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.222+0000 7f0022600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c10e410 con 0x7f001c0fe0e0 2024-02-28T16:06:15.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.222+0000 7f0022600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c10ecb0 con 0x7f001c0fcef0 2024-02-28T16:06:15.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.222+0000 7f001aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c0fe0e0 0x7f001c10de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:15.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.222+0000 7f001b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c0fcef0 0x7f001c10d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:15.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.222+0000 7f001aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c0fe0e0 0x7f001c10de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40158/0 (socket says 172.21.15.57:40158) 2024-02-28T16:06:15.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.222+0000 7f001aa00700 1 -- 172.21.15.57:0/400945049 learned_addr learned my addr 172.21.15.57:0/400945049 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:15.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.223+0000 7f001aa00700 1 -- 172.21.15.57:0/400945049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c0fcef0 msgr2=0x7f001c10d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:15.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.223+0000 7f001aa00700 1 --2- 172.21.15.57:0/400945049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c0fcef0 0x7f001c10d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.223+0000 7f001aa00700 1 -- 172.21.15.57:0/400945049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008005040 con 0x7f001c0fe0e0 2024-02-28T16:06:15.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.224+0000 7f001aa00700 1 --2- 172.21.15.57:0/400945049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c0fe0e0 0x7f001c10de10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00080043d0 tx=0x7f0008009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:15.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.224+0000 7f0013400700 1 -- 172.21.15.57:0/400945049 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f000800e070 con 0x7f001c0fe0e0 2024-02-28T16:06:15.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.224+0000 7f0013400700 1 -- 172.21.15.57:0/400945049 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f000801c400 con 0x7f001c0fe0e0 2024-02-28T16:06:15.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.224+0000 7f0022600700 1 -- 172.21.15.57:0/400945049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c10ef30 con 0x7f001c0fe0e0 2024-02-28T16:06:15.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.225+0000 7f0013400700 1 -- 172.21.15.57:0/400945049 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f000800b650 con 0x7f001c0fe0e0 2024-02-28T16:06:15.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.225+0000 7f0022600700 1 -- 172.21.15.57:0/400945049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c10f410 con 0x7f001c0fe0e0 2024-02-28T16:06:15.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.226+0000 7f0022600700 1 -- 172.21.15.57:0/400945049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c04bed0 con 0x7f001c0fe0e0 2024-02-28T16:06:15.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.230+0000 7f0013400700 1 -- 172.21.15.57:0/400945049 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f000801ca70 con 0x7f001c0fe0e0 2024-02-28T16:06:15.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.231+0000 7f0013400700 1 --2- 172.21.15.57:0/400945049 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7e0 0x7f000006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:15.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.231+0000 7f0013400700 1 -- 172.21.15.57:0/400945049 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f000808e4b0 con 0x7f001c0fe0e0 2024-02-28T16:06:15.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.232+0000 7f001b400700 1 --2- 172.21.15.57:0/400945049 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7e0 0x7f000006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:15.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.233+0000 7f001b400700 1 --2- 172.21.15.57:0/400945049 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7e0 0x7f000006fc90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f000c009b80 tx=0x7f000c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:15.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.237+0000 7f0013400700 1 -- 172.21.15.57:0/400945049 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f000805b8e0 con 0x7f001c0fe0e0 2024-02-28T16:06:15.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.545+0000 7f0022600700 1 -- 172.21.15.57:0/400945049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f001c105a30 con 0x7f001c0fe0e0 2024-02-28T16:06:15.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.546+0000 7f0013400700 1 -- 172.21.15.57:0/400945049 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f000805b470 con 0x7f001c0fe0e0 2024-02-28T16:06:15.539 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:06:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:06:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 10, 2024-02-28T16:06:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:06:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:06:15.541 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:06:15.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 -- 172.21.15.57:0/400945049 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7e0 msgr2=0x7f000006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:15.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 --2- 172.21.15.57:0/400945049 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7e0 0x7f000006fc90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f000c009b80 tx=0x7f000c00b040 comp rx=0 tx=0).stop 2024-02-28T16:06:15.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 -- 172.21.15.57:0/400945049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c0fe0e0 msgr2=0x7f001c10de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:15.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 --2- 172.21.15.57:0/400945049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c0fe0e0 0x7f001c10de10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00080043d0 tx=0x7f0008009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:15.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 -- 172.21.15.57:0/400945049 shutdown_connections 2024-02-28T16:06:15.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 --2- 172.21.15.57:0/400945049 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7e0 0x7f000006fc90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 --2- 172.21.15.57:0/400945049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c0fcef0 0x7f001c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 --2- 172.21.15.57:0/400945049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c0fe0e0 0x7f001c10de10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 -- 172.21.15.57:0/400945049 >> 172.21.15.57:0/400945049 conn(0x7f001c0f8620 msgr2=0x7f001c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:15.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 -- 172.21.15.57:0/400945049 shutdown_connections 2024-02-28T16:06:15.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.549+0000 7f0022600700 1 -- 172.21.15.57:0/400945049 wait complete. 2024-02-28T16:06:15.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.701+0000 7ff97b000700 1 -- 172.21.15.57:0/2955873107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9740708c0 msgr2=0x7ff974070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:15.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.701+0000 7ff97b000700 1 --2- 172.21.15.57:0/2955873107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9740708c0 0x7ff974070d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff960004940 tx=0x7ff960009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:15.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.701+0000 7ff97b000700 1 -- 172.21.15.57:0/2955873107 shutdown_connections 2024-02-28T16:06:15.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.701+0000 7ff97b000700 1 --2- 172.21.15.57:0/2955873107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9740708c0 0x7ff974070d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.701+0000 7ff97b000700 1 --2- 172.21.15.57:0/2955873107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff974071f10 0x7ff974070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.701+0000 7ff97b000700 1 -- 172.21.15.57:0/2955873107 >> 172.21.15.57:0/2955873107 conn(0x7ff9740f8620 msgr2=0x7ff9740faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:15.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.701+0000 7ff97b000700 1 -- 172.21.15.57:0/2955873107 shutdown_connections 2024-02-28T16:06:15.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.701+0000 7ff97b000700 1 -- 172.21.15.57:0/2955873107 wait complete. 2024-02-28T16:06:15.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.702+0000 7ff97b000700 1 Processor -- start 2024-02-28T16:06:15.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.702+0000 7ff97b000700 1 -- start start 2024-02-28T16:06:15.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.703+0000 7ff97b000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9740708c0 0x7ff974113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:15.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.703+0000 7ff97b000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff974071f10 0x7ff9741144f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:15.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.703+0000 7ff97b000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff974114af0 con 0x7ff9740708c0 2024-02-28T16:06:15.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.703+0000 7ff97b000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff974115390 con 0x7ff974071f10 2024-02-28T16:06:15.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:15 smithi057 ceph-mon[93219]: pgmap v53: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-28T16:06:15.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:15 smithi057 ceph-mon[93219]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:15.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:15 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:15.696 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:15 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.703+0000 7ff973e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9740708c0 0x7ff974113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.703+0000 7ff973e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9740708c0 0x7ff974113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40172/0 (socket says 172.21.15.57:40172) 2024-02-28T16:06:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.703+0000 7ff973e00700 1 -- 172.21.15.57:0/103700038 learned_addr learned my addr 172.21.15.57:0/103700038 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.703+0000 7ff973400700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff974071f10 0x7ff9741144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.704+0000 7ff973e00700 1 -- 172.21.15.57:0/103700038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff974071f10 msgr2=0x7ff9741144f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.704+0000 7ff973e00700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff974071f10 0x7ff9741144f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.704+0000 7ff973e00700 1 -- 172.21.15.57:0/103700038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff960005040 con 0x7ff9740708c0 2024-02-28T16:06:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.704+0000 7ff973e00700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9740708c0 0x7ff974113fb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff964002a50 tx=0x7ff9640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:15.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.704+0000 7ff96be00700 1 -- 172.21.15.57:0/103700038 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff964007cc0 con 0x7ff9740708c0 2024-02-28T16:06:15.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.705+0000 7ff96be00700 1 -- 172.21.15.57:0/103700038 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff96400f040 con 0x7ff9740708c0 2024-02-28T16:06:15.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.705+0000 7ff97b000700 1 -- 172.21.15.57:0/103700038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff974115670 con 0x7ff9740708c0 2024-02-28T16:06:15.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.705+0000 7ff97b000700 1 -- 172.21.15.57:0/103700038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff974115bb0 con 0x7ff9740708c0 2024-02-28T16:06:15.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.705+0000 7ff96be00700 1 -- 172.21.15.57:0/103700038 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff96400da30 con 0x7ff9740708c0 2024-02-28T16:06:15.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.706+0000 7ff97b000700 1 -- 172.21.15.57:0/103700038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97404bed0 con 0x7ff9740708c0 2024-02-28T16:06:15.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.707+0000 7ff96be00700 1 -- 172.21.15.57:0/103700038 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff96400db90 con 0x7ff9740708c0 2024-02-28T16:06:15.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.708+0000 7ff96be00700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff95806d7f0 0x7ff95806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:15.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.708+0000 7ff96be00700 1 -- 172.21.15.57:0/103700038 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff96408ccb0 con 0x7ff9740708c0 2024-02-28T16:06:15.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.708+0000 7ff973400700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff95806d7f0 0x7ff95806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:15.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.709+0000 7ff973400700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff95806d7f0 0x7ff95806fca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff9600043d0 tx=0x7ff960009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:15.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.713+0000 7ff96be00700 1 -- 172.21.15.57:0/103700038 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff964059fe0 con 0x7ff9740708c0 2024-02-28T16:06:15.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:15 smithi087 ceph-mon[82628]: pgmap v53: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-28T16:06:15.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:15 smithi087 ceph-mon[82628]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:15.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:15 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:15.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:15 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:15.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.975+0000 7ff97b000700 1 -- 172.21.15.57:0/103700038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff974115f20 con 0x7ff9740708c0 2024-02-28T16:06:15.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.975+0000 7ff96be00700 1 -- 172.21.15.57:0/103700038 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1897 (secure 0 0 0) 0x7ff964059b70 con 0x7ff9740708c0 2024-02-28T16:06:15.968 INFO:teuthology.orchestra.run.smithi057.stdout:e16 2024-02-28T16:06:15.968 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 16 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:02:07.353165+0000 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:06:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:06:15.970 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:06:15.971 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:06:15.971 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:06:15.971 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:06:15.971 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:06:15.971 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:06:15.971 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:06:15.971 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:06:15.971 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:06:15.971 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:06:15.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.979+0000 7ff97b000700 1 -- 172.21.15.57:0/103700038 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff95806d7f0 msgr2=0x7ff95806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:15.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.979+0000 7ff97b000700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff95806d7f0 0x7ff95806fca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff9600043d0 tx=0x7ff960009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:15.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.979+0000 7ff97b000700 1 -- 172.21.15.57:0/103700038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9740708c0 msgr2=0x7ff974113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:15.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.979+0000 7ff97b000700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9740708c0 0x7ff974113fb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff964002a50 tx=0x7ff9640046b0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.979+0000 7ff97b000700 1 -- 172.21.15.57:0/103700038 shutdown_connections 2024-02-28T16:06:15.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.979+0000 7ff97b000700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff95806d7f0 0x7ff95806fca0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.979+0000 7ff97b000700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9740708c0 0x7ff974113fb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.979+0000 7ff97b000700 1 --2- 172.21.15.57:0/103700038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff974071f10 0x7ff9741144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:15.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.979+0000 7ff97b000700 1 -- 172.21.15.57:0/103700038 >> 172.21.15.57:0/103700038 conn(0x7ff9740f8620 msgr2=0x7ff9740fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:15.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.979+0000 7ff97b000700 1 -- 172.21.15.57:0/103700038 shutdown_connections 2024-02-28T16:06:15.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:15.980+0000 7ff97b000700 1 -- 172.21.15.57:0/103700038 wait complete. 2024-02-28T16:06:15.973 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2024-02-28T16:06:16.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.133+0000 7feada000700 1 -- 172.21.15.57:0/2411629022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fead40fcef0 msgr2=0x7fead40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:16.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.133+0000 7feada000700 1 --2- 172.21.15.57:0/2411629022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fead40fcef0 0x7fead40fd320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feac4004940 tx=0x7feac4009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:16.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.133+0000 7feada000700 1 -- 172.21.15.57:0/2411629022 shutdown_connections 2024-02-28T16:06:16.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.133+0000 7feada000700 1 --2- 172.21.15.57:0/2411629022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead40fe0e0 0x7fead40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.133+0000 7feada000700 1 --2- 172.21.15.57:0/2411629022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fead40fcef0 0x7fead40fd320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.133+0000 7feada000700 1 -- 172.21.15.57:0/2411629022 >> 172.21.15.57:0/2411629022 conn(0x7fead40f8620 msgr2=0x7fead40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:16.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.133+0000 7feada000700 1 -- 172.21.15.57:0/2411629022 shutdown_connections 2024-02-28T16:06:16.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.134+0000 7feada000700 1 -- 172.21.15.57:0/2411629022 wait complete. 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.134+0000 7feada000700 1 Processor -- start 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.135+0000 7feada000700 1 -- start start 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.135+0000 7feada000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fead40fcef0 0x7fead410fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.135+0000 7feada000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead40fe0e0 0x7fead41100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.135+0000 7feada000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead4110760 con 0x7fead40fcef0 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.135+0000 7feada000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead4110fa0 con 0x7fead40fe0e0 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.135+0000 7fead3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fead40fcef0 0x7fead410fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.135+0000 7fead3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fead40fcef0 0x7fead410fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40182/0 (socket says 172.21.15.57:40182) 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.135+0000 7fead3400700 1 -- 172.21.15.57:0/1919776552 learned_addr learned my addr 172.21.15.57:0/1919776552 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.136+0000 7fead3400700 1 -- 172.21.15.57:0/1919776552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead40fe0e0 msgr2=0x7fead41100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.136+0000 7fead3400700 1 --2- 172.21.15.57:0/1919776552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead40fe0e0 0x7fead41100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.136+0000 7fead3400700 1 -- 172.21.15.57:0/1919776552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4005040 con 0x7fead40fcef0 2024-02-28T16:06:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.136+0000 7fead3400700 1 --2- 172.21.15.57:0/1919776552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fead40fcef0 0x7fead410fb90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feac4000c00 tx=0x7feac4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:16.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.136+0000 7feacb400700 1 -- 172.21.15.57:0/1919776552 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac400e040 con 0x7fead40fcef0 2024-02-28T16:06:16.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.136+0000 7feacb400700 1 -- 172.21.15.57:0/1919776552 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feac400bcc0 con 0x7fead40fcef0 2024-02-28T16:06:16.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.136+0000 7feada000700 1 -- 172.21.15.57:0/1919776552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead4111220 con 0x7fead40fcef0 2024-02-28T16:06:16.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.136+0000 7feacb400700 1 -- 172.21.15.57:0/1919776552 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac401c630 con 0x7fead40fcef0 2024-02-28T16:06:16.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.136+0000 7feada000700 1 -- 172.21.15.57:0/1919776552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead4111760 con 0x7fead40fcef0 2024-02-28T16:06:16.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.138+0000 7feada000700 1 -- 172.21.15.57:0/1919776552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead4102210 con 0x7fead40fcef0 2024-02-28T16:06:16.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.140+0000 7feacb400700 1 -- 172.21.15.57:0/1919776552 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7feac4013980 con 0x7fead40fcef0 2024-02-28T16:06:16.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.140+0000 7feacb400700 1 --2- 172.21.15.57:0/1919776552 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7feab806d7e0 0x7feab806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:16.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.140+0000 7feacb400700 1 -- 172.21.15.57:0/1919776552 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7feac408e380 con 0x7fead40fcef0 2024-02-28T16:06:16.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.141+0000 7feacbe00700 1 --2- 172.21.15.57:0/1919776552 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7feab806d7e0 0x7feab806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:16.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.142+0000 7feacbe00700 1 --2- 172.21.15.57:0/1919776552 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7feab806d7e0 0x7feab806fc90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feabc006fd0 tx=0x7feabc006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:16.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.145+0000 7feacb400700 1 -- 172.21.15.57:0/1919776552 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feac405b6b0 con 0x7fead40fcef0 2024-02-28T16:06:16.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.393+0000 7feada000700 1 -- 172.21.15.57:0/1919776552 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fead4111ab0 con 0x7feab806d7e0 2024-02-28T16:06:16.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.395+0000 7feacb400700 1 -- 172.21.15.57:0/1919776552 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7fead4111ab0 con 0x7feab806d7e0 2024-02-28T16:06:16.388 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:06:16.388 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:06:16.388 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:06:16.388 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:06:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:06:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:06:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:06:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:06:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:06:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "6/21 daemons upgraded", 2024-02-28T16:06:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading crash daemons", 2024-02-28T16:06:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:06:16.389 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:06:16.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.398+0000 7feada000700 1 -- 172.21.15.57:0/1919776552 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7feab806d7e0 msgr2=0x7feab806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:16.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.398+0000 7feada000700 1 --2- 172.21.15.57:0/1919776552 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7feab806d7e0 0x7feab806fc90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feabc006fd0 tx=0x7feabc006db0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.398+0000 7feada000700 1 -- 172.21.15.57:0/1919776552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fead40fcef0 msgr2=0x7fead410fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:16.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.398+0000 7feada000700 1 --2- 172.21.15.57:0/1919776552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fead40fcef0 0x7fead410fb90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feac4000c00 tx=0x7feac4009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:16.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.399+0000 7feada000700 1 -- 172.21.15.57:0/1919776552 shutdown_connections 2024-02-28T16:06:16.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.399+0000 7feada000700 1 --2- 172.21.15.57:0/1919776552 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7feab806d7e0 0x7feab806fc90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.399+0000 7feada000700 1 --2- 172.21.15.57:0/1919776552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fead40fcef0 0x7fead410fb90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.399+0000 7feada000700 1 --2- 172.21.15.57:0/1919776552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead40fe0e0 0x7fead41100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.399+0000 7feada000700 1 -- 172.21.15.57:0/1919776552 >> 172.21.15.57:0/1919776552 conn(0x7fead40f8620 msgr2=0x7fead40ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:16.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.399+0000 7feada000700 1 -- 172.21.15.57:0/1919776552 shutdown_connections 2024-02-28T16:06:16.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.399+0000 7feada000700 1 -- 172.21.15.57:0/1919776552 wait complete. 2024-02-28T16:06:16.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.558+0000 7f22e2e00700 1 -- 172.21.15.57:0/1029650358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22dc0708c0 msgr2=0x7f22dc070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:16.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.558+0000 7f22e2e00700 1 --2- 172.21.15.57:0/1029650358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22dc0708c0 0x7f22dc070d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f22c8004940 tx=0x7f22c8009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:16.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.558+0000 7f22e2e00700 1 -- 172.21.15.57:0/1029650358 shutdown_connections 2024-02-28T16:06:16.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.558+0000 7f22e2e00700 1 --2- 172.21.15.57:0/1029650358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22dc0708c0 0x7f22dc070d10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.558+0000 7f22e2e00700 1 --2- 172.21.15.57:0/1029650358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22dc071f10 0x7f22dc070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.558+0000 7f22e2e00700 1 -- 172.21.15.57:0/1029650358 >> 172.21.15.57:0/1029650358 conn(0x7f22dc0f8620 msgr2=0x7f22dc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:16.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.558+0000 7f22e2e00700 1 -- 172.21.15.57:0/1029650358 shutdown_connections 2024-02-28T16:06:16.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.558+0000 7f22e2e00700 1 -- 172.21.15.57:0/1029650358 wait complete. 2024-02-28T16:06:16.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.559+0000 7f22e2e00700 1 Processor -- start 2024-02-28T16:06:16.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.559+0000 7f22e2e00700 1 -- start start 2024-02-28T16:06:16.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.559+0000 7f22e2e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22dc0708c0 0x7f22dc113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:16.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.559+0000 7f22e2e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22dc071f10 0x7f22dc1144f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:16.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.559+0000 7f22e2e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc114af0 con 0x7f22dc071f10 2024-02-28T16:06:16.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.559+0000 7f22e2e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc115390 con 0x7f22dc0708c0 2024-02-28T16:06:16.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.560+0000 7f22db400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22dc071f10 0x7f22dc1144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:16.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.560+0000 7f22db400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22dc071f10 0x7f22dc1144f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40190/0 (socket says 172.21.15.57:40190) 2024-02-28T16:06:16.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.560+0000 7f22db400700 1 -- 172.21.15.57:0/4184947613 learned_addr learned my addr 172.21.15.57:0/4184947613 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:16.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.560+0000 7f22dbe00700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22dc0708c0 0x7f22dc113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.560+0000 7f22db400700 1 -- 172.21.15.57:0/4184947613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22dc0708c0 msgr2=0x7f22dc113fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.560+0000 7f22db400700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22dc0708c0 0x7f22dc113fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.560+0000 7f22db400700 1 -- 172.21.15.57:0/4184947613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8005040 con 0x7f22dc071f10 2024-02-28T16:06:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.561+0000 7f22db400700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22dc071f10 0x7f22dc1144f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009fd0 tx=0x7f22c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.561+0000 7f22d3e00700 1 -- 172.21.15.57:0/4184947613 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c800e040 con 0x7f22dc071f10 2024-02-28T16:06:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.561+0000 7f22d3e00700 1 -- 172.21.15.57:0/4184947613 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22c800bcc0 con 0x7f22dc071f10 2024-02-28T16:06:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.561+0000 7f22e2e00700 1 -- 172.21.15.57:0/4184947613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc115610 con 0x7f22dc071f10 2024-02-28T16:06:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.561+0000 7f22d3e00700 1 -- 172.21.15.57:0/4184947613 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c801c630 con 0x7f22dc071f10 2024-02-28T16:06:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.561+0000 7f22e2e00700 1 -- 172.21.15.57:0/4184947613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc115b50 con 0x7f22dc071f10 2024-02-28T16:06:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.562+0000 7f22e2e00700 1 -- 172.21.15.57:0/4184947613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc04bed0 con 0x7f22dc071f10 2024-02-28T16:06:16.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.564+0000 7f22d3e00700 1 -- 172.21.15.57:0/4184947613 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f22c8013420 con 0x7f22dc071f10 2024-02-28T16:06:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.564+0000 7f22d3e00700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f22c006d7f0 0x7f22c006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.565+0000 7f22d3e00700 1 -- 172.21.15.57:0/4184947613 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f22c808e270 con 0x7f22dc071f10 2024-02-28T16:06:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.565+0000 7f22dbe00700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f22c006d7f0 0x7f22c006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:16.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.565+0000 7f22dbe00700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f22c006d7f0 0x7f22c006fca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22cc007fd0 tx=0x7f22cc009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:16.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.570+0000 7f22d3e00700 1 -- 172.21.15.57:0/4184947613 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f22c805b6a0 con 0x7f22dc071f10 2024-02-28T16:06:16.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:16 smithi057 ceph-mon[93219]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:16.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:16 smithi057 ceph-mon[93219]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:16.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:16 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/400945049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:16.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:16 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/103700038' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:06:16.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:16.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:16.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:16 smithi087 ceph-mon[82628]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:16.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:16 smithi087 ceph-mon[82628]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:16.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:16 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/400945049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:16.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:16 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/103700038' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:06:16.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:16.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:16.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.877+0000 7f22e2e00700 1 -- 172.21.15.57:0/4184947613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f22dc115e80 con 0x7f22dc071f10 2024-02-28T16:06:16.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.877+0000 7f22d3e00700 1 -- 172.21.15.57:0/4184947613 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f22c805b230 con 0x7f22dc071f10 2024-02-28T16:06:16.870 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:06:16.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.880+0000 7f22e2e00700 1 -- 172.21.15.57:0/4184947613 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f22c006d7f0 msgr2=0x7f22c006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:16.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.880+0000 7f22e2e00700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f22c006d7f0 0x7f22c006fca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22cc007fd0 tx=0x7f22cc009040 comp rx=0 tx=0).stop 2024-02-28T16:06:16.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.880+0000 7f22e2e00700 1 -- 172.21.15.57:0/4184947613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22dc071f10 msgr2=0x7f22dc1144f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.880+0000 7f22e2e00700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22dc071f10 0x7f22dc1144f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009fd0 tx=0x7f22c8009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.881+0000 7f22e2e00700 1 -- 172.21.15.57:0/4184947613 shutdown_connections 2024-02-28T16:06:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.881+0000 7f22e2e00700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f22c006d7f0 0x7f22c006fca0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.881+0000 7f22e2e00700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22dc0708c0 0x7f22dc113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.881+0000 7f22e2e00700 1 --2- 172.21.15.57:0/4184947613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22dc071f10 0x7f22dc1144f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.881+0000 7f22e2e00700 1 -- 172.21.15.57:0/4184947613 >> 172.21.15.57:0/4184947613 conn(0x7f22dc0f8620 msgr2=0x7f22dc0fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.881+0000 7f22e2e00700 1 -- 172.21.15.57:0/4184947613 shutdown_connections 2024-02-28T16:06:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:16.881+0000 7f22e2e00700 1 -- 172.21.15.57:0/4184947613 wait complete. 2024-02-28T16:06:17.639 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:17 smithi057 ceph-mon[93219]: pgmap v54: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-28T16:06:17.640 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:17 smithi057 ceph-mon[93219]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:17.640 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:17 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/4184947613' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:06:17.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:17 smithi087 ceph-mon[82628]: pgmap v54: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-28T16:06:17.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:17 smithi087 ceph-mon[82628]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:17.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:17 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/4184947613' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:06:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:19 smithi057 ceph-mon[93219]: pgmap v55: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:06:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:19 smithi087 ceph-mon[82628]: pgmap v55: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:06:21.819 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:21 smithi057 ceph-mon[93219]: pgmap v56: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:06:21.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:21 smithi087 ceph-mon[82628]: pgmap v56: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:06:23.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: pgmap v57: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: Upgrade: Setting container_image for all crash 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:23.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi057"}]: dispatch 2024-02-28T16:06:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi057"}]': finished 2024-02-28T16:06:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi087"}]: dispatch 2024-02-28T16:06:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi087"}]': finished 2024-02-28T16:06:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:06:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:06:23.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:22 smithi057 ceph-mon[93219]: Upgrade: osd.0 is safe to restart 2024-02-28T16:06:23.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: pgmap v57: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:23.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:23.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:23.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:06:23.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:06:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:06:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:23.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: Upgrade: Setting container_image for all crash 2024-02-28T16:06:23.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:23.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi057"}]: dispatch 2024-02-28T16:06:23.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi057"}]': finished 2024-02-28T16:06:23.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi087"}]: dispatch 2024-02-28T16:06:23.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi087"}]': finished 2024-02-28T16:06:23.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:06:23.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:06:23.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:22 smithi087 ceph-mon[82628]: Upgrade: osd.0 is safe to restart 2024-02-28T16:06:25.685 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:25 smithi057 ceph-mon[93219]: pgmap v58: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:25.685 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:25 smithi057 ceph-mon[93219]: Upgrade: Updating osd.0 2024-02-28T16:06:25.685 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:25.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:06:25.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:06:25.686 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:25 smithi057 ceph-mon[93219]: Deploying daemon osd.0 on smithi057 2024-02-28T16:06:25.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:25 smithi087 ceph-mon[82628]: pgmap v58: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:25.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:25 smithi087 ceph-mon[82628]: Upgrade: Updating osd.0 2024-02-28T16:06:25.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:25.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:06:25.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:06:25.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:25 smithi087 ceph-mon[82628]: Deploying daemon osd.0 on smithi057 2024-02-28T16:06:27.811 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:27 smithi057 ceph-mon[93219]: pgmap v59: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:06:27.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:27 smithi087 ceph-mon[82628]: pgmap v59: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:06:28.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:28 smithi057 ceph-mon[93219]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:06:28.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:28 smithi087 ceph-mon[82628]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:06:29.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:29 smithi057 ceph-mon[93219]: pgmap v60: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:29.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:29 smithi057 ceph-mon[93219]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:06:29.927 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:29 smithi057 systemd[1]: Stopping Ceph osd.0 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:06:29.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:29 smithi087 ceph-mon[82628]: pgmap v60: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:06:29.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:29 smithi087 ceph-mon[82628]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby-replay 2024-02-28T16:06:30.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:29 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0[46779]: 2024-02-28T16:06:29.944+0000 7f27e2e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:06:30.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:29 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0[46779]: 2024-02-28T16:06:29.945+0000 7f27e2e00700 -1 osd.0 49 *** Got signal Terminated *** 2024-02-28T16:06:30.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:29 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0[46779]: 2024-02-28T16:06:29.945+0000 7f27e2e00700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:06:30.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:30 smithi057 ceph-mon[93219]: osd.0 marked itself down and dead 2024-02-28T16:06:30.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:30 smithi087 ceph-mon[82628]: osd.0 marked itself down and dead 2024-02-28T16:06:31.544 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:31 smithi057 podman[101484]: 2024-02-28 16:06:31.241914596 +0000 UTC m=+1.422394698 container died e62180e2f2325cdd0d7a14c6cf489dd1191311ec5f00edbf2a804b67c80f789e (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0, GIT_BRANCH=HEAD, RELEASE=quincy-c0f02e6, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:06:31.927 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:31 smithi057 podman[101484]: 2024-02-28 16:06:31.695995299 +0000 UTC m=+1.876475419 container cleanup e62180e2f2325cdd0d7a14c6cf489dd1191311ec5f00edbf2a804b67c80f789e (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=quincy-c0f02e6, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:06:31.927 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:31 smithi057 bash[101484]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0 2024-02-28T16:06:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:31 smithi057 ceph-mon[93219]: pgmap v61: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:06:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:31 smithi057 ceph-mon[93219]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:06:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:31 smithi057 ceph-mon[93219]: osdmap e50: 6 total, 5 up, 6 in 2024-02-28T16:06:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:31 smithi087 ceph-mon[82628]: pgmap v61: 65 pgs: 65 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:06:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:31 smithi087 ceph-mon[82628]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:06:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:31 smithi087 ceph-mon[82628]: osdmap e50: 6 total, 5 up, 6 in 2024-02-28T16:06:32.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:31 smithi057 podman[101501]: 2024-02-28 16:06:31.965270068 +0000 UTC m=+0.712022342 container remove e62180e2f2325cdd0d7a14c6cf489dd1191311ec5f00edbf2a804b67c80f789e (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=quincy-c0f02e6, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-02-28T16:06:32.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:32 smithi057 ceph-mon[93219]: osdmap e51: 6 total, 5 up, 6 in 2024-02-28T16:06:32.841 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:32 smithi057 podman[101591]: 2024-02-28 16:06:32.72442734 +0000 UTC m=+0.040062742 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:06:32.841 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:32 smithi057 podman[101591]: 2024-02-28 16:06:32.848668537 +0000 UTC m=+0.164303936 container create 662b39fc85ff4f9f1f4edb28e85029d852fb2e627dce86cb1d033020d30bbc57 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-02-28T16:06:32.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:32 smithi087 ceph-mon[82628]: osdmap e51: 6 total, 5 up, 6 in 2024-02-28T16:06:33.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:33 smithi057 podman[101591]: 2024-02-28 16:06:33.144435073 +0000 UTC m=+0.460070513 container init 662b39fc85ff4f9f1f4edb28e85029d852fb2e627dce86cb1d033020d30bbc57 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-28T16:06:33.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:33 smithi057 podman[101591]: 2024-02-28 16:06:33.156007941 +0000 UTC m=+0.471643344 container start 662b39fc85ff4f9f1f4edb28e85029d852fb2e627dce86cb1d033020d30bbc57 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:06:33.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:33 smithi057 podman[101591]: 2024-02-28 16:06:33.309936784 +0000 UTC m=+0.625572171 container attach 662b39fc85ff4f9f1f4edb28e85029d852fb2e627dce86cb1d033020d30bbc57 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-02-28T16:06:33.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:33 smithi057 ceph-mon[93219]: pgmap v64: 65 pgs: 9 stale+active+clean, 56 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:06:33.927 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:33 smithi057 podman[101591]: 2024-02-28 16:06:33.604198106 +0000 UTC m=+0.919833512 container died 662b39fc85ff4f9f1f4edb28e85029d852fb2e627dce86cb1d033020d30bbc57 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-02-28T16:06:33.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:33 smithi087 ceph-mon[82628]: pgmap v64: 65 pgs: 9 stale+active+clean, 56 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:06:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]: dispatch 2024-02-28T16:06:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 0]}]: dispatch 2024-02-28T16:06:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]}]: dispatch 2024-02-28T16:06:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 0]}]: dispatch 2024-02-28T16:06:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [1, 0]}]: dispatch 2024-02-28T16:06:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2024-02-28T16:06:34.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [3, 2]}]: dispatch 2024-02-28T16:06:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0]}]: dispatch 2024-02-28T16:06:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 0]}]: dispatch 2024-02-28T16:06:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:34.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:06:34.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:34 smithi057 podman[101617]: 2024-02-28 16:06:34.389564551 +0000 UTC m=+0.767843568 container remove 662b39fc85ff4f9f1f4edb28e85029d852fb2e627dce86cb1d033020d30bbc57 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-28T16:06:34.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:34 smithi057 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-28T16:06:34.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:34 smithi057 systemd[1]: Stopped Ceph osd.0 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:06:34.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:34 smithi057 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.0.service: Consumed 1min 41.884s CPU time. 2024-02-28T16:06:34.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]: dispatch 2024-02-28T16:06:34.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 0]}]: dispatch 2024-02-28T16:06:34.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]}]: dispatch 2024-02-28T16:06:34.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 0]}]: dispatch 2024-02-28T16:06:34.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [1, 0]}]: dispatch 2024-02-28T16:06:34.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2024-02-28T16:06:34.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [3, 2]}]: dispatch 2024-02-28T16:06:34.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0]}]: dispatch 2024-02-28T16:06:34.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 0]}]: dispatch 2024-02-28T16:06:34.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:34.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:06:35.167 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:34 smithi057 systemd[1]: Starting Ceph osd.0 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:06:35.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:35 smithi057 podman[101721]: 2024-02-28 16:06:35.082288486 +0000 UTC m=+0.042204400 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:06:35.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:35 smithi057 podman[101721]: 2024-02-28 16:06:35.238664727 +0000 UTC m=+0.198580666 container create 3d05e0c2b36c8b88058d6c68ff66719d55ea07408fd129dd56022c3a5efdff9e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: pgmap v65: 65 pgs: 9 stale+active+clean, 56 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]': finished 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 0]}]': finished 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]}]': finished 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 0]}]': finished 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [1, 0]}]': finished 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [3, 2]}]': finished 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0]}]': finished 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 0]}]': finished 2024-02-28T16:06:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:35 smithi057 ceph-mon[93219]: osdmap e52: 6 total, 5 up, 6 in 2024-02-28T16:06:35.928 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:35 smithi057 podman[101721]: 2024-02-28 16:06:35.535902823 +0000 UTC m=+0.495818769 container init 3d05e0c2b36c8b88058d6c68ff66719d55ea07408fd129dd56022c3a5efdff9e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-02-28T16:06:35.928 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:35 smithi057 podman[101721]: 2024-02-28 16:06:35.548303597 +0000 UTC m=+0.508219526 container start 3d05e0c2b36c8b88058d6c68ff66719d55ea07408fd129dd56022c3a5efdff9e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD) 2024-02-28T16:06:35.928 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:35 smithi057 podman[101721]: 2024-02-28 16:06:35.652323691 +0000 UTC m=+0.612239630 container attach 3d05e0c2b36c8b88058d6c68ff66719d55ea07408fd129dd56022c3a5efdff9e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=) 2024-02-28T16:06:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: pgmap v65: 65 pgs: 9 stale+active+clean, 56 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T16:06:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]': finished 2024-02-28T16:06:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [3, 0]}]': finished 2024-02-28T16:06:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]}]': finished 2024-02-28T16:06:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 0]}]': finished 2024-02-28T16:06:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [1, 0]}]': finished 2024-02-28T16:06:35.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2024-02-28T16:06:35.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [3, 2]}]': finished 2024-02-28T16:06:35.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0]}]': finished 2024-02-28T16:06:35.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 0]}]': finished 2024-02-28T16:06:35.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:35 smithi087 ceph-mon[82628]: osdmap e52: 6 total, 5 up, 6 in 2024-02-28T16:06:36.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:36 smithi057 ceph-mon[93219]: osdmap e53: 6 total, 5 up, 6 in 2024-02-28T16:06:36.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:36 smithi057 ceph-mon[93219]: pgmap v68: 65 pgs: 8 peering, 18 active+undersized+degraded, 14 active+undersized, 25 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/333 objects degraded (18.619%) 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate[101735]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate[101735]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 bash[101721]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 bash[101721]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 bash[101721]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 bash[101721]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 bash[101721]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 bash[101721]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 bash[101721]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate[101735]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate[101735]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:06:36.678 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate[101735]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-28T16:06:36.679 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate[101735]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:06:36.679 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate[101735]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-28T16:06:36.679 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:36 smithi057 podman[101721]: 2024-02-28 16:06:36.463793073 +0000 UTC m=+1.423709062 container died 3d05e0c2b36c8b88058d6c68ff66719d55ea07408fd129dd56022c3a5efdff9e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-02-28T16:06:36.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:36 smithi087 ceph-mon[82628]: osdmap e53: 6 total, 5 up, 6 in 2024-02-28T16:06:36.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:36 smithi087 ceph-mon[82628]: pgmap v68: 65 pgs: 8 peering, 18 active+undersized+degraded, 14 active+undersized, 25 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/333 objects degraded (18.619%) 2024-02-28T16:06:37.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:37 smithi057 ceph-mon[93219]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-28T16:06:37.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:37 smithi057 ceph-mon[93219]: Health check failed: Degraded data redundancy: 62/333 objects degraded (18.619%), 18 pgs degraded (PG_DEGRADED) 2024-02-28T16:06:37.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:37 smithi057 ceph-mon[93219]: osdmap e54: 6 total, 5 up, 6 in 2024-02-28T16:06:37.677 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:37 smithi057 podman[101858]: 2024-02-28 16:06:37.40103469 +0000 UTC m=+0.916678708 container remove 3d05e0c2b36c8b88058d6c68ff66719d55ea07408fd129dd56022c3a5efdff9e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, ceph=True, org.label-schema.vendor=CentOS) 2024-02-28T16:06:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:37 smithi087 ceph-mon[82628]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-28T16:06:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:37 smithi087 ceph-mon[82628]: Health check failed: Degraded data redundancy: 62/333 objects degraded (18.619%), 18 pgs degraded (PG_DEGRADED) 2024-02-28T16:06:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:37 smithi087 ceph-mon[82628]: osdmap e54: 6 total, 5 up, 6 in 2024-02-28T16:06:38.099 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:37 smithi057 podman[101916]: 2024-02-28 16:06:37.666026935 +0000 UTC m=+0.039175063 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:06:38.099 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:37 smithi057 podman[101916]: 2024-02-28 16:06:37.801019405 +0000 UTC m=+0.174167568 container create 5a9d77191a1041230e80642f9e3e46b844cfb1ccf9b116f3f0a41bba04e55aae (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-28T16:06:38.099 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:38 smithi057 podman[101916]: 2024-02-28 16:06:38.106732678 +0000 UTC m=+0.479880901 container init 5a9d77191a1041230e80642f9e3e46b844cfb1ccf9b116f3f0a41bba04e55aae (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-28T16:06:38.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:38 smithi057 podman[101916]: 2024-02-28 16:06:38.119170692 +0000 UTC m=+0.492318828 container start 5a9d77191a1041230e80642f9e3e46b844cfb1ccf9b116f3f0a41bba04e55aae (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T16:06:38.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:38 smithi057 ceph-osd[101935]: -- 172.21.15.57:0/705625286 <== mon.0 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561428811680 con 0x5614287db000 2024-02-28T16:06:38.427 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:38 smithi057 bash[101916]: 5a9d77191a1041230e80642f9e3e46b844cfb1ccf9b116f3f0a41bba04e55aae 2024-02-28T16:06:38.428 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:38 smithi057 systemd[1]: Started Ceph osd.0 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:06:38.927 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:38 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0[101931]: 2024-02-28T16:06:38.690+0000 7fd392da57c0 -1 Falling back to public interface 2024-02-28T16:06:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:38 smithi057 ceph-mon[93219]: osdmap e55: 6 total, 5 up, 6 in 2024-02-28T16:06:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:38 smithi057 ceph-mon[93219]: pgmap v71: 65 pgs: 8 peering, 18 active+undersized+degraded, 14 active+undersized, 25 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/333 objects degraded (18.619%) 2024-02-28T16:06:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:38 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:38 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:38.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:38 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:06:38.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:38 smithi087 ceph-mon[82628]: osdmap e55: 6 total, 5 up, 6 in 2024-02-28T16:06:38.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:38 smithi087 ceph-mon[82628]: pgmap v71: 65 pgs: 8 peering, 18 active+undersized+degraded, 14 active+undersized, 25 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/333 objects degraded (18.619%) 2024-02-28T16:06:38.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:38 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:38.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:38 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:38.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:38 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:06:39.904 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:39 smithi057 ceph-mon[93219]: osdmap e56: 6 total, 5 up, 6 in 2024-02-28T16:06:39.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:39 smithi087 ceph-mon[82628]: osdmap e56: 6 total, 5 up, 6 in 2024-02-28T16:06:40.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:40 smithi057 ceph-mon[93219]: osdmap e57: 6 total, 5 up, 6 in 2024-02-28T16:06:40.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:40 smithi057 ceph-mon[93219]: pgmap v74: 65 pgs: 1 remapped+peering, 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 24 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 62/333 objects degraded (18.619%); 9/333 objects misplaced (2.703%); 1024 KiB/s, 0 objects/s recovering 2024-02-28T16:06:40.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:40 smithi087 ceph-mon[82628]: osdmap e57: 6 total, 5 up, 6 in 2024-02-28T16:06:40.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:40 smithi087 ceph-mon[82628]: pgmap v74: 65 pgs: 1 remapped+peering, 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 24 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 62/333 objects degraded (18.619%); 9/333 objects misplaced (2.703%); 1024 KiB/s, 0 objects/s recovering 2024-02-28T16:06:41.851 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:41 smithi057 ceph-mon[93219]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-28T16:06:41.851 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:41 smithi057 ceph-mon[93219]: osdmap e58: 6 total, 5 up, 6 in 2024-02-28T16:06:41.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:41 smithi087 ceph-mon[82628]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-28T16:06:41.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:41 smithi087 ceph-mon[82628]: osdmap e58: 6 total, 5 up, 6 in 2024-02-28T16:06:42.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:42 smithi087 ceph-mon[82628]: pgmap v76: 65 pgs: 1 remapped+peering, 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 24 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 62/333 objects degraded (18.619%); 9/333 objects misplaced (2.703%); 996 KiB/s, 0 objects/s recovering 2024-02-28T16:06:43.016 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:42 smithi057 ceph-mon[93219]: pgmap v76: 65 pgs: 1 remapped+peering, 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 24 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 62/333 objects degraded (18.619%); 9/333 objects misplaced (2.703%); 996 KiB/s, 0 objects/s recovering 2024-02-28T16:06:43.426 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:43 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0[101931]: 2024-02-28T16:06:43.266+0000 7fd392da57c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-28T16:06:44.176 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:43 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0[101931]: 2024-02-28T16:06:43.798+0000 7fd392da57c0 -1 osd.0 49 log_to_monitors true 2024-02-28T16:06:45.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:44 smithi057 ceph-mon[93219]: pgmap v77: 65 pgs: 1 remapped+peering, 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 24 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 62/333 objects degraded (18.619%); 9/333 objects misplaced (2.703%); 682 KiB/s, 0 objects/s recovering 2024-02-28T16:06:45.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:44 smithi057 ceph-mon[93219]: from='osd.0 [v2:172.21.15.57:6802/1715766120,v1:172.21.15.57:6803/1715766120]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T16:06:45.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:44 smithi087 ceph-mon[82628]: pgmap v77: 65 pgs: 1 remapped+peering, 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 24 active+clean; 269 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 62/333 objects degraded (18.619%); 9/333 objects misplaced (2.703%); 682 KiB/s, 0 objects/s recovering 2024-02-28T16:06:45.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:44 smithi087 ceph-mon[82628]: from='osd.0 [v2:172.21.15.57:6802/1715766120,v1:172.21.15.57:6803/1715766120]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T16:06:46.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:45 smithi057 ceph-mon[93219]: from='osd.0 [v2:172.21.15.57:6802/1715766120,v1:172.21.15.57:6803/1715766120]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T16:06:46.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:45 smithi057 ceph-mon[93219]: osdmap e59: 6 total, 5 up, 6 in 2024-02-28T16:06:46.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:45 smithi057 ceph-mon[93219]: from='osd.0 [v2:172.21.15.57:6802/1715766120,v1:172.21.15.57:6803/1715766120]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T16:06:46.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:45 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:46.180 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:45 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:46.181 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:06:45 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0[101931]: 2024-02-28T16:06:45.908+0000 7fd37d200700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:06:46.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:45 smithi087 ceph-mon[82628]: from='osd.0 [v2:172.21.15.57:6802/1715766120,v1:172.21.15.57:6803/1715766120]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T16:06:46.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:45 smithi087 ceph-mon[82628]: osdmap e59: 6 total, 5 up, 6 in 2024-02-28T16:06:46.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:45 smithi087 ceph-mon[82628]: from='osd.0 [v2:172.21.15.57:6802/1715766120,v1:172.21.15.57:6803/1715766120]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T16:06:46.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:45 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:46.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:45 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:47.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.082+0000 7f7b6c600700 1 -- 172.21.15.57:0/334228917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b640fb870 msgr2=0x7f7b640fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:47.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.082+0000 7f7b6c600700 1 --2- 172.21.15.57:0/334228917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b640fb870 0x7f7b640fbc80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7b58004940 tx=0x7f7b58009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:47.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.083+0000 7f7b6c600700 1 -- 172.21.15.57:0/334228917 shutdown_connections 2024-02-28T16:06:47.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.083+0000 7f7b6c600700 1 --2- 172.21.15.57:0/334228917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b640fc1c0 0x7f7b640fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.083+0000 7f7b6c600700 1 --2- 172.21.15.57:0/334228917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b640fb870 0x7f7b640fbc80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.083+0000 7f7b6c600700 1 -- 172.21.15.57:0/334228917 >> 172.21.15.57:0/334228917 conn(0x7f7b640f74e0 msgr2=0x7f7b640f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:47.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.083+0000 7f7b6c600700 1 -- 172.21.15.57:0/334228917 shutdown_connections 2024-02-28T16:06:47.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.083+0000 7f7b6c600700 1 -- 172.21.15.57:0/334228917 wait complete. 2024-02-28T16:06:47.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.084+0000 7f7b6c600700 1 Processor -- start 2024-02-28T16:06:47.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.084+0000 7f7b6c600700 1 -- start start 2024-02-28T16:06:47.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.084+0000 7f7b6c600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b640fb870 0x7f7b6410fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:47.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.084+0000 7f7b6c600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b640fc1c0 0x7f7b641100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:47.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.084+0000 7f7b6c600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b64110730 con 0x7f7b640fb870 2024-02-28T16:06:47.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.084+0000 7f7b6c600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b64110f70 con 0x7f7b640fc1c0 2024-02-28T16:06:47.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.085+0000 7f7b69c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b640fb870 0x7f7b6410fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:47.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.085+0000 7f7b69c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b640fb870 0x7f7b6410fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43718/0 (socket says 172.21.15.57:43718) 2024-02-28T16:06:47.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.085+0000 7f7b69c00700 1 -- 172.21.15.57:0/3386040081 learned_addr learned my addr 172.21.15.57:0/3386040081 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:47.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.085+0000 7f7b69200700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b640fc1c0 0x7f7b641100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:47.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.085+0000 7f7b69c00700 1 -- 172.21.15.57:0/3386040081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b640fc1c0 msgr2=0x7f7b641100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:47.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.085+0000 7f7b69c00700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b640fc1c0 0x7f7b641100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.085+0000 7f7b69c00700 1 -- 172.21.15.57:0/3386040081 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58005040 con 0x7f7b640fb870 2024-02-28T16:06:47.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.086+0000 7f7b69c00700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b640fb870 0x7f7b6410fb60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800b3b0 tx=0x7f7b58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:47.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.086+0000 7f7b61600700 1 -- 172.21.15.57:0/3386040081 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b5800e040 con 0x7f7b640fb870 2024-02-28T16:06:47.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.086+0000 7f7b61600700 1 -- 172.21.15.57:0/3386040081 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b5800bd90 con 0x7f7b640fb870 2024-02-28T16:06:47.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.086+0000 7f7b61600700 1 -- 172.21.15.57:0/3386040081 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b5801c630 con 0x7f7b640fb870 2024-02-28T16:06:47.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.086+0000 7f7b6c600700 1 -- 172.21.15.57:0/3386040081 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b641111f0 con 0x7f7b640fb870 2024-02-28T16:06:47.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.086+0000 7f7b6c600700 1 -- 172.21.15.57:0/3386040081 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b641116e0 con 0x7f7b640fb870 2024-02-28T16:06:47.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.088+0000 7f7b6c600700 1 -- 172.21.15.57:0/3386040081 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6404bed0 con 0x7f7b640fb870 2024-02-28T16:06:47.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.089+0000 7f7b61600700 1 -- 172.21.15.57:0/3386040081 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f7b580139f0 con 0x7f7b640fb870 2024-02-28T16:06:47.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.090+0000 7f7b61600700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7b4c06d7f0 0x7f7b4c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:47.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.090+0000 7f7b61600700 1 -- 172.21.15.57:0/3386040081 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6882+0+0 (secure 0 0 0) 0x7f7b5808e630 con 0x7f7b640fb870 2024-02-28T16:06:47.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.091+0000 7f7b69200700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7b4c06d7f0 0x7f7b4c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:47.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.091+0000 7f7b69200700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7b4c06d7f0 0x7f7b4c06fca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b50006fd0 tx=0x7f7b50008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:47.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.096+0000 7f7b61600700 1 -- 172.21.15.57:0/3386040081 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7b5805b7b0 con 0x7f7b640fb870 2024-02-28T16:06:47.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:46 smithi057 ceph-mon[93219]: pgmap v79: 65 pgs: 9 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 24 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.3 KiB/s rd, 6 op/s; 62/333 objects degraded (18.619%); 9/333 objects misplaced (2.703%); 674 KiB/s, 126 objects/s recovering 2024-02-28T16:06:47.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:46 smithi057 ceph-mon[93219]: from='osd.0 [v2:172.21.15.57:6802/1715766120,v1:172.21.15.57:6803/1715766120]' entity='osd.0' 2024-02-28T16:06:47.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:46 smithi087 ceph-mon[82628]: pgmap v79: 65 pgs: 9 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 24 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.3 KiB/s rd, 6 op/s; 62/333 objects degraded (18.619%); 9/333 objects misplaced (2.703%); 674 KiB/s, 126 objects/s recovering 2024-02-28T16:06:47.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:46 smithi087 ceph-mon[82628]: from='osd.0 [v2:172.21.15.57:6802/1715766120,v1:172.21.15.57:6803/1715766120]' entity='osd.0' 2024-02-28T16:06:47.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.345+0000 7f7b6c600700 1 -- 172.21.15.57:0/3386040081 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b641055c0 con 0x7f7b4c06d7f0 2024-02-28T16:06:47.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.347+0000 7f7b61600700 1 -- 172.21.15.57:0/3386040081 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7b641055c0 con 0x7f7b4c06d7f0 2024-02-28T16:06:47.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.350+0000 7f7b6c600700 1 -- 172.21.15.57:0/3386040081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7b4c06d7f0 msgr2=0x7f7b4c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:47.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.350+0000 7f7b6c600700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7b4c06d7f0 0x7f7b4c06fca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b50006fd0 tx=0x7f7b50008040 comp rx=0 tx=0).stop 2024-02-28T16:06:47.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.350+0000 7f7b6c600700 1 -- 172.21.15.57:0/3386040081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b640fb870 msgr2=0x7f7b6410fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:47.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.350+0000 7f7b6c600700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b640fb870 0x7f7b6410fb60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800b3b0 tx=0x7f7b58009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:47.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.351+0000 7f7b6c600700 1 -- 172.21.15.57:0/3386040081 shutdown_connections 2024-02-28T16:06:47.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.351+0000 7f7b6c600700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7b4c06d7f0 0x7f7b4c06fca0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.351+0000 7f7b6c600700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b640fb870 0x7f7b6410fb60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.351+0000 7f7b6c600700 1 --2- 172.21.15.57:0/3386040081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b640fc1c0 0x7f7b641100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.351+0000 7f7b6c600700 1 -- 172.21.15.57:0/3386040081 >> 172.21.15.57:0/3386040081 conn(0x7f7b640f74e0 msgr2=0x7f7b64103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:47.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.351+0000 7f7b6c600700 1 -- 172.21.15.57:0/3386040081 shutdown_connections 2024-02-28T16:06:47.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.351+0000 7f7b6c600700 1 -- 172.21.15.57:0/3386040081 wait complete. 2024-02-28T16:06:47.359 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:06:47.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.512+0000 7f5467000700 1 -- 172.21.15.57:0/772248295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5460100120 msgr2=0x7f5460102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.512+0000 7f5467000700 1 --2- 172.21.15.57:0/772248295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5460100120 0x7f5460102520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f544c004940 tx=0x7f544c009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.512+0000 7f5467000700 1 -- 172.21.15.57:0/772248295 shutdown_connections 2024-02-28T16:06:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.512+0000 7f5467000700 1 --2- 172.21.15.57:0/772248295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5460100120 0x7f5460102520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.512+0000 7f5467000700 1 --2- 172.21.15.57:0/772248295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460066c10 0x7f54600ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.512+0000 7f5467000700 1 -- 172.21.15.57:0/772248295 >> 172.21.15.57:0/772248295 conn(0x7f54600f7520 msgr2=0x7f54600f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.513+0000 7f5467000700 1 -- 172.21.15.57:0/772248295 shutdown_connections 2024-02-28T16:06:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.513+0000 7f5467000700 1 -- 172.21.15.57:0/772248295 wait complete. 2024-02-28T16:06:47.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.514+0000 7f5467000700 1 Processor -- start 2024-02-28T16:06:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.514+0000 7f5467000700 1 -- start start 2024-02-28T16:06:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.514+0000 7f5467000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5460066c10 0x7f546010fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.514+0000 7f5467000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460100120 0x7f54601100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.514+0000 7f5467000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54601106c0 con 0x7f5460066c10 2024-02-28T16:06:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.514+0000 7f5467000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5460110f60 con 0x7f5460100120 2024-02-28T16:06:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.514+0000 7f545fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5460066c10 0x7f546010fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.514+0000 7f545fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5460066c10 0x7f546010fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43736/0 (socket says 172.21.15.57:43736) 2024-02-28T16:06:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.514+0000 7f545fe00700 1 -- 172.21.15.57:0/530062163 learned_addr learned my addr 172.21.15.57:0/530062163 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.515+0000 7f545f400700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460100120 0x7f54601100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.515+0000 7f545fe00700 1 -- 172.21.15.57:0/530062163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460100120 msgr2=0x7f54601100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.515+0000 7f545fe00700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460100120 0x7f54601100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.515+0000 7f545fe00700 1 -- 172.21.15.57:0/530062163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c005040 con 0x7f5460066c10 2024-02-28T16:06:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.515+0000 7f545fe00700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5460066c10 0x7f546010fb80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5450002a50 tx=0x7f54500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.516+0000 7f5457e00700 1 -- 172.21.15.57:0/530062163 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5450007cc0 con 0x7f5460066c10 2024-02-28T16:06:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.516+0000 7f5457e00700 1 -- 172.21.15.57:0/530062163 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f545000f040 con 0x7f5460066c10 2024-02-28T16:06:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.516+0000 7f5457e00700 1 -- 172.21.15.57:0/530062163 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5450009640 con 0x7f5460066c10 2024-02-28T16:06:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.516+0000 7f5467000700 1 -- 172.21.15.57:0/530062163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5460111240 con 0x7f5460066c10 2024-02-28T16:06:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.516+0000 7f5467000700 1 -- 172.21.15.57:0/530062163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5460111780 con 0x7f5460066c10 2024-02-28T16:06:47.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.517+0000 7f5467000700 1 -- 172.21.15.57:0/530062163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54600f9050 con 0x7f5460066c10 2024-02-28T16:06:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.519+0000 7f5457e00700 1 -- 172.21.15.57:0/530062163 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f54500097a0 con 0x7f5460066c10 2024-02-28T16:06:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.520+0000 7f5457e00700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f544406d7f0 0x7f544406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.520+0000 7f5457e00700 1 -- 172.21.15.57:0/530062163 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6882+0+0 (secure 0 0 0) 0x7f545008ce40 con 0x7f5460066c10 2024-02-28T16:06:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.520+0000 7f545f400700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f544406d7f0 0x7f544406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.521+0000 7f545f400700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f544406d7f0 0x7f544406fca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f544c00b020 tx=0x7f544c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:47.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.525+0000 7f5457e00700 1 -- 172.21.15.57:0/530062163 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5450059fc0 con 0x7f5460066c10 2024-02-28T16:06:47.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.782+0000 7f5467000700 1 -- 172.21.15.57:0/530062163 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5460111b00 con 0x7f544406d7f0 2024-02-28T16:06:47.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.784+0000 7f5457e00700 1 -- 172.21.15.57:0/530062163 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5460111b00 con 0x7f544406d7f0 2024-02-28T16:06:47.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.786+0000 7f5467000700 1 -- 172.21.15.57:0/530062163 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f544406d7f0 msgr2=0x7f544406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:47.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.786+0000 7f5467000700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f544406d7f0 0x7f544406fca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f544c00b020 tx=0x7f544c009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:47.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.786+0000 7f5467000700 1 -- 172.21.15.57:0/530062163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5460066c10 msgr2=0x7f546010fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:47.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.786+0000 7f5467000700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5460066c10 0x7f546010fb80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5450002a50 tx=0x7f54500046b0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.787+0000 7f5467000700 1 -- 172.21.15.57:0/530062163 shutdown_connections 2024-02-28T16:06:47.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.787+0000 7f5467000700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f544406d7f0 0x7f544406fca0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.787+0000 7f5467000700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5460066c10 0x7f546010fb80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.787+0000 7f5467000700 1 --2- 172.21.15.57:0/530062163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460100120 0x7f54601100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.787+0000 7f5467000700 1 -- 172.21.15.57:0/530062163 >> 172.21.15.57:0/530062163 conn(0x7f54600f7520 msgr2=0x7f5460100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.787+0000 7f5467000700 1 -- 172.21.15.57:0/530062163 shutdown_connections 2024-02-28T16:06:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.787+0000 7f5467000700 1 -- 172.21.15.57:0/530062163 wait complete. 2024-02-28T16:06:47.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.950+0000 7f841a000700 1 -- 172.21.15.57:0/662006494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84140fb870 msgr2=0x7f84140fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:47.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.950+0000 7f841a000700 1 --2- 172.21.15.57:0/662006494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84140fb870 0x7f84140fdc90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0049c0 tx=0x7f83fc009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:47.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.950+0000 7f841a000700 1 -- 172.21.15.57:0/662006494 shutdown_connections 2024-02-28T16:06:47.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.950+0000 7f841a000700 1 --2- 172.21.15.57:0/662006494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84140fe1d0 0x7f8414100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.950+0000 7f841a000700 1 --2- 172.21.15.57:0/662006494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84140fb870 0x7f84140fdc90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.950+0000 7f841a000700 1 -- 172.21.15.57:0/662006494 >> 172.21.15.57:0/662006494 conn(0x7f84140f74e0 msgr2=0x7f84140f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:47.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.951+0000 7f841a000700 1 -- 172.21.15.57:0/662006494 shutdown_connections 2024-02-28T16:06:47.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.952+0000 7f841a000700 1 -- 172.21.15.57:0/662006494 wait complete. 2024-02-28T16:06:47.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.953+0000 7f841a000700 1 Processor -- start 2024-02-28T16:06:47.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.954+0000 7f841a000700 1 -- start start 2024-02-28T16:06:47.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.955+0000 7f841a000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84140fb870 0x7f841410b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:47.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.955+0000 7f841a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84140fe1d0 0x7f841410bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:47.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.956+0000 7f8413400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84140fb870 0x7f841410b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:47.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.956+0000 7f841a000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841410c200 con 0x7f84140fe1d0 2024-02-28T16:06:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.956+0000 7f841a000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841410caa0 con 0x7f84140fb870 2024-02-28T16:06:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.956+0000 7f8412a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84140fe1d0 0x7f841410bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.956+0000 7f8412a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84140fe1d0 0x7f841410bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43754/0 (socket says 172.21.15.57:43754) 2024-02-28T16:06:47.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.956+0000 7f8412a00700 1 -- 172.21.15.57:0/1934945287 learned_addr learned my addr 172.21.15.57:0/1934945287 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:47.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.957+0000 7f8412a00700 1 -- 172.21.15.57:0/1934945287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84140fb870 msgr2=0x7f841410b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:47.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.957+0000 7f8412a00700 1 --2- 172.21.15.57:0/1934945287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84140fb870 0x7f841410b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:47.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.957+0000 7f8412a00700 1 -- 172.21.15.57:0/1934945287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc005040 con 0x7f84140fe1d0 2024-02-28T16:06:47.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.958+0000 7f8412a00700 1 --2- 172.21.15.57:0/1934945287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84140fe1d0 0x7f841410bc00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f840400c830 tx=0x7f8404004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:47.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.959+0000 7f840b400700 1 -- 172.21.15.57:0/1934945287 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f840400a760 con 0x7f84140fe1d0 2024-02-28T16:06:47.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.959+0000 7f840b400700 1 -- 172.21.15.57:0/1934945287 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f840400ad90 con 0x7f84140fe1d0 2024-02-28T16:06:47.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.959+0000 7f840b400700 1 -- 172.21.15.57:0/1934945287 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84040113a0 con 0x7f84140fe1d0 2024-02-28T16:06:47.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.960+0000 7f841a000700 1 -- 172.21.15.57:0/1934945287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841410cd80 con 0x7f84140fe1d0 2024-02-28T16:06:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.960+0000 7f841a000700 1 -- 172.21.15.57:0/1934945287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841410d290 con 0x7f84140fe1d0 2024-02-28T16:06:47.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.965+0000 7f840b400700 1 -- 172.21.15.57:0/1934945287 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f8404012400 con 0x7f84140fe1d0 2024-02-28T16:06:47.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.965+0000 7f841a000700 1 -- 172.21.15.57:0/1934945287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8414105830 con 0x7f84140fe1d0 2024-02-28T16:06:47.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.966+0000 7f840b400700 1 --2- 172.21.15.57:0/1934945287 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f83f806d8a0 0x7f83f806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:47.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.966+0000 7f840b400700 1 -- 172.21.15.57:0/1934945287 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6788+0+0 (secure 0 0 0) 0x7f840408ca20 con 0x7f84140fe1d0 2024-02-28T16:06:47.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.967+0000 7f8413400700 1 --2- 172.21.15.57:0/1934945287 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f83f806d8a0 0x7f83f806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:47.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.968+0000 7f8413400700 1 --2- 172.21.15.57:0/1934945287 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f83f806d8a0 0x7f83f806fd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83fc005010 tx=0x7f83fc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:47.975+0000 7f840b400700 1 -- 172.21.15.57:0/1934945287 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8404059d40 con 0x7f84140fe1d0 2024-02-28T16:06:48.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:47 smithi057 ceph-mon[93219]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:06:48.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:47 smithi057 ceph-mon[93219]: osd.0 [v2:172.21.15.57:6802/1715766120,v1:172.21.15.57:6803/1715766120] boot 2024-02-28T16:06:48.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:47 smithi057 ceph-mon[93219]: osdmap e60: 6 total, 6 up, 6 in 2024-02-28T16:06:48.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:06:48.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:47 smithi057 ceph-mon[93219]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:48.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:48.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:48.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:47 smithi057 ceph-mon[93219]: osdmap e61: 6 total, 6 up, 6 in 2024-02-28T16:06:48.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.209+0000 7f841a000700 1 -- 172.21.15.57:0/1934945287 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f841410d570 con 0x7f83f806d8a0 2024-02-28T16:06:48.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:47 smithi087 ceph-mon[82628]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:06:48.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:47 smithi087 ceph-mon[82628]: osd.0 [v2:172.21.15.57:6802/1715766120,v1:172.21.15.57:6803/1715766120] boot 2024-02-28T16:06:48.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:47 smithi087 ceph-mon[82628]: osdmap e60: 6 total, 6 up, 6 in 2024-02-28T16:06:48.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:06:48.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:47 smithi087 ceph-mon[82628]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:48.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:48.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:48.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:47 smithi087 ceph-mon[82628]: osdmap e61: 6 total, 6 up, 6 in 2024-02-28T16:06:48.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.230+0000 7f840b400700 1 -- 172.21.15.57:0/1934945287 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f841410d570 con 0x7f83f806d8a0 2024-02-28T16:06:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:06:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (5m) 2s ago 15m 14.0M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:06:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (49s) 2s ago 16m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:06:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (41s) 36s ago 14m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:06:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (4m) 2s ago 15m 74.9M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:06:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (8m) 2s ago 8m 125M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:06:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (8m) 2s ago 8m 68.1M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:06:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (8m) 36s ago 8m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:06:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (8m) 36s ago 8m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:06:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (4m) 2s ago 17m 498M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (2m) 36s ago 14m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (2m) 2s ago 17m 44.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (110s) 36s ago 14m 35.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (5m) 2s ago 16m 7972k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (4m) 36s ago 14m 7852k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (10s) 2s ago 13m 11.2M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (12m) 2s ago 12m 234M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (12m) 2s ago 12m 200M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (11m) 36s ago 11m 261M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (11m) 36s ago 11m 236M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (10m) 36s ago 10m 220M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:06:48.227 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (3m) 2s ago 15m 52.2M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:06:48.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 -- 172.21.15.57:0/1934945287 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f83f806d8a0 msgr2=0x7f83f806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:48.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 --2- 172.21.15.57:0/1934945287 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f83f806d8a0 0x7f83f806fd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83fc005010 tx=0x7f83fc009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 -- 172.21.15.57:0/1934945287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84140fe1d0 msgr2=0x7f841410bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 --2- 172.21.15.57:0/1934945287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84140fe1d0 0x7f841410bc00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f840400c830 tx=0x7f8404004470 comp rx=0 tx=0).stop 2024-02-28T16:06:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 -- 172.21.15.57:0/1934945287 shutdown_connections 2024-02-28T16:06:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 --2- 172.21.15.57:0/1934945287 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f83f806d8a0 0x7f83f806fd50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 --2- 172.21.15.57:0/1934945287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84140fb870 0x7f841410b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 --2- 172.21.15.57:0/1934945287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84140fe1d0 0x7f841410bc00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 -- 172.21.15.57:0/1934945287 >> 172.21.15.57:0/1934945287 conn(0x7f84140f74e0 msgr2=0x7f84140f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 -- 172.21.15.57:0/1934945287 shutdown_connections 2024-02-28T16:06:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.234+0000 7f841a000700 1 -- 172.21.15.57:0/1934945287 wait complete. 2024-02-28T16:06:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.377+0000 7fd92dc00700 1 -- 172.21.15.57:0/492718141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9280708c0 msgr2=0x7fd928070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.377+0000 7fd92dc00700 1 --2- 172.21.15.57:0/492718141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9280708c0 0x7fd928070d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd914004940 tx=0x7fd914009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.378+0000 7fd92dc00700 1 -- 172.21.15.57:0/492718141 shutdown_connections 2024-02-28T16:06:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.378+0000 7fd92dc00700 1 --2- 172.21.15.57:0/492718141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9280708c0 0x7fd928070d10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.378+0000 7fd92dc00700 1 --2- 172.21.15.57:0/492718141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd928071f10 0x7fd928070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.378+0000 7fd92dc00700 1 -- 172.21.15.57:0/492718141 >> 172.21.15.57:0/492718141 conn(0x7fd9280f8620 msgr2=0x7fd9280faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.378+0000 7fd92dc00700 1 -- 172.21.15.57:0/492718141 shutdown_connections 2024-02-28T16:06:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.378+0000 7fd92dc00700 1 -- 172.21.15.57:0/492718141 wait complete. 2024-02-28T16:06:48.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.379+0000 7fd92dc00700 1 Processor -- start 2024-02-28T16:06:48.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.379+0000 7fd92dc00700 1 -- start start 2024-02-28T16:06:48.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.379+0000 7fd92dc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280708c0 0x7fd92810fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:48.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.379+0000 7fd92dc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd928071f10 0x7fd9281100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:48.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.379+0000 7fd92dc00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9281106b0 con 0x7fd928071f10 2024-02-28T16:06:48.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.379+0000 7fd92dc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928110f50 con 0x7fd9280708c0 2024-02-28T16:06:48.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.380+0000 7fd926000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd928071f10 0x7fd9281100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:48.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.380+0000 7fd926000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd928071f10 0x7fd9281100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43780/0 (socket says 172.21.15.57:43780) 2024-02-28T16:06:48.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.380+0000 7fd926000700 1 -- 172.21.15.57:0/2548280205 learned_addr learned my addr 172.21.15.57:0/2548280205 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:48.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.380+0000 7fd926a00700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280708c0 0x7fd92810fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:48.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.380+0000 7fd926000700 1 -- 172.21.15.57:0/2548280205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280708c0 msgr2=0x7fd92810fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:48.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.380+0000 7fd926000700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280708c0 0x7fd92810fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.380+0000 7fd926000700 1 -- 172.21.15.57:0/2548280205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd914005040 con 0x7fd928071f10 2024-02-28T16:06:48.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.380+0000 7fd926a00700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280708c0 0x7fd92810fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:06:48.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.381+0000 7fd926000700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd928071f10 0x7fd9281100b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd914009fd0 tx=0x7fd914009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:48.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.381+0000 7fd91ea00700 1 -- 172.21.15.57:0/2548280205 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd91400e040 con 0x7fd928071f10 2024-02-28T16:06:48.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.381+0000 7fd91ea00700 1 -- 172.21.15.57:0/2548280205 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd914004290 con 0x7fd928071f10 2024-02-28T16:06:48.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.381+0000 7fd92dc00700 1 -- 172.21.15.57:0/2548280205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9281111d0 con 0x7fd928071f10 2024-02-28T16:06:48.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.381+0000 7fd91ea00700 1 -- 172.21.15.57:0/2548280205 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd91401c630 con 0x7fd928071f10 2024-02-28T16:06:48.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.381+0000 7fd92dc00700 1 -- 172.21.15.57:0/2548280205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd928111710 con 0x7fd928071f10 2024-02-28T16:06:48.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.382+0000 7fd92dc00700 1 -- 172.21.15.57:0/2548280205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92804bed0 con 0x7fd928071f10 2024-02-28T16:06:48.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.384+0000 7fd91ea00700 1 -- 172.21.15.57:0/2548280205 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd91400bc60 con 0x7fd928071f10 2024-02-28T16:06:48.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.385+0000 7fd91ea00700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd90c06d7f0 0x7fd90c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:48.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.385+0000 7fd91ea00700 1 -- 172.21.15.57:0/2548280205 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6788+0+0 (secure 0 0 0) 0x7fd91408ef80 con 0x7fd928071f10 2024-02-28T16:06:48.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.386+0000 7fd926a00700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd90c06d7f0 0x7fd90c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:48.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.386+0000 7fd926a00700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd90c06d7f0 0x7fd90c06fca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd918009fd0 tx=0x7fd918009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:48.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.389+0000 7fd91ea00700 1 -- 172.21.15.57:0/2548280205 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd91405c1e0 con 0x7fd928071f10 2024-02-28T16:06:48.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.702+0000 7fd92dc00700 1 -- 172.21.15.57:0/2548280205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd928107c10 con 0x7fd928071f10 2024-02-28T16:06:48.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.703+0000 7fd91ea00700 1 -- 172.21.15.57:0/2548280205 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fd91405bd70 con 0x7fd928071f10 2024-02-28T16:06:48.695 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:06:48.695 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:06:48.695 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:06:48.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:06:48.695 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:06:48.695 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:06:48.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 5, 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 9, 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:06:48.696 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:06:48.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.706+0000 7fd92dc00700 1 -- 172.21.15.57:0/2548280205 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd90c06d7f0 msgr2=0x7fd90c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:48.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.706+0000 7fd92dc00700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd90c06d7f0 0x7fd90c06fca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd918009fd0 tx=0x7fd918009ee0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.706+0000 7fd92dc00700 1 -- 172.21.15.57:0/2548280205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd928071f10 msgr2=0x7fd9281100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:48.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.706+0000 7fd92dc00700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd928071f10 0x7fd9281100b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd914009fd0 tx=0x7fd914009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:48.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.707+0000 7fd92dc00700 1 -- 172.21.15.57:0/2548280205 shutdown_connections 2024-02-28T16:06:48.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.707+0000 7fd92dc00700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd90c06d7f0 0x7fd90c06fca0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.707+0000 7fd92dc00700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280708c0 0x7fd92810fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.707+0000 7fd92dc00700 1 --2- 172.21.15.57:0/2548280205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd928071f10 0x7fd9281100b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.707+0000 7fd92dc00700 1 -- 172.21.15.57:0/2548280205 >> 172.21.15.57:0/2548280205 conn(0x7fd9280f8620 msgr2=0x7fd928102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:48.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.707+0000 7fd92dc00700 1 -- 172.21.15.57:0/2548280205 shutdown_connections 2024-02-28T16:06:48.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.707+0000 7fd92dc00700 1 -- 172.21.15.57:0/2548280205 wait complete. 2024-02-28T16:06:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.863+0000 7fbc60200700 1 -- 172.21.15.57:0/357842141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc58100360 msgr2=0x7fbc581007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.863+0000 7fbc60200700 1 --2- 172.21.15.57:0/357842141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc58100360 0x7fbc581007b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbc44004940 tx=0x7fbc44009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.864+0000 7fbc60200700 1 -- 172.21.15.57:0/357842141 shutdown_connections 2024-02-28T16:06:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.864+0000 7fbc60200700 1 --2- 172.21.15.57:0/357842141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc58100360 0x7fbc581007b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.864+0000 7fbc60200700 1 --2- 172.21.15.57:0/357842141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc580ff150 0x7fbc580ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.864+0000 7fbc60200700 1 -- 172.21.15.57:0/357842141 >> 172.21.15.57:0/357842141 conn(0x7fbc580fa920 msgr2=0x7fbc580fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.864+0000 7fbc60200700 1 -- 172.21.15.57:0/357842141 shutdown_connections 2024-02-28T16:06:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.864+0000 7fbc60200700 1 -- 172.21.15.57:0/357842141 wait complete. 2024-02-28T16:06:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.864+0000 7fbc60200700 1 Processor -- start 2024-02-28T16:06:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.865+0000 7fbc60200700 1 -- start start 2024-02-28T16:06:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.865+0000 7fbc60200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc580ff150 0x7fbc5810fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.865+0000 7fbc60200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc58100360 0x7fbc581100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.865+0000 7fbc60200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc581106b0 con 0x7fbc580ff150 2024-02-28T16:06:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.865+0000 7fbc60200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc58110f50 con 0x7fbc58100360 2024-02-28T16:06:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.865+0000 7fbc5d800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc580ff150 0x7fbc5810fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.865+0000 7fbc5d800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc580ff150 0x7fbc5810fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43790/0 (socket says 172.21.15.57:43790) 2024-02-28T16:06:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.865+0000 7fbc5d800700 1 -- 172.21.15.57:0/3102722194 learned_addr learned my addr 172.21.15.57:0/3102722194 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.866+0000 7fbc5d800700 1 -- 172.21.15.57:0/3102722194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc58100360 msgr2=0x7fbc581100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.866+0000 7fbc5d800700 1 --2- 172.21.15.57:0/3102722194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc58100360 0x7fbc581100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.866+0000 7fbc5d800700 1 -- 172.21.15.57:0/3102722194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc44005040 con 0x7fbc580ff150 2024-02-28T16:06:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.866+0000 7fbc5d800700 1 --2- 172.21.15.57:0/3102722194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc580ff150 0x7fbc5810fb70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c8e0 tx=0x7fbc4c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.866+0000 7fbc55600700 1 -- 172.21.15.57:0/3102722194 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc4c00a940 con 0x7fbc580ff150 2024-02-28T16:06:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.866+0000 7fbc55600700 1 -- 172.21.15.57:0/3102722194 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc4c00ce80 con 0x7fbc580ff150 2024-02-28T16:06:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.866+0000 7fbc55600700 1 -- 172.21.15.57:0/3102722194 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc4c0113a0 con 0x7fbc580ff150 2024-02-28T16:06:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.866+0000 7fbc60200700 1 -- 172.21.15.57:0/3102722194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc58111230 con 0x7fbc580ff150 2024-02-28T16:06:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.866+0000 7fbc60200700 1 -- 172.21.15.57:0/3102722194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc58111770 con 0x7fbc580ff150 2024-02-28T16:06:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.867+0000 7fbc60200700 1 -- 172.21.15.57:0/3102722194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5804bed0 con 0x7fbc580ff150 2024-02-28T16:06:48.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.868+0000 7fbc55600700 1 -- 172.21.15.57:0/3102722194 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fbc4c012400 con 0x7fbc580ff150 2024-02-28T16:06:48.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.869+0000 7fbc55600700 1 --2- 172.21.15.57:0/3102722194 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc4006d7e0 0x7fbc4006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:48.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.869+0000 7fbc55600700 1 -- 172.21.15.57:0/3102722194 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6788+0+0 (secure 0 0 0) 0x7fbc4c08d0b0 con 0x7fbc580ff150 2024-02-28T16:06:48.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.870+0000 7fbc5ce00700 1 --2- 172.21.15.57:0/3102722194 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc4006d7e0 0x7fbc4006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:48.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.870+0000 7fbc5ce00700 1 --2- 172.21.15.57:0/3102722194 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc4006d7e0 0x7fbc4006fc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbc44004f90 tx=0x7fbc44009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:48.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:48.874+0000 7fbc55600700 1 -- 172.21.15.57:0/3102722194 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbc4c05a310 con 0x7fbc580ff150 2024-02-28T16:06:49.161 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:48 smithi057 ceph-mon[93219]: pgmap v81: 65 pgs: 9 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 24 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 62/333 objects degraded (18.619%); 9/333 objects misplaced (2.703%); 0 B/s, 107 objects/s recovering 2024-02-28T16:06:49.161 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:48 smithi057 ceph-mon[93219]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:49.161 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:48 smithi057 ceph-mon[93219]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:49.161 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:48 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2548280205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:49.161 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:49.161 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:06:49.161 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:48 smithi057 ceph-mon[93219]: osdmap e62: 6 total, 6 up, 6 in 2024-02-28T16:06:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.222+0000 7fbc60200700 1 -- 172.21.15.57:0/3102722194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbc58116190 con 0x7fbc580ff150 2024-02-28T16:06:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.223+0000 7fbc55600700 1 -- 172.21.15.57:0/3102722194 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1863 (secure 0 0 0) 0x7fbc4c059ea0 con 0x7fbc580ff150 2024-02-28T16:06:49.215 INFO:teuthology.orchestra.run.smithi057.stdout:e18 2024-02-28T16:06:49.215 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:06:49.215 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:06:49.215 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:06:49.215 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:06:49.215 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:06:49.215 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:06:49.215 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 18 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:06:28.521002+0000 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:06:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:06:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:06:49.218 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:06:49.218 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:06:49.218 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:06:49.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:48 smithi087 ceph-mon[82628]: pgmap v81: 65 pgs: 9 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 24 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 62/333 objects degraded (18.619%); 9/333 objects misplaced (2.703%); 0 B/s, 107 objects/s recovering 2024-02-28T16:06:49.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:48 smithi087 ceph-mon[82628]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:49.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:48 smithi087 ceph-mon[82628]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:49.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:48 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2548280205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:49.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:49.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:06:49.219 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:48 smithi087 ceph-mon[82628]: osdmap e62: 6 total, 6 up, 6 in 2024-02-28T16:06:49.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 -- 172.21.15.57:0/3102722194 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc4006d7e0 msgr2=0x7fbc4006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:49.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 --2- 172.21.15.57:0/3102722194 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc4006d7e0 0x7fbc4006fc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbc44004f90 tx=0x7fbc44009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 -- 172.21.15.57:0/3102722194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc580ff150 msgr2=0x7fbc5810fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 --2- 172.21.15.57:0/3102722194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc580ff150 0x7fbc5810fb70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c8e0 tx=0x7fbc4c0044c0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 -- 172.21.15.57:0/3102722194 shutdown_connections 2024-02-28T16:06:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 --2- 172.21.15.57:0/3102722194 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc4006d7e0 0x7fbc4006fc90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 --2- 172.21.15.57:0/3102722194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc580ff150 0x7fbc5810fb70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 --2- 172.21.15.57:0/3102722194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc58100360 0x7fbc581100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 -- 172.21.15.57:0/3102722194 >> 172.21.15.57:0/3102722194 conn(0x7fbc580fa920 msgr2=0x7fbc58103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 -- 172.21.15.57:0/3102722194 shutdown_connections 2024-02-28T16:06:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.226+0000 7fbc60200700 1 -- 172.21.15.57:0/3102722194 wait complete. 2024-02-28T16:06:49.221 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-02-28T16:06:49.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.380+0000 7fd83e600700 1 -- 172.21.15.57:0/3442124571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd838100380 msgr2=0x7fd8381007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:49.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.380+0000 7fd83e600700 1 --2- 172.21.15.57:0/3442124571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd838100380 0x7fd8381007d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd824004940 tx=0x7fd824009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:49.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.381+0000 7fd83e600700 1 -- 172.21.15.57:0/3442124571 shutdown_connections 2024-02-28T16:06:49.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.381+0000 7fd83e600700 1 --2- 172.21.15.57:0/3442124571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd838100380 0x7fd8381007d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.381+0000 7fd83e600700 1 --2- 172.21.15.57:0/3442124571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ff170 0x7fd8380ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.381+0000 7fd83e600700 1 -- 172.21.15.57:0/3442124571 >> 172.21.15.57:0/3442124571 conn(0x7fd8380fa920 msgr2=0x7fd8380fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:49.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.381+0000 7fd83e600700 1 -- 172.21.15.57:0/3442124571 shutdown_connections 2024-02-28T16:06:49.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.381+0000 7fd83e600700 1 -- 172.21.15.57:0/3442124571 wait complete. 2024-02-28T16:06:49.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.382+0000 7fd83e600700 1 Processor -- start 2024-02-28T16:06:49.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.382+0000 7fd83e600700 1 -- start start 2024-02-28T16:06:49.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.382+0000 7fd83e600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8380ff170 0x7fd83810fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:49.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.382+0000 7fd83e600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd838100380 0x7fd8381100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:49.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.382+0000 7fd83e600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838110770 con 0x7fd8380ff170 2024-02-28T16:06:49.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.382+0000 7fd83e600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838110fb0 con 0x7fd838100380 2024-02-28T16:06:49.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.382+0000 7fd837400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8380ff170 0x7fd83810fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:49.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.382+0000 7fd837400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8380ff170 0x7fd83810fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43802/0 (socket says 172.21.15.57:43802) 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.382+0000 7fd837400700 1 -- 172.21.15.57:0/2039770816 learned_addr learned my addr 172.21.15.57:0/2039770816 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.383+0000 7fd836a00700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd838100380 0x7fd8381100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.383+0000 7fd837400700 1 -- 172.21.15.57:0/2039770816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd838100380 msgr2=0x7fd8381100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.383+0000 7fd837400700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd838100380 0x7fd8381100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.383+0000 7fd837400700 1 -- 172.21.15.57:0/2039770816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd824005040 con 0x7fd8380ff170 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.383+0000 7fd836a00700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd838100380 0x7fd8381100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.383+0000 7fd837400700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8380ff170 0x7fd83810fba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd82800b790 tx=0x7fd828009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.383+0000 7fd82f400700 1 -- 172.21.15.57:0/2039770816 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd82800f6f0 con 0x7fd8380ff170 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.383+0000 7fd82f400700 1 -- 172.21.15.57:0/2039770816 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd82800fd20 con 0x7fd8380ff170 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.383+0000 7fd82f400700 1 -- 172.21.15.57:0/2039770816 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8280103a0 con 0x7fd8380ff170 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.384+0000 7fd83e600700 1 -- 172.21.15.57:0/2039770816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd838111290 con 0x7fd8380ff170 2024-02-28T16:06:49.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.384+0000 7fd83e600700 1 -- 172.21.15.57:0/2039770816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8381117d0 con 0x7fd8380ff170 2024-02-28T16:06:49.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.385+0000 7fd83e600700 1 -- 172.21.15.57:0/2039770816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83804bed0 con 0x7fd8380ff170 2024-02-28T16:06:49.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.386+0000 7fd82f400700 1 -- 172.21.15.57:0/2039770816 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd828011400 con 0x7fd8380ff170 2024-02-28T16:06:49.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.387+0000 7fd82f400700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd81c06d7e0 0x7fd81c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:49.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.387+0000 7fd82f400700 1 -- 172.21.15.57:0/2039770816 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6788+0+0 (secure 0 0 0) 0x7fd82808ce70 con 0x7fd8380ff170 2024-02-28T16:06:49.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.387+0000 7fd836a00700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd81c06d7e0 0x7fd81c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:49.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.388+0000 7fd836a00700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd81c06d7e0 0x7fd81c06fc90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd824009fd0 tx=0x7fd824009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:49.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.392+0000 7fd82f400700 1 -- 172.21.15.57:0/2039770816 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd82805a050 con 0x7fd8380ff170 2024-02-28T16:06:49.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.659+0000 7fd83e600700 1 -- 172.21.15.57:0/2039770816 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd838111d80 con 0x7fd81c06d7e0 2024-02-28T16:06:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.661+0000 7fd82f400700 1 -- 172.21.15.57:0/2039770816 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd838111d80 con 0x7fd81c06d7e0 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "7/21 daemons upgraded", 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:06:49.653 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:06:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 -- 172.21.15.57:0/2039770816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd81c06d7e0 msgr2=0x7fd81c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd81c06d7e0 0x7fd81c06fc90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd824009fd0 tx=0x7fd824009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 -- 172.21.15.57:0/2039770816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8380ff170 msgr2=0x7fd83810fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8380ff170 0x7fd83810fba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd82800b790 tx=0x7fd828009220 comp rx=0 tx=0).stop 2024-02-28T16:06:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 -- 172.21.15.57:0/2039770816 shutdown_connections 2024-02-28T16:06:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd81c06d7e0 0x7fd81c06fc90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8380ff170 0x7fd83810fba0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 --2- 172.21.15.57:0/2039770816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd838100380 0x7fd8381100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 -- 172.21.15.57:0/2039770816 >> 172.21.15.57:0/2039770816 conn(0x7fd8380fa920 msgr2=0x7fd8381035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:49.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 -- 172.21.15.57:0/2039770816 shutdown_connections 2024-02-28T16:06:49.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.664+0000 7fd83e600700 1 -- 172.21.15.57:0/2039770816 wait complete. 2024-02-28T16:06:49.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.823+0000 7fd787200700 1 -- 172.21.15.57:0/1522758209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7801003a0 msgr2=0x7fd780102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:49.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.823+0000 7fd787200700 1 --2- 172.21.15.57:0/1522758209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7801003a0 0x7fd780102780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd76c004940 tx=0x7fd76c009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:49.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.823+0000 7fd787200700 1 -- 172.21.15.57:0/1522758209 shutdown_connections 2024-02-28T16:06:49.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.823+0000 7fd787200700 1 --2- 172.21.15.57:0/1522758209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7801003a0 0x7fd780102780 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.823+0000 7fd787200700 1 --2- 172.21.15.57:0/1522758209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7800fda80 0x7fd7800ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.823+0000 7fd787200700 1 -- 172.21.15.57:0/1522758209 >> 172.21.15.57:0/1522758209 conn(0x7fd7800f74e0 msgr2=0x7fd7800f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:49.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.823+0000 7fd787200700 1 -- 172.21.15.57:0/1522758209 shutdown_connections 2024-02-28T16:06:49.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.823+0000 7fd787200700 1 -- 172.21.15.57:0/1522758209 wait complete. 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.824+0000 7fd787200700 1 Processor -- start 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.824+0000 7fd787200700 1 -- start start 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.825+0000 7fd787200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7800fda80 0x7fd78010fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.825+0000 7fd787200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7801003a0 0x7fd780110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.825+0000 7fd787200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd780110690 con 0x7fd7801003a0 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.825+0000 7fd787200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd780110f30 con 0x7fd7800fda80 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.825+0000 7fd77f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7801003a0 0x7fd780110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.825+0000 7fd77f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7801003a0 0x7fd780110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43814/0 (socket says 172.21.15.57:43814) 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.825+0000 7fd77f400700 1 -- 172.21.15.57:0/721831210 learned_addr learned my addr 172.21.15.57:0/721831210 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.825+0000 7fd77f400700 1 -- 172.21.15.57:0/721831210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7800fda80 msgr2=0x7fd78010fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:49.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.825+0000 7fd77fe00700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7800fda80 0x7fd78010fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:49.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.826+0000 7fd77f400700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7800fda80 0x7fd78010fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:49.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.826+0000 7fd77f400700 1 -- 172.21.15.57:0/721831210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c005040 con 0x7fd7801003a0 2024-02-28T16:06:49.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.826+0000 7fd77fe00700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7800fda80 0x7fd78010fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:06:49.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.826+0000 7fd77f400700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7801003a0 0x7fd780110090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00b3b0 tx=0x7fd76c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:49.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.826+0000 7fd777e00700 1 -- 172.21.15.57:0/721831210 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd76c00e040 con 0x7fd7801003a0 2024-02-28T16:06:49.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.826+0000 7fd777e00700 1 -- 172.21.15.57:0/721831210 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd76c00bd90 con 0x7fd7801003a0 2024-02-28T16:06:49.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.826+0000 7fd787200700 1 -- 172.21.15.57:0/721831210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7801111b0 con 0x7fd7801003a0 2024-02-28T16:06:49.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.826+0000 7fd777e00700 1 -- 172.21.15.57:0/721831210 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd76c01c630 con 0x7fd7801003a0 2024-02-28T16:06:49.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.826+0000 7fd787200700 1 -- 172.21.15.57:0/721831210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7801116f0 con 0x7fd7801003a0 2024-02-28T16:06:49.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.827+0000 7fd787200700 1 -- 172.21.15.57:0/721831210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78004bed0 con 0x7fd7801003a0 2024-02-28T16:06:49.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.829+0000 7fd777e00700 1 -- 172.21.15.57:0/721831210 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd76c0139f0 con 0x7fd7801003a0 2024-02-28T16:06:49.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.829+0000 7fd777e00700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd76406d7f0 0x7fd76406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:06:49.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.830+0000 7fd777e00700 1 -- 172.21.15.57:0/721831210 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6788+0+0 (secure 0 0 0) 0x7fd76c08e600 con 0x7fd7801003a0 2024-02-28T16:06:49.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.830+0000 7fd77fe00700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd76406d7f0 0x7fd76406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:06:49.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.830+0000 7fd77fe00700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd76406d7f0 0x7fd76406fca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd770007fd0 tx=0x7fd770009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:06:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:49.835+0000 7fd777e00700 1 -- 172.21.15.57:0/721831210 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd76c05b7e0 con 0x7fd7801003a0 2024-02-28T16:06:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.179+0000 7fd787200700 1 -- 172.21.15.57:0/721831210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd780105a10 con 0x7fd7801003a0 2024-02-28T16:06:50.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.179+0000 7fd777e00700 1 -- 172.21.15.57:0/721831210 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+670 (secure 0 0 0) 0x7fd76c05b370 con 0x7fd7801003a0 2024-02-28T16:06:50.171 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_WARN Degraded data redundancy: 2845/333 objects degraded (854.354%), 7 pgs degraded 2024-02-28T16:06:50.171 INFO:teuthology.orchestra.run.smithi057.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 2845/333 objects degraded (854.354%), 7 pgs degraded 2024-02-28T16:06:50.171 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-02-28T16:06:50.171 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-02-28T16:06:50.172 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-02-28T16:06:50.172 INFO:teuthology.orchestra.run.smithi057.stdout: pg 3.0 is active+recovery_wait+undersized+degraded+remapped, acting [2,4] 2024-02-28T16:06:50.172 INFO:teuthology.orchestra.run.smithi057.stdout: pg 3.2 is active+recovery_wait+undersized+degraded+remapped, acting [5,3] 2024-02-28T16:06:50.172 INFO:teuthology.orchestra.run.smithi057.stdout: pg 3.e is active+recovery_wait+undersized+degraded+remapped, acting [5,1] 2024-02-28T16:06:50.172 INFO:teuthology.orchestra.run.smithi057.stdout: pg 3.1a is active+recovery_wait+undersized+degraded+remapped, acting [1,2] 2024-02-28T16:06:50.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 -- 172.21.15.57:0/721831210 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd76406d7f0 msgr2=0x7fd76406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:50.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd76406d7f0 0x7fd76406fca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd770007fd0 tx=0x7fd770009040 comp rx=0 tx=0).stop 2024-02-28T16:06:50.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 -- 172.21.15.57:0/721831210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7801003a0 msgr2=0x7fd780110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:06:50.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7801003a0 0x7fd780110090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00b3b0 tx=0x7fd76c009e30 comp rx=0 tx=0).stop 2024-02-28T16:06:50.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 -- 172.21.15.57:0/721831210 shutdown_connections 2024-02-28T16:06:50.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd76406d7f0 0x7fd76406fca0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:50.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7800fda80 0x7fd78010fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:50.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 --2- 172.21.15.57:0/721831210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7801003a0 0x7fd780110090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:06:50.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 -- 172.21.15.57:0/721831210 >> 172.21.15.57:0/721831210 conn(0x7fd7800f74e0 msgr2=0x7fd7800fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:06:50.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 -- 172.21.15.57:0/721831210 shutdown_connections 2024-02-28T16:06:50.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:06:50.182+0000 7fd787200700 1 -- 172.21.15.57:0/721831210 wait complete. 2024-02-28T16:06:50.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:49 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3102722194' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:06:50.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:49 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3102722194' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:06:50.998 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:50 smithi057 ceph-mon[93219]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:50.998 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:50 smithi057 ceph-mon[93219]: pgmap v84: 65 pgs: 49 active+clean, 1 active+recovering+undersized+remapped, 6 active+undersized, 3 active+undersized+degraded, 2 active+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s; 2845/333 objects degraded (854.354%); 2.4 MiB/s, 23 objects/s recovering 2024-02-28T16:06:50.998 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:50 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 2845/333 objects degraded (854.354%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:06:50.998 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:50 smithi057 ceph-mon[93219]: osdmap e63: 6 total, 6 up, 6 in 2024-02-28T16:06:50.998 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:50 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/721831210' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:06:51.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:50 smithi087 ceph-mon[82628]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:06:51.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:50 smithi087 ceph-mon[82628]: pgmap v84: 65 pgs: 49 active+clean, 1 active+recovering+undersized+remapped, 6 active+undersized, 3 active+undersized+degraded, 2 active+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s; 2845/333 objects degraded (854.354%); 2.4 MiB/s, 23 objects/s recovering 2024-02-28T16:06:51.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:50 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 2845/333 objects degraded (854.354%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:06:51.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:50 smithi087 ceph-mon[82628]: osdmap e63: 6 total, 6 up, 6 in 2024-02-28T16:06:51.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:50 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/721831210' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:06:52.242 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:51 smithi057 ceph-mon[93219]: osdmap e64: 6 total, 6 up, 6 in 2024-02-28T16:06:52.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:51 smithi087 ceph-mon[82628]: osdmap e64: 6 total, 6 up, 6 in 2024-02-28T16:06:53.236 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:52 smithi057 ceph-mon[93219]: pgmap v87: 65 pgs: 58 active+clean, 1 active+recovering+undersized+remapped, 2 active+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 2 op/s; 2833/333 objects degraded (850.751%); 3.0 MiB/s, 29 objects/s recovering 2024-02-28T16:06:53.236 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:52 smithi057 ceph-mon[93219]: osdmap e65: 6 total, 6 up, 6 in 2024-02-28T16:06:53.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:52 smithi087 ceph-mon[82628]: pgmap v87: 65 pgs: 58 active+clean, 1 active+recovering+undersized+remapped, 2 active+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 2 op/s; 2833/333 objects degraded (850.751%); 3.0 MiB/s, 29 objects/s recovering 2024-02-28T16:06:53.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:52 smithi087 ceph-mon[82628]: osdmap e65: 6 total, 6 up, 6 in 2024-02-28T16:06:54.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:54 smithi087 ceph-mon[82628]: osdmap e66: 6 total, 6 up, 6 in 2024-02-28T16:06:54.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:54 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:54.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:54 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:54.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:54 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:06:54.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:54 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:06:54.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:54 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:54.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:54 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:06:54.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:54 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:54.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:54 smithi087 ceph-mon[82628]: osdmap e67: 6 total, 6 up, 6 in 2024-02-28T16:06:54.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:54 smithi057 ceph-mon[93219]: osdmap e66: 6 total, 6 up, 6 in 2024-02-28T16:06:54.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:54 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:54.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:54 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:54.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:54 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:06:54.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:54 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:06:54.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:54 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:06:54.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:54 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:06:54.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:54 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:54.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:54 smithi057 ceph-mon[93219]: osdmap e67: 6 total, 6 up, 6 in 2024-02-28T16:06:55.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:55 smithi057 ceph-mon[93219]: pgmap v90: 65 pgs: 58 active+clean, 1 active+recovering+undersized+remapped, 2 active+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 2833/333 objects degraded (850.751%) 2024-02-28T16:06:55.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:55.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:55.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:06:55.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:55 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:06:55.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:55 smithi057 ceph-mon[93219]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-02-28T16:06:55.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:55 smithi057 ceph-mon[93219]: osdmap e68: 6 total, 6 up, 6 in 2024-02-28T16:06:55.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:55 smithi087 ceph-mon[82628]: pgmap v90: 65 pgs: 58 active+clean, 1 active+recovering+undersized+remapped, 2 active+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 2833/333 objects degraded (850.751%) 2024-02-28T16:06:55.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:55.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:06:55.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:06:55.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:55 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:06:55.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:55 smithi087 ceph-mon[82628]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-02-28T16:06:55.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:55 smithi087 ceph-mon[82628]: osdmap e68: 6 total, 6 up, 6 in 2024-02-28T16:06:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:56 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 690/333 objects degraded (207.207%), 1 pg degraded (PG_DEGRADED) 2024-02-28T16:06:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:56 smithi057 ceph-mon[93219]: osdmap e69: 6 total, 6 up, 6 in 2024-02-28T16:06:56.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:56 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 690/333 objects degraded (207.207%), 1 pg degraded (PG_DEGRADED) 2024-02-28T16:06:56.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:56 smithi087 ceph-mon[82628]: osdmap e69: 6 total, 6 up, 6 in 2024-02-28T16:06:57.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:57 smithi057 ceph-mon[93219]: pgmap v93: 65 pgs: 1 peering, 62 active+clean, 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 690/333 objects degraded (207.207%); 0 B/s, 579 objects/s recovering 2024-02-28T16:06:57.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:57 smithi057 ceph-mon[93219]: osdmap e70: 6 total, 6 up, 6 in 2024-02-28T16:06:57.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:57 smithi087 ceph-mon[82628]: pgmap v93: 65 pgs: 1 peering, 62 active+clean, 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 690/333 objects degraded (207.207%); 0 B/s, 579 objects/s recovering 2024-02-28T16:06:57.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:57 smithi087 ceph-mon[82628]: osdmap e70: 6 total, 6 up, 6 in 2024-02-28T16:06:59.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:59 smithi057 ceph-mon[93219]: pgmap v96: 65 pgs: 1 peering, 62 active+clean, 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 690/333 objects degraded (207.207%); 0 B/s, 579 objects/s recovering 2024-02-28T16:06:59.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:06:59 smithi057 ceph-mon[93219]: osdmap e71: 6 total, 6 up, 6 in 2024-02-28T16:06:59.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:59 smithi087 ceph-mon[82628]: pgmap v96: 65 pgs: 1 peering, 62 active+clean, 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 690/333 objects degraded (207.207%); 0 B/s, 579 objects/s recovering 2024-02-28T16:06:59.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:06:59 smithi087 ceph-mon[82628]: osdmap e71: 6 total, 6 up, 6 in 2024-02-28T16:07:00.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:00 smithi057 ceph-mon[93219]: osdmap e72: 6 total, 6 up, 6 in 2024-02-28T16:07:00.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:00 smithi087 ceph-mon[82628]: osdmap e72: 6 total, 6 up, 6 in 2024-02-28T16:07:01.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:01 smithi057 ceph-mon[93219]: pgmap v99: 65 pgs: 1 peering, 63 active+clean, 1 active+recovering+undersized+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s; 0 B/s, 172 objects/s recovering 2024-02-28T16:07:01.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:01 smithi057 ceph-mon[93219]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 690/333 objects degraded (207.207%), 1 pg degraded) 2024-02-28T16:07:01.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:01 smithi057 ceph-mon[93219]: Cluster is now healthy 2024-02-28T16:07:01.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:01 smithi087 ceph-mon[82628]: pgmap v99: 65 pgs: 1 peering, 63 active+clean, 1 active+recovering+undersized+remapped; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s; 0 B/s, 172 objects/s recovering 2024-02-28T16:07:01.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:01 smithi087 ceph-mon[82628]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 690/333 objects degraded (207.207%), 1 pg degraded) 2024-02-28T16:07:01.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:01 smithi087 ceph-mon[82628]: Cluster is now healthy 2024-02-28T16:07:03.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:03 smithi057 ceph-mon[93219]: pgmap v100: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 0 B/s, 70 objects/s recovering 2024-02-28T16:07:03.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:03 smithi087 ceph-mon[82628]: pgmap v100: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 0 B/s, 70 objects/s recovering 2024-02-28T16:07:05.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:04 smithi057 ceph-mon[93219]: pgmap v101: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 0 B/s, 60 objects/s recovering 2024-02-28T16:07:05.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:05.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:07:05.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:04 smithi087 ceph-mon[82628]: pgmap v101: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 0 B/s, 60 objects/s recovering 2024-02-28T16:07:05.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:05.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:07:07.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:06 smithi057 ceph-mon[93219]: pgmap v102: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 50 objects/s recovering 2024-02-28T16:07:07.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:06 smithi087 ceph-mon[82628]: pgmap v102: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 50 objects/s recovering 2024-02-28T16:07:08.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:08 smithi057 ceph-mon[93219]: pgmap v103: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s; 0 B/s, 41 objects/s recovering 2024-02-28T16:07:08.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:08 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:08 smithi087 ceph-mon[82628]: pgmap v103: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s; 0 B/s, 41 objects/s recovering 2024-02-28T16:07:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:08 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:10.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:07:10.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:09 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:07:10.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:09 smithi057 ceph-mon[93219]: Upgrade: osd.1 is safe to restart 2024-02-28T16:07:10.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:07:10.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:09 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:07:10.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:09 smithi087 ceph-mon[82628]: Upgrade: osd.1 is safe to restart 2024-02-28T16:07:11.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:10 smithi057 ceph-mon[93219]: pgmap v104: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 5 op/s; 0 B/s, 37 objects/s recovering 2024-02-28T16:07:11.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:10 smithi087 ceph-mon[82628]: pgmap v104: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 5 op/s; 0 B/s, 37 objects/s recovering 2024-02-28T16:07:12.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:12 smithi057 ceph-mon[93219]: Upgrade: Updating osd.1 2024-02-28T16:07:12.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:12.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:07:12.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:07:12.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:12 smithi057 ceph-mon[93219]: Deploying daemon osd.1 on smithi057 2024-02-28T16:07:12.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:12 smithi087 ceph-mon[82628]: Upgrade: Updating osd.1 2024-02-28T16:07:12.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:12.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:07:12.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:07:12.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:12 smithi087 ceph-mon[82628]: Deploying daemon osd.1 on smithi057 2024-02-28T16:07:13.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:13 smithi057 ceph-mon[93219]: pgmap v105: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:13.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:13 smithi087 ceph-mon[82628]: pgmap v105: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:15.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:15 smithi057 ceph-mon[93219]: pgmap v106: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:15.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:15 smithi087 ceph-mon[82628]: pgmap v106: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:16.927 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:16 smithi057 systemd[1]: Stopping Ceph osd.1 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:07:17.427 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:16 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1[54007]: 2024-02-28T16:07:16.947+0000 7f5768e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:07:17.427 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:16 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1[54007]: 2024-02-28T16:07:16.948+0000 7f5768e00700 -1 osd.1 72 *** Got signal Terminated *** 2024-02-28T16:07:17.427 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:16 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1[54007]: 2024-02-28T16:07:16.948+0000 7f5768e00700 -1 osd.1 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:07:17.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:17 smithi057 ceph-mon[93219]: pgmap v107: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:07:17.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:17 smithi057 ceph-mon[93219]: osd.1 marked itself down and dead 2024-02-28T16:07:17.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:17 smithi087 ceph-mon[82628]: pgmap v107: 65 pgs: 65 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:07:17.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:17 smithi087 ceph-mon[82628]: osd.1 marked itself down and dead 2024-02-28T16:07:18.550 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:18 smithi057 podman[106852]: 2024-02-28 16:07:18.25627751 +0000 UTC m=+1.444684811 container died b82f9e9f2d5d28a3480656274fdae16dbc0d95b7245beadd074944486892b435 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=quincy-c0f02e6, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-02-28T16:07:18.853 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:18 smithi057 ceph-mon[93219]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:07:18.853 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:18 smithi057 ceph-mon[93219]: osdmap e73: 6 total, 5 up, 6 in 2024-02-28T16:07:18.853 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:18 smithi057 podman[106852]: 2024-02-28 16:07:18.691553946 +0000 UTC m=+1.879961282 container cleanup b82f9e9f2d5d28a3480656274fdae16dbc0d95b7245beadd074944486892b435 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1, RELEASE=quincy-c0f02e6, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5) 2024-02-28T16:07:18.853 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:18 smithi057 bash[106852]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1 2024-02-28T16:07:18.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:18 smithi087 ceph-mon[82628]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:07:18.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:18 smithi087 ceph-mon[82628]: osdmap e73: 6 total, 5 up, 6 in 2024-02-28T16:07:19.176 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:18 smithi057 podman[106870]: 2024-02-28 16:07:18.859604154 +0000 UTC m=+0.589180427 container remove b82f9e9f2d5d28a3480656274fdae16dbc0d95b7245beadd074944486892b435 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-c0f02e6, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240222, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-28T16:07:19.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:19 smithi057 ceph-mon[93219]: pgmap v109: 65 pgs: 10 stale+active+clean, 55 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-28T16:07:19.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:19 smithi057 ceph-mon[93219]: osdmap e74: 6 total, 5 up, 6 in 2024-02-28T16:07:19.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:19.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:07:19.902 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:19 smithi057 podman[106957]: 2024-02-28 16:07:19.603871712 +0000 UTC m=+0.038178119 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:07:19.902 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:19 smithi057 podman[106957]: 2024-02-28 16:07:19.73575157 +0000 UTC m=+0.170057982 container create 02e0a56e2cd8f94534da76987dfdaf448de62b5ff6dc53a37be6026d9a747cf6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-28T16:07:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:19 smithi087 ceph-mon[82628]: pgmap v109: 65 pgs: 10 stale+active+clean, 55 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-28T16:07:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:19 smithi087 ceph-mon[82628]: osdmap e74: 6 total, 5 up, 6 in 2024-02-28T16:07:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:07:20.180 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:20 smithi057 podman[106957]: 2024-02-28 16:07:20.024492719 +0000 UTC m=+0.458799158 container init 02e0a56e2cd8f94534da76987dfdaf448de62b5ff6dc53a37be6026d9a747cf6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux ) 2024-02-28T16:07:20.180 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:20 smithi057 podman[106957]: 2024-02-28 16:07:20.040571163 +0000 UTC m=+0.474877578 container start 02e0a56e2cd8f94534da76987dfdaf448de62b5ff6dc53a37be6026d9a747cf6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, ceph=True) 2024-02-28T16:07:20.180 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:20 smithi057 podman[106957]: 2024-02-28 16:07:20.122186111 +0000 UTC m=+0.556492556 container attach 02e0a56e2cd8f94534da76987dfdaf448de62b5ff6dc53a37be6026d9a747cf6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-28T16:07:20.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.358+0000 7f0985400700 1 -- 172.21.15.57:0/3116589912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09800fe0e0 msgr2=0x7f09800fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:20.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.358+0000 7f0985400700 1 --2- 172.21.15.57:0/3116589912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09800fe0e0 0x7f09800fe550 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f096c004940 tx=0x7f096c009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:20.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.358+0000 7f0985400700 1 -- 172.21.15.57:0/3116589912 shutdown_connections 2024-02-28T16:07:20.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.358+0000 7f0985400700 1 --2- 172.21.15.57:0/3116589912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09800fe0e0 0x7f09800fe550 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:20.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.358+0000 7f0985400700 1 --2- 172.21.15.57:0/3116589912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09800fcef0 0x7f09800fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:20.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.358+0000 7f0985400700 1 -- 172.21.15.57:0/3116589912 >> 172.21.15.57:0/3116589912 conn(0x7f09800f8620 msgr2=0x7f09800faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:20.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.358+0000 7f0985400700 1 -- 172.21.15.57:0/3116589912 shutdown_connections 2024-02-28T16:07:20.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.358+0000 7f0985400700 1 -- 172.21.15.57:0/3116589912 wait complete. 2024-02-28T16:07:20.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.360+0000 7f0985400700 1 Processor -- start 2024-02-28T16:07:20.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.360+0000 7f0985400700 1 -- start start 2024-02-28T16:07:20.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.360+0000 7f0985400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09800fcef0 0x7f098010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:20.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.360+0000 7f0985400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09800fe0e0 0x7f09801100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:20.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.360+0000 7f0985400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09801106a0 con 0x7f09800fcef0 2024-02-28T16:07:20.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.360+0000 7f0985400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0980110f40 con 0x7f09800fe0e0 2024-02-28T16:07:20.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.361+0000 7f097e800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09800fcef0 0x7f098010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:20.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.361+0000 7f097e800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09800fcef0 0x7f098010fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49252/0 (socket says 172.21.15.57:49252) 2024-02-28T16:07:20.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.361+0000 7f097e800700 1 -- 172.21.15.57:0/2255925209 learned_addr learned my addr 172.21.15.57:0/2255925209 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:20.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.361+0000 7f097de00700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09800fe0e0 0x7f09801100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:20.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.361+0000 7f097e800700 1 -- 172.21.15.57:0/2255925209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09800fe0e0 msgr2=0x7f09801100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:20.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.361+0000 7f097e800700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09800fe0e0 0x7f09801100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:20.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.361+0000 7f097e800700 1 -- 172.21.15.57:0/2255925209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c005040 con 0x7f09800fcef0 2024-02-28T16:07:20.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.362+0000 7f097e800700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09800fcef0 0x7f098010fb60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f097000c8b0 tx=0x7f0970004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:20.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.362+0000 7f0976a00700 1 -- 172.21.15.57:0/2255925209 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f097000a760 con 0x7f09800fcef0 2024-02-28T16:07:20.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.362+0000 7f0976a00700 1 -- 172.21.15.57:0/2255925209 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f097000ad90 con 0x7f09800fcef0 2024-02-28T16:07:20.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.362+0000 7f0976a00700 1 -- 172.21.15.57:0/2255925209 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09700113a0 con 0x7f09800fcef0 2024-02-28T16:07:20.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.362+0000 7f0985400700 1 -- 172.21.15.57:0/2255925209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0980111220 con 0x7f09800fcef0 2024-02-28T16:07:20.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.362+0000 7f0985400700 1 -- 172.21.15.57:0/2255925209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0980111760 con 0x7f09800fcef0 2024-02-28T16:07:20.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.364+0000 7f0985400700 1 -- 172.21.15.57:0/2255925209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0980102210 con 0x7f09800fcef0 2024-02-28T16:07:20.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.365+0000 7f0976a00700 1 -- 172.21.15.57:0/2255925209 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f0970012400 con 0x7f09800fcef0 2024-02-28T16:07:20.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.366+0000 7f0976a00700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f096406d7f0 0x7f096406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:20.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.366+0000 7f0976a00700 1 -- 172.21.15.57:0/2255925209 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f097008da20 con 0x7f09800fcef0 2024-02-28T16:07:20.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.366+0000 7f097de00700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f096406d7f0 0x7f096406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:20.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.367+0000 7f097de00700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f096406d7f0 0x7f096406fca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f096c00b020 tx=0x7f096c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:20.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.374+0000 7f0976a00700 1 -- 172.21.15.57:0/2255925209 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f097005ad50 con 0x7f09800fcef0 2024-02-28T16:07:20.613 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:20 smithi057 podman[106957]: 2024-02-28 16:07:20.494585046 +0000 UTC m=+0.928891521 container died 02e0a56e2cd8f94534da76987dfdaf448de62b5ff6dc53a37be6026d9a747cf6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240222) 2024-02-28T16:07:20.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.633+0000 7f0985400700 1 -- 172.21.15.57:0/2255925209 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0980111ba0 con 0x7f096406d7f0 2024-02-28T16:07:20.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.635+0000 7f0976a00700 1 -- 172.21.15.57:0/2255925209 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0980111ba0 con 0x7f096406d7f0 2024-02-28T16:07:20.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.637+0000 7f0985400700 1 -- 172.21.15.57:0/2255925209 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f096406d7f0 msgr2=0x7f096406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:20.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.637+0000 7f0985400700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f096406d7f0 0x7f096406fca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f096c00b020 tx=0x7f096c009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:20.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.637+0000 7f0985400700 1 -- 172.21.15.57:0/2255925209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09800fcef0 msgr2=0x7f098010fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:20.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.637+0000 7f0985400700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09800fcef0 0x7f098010fb60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f097000c8b0 tx=0x7f0970004470 comp rx=0 tx=0).stop 2024-02-28T16:07:20.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.638+0000 7f0985400700 1 -- 172.21.15.57:0/2255925209 shutdown_connections 2024-02-28T16:07:20.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.638+0000 7f0985400700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f096406d7f0 0x7f096406fca0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:20.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.638+0000 7f0985400700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09800fcef0 0x7f098010fb60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:20.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.638+0000 7f0985400700 1 --2- 172.21.15.57:0/2255925209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09800fe0e0 0x7f09801100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:20.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.638+0000 7f0985400700 1 -- 172.21.15.57:0/2255925209 >> 172.21.15.57:0/2255925209 conn(0x7f09800f8620 msgr2=0x7f09800ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:20.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.638+0000 7f0985400700 1 -- 172.21.15.57:0/2255925209 shutdown_connections 2024-02-28T16:07:20.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.638+0000 7f0985400700 1 -- 172.21.15.57:0/2255925209 wait complete. 2024-02-28T16:07:20.646 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:07:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.797+0000 7fec2ba00700 1 -- 172.21.15.57:0/2113694858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec240fb870 msgr2=0x7fec240fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.797+0000 7fec2ba00700 1 --2- 172.21.15.57:0/2113694858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec240fb870 0x7fec240fbc80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec18004940 tx=0x7fec18009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.797+0000 7fec2ba00700 1 -- 172.21.15.57:0/2113694858 shutdown_connections 2024-02-28T16:07:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.797+0000 7fec2ba00700 1 --2- 172.21.15.57:0/2113694858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec240fc1c0 0x7fec240fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.797+0000 7fec2ba00700 1 --2- 172.21.15.57:0/2113694858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec240fb870 0x7fec240fbc80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.797+0000 7fec2ba00700 1 -- 172.21.15.57:0/2113694858 >> 172.21.15.57:0/2113694858 conn(0x7fec240f74e0 msgr2=0x7fec240f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.797+0000 7fec2ba00700 1 -- 172.21.15.57:0/2113694858 shutdown_connections 2024-02-28T16:07:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.798+0000 7fec2ba00700 1 -- 172.21.15.57:0/2113694858 wait complete. 2024-02-28T16:07:20.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.799+0000 7fec2ba00700 1 Processor -- start 2024-02-28T16:07:20.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.799+0000 7fec2ba00700 1 -- start start 2024-02-28T16:07:20.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.799+0000 7fec2ba00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec240fb870 0x7fec2410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:20.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.799+0000 7fec2ba00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec240fc1c0 0x7fec24110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:20.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.799+0000 7fec2ba00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec24110680 con 0x7fec240fb870 2024-02-28T16:07:20.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.799+0000 7fec2ba00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec24110f20 con 0x7fec240fc1c0 2024-02-28T16:07:20.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.799+0000 7fec29000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec240fb870 0x7fec2410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:20.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.800+0000 7fec29000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec240fb870 0x7fec2410fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49266/0 (socket says 172.21.15.57:49266) 2024-02-28T16:07:20.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.800+0000 7fec29000700 1 -- 172.21.15.57:0/908489520 learned_addr learned my addr 172.21.15.57:0/908489520 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:20.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.800+0000 7fec23e00700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec240fc1c0 0x7fec24110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:20.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.800+0000 7fec29000700 1 -- 172.21.15.57:0/908489520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec240fc1c0 msgr2=0x7fec24110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:20.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.800+0000 7fec29000700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec240fc1c0 0x7fec24110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:20.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.800+0000 7fec29000700 1 -- 172.21.15.57:0/908489520 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec18005040 con 0x7fec240fb870 2024-02-28T16:07:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.800+0000 7fec29000700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec240fb870 0x7fec2410fb40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec1800b3b0 tx=0x7fec18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.801+0000 7fec20c00700 1 -- 172.21.15.57:0/908489520 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1800e040 con 0x7fec240fb870 2024-02-28T16:07:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.801+0000 7fec2ba00700 1 -- 172.21.15.57:0/908489520 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec241111a0 con 0x7fec240fb870 2024-02-28T16:07:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.801+0000 7fec20c00700 1 -- 172.21.15.57:0/908489520 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec1800bd90 con 0x7fec240fb870 2024-02-28T16:07:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.801+0000 7fec20c00700 1 -- 172.21.15.57:0/908489520 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1801c630 con 0x7fec240fb870 2024-02-28T16:07:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.801+0000 7fec2ba00700 1 -- 172.21.15.57:0/908489520 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec241116e0 con 0x7fec240fb870 2024-02-28T16:07:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.802+0000 7fec2ba00700 1 -- 172.21.15.57:0/908489520 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2404bed0 con 0x7fec240fb870 2024-02-28T16:07:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.803+0000 7fec20c00700 1 -- 172.21.15.57:0/908489520 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fec180139f0 con 0x7fec240fb870 2024-02-28T16:07:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.804+0000 7fec20c00700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fec0c06d7f0 0x7fec0c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.804+0000 7fec20c00700 1 -- 172.21.15.57:0/908489520 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fec1808e3a0 con 0x7fec240fb870 2024-02-28T16:07:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.805+0000 7fec23e00700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fec0c06d7f0 0x7fec0c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:20.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.805+0000 7fec23e00700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fec0c06d7f0 0x7fec0c06fca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fec10004990 tx=0x7fec10009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:20.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:20.809+0000 7fec20c00700 1 -- 172.21.15.57:0/908489520 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fec1805b790 con 0x7fec240fb870 2024-02-28T16:07:20.906 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:20 smithi057 ceph-mon[93219]: pgmap v111: 65 pgs: 12 active+undersized, 13 active+undersized+degraded, 4 stale+active+clean, 36 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:07:20.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:20 smithi087 ceph-mon[82628]: pgmap v111: 65 pgs: 12 active+undersized, 13 active+undersized+degraded, 4 stale+active+clean, 36 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:07:21.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.064+0000 7fec2ba00700 1 -- 172.21.15.57:0/908489520 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec241055c0 con 0x7fec0c06d7f0 2024-02-28T16:07:21.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.066+0000 7fec20c00700 1 -- 172.21.15.57:0/908489520 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fec241055c0 con 0x7fec0c06d7f0 2024-02-28T16:07:21.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 -- 172.21.15.57:0/908489520 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fec0c06d7f0 msgr2=0x7fec0c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fec0c06d7f0 0x7fec0c06fca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fec10004990 tx=0x7fec10009ee0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 -- 172.21.15.57:0/908489520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec240fb870 msgr2=0x7fec2410fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec240fb870 0x7fec2410fb40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec1800b3b0 tx=0x7fec18009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 -- 172.21.15.57:0/908489520 shutdown_connections 2024-02-28T16:07:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fec0c06d7f0 0x7fec0c06fca0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec240fb870 0x7fec2410fb40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 --2- 172.21.15.57:0/908489520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec240fc1c0 0x7fec24110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 -- 172.21.15.57:0/908489520 >> 172.21.15.57:0/908489520 conn(0x7fec240f74e0 msgr2=0x7fec24103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 -- 172.21.15.57:0/908489520 shutdown_connections 2024-02-28T16:07:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.069+0000 7fec2ba00700 1 -- 172.21.15.57:0/908489520 wait complete. 2024-02-28T16:07:21.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.231+0000 7f1f85e00700 1 -- 172.21.15.57:0/1302288286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f80104750 msgr2=0x7f1f80104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:21.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.231+0000 7f1f85e00700 1 --2- 172.21.15.57:0/1302288286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f80104750 0x7f1f80104ba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c004940 tx=0x7f1f6c009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:21.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.231+0000 7f1f85e00700 1 -- 172.21.15.57:0/1302288286 shutdown_connections 2024-02-28T16:07:21.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.231+0000 7f1f85e00700 1 --2- 172.21.15.57:0/1302288286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f80104750 0x7f1f80104ba0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.231+0000 7f1f85e00700 1 --2- 172.21.15.57:0/1302288286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f80103540 0x7f1f80103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.231+0000 7f1f85e00700 1 -- 172.21.15.57:0/1302288286 >> 172.21.15.57:0/1302288286 conn(0x7f1f800727d0 msgr2=0x7f1f80074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:21.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.232+0000 7f1f85e00700 1 -- 172.21.15.57:0/1302288286 shutdown_connections 2024-02-28T16:07:21.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.232+0000 7f1f85e00700 1 -- 172.21.15.57:0/1302288286 wait complete. 2024-02-28T16:07:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.232+0000 7f1f85e00700 1 Processor -- start 2024-02-28T16:07:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.233+0000 7f1f85e00700 1 -- start start 2024-02-28T16:07:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.233+0000 7f1f85e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f80103540 0x7f1f80113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.233+0000 7f1f85e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f80104750 0x7f1f801144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.233+0000 7f1f85e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80114aa0 con 0x7f1f80104750 2024-02-28T16:07:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.233+0000 7f1f85e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80115340 con 0x7f1f80103540 2024-02-28T16:07:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.233+0000 7f1f7e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f80104750 0x7f1f801144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.233+0000 7f1f7e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f80104750 0x7f1f801144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49288/0 (socket says 172.21.15.57:49288) 2024-02-28T16:07:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.233+0000 7f1f7e000700 1 -- 172.21.15.57:0/2910641504 learned_addr learned my addr 172.21.15.57:0/2910641504 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.234+0000 7f1f7ea00700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f80103540 0x7f1f80113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.234+0000 7f1f7e000700 1 -- 172.21.15.57:0/2910641504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f80103540 msgr2=0x7f1f80113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.234+0000 7f1f7e000700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f80103540 0x7f1f80113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.234+0000 7f1f7e000700 1 -- 172.21.15.57:0/2910641504 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c005040 con 0x7f1f80104750 2024-02-28T16:07:21.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.234+0000 7f1f7e000700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f80104750 0x7f1f801144a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00b3b0 tx=0x7f1f6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:21.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.234+0000 7f1f76a00700 1 -- 172.21.15.57:0/2910641504 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f6c00e040 con 0x7f1f80104750 2024-02-28T16:07:21.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.235+0000 7f1f76a00700 1 -- 172.21.15.57:0/2910641504 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f6c00bd90 con 0x7f1f80104750 2024-02-28T16:07:21.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.235+0000 7f1f76a00700 1 -- 172.21.15.57:0/2910641504 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f6c01c630 con 0x7f1f80104750 2024-02-28T16:07:21.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.235+0000 7f1f85e00700 1 -- 172.21.15.57:0/2910641504 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f801155c0 con 0x7f1f80104750 2024-02-28T16:07:21.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.235+0000 7f1f85e00700 1 -- 172.21.15.57:0/2910641504 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f80115b00 con 0x7f1f80104750 2024-02-28T16:07:21.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.236+0000 7f1f85e00700 1 -- 172.21.15.57:0/2910641504 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8004bed0 con 0x7f1f80104750 2024-02-28T16:07:21.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.237+0000 7f1f76a00700 1 -- 172.21.15.57:0/2910641504 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1f6c0139f0 con 0x7f1f80104750 2024-02-28T16:07:21.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.238+0000 7f1f76a00700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f6406d7f0 0x7f1f6406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:21.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.238+0000 7f1f76a00700 1 -- 172.21.15.57:0/2910641504 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f1f6c08e460 con 0x7f1f80104750 2024-02-28T16:07:21.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.238+0000 7f1f7ea00700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f6406d7f0 0x7f1f6406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:21.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.239+0000 7f1f7ea00700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f6406d7f0 0x7f1f6406fca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009fd0 tx=0x7f1f70009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:21.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.243+0000 7f1f76a00700 1 -- 172.21.15.57:0/2910641504 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1f6c05b790 con 0x7f1f80104750 2024-02-28T16:07:21.534 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:21 smithi057 podman[107006]: 2024-02-28 16:07:21.244112488 +0000 UTC m=+0.727428774 container remove 02e0a56e2cd8f94534da76987dfdaf448de62b5ff6dc53a37be6026d9a747cf6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:07:21.534 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:21 smithi057 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-28T16:07:21.535 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:21 smithi057 systemd[1]: Stopped Ceph osd.1 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:07:21.535 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:21 smithi057 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.1.service: Consumed 1min 57.459s CPU time. 2024-02-28T16:07:21.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.540+0000 7f1f85e00700 1 -- 172.21.15.57:0/2910641504 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f80115fb0 con 0x7f1f6406d7f0 2024-02-28T16:07:21.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.560+0000 7f1f76a00700 1 -- 172.21.15.57:0/2910641504 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1f80115fb0 con 0x7f1f6406d7f0 2024-02-28T16:07:21.554 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:07:21.554 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (5m) 35s ago 16m 14.0M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:07:21.554 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (82s) 35s ago 16m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:07:21.554 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (75s) 70s ago 15m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:07:21.554 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (5m) 35s ago 16m 74.9M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:07:21.554 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (9m) 35s ago 9m 125M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:07:21.554 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (9m) 35s ago 9m 68.1M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:07:21.554 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (9m) 70s ago 9m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:07:21.554 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (9m) 70s ago 9m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (4m) 35s ago 18m 498M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (3m) 70s ago 15m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (3m) 35s ago 18m 44.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (2m) 70s ago 14m 35.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (5m) 35s ago 16m 7972k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (4m) 70s ago 15m 7852k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (43s) 35s ago 13m 11.2M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (13m) 35s ago 13m 234M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b82f9e9f2d5d 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (12m) 35s ago 12m 200M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (12m) 70s ago 12m 261M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:07:21.555 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (11m) 70s ago 11m 236M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:07:21.556 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (11m) 70s ago 11m 220M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:07:21.556 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (3m) 35s ago 15m 52.2M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:07:21.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 -- 172.21.15.57:0/2910641504 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f6406d7f0 msgr2=0x7f1f6406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:21.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f6406d7f0 0x7f1f6406fca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009fd0 tx=0x7f1f70009f00 comp rx=0 tx=0).stop 2024-02-28T16:07:21.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 -- 172.21.15.57:0/2910641504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f80104750 msgr2=0x7f1f801144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:21.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f80104750 0x7f1f801144a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00b3b0 tx=0x7f1f6c009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:21.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 -- 172.21.15.57:0/2910641504 shutdown_connections 2024-02-28T16:07:21.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f6406d7f0 0x7f1f6406fca0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f80103540 0x7f1f80113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 --2- 172.21.15.57:0/2910641504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f80104750 0x7f1f801144a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 -- 172.21.15.57:0/2910641504 >> 172.21.15.57:0/2910641504 conn(0x7f1f800727d0 msgr2=0x7f1f80107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:21.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 -- 172.21.15.57:0/2910641504 shutdown_connections 2024-02-28T16:07:21.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.563+0000 7f1f85e00700 1 -- 172.21.15.57:0/2910641504 wait complete. 2024-02-28T16:07:21.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.722+0000 7f1e37c00700 1 -- 172.21.15.57:0/544257561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e30071f10 msgr2=0x7f1e30070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:21.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.722+0000 7f1e37c00700 1 --2- 172.21.15.57:0/544257561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e30071f10 0x7f1e30070380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e24004940 tx=0x7f1e24009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:21.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.723+0000 7f1e37c00700 1 -- 172.21.15.57:0/544257561 shutdown_connections 2024-02-28T16:07:21.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.723+0000 7f1e37c00700 1 --2- 172.21.15.57:0/544257561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e300708c0 0x7f1e30070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.723+0000 7f1e37c00700 1 --2- 172.21.15.57:0/544257561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e30071f10 0x7f1e30070380 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.723+0000 7f1e37c00700 1 -- 172.21.15.57:0/544257561 >> 172.21.15.57:0/544257561 conn(0x7f1e300f8620 msgr2=0x7f1e300faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:21.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.723+0000 7f1e37c00700 1 -- 172.21.15.57:0/544257561 shutdown_connections 2024-02-28T16:07:21.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.723+0000 7f1e37c00700 1 -- 172.21.15.57:0/544257561 wait complete. 2024-02-28T16:07:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.723+0000 7f1e37c00700 1 Processor -- start 2024-02-28T16:07:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.724+0000 7f1e37c00700 1 -- start start 2024-02-28T16:07:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.724+0000 7f1e37c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e300708c0 0x7f1e3010fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.724+0000 7f1e37c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e30071f10 0x7f1e301100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.724+0000 7f1e37c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301106e0 con 0x7f1e30071f10 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.724+0000 7f1e37c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30110f80 con 0x7f1e300708c0 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.724+0000 7f1e2fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e30071f10 0x7f1e301100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.724+0000 7f1e2fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e30071f10 0x7f1e301100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49304/0 (socket says 172.21.15.57:49304) 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.724+0000 7f1e2fe00700 1 -- 172.21.15.57:0/2186249485 learned_addr learned my addr 172.21.15.57:0/2186249485 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.725+0000 7f1e35200700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e300708c0 0x7f1e3010fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.725+0000 7f1e2fe00700 1 -- 172.21.15.57:0/2186249485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e300708c0 msgr2=0x7f1e3010fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.725+0000 7f1e2fe00700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e300708c0 0x7f1e3010fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.725+0000 7f1e2fe00700 1 -- 172.21.15.57:0/2186249485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24005040 con 0x7f1e30071f10 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.725+0000 7f1e2fe00700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e30071f10 0x7f1e301100e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c8c0 tx=0x7f1e1c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.725+0000 7f1e2cc00700 1 -- 172.21.15.57:0/2186249485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e1c00a980 con 0x7f1e30071f10 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.725+0000 7f1e2cc00700 1 -- 172.21.15.57:0/2186249485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e1c00ce60 con 0x7f1e30071f10 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.725+0000 7f1e37c00700 1 -- 172.21.15.57:0/2186249485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e30111260 con 0x7f1e30071f10 2024-02-28T16:07:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.725+0000 7f1e2cc00700 1 -- 172.21.15.57:0/2186249485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e1c0115e0 con 0x7f1e30071f10 2024-02-28T16:07:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.726+0000 7f1e37c00700 1 -- 172.21.15.57:0/2186249485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e301117a0 con 0x7f1e30071f10 2024-02-28T16:07:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.727+0000 7f1e37c00700 1 -- 172.21.15.57:0/2186249485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3004bed0 con 0x7f1e30071f10 2024-02-28T16:07:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.728+0000 7f1e2cc00700 1 -- 172.21.15.57:0/2186249485 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1e1c012400 con 0x7f1e30071f10 2024-02-28T16:07:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.729+0000 7f1e2cc00700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e1806d7f0 0x7f1e1806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.729+0000 7f1e2cc00700 1 -- 172.21.15.57:0/2186249485 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f1e1c08d0f0 con 0x7f1e30071f10 2024-02-28T16:07:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.730+0000 7f1e35200700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e1806d7f0 0x7f1e1806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:21.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.731+0000 7f1e35200700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e1806d7f0 0x7f1e1806fca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e24004f90 tx=0x7f1e24009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:21.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:21.735+0000 7f1e2cc00700 1 -- 172.21.15.57:0/2186249485 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1e1c05a3a0 con 0x7f1e30071f10 2024-02-28T16:07:21.926 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:21 smithi057 systemd[1]: Starting Ceph osd.1 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:07:21.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:21 smithi057 ceph-mon[93219]: Health check failed: Degraded data redundancy: 44/333 objects degraded (13.213%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T16:07:21.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:21 smithi057 ceph-mon[93219]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:21.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:21 smithi057 ceph-mon[93219]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:21.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:21 smithi057 ceph-mon[93219]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:21.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:21 smithi087 ceph-mon[82628]: Health check failed: Degraded data redundancy: 44/333 objects degraded (13.213%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T16:07:21.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:21 smithi087 ceph-mon[82628]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:21.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:21 smithi087 ceph-mon[82628]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:21.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:21 smithi087 ceph-mon[82628]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.084+0000 7f1e37c00700 1 -- 172.21.15.57:0/2186249485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e30111b00 con 0x7f1e30071f10 2024-02-28T16:07:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.084+0000 7f1e2cc00700 1 -- 172.21.15.57:0/2186249485 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f1e1c0126b0 con 0x7f1e30071f10 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4, 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:07:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:07:22.079 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:07:22.079 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 8, 2024-02-28T16:07:22.079 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T16:07:22.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:07:22.079 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:07:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.087+0000 7f1e37c00700 1 -- 172.21.15.57:0/2186249485 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e1806d7f0 msgr2=0x7f1e1806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.087+0000 7f1e37c00700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e1806d7f0 0x7f1e1806fca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e24004f90 tx=0x7f1e24009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.087+0000 7f1e37c00700 1 -- 172.21.15.57:0/2186249485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e30071f10 msgr2=0x7f1e301100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.087+0000 7f1e37c00700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e30071f10 0x7f1e301100e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c8c0 tx=0x7f1e1c0044c0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.087+0000 7f1e37c00700 1 -- 172.21.15.57:0/2186249485 shutdown_connections 2024-02-28T16:07:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.087+0000 7f1e37c00700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e1806d7f0 0x7f1e1806fca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.087+0000 7f1e37c00700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e300708c0 0x7f1e3010fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.087+0000 7f1e37c00700 1 --2- 172.21.15.57:0/2186249485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e30071f10 0x7f1e301100e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.087+0000 7f1e37c00700 1 -- 172.21.15.57:0/2186249485 >> 172.21.15.57:0/2186249485 conn(0x7f1e300f8620 msgr2=0x7f1e30102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.088+0000 7f1e37c00700 1 -- 172.21.15.57:0/2186249485 shutdown_connections 2024-02-28T16:07:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.088+0000 7f1e37c00700 1 -- 172.21.15.57:0/2186249485 wait complete. 2024-02-28T16:07:22.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.231+0000 7fd0f7000700 1 -- 172.21.15.57:0/2799304766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0f01000c0 msgr2=0x7fd0f0102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:22.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.231+0000 7fd0f7000700 1 --2- 172.21.15.57:0/2799304766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0f01000c0 0x7fd0f0102520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc004940 tx=0x7fd0dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:22.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.231+0000 7fd0f7000700 1 -- 172.21.15.57:0/2799304766 shutdown_connections 2024-02-28T16:07:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.231+0000 7fd0f7000700 1 --2- 172.21.15.57:0/2799304766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0f01000c0 0x7fd0f0102520 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.231+0000 7fd0f7000700 1 --2- 172.21.15.57:0/2799304766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f00663e0 0x7fd0f00ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.231+0000 7fd0f7000700 1 -- 172.21.15.57:0/2799304766 >> 172.21.15.57:0/2799304766 conn(0x7fd0f00f74e0 msgr2=0x7fd0f00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.232+0000 7fd0f7000700 1 -- 172.21.15.57:0/2799304766 shutdown_connections 2024-02-28T16:07:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.232+0000 7fd0f7000700 1 -- 172.21.15.57:0/2799304766 wait complete. 2024-02-28T16:07:22.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.232+0000 7fd0f7000700 1 Processor -- start 2024-02-28T16:07:22.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.233+0000 7fd0f7000700 1 -- start start 2024-02-28T16:07:22.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.233+0000 7fd0f7000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f00663e0 0x7fd0f00fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:22.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.233+0000 7fd0f7000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0f01000c0 0x7fd0f00fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:22.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.233+0000 7fd0f7000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f00fbff0 con 0x7fd0f01000c0 2024-02-28T16:07:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.233+0000 7fd0f7000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f00fc160 con 0x7fd0f00663e0 2024-02-28T16:07:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.233+0000 7fd0ef400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0f01000c0 0x7fd0f00fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.233+0000 7fd0ef400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0f01000c0 0x7fd0f00fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59386/0 (socket says 172.21.15.57:59386) 2024-02-28T16:07:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.233+0000 7fd0ef400700 1 -- 172.21.15.57:0/521233040 learned_addr learned my addr 172.21.15.57:0/521233040 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.234+0000 7fd0ef400700 1 -- 172.21.15.57:0/521233040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f00663e0 msgr2=0x7fd0f00fd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.234+0000 7fd0ef400700 1 --2- 172.21.15.57:0/521233040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f00663e0 0x7fd0f00fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.234+0000 7fd0ef400700 1 -- 172.21.15.57:0/521233040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc005040 con 0x7fd0f01000c0 2024-02-28T16:07:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.234+0000 7fd0ef400700 1 --2- 172.21.15.57:0/521233040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0f01000c0 0x7fd0f00fb9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009360 tx=0x7fd0dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:22.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.234+0000 7fd0e7e00700 1 -- 172.21.15.57:0/521233040 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0dc00e040 con 0x7fd0f01000c0 2024-02-28T16:07:22.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.234+0000 7fd0e7e00700 1 -- 172.21.15.57:0/521233040 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0dc004290 con 0x7fd0f01000c0 2024-02-28T16:07:22.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.234+0000 7fd0e7e00700 1 -- 172.21.15.57:0/521233040 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0dc01c630 con 0x7fd0f01000c0 2024-02-28T16:07:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.234+0000 7fd0f7000700 1 -- 172.21.15.57:0/521233040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f00fc3e0 con 0x7fd0f01000c0 2024-02-28T16:07:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.235+0000 7fd0f7000700 1 -- 172.21.15.57:0/521233040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f01159a0 con 0x7fd0f01000c0 2024-02-28T16:07:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.236+0000 7fd0f7000700 1 -- 172.21.15.57:0/521233040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f004bed0 con 0x7fd0f01000c0 2024-02-28T16:07:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.237+0000 7fd0e7e00700 1 -- 172.21.15.57:0/521233040 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd0dc00bcc0 con 0x7fd0f01000c0 2024-02-28T16:07:22.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.238+0000 7fd0e7e00700 1 --2- 172.21.15.57:0/521233040 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0d406d7f0 0x7fd0d406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:22.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.238+0000 7fd0e7e00700 1 -- 172.21.15.57:0/521233040 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fd0dc08e390 con 0x7fd0f01000c0 2024-02-28T16:07:22.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.239+0000 7fd0efe00700 1 --2- 172.21.15.57:0/521233040 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0d406d7f0 0x7fd0d406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:22.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.239+0000 7fd0efe00700 1 --2- 172.21.15.57:0/521233040 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0d406d7f0 0x7fd0d406fca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00fd300 tx=0x7fd0e0007cc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:22.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.243+0000 7fd0e7e00700 1 -- 172.21.15.57:0/521233040 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd0dc05b6c0 con 0x7fd0f01000c0 2024-02-28T16:07:22.373 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:22 smithi057 podman[107174]: 2024-02-28 16:07:21.941242298 +0000 UTC m=+0.052339902 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:07:22.373 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:22 smithi057 podman[107174]: 2024-02-28 16:07:22.070498739 +0000 UTC m=+0.181596380 container create 28e27fc184b8f85e8de426bb6761bb516a2c6508e0d7710019e83e92e0b349c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:07:22.373 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:22 smithi057 podman[107174]: 2024-02-28 16:07:22.381108192 +0000 UTC m=+0.492205837 container init 28e27fc184b8f85e8de426bb6761bb516a2c6508e0d7710019e83e92e0b349c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-02-28T16:07:22.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.506+0000 7fd0f7000700 1 -- 172.21.15.57:0/521233040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd0f00fc570 con 0x7fd0f01000c0 2024-02-28T16:07:22.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.507+0000 7fd0e7e00700 1 -- 172.21.15.57:0/521233040 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1863 (secure 0 0 0) 0x7fd0f00fc570 con 0x7fd0f01000c0 2024-02-28T16:07:22.500 INFO:teuthology.orchestra.run.smithi057.stdout:e18 2024-02-28T16:07:22.500 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 18 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:06:28.521002+0000 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:07:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:07:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:07:22.503 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:07:22.504 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:07:22.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.509+0000 7fd0f7000700 1 -- 172.21.15.57:0/521233040 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0d406d7f0 msgr2=0x7fd0d406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:22.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.509+0000 7fd0f7000700 1 --2- 172.21.15.57:0/521233040 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0d406d7f0 0x7fd0d406fca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00fd300 tx=0x7fd0e0007cc0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.510+0000 7fd0f7000700 1 -- 172.21.15.57:0/521233040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0f01000c0 msgr2=0x7fd0f00fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:22.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.510+0000 7fd0f7000700 1 --2- 172.21.15.57:0/521233040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0f01000c0 0x7fd0f00fb9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009360 tx=0x7fd0dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:22.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.510+0000 7fd0f7000700 1 -- 172.21.15.57:0/521233040 shutdown_connections 2024-02-28T16:07:22.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.510+0000 7fd0f7000700 1 --2- 172.21.15.57:0/521233040 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0d406d7f0 0x7fd0d406fca0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.510+0000 7fd0f7000700 1 --2- 172.21.15.57:0/521233040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f00663e0 0x7fd0f00fd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.510+0000 7fd0f7000700 1 --2- 172.21.15.57:0/521233040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0f01000c0 0x7fd0f00fb9f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.510+0000 7fd0f7000700 1 -- 172.21.15.57:0/521233040 >> 172.21.15.57:0/521233040 conn(0x7fd0f00f74e0 msgr2=0x7fd0f00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.510+0000 7fd0f7000700 1 -- 172.21.15.57:0/521233040 shutdown_connections 2024-02-28T16:07:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.510+0000 7fd0f7000700 1 -- 172.21.15.57:0/521233040 wait complete. 2024-02-28T16:07:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-02-28T16:07:22.631 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:22 smithi057 podman[107174]: 2024-02-28 16:07:22.396187464 +0000 UTC m=+0.507285109 container start 28e27fc184b8f85e8de426bb6761bb516a2c6508e0d7710019e83e92e0b349c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10) 2024-02-28T16:07:22.631 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:22 smithi057 podman[107174]: 2024-02-28 16:07:22.498795516 +0000 UTC m=+0.609893197 container attach 28e27fc184b8f85e8de426bb6761bb516a2c6508e0d7710019e83e92e0b349c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-28T16:07:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.665+0000 7fadbb800700 1 -- 172.21.15.57:0/948919900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadb40fe0e0 msgr2=0x7fadb40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.665+0000 7fadbb800700 1 --2- 172.21.15.57:0/948919900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadb40fe0e0 0x7fadb40fe550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fada0004940 tx=0x7fada0009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.665+0000 7fadbb800700 1 -- 172.21.15.57:0/948919900 shutdown_connections 2024-02-28T16:07:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.665+0000 7fadbb800700 1 --2- 172.21.15.57:0/948919900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadb40fe0e0 0x7fadb40fe550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.665+0000 7fadbb800700 1 --2- 172.21.15.57:0/948919900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadb40fcef0 0x7fadb40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.665+0000 7fadbb800700 1 -- 172.21.15.57:0/948919900 >> 172.21.15.57:0/948919900 conn(0x7fadb40f8620 msgr2=0x7fadb40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.665+0000 7fadbb800700 1 -- 172.21.15.57:0/948919900 shutdown_connections 2024-02-28T16:07:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.665+0000 7fadbb800700 1 -- 172.21.15.57:0/948919900 wait complete. 2024-02-28T16:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.666+0000 7fadbb800700 1 Processor -- start 2024-02-28T16:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.666+0000 7fadbb800700 1 -- start start 2024-02-28T16:07:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.667+0000 7fadbb800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadb40fcef0 0x7fadb410fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.667+0000 7fadbb800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadb40fe0e0 0x7fadb41100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.667+0000 7fadbb800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb41106a0 con 0x7fadb40fe0e0 2024-02-28T16:07:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.667+0000 7fadbb800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb4110f40 con 0x7fadb40fcef0 2024-02-28T16:07:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.667+0000 7fadb3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadb40fe0e0 0x7fadb41100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.667+0000 7fadb3e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadb40fe0e0 0x7fadb41100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59408/0 (socket says 172.21.15.57:59408) 2024-02-28T16:07:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.667+0000 7fadb3e00700 1 -- 172.21.15.57:0/2717786741 learned_addr learned my addr 172.21.15.57:0/2717786741 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.668+0000 7fadb8e00700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadb40fcef0 0x7fadb410fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:22.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.668+0000 7fadb3e00700 1 -- 172.21.15.57:0/2717786741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadb40fcef0 msgr2=0x7fadb410fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:22.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.668+0000 7fadb3e00700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadb40fcef0 0x7fadb410fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.668+0000 7fadb3e00700 1 -- 172.21.15.57:0/2717786741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada0005040 con 0x7fadb40fe0e0 2024-02-28T16:07:22.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.668+0000 7fadb3e00700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadb40fe0e0 0x7fadb41100a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fada000b3b0 tx=0x7fada0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:22.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.668+0000 7fadb0c00700 1 -- 172.21.15.57:0/2717786741 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fada000e040 con 0x7fadb40fe0e0 2024-02-28T16:07:22.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.668+0000 7fadb0c00700 1 -- 172.21.15.57:0/2717786741 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fada000bd90 con 0x7fadb40fe0e0 2024-02-28T16:07:22.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.669+0000 7fadbb800700 1 -- 172.21.15.57:0/2717786741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb41111c0 con 0x7fadb40fe0e0 2024-02-28T16:07:22.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.669+0000 7fadb0c00700 1 -- 172.21.15.57:0/2717786741 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fada001c630 con 0x7fadb40fe0e0 2024-02-28T16:07:22.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.669+0000 7fadbb800700 1 -- 172.21.15.57:0/2717786741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb4111700 con 0x7fadb40fe0e0 2024-02-28T16:07:22.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.670+0000 7fadbb800700 1 -- 172.21.15.57:0/2717786741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb4102210 con 0x7fadb40fe0e0 2024-02-28T16:07:22.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.671+0000 7fadb0c00700 1 -- 172.21.15.57:0/2717786741 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fada00139f0 con 0x7fadb40fe0e0 2024-02-28T16:07:22.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.672+0000 7fadb0c00700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fad9c06d7f0 0x7fad9c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:22.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.672+0000 7fadb0c00700 1 -- 172.21.15.57:0/2717786741 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fada008e490 con 0x7fadb40fe0e0 2024-02-28T16:07:22.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.673+0000 7fadb8e00700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fad9c06d7f0 0x7fad9c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:22.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.673+0000 7fadb8e00700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fad9c06d7f0 0x7fad9c06fca0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fada8007fd0 tx=0x7fada8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.677+0000 7fadb0c00700 1 -- 172.21.15.57:0/2717786741 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fada005b7e0 con 0x7fadb40fe0e0 2024-02-28T16:07:22.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.922+0000 7fadbb800700 1 -- 172.21.15.57:0/2717786741 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadb4111a50 con 0x7fad9c06d7f0 2024-02-28T16:07:22.916 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:22 smithi057 ceph-mon[93219]: pgmap v112: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:22.916 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:22 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2186249485' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:07:22.916 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:22 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/521233040' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:07:22.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.925+0000 7fadb0c00700 1 -- 172.21.15.57:0/2717786741 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fadb4111a50 con 0x7fad9c06d7f0 2024-02-28T16:07:22.917 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:07:22.917 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "7/21 daemons upgraded", 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:07:22.918 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:07:22.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 -- 172.21.15.57:0/2717786741 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fad9c06d7f0 msgr2=0x7fad9c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:22.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fad9c06d7f0 0x7fad9c06fca0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fada8007fd0 tx=0x7fada8009040 comp rx=0 tx=0).stop 2024-02-28T16:07:22.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 -- 172.21.15.57:0/2717786741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadb40fe0e0 msgr2=0x7fadb41100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:22.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadb40fe0e0 0x7fadb41100a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fada000b3b0 tx=0x7fada0009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:22.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 -- 172.21.15.57:0/2717786741 shutdown_connections 2024-02-28T16:07:22.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fad9c06d7f0 0x7fad9c06fca0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadb40fcef0 0x7fadb410fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 --2- 172.21.15.57:0/2717786741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadb40fe0e0 0x7fadb41100a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 -- 172.21.15.57:0/2717786741 >> 172.21.15.57:0/2717786741 conn(0x7fadb40f8620 msgr2=0x7fadb40ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 -- 172.21.15.57:0/2717786741 shutdown_connections 2024-02-28T16:07:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:22.929+0000 7fadbb800700 1 -- 172.21.15.57:0/2717786741 wait complete. 2024-02-28T16:07:22.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:22 smithi087 ceph-mon[82628]: pgmap v112: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:22.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:22 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2186249485' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:07:22.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:22 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/521233040' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:07:23.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.078+0000 7f19b7c00700 1 -- 172.21.15.57:0/492942076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b0071f10 msgr2=0x7f19b0070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:23.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.078+0000 7f19b7c00700 1 --2- 172.21.15.57:0/492942076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b0071f10 0x7f19b0070380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f19a4004940 tx=0x7f19a4009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:23.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.079+0000 7f19b7c00700 1 -- 172.21.15.57:0/492942076 shutdown_connections 2024-02-28T16:07:23.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.079+0000 7f19b7c00700 1 --2- 172.21.15.57:0/492942076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19b00708c0 0x7f19b0070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:23.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.079+0000 7f19b7c00700 1 --2- 172.21.15.57:0/492942076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b0071f10 0x7f19b0070380 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:23.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.079+0000 7f19b7c00700 1 -- 172.21.15.57:0/492942076 >> 172.21.15.57:0/492942076 conn(0x7f19b00f8620 msgr2=0x7f19b00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:23.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.079+0000 7f19b7c00700 1 -- 172.21.15.57:0/492942076 shutdown_connections 2024-02-28T16:07:23.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.079+0000 7f19b7c00700 1 -- 172.21.15.57:0/492942076 wait complete. 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.080+0000 7f19b7c00700 1 Processor -- start 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.080+0000 7f19b7c00700 1 -- start start 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.080+0000 7f19b7c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b00708c0 0x7f19b010fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.080+0000 7f19b7c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19b0071f10 0x7f19b01100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.080+0000 7f19b7c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b01106e0 con 0x7f19b00708c0 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.080+0000 7f19b7c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0110f80 con 0x7f19b0071f10 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.080+0000 7f19b5200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b00708c0 0x7f19b010fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.080+0000 7f19b5200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b00708c0 0x7f19b010fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59430/0 (socket says 172.21.15.57:59430) 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.081+0000 7f19b5200700 1 -- 172.21.15.57:0/2918474650 learned_addr learned my addr 172.21.15.57:0/2918474650 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.081+0000 7f19afe00700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19b0071f10 0x7f19b01100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.081+0000 7f19b5200700 1 -- 172.21.15.57:0/2918474650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19b0071f10 msgr2=0x7f19b01100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.081+0000 7f19b5200700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19b0071f10 0x7f19b01100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:23.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.081+0000 7f19b5200700 1 -- 172.21.15.57:0/2918474650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4005040 con 0x7f19b00708c0 2024-02-28T16:07:23.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.081+0000 7f19afe00700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19b0071f10 0x7f19b01100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:07:23.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.081+0000 7f19b5200700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b00708c0 0x7f19b010fba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009fd0 tx=0x7f19a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:23.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.082+0000 7f19acc00700 1 -- 172.21.15.57:0/2918474650 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19a400e040 con 0x7f19b00708c0 2024-02-28T16:07:23.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.082+0000 7f19acc00700 1 -- 172.21.15.57:0/2918474650 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19a4004290 con 0x7f19b00708c0 2024-02-28T16:07:23.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.082+0000 7f19b7c00700 1 -- 172.21.15.57:0/2918474650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b0111200 con 0x7f19b00708c0 2024-02-28T16:07:23.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.082+0000 7f19acc00700 1 -- 172.21.15.57:0/2918474650 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19a401c630 con 0x7f19b00708c0 2024-02-28T16:07:23.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.082+0000 7f19b7c00700 1 -- 172.21.15.57:0/2918474650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b0111740 con 0x7f19b00708c0 2024-02-28T16:07:23.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.083+0000 7f19b7c00700 1 -- 172.21.15.57:0/2918474650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b004bed0 con 0x7f19b00708c0 2024-02-28T16:07:23.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.084+0000 7f19acc00700 1 -- 172.21.15.57:0/2918474650 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f19a400bc60 con 0x7f19b00708c0 2024-02-28T16:07:23.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.085+0000 7f19acc00700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f199806d7f0 0x7f199806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:23.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.085+0000 7f19acc00700 1 -- 172.21.15.57:0/2918474650 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f19a408edf0 con 0x7f19b00708c0 2024-02-28T16:07:23.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.086+0000 7f19afe00700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f199806d7f0 0x7f199806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:23.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.086+0000 7f19afe00700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f199806d7f0 0x7f199806fca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f199c009fd0 tx=0x7f199c009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:23.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.089+0000 7f19acc00700 1 -- 172.21.15.57:0/2918474650 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f19a405c1e0 con 0x7f19b00708c0 2024-02-28T16:07:23.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.392+0000 7f19b7c00700 1 -- 172.21.15.57:0/2918474650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f19b0107c10 con 0x7f19b00708c0 2024-02-28T16:07:23.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.394+0000 7f19acc00700 1 -- 172.21.15.57:0/2918474650 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1160 (secure 0 0 0) 0x7f19a405bd70 con 0x7f19b00708c0 2024-02-28T16:07:23.386 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 52/333 objects degraded (15.616%), 16 pgs degraded 2024-02-28T16:07:23.386 INFO:teuthology.orchestra.run.smithi057.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: osd.1 (root=default,host=smithi057) is down 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 52/333 objects degraded (15.616%), 16 pgs degraded 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.6 is active+undersized+degraded, acting [0,4] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.a is active+undersized+degraded, acting [4,0] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-02-28T16:07:23.387 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-02-28T16:07:23.388 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.15 is active+undersized+degraded, acting [2,0] 2024-02-28T16:07:23.388 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-02-28T16:07:23.388 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-02-28T16:07:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.396+0000 7f19b7c00700 1 -- 172.21.15.57:0/2918474650 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f199806d7f0 msgr2=0x7f199806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.396+0000 7f19b7c00700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f199806d7f0 0x7f199806fca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f199c009fd0 tx=0x7f199c009ee0 comp rx=0 tx=0).stop 2024-02-28T16:07:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.396+0000 7f19b7c00700 1 -- 172.21.15.57:0/2918474650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b00708c0 msgr2=0x7f19b010fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.396+0000 7f19b7c00700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b00708c0 0x7f19b010fba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009fd0 tx=0x7f19a4009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.396+0000 7f19b7c00700 1 -- 172.21.15.57:0/2918474650 shutdown_connections 2024-02-28T16:07:23.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.397+0000 7f19b7c00700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f199806d7f0 0x7f199806fca0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:23.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.397+0000 7f19b7c00700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b00708c0 0x7f19b010fba0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:23.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.397+0000 7f19b7c00700 1 --2- 172.21.15.57:0/2918474650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19b0071f10 0x7f19b01100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:23.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.397+0000 7f19b7c00700 1 -- 172.21.15.57:0/2918474650 >> 172.21.15.57:0/2918474650 conn(0x7f19b00f8620 msgr2=0x7f19b0102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:23.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.397+0000 7f19b7c00700 1 -- 172.21.15.57:0/2918474650 shutdown_connections 2024-02-28T16:07:23.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:23.397+0000 7f19b7c00700 1 -- 172.21.15.57:0/2918474650 wait complete. 2024-02-28T16:07:23.617 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate[107192]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:07:23.617 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate[107192]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 bash[107174]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 bash[107174]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 bash[107174]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 bash[107174]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 bash[107174]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 bash[107174]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 bash[107174]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate[107192]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate[107192]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate[107192]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate[107192]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate[107192]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-28T16:07:23.618 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 podman[107174]: 2024-02-28 16:07:23.263977344 +0000 UTC m=+1.375074989 container died 28e27fc184b8f85e8de426bb6761bb516a2c6508e0d7710019e83e92e0b349c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-28T16:07:23.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:23 smithi057 ceph-mon[93219]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:23.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:23 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2918474650' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:07:23.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:23 smithi087 ceph-mon[82628]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:23.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:23 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2918474650' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:07:24.302 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:23 smithi057 podman[107397]: 2024-02-28 16:07:23.961593073 +0000 UTC m=+0.678239806 container remove 28e27fc184b8f85e8de426bb6761bb516a2c6508e0d7710019e83e92e0b349c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=) 2024-02-28T16:07:24.646 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:24 smithi057 podman[107465]: 2024-02-28 16:07:24.217294424 +0000 UTC m=+0.036979277 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:07:24.646 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:24 smithi057 podman[107465]: 2024-02-28 16:07:24.496147051 +0000 UTC m=+0.315831939 container create 676452ac2f892b62cd53c5adf51475c92bca75e542461e676d834d21ca5e7de1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=) 2024-02-28T16:07:24.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:24 smithi057 ceph-mon[93219]: pgmap v113: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-02-28T16:07:24.927 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:24 smithi057 podman[107465]: 2024-02-28 16:07:24.75869594 +0000 UTC m=+0.578380831 container init 676452ac2f892b62cd53c5adf51475c92bca75e542461e676d834d21ca5e7de1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:07:24.927 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:24 smithi057 podman[107465]: 2024-02-28 16:07:24.770709647 +0000 UTC m=+0.590394561 container start 676452ac2f892b62cd53c5adf51475c92bca75e542461e676d834d21ca5e7de1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True) 2024-02-28T16:07:24.927 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:24 smithi057 ceph-osd[107483]: -- 172.21.15.57:0/1448610763 <== mon.0 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5581072fb680 con 0x5581072c4c00 2024-02-28T16:07:24.927 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:24 smithi057 bash[107465]: 676452ac2f892b62cd53c5adf51475c92bca75e542461e676d834d21ca5e7de1 2024-02-28T16:07:24.927 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:24 smithi057 systemd[1]: Started Ceph osd.1 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:07:24.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:24 smithi087 ceph-mon[82628]: pgmap v113: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-02-28T16:07:25.676 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:25 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1[107479]: 2024-02-28T16:07:25.343+0000 7f59513717c0 -1 Falling back to public interface 2024-02-28T16:07:26.287 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:26.287 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:26.287 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:07:26.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:26.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:26.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:07:27.410 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:27 smithi057 ceph-mon[93219]: pgmap v114: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:27.410 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:27 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 52/333 objects degraded (15.616%), 16 pgs degraded (PG_DEGRADED) 2024-02-28T16:07:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:27 smithi087 ceph-mon[82628]: pgmap v114: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:27 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 52/333 objects degraded (15.616%), 16 pgs degraded (PG_DEGRADED) 2024-02-28T16:07:29.379 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:29 smithi057 ceph-mon[93219]: pgmap v115: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:29.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:29 smithi087 ceph-mon[82628]: pgmap v115: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:30.838 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:30 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1[107479]: 2024-02-28T16:07:30.512+0000 7f59513717c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-28T16:07:31.103 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:31 smithi057 ceph-mon[93219]: pgmap v116: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:31.426 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:31 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1[107479]: 2024-02-28T16:07:31.110+0000 7f59513717c0 -1 osd.1 72 log_to_monitors true 2024-02-28T16:07:31.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:31 smithi087 ceph-mon[82628]: pgmap v116: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:32.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:32 smithi057 ceph-mon[93219]: from='osd.1 [v2:172.21.15.57:6810/1999906736,v1:172.21.15.57:6811/1999906736]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T16:07:32.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:32 smithi087 ceph-mon[82628]: from='osd.1 [v2:172.21.15.57:6810/1999906736,v1:172.21.15.57:6811/1999906736]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T16:07:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:33 smithi057 ceph-mon[93219]: pgmap v117: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:33 smithi057 ceph-mon[93219]: from='osd.1 [v2:172.21.15.57:6810/1999906736,v1:172.21.15.57:6811/1999906736]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T16:07:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:33 smithi057 ceph-mon[93219]: osdmap e75: 6 total, 5 up, 6 in 2024-02-28T16:07:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:33 smithi057 ceph-mon[93219]: from='osd.1 [v2:172.21.15.57:6810/1999906736,v1:172.21.15.57:6811/1999906736]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T16:07:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:33.427 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:07:33 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1[107479]: 2024-02-28T16:07:33.135+0000 7f593b600700 -1 osd.1 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:07:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:33 smithi087 ceph-mon[82628]: pgmap v117: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:33 smithi087 ceph-mon[82628]: from='osd.1 [v2:172.21.15.57:6810/1999906736,v1:172.21.15.57:6811/1999906736]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T16:07:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:33 smithi087 ceph-mon[82628]: osdmap e75: 6 total, 5 up, 6 in 2024-02-28T16:07:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:33 smithi087 ceph-mon[82628]: from='osd.1 [v2:172.21.15.57:6810/1999906736,v1:172.21.15.57:6811/1999906736]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T16:07:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:34.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:34 smithi057 ceph-mon[93219]: from='osd.1 [v2:172.21.15.57:6810/1999906736,v1:172.21.15.57:6811/1999906736]' entity='osd.1' 2024-02-28T16:07:34.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:34.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:07:34.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:34 smithi087 ceph-mon[82628]: from='osd.1 [v2:172.21.15.57:6810/1999906736,v1:172.21.15.57:6811/1999906736]' entity='osd.1' 2024-02-28T16:07:34.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:34.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:07:35.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:35 smithi057 ceph-mon[93219]: pgmap v119: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:35.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:35 smithi057 ceph-mon[93219]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:07:35.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:35 smithi057 ceph-mon[93219]: osd.1 [v2:172.21.15.57:6810/1999906736,v1:172.21.15.57:6811/1999906736] boot 2024-02-28T16:07:35.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:35 smithi057 ceph-mon[93219]: osdmap e76: 6 total, 6 up, 6 in 2024-02-28T16:07:35.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:07:35.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:35.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:35.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:35 smithi057 ceph-mon[93219]: osdmap e77: 6 total, 6 up, 6 in 2024-02-28T16:07:35.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:35 smithi087 ceph-mon[82628]: pgmap v119: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 52/333 objects degraded (15.616%) 2024-02-28T16:07:35.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:35 smithi087 ceph-mon[82628]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:07:35.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:35 smithi087 ceph-mon[82628]: osd.1 [v2:172.21.15.57:6810/1999906736,v1:172.21.15.57:6811/1999906736] boot 2024-02-28T16:07:35.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:35 smithi087 ceph-mon[82628]: osdmap e76: 6 total, 6 up, 6 in 2024-02-28T16:07:35.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:07:35.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:35.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:35.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:35 smithi087 ceph-mon[82628]: osdmap e77: 6 total, 6 up, 6 in 2024-02-28T16:07:36.453 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:36 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 22/333 objects degraded (6.607%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:07:36.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:36 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 22/333 objects degraded (6.607%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:07:37.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:37 smithi087 ceph-mon[82628]: pgmap v122: 65 pgs: 22 peering, 3 active+undersized, 7 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 22/333 objects degraded (6.607%) 2024-02-28T16:07:37.554 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:37 smithi057 ceph-mon[93219]: pgmap v122: 65 pgs: 22 peering, 3 active+undersized, 7 active+undersized+degraded, 33 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 22/333 objects degraded (6.607%) 2024-02-28T16:07:38.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:38 smithi057 ceph-mon[93219]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/333 objects degraded (6.607%), 7 pgs degraded) 2024-02-28T16:07:38.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:38 smithi057 ceph-mon[93219]: Cluster is now healthy 2024-02-28T16:07:38.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:38 smithi087 ceph-mon[82628]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/333 objects degraded (6.607%), 7 pgs degraded) 2024-02-28T16:07:38.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:38 smithi087 ceph-mon[82628]: Cluster is now healthy 2024-02-28T16:07:39.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:39 smithi057 ceph-mon[93219]: pgmap v123: 65 pgs: 22 peering, 43 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T16:07:39.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:39 smithi087 ceph-mon[82628]: pgmap v123: 65 pgs: 22 peering, 43 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T16:07:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: pgmap v124: 65 pgs: 3 peering, 62 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:07:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:07:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:07:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:07:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:07:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:07:41.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:07:41.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:07:41.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: pgmap v124: 65 pgs: 3 peering, 62 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:07:41.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:41.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:41.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:07:41.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:07:41.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:41.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:07:41.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:07:41.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:07:41.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:07:41.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:07:42.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:42 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:07:42.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:42 smithi057 ceph-mon[93219]: Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2024-02-28T16:07:42.616 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:42 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:07:42.616 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:42 smithi087 ceph-mon[82628]: Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2024-02-28T16:07:43.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:43 smithi057 ceph-mon[93219]: pgmap v125: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-28T16:07:43.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:43 smithi087 ceph-mon[82628]: pgmap v125: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-28T16:07:45.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:45 smithi057 ceph-mon[93219]: pgmap v126: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:45.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:45 smithi087 ceph-mon[82628]: pgmap v126: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:47.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:47 smithi057 ceph-mon[93219]: pgmap v127: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-28T16:07:47.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:47 smithi087 ceph-mon[82628]: pgmap v127: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-28T16:07:49.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:49 smithi057 ceph-mon[93219]: pgmap v128: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:07:49.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:49.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:07:49.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:49 smithi087 ceph-mon[82628]: pgmap v128: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:07:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:07:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:51.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:51 smithi087 ceph-mon[82628]: pgmap v129: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:07:51.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:51 smithi057 ceph-mon[93219]: pgmap v129: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:07:53.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.572+0000 7fac3d400700 1 -- 172.21.15.57:0/1670333323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac380fff00 msgr2=0x7fac38102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:53.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.572+0000 7fac3d400700 1 --2- 172.21.15.57:0/1670333323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac380fff00 0x7fac38102320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac24004940 tx=0x7fac24009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:53.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.572+0000 7fac3d400700 1 -- 172.21.15.57:0/1670333323 shutdown_connections 2024-02-28T16:07:53.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.572+0000 7fac3d400700 1 --2- 172.21.15.57:0/1670333323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac380fff00 0x7fac38102320 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:53.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.572+0000 7fac3d400700 1 --2- 172.21.15.57:0/1670333323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac380663a0 0x7fac380ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:53.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.572+0000 7fac3d400700 1 -- 172.21.15.57:0/1670333323 >> 172.21.15.57:0/1670333323 conn(0x7fac380f72c0 msgr2=0x7fac380f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.572+0000 7fac3d400700 1 -- 172.21.15.57:0/1670333323 shutdown_connections 2024-02-28T16:07:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.572+0000 7fac3d400700 1 -- 172.21.15.57:0/1670333323 wait complete. 2024-02-28T16:07:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.573+0000 7fac3d400700 1 Processor -- start 2024-02-28T16:07:53.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.573+0000 7fac3d400700 1 -- start start 2024-02-28T16:07:53.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.573+0000 7fac3d400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac380663a0 0x7fac380fd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:53.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.573+0000 7fac3d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac380fff00 0x7fac380fb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:53.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.573+0000 7fac3d400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac380fbe30 con 0x7fac380fff00 2024-02-28T16:07:53.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.573+0000 7fac3d400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac380fbfa0 con 0x7fac380663a0 2024-02-28T16:07:53.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.573+0000 7fac37400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac380fff00 0x7fac380fb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:53.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.573+0000 7fac37400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac380fff00 0x7fac380fb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51202/0 (socket says 172.21.15.57:51202) 2024-02-28T16:07:53.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.573+0000 7fac37400700 1 -- 172.21.15.57:0/257786084 learned_addr learned my addr 172.21.15.57:0/257786084 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:53.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.574+0000 7fac37e00700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac380663a0 0x7fac380fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:53.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.574+0000 7fac37400700 1 -- 172.21.15.57:0/257786084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac380663a0 msgr2=0x7fac380fd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:53.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.574+0000 7fac37400700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac380663a0 0x7fac380fd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:53.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.574+0000 7fac37400700 1 -- 172.21.15.57:0/257786084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24005040 con 0x7fac380fff00 2024-02-28T16:07:53.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.574+0000 7fac37400700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac380fff00 0x7fac380fb830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac24009360 tx=0x7fac24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:53.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.574+0000 7fac2fe00700 1 -- 172.21.15.57:0/257786084 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac2400e040 con 0x7fac380fff00 2024-02-28T16:07:53.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.575+0000 7fac2fe00700 1 -- 172.21.15.57:0/257786084 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac24004290 con 0x7fac380fff00 2024-02-28T16:07:53.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.575+0000 7fac2fe00700 1 -- 172.21.15.57:0/257786084 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac2401c630 con 0x7fac380fff00 2024-02-28T16:07:53.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.575+0000 7fac3d400700 1 -- 172.21.15.57:0/257786084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac380fc220 con 0x7fac380fff00 2024-02-28T16:07:53.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.575+0000 7fac3d400700 1 -- 172.21.15.57:0/257786084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac38115780 con 0x7fac380fff00 2024-02-28T16:07:53.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.576+0000 7fac3d400700 1 -- 172.21.15.57:0/257786084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3804bed0 con 0x7fac380fff00 2024-02-28T16:07:53.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.577+0000 7fac2fe00700 1 -- 172.21.15.57:0/257786084 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fac2400bcc0 con 0x7fac380fff00 2024-02-28T16:07:53.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.578+0000 7fac2fe00700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fac1c06d7f0 0x7fac1c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:53.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.578+0000 7fac2fe00700 1 -- 172.21.15.57:0/257786084 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fac2408e2a0 con 0x7fac380fff00 2024-02-28T16:07:53.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.578+0000 7fac37e00700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fac1c06d7f0 0x7fac1c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:53.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.579+0000 7fac37e00700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fac1c06d7f0 0x7fac1c06fca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fac380fd140 tx=0x7fac28009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:53.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.584+0000 7fac2fe00700 1 -- 172.21.15.57:0/257786084 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fac2405b690 con 0x7fac380fff00 2024-02-28T16:07:53.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:53 smithi087 ceph-mon[82628]: pgmap v130: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:53.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.830+0000 7fac3d400700 1 -- 172.21.15.57:0/257786084 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac38100b60 con 0x7fac1c06d7f0 2024-02-28T16:07:53.823 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:53 smithi057 ceph-mon[93219]: pgmap v130: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:53.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.833+0000 7fac2fe00700 1 -- 172.21.15.57:0/257786084 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fac38100b60 con 0x7fac1c06d7f0 2024-02-28T16:07:53.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.835+0000 7fac3d400700 1 -- 172.21.15.57:0/257786084 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fac1c06d7f0 msgr2=0x7fac1c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:53.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.835+0000 7fac3d400700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fac1c06d7f0 0x7fac1c06fca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fac380fd140 tx=0x7fac28009ee0 comp rx=0 tx=0).stop 2024-02-28T16:07:53.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.835+0000 7fac3d400700 1 -- 172.21.15.57:0/257786084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac380fff00 msgr2=0x7fac380fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:53.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.835+0000 7fac3d400700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac380fff00 0x7fac380fb830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac24009360 tx=0x7fac24009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:53.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.836+0000 7fac3d400700 1 -- 172.21.15.57:0/257786084 shutdown_connections 2024-02-28T16:07:53.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.836+0000 7fac3d400700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fac1c06d7f0 0x7fac1c06fca0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:53.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.836+0000 7fac3d400700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac380663a0 0x7fac380fd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:53.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.836+0000 7fac3d400700 1 --2- 172.21.15.57:0/257786084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac380fff00 0x7fac380fb830 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:53.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.836+0000 7fac3d400700 1 -- 172.21.15.57:0/257786084 >> 172.21.15.57:0/257786084 conn(0x7fac380f72c0 msgr2=0x7fac380f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:53.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.836+0000 7fac3d400700 1 -- 172.21.15.57:0/257786084 shutdown_connections 2024-02-28T16:07:53.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.836+0000 7fac3d400700 1 -- 172.21.15.57:0/257786084 wait complete. 2024-02-28T16:07:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:07:53.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.989+0000 7f796d600700 1 -- 172.21.15.57:0/2916451292 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795c00bcb0 con 0x7f79700fe0e0 2024-02-28T16:07:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.989+0000 7f7975800700 1 -- 172.21.15.57:0/2916451292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79700fe0e0 msgr2=0x7f79700fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.989+0000 7f7975800700 1 --2- 172.21.15.57:0/2916451292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79700fe0e0 0x7f79700fe550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f795c004940 tx=0x7f795c009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.989+0000 7f7975800700 1 -- 172.21.15.57:0/2916451292 shutdown_connections 2024-02-28T16:07:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.989+0000 7f7975800700 1 --2- 172.21.15.57:0/2916451292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79700fe0e0 0x7f79700fe550 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.989+0000 7f7975800700 1 --2- 172.21.15.57:0/2916451292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79700fcef0 0x7f79700fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.990+0000 7f7975800700 1 -- 172.21.15.57:0/2916451292 >> 172.21.15.57:0/2916451292 conn(0x7f79700f8620 msgr2=0x7f79700faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.990+0000 7f7975800700 1 -- 172.21.15.57:0/2916451292 shutdown_connections 2024-02-28T16:07:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.990+0000 7f7975800700 1 -- 172.21.15.57:0/2916451292 wait complete. 2024-02-28T16:07:53.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.991+0000 7f7975800700 1 Processor -- start 2024-02-28T16:07:53.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.991+0000 7f7975800700 1 -- start start 2024-02-28T16:07:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.991+0000 7f7975800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79700fcef0 0x7f797010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.991+0000 7f7975800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79700fe0e0 0x7f797010dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.991+0000 7f7975800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797010e4a0 con 0x7f79700fe0e0 2024-02-28T16:07:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.991+0000 7f7975800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797010ed40 con 0x7f79700fcef0 2024-02-28T16:07:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.991+0000 7f796e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79700fe0e0 0x7f797010dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.991+0000 7f796e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79700fe0e0 0x7f797010dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51216/0 (socket says 172.21.15.57:51216) 2024-02-28T16:07:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.991+0000 7f796e000700 1 -- 172.21.15.57:0/2438166272 learned_addr learned my addr 172.21.15.57:0/2438166272 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.992+0000 7f796ea00700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79700fcef0 0x7f797010d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.992+0000 7f796e000700 1 -- 172.21.15.57:0/2438166272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79700fcef0 msgr2=0x7f797010d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.992+0000 7f796e000700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79700fcef0 0x7f797010d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.992+0000 7f796e000700 1 -- 172.21.15.57:0/2438166272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c005040 con 0x7f79700fe0e0 2024-02-28T16:07:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.992+0000 7f796e000700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79700fe0e0 0x7f797010dea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f795c0093b0 tx=0x7f795c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.992+0000 7f7966a00700 1 -- 172.21.15.57:0/2438166272 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795c00e040 con 0x7f79700fe0e0 2024-02-28T16:07:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.993+0000 7f7966a00700 1 -- 172.21.15.57:0/2438166272 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f795c00bcc0 con 0x7f79700fe0e0 2024-02-28T16:07:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.993+0000 7f7966a00700 1 -- 172.21.15.57:0/2438166272 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795c01c630 con 0x7f79700fe0e0 2024-02-28T16:07:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.993+0000 7f7975800700 1 -- 172.21.15.57:0/2438166272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797010efc0 con 0x7f79700fe0e0 2024-02-28T16:07:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.993+0000 7f7975800700 1 -- 172.21.15.57:0/2438166272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797010f500 con 0x7f79700fe0e0 2024-02-28T16:07:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.994+0000 7f7975800700 1 -- 172.21.15.57:0/2438166272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797004bed0 con 0x7f79700fe0e0 2024-02-28T16:07:53.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.995+0000 7f7966a00700 1 -- 172.21.15.57:0/2438166272 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f795c0139f0 con 0x7f79700fe0e0 2024-02-28T16:07:53.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.996+0000 7f7966a00700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f795406d7e0 0x7f795406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:53.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.996+0000 7f7966a00700 1 -- 172.21.15.57:0/2438166272 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f795c08e370 con 0x7f79700fe0e0 2024-02-28T16:07:53.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.996+0000 7f796ea00700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f795406d7e0 0x7f795406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:53.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:53.997+0000 7f796ea00700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f795406d7e0 0x7f795406fc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7960009fd0 tx=0x7f7960009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:53.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.001+0000 7f7966a00700 1 -- 172.21.15.57:0/2438166272 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f795c05b6a0 con 0x7f79700fe0e0 2024-02-28T16:07:54.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.247+0000 7f7975800700 1 -- 172.21.15.57:0/2438166272 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7970102ac0 con 0x7f795406d7e0 2024-02-28T16:07:54.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.249+0000 7f7966a00700 1 -- 172.21.15.57:0/2438166272 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7970102ac0 con 0x7f795406d7e0 2024-02-28T16:07:54.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.251+0000 7f7975800700 1 -- 172.21.15.57:0/2438166272 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f795406d7e0 msgr2=0x7f795406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:54.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.251+0000 7f7975800700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f795406d7e0 0x7f795406fc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7960009fd0 tx=0x7f7960009f00 comp rx=0 tx=0).stop 2024-02-28T16:07:54.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.251+0000 7f7975800700 1 -- 172.21.15.57:0/2438166272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79700fe0e0 msgr2=0x7f797010dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:54.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.251+0000 7f7975800700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79700fe0e0 0x7f797010dea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f795c0093b0 tx=0x7f795c009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:54.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.252+0000 7f7975800700 1 -- 172.21.15.57:0/2438166272 shutdown_connections 2024-02-28T16:07:54.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.252+0000 7f7975800700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f795406d7e0 0x7f795406fc90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.252+0000 7f7975800700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79700fcef0 0x7f797010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.252+0000 7f7975800700 1 --2- 172.21.15.57:0/2438166272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79700fe0e0 0x7f797010dea0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.252+0000 7f7975800700 1 -- 172.21.15.57:0/2438166272 >> 172.21.15.57:0/2438166272 conn(0x7f79700f8620 msgr2=0x7f79701013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:54.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.252+0000 7f7975800700 1 -- 172.21.15.57:0/2438166272 shutdown_connections 2024-02-28T16:07:54.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.252+0000 7f7975800700 1 -- 172.21.15.57:0/2438166272 wait complete. 2024-02-28T16:07:54.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.406+0000 7fdce4800700 1 -- 172.21.15.57:0/550201711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc0fe0e0 msgr2=0x7fdcdc0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:54.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.406+0000 7fdce4800700 1 --2- 172.21.15.57:0/550201711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc0fe0e0 0x7fdcdc0fe550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdccc004940 tx=0x7fdccc009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:54.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.406+0000 7fdce4800700 1 -- 172.21.15.57:0/550201711 shutdown_connections 2024-02-28T16:07:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.406+0000 7fdce4800700 1 --2- 172.21.15.57:0/550201711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc0fe0e0 0x7fdcdc0fe550 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.406+0000 7fdce4800700 1 --2- 172.21.15.57:0/550201711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcdc0fcef0 0x7fdcdc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.406+0000 7fdce4800700 1 -- 172.21.15.57:0/550201711 >> 172.21.15.57:0/550201711 conn(0x7fdcdc0f8620 msgr2=0x7fdcdc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.407+0000 7fdce4800700 1 -- 172.21.15.57:0/550201711 shutdown_connections 2024-02-28T16:07:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.407+0000 7fdce4800700 1 -- 172.21.15.57:0/550201711 wait complete. 2024-02-28T16:07:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.408+0000 7fdce4800700 1 Processor -- start 2024-02-28T16:07:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.408+0000 7fdce4800700 1 -- start start 2024-02-28T16:07:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.408+0000 7fdce4800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc0fcef0 0x7fdcdc10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.408+0000 7fdce4800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcdc0fe0e0 0x7fdcdc10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.408+0000 7fdce4800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc10e430 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.408+0000 7fdce4800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc10ecd0 con 0x7fdcdc0fe0e0 2024-02-28T16:07:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.409+0000 7fdce1e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc0fcef0 0x7fdcdc10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.409+0000 7fdce1e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc0fcef0 0x7fdcdc10d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51244/0 (socket says 172.21.15.57:51244) 2024-02-28T16:07:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.409+0000 7fdce1e00700 1 -- 172.21.15.57:0/112272414 learned_addr learned my addr 172.21.15.57:0/112272414 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:54.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.409+0000 7fdce1400700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcdc0fe0e0 0x7fdcdc10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:54.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.409+0000 7fdce1e00700 1 -- 172.21.15.57:0/112272414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcdc0fe0e0 msgr2=0x7fdcdc10de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.409+0000 7fdce1e00700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcdc0fe0e0 0x7fdcdc10de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.409+0000 7fdce1e00700 1 -- 172.21.15.57:0/112272414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc005040 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.409+0000 7fdce1e00700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc0fcef0 0x7fdcdc10d8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000eb40 tx=0x7fdcd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.410+0000 7fdcd6000700 1 -- 172.21.15.57:0/112272414 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcd0007cc0 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.410+0000 7fdcd6000700 1 -- 172.21.15.57:0/112272414 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdcd000f040 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.410+0000 7fdcd6000700 1 -- 172.21.15.57:0/112272414 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcd000cb30 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.410+0000 7fdce4800700 1 -- 172.21.15.57:0/112272414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc10ef50 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.410+0000 7fdce4800700 1 -- 172.21.15.57:0/112272414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc10f490 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.411+0000 7fdce4800700 1 -- 172.21.15.57:0/112272414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc04bed0 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.412+0000 7fdcd6000700 1 -- 172.21.15.57:0/112272414 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fdcd000cc90 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.413+0000 7fdcd6000700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdcc406d7f0 0x7fdcc406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:54.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.413+0000 7fdcd6000700 1 -- 172.21.15.57:0/112272414 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fdcd008cb50 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.413+0000 7fdce1400700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdcc406d7f0 0x7fdcc406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.414+0000 7fdce1400700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdcc406d7f0 0x7fdcc406fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdccc004560 tx=0x7fdccc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:54.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.418+0000 7fdcd6000700 1 -- 172.21.15.57:0/112272414 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdcd0059e00 con 0x7fdcdc0fcef0 2024-02-28T16:07:54.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.655+0000 7fdce4800700 1 -- 172.21.15.57:0/112272414 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcdc102ac0 con 0x7fdcc406d7f0 2024-02-28T16:07:54.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.674+0000 7fdcd6000700 1 -- 172.21.15.57:0/112272414 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdcdc102ac0 con 0x7fdcc406d7f0 2024-02-28T16:07:54.666 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:07:54.666 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (6m) 22s ago 16m 14.1M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:07:54.666 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (116s) 22s ago 17m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:07:54.666 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (108s) 103s ago 15m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:07:54.666 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (5m) 22s ago 16m 74.9M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:07:54.666 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (9m) 22s ago 9m 125M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:07:54.666 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (9m) 22s ago 9m 68.1M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:07:54.666 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (9m) 103s ago 9m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:07:54.666 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (9m) 103s ago 9m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:07:54.666 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (5m) 22s ago 18m 500M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (3m) 103s ago 15m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (3m) 22s ago 18m 46.8M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (2m) 103s ago 15m 35.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (6m) 22s ago 17m 7960k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (5m) 103s ago 15m 7852k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (76s) 22s ago 14m 136M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (30s) 22s ago 13m 11.1M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (13m) 22s ago 13m 228M 1559M 17.2.7-535-gc0f02e60 1c37ed371348 b2bb5c4e1ea9 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (12m) 103s ago 12m 261M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (12m) 103s ago 12m 236M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (11m) 103s ago 11m 220M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:07:54.667 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (4m) 22s ago 16m 53.3M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:07:54.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 -- 172.21.15.57:0/112272414 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdcc406d7f0 msgr2=0x7fdcc406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:54.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdcc406d7f0 0x7fdcc406fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdccc004560 tx=0x7fdccc009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:54.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 -- 172.21.15.57:0/112272414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc0fcef0 msgr2=0x7fdcdc10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:54.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc0fcef0 0x7fdcdc10d8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000eb40 tx=0x7fdcd000b040 comp rx=0 tx=0).stop 2024-02-28T16:07:54.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 -- 172.21.15.57:0/112272414 shutdown_connections 2024-02-28T16:07:54.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdcc406d7f0 0x7fdcc406fca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc0fcef0 0x7fdcdc10d8f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 --2- 172.21.15.57:0/112272414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcdc0fe0e0 0x7fdcdc10de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 -- 172.21.15.57:0/112272414 >> 172.21.15.57:0/112272414 conn(0x7fdcdc0f8620 msgr2=0x7fdcdc1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:54.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 -- 172.21.15.57:0/112272414 shutdown_connections 2024-02-28T16:07:54.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.677+0000 7fdce4800700 1 -- 172.21.15.57:0/112272414 wait complete. 2024-02-28T16:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.818+0000 7f75f7e00700 1 -- 172.21.15.57:0/288059114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f0100380 msgr2=0x7f75f01007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.818+0000 7f75f7e00700 1 --2- 172.21.15.57:0/288059114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f0100380 0x7f75f01007d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f75dc004940 tx=0x7f75dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.818+0000 7f75f7e00700 1 -- 172.21.15.57:0/288059114 shutdown_connections 2024-02-28T16:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.818+0000 7f75f7e00700 1 --2- 172.21.15.57:0/288059114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f0100380 0x7f75f01007d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.818+0000 7f75f7e00700 1 --2- 172.21.15.57:0/288059114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75f00ff170 0x7f75f00ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.818+0000 7f75f7e00700 1 -- 172.21.15.57:0/288059114 >> 172.21.15.57:0/288059114 conn(0x7f75f00fa920 msgr2=0x7f75f00fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.818+0000 7f75f7e00700 1 -- 172.21.15.57:0/288059114 shutdown_connections 2024-02-28T16:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.818+0000 7f75f7e00700 1 -- 172.21.15.57:0/288059114 wait complete. 2024-02-28T16:07:54.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.819+0000 7f75f7e00700 1 Processor -- start 2024-02-28T16:07:54.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.819+0000 7f75f7e00700 1 -- start start 2024-02-28T16:07:54.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f00ff170 0x7f75f010fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:54.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f7e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75f0100380 0x7f75f0110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:54.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f7e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0110650 con 0x7f75f00ff170 2024-02-28T16:07:54.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f7e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0110ef0 con 0x7f75f0100380 2024-02-28T16:07:54.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f5400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f00ff170 0x7f75f010fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:54.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f5400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f00ff170 0x7f75f010fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51268/0 (socket says 172.21.15.57:51268) 2024-02-28T16:07:54.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f5400700 1 -- 172.21.15.57:0/2338894422 learned_addr learned my addr 172.21.15.57:0/2338894422 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:54.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f4a00700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75f0100380 0x7f75f0110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:54.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f5400700 1 -- 172.21.15.57:0/2338894422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75f0100380 msgr2=0x7f75f0110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:54.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f5400700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75f0100380 0x7f75f0110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:54.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.820+0000 7f75f5400700 1 -- 172.21.15.57:0/2338894422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc005040 con 0x7f75f00ff170 2024-02-28T16:07:54.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.821+0000 7f75f5400700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f00ff170 0x7f75f010fb10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f75e400eb70 tx=0x7f75e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:54.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.821+0000 7f75ed600700 1 -- 172.21.15.57:0/2338894422 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e4007cc0 con 0x7f75f00ff170 2024-02-28T16:07:54.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.821+0000 7f75ed600700 1 -- 172.21.15.57:0/2338894422 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75e400f040 con 0x7f75f00ff170 2024-02-28T16:07:54.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.821+0000 7f75ed600700 1 -- 172.21.15.57:0/2338894422 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e400cbd0 con 0x7f75f00ff170 2024-02-28T16:07:54.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.821+0000 7f75f7e00700 1 -- 172.21.15.57:0/2338894422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f0111170 con 0x7f75f00ff170 2024-02-28T16:07:54.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.821+0000 7f75f7e00700 1 -- 172.21.15.57:0/2338894422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f01116b0 con 0x7f75f00ff170 2024-02-28T16:07:54.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.822+0000 7f75f7e00700 1 -- 172.21.15.57:0/2338894422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f004bed0 con 0x7f75f00ff170 2024-02-28T16:07:54.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.824+0000 7f75ed600700 1 -- 172.21.15.57:0/2338894422 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f75e400cd30 con 0x7f75f00ff170 2024-02-28T16:07:54.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.825+0000 7f75ed600700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f75d806d7e0 0x7f75d806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:54.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.825+0000 7f75ed600700 1 -- 172.21.15.57:0/2338894422 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f75e408ca00 con 0x7f75f00ff170 2024-02-28T16:07:54.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.825+0000 7f75f4a00700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f75d806d7e0 0x7f75d806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:54.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.826+0000 7f75f4a00700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f75d806d7e0 0x7f75d806fc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f75dc000c00 tx=0x7f75dc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:54.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:54.829+0000 7f75ed600700 1 -- 172.21.15.57:0/2338894422 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f75e4059d60 con 0x7f75f00ff170 2024-02-28T16:07:55.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.132+0000 7f75f7e00700 1 -- 172.21.15.57:0/2338894422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f75f0116130 con 0x7f75f00ff170 2024-02-28T16:07:55.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.133+0000 7f75ed600700 1 -- 172.21.15.57:0/2338894422 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f75e40598f0 con 0x7f75f00ff170 2024-02-28T16:07:55.125 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4, 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:07:55.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:07:55.127 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:07:55.127 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 8, 2024-02-28T16:07:55.127 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:07:55.127 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:07:55.127 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:07:55.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.136+0000 7f75f7e00700 1 -- 172.21.15.57:0/2338894422 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f75d806d7e0 msgr2=0x7f75d806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:55.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.136+0000 7f75f7e00700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f75d806d7e0 0x7f75d806fc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f75dc000c00 tx=0x7f75dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:55.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.136+0000 7f75f7e00700 1 -- 172.21.15.57:0/2338894422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f00ff170 msgr2=0x7f75f010fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:55.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.136+0000 7f75f7e00700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f00ff170 0x7f75f010fb10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f75e400eb70 tx=0x7f75e400b040 comp rx=0 tx=0).stop 2024-02-28T16:07:55.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.136+0000 7f75f7e00700 1 -- 172.21.15.57:0/2338894422 shutdown_connections 2024-02-28T16:07:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.136+0000 7f75f7e00700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f75d806d7e0 0x7f75d806fc90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.136+0000 7f75f7e00700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f00ff170 0x7f75f010fb10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.136+0000 7f75f7e00700 1 --2- 172.21.15.57:0/2338894422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75f0100380 0x7f75f0110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.136+0000 7f75f7e00700 1 -- 172.21.15.57:0/2338894422 >> 172.21.15.57:0/2338894422 conn(0x7f75f00fa920 msgr2=0x7f75f01035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.137+0000 7f75f7e00700 1 -- 172.21.15.57:0/2338894422 shutdown_connections 2024-02-28T16:07:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.137+0000 7f75f7e00700 1 -- 172.21.15.57:0/2338894422 wait complete. 2024-02-28T16:07:55.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.293+0000 7f4218e00700 1 -- 172.21.15.57:0/859177339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42140fcef0 msgr2=0x7f42140fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.294+0000 7f4218e00700 1 --2- 172.21.15.57:0/859177339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42140fcef0 0x7f42140fd320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4204004940 tx=0x7f4204009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.294+0000 7f4218e00700 1 -- 172.21.15.57:0/859177339 shutdown_connections 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.294+0000 7f4218e00700 1 --2- 172.21.15.57:0/859177339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42140fe0e0 0x7f42140fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.294+0000 7f4218e00700 1 --2- 172.21.15.57:0/859177339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42140fcef0 0x7f42140fd320 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.294+0000 7f4218e00700 1 -- 172.21.15.57:0/859177339 >> 172.21.15.57:0/859177339 conn(0x7f42140f8620 msgr2=0x7f42140faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.294+0000 7f4218e00700 1 -- 172.21.15.57:0/859177339 shutdown_connections 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.294+0000 7f4218e00700 1 -- 172.21.15.57:0/859177339 wait complete. 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.295+0000 7f4218e00700 1 Processor -- start 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.295+0000 7f4218e00700 1 -- start start 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.295+0000 7f4218e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42140fcef0 0x7f421410fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.295+0000 7f4218e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42140fe0e0 0x7f42141100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.295+0000 7f4218e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42141106d0 con 0x7f42140fe0e0 2024-02-28T16:07:55.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.295+0000 7f4218e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4214110f70 con 0x7f42140fcef0 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.296+0000 7f4211400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42140fe0e0 0x7f42141100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.296+0000 7f4211400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42140fe0e0 0x7f42141100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51292/0 (socket says 172.21.15.57:51292) 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.296+0000 7f4211400700 1 -- 172.21.15.57:0/3321202968 learned_addr learned my addr 172.21.15.57:0/3321202968 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.296+0000 7f4211e00700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42140fcef0 0x7f421410fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.296+0000 7f4211400700 1 -- 172.21.15.57:0/3321202968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42140fcef0 msgr2=0x7f421410fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.296+0000 7f4211400700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42140fcef0 0x7f421410fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.296+0000 7f4211400700 1 -- 172.21.15.57:0/3321202968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204005040 con 0x7f42140fe0e0 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.296+0000 7f4211e00700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42140fcef0 0x7f421410fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.297+0000 7f4211400700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42140fe0e0 0x7f42141100d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4200002a50 tx=0x7f42000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.297+0000 7f420a000700 1 -- 172.21.15.57:0/3321202968 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4200007cc0 con 0x7f42140fe0e0 2024-02-28T16:07:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.297+0000 7f420a000700 1 -- 172.21.15.57:0/3321202968 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f420000f040 con 0x7f42140fe0e0 2024-02-28T16:07:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.297+0000 7f420a000700 1 -- 172.21.15.57:0/3321202968 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4200009640 con 0x7f42140fe0e0 2024-02-28T16:07:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.297+0000 7f4218e00700 1 -- 172.21.15.57:0/3321202968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4214111250 con 0x7f42140fe0e0 2024-02-28T16:07:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.297+0000 7f4218e00700 1 -- 172.21.15.57:0/3321202968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4214111790 con 0x7f42140fe0e0 2024-02-28T16:07:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.298+0000 7f4218e00700 1 -- 172.21.15.57:0/3321202968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4214102210 con 0x7f42140fe0e0 2024-02-28T16:07:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.299+0000 7f420a000700 1 -- 172.21.15.57:0/3321202968 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f42000097c0 con 0x7f42140fe0e0 2024-02-28T16:07:55.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.300+0000 7f420a000700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f41f806d7f0 0x7f41f806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:55.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.300+0000 7f420a000700 1 -- 172.21.15.57:0/3321202968 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f420008ccd0 con 0x7f42140fe0e0 2024-02-28T16:07:55.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.301+0000 7f4211e00700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f41f806d7f0 0x7f41f806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:55.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.301+0000 7f4211e00700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f41f806d7f0 0x7f41f806fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f420400b3b0 tx=0x7f4204009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:55.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.305+0000 7f420a000700 1 -- 172.21.15.57:0/3321202968 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4200059f80 con 0x7f42140fe0e0 2024-02-28T16:07:55.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.582+0000 7f4218e00700 1 -- 172.21.15.57:0/3321202968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f421404bed0 con 0x7f42140fe0e0 2024-02-28T16:07:55.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.583+0000 7f420a000700 1 -- 172.21.15.57:0/3321202968 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1863 (secure 0 0 0) 0x7f4200059b10 con 0x7f42140fe0e0 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout:e18 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 18 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:07:55.576 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:06:28.521002+0000 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:07:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:07:55.578 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:07:55.578 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:07:55.578 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:07:55.578 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:07:55.578 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:07:55.578 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:07:55.578 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:07:55.578 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:07:55.578 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:07:55.578 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:07:55.579 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:07:55.579 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:07:55.579 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:07:55.579 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:07:55.579 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:07:55.579 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:07:55.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 -- 172.21.15.57:0/3321202968 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f41f806d7f0 msgr2=0x7f41f806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:55.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f41f806d7f0 0x7f41f806fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f420400b3b0 tx=0x7f4204009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:55.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 -- 172.21.15.57:0/3321202968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42140fe0e0 msgr2=0x7f42141100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42140fe0e0 0x7f42141100d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4200002a50 tx=0x7f42000046b0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 -- 172.21.15.57:0/3321202968 shutdown_connections 2024-02-28T16:07:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f41f806d7f0 0x7f41f806fca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42140fcef0 0x7f421410fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 --2- 172.21.15.57:0/3321202968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42140fe0e0 0x7f42141100d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 -- 172.21.15.57:0/3321202968 >> 172.21.15.57:0/3321202968 conn(0x7f42140f8620 msgr2=0x7f42140ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 -- 172.21.15.57:0/3321202968 shutdown_connections 2024-02-28T16:07:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.587+0000 7f4218e00700 1 -- 172.21.15.57:0/3321202968 wait complete. 2024-02-28T16:07:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-02-28T16:07:55.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:55 smithi087 ceph-mon[82628]: pgmap v131: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:55.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:55 smithi087 ceph-mon[82628]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:55.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:55 smithi087 ceph-mon[82628]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:55.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:55 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2338894422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:07:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.728+0000 7fdcaea00700 1 -- 172.21.15.57:0/3272670674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80fe0e0 msgr2=0x7fdca80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.728+0000 7fdcaea00700 1 --2- 172.21.15.57:0/3272670674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80fe0e0 0x7fdca80fe550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc90004940 tx=0x7fdc90009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.728+0000 7fdcaea00700 1 -- 172.21.15.57:0/3272670674 shutdown_connections 2024-02-28T16:07:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.728+0000 7fdcaea00700 1 --2- 172.21.15.57:0/3272670674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80fe0e0 0x7fdca80fe550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.728+0000 7fdcaea00700 1 --2- 172.21.15.57:0/3272670674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdca80fcef0 0x7fdca80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.728+0000 7fdcaea00700 1 -- 172.21.15.57:0/3272670674 >> 172.21.15.57:0/3272670674 conn(0x7fdca80f8620 msgr2=0x7fdca80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.728+0000 7fdcaea00700 1 -- 172.21.15.57:0/3272670674 shutdown_connections 2024-02-28T16:07:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.728+0000 7fdcaea00700 1 -- 172.21.15.57:0/3272670674 wait complete. 2024-02-28T16:07:55.720 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:55 smithi057 ceph-mon[93219]: pgmap v131: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:55.720 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:55 smithi057 ceph-mon[93219]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:55.721 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:55 smithi057 ceph-mon[93219]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:55.721 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:55 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2338894422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:07:55.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.729+0000 7fdcaea00700 1 Processor -- start 2024-02-28T16:07:55.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.729+0000 7fdcaea00700 1 -- start start 2024-02-28T16:07:55.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.729+0000 7fdcaea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdca80fcef0 0x7fdca810fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:55.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.729+0000 7fdcaea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80fe0e0 0x7fdca81100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:55.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.729+0000 7fdcaea00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81106f0 con 0x7fdca80fe0e0 2024-02-28T16:07:55.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.729+0000 7fdcaea00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8110f90 con 0x7fdca80fcef0 2024-02-28T16:07:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.730+0000 7fdc9fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80fe0e0 0x7fdca81100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.730+0000 7fdc9fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80fe0e0 0x7fdca81100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51300/0 (socket says 172.21.15.57:51300) 2024-02-28T16:07:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.730+0000 7fdc9fe00700 1 -- 172.21.15.57:0/3194450733 learned_addr learned my addr 172.21.15.57:0/3194450733 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.730+0000 7fdca7e00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdca80fcef0 0x7fdca810fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.730+0000 7fdc9fe00700 1 -- 172.21.15.57:0/3194450733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdca80fcef0 msgr2=0x7fdca810fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.730+0000 7fdc9fe00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdca80fcef0 0x7fdca810fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.730+0000 7fdc9fe00700 1 -- 172.21.15.57:0/3194450733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc90005040 con 0x7fdca80fe0e0 2024-02-28T16:07:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.730+0000 7fdca7e00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdca80fcef0 0x7fdca810fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:07:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.731+0000 7fdc9fe00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80fe0e0 0x7fdca81100f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009fd0 tx=0x7fdc90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.731+0000 7fdca4c00700 1 -- 172.21.15.57:0/3194450733 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9000e040 con 0x7fdca80fe0e0 2024-02-28T16:07:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.731+0000 7fdca4c00700 1 -- 172.21.15.57:0/3194450733 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc9000bcc0 con 0x7fdca80fe0e0 2024-02-28T16:07:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.731+0000 7fdcaea00700 1 -- 172.21.15.57:0/3194450733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca8111210 con 0x7fdca80fe0e0 2024-02-28T16:07:55.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.731+0000 7fdca4c00700 1 -- 172.21.15.57:0/3194450733 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9001c630 con 0x7fdca80fe0e0 2024-02-28T16:07:55.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.731+0000 7fdcaea00700 1 -- 172.21.15.57:0/3194450733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca8111750 con 0x7fdca80fe0e0 2024-02-28T16:07:55.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.733+0000 7fdcaea00700 1 -- 172.21.15.57:0/3194450733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca8102210 con 0x7fdca80fe0e0 2024-02-28T16:07:55.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.734+0000 7fdca4c00700 1 -- 172.21.15.57:0/3194450733 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fdc90013980 con 0x7fdca80fe0e0 2024-02-28T16:07:55.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.735+0000 7fdca4c00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc8c06d7f0 0x7fdc8c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:55.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.735+0000 7fdca4c00700 1 -- 172.21.15.57:0/3194450733 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fdc9008e4a0 con 0x7fdca80fe0e0 2024-02-28T16:07:55.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.736+0000 7fdca7e00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc8c06d7f0 0x7fdc8c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:55.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.737+0000 7fdca7e00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc8c06d7f0 0x7fdc8c06fca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009fd0 tx=0x7fdc98009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.740+0000 7fdca4c00700 1 -- 172.21.15.57:0/3194450733 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdc9005b750 con 0x7fdca80fe0e0 2024-02-28T16:07:55.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.997+0000 7fdcaea00700 1 -- 172.21.15.57:0/3194450733 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdca802b3b0 con 0x7fdc8c06d7f0 2024-02-28T16:07:55.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:55.999+0000 7fdca4c00700 1 -- 172.21.15.57:0/3194450733 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdca802b3b0 con 0x7fdc8c06d7f0 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "8/21 daemons upgraded", 2024-02-28T16:07:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:07:55.992 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:07:55.992 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:07:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.001+0000 7fdcaea00700 1 -- 172.21.15.57:0/3194450733 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc8c06d7f0 msgr2=0x7fdc8c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.001+0000 7fdcaea00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc8c06d7f0 0x7fdc8c06fca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009fd0 tx=0x7fdc98009ee0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.001+0000 7fdcaea00700 1 -- 172.21.15.57:0/3194450733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80fe0e0 msgr2=0x7fdca81100f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.001+0000 7fdcaea00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80fe0e0 0x7fdca81100f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009fd0 tx=0x7fdc90009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.001+0000 7fdcaea00700 1 -- 172.21.15.57:0/3194450733 shutdown_connections 2024-02-28T16:07:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.001+0000 7fdcaea00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdc8c06d7f0 0x7fdc8c06fca0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.001+0000 7fdcaea00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdca80fcef0 0x7fdca810fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.001+0000 7fdcaea00700 1 --2- 172.21.15.57:0/3194450733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80fe0e0 0x7fdca81100f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.001+0000 7fdcaea00700 1 -- 172.21.15.57:0/3194450733 >> 172.21.15.57:0/3194450733 conn(0x7fdca80f8620 msgr2=0x7fdca80ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.002+0000 7fdcaea00700 1 -- 172.21.15.57:0/3194450733 shutdown_connections 2024-02-28T16:07:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.002+0000 7fdcaea00700 1 -- 172.21.15.57:0/3194450733 wait complete. 2024-02-28T16:07:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.155+0000 7fe616400700 1 -- 172.21.15.57:0/1149726028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6100fda80 msgr2=0x7fe6100ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.155+0000 7fe616400700 1 --2- 172.21.15.57:0/1149726028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6100fda80 0x7fe6100ffe60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe600004940 tx=0x7fe600009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.155+0000 7fe616400700 1 -- 172.21.15.57:0/1149726028 shutdown_connections 2024-02-28T16:07:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.155+0000 7fe616400700 1 --2- 172.21.15.57:0/1149726028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6101003a0 0x7fe610102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.155+0000 7fe616400700 1 --2- 172.21.15.57:0/1149726028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6100fda80 0x7fe6100ffe60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.155+0000 7fe616400700 1 -- 172.21.15.57:0/1149726028 >> 172.21.15.57:0/1149726028 conn(0x7fe6100f74e0 msgr2=0x7fe6100f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.156+0000 7fe616400700 1 -- 172.21.15.57:0/1149726028 shutdown_connections 2024-02-28T16:07:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.156+0000 7fe616400700 1 -- 172.21.15.57:0/1149726028 wait complete. 2024-02-28T16:07:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.157+0000 7fe616400700 1 Processor -- start 2024-02-28T16:07:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.157+0000 7fe616400700 1 -- start start 2024-02-28T16:07:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.157+0000 7fe616400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6100fda80 0x7fe61010d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.157+0000 7fe616400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6101003a0 0x7fe61010de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.158+0000 7fe616400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61010e470 con 0x7fe6100fda80 2024-02-28T16:07:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.158+0000 7fe616400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61010ed10 con 0x7fe6101003a0 2024-02-28T16:07:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.158+0000 7fe60f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6100fda80 0x7fe61010d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.158+0000 7fe60f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6100fda80 0x7fe61010d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51330/0 (socket says 172.21.15.57:51330) 2024-02-28T16:07:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.158+0000 7fe60f400700 1 -- 172.21.15.57:0/1049853141 learned_addr learned my addr 172.21.15.57:0/1049853141 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:07:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.158+0000 7fe60ea00700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6101003a0 0x7fe61010de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.158+0000 7fe60f400700 1 -- 172.21.15.57:0/1049853141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6101003a0 msgr2=0x7fe61010de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.158+0000 7fe60f400700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6101003a0 0x7fe61010de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.158+0000 7fe60f400700 1 -- 172.21.15.57:0/1049853141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600005040 con 0x7fe6100fda80 2024-02-28T16:07:56.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.159+0000 7fe60f400700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6100fda80 0x7fe61010d930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe600009fd0 tx=0x7fe600009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:56.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.159+0000 7fe607400700 1 -- 172.21.15.57:0/1049853141 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe60000e040 con 0x7fe6100fda80 2024-02-28T16:07:56.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.159+0000 7fe607400700 1 -- 172.21.15.57:0/1049853141 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe60000bcc0 con 0x7fe6100fda80 2024-02-28T16:07:56.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.159+0000 7fe607400700 1 -- 172.21.15.57:0/1049853141 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe60001c630 con 0x7fe6100fda80 2024-02-28T16:07:56.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.159+0000 7fe616400700 1 -- 172.21.15.57:0/1049853141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61010ef90 con 0x7fe6100fda80 2024-02-28T16:07:56.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.159+0000 7fe616400700 1 -- 172.21.15.57:0/1049853141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61010f4d0 con 0x7fe6100fda80 2024-02-28T16:07:56.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.160+0000 7fe616400700 1 -- 172.21.15.57:0/1049853141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61004bed0 con 0x7fe6100fda80 2024-02-28T16:07:56.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.161+0000 7fe607400700 1 -- 172.21.15.57:0/1049853141 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe600013980 con 0x7fe6100fda80 2024-02-28T16:07:56.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.163+0000 7fe607400700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe5f406d7f0 0x7fe5f406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:07:56.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.163+0000 7fe607400700 1 -- 172.21.15.57:0/1049853141 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fe60008e330 con 0x7fe6100fda80 2024-02-28T16:07:56.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.163+0000 7fe60ea00700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe5f406d7f0 0x7fe5f406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:07:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.164+0000 7fe60ea00700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe5f406d7f0 0x7fe5f406fca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc004c40 tx=0x7fe5fc009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:07:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.167+0000 7fe607400700 1 -- 172.21.15.57:0/1049853141 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe60005b720 con 0x7fe6100fda80 2024-02-28T16:07:56.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.486+0000 7fe616400700 1 -- 172.21.15.57:0/1049853141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe610105a10 con 0x7fe6100fda80 2024-02-28T16:07:56.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.486+0000 7fe607400700 1 -- 172.21.15.57:0/1049853141 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe60005b2b0 con 0x7fe6100fda80 2024-02-28T16:07:56.478 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:07:56.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 -- 172.21.15.57:0/1049853141 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe5f406d7f0 msgr2=0x7fe5f406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:56.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe5f406d7f0 0x7fe5f406fca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc004c40 tx=0x7fe5fc009040 comp rx=0 tx=0).stop 2024-02-28T16:07:56.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 -- 172.21.15.57:0/1049853141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6100fda80 msgr2=0x7fe61010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:07:56.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6100fda80 0x7fe61010d930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe600009fd0 tx=0x7fe600009e30 comp rx=0 tx=0).stop 2024-02-28T16:07:56.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 -- 172.21.15.57:0/1049853141 shutdown_connections 2024-02-28T16:07:56.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe5f406d7f0 0x7fe5f406fca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:56.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6100fda80 0x7fe61010d930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:56.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 --2- 172.21.15.57:0/1049853141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6101003a0 0x7fe61010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:07:56.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 -- 172.21.15.57:0/1049853141 >> 172.21.15.57:0/1049853141 conn(0x7fe6100f74e0 msgr2=0x7fe6100f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:07:56.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 -- 172.21.15.57:0/1049853141 shutdown_connections 2024-02-28T16:07:56.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:07:56.489+0000 7fe616400700 1 -- 172.21.15.57:0/1049853141 wait complete. 2024-02-28T16:07:56.713 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:56 smithi057 ceph-mon[93219]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:56.713 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:56 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3321202968' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:07:56.713 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:07:56.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:56 smithi087 ceph-mon[82628]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:56.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:56 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3321202968' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:07:56.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:07:57.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:57 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:07:57.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:57 smithi087 ceph-mon[82628]: Upgrade: osd.2 is safe to restart 2024-02-28T16:07:57.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:57 smithi087 ceph-mon[82628]: pgmap v132: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:07:57.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:57 smithi087 ceph-mon[82628]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:57.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:57 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1049853141' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:07:57.900 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:57 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:07:57.900 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:57 smithi057 ceph-mon[93219]: Upgrade: osd.2 is safe to restart 2024-02-28T16:07:57.900 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:57 smithi057 ceph-mon[93219]: pgmap v132: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:07:57.900 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:57 smithi057 ceph-mon[93219]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:07:57.900 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:57 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1049853141' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:07:59.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:59 smithi057 ceph-mon[93219]: pgmap v133: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:59.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:59 smithi057 ceph-mon[93219]: Upgrade: Updating osd.2 2024-02-28T16:07:59.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:59 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:59.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:59 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:07:59.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:59 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:07:59.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:07:59 smithi057 ceph-mon[93219]: Deploying daemon osd.2 on smithi057 2024-02-28T16:07:59.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:59 smithi087 ceph-mon[82628]: pgmap v133: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:07:59.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:59 smithi087 ceph-mon[82628]: Upgrade: Updating osd.2 2024-02-28T16:07:59.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:59 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:07:59.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:59 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:07:59.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:59 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:07:59.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:07:59 smithi087 ceph-mon[82628]: Deploying daemon osd.2 on smithi057 2024-02-28T16:08:01.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:01 smithi057 ceph-mon[93219]: pgmap v134: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:08:01.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:01 smithi087 ceph-mon[82628]: pgmap v134: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:08:03.177 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:02 smithi057 systemd[1]: Stopping Ceph osd.2 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:08:03.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:03 smithi087 ceph-mon[82628]: pgmap v135: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:08:03.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:03 smithi057 ceph-mon[93219]: pgmap v135: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:08:03.927 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:03 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2[61755]: 2024-02-28T16:08:03.449+0000 7f48ba200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:08:03.927 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:03 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2[61755]: 2024-02-28T16:08:03.449+0000 7f48ba200700 -1 osd.2 77 *** Got signal Terminated *** 2024-02-28T16:08:03.927 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:03 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2[61755]: 2024-02-28T16:08:03.449+0000 7f48ba200700 -1 osd.2 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:08:04.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:04 smithi087 ceph-mon[82628]: osd.2 marked itself down and dead 2024-02-28T16:08:04.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:08:04.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:04 smithi057 ceph-mon[93219]: osd.2 marked itself down and dead 2024-02-28T16:08:04.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:08:05.307 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:05 smithi057 podman[112576]: 2024-02-28 16:08:05.025546316 +0000 UTC m=+1.764028704 container died b2bb5c4e1ea9f9ac1d60d9702507b5abaa58b994ceab7c49ae55a9b36bb3129b (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c0f02e6, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-02-28T16:08:05.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:05 smithi057 ceph-mon[93219]: pgmap v136: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:08:05.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:05 smithi057 ceph-mon[93219]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:08:05.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:05 smithi057 ceph-mon[93219]: osdmap e78: 6 total, 5 up, 6 in 2024-02-28T16:08:05.678 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:05 smithi057 podman[112576]: 2024-02-28 16:08:05.491354536 +0000 UTC m=+2.229836920 container cleanup b2bb5c4e1ea9f9ac1d60d9702507b5abaa58b994ceab7c49ae55a9b36bb3129b (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=quincy-c0f02e6, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-02-28T16:08:05.678 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:05 smithi057 bash[112576]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2 2024-02-28T16:08:05.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:05 smithi087 ceph-mon[82628]: pgmap v136: 65 pgs: 65 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:08:05.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:05 smithi087 ceph-mon[82628]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:08:05.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:05 smithi087 ceph-mon[82628]: osdmap e78: 6 total, 5 up, 6 in 2024-02-28T16:08:06.177 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:05 smithi057 podman[112595]: 2024-02-28 16:08:05.734630686 +0000 UTC m=+0.698340059 container remove b2bb5c4e1ea9f9ac1d60d9702507b5abaa58b994ceab7c49ae55a9b36bb3129b (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, RELEASE=quincy-c0f02e6, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-28T16:08:06.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:06 smithi087 ceph-mon[82628]: osdmap e79: 6 total, 5 up, 6 in 2024-02-28T16:08:06.744 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:06 smithi057 ceph-mon[93219]: osdmap e79: 6 total, 5 up, 6 in 2024-02-28T16:08:06.745 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:06 smithi057 podman[112683]: 2024-02-28 16:08:06.457795246 +0000 UTC m=+0.035560480 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:08:06.745 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:06 smithi057 podman[112683]: 2024-02-28 16:08:06.585235661 +0000 UTC m=+0.163000895 container create 437f62daf5a16156b30d9bceb024200e9f9c214400267d41db07fcba4eb51367 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=main-1fb5d10) 2024-02-28T16:08:07.177 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:06 smithi057 podman[112683]: 2024-02-28 16:08:06.881344272 +0000 UTC m=+0.459109539 container init 437f62daf5a16156b30d9bceb024200e9f9c214400267d41db07fcba4eb51367 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=main-1fb5d10, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:08:07.177 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:06 smithi057 podman[112683]: 2024-02-28 16:08:06.893538679 +0000 UTC m=+0.471303946 container start 437f62daf5a16156b30d9bceb024200e9f9c214400267d41db07fcba4eb51367 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-28T16:08:07.178 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:06 smithi057 podman[112683]: 2024-02-28 16:08:06.971748773 +0000 UTC m=+0.549514077 container attach 437f62daf5a16156b30d9bceb024200e9f9c214400267d41db07fcba4eb51367 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-02-28T16:08:07.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:07 smithi057 ceph-mon[93219]: pgmap v139: 65 pgs: 22 peering, 4 stale+active+clean, 39 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:08:07.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:07 smithi057 ceph-mon[93219]: Health check failed: Reduced data availability: 1 pg inactive, 6 pgs peering (PG_AVAILABILITY) 2024-02-28T16:08:07.677 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:07 smithi057 podman[112709]: 2024-02-28 16:08:07.39920466 +0000 UTC m=+0.036058567 container died 437f62daf5a16156b30d9bceb024200e9f9c214400267d41db07fcba4eb51367 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-28T16:08:07.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:07 smithi087 ceph-mon[82628]: pgmap v139: 65 pgs: 22 peering, 4 stale+active+clean, 39 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:08:07.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:07 smithi087 ceph-mon[82628]: Health check failed: Reduced data availability: 1 pg inactive, 6 pgs peering (PG_AVAILABILITY) 2024-02-28T16:08:08.427 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:08 smithi057 podman[112709]: 2024-02-28 16:08:08.151012938 +0000 UTC m=+0.787866899 container remove 437f62daf5a16156b30d9bceb024200e9f9c214400267d41db07fcba4eb51367 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-28T16:08:08.427 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:08 smithi057 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-28T16:08:08.427 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:08 smithi057 systemd[1]: Stopped Ceph osd.2 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:08:08.427 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:08 smithi057 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.2.service: Consumed 1min 39.427s CPU time. 2024-02-28T16:08:08.924 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:08 smithi057 ceph-mon[93219]: Health check failed: Degraded data redundancy: 17/333 objects degraded (5.105%), 4 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:08.925 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:08 smithi057 systemd[1]: Starting Ceph osd.2 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:08:08.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:08 smithi087 ceph-mon[82628]: Health check failed: Degraded data redundancy: 17/333 objects degraded (5.105%), 4 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:09.177 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:08 smithi057 podman[112812]: 2024-02-28 16:08:08.838499785 +0000 UTC m=+0.037158926 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:08:09.177 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:08 smithi057 podman[112812]: 2024-02-28 16:08:08.985720452 +0000 UTC m=+0.184379630 container create 4fc9dbcfd9dbfe6b9151eb37b328b391d0c0235b64b0a5cd39c75c550f156e3b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-28T16:08:09.523 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:09 smithi057 podman[112812]: 2024-02-28 16:08:09.273204607 +0000 UTC m=+0.471863792 container init 4fc9dbcfd9dbfe6b9151eb37b328b391d0c0235b64b0a5cd39c75c550f156e3b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:08:09.523 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:09 smithi057 podman[112812]: 2024-02-28 16:08:09.285963051 +0000 UTC m=+0.484622235 container start 4fc9dbcfd9dbfe6b9151eb37b328b391d0c0235b64b0a5cd39c75c550f156e3b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-28T16:08:09.524 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:09 smithi057 podman[112812]: 2024-02-28 16:08:09.371803517 +0000 UTC m=+0.570462742 container attach 4fc9dbcfd9dbfe6b9151eb37b328b391d0c0235b64b0a5cd39c75c550f156e3b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:08:09.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:09 smithi057 ceph-mon[93219]: pgmap v140: 65 pgs: 3 active+undersized, 4 active+undersized+degraded, 22 peering, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 17/333 objects degraded (5.105%) 2024-02-28T16:08:09.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:09 smithi087 ceph-mon[82628]: pgmap v140: 65 pgs: 3 active+undersized, 4 active+undersized+degraded, 22 peering, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 17/333 objects degraded (5.105%) 2024-02-28T16:08:10.428 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate[112827]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:08:10.428 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate[112827]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:08:10.428 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 bash[112812]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:08:10.428 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 bash[112812]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 bash[112812]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 bash[112812]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 bash[112812]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 bash[112812]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 bash[112812]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate[112827]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate[112827]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate[112827]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate[112827]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate[112827]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-28T16:08:10.429 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:10 smithi057 podman[112812]: 2024-02-28 16:08:10.217553145 +0000 UTC m=+1.416212303 container died 4fc9dbcfd9dbfe6b9151eb37b328b391d0c0235b64b0a5cd39c75c550f156e3b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10) 2024-02-28T16:08:11.176 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:11 smithi057 podman[112961]: 2024-02-28 16:08:11.060291986 +0000 UTC m=+0.820261313 container remove 4fc9dbcfd9dbfe6b9151eb37b328b391d0c0235b64b0a5cd39c75c550f156e3b (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-28T16:08:11.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:11 smithi057 ceph-mon[93219]: pgmap v141: 65 pgs: 10 active+undersized, 9 active+undersized+degraded, 10 peering, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 32/333 objects degraded (9.610%) 2024-02-28T16:08:11.677 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:11 smithi057 podman[113023]: 2024-02-28 16:08:11.323008952 +0000 UTC m=+0.034603784 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:08:11.677 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:11 smithi057 podman[113023]: 2024-02-28 16:08:11.461303335 +0000 UTC m=+0.172898197 container create bb9a6a24a249a2f31f4cc1522c5cdb48dd8473bb77abe458d60864d977f63802 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:08:11.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:11 smithi087 ceph-mon[82628]: pgmap v141: 65 pgs: 10 active+undersized, 9 active+undersized+degraded, 10 peering, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 32/333 objects degraded (9.610%) 2024-02-28T16:08:12.416 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:11 smithi057 podman[113023]: 2024-02-28 16:08:11.940709672 +0000 UTC m=+0.652304580 container init bb9a6a24a249a2f31f4cc1522c5cdb48dd8473bb77abe458d60864d977f63802 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-02-28T16:08:12.416 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:11 smithi057 podman[113023]: 2024-02-28 16:08:11.951800237 +0000 UTC m=+0.663395106 container start bb9a6a24a249a2f31f4cc1522c5cdb48dd8473bb77abe458d60864d977f63802 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-28T16:08:12.416 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:11 smithi057 ceph-osd[113041]: -- 172.21.15.57:0/4123562596 <== mon.0 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c4b20eb680 con 0x55c4b20b5000 2024-02-28T16:08:12.417 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:12 smithi057 bash[113023]: bb9a6a24a249a2f31f4cc1522c5cdb48dd8473bb77abe458d60864d977f63802 2024-02-28T16:08:12.417 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:12 smithi057 systemd[1]: Started Ceph osd.2 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:08:12.676 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:12 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2[113037]: 2024-02-28T16:08:12.521+0000 7f209da697c0 -1 Falling back to public interface 2024-02-28T16:08:13.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:13 smithi057 ceph-mon[93219]: pgmap v142: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 44/333 objects degraded (13.213%) 2024-02-28T16:08:13.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:13.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:13.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:08:13.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:13 smithi057 ceph-mon[93219]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-28T16:08:13.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:13 smithi087 ceph-mon[82628]: pgmap v142: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 44/333 objects degraded (13.213%) 2024-02-28T16:08:13.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:13.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:13.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:08:13.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:13 smithi087 ceph-mon[82628]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-28T16:08:15.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:15 smithi057 ceph-mon[93219]: pgmap v143: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 44/333 objects degraded (13.213%) 2024-02-28T16:08:15.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:15 smithi087 ceph-mon[82628]: pgmap v143: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 44/333 objects degraded (13.213%) 2024-02-28T16:08:17.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:17 smithi057 ceph-mon[93219]: pgmap v144: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:08:17.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:17 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 44/333 objects degraded (13.213%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:17.427 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:17 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2[113037]: 2024-02-28T16:08:17.112+0000 7f209da697c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-28T16:08:17.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:17 smithi087 ceph-mon[82628]: pgmap v144: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:08:17.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:17 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 44/333 objects degraded (13.213%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:17.928 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:17 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2[113037]: 2024-02-28T16:08:17.665+0000 7f209da697c0 -1 osd.2 77 log_to_monitors true 2024-02-28T16:08:18.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:18 smithi087 ceph-mon[82628]: from='osd.2 [v2:172.21.15.57:6818/3549211468,v1:172.21.15.57:6819/3549211468]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T16:08:18.639 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:18 smithi057 ceph-mon[93219]: from='osd.2 [v2:172.21.15.57:6818/3549211468,v1:172.21.15.57:6819/3549211468]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T16:08:19.426 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:08:19 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2[113037]: 2024-02-28T16:08:19.166+0000 7f2087e00700 -1 osd.2 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:08:19.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:19 smithi057 ceph-mon[93219]: pgmap v145: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:08:19.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:19 smithi057 ceph-mon[93219]: from='osd.2 [v2:172.21.15.57:6818/3549211468,v1:172.21.15.57:6819/3549211468]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T16:08:19.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:19 smithi057 ceph-mon[93219]: osdmap e80: 6 total, 5 up, 6 in 2024-02-28T16:08:19.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:19 smithi057 ceph-mon[93219]: from='osd.2 [v2:172.21.15.57:6818/3549211468,v1:172.21.15.57:6819/3549211468]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T16:08:19.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:19.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:08:19.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:19 smithi057 ceph-mon[93219]: from='osd.2 [v2:172.21.15.57:6818/3549211468,v1:172.21.15.57:6819/3549211468]' entity='osd.2' 2024-02-28T16:08:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:19 smithi087 ceph-mon[82628]: pgmap v145: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:08:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:19 smithi087 ceph-mon[82628]: from='osd.2 [v2:172.21.15.57:6818/3549211468,v1:172.21.15.57:6819/3549211468]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T16:08:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:19 smithi087 ceph-mon[82628]: osdmap e80: 6 total, 5 up, 6 in 2024-02-28T16:08:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:19 smithi087 ceph-mon[82628]: from='osd.2 [v2:172.21.15.57:6818/3549211468,v1:172.21.15.57:6819/3549211468]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-02-28T16:08:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:08:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:19 smithi087 ceph-mon[82628]: from='osd.2 [v2:172.21.15.57:6818/3549211468,v1:172.21.15.57:6819/3549211468]' entity='osd.2' 2024-02-28T16:08:20.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:20.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:20.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:20 smithi057 ceph-mon[93219]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:08:20.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:20 smithi057 ceph-mon[93219]: osd.2 [v2:172.21.15.57:6818/3549211468,v1:172.21.15.57:6819/3549211468] boot 2024-02-28T16:08:20.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:20 smithi057 ceph-mon[93219]: osdmap e81: 6 total, 6 up, 6 in 2024-02-28T16:08:20.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:08:20.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:20.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:20.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:20 smithi087 ceph-mon[82628]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:08:20.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:20 smithi087 ceph-mon[82628]: osd.2 [v2:172.21.15.57:6818/3549211468,v1:172.21.15.57:6819/3549211468] boot 2024-02-28T16:08:20.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:20 smithi087 ceph-mon[82628]: osdmap e81: 6 total, 6 up, 6 in 2024-02-28T16:08:20.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:08:21.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:21 smithi057 ceph-mon[93219]: pgmap v147: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:08:21.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:21 smithi057 ceph-mon[93219]: osdmap e82: 6 total, 6 up, 6 in 2024-02-28T16:08:21.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:21 smithi087 ceph-mon[82628]: pgmap v147: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:08:21.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:21 smithi087 ceph-mon[82628]: osdmap e82: 6 total, 6 up, 6 in 2024-02-28T16:08:22.691 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:22.692 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:22.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:22.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:23.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:23 smithi057 ceph-mon[93219]: pgmap v150: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:08:23.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:23 smithi087 ceph-mon[82628]: pgmap v150: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:08:24.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:24 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 23/333 objects degraded (6.907%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:24.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:24 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 23/333 objects degraded (6.907%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:25.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:25 smithi057 ceph-mon[93219]: pgmap v151: 65 pgs: 9 active+undersized, 7 active+undersized+degraded, 49 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 23/333 objects degraded (6.907%) 2024-02-28T16:08:25.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:25 smithi087 ceph-mon[82628]: pgmap v151: 65 pgs: 9 active+undersized, 7 active+undersized+degraded, 49 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 23/333 objects degraded (6.907%) 2024-02-28T16:08:26.649 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:26 smithi057 ceph-mon[93219]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/333 objects degraded (6.907%), 7 pgs degraded) 2024-02-28T16:08:26.650 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:26 smithi057 ceph-mon[93219]: Cluster is now healthy 2024-02-28T16:08:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.656+0000 7f9606800700 1 -- 172.21.15.57:0/1415900667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96000663e0 msgr2=0x7f96000ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.656+0000 7f9606800700 1 --2- 172.21.15.57:0/1415900667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96000663e0 0x7f96000ffaf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f95f0004940 tx=0x7f95f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.656+0000 7f9606800700 1 -- 172.21.15.57:0/1415900667 shutdown_connections 2024-02-28T16:08:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.656+0000 7f9606800700 1 --2- 172.21.15.57:0/1415900667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96001000c0 0x7f9600102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.656+0000 7f9606800700 1 --2- 172.21.15.57:0/1415900667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96000663e0 0x7f96000ffaf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.656+0000 7f9606800700 1 -- 172.21.15.57:0/1415900667 >> 172.21.15.57:0/1415900667 conn(0x7f96000f74e0 msgr2=0x7f96000f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.657+0000 7f9606800700 1 -- 172.21.15.57:0/1415900667 shutdown_connections 2024-02-28T16:08:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.657+0000 7f9606800700 1 -- 172.21.15.57:0/1415900667 wait complete. 2024-02-28T16:08:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.658+0000 7f9606800700 1 Processor -- start 2024-02-28T16:08:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.658+0000 7f9606800700 1 -- start start 2024-02-28T16:08:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.658+0000 7f9606800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96000663e0 0x7f96000fd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:26.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.658+0000 7f9606800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96001000c0 0x7f96000fd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:26.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.658+0000 7f9606800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000fbc00 con 0x7f96001000c0 2024-02-28T16:08:26.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.658+0000 7f9606800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000fbd40 con 0x7f96000663e0 2024-02-28T16:08:26.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.659+0000 7f95fea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96001000c0 0x7f96000fd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:26.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.659+0000 7f95fea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96001000c0 0x7f96000fd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57032/0 (socket says 172.21.15.57:57032) 2024-02-28T16:08:26.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.659+0000 7f95fea00700 1 -- 172.21.15.57:0/276261387 learned_addr learned my addr 172.21.15.57:0/276261387 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:08:26.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.659+0000 7f95ff400700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96000663e0 0x7f96000fd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.659+0000 7f95fea00700 1 -- 172.21.15.57:0/276261387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96000663e0 msgr2=0x7f96000fd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.659+0000 7f95fea00700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96000663e0 0x7f96000fd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.659+0000 7f95fea00700 1 -- 172.21.15.57:0/276261387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0005040 con 0x7f96001000c0 2024-02-28T16:08:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.660+0000 7f95fea00700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96001000c0 0x7f96000fd550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c800 tx=0x7f95ec004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.660+0000 7f95f7400700 1 -- 172.21.15.57:0/276261387 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95ec00a760 con 0x7f96001000c0 2024-02-28T16:08:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.660+0000 7f9606800700 1 -- 172.21.15.57:0/276261387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96000fc020 con 0x7f96001000c0 2024-02-28T16:08:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.660+0000 7f95f7400700 1 -- 172.21.15.57:0/276261387 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95ec00ad90 con 0x7f96001000c0 2024-02-28T16:08:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.660+0000 7f9606800700 1 -- 172.21.15.57:0/276261387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96000fc560 con 0x7f96001000c0 2024-02-28T16:08:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.661+0000 7f95f7400700 1 -- 172.21.15.57:0/276261387 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95ec01b400 con 0x7f96001000c0 2024-02-28T16:08:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.662+0000 7f9606800700 1 -- 172.21.15.57:0/276261387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960004bed0 con 0x7f96001000c0 2024-02-28T16:08:26.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.663+0000 7f95f7400700 1 -- 172.21.15.57:0/276261387 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f95ec012400 con 0x7f96001000c0 2024-02-28T16:08:26.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.666+0000 7f95f7400700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f95e406d7f0 0x7f95e406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:26.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.666+0000 7f95f7400700 1 -- 172.21.15.57:0/276261387 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f95ec08cfc0 con 0x7f96001000c0 2024-02-28T16:08:26.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.667+0000 7f95ff400700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f95e406d7f0 0x7f95e406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:26.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.668+0000 7f95ff400700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f95e406d7f0 0x7f95e406fca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95f000b020 tx=0x7f95f0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:26.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.674+0000 7f95f7400700 1 -- 172.21.15.57:0/276261387 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f95ec0567e0 con 0x7f96001000c0 2024-02-28T16:08:26.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.921+0000 7f9606800700 1 -- 172.21.15.57:0/276261387 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9600068ba0 con 0x7f95e406d7f0 2024-02-28T16:08:26.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.923+0000 7f95f7400700 1 -- 172.21.15.57:0/276261387 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9600068ba0 con 0x7f95e406d7f0 2024-02-28T16:08:26.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.926+0000 7f9606800700 1 -- 172.21.15.57:0/276261387 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f95e406d7f0 msgr2=0x7f95e406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:26.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.926+0000 7f9606800700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f95e406d7f0 0x7f95e406fca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95f000b020 tx=0x7f95f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.926+0000 7f9606800700 1 -- 172.21.15.57:0/276261387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96001000c0 msgr2=0x7f96000fd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.926+0000 7f9606800700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96001000c0 0x7f96000fd550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c800 tx=0x7f95ec004470 comp rx=0 tx=0).stop 2024-02-28T16:08:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.927+0000 7f9606800700 1 -- 172.21.15.57:0/276261387 shutdown_connections 2024-02-28T16:08:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.927+0000 7f9606800700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f95e406d7f0 0x7f95e406fca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.927+0000 7f9606800700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96000663e0 0x7f96000fd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.927+0000 7f9606800700 1 --2- 172.21.15.57:0/276261387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96001000c0 0x7f96000fd550 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.927+0000 7f9606800700 1 -- 172.21.15.57:0/276261387 >> 172.21.15.57:0/276261387 conn(0x7f96000f74e0 msgr2=0x7f96000f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.927+0000 7f9606800700 1 -- 172.21.15.57:0/276261387 shutdown_connections 2024-02-28T16:08:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:26.927+0000 7f9606800700 1 -- 172.21.15.57:0/276261387 wait complete. 2024-02-28T16:08:26.936 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:08:26.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:26 smithi087 ceph-mon[82628]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/333 objects degraded (6.907%), 7 pgs degraded) 2024-02-28T16:08:26.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:26 smithi087 ceph-mon[82628]: Cluster is now healthy 2024-02-28T16:08:27.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.089+0000 7f3adb800700 1 -- 172.21.15.57:0/3699043039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ad40ff150 msgr2=0x7f3ad40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:27.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.089+0000 7f3adb800700 1 --2- 172.21.15.57:0/3699043039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ad40ff150 0x7f3ad40ff560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009ce0 tx=0x7f3ac8004d10 comp rx=0 tx=0).stop 2024-02-28T16:08:27.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.089+0000 7f3adb800700 1 -- 172.21.15.57:0/3699043039 shutdown_connections 2024-02-28T16:08:27.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.089+0000 7f3adb800700 1 --2- 172.21.15.57:0/3699043039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad4100360 0x7f3ad41007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.089+0000 7f3adb800700 1 --2- 172.21.15.57:0/3699043039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ad40ff150 0x7f3ad40ff560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.090+0000 7f3adb800700 1 -- 172.21.15.57:0/3699043039 >> 172.21.15.57:0/3699043039 conn(0x7f3ad40fa920 msgr2=0x7f3ad40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:27.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.090+0000 7f3adb800700 1 -- 172.21.15.57:0/3699043039 shutdown_connections 2024-02-28T16:08:27.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.090+0000 7f3adb800700 1 -- 172.21.15.57:0/3699043039 wait complete. 2024-02-28T16:08:27.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.090+0000 7f3adb800700 1 Processor -- start 2024-02-28T16:08:27.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.091+0000 7f3adb800700 1 -- start start 2024-02-28T16:08:27.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.091+0000 7f3adb800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ad40ff150 0x7f3ad410fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.091+0000 7f3adb800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad4100360 0x7f3ad4110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.091+0000 7f3adb800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4110750 con 0x7f3ad40ff150 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.091+0000 7f3adb800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4110ff0 con 0x7f3ad4100360 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.091+0000 7f3ad8e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ad40ff150 0x7f3ad410fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.091+0000 7f3ad8e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ad40ff150 0x7f3ad410fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57050/0 (socket says 172.21.15.57:57050) 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.091+0000 7f3ad8e00700 1 -- 172.21.15.57:0/589416773 learned_addr learned my addr 172.21.15.57:0/589416773 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.092+0000 7f3ad3e00700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad4100360 0x7f3ad4110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.092+0000 7f3ad8e00700 1 -- 172.21.15.57:0/589416773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad4100360 msgr2=0x7f3ad4110150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.092+0000 7f3ad8e00700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad4100360 0x7f3ad4110150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.092+0000 7f3ad8e00700 1 -- 172.21.15.57:0/589416773 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8009940 con 0x7f3ad40ff150 2024-02-28T16:08:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.092+0000 7f3ad8e00700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ad40ff150 0x7f3ad410fc10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8004a00 tx=0x7f3ac8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.092+0000 7f3ad0c00700 1 -- 172.21.15.57:0/589416773 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ac800e040 con 0x7f3ad40ff150 2024-02-28T16:08:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.092+0000 7f3ad0c00700 1 -- 172.21.15.57:0/589416773 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ac801cd00 con 0x7f3ad40ff150 2024-02-28T16:08:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.092+0000 7f3ad0c00700 1 -- 172.21.15.57:0/589416773 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ac8012cf0 con 0x7f3ad40ff150 2024-02-28T16:08:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.092+0000 7f3adb800700 1 -- 172.21.15.57:0/589416773 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad4111270 con 0x7f3ad40ff150 2024-02-28T16:08:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.093+0000 7f3adb800700 1 -- 172.21.15.57:0/589416773 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad4111760 con 0x7f3ad40ff150 2024-02-28T16:08:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.094+0000 7f3adb800700 1 -- 172.21.15.57:0/589416773 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad404bed0 con 0x7f3ad40ff150 2024-02-28T16:08:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.095+0000 7f3ad0c00700 1 -- 172.21.15.57:0/589416773 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f3ac80124a0 con 0x7f3ad40ff150 2024-02-28T16:08:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.096+0000 7f3ad0c00700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f3abc06d7f0 0x7f3abc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.096+0000 7f3ad0c00700 1 -- 172.21.15.57:0/589416773 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f3ac808f430 con 0x7f3ad40ff150 2024-02-28T16:08:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.096+0000 7f3ad3e00700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f3abc06d7f0 0x7f3abc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:27.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.097+0000 7f3ad3e00700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f3abc06d7f0 0x7f3abc06fca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0004600 tx=0x7f3ac000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.100+0000 7f3ad0c00700 1 -- 172.21.15.57:0/589416773 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3ac805c660 con 0x7f3ad40ff150 2024-02-28T16:08:27.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.348+0000 7f3adb800700 1 -- 172.21.15.57:0/589416773 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ad4111c00 con 0x7f3abc06d7f0 2024-02-28T16:08:27.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.351+0000 7f3ad0c00700 1 -- 172.21.15.57:0/589416773 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3ad4111c00 con 0x7f3abc06d7f0 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 -- 172.21.15.57:0/589416773 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f3abc06d7f0 msgr2=0x7f3abc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f3abc06d7f0 0x7f3abc06fca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0004600 tx=0x7f3ac000b040 comp rx=0 tx=0).stop 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 -- 172.21.15.57:0/589416773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ad40ff150 msgr2=0x7f3ad410fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ad40ff150 0x7f3ad410fc10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8004a00 tx=0x7f3ac8004d10 comp rx=0 tx=0).stop 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 -- 172.21.15.57:0/589416773 shutdown_connections 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f3abc06d7f0 0x7f3abc06fca0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ad40ff150 0x7f3ad410fc10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 --2- 172.21.15.57:0/589416773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad4100360 0x7f3ad4110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 -- 172.21.15.57:0/589416773 >> 172.21.15.57:0/589416773 conn(0x7f3ad40fa920 msgr2=0x7f3ad4103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 -- 172.21.15.57:0/589416773 shutdown_connections 2024-02-28T16:08:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.354+0000 7f3adb800700 1 -- 172.21.15.57:0/589416773 wait complete. 2024-02-28T16:08:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.510+0000 7f1ea0400700 1 -- 172.21.15.57:0/371593373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e980fcef0 msgr2=0x7f1e980fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.510+0000 7f1ea0400700 1 --2- 172.21.15.57:0/371593373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e980fcef0 0x7f1e980fd320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c004940 tx=0x7f1e8c009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.511+0000 7f1ea0400700 1 -- 172.21.15.57:0/371593373 shutdown_connections 2024-02-28T16:08:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.511+0000 7f1ea0400700 1 --2- 172.21.15.57:0/371593373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e980fe0e0 0x7f1e980fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.511+0000 7f1ea0400700 1 --2- 172.21.15.57:0/371593373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e980fcef0 0x7f1e980fd320 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.511+0000 7f1ea0400700 1 -- 172.21.15.57:0/371593373 >> 172.21.15.57:0/371593373 conn(0x7f1e980f8620 msgr2=0x7f1e980faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.511+0000 7f1ea0400700 1 -- 172.21.15.57:0/371593373 shutdown_connections 2024-02-28T16:08:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.511+0000 7f1ea0400700 1 -- 172.21.15.57:0/371593373 wait complete. 2024-02-28T16:08:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.512+0000 7f1ea0400700 1 Processor -- start 2024-02-28T16:08:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.512+0000 7f1ea0400700 1 -- start start 2024-02-28T16:08:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.512+0000 7f1ea0400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e980fcef0 0x7f1e98071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.512+0000 7f1ea0400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e980fe0e0 0x7f1e980702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.512+0000 7f1ea0400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980708e0 con 0x7f1e980fcef0 2024-02-28T16:08:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.512+0000 7f1ea0400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98070a50 con 0x7f1e980fe0e0 2024-02-28T16:08:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.513+0000 7f1e9da00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e980fcef0 0x7f1e98071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.513+0000 7f1e9da00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e980fcef0 0x7f1e98071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57064/0 (socket says 172.21.15.57:57064) 2024-02-28T16:08:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.513+0000 7f1e9da00700 1 -- 172.21.15.57:0/676754635 learned_addr learned my addr 172.21.15.57:0/676754635 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:08:27.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.513+0000 7f1e9d000700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e980fe0e0 0x7f1e980702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:27.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.513+0000 7f1e9da00700 1 -- 172.21.15.57:0/676754635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e980fe0e0 msgr2=0x7f1e980702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:27.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.513+0000 7f1e9da00700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e980fe0e0 0x7f1e980702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.513+0000 7f1e9da00700 1 -- 172.21.15.57:0/676754635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c005040 con 0x7f1e980fcef0 2024-02-28T16:08:27.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.514+0000 7f1e9da00700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e980fcef0 0x7f1e98071e60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c000c00 tx=0x7f1e8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:27.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.514+0000 7f1e95600700 1 -- 172.21.15.57:0/676754635 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e8c00e040 con 0x7f1e980fcef0 2024-02-28T16:08:27.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.514+0000 7f1e95600700 1 -- 172.21.15.57:0/676754635 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e8c00bcc0 con 0x7f1e980fcef0 2024-02-28T16:08:27.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.514+0000 7f1e95600700 1 -- 172.21.15.57:0/676754635 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e8c013ea0 con 0x7f1e980fcef0 2024-02-28T16:08:27.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.514+0000 7f1ea0400700 1 -- 172.21.15.57:0/676754635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e98070cd0 con 0x7f1e980fcef0 2024-02-28T16:08:27.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.514+0000 7f1ea0400700 1 -- 172.21.15.57:0/676754635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e981159a0 con 0x7f1e980fcef0 2024-02-28T16:08:27.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.515+0000 7f1ea0400700 1 -- 172.21.15.57:0/676754635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9804bed0 con 0x7f1e980fcef0 2024-02-28T16:08:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.516+0000 7f1e95600700 1 -- 172.21.15.57:0/676754635 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1e8c013420 con 0x7f1e980fcef0 2024-02-28T16:08:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.517+0000 7f1e95600700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e8006d7f0 0x7f1e8006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.517+0000 7f1e95600700 1 -- 172.21.15.57:0/676754635 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f1e8c08e2b0 con 0x7f1e980fcef0 2024-02-28T16:08:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.518+0000 7f1e9d000700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e8006d7f0 0x7f1e8006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.518+0000 7f1e9d000700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e8006d7f0 0x7f1e8006fca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e84007fd0 tx=0x7f1e84009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:27.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.524+0000 7f1e95600700 1 -- 172.21.15.57:0/676754635 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1e8c05b560 con 0x7f1e980fcef0 2024-02-28T16:08:27.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.781+0000 7f1ea0400700 1 -- 172.21.15.57:0/676754635 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e98102ac0 con 0x7f1e8006d7f0 2024-02-28T16:08:27.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.812+0000 7f1e95600700 1 -- 172.21.15.57:0/676754635 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1e98102ac0 con 0x7f1e8006d7f0 2024-02-28T16:08:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:08:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (6m) 8s ago 17m 14.2M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:08:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (2m) 8s ago 17m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:08:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (2m) 2m ago 16m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:08:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (6m) 8s ago 17m 75.3M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:08:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (10m) 8s ago 10m 125M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:08:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (10m) 8s ago 10m 68.0M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:08:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (10m) 2m ago 10m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:08:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (10m) 2m ago 10m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:08:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (5m) 8s ago 19m 506M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:08:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (4m) 2m ago 16m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:08:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (4m) 8s ago 19m 48.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:08:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (3m) 2m ago 16m 35.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:08:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (6m) 8s ago 17m 7906k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:08:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (5m) 2m ago 16m 7852k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:08:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (110s) 8s ago 15m 137M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:08:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (63s) 8s ago 14m 94.7M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:08:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (16s) 8s ago 13m 11.0M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:08:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (13m) 2m ago 13m 261M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 13f3a1ca401a 2024-02-28T16:08:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (12m) 2m ago 12m 236M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:08:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (12m) 2m ago 12m 220M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:08:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (4m) 8s ago 16m 53.5M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:08:27.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.814+0000 7f1ea0400700 1 -- 172.21.15.57:0/676754635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e8006d7f0 msgr2=0x7f1e8006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:27.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.814+0000 7f1ea0400700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e8006d7f0 0x7f1e8006fca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e84007fd0 tx=0x7f1e84009040 comp rx=0 tx=0).stop 2024-02-28T16:08:27.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.814+0000 7f1ea0400700 1 -- 172.21.15.57:0/676754635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e980fcef0 msgr2=0x7f1e98071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:27.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.814+0000 7f1ea0400700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e980fcef0 0x7f1e98071e60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c000c00 tx=0x7f1e8c009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:27.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.815+0000 7f1ea0400700 1 -- 172.21.15.57:0/676754635 shutdown_connections 2024-02-28T16:08:27.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.815+0000 7f1ea0400700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e8006d7f0 0x7f1e8006fca0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.815+0000 7f1ea0400700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e980fcef0 0x7f1e98071e60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.815+0000 7f1ea0400700 1 --2- 172.21.15.57:0/676754635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e980fe0e0 0x7f1e980702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.815+0000 7f1ea0400700 1 -- 172.21.15.57:0/676754635 >> 172.21.15.57:0/676754635 conn(0x7f1e980f8620 msgr2=0x7f1e981013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:27.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.815+0000 7f1ea0400700 1 -- 172.21.15.57:0/676754635 shutdown_connections 2024-02-28T16:08:27.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.815+0000 7f1ea0400700 1 -- 172.21.15.57:0/676754635 wait complete. 2024-02-28T16:08:27.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:27 smithi057 ceph-mon[93219]: pgmap v152: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:08:27.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:27.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:27.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:08:27.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:08:27.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:27.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:27 smithi087 ceph-mon[82628]: pgmap v152: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:08:27.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:27.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:27.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:08:27.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:08:27.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.977+0000 7f5e6f400700 1 -- 172.21.15.57:0/603150766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e68071eb0 msgr2=0x7f5e68070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.977+0000 7f5e6f400700 1 --2- 172.21.15.57:0/603150766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e68071eb0 0x7f5e68070320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c004940 tx=0x7f5e5c009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.977+0000 7f5e6f400700 1 -- 172.21.15.57:0/603150766 shutdown_connections 2024-02-28T16:08:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.977+0000 7f5e6f400700 1 --2- 172.21.15.57:0/603150766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e68070860 0x7f5e68070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.977+0000 7f5e6f400700 1 --2- 172.21.15.57:0/603150766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e68071eb0 0x7f5e68070320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.977+0000 7f5e6f400700 1 -- 172.21.15.57:0/603150766 >> 172.21.15.57:0/603150766 conn(0x7f5e680f8620 msgr2=0x7f5e680faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.977+0000 7f5e6f400700 1 -- 172.21.15.57:0/603150766 shutdown_connections 2024-02-28T16:08:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.977+0000 7f5e6f400700 1 -- 172.21.15.57:0/603150766 wait complete. 2024-02-28T16:08:27.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.978+0000 7f5e6f400700 1 Processor -- start 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.978+0000 7f5e6f400700 1 -- start start 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.978+0000 7f5e6f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e68070860 0x7f5e6810fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.978+0000 7f5e6f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e68071eb0 0x7f5e68110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.978+0000 7f5e6f400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68110600 con 0x7f5e68070860 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.978+0000 7f5e6f400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68110ea0 con 0x7f5e68071eb0 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.979+0000 7f5e6ca00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e68070860 0x7f5e6810fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.979+0000 7f5e6ca00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e68070860 0x7f5e6810fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57092/0 (socket says 172.21.15.57:57092) 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.979+0000 7f5e6ca00700 1 -- 172.21.15.57:0/3454861239 learned_addr learned my addr 172.21.15.57:0/3454861239 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.979+0000 7f5e67e00700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e68071eb0 0x7f5e68110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.979+0000 7f5e6ca00700 1 -- 172.21.15.57:0/3454861239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e68071eb0 msgr2=0x7f5e68110000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.979+0000 7f5e6ca00700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e68071eb0 0x7f5e68110000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.979+0000 7f5e6ca00700 1 -- 172.21.15.57:0/3454861239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c005040 con 0x7f5e68070860 2024-02-28T16:08:27.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.979+0000 7f5e6ca00700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e68070860 0x7f5e6810fac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c000c00 tx=0x7f5e5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:27.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.980+0000 7f5e64c00700 1 -- 172.21.15.57:0/3454861239 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e5c021070 con 0x7f5e68070860 2024-02-28T16:08:27.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.980+0000 7f5e64c00700 1 -- 172.21.15.57:0/3454861239 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e5c01c400 con 0x7f5e68070860 2024-02-28T16:08:27.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.980+0000 7f5e6f400700 1 -- 172.21.15.57:0/3454861239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e68111120 con 0x7f5e68070860 2024-02-28T16:08:27.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.980+0000 7f5e64c00700 1 -- 172.21.15.57:0/3454861239 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e5c00e070 con 0x7f5e68070860 2024-02-28T16:08:27.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.980+0000 7f5e6f400700 1 -- 172.21.15.57:0/3454861239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e68111600 con 0x7f5e68070860 2024-02-28T16:08:27.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.981+0000 7f5e6f400700 1 -- 172.21.15.57:0/3454861239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6804bed0 con 0x7f5e68070860 2024-02-28T16:08:27.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.982+0000 7f5e64c00700 1 -- 172.21.15.57:0/3454861239 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f5e5c01ca50 con 0x7f5e68070860 2024-02-28T16:08:27.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.983+0000 7f5e64c00700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5e5006d7f0 0x7f5e5006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:27.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.983+0000 7f5e64c00700 1 -- 172.21.15.57:0/3454861239 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f5e5c08e000 con 0x7f5e68070860 2024-02-28T16:08:27.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.983+0000 7f5e67e00700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5e5006d7f0 0x7f5e5006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:27.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.984+0000 7f5e67e00700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5e5006d7f0 0x7f5e5006fca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009b80 tx=0x7f5e5400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:27.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:27.988+0000 7f5e64c00700 1 -- 172.21.15.57:0/3454861239 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5e5c05b3f0 con 0x7f5e68070860 2024-02-28T16:08:28.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.287+0000 7f5e6f400700 1 -- 172.21.15.57:0/3454861239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5e681160e0 con 0x7f5e68070860 2024-02-28T16:08:28.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.288+0000 7f5e64c00700 1 -- 172.21.15.57:0/3454861239 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f5e5c05af80 con 0x7f5e68070860 2024-02-28T16:08:28.281 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:08:28.281 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 3, 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 7, 2024-02-28T16:08:28.282 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 7 2024-02-28T16:08:28.283 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:08:28.283 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:08:28.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.291+0000 7f5e6f400700 1 -- 172.21.15.57:0/3454861239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5e5006d7f0 msgr2=0x7f5e5006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:28.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.291+0000 7f5e6f400700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5e5006d7f0 0x7f5e5006fca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009b80 tx=0x7f5e5400b040 comp rx=0 tx=0).stop 2024-02-28T16:08:28.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.291+0000 7f5e6f400700 1 -- 172.21.15.57:0/3454861239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e68070860 msgr2=0x7f5e6810fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:28.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.291+0000 7f5e6f400700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e68070860 0x7f5e6810fac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c000c00 tx=0x7f5e5c009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:28.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.291+0000 7f5e6f400700 1 -- 172.21.15.57:0/3454861239 shutdown_connections 2024-02-28T16:08:28.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.291+0000 7f5e6f400700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5e5006d7f0 0x7f5e5006fca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.291+0000 7f5e6f400700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e68070860 0x7f5e6810fac0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.291+0000 7f5e6f400700 1 --2- 172.21.15.57:0/3454861239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e68071eb0 0x7f5e68110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.291+0000 7f5e6f400700 1 -- 172.21.15.57:0/3454861239 >> 172.21.15.57:0/3454861239 conn(0x7f5e680f8620 msgr2=0x7f5e68102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:28.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.291+0000 7f5e6f400700 1 -- 172.21.15.57:0/3454861239 shutdown_connections 2024-02-28T16:08:28.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.292+0000 7f5e6f400700 1 -- 172.21.15.57:0/3454861239 wait complete. 2024-02-28T16:08:28.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.448+0000 7f2ba4a00700 1 -- 172.21.15.57:0/1769486303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ba00fcef0 msgr2=0x7f2ba00fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:28.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.448+0000 7f2ba4a00700 1 --2- 172.21.15.57:0/1769486303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ba00fcef0 0x7f2ba00fd320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b90004940 tx=0x7f2b90009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:28.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.448+0000 7f2ba4a00700 1 -- 172.21.15.57:0/1769486303 shutdown_connections 2024-02-28T16:08:28.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.448+0000 7f2ba4a00700 1 --2- 172.21.15.57:0/1769486303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ba00fe0e0 0x7f2ba00fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.448+0000 7f2ba4a00700 1 --2- 172.21.15.57:0/1769486303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ba00fcef0 0x7f2ba00fd320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.448+0000 7f2ba4a00700 1 -- 172.21.15.57:0/1769486303 >> 172.21.15.57:0/1769486303 conn(0x7f2ba00f8620 msgr2=0x7f2ba00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:28.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.448+0000 7f2ba4a00700 1 -- 172.21.15.57:0/1769486303 shutdown_connections 2024-02-28T16:08:28.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.448+0000 7f2ba4a00700 1 -- 172.21.15.57:0/1769486303 wait complete. 2024-02-28T16:08:28.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.449+0000 7f2ba4a00700 1 Processor -- start 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.449+0000 7f2ba4a00700 1 -- start start 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2ba4a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ba00fcef0 0x7f2ba010fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2ba4a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ba00fe0e0 0x7f2ba0110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2ba4a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0110650 con 0x7f2ba00fe0e0 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2ba4a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0110ef0 con 0x7f2ba00fcef0 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2b9d400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ba00fe0e0 0x7f2ba0110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2b9de00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ba00fcef0 0x7f2ba010fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2b9de00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ba00fcef0 0x7f2ba010fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:60290/0 (socket says 172.21.15.57:60290) 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2b9de00700 1 -- 172.21.15.57:0/3788018043 learned_addr learned my addr 172.21.15.57:0/3788018043 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2b9de00700 1 -- 172.21.15.57:0/3788018043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ba00fe0e0 msgr2=0x7f2ba0110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2b9de00700 1 --2- 172.21.15.57:0/3788018043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ba00fe0e0 0x7f2ba0110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.450+0000 7f2b9de00700 1 -- 172.21.15.57:0/3788018043 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90005040 con 0x7f2ba00fcef0 2024-02-28T16:08:28.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.451+0000 7f2b9de00700 1 --2- 172.21.15.57:0/3788018043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ba00fcef0 0x7f2ba010fb10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2b900043d0 tx=0x7f2b90009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:28.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.451+0000 7f2b96000700 1 -- 172.21.15.57:0/3788018043 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b9000e070 con 0x7f2ba00fcef0 2024-02-28T16:08:28.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.451+0000 7f2b96000700 1 -- 172.21.15.57:0/3788018043 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b9001c400 con 0x7f2ba00fcef0 2024-02-28T16:08:28.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.451+0000 7f2b96000700 1 -- 172.21.15.57:0/3788018043 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b9000b650 con 0x7f2ba00fcef0 2024-02-28T16:08:28.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.451+0000 7f2ba4a00700 1 -- 172.21.15.57:0/3788018043 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba0111170 con 0x7f2ba00fcef0 2024-02-28T16:08:28.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.451+0000 7f2ba4a00700 1 -- 172.21.15.57:0/3788018043 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba0111650 con 0x7f2ba00fcef0 2024-02-28T16:08:28.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.452+0000 7f2ba4a00700 1 -- 172.21.15.57:0/3788018043 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba0102210 con 0x7f2ba00fcef0 2024-02-28T16:08:28.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.453+0000 7f2b96000700 1 -- 172.21.15.57:0/3788018043 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2b9001ca50 con 0x7f2ba00fcef0 2024-02-28T16:08:28.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.454+0000 7f2b96000700 1 --2- 172.21.15.57:0/3788018043 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2b8406d7e0 0x7f2b8406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:28.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.454+0000 7f2b96000700 1 -- 172.21.15.57:0/3788018043 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f2b9008e550 con 0x7f2ba00fcef0 2024-02-28T16:08:28.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.455+0000 7f2b9d400700 1 --2- 172.21.15.57:0/3788018043 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2b8406d7e0 0x7f2b8406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:28.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.455+0000 7f2b9d400700 1 --2- 172.21.15.57:0/3788018043 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2b8406d7e0 0x7f2b8406fc90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009b80 tx=0x7f2b8c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:28.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.462+0000 7f2b96000700 1 -- 172.21.15.57:0/3788018043 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2b9005b880 con 0x7f2ba00fcef0 2024-02-28T16:08:28.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.740+0000 7f2ba4a00700 1 -- 172.21.15.57:0/3788018043 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2ba002b2a0 con 0x7f2ba00fcef0 2024-02-28T16:08:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.741+0000 7f2b96000700 1 -- 172.21.15.57:0/3788018043 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1863 (secure 0 0 0) 0x7f2b9005b410 con 0x7f2ba00fcef0 2024-02-28T16:08:28.734 INFO:teuthology.orchestra.run.smithi057.stdout:e18 2024-02-28T16:08:28.734 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:08:28.734 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:08:28.734 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:08:28.734 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:08:28.734 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:08:28.734 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:08:28.734 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 18 2024-02-28T16:08:28.734 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:06:28.521002+0000 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:08:28.735 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:08:28.736 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:08:28.737 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:08:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.745+0000 7f2ba4a00700 1 -- 172.21.15.57:0/3788018043 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2b8406d7e0 msgr2=0x7f2b8406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.745+0000 7f2ba4a00700 1 --2- 172.21.15.57:0/3788018043 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2b8406d7e0 0x7f2b8406fc90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009b80 tx=0x7f2b8c00b040 comp rx=0 tx=0).stop 2024-02-28T16:08:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.745+0000 7f2ba4a00700 1 -- 172.21.15.57:0/3788018043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ba00fcef0 msgr2=0x7f2ba010fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.745+0000 7f2ba4a00700 1 --2- 172.21.15.57:0/3788018043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ba00fcef0 0x7f2ba010fb10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2b900043d0 tx=0x7f2b90009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.746+0000 7f2ba4a00700 1 -- 172.21.15.57:0/3788018043 shutdown_connections 2024-02-28T16:08:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.746+0000 7f2ba4a00700 1 --2- 172.21.15.57:0/3788018043 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2b8406d7e0 0x7f2b8406fc90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.746+0000 7f2ba4a00700 1 --2- 172.21.15.57:0/3788018043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ba00fcef0 0x7f2ba010fb10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.746+0000 7f2ba4a00700 1 --2- 172.21.15.57:0/3788018043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ba00fe0e0 0x7f2ba0110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.746+0000 7f2ba4a00700 1 -- 172.21.15.57:0/3788018043 >> 172.21.15.57:0/3788018043 conn(0x7f2ba00f8620 msgr2=0x7f2ba00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.746+0000 7f2ba4a00700 1 -- 172.21.15.57:0/3788018043 shutdown_connections 2024-02-28T16:08:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.746+0000 7f2ba4a00700 1 -- 172.21.15.57:0/3788018043 wait complete. 2024-02-28T16:08:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-02-28T16:08:28.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.906+0000 7f87c2000700 1 -- 172.21.15.57:0/637273812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87bc104750 msgr2=0x7f87bc104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.906+0000 7f87c2000700 1 --2- 172.21.15.57:0/637273812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87bc104750 0x7f87bc104ba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f87a8004940 tx=0x7f87a8009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.907+0000 7f87c2000700 1 -- 172.21.15.57:0/637273812 shutdown_connections 2024-02-28T16:08:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.907+0000 7f87c2000700 1 --2- 172.21.15.57:0/637273812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87bc104750 0x7f87bc104ba0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.907+0000 7f87c2000700 1 --2- 172.21.15.57:0/637273812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87bc103540 0x7f87bc103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.907+0000 7f87c2000700 1 -- 172.21.15.57:0/637273812 >> 172.21.15.57:0/637273812 conn(0x7f87bc0727d0 msgr2=0x7f87bc074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.907+0000 7f87c2000700 1 -- 172.21.15.57:0/637273812 shutdown_connections 2024-02-28T16:08:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.907+0000 7f87c2000700 1 -- 172.21.15.57:0/637273812 wait complete. 2024-02-28T16:08:28.900 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:28 smithi057 ceph-mon[93219]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:08:28.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:28 smithi057 ceph-mon[93219]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:08:28.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:28 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:08:28.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:28 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:28.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:28 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:28.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:28 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:28.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:28 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:08:28.901 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:28 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3454861239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:28.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.908+0000 7f87c2000700 1 Processor -- start 2024-02-28T16:08:28.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.908+0000 7f87c2000700 1 -- start start 2024-02-28T16:08:28.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.908+0000 7f87c2000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87bc103540 0x7f87bc113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.908+0000 7f87c2000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87bc104750 0x7f87bc1144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.908+0000 7f87c2000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc114aa0 con 0x7f87bc104750 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.908+0000 7f87c2000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc115340 con 0x7f87bc103540 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.909+0000 7f87baa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87bc104750 0x7f87bc1144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.909+0000 7f87baa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87bc104750 0x7f87bc1144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57124/0 (socket says 172.21.15.57:57124) 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.909+0000 7f87baa00700 1 -- 172.21.15.57:0/3288884929 learned_addr learned my addr 172.21.15.57:0/3288884929 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.909+0000 7f87bb400700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87bc103540 0x7f87bc113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.909+0000 7f87baa00700 1 -- 172.21.15.57:0/3288884929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87bc103540 msgr2=0x7f87bc113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.909+0000 7f87baa00700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87bc103540 0x7f87bc113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.909+0000 7f87baa00700 1 -- 172.21.15.57:0/3288884929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8005040 con 0x7f87bc104750 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.910+0000 7f87baa00700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87bc104750 0x7f87bc1144a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f87a800b3b0 tx=0x7f87a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.910+0000 7f87b3400700 1 -- 172.21.15.57:0/3288884929 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87a800e040 con 0x7f87bc104750 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.910+0000 7f87c2000700 1 -- 172.21.15.57:0/3288884929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87bc1155c0 con 0x7f87bc104750 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.910+0000 7f87b3400700 1 -- 172.21.15.57:0/3288884929 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87a800bd90 con 0x7f87bc104750 2024-02-28T16:08:28.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.910+0000 7f87b3400700 1 -- 172.21.15.57:0/3288884929 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87a801c630 con 0x7f87bc104750 2024-02-28T16:08:28.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.910+0000 7f87c2000700 1 -- 172.21.15.57:0/3288884929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87bc115b00 con 0x7f87bc104750 2024-02-28T16:08:28.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.912+0000 7f87c2000700 1 -- 172.21.15.57:0/3288884929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87bc04bed0 con 0x7f87bc104750 2024-02-28T16:08:28.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.912+0000 7f87b3400700 1 -- 172.21.15.57:0/3288884929 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f87a80139f0 con 0x7f87bc104750 2024-02-28T16:08:28.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.914+0000 7f87b3400700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87a006d7f0 0x7f87a006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:28.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.914+0000 7f87b3400700 1 -- 172.21.15.57:0/3288884929 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f87a808e460 con 0x7f87bc104750 2024-02-28T16:08:28.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.914+0000 7f87bb400700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87a006d7f0 0x7f87a006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:28.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.915+0000 7f87bb400700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87a006d7f0 0x7f87a006fca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009fd0 tx=0x7f87ac009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:28.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:28.919+0000 7f87b3400700 1 -- 172.21.15.57:0/3288884929 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f87a805b790 con 0x7f87bc104750 2024-02-28T16:08:28.924 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:28 smithi087 ceph-mon[82628]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:08:28.925 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:28 smithi087 ceph-mon[82628]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:08:28.925 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:28 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:08:28.925 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:28 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:28.925 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:28 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:28.925 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:28 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:28.925 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:28 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:08:28.925 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:28 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3454861239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:29.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.167+0000 7f87c2000700 1 -- 172.21.15.57:0/3288884929 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87bc115fa0 con 0x7f87a006d7f0 2024-02-28T16:08:29.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.170+0000 7f87b3400700 1 -- 172.21.15.57:0/3288884929 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f87bc115fa0 con 0x7f87a006d7f0 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "9/21 daemons upgraded", 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:08:29.163 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:08:29.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 -- 172.21.15.57:0/3288884929 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87a006d7f0 msgr2=0x7f87a006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:29.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87a006d7f0 0x7f87a006fca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009fd0 tx=0x7f87ac009f00 comp rx=0 tx=0).stop 2024-02-28T16:08:29.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 -- 172.21.15.57:0/3288884929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87bc104750 msgr2=0x7f87bc1144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:29.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87bc104750 0x7f87bc1144a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f87a800b3b0 tx=0x7f87a8009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:29.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 -- 172.21.15.57:0/3288884929 shutdown_connections 2024-02-28T16:08:29.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f87a006d7f0 0x7f87a006fca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:29.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87bc103540 0x7f87bc113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:29.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 --2- 172.21.15.57:0/3288884929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87bc104750 0x7f87bc1144a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:29.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 -- 172.21.15.57:0/3288884929 >> 172.21.15.57:0/3288884929 conn(0x7f87bc0727d0 msgr2=0x7f87bc107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:29.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 -- 172.21.15.57:0/3288884929 shutdown_connections 2024-02-28T16:08:29.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.173+0000 7f87c2000700 1 -- 172.21.15.57:0/3288884929 wait complete. 2024-02-28T16:08:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.340+0000 7ff29b200700 1 -- 172.21.15.57:0/3576012215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff29c070cd0 msgr2=0x7ff29c1093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.340+0000 7ff29b200700 1 --2- 172.21.15.57:0/3576012215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff29c070cd0 0x7ff29c1093f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff288004940 tx=0x7ff288009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.340+0000 7ff29b200700 1 -- 172.21.15.57:0/3576012215 shutdown_connections 2024-02-28T16:08:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.340+0000 7ff29b200700 1 --2- 172.21.15.57:0/3576012215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff29c070cd0 0x7ff29c1093f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.340+0000 7ff29b200700 1 --2- 172.21.15.57:0/3576012215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff29c070380 0x7ff29c070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.340+0000 7ff29b200700 1 -- 172.21.15.57:0/3576012215 >> 172.21.15.57:0/3576012215 conn(0x7ff29c0f8400 msgr2=0x7ff29c0fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.340+0000 7ff29b200700 1 -- 172.21.15.57:0/3576012215 shutdown_connections 2024-02-28T16:08:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.340+0000 7ff29b200700 1 -- 172.21.15.57:0/3576012215 wait complete. 2024-02-28T16:08:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.341+0000 7ff29b200700 1 Processor -- start 2024-02-28T16:08:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.342+0000 7ff29b200700 1 -- start start 2024-02-28T16:08:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.342+0000 7ff29b200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff29c070380 0x7ff29c113d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.342+0000 7ff29b200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff29c070cd0 0x7ff29c1142c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.342+0000 7ff29b200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c1150b0 con 0x7ff29c070380 2024-02-28T16:08:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.342+0000 7ff29b200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c115220 con 0x7ff29c070cd0 2024-02-28T16:08:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.342+0000 7ff299e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff29c070380 0x7ff29c113d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.342+0000 7ff299e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff29c070380 0x7ff29c113d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57146/0 (socket says 172.21.15.57:57146) 2024-02-28T16:08:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.342+0000 7ff299e00700 1 -- 172.21.15.57:0/1190499660 learned_addr learned my addr 172.21.15.57:0/1190499660 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:08:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.343+0000 7ff299400700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff29c070cd0 0x7ff29c1142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.343+0000 7ff299e00700 1 -- 172.21.15.57:0/1190499660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff29c070cd0 msgr2=0x7ff29c1142c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.343+0000 7ff299e00700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff29c070cd0 0x7ff29c1142c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.343+0000 7ff299e00700 1 -- 172.21.15.57:0/1190499660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff288005040 con 0x7ff29c070380 2024-02-28T16:08:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.343+0000 7ff299400700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff29c070cd0 0x7ff29c1142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:08:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.343+0000 7ff299e00700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff29c070380 0x7ff29c113d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff28c002a50 tx=0x7ff28c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.343+0000 7ff292000700 1 -- 172.21.15.57:0/1190499660 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff28c007cc0 con 0x7ff29c070380 2024-02-28T16:08:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.343+0000 7ff292000700 1 -- 172.21.15.57:0/1190499660 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff28c00f040 con 0x7ff29c070380 2024-02-28T16:08:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.343+0000 7ff29b200700 1 -- 172.21.15.57:0/1190499660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c115500 con 0x7ff29c070380 2024-02-28T16:08:29.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.343+0000 7ff292000700 1 -- 172.21.15.57:0/1190499660 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff28c009640 con 0x7ff29c070380 2024-02-28T16:08:29.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.344+0000 7ff29b200700 1 -- 172.21.15.57:0/1190499660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c115ac0 con 0x7ff29c070380 2024-02-28T16:08:29.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.345+0000 7ff29b200700 1 -- 172.21.15.57:0/1190499660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c05f5c0 con 0x7ff29c070380 2024-02-28T16:08:29.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.346+0000 7ff292000700 1 -- 172.21.15.57:0/1190499660 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff28c0097c0 con 0x7ff29c070380 2024-02-28T16:08:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.347+0000 7ff292000700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff28006d7f0 0x7ff28006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.347+0000 7ff292000700 1 -- 172.21.15.57:0/1190499660 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6585+0+0 (secure 0 0 0) 0x7ff28c08ccd0 con 0x7ff29c070380 2024-02-28T16:08:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.347+0000 7ff299400700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff28006d7f0 0x7ff28006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:29.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.348+0000 7ff299400700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff28006d7f0 0x7ff28006fca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff28800b7a0 tx=0x7ff288009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:29.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.352+0000 7ff292000700 1 -- 172.21.15.57:0/1190499660 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff28c056450 con 0x7ff29c070380 2024-02-28T16:08:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.674+0000 7ff29b200700 1 -- 172.21.15.57:0/1190499660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff29c115e90 con 0x7ff29c070380 2024-02-28T16:08:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.675+0000 7ff292000700 1 -- 172.21.15.57:0/1190499660 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff28c059b10 con 0x7ff29c070380 2024-02-28T16:08:29.667 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:08:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 -- 172.21.15.57:0/1190499660 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff28006d7f0 msgr2=0x7ff28006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff28006d7f0 0x7ff28006fca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff28800b7a0 tx=0x7ff288009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 -- 172.21.15.57:0/1190499660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff29c070380 msgr2=0x7ff29c113d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff29c070380 0x7ff29c113d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff28c002a50 tx=0x7ff28c0046b0 comp rx=0 tx=0).stop 2024-02-28T16:08:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 -- 172.21.15.57:0/1190499660 shutdown_connections 2024-02-28T16:08:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff28006d7f0 0x7ff28006fca0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff29c070380 0x7ff29c113d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 --2- 172.21.15.57:0/1190499660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff29c070cd0 0x7ff29c1142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 -- 172.21.15.57:0/1190499660 >> 172.21.15.57:0/1190499660 conn(0x7ff29c0f8400 msgr2=0x7ff29c0fa730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 -- 172.21.15.57:0/1190499660 shutdown_connections 2024-02-28T16:08:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:29.678+0000 7ff29b200700 1 -- 172.21.15.57:0/1190499660 wait complete. 2024-02-28T16:08:29.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:29 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:08:29.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:29 smithi057 ceph-mon[93219]: Upgrade: osd.3 is safe to restart 2024-02-28T16:08:29.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:29 smithi057 ceph-mon[93219]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:08:29.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:29 smithi057 ceph-mon[93219]: pgmap v153: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 2 op/s 2024-02-28T16:08:29.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:29 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3788018043' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:08:29.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:29 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:08:29.959 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:29 smithi087 ceph-mon[82628]: Upgrade: osd.3 is safe to restart 2024-02-28T16:08:29.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:29 smithi087 ceph-mon[82628]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:08:29.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:29 smithi087 ceph-mon[82628]: pgmap v153: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 2 op/s 2024-02-28T16:08:29.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:29 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3788018043' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:08:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:30 smithi057 ceph-mon[93219]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:08:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:30 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1190499660' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:08:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:30 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:30.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:30 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:08:30.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:30 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:08:30.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:30 smithi087 ceph-mon[82628]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:08:30.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:30 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1190499660' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:08:30.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:30 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:30.960 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:30 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:08:30.961 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:30 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:08:31.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:31 smithi057 ceph-mon[93219]: pgmap v154: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-02-28T16:08:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:31 smithi057 ceph-mon[93219]: Upgrade: Updating osd.3 2024-02-28T16:08:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:31 smithi057 ceph-mon[93219]: Deploying daemon osd.3 on smithi087 2024-02-28T16:08:31.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:31 smithi087 ceph-mon[82628]: pgmap v154: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-02-28T16:08:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:31 smithi087 ceph-mon[82628]: Upgrade: Updating osd.3 2024-02-28T16:08:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:31 smithi087 ceph-mon[82628]: Deploying daemon osd.3 on smithi087 2024-02-28T16:08:33.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:33 smithi057 ceph-mon[93219]: pgmap v155: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-02-28T16:08:33.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:33 smithi087 ceph-mon[82628]: pgmap v155: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-02-28T16:08:35.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:34 smithi057 ceph-mon[93219]: pgmap v156: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T16:08:35.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:35.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:08:35.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:35.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:34 smithi087 ceph-mon[82628]: pgmap v156: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T16:08:35.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:35.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:08:35.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:35.216 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:34 smithi087 systemd[1]: Stopping Ceph osd.3 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:08:35.715 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:35 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[42552]: 2024-02-28T16:08:35.267+0000 7f82d8c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:08:35.716 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:35 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[42552]: 2024-02-28T16:08:35.267+0000 7f82d8c00700 -1 osd.3 82 *** Got signal Terminated *** 2024-02-28T16:08:35.716 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:35 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[42552]: 2024-02-28T16:08:35.267+0000 7f82d8c00700 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:08:36.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:35 smithi057 ceph-mon[93219]: osd.3 marked itself down and dead 2024-02-28T16:08:36.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:35 smithi087 ceph-mon[82628]: osd.3 marked itself down and dead 2024-02-28T16:08:36.808 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:36 smithi087 podman[91528]: 2024-02-28 16:08:36.495347468 +0000 UTC m=+1.365277146 container died 13f3a1ca401a1a4f3aa214e9322f6a3b84847196b22126771a056d5023e05cdd (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=quincy-c0f02e6, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-02-28T16:08:37.162 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:36 smithi087 ceph-mon[82628]: pgmap v157: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-28T16:08:37.162 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:36 smithi087 ceph-mon[82628]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:08:37.162 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:36 smithi087 ceph-mon[82628]: osdmap e83: 6 total, 5 up, 6 in 2024-02-28T16:08:37.162 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:36 smithi087 podman[91528]: 2024-02-28 16:08:36.952851464 +0000 UTC m=+1.822781182 container cleanup 13f3a1ca401a1a4f3aa214e9322f6a3b84847196b22126771a056d5023e05cdd (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-c0f02e6, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-28T16:08:37.163 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:36 smithi087 bash[91528]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3 2024-02-28T16:08:37.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:36 smithi057 ceph-mon[93219]: pgmap v157: 65 pgs: 65 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-28T16:08:37.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:36 smithi057 ceph-mon[93219]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:08:37.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:36 smithi057 ceph-mon[93219]: osdmap e83: 6 total, 5 up, 6 in 2024-02-28T16:08:37.464 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:37 smithi087 podman[91547]: 2024-02-28 16:08:37.170669502 +0000 UTC m=+0.662585747 container remove 13f3a1ca401a1a4f3aa214e9322f6a3b84847196b22126771a056d5023e05cdd (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=quincy-c0f02e6, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-28T16:08:38.147 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:37 smithi087 ceph-mon[82628]: osdmap e84: 6 total, 5 up, 6 in 2024-02-28T16:08:38.147 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:37 smithi087 podman[91634]: 2024-02-28 16:08:37.874761433 +0000 UTC m=+0.031523264 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:08:38.147 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:37 smithi087 podman[91634]: 2024-02-28 16:08:37.996791509 +0000 UTC m=+0.153553365 container create 13f778ec82181f735198544cfaa9ef2a01b95ec84121a27fc8f60086218c4c88 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-28T16:08:38.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:37 smithi057 ceph-mon[93219]: osdmap e84: 6 total, 5 up, 6 in 2024-02-28T16:08:38.415 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:38 smithi087 podman[91634]: 2024-02-28 16:08:38.317129283 +0000 UTC m=+0.473891145 container init 13f778ec82181f735198544cfaa9ef2a01b95ec84121a27fc8f60086218c4c88 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:08:38.416 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:38 smithi087 podman[91634]: 2024-02-28 16:08:38.32908586 +0000 UTC m=+0.485847722 container start 13f778ec82181f735198544cfaa9ef2a01b95ec84121a27fc8f60086218c4c88 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-28T16:08:38.416 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:38 smithi087 podman[91634]: 2024-02-28 16:08:38.424231555 +0000 UTC m=+0.580993485 container attach 13f778ec82181f735198544cfaa9ef2a01b95ec84121a27fc8f60086218c4c88 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:08:39.080 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:38 smithi087 ceph-mon[82628]: pgmap v160: 65 pgs: 2 active+undersized, 3 active+undersized+degraded, 13 stale+active+clean, 47 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 11/333 objects degraded (3.303%) 2024-02-28T16:08:39.081 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:38 smithi087 ceph-mon[82628]: Health check failed: Degraded data redundancy: 11/333 objects degraded (3.303%), 3 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:39.081 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:38 smithi087 podman[91634]: 2024-02-28 16:08:38.758855454 +0000 UTC m=+0.915617320 container died 13f778ec82181f735198544cfaa9ef2a01b95ec84121a27fc8f60086218c4c88 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:08:39.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:38 smithi057 ceph-mon[93219]: pgmap v160: 65 pgs: 2 active+undersized, 3 active+undersized+degraded, 13 stale+active+clean, 47 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 11/333 objects degraded (3.303%) 2024-02-28T16:08:39.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:38 smithi057 ceph-mon[93219]: Health check failed: Degraded data redundancy: 11/333 objects degraded (3.303%), 3 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:39.715 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:39 smithi087 podman[91660]: 2024-02-28 16:08:39.461346684 +0000 UTC m=+0.685094055 container remove 13f778ec82181f735198544cfaa9ef2a01b95ec84121a27fc8f60086218c4c88 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, io.buildah.version=1.33.5) 2024-02-28T16:08:39.715 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:39 smithi087 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-28T16:08:39.715 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:39 smithi087 systemd[1]: Stopped Ceph osd.3 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:08:39.715 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:39 smithi087 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.3.service: Consumed 2min 12.196s CPU time. 2024-02-28T16:08:40.214 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:39 smithi087 systemd[1]: Starting Ceph osd.3 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:08:40.465 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:40 smithi087 podman[91756]: 2024-02-28 16:08:40.127633494 +0000 UTC m=+0.031180825 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:08:40.465 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:40 smithi087 podman[91756]: 2024-02-28 16:08:40.27143136 +0000 UTC m=+0.174978729 container create 80a150a12766c59d1148058ba6a97cfd706122c0a52a868317f9fbfa196445e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-02-28T16:08:40.849 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:40 smithi087 podman[91756]: 2024-02-28 16:08:40.522896973 +0000 UTC m=+0.426444345 container init 80a150a12766c59d1148058ba6a97cfd706122c0a52a868317f9fbfa196445e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:08:40.849 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:40 smithi087 podman[91756]: 2024-02-28 16:08:40.534966275 +0000 UTC m=+0.438513673 container start 80a150a12766c59d1148058ba6a97cfd706122c0a52a868317f9fbfa196445e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10) 2024-02-28T16:08:40.849 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:40 smithi087 podman[91756]: 2024-02-28 16:08:40.648505488 +0000 UTC m=+0.552052890 container attach 80a150a12766c59d1148058ba6a97cfd706122c0a52a868317f9fbfa196445e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-28T16:08:41.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:40 smithi057 ceph-mon[93219]: pgmap v161: 65 pgs: 12 active+undersized, 13 active+undersized+degraded, 3 stale+active+clean, 37 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-02-28T16:08:41.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:40 smithi087 ceph-mon[82628]: pgmap v161: 65 pgs: 12 active+undersized, 13 active+undersized+degraded, 3 stale+active+clean, 37 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-02-28T16:08:41.707 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate[91770]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:08:41.707 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate[91770]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:08:41.707 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 bash[91756]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:08:41.707 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 bash[91756]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:08:41.707 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 bash[91756]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:08:41.708 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 bash[91756]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:08:41.708 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 bash[91756]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-28T16:08:41.708 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 bash[91756]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:08:41.708 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 bash[91756]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-28T16:08:41.708 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate[91770]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:08:41.708 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate[91770]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:08:41.708 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate[91770]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-28T16:08:41.708 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate[91770]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:08:41.708 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate[91770]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-28T16:08:41.708 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:41 smithi087 podman[91756]: 2024-02-28 16:08:41.426089083 +0000 UTC m=+1.329636463 container died 80a150a12766c59d1148058ba6a97cfd706122c0a52a868317f9fbfa196445e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:08:42.464 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:42 smithi087 podman[91905]: 2024-02-28 16:08:42.302089933 +0000 UTC m=+0.855713905 container remove 80a150a12766c59d1148058ba6a97cfd706122c0a52a868317f9fbfa196445e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:08:42.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:42 smithi087 ceph-mon[82628]: pgmap v162: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/333 objects degraded (18.018%) 2024-02-28T16:08:42.965 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:42 smithi087 podman[91967]: 2024-02-28 16:08:42.565464265 +0000 UTC m=+0.033008256 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:08:42.965 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:42 smithi087 podman[91967]: 2024-02-28 16:08:42.702919702 +0000 UTC m=+0.170463718 container create 8d59e4ee9f7d6488aeca5245a003ed22bf9188370400daa040d0f9fe0c325c59 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:08:43.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:42 smithi057 ceph-mon[93219]: pgmap v162: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/333 objects degraded (18.018%) 2024-02-28T16:08:43.464 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:43 smithi087 podman[91967]: 2024-02-28 16:08:43.032319641 +0000 UTC m=+0.499863690 container init 8d59e4ee9f7d6488aeca5245a003ed22bf9188370400daa040d0f9fe0c325c59 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-02-28T16:08:43.465 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:43 smithi087 podman[91967]: 2024-02-28 16:08:43.042748277 +0000 UTC m=+0.510292300 container start 8d59e4ee9f7d6488aeca5245a003ed22bf9188370400daa040d0f9fe0c325c59 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10) 2024-02-28T16:08:43.465 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:43 smithi087 ceph-osd[91987]: -- 172.21.15.87:0/653674686 <== mon.1 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562a9c8eb680 con 0x562a9c8b5000 2024-02-28T16:08:43.465 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:43 smithi087 bash[91967]: 8d59e4ee9f7d6488aeca5245a003ed22bf9188370400daa040d0f9fe0c325c59 2024-02-28T16:08:43.465 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:43 smithi087 systemd[1]: Started Ceph osd.3 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:08:43.820 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:43 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:08:43.612+0000 7fab1b0bd7c0 -1 Falling back to public interface 2024-02-28T16:08:44.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:44.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:44.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:08:44.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:44.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:44.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:08:45.456 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:45 smithi087 ceph-mon[82628]: pgmap v163: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/333 objects degraded (18.018%) 2024-02-28T16:08:45.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:45 smithi057 ceph-mon[93219]: pgmap v163: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/333 objects degraded (18.018%) 2024-02-28T16:08:47.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:47 smithi057 ceph-mon[93219]: pgmap v164: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/333 objects degraded (18.018%) 2024-02-28T16:08:47.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:47 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 60/333 objects degraded (18.018%), 16 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:47.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:47 smithi087 ceph-mon[82628]: pgmap v164: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/333 objects degraded (18.018%) 2024-02-28T16:08:47.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:47 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 60/333 objects degraded (18.018%), 16 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:48.796 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:48.796 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:48.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:48.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:49.214 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:48 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:08:48.803+0000 7fab1b0bd7c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-28T16:08:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:49 smithi087 ceph-mon[82628]: pgmap v165: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/333 objects degraded (18.018%) 2024-02-28T16:08:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:08:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:49 smithi087 ceph-mon[82628]: from='osd.3 [v2:172.21.15.87:6800/2608240291,v1:172.21.15.87:6801/2608240291]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:08:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:49 smithi087 ceph-mon[82628]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:08:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:49.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:49.715 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:49 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:08:49.368+0000 7fab1b0bd7c0 -1 osd.3 82 log_to_monitors true 2024-02-28T16:08:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:49 smithi057 ceph-mon[93219]: pgmap v165: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/333 objects degraded (18.018%) 2024-02-28T16:08:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:08:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:49 smithi057 ceph-mon[93219]: from='osd.3 [v2:172.21.15.87:6800/2608240291,v1:172.21.15.87:6801/2608240291]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:08:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:49 smithi057 ceph-mon[93219]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:08:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:50.214 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:08:49 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:08:49.852+0000 7fab0a400700 -1 osd.3 82 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:08:51.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:50 smithi057 ceph-mon[93219]: pgmap v166: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/333 objects degraded (18.018%) 2024-02-28T16:08:51.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:50 smithi057 ceph-mon[93219]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T16:08:51.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:50 smithi057 ceph-mon[93219]: osdmap e85: 6 total, 5 up, 6 in 2024-02-28T16:08:51.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:50 smithi057 ceph-mon[93219]: from='osd.3 [v2:172.21.15.87:6800/2608240291,v1:172.21.15.87:6801/2608240291]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:08:51.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:50 smithi057 ceph-mon[93219]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:08:51.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:50 smithi087 ceph-mon[82628]: pgmap v166: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/333 objects degraded (18.018%) 2024-02-28T16:08:51.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:50 smithi087 ceph-mon[82628]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T16:08:51.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:50 smithi087 ceph-mon[82628]: osdmap e85: 6 total, 5 up, 6 in 2024-02-28T16:08:51.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:50 smithi087 ceph-mon[82628]: from='osd.3 [v2:172.21.15.87:6800/2608240291,v1:172.21.15.87:6801/2608240291]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:08:51.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:50 smithi087 ceph-mon[82628]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:08:52.046 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:51 smithi087 ceph-mon[82628]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:08:52.047 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:51 smithi087 ceph-mon[82628]: osd.3 [v2:172.21.15.87:6800/2608240291,v1:172.21.15.87:6801/2608240291] boot 2024-02-28T16:08:52.047 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:51 smithi087 ceph-mon[82628]: osdmap e86: 6 total, 6 up, 6 in 2024-02-28T16:08:52.047 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:08:52.047 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:51 smithi087 ceph-mon[82628]: osdmap e87: 6 total, 6 up, 6 in 2024-02-28T16:08:52.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:51 smithi057 ceph-mon[93219]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:08:52.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:51 smithi057 ceph-mon[93219]: osd.3 [v2:172.21.15.87:6800/2608240291,v1:172.21.15.87:6801/2608240291] boot 2024-02-28T16:08:52.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:51 smithi057 ceph-mon[93219]: osdmap e86: 6 total, 6 up, 6 in 2024-02-28T16:08:52.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:08:52.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:51 smithi057 ceph-mon[93219]: osdmap e87: 6 total, 6 up, 6 in 2024-02-28T16:08:53.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:52 smithi057 ceph-mon[93219]: pgmap v169: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 60/333 objects degraded (18.018%) 2024-02-28T16:08:53.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:52 smithi087 ceph-mon[82628]: pgmap v169: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 60/333 objects degraded (18.018%) 2024-02-28T16:08:54.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:53 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 55/333 objects degraded (16.517%), 14 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:54.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:53 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 55/333 objects degraded (16.517%), 14 pgs degraded (PG_DEGRADED) 2024-02-28T16:08:55.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:54 smithi057 ceph-mon[93219]: pgmap v171: 65 pgs: 13 active+undersized, 14 active+undersized+degraded, 38 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:08:55.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:54 smithi087 ceph-mon[82628]: pgmap v171: 65 pgs: 13 active+undersized, 14 active+undersized+degraded, 38 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:08:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:08:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:08:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:08:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:56.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:56.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:08:56.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:08:56.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:56 smithi057 ceph-mon[93219]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-02-28T16:08:56.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:56.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:56.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:08:56.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:08:56.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:08:56.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:08:56.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:56.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:56.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:08:56.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:08:56.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:08:56.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:56 smithi087 ceph-mon[82628]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-02-28T16:08:57.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:57 smithi057 ceph-mon[93219]: pgmap v172: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-02-28T16:08:57.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:57 smithi057 ceph-mon[93219]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/333 objects degraded (16.517%), 14 pgs degraded) 2024-02-28T16:08:57.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:57 smithi057 ceph-mon[93219]: Cluster is now healthy 2024-02-28T16:08:57.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:57 smithi087 ceph-mon[82628]: pgmap v172: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-02-28T16:08:57.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:57 smithi087 ceph-mon[82628]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/333 objects degraded (16.517%), 14 pgs degraded) 2024-02-28T16:08:57.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:57 smithi087 ceph-mon[82628]: Cluster is now healthy 2024-02-28T16:08:59.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:08:59 smithi057 ceph-mon[93219]: pgmap v173: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 896 B/s rd, 2 op/s 2024-02-28T16:08:59.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:08:59 smithi087 ceph-mon[82628]: pgmap v173: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 896 B/s rd, 2 op/s 2024-02-28T16:08:59.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.853+0000 7f079d200700 1 -- 172.21.15.57:0/1637145232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0798100380 msgr2=0x7f07981007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:59.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.853+0000 7f079d200700 1 --2- 172.21.15.57:0/1637145232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0798100380 0x7f07981007d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0784004940 tx=0x7f0784009e30 comp rx=0 tx=0).stop 2024-02-28T16:08:59.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.853+0000 7f079d200700 1 -- 172.21.15.57:0/1637145232 shutdown_connections 2024-02-28T16:08:59.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.853+0000 7f079d200700 1 --2- 172.21.15.57:0/1637145232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0798100380 0x7f07981007d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:59.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.853+0000 7f079d200700 1 --2- 172.21.15.57:0/1637145232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07980ff170 0x7f07980ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:59.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.853+0000 7f079d200700 1 -- 172.21.15.57:0/1637145232 >> 172.21.15.57:0/1637145232 conn(0x7f07980fa920 msgr2=0x7f07980fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:08:59.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.854+0000 7f079d200700 1 -- 172.21.15.57:0/1637145232 shutdown_connections 2024-02-28T16:08:59.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.854+0000 7f079d200700 1 -- 172.21.15.57:0/1637145232 wait complete. 2024-02-28T16:08:59.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.855+0000 7f079d200700 1 Processor -- start 2024-02-28T16:08:59.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.855+0000 7f079d200700 1 -- start start 2024-02-28T16:08:59.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.855+0000 7f079d200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980ff170 0x7f079810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:59.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.855+0000 7f079d200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0798100380 0x7f07981100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:59.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.855+0000 7f079d200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07981106d0 con 0x7f07980ff170 2024-02-28T16:08:59.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.855+0000 7f079d200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0798110f70 con 0x7f0798100380 2024-02-28T16:08:59.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.856+0000 7f0795e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980ff170 0x7f079810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:59.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.856+0000 7f0795e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980ff170 0x7f079810fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49066/0 (socket says 172.21.15.57:49066) 2024-02-28T16:08:59.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.856+0000 7f0795e00700 1 -- 172.21.15.57:0/359644427 learned_addr learned my addr 172.21.15.57:0/359644427 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:08:59.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.856+0000 7f0795400700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0798100380 0x7f07981100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:59.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.856+0000 7f0795e00700 1 -- 172.21.15.57:0/359644427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0798100380 msgr2=0x7f07981100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:08:59.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.856+0000 7f0795e00700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0798100380 0x7f07981100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:08:59.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.856+0000 7f0795e00700 1 -- 172.21.15.57:0/359644427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0784005040 con 0x7f07980ff170 2024-02-28T16:08:59.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.857+0000 7f0795e00700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980ff170 0x7f079810fb90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0788002a80 tx=0x7f0788004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:59.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.857+0000 7f078e000700 1 -- 172.21.15.57:0/359644427 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0788007cc0 con 0x7f07980ff170 2024-02-28T16:08:59.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.857+0000 7f078e000700 1 -- 172.21.15.57:0/359644427 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f078800f040 con 0x7f07980ff170 2024-02-28T16:08:59.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.857+0000 7f079d200700 1 -- 172.21.15.57:0/359644427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0798111250 con 0x7f07980ff170 2024-02-28T16:08:59.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.857+0000 7f078e000700 1 -- 172.21.15.57:0/359644427 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f078800dad0 con 0x7f07980ff170 2024-02-28T16:08:59.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.857+0000 7f079d200700 1 -- 172.21.15.57:0/359644427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0798111790 con 0x7f07980ff170 2024-02-28T16:08:59.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.858+0000 7f079d200700 1 -- 172.21.15.57:0/359644427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079804bed0 con 0x7f07980ff170 2024-02-28T16:08:59.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.859+0000 7f078e000700 1 -- 172.21.15.57:0/359644427 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f078800dc30 con 0x7f07980ff170 2024-02-28T16:08:59.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.860+0000 7f078e000700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f077c06d7f0 0x7f077c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:08:59.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.860+0000 7f078e000700 1 -- 172.21.15.57:0/359644427 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f078808cdd0 con 0x7f07980ff170 2024-02-28T16:08:59.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.861+0000 7f0795400700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f077c06d7f0 0x7f077c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:08:59.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.861+0000 7f0795400700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f077c06d7f0 0x7f077c06fca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f078400b020 tx=0x7f0784009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:08:59.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:08:59.866+0000 7f078e000700 1 -- 172.21.15.57:0/359644427 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f078805a000 con 0x7f07980ff170 2024-02-28T16:09:00.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.115+0000 7f079d200700 1 -- 172.21.15.57:0/359644427 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0798111df0 con 0x7f077c06d7f0 2024-02-28T16:09:00.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.117+0000 7f078e000700 1 -- 172.21.15.57:0/359644427 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0798111df0 con 0x7f077c06d7f0 2024-02-28T16:09:00.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.120+0000 7f079d200700 1 -- 172.21.15.57:0/359644427 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f077c06d7f0 msgr2=0x7f077c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:00.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.121+0000 7f079d200700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f077c06d7f0 0x7f077c06fca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f078400b020 tx=0x7f0784009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:00.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.121+0000 7f079d200700 1 -- 172.21.15.57:0/359644427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980ff170 msgr2=0x7f079810fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:00.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.121+0000 7f079d200700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980ff170 0x7f079810fb90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0788002a80 tx=0x7f0788004600 comp rx=0 tx=0).stop 2024-02-28T16:09:00.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.121+0000 7f079d200700 1 -- 172.21.15.57:0/359644427 shutdown_connections 2024-02-28T16:09:00.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.121+0000 7f079d200700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f077c06d7f0 0x7f077c06fca0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.121+0000 7f079d200700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980ff170 0x7f079810fb90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.121+0000 7f079d200700 1 --2- 172.21.15.57:0/359644427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0798100380 0x7f07981100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.121+0000 7f079d200700 1 -- 172.21.15.57:0/359644427 >> 172.21.15.57:0/359644427 conn(0x7f07980fa920 msgr2=0x7f07981035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:00.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.121+0000 7f079d200700 1 -- 172.21.15.57:0/359644427 shutdown_connections 2024-02-28T16:09:00.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.121+0000 7f079d200700 1 -- 172.21.15.57:0/359644427 wait complete. 2024-02-28T16:09:00.130 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:09:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.284+0000 7f8169800700 1 -- 172.21.15.57:0/462635429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8164103540 msgr2=0x7f8164103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.284+0000 7f8169800700 1 --2- 172.21.15.57:0/462635429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8164103540 0x7f8164103950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8154009ce0 tx=0x7f8154004d10 comp rx=0 tx=0).stop 2024-02-28T16:09:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.285+0000 7f8169800700 1 -- 172.21.15.57:0/462635429 shutdown_connections 2024-02-28T16:09:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.285+0000 7f8169800700 1 --2- 172.21.15.57:0/462635429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8164104750 0x7f8164104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.285+0000 7f8169800700 1 --2- 172.21.15.57:0/462635429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8164103540 0x7f8164103950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.285+0000 7f8169800700 1 -- 172.21.15.57:0/462635429 >> 172.21.15.57:0/462635429 conn(0x7f81640727d0 msgr2=0x7f8164074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.285+0000 7f8169800700 1 -- 172.21.15.57:0/462635429 shutdown_connections 2024-02-28T16:09:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.285+0000 7f8169800700 1 -- 172.21.15.57:0/462635429 wait complete. 2024-02-28T16:09:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.286+0000 7f8169800700 1 Processor -- start 2024-02-28T16:09:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.286+0000 7f8169800700 1 -- start start 2024-02-28T16:09:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.286+0000 7f8169800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8164103540 0x7f8164114120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.286+0000 7f8169800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8164104750 0x7f8164114660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.286+0000 7f8169800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8164114c60 con 0x7f8164104750 2024-02-28T16:09:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.286+0000 7f8169800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8164115500 con 0x7f8164103540 2024-02-28T16:09:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.286+0000 7f815a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8164104750 0x7f8164114660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.287+0000 7f815a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8164104750 0x7f8164114660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49072/0 (socket says 172.21.15.57:49072) 2024-02-28T16:09:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.287+0000 7f815a000700 1 -- 172.21.15.57:0/3983046353 learned_addr learned my addr 172.21.15.57:0/3983046353 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.287+0000 7f8162a00700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8164103540 0x7f8164114120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:00.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.287+0000 7f815a000700 1 -- 172.21.15.57:0/3983046353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8164103540 msgr2=0x7f8164114120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.287+0000 7f815a000700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8164103540 0x7f8164114120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.287+0000 7f815a000700 1 -- 172.21.15.57:0/3983046353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8154009940 con 0x7f8164104750 2024-02-28T16:09:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.287+0000 7f815a000700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8164104750 0x7f8164114660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f814c002a50 tx=0x7f814c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.288+0000 7f815b400700 1 -- 172.21.15.57:0/3983046353 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f814c007cc0 con 0x7f8164104750 2024-02-28T16:09:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.288+0000 7f815b400700 1 -- 172.21.15.57:0/3983046353 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f814c00f040 con 0x7f8164104750 2024-02-28T16:09:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.288+0000 7f8169800700 1 -- 172.21.15.57:0/3983046353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81641157e0 con 0x7f8164104750 2024-02-28T16:09:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.288+0000 7f815b400700 1 -- 172.21.15.57:0/3983046353 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f814c009640 con 0x7f8164104750 2024-02-28T16:09:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.288+0000 7f8169800700 1 -- 172.21.15.57:0/3983046353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8164115d20 con 0x7f8164104750 2024-02-28T16:09:00.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.289+0000 7f8169800700 1 -- 172.21.15.57:0/3983046353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816404bed0 con 0x7f8164104750 2024-02-28T16:09:00.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.290+0000 7f815b400700 1 -- 172.21.15.57:0/3983046353 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f814c0097a0 con 0x7f8164104750 2024-02-28T16:09:00.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.291+0000 7f815b400700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f814806d7f0 0x7f814806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:00.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.291+0000 7f815b400700 1 -- 172.21.15.57:0/3983046353 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f814c08cd10 con 0x7f8164104750 2024-02-28T16:09:00.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.291+0000 7f8162a00700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f814806d7f0 0x7f814806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:00.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.292+0000 7f8162a00700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f814806d7f0 0x7f814806fca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8154009470 tx=0x7f8154004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:00.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.296+0000 7f815b400700 1 -- 172.21.15.57:0/3983046353 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f814c059fc0 con 0x7f8164104750 2024-02-28T16:09:00.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.533+0000 7f8169800700 1 -- 172.21.15.57:0/3983046353 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81641161c0 con 0x7f814806d7f0 2024-02-28T16:09:00.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.535+0000 7f815b400700 1 -- 172.21.15.57:0/3983046353 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f81641161c0 con 0x7f814806d7f0 2024-02-28T16:09:00.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.537+0000 7f8169800700 1 -- 172.21.15.57:0/3983046353 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f814806d7f0 msgr2=0x7f814806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:00.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.537+0000 7f8169800700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f814806d7f0 0x7f814806fca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8154009470 tx=0x7f8154004d10 comp rx=0 tx=0).stop 2024-02-28T16:09:00.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.537+0000 7f8169800700 1 -- 172.21.15.57:0/3983046353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8164104750 msgr2=0x7f8164114660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:00.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.537+0000 7f8169800700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8164104750 0x7f8164114660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f814c002a50 tx=0x7f814c0046b0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.538+0000 7f8169800700 1 -- 172.21.15.57:0/3983046353 shutdown_connections 2024-02-28T16:09:00.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.538+0000 7f8169800700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f814806d7f0 0x7f814806fca0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.538+0000 7f8169800700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8164103540 0x7f8164114120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.538+0000 7f8169800700 1 --2- 172.21.15.57:0/3983046353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8164104750 0x7f8164114660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.538+0000 7f8169800700 1 -- 172.21.15.57:0/3983046353 >> 172.21.15.57:0/3983046353 conn(0x7f81640727d0 msgr2=0x7f8164107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:00.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.538+0000 7f8169800700 1 -- 172.21.15.57:0/3983046353 shutdown_connections 2024-02-28T16:09:00.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.538+0000 7f8169800700 1 -- 172.21.15.57:0/3983046353 wait complete. 2024-02-28T16:09:00.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.690+0000 7fde84800700 1 -- 172.21.15.57:0/870689593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde7c104750 msgr2=0x7fde7c104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:00.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.690+0000 7fde84800700 1 --2- 172.21.15.57:0/870689593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde7c104750 0x7fde7c104ba0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fde6c004940 tx=0x7fde6c009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:00.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.690+0000 7fde84800700 1 -- 172.21.15.57:0/870689593 shutdown_connections 2024-02-28T16:09:00.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.690+0000 7fde84800700 1 --2- 172.21.15.57:0/870689593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde7c104750 0x7fde7c104ba0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.690+0000 7fde84800700 1 --2- 172.21.15.57:0/870689593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde7c103540 0x7fde7c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.690+0000 7fde84800700 1 -- 172.21.15.57:0/870689593 >> 172.21.15.57:0/870689593 conn(0x7fde7c0727d0 msgr2=0x7fde7c074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:00.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.690+0000 7fde84800700 1 -- 172.21.15.57:0/870689593 shutdown_connections 2024-02-28T16:09:00.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.690+0000 7fde84800700 1 -- 172.21.15.57:0/870689593 wait complete. 2024-02-28T16:09:00.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.691+0000 7fde84800700 1 Processor -- start 2024-02-28T16:09:00.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.691+0000 7fde84800700 1 -- start start 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde84800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde7c103540 0x7fde7c113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde84800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde7c104750 0x7fde7c1144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde84800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c114aa0 con 0x7fde7c103540 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde84800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c115340 con 0x7fde7c104750 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde81e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde7c103540 0x7fde7c113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde81e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde7c103540 0x7fde7c113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49090/0 (socket says 172.21.15.57:49090) 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde81e00700 1 -- 172.21.15.57:0/87191104 learned_addr learned my addr 172.21.15.57:0/87191104 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde81400700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde7c104750 0x7fde7c1144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde81e00700 1 -- 172.21.15.57:0/87191104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde7c104750 msgr2=0x7fde7c1144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde81e00700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde7c104750 0x7fde7c1144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.692+0000 7fde81e00700 1 -- 172.21.15.57:0/87191104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c005040 con 0x7fde7c103540 2024-02-28T16:09:00.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.693+0000 7fde81e00700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde7c103540 0x7fde7c113f60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde70002a80 tx=0x7fde70004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:00.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.693+0000 7fde76000700 1 -- 172.21.15.57:0/87191104 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde70007cc0 con 0x7fde7c103540 2024-02-28T16:09:00.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.693+0000 7fde76000700 1 -- 172.21.15.57:0/87191104 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde7000f040 con 0x7fde7c103540 2024-02-28T16:09:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.693+0000 7fde76000700 1 -- 172.21.15.57:0/87191104 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde7000dad0 con 0x7fde7c103540 2024-02-28T16:09:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.693+0000 7fde84800700 1 -- 172.21.15.57:0/87191104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c115620 con 0x7fde7c103540 2024-02-28T16:09:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.693+0000 7fde84800700 1 -- 172.21.15.57:0/87191104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c115b60 con 0x7fde7c103540 2024-02-28T16:09:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.694+0000 7fde84800700 1 -- 172.21.15.57:0/87191104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c04bed0 con 0x7fde7c103540 2024-02-28T16:09:00.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.695+0000 7fde76000700 1 -- 172.21.15.57:0/87191104 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fde7000dc30 con 0x7fde7c103540 2024-02-28T16:09:00.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.696+0000 7fde76000700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde6406d7f0 0x7fde6406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:00.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.696+0000 7fde76000700 1 -- 172.21.15.57:0/87191104 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fde7008cba0 con 0x7fde7c103540 2024-02-28T16:09:00.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.696+0000 7fde81400700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde6406d7f0 0x7fde6406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:00.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.697+0000 7fde81400700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde6406d7f0 0x7fde6406fca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00b020 tx=0x7fde6c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:00.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.701+0000 7fde76000700 1 -- 172.21.15.57:0/87191104 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fde70059dd0 con 0x7fde7c103540 2024-02-28T16:09:00.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.942+0000 7fde84800700 1 -- 172.21.15.57:0/87191104 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fde7c115fb0 con 0x7fde6406d7f0 2024-02-28T16:09:00.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.959+0000 7fde76000700 1 -- 172.21.15.57:0/87191104 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fde7c115fb0 con 0x7fde6406d7f0 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (7m) 41s ago 18m 14.2M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (3m) 41s ago 18m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (2m) 13s ago 16m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (6m) 41s ago 17m 75.3M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (10m) 41s ago 10m 125M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (10m) 41s ago 10m 68.0M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (10m) 13s ago 10m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (10m) 13s ago 10m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (6m) 41s ago 19m 506M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:09:00.951 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (5m) 13s ago 16m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (4m) 41s ago 19m 48.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (4m) 13s ago 16m 38.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (7m) 41s ago 18m 7906k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (6m) 13s ago 16m 7612k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (2m) 41s ago 15m 137M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (96s) 41s ago 15m 94.7M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (49s) 41s ago 14m 11.0M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (18s) 13s ago 13m 11.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (13m) 13s ago 13m 236M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 0b96b1484dbd 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (12m) 13s ago 12m 302M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:09:00.952 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (5m) 41s ago 17m 53.5M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.962+0000 7fde84800700 1 -- 172.21.15.57:0/87191104 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde6406d7f0 msgr2=0x7fde6406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:00.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.962+0000 7fde84800700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde6406d7f0 0x7fde6406fca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00b020 tx=0x7fde6c009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:00.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.962+0000 7fde84800700 1 -- 172.21.15.57:0/87191104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde7c103540 msgr2=0x7fde7c113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:00.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.962+0000 7fde84800700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde7c103540 0x7fde7c113f60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde70002a80 tx=0x7fde70004600 comp rx=0 tx=0).stop 2024-02-28T16:09:00.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.962+0000 7fde84800700 1 -- 172.21.15.57:0/87191104 shutdown_connections 2024-02-28T16:09:00.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.962+0000 7fde84800700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fde6406d7f0 0x7fde6406fca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.962+0000 7fde84800700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde7c103540 0x7fde7c113f60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.962+0000 7fde84800700 1 --2- 172.21.15.57:0/87191104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde7c104750 0x7fde7c1144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:00.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.962+0000 7fde84800700 1 -- 172.21.15.57:0/87191104 >> 172.21.15.57:0/87191104 conn(0x7fde7c0727d0 msgr2=0x7fde7c107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:00.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.962+0000 7fde84800700 1 -- 172.21.15.57:0/87191104 shutdown_connections 2024-02-28T16:09:00.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:00.963+0000 7fde84800700 1 -- 172.21.15.57:0/87191104 wait complete. 2024-02-28T16:09:01.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.120+0000 7f1796600700 1 -- 172.21.15.57:0/415055273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17900fe0e0 msgr2=0x7f17900fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:01.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.120+0000 7f1796600700 1 --2- 172.21.15.57:0/415055273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17900fe0e0 0x7f17900fe550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f177c004940 tx=0x7f177c009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:01.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.120+0000 7f1796600700 1 -- 172.21.15.57:0/415055273 shutdown_connections 2024-02-28T16:09:01.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.120+0000 7f1796600700 1 --2- 172.21.15.57:0/415055273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17900fe0e0 0x7f17900fe550 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.120+0000 7f1796600700 1 --2- 172.21.15.57:0/415055273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17900fcef0 0x7f17900fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.120+0000 7f1796600700 1 -- 172.21.15.57:0/415055273 >> 172.21.15.57:0/415055273 conn(0x7f17900f8620 msgr2=0x7f17900faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:01.112 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:01 smithi057 ceph-mon[93219]: pgmap v174: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T16:09:01.112 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:01 smithi057 ceph-mon[93219]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:01.112 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:01 smithi057 ceph-mon[93219]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.120+0000 7f1796600700 1 -- 172.21.15.57:0/415055273 shutdown_connections 2024-02-28T16:09:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.120+0000 7f1796600700 1 -- 172.21.15.57:0/415055273 wait complete. 2024-02-28T16:09:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.121+0000 7f1796600700 1 Processor -- start 2024-02-28T16:09:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.122+0000 7f1796600700 1 -- start start 2024-02-28T16:09:01.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.122+0000 7f1796600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17900fcef0 0x7f179010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:01.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.122+0000 7f1796600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17900fe0e0 0x7f17901100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:01.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.122+0000 7f1796600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17901106a0 con 0x7f17900fcef0 2024-02-28T16:09:01.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.122+0000 7f1796600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1790110f40 con 0x7f17900fe0e0 2024-02-28T16:09:01.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.122+0000 7f178f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17900fcef0 0x7f179010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:01.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.123+0000 7f178f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17900fcef0 0x7f179010fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49118/0 (socket says 172.21.15.57:49118) 2024-02-28T16:09:01.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.123+0000 7f178f400700 1 -- 172.21.15.57:0/3282014623 learned_addr learned my addr 172.21.15.57:0/3282014623 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:01.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.123+0000 7f178ea00700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17900fe0e0 0x7f17901100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.123+0000 7f178f400700 1 -- 172.21.15.57:0/3282014623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17900fe0e0 msgr2=0x7f17901100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.123+0000 7f178f400700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17900fe0e0 0x7f17901100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.123+0000 7f178f400700 1 -- 172.21.15.57:0/3282014623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c005040 con 0x7f17900fcef0 2024-02-28T16:09:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.123+0000 7f178f400700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17900fcef0 0x7f179010fb60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1780002a80 tx=0x7f1780004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.124+0000 7f1787400700 1 -- 172.21.15.57:0/3282014623 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1780007cc0 con 0x7f17900fcef0 2024-02-28T16:09:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.124+0000 7f1787400700 1 -- 172.21.15.57:0/3282014623 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f178000f040 con 0x7f17900fcef0 2024-02-28T16:09:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.124+0000 7f1796600700 1 -- 172.21.15.57:0/3282014623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1790111220 con 0x7f17900fcef0 2024-02-28T16:09:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.124+0000 7f1787400700 1 -- 172.21.15.57:0/3282014623 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178000dad0 con 0x7f17900fcef0 2024-02-28T16:09:01.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.124+0000 7f1796600700 1 -- 172.21.15.57:0/3282014623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1790111760 con 0x7f17900fcef0 2024-02-28T16:09:01.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.125+0000 7f1796600700 1 -- 172.21.15.57:0/3282014623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1790102210 con 0x7f17900fcef0 2024-02-28T16:09:01.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.126+0000 7f1787400700 1 -- 172.21.15.57:0/3282014623 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f178000dc30 con 0x7f17900fcef0 2024-02-28T16:09:01.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.127+0000 7f1787400700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f177406d7f0 0x7f177406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:01.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.127+0000 7f1787400700 1 -- 172.21.15.57:0/3282014623 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f178008cc10 con 0x7f17900fcef0 2024-02-28T16:09:01.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.127+0000 7f178ea00700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f177406d7f0 0x7f177406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:01.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.128+0000 7f178ea00700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f177406d7f0 0x7f177406fca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f177c00b020 tx=0x7f177c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:01.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.132+0000 7f1787400700 1 -- 172.21.15.57:0/3282014623 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1780059f60 con 0x7f17900fcef0 2024-02-28T16:09:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.456+0000 7f1796600700 1 -- 172.21.15.57:0/3282014623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1790111a00 con 0x7f17900fcef0 2024-02-28T16:09:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.457+0000 7f1787400700 1 -- 172.21.15.57:0/3282014623 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f1780059af0 con 0x7f17900fcef0 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2, 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:09:01.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:09:01.450 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:09:01.450 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:09:01.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:09:01.450 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:09:01.450 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6, 2024-02-28T16:09:01.450 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 8 2024-02-28T16:09:01.450 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:09:01.450 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:09:01.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 -- 172.21.15.57:0/3282014623 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f177406d7f0 msgr2=0x7f177406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:01.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f177406d7f0 0x7f177406fca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f177c00b020 tx=0x7f177c009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:01.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 -- 172.21.15.57:0/3282014623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17900fcef0 msgr2=0x7f179010fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:01.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17900fcef0 0x7f179010fb60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1780002a80 tx=0x7f1780004600 comp rx=0 tx=0).stop 2024-02-28T16:09:01.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 -- 172.21.15.57:0/3282014623 shutdown_connections 2024-02-28T16:09:01.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f177406d7f0 0x7f177406fca0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17900fcef0 0x7f179010fb60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 --2- 172.21.15.57:0/3282014623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17900fe0e0 0x7f17901100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 -- 172.21.15.57:0/3282014623 >> 172.21.15.57:0/3282014623 conn(0x7f17900f8620 msgr2=0x7f17900ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:01.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 -- 172.21.15.57:0/3282014623 shutdown_connections 2024-02-28T16:09:01.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.460+0000 7f1796600700 1 -- 172.21.15.57:0/3282014623 wait complete. 2024-02-28T16:09:01.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:01 smithi087 ceph-mon[82628]: pgmap v174: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T16:09:01.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:01 smithi087 ceph-mon[82628]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:01.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:01 smithi087 ceph-mon[82628]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.605+0000 7f356d200700 1 -- 172.21.15.57:0/1349010421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35680fc990 msgr2=0x7f35680fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.605+0000 7f356d200700 1 --2- 172.21.15.57:0/1349010421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35680fc990 0x7f35680fcde0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3554004940 tx=0x7f3554009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.605+0000 7f356d200700 1 -- 172.21.15.57:0/1349010421 shutdown_connections 2024-02-28T16:09:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.605+0000 7f356d200700 1 --2- 172.21.15.57:0/1349010421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35680fc990 0x7f35680fcde0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.605+0000 7f356d200700 1 --2- 172.21.15.57:0/1349010421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35680fe440 0x7f35680fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.605+0000 7f356d200700 1 -- 172.21.15.57:0/1349010421 >> 172.21.15.57:0/1349010421 conn(0x7f35680f8400 msgr2=0x7f35680fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.605+0000 7f356d200700 1 -- 172.21.15.57:0/1349010421 shutdown_connections 2024-02-28T16:09:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.605+0000 7f356d200700 1 -- 172.21.15.57:0/1349010421 wait complete. 2024-02-28T16:09:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.606+0000 7f356d200700 1 Processor -- start 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.606+0000 7f356d200700 1 -- start start 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.606+0000 7f356d200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35680fc990 0x7f356810f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.606+0000 7f356d200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35680fe440 0x7f356810fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.606+0000 7f356d200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3568110470 con 0x7f35680fc990 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.606+0000 7f356d200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3568110d10 con 0x7f35680fe440 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.607+0000 7f3567400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35680fc990 0x7f356810f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.607+0000 7f3567400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35680fc990 0x7f356810f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49144/0 (socket says 172.21.15.57:49144) 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.607+0000 7f3567400700 1 -- 172.21.15.57:0/7976880 learned_addr learned my addr 172.21.15.57:0/7976880 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.607+0000 7f3566a00700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35680fe440 0x7f356810fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.607+0000 7f3567400700 1 -- 172.21.15.57:0/7976880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35680fe440 msgr2=0x7f356810fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.607+0000 7f3567400700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35680fe440 0x7f356810fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.607+0000 7f3567400700 1 -- 172.21.15.57:0/7976880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554005040 con 0x7f35680fc990 2024-02-28T16:09:01.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.607+0000 7f3567400700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35680fc990 0x7f356810f930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3558002a80 tx=0x7f3558004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:01.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.608+0000 7f355f400700 1 -- 172.21.15.57:0/7976880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3558007cc0 con 0x7f35680fc990 2024-02-28T16:09:01.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.608+0000 7f355f400700 1 -- 172.21.15.57:0/7976880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f355800f040 con 0x7f35680fc990 2024-02-28T16:09:01.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.608+0000 7f355f400700 1 -- 172.21.15.57:0/7976880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f355800dad0 con 0x7f35680fc990 2024-02-28T16:09:01.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.608+0000 7f356d200700 1 -- 172.21.15.57:0/7976880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3568110ff0 con 0x7f35680fc990 2024-02-28T16:09:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.608+0000 7f356d200700 1 -- 172.21.15.57:0/7976880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3568111530 con 0x7f35680fc990 2024-02-28T16:09:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.609+0000 7f356d200700 1 -- 172.21.15.57:0/7976880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3568102010 con 0x7f35680fc990 2024-02-28T16:09:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.610+0000 7f355f400700 1 -- 172.21.15.57:0/7976880 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f355800dc30 con 0x7f35680fc990 2024-02-28T16:09:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.611+0000 7f355f400700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f354c06d7f0 0x7f354c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.611+0000 7f355f400700 1 -- 172.21.15.57:0/7976880 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f355808ca50 con 0x7f35680fc990 2024-02-28T16:09:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.611+0000 7f3566a00700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f354c06d7f0 0x7f354c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:01.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.612+0000 7f3566a00700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f354c06d7f0 0x7f354c06fca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f355400b3b0 tx=0x7f3554009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:01.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.616+0000 7f355f400700 1 -- 172.21.15.57:0/7976880 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3558059da0 con 0x7f35680fc990 2024-02-28T16:09:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.910+0000 7f356d200700 1 -- 172.21.15.57:0/7976880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f35681118a0 con 0x7f35680fc990 2024-02-28T16:09:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.911+0000 7f355f400700 1 -- 172.21.15.57:0/7976880 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1863 (secure 0 0 0) 0x7f3558059930 con 0x7f35680fc990 2024-02-28T16:09:01.903 INFO:teuthology.orchestra.run.smithi057.stdout:e18 2024-02-28T16:09:01.903 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:09:01.903 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:09:01.903 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:09:01.903 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:09:01.903 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:09:01.903 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:09:01.903 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 18 2024-02-28T16:09:01.903 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:06:28.521002+0000 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:09:01.905 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:09:01.905 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:09:01.905 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:09:01.905 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:09:01.905 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:09:01.905 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:09:01.906 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:09:01.907 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:09:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.914+0000 7f356d200700 1 -- 172.21.15.57:0/7976880 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f354c06d7f0 msgr2=0x7f354c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.914+0000 7f356d200700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f354c06d7f0 0x7f354c06fca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f355400b3b0 tx=0x7f3554009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.914+0000 7f356d200700 1 -- 172.21.15.57:0/7976880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35680fc990 msgr2=0x7f356810f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.914+0000 7f356d200700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35680fc990 0x7f356810f930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3558002a80 tx=0x7f3558004600 comp rx=0 tx=0).stop 2024-02-28T16:09:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.914+0000 7f356d200700 1 -- 172.21.15.57:0/7976880 shutdown_connections 2024-02-28T16:09:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.914+0000 7f356d200700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f354c06d7f0 0x7f354c06fca0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.914+0000 7f356d200700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35680fc990 0x7f356810f930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.914+0000 7f356d200700 1 --2- 172.21.15.57:0/7976880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35680fe440 0x7f356810fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.914+0000 7f356d200700 1 -- 172.21.15.57:0/7976880 >> 172.21.15.57:0/7976880 conn(0x7f35680f8400 msgr2=0x7f35680ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.915+0000 7f356d200700 1 -- 172.21.15.57:0/7976880 shutdown_connections 2024-02-28T16:09:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:01.915+0000 7f356d200700 1 -- 172.21.15.57:0/7976880 wait complete. 2024-02-28T16:09:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-02-28T16:09:02.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.063+0000 7f7932a00700 1 -- 172.21.15.57:0/3543665026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f792c0fcef0 msgr2=0x7f792c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:02.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.063+0000 7f7932a00700 1 --2- 172.21.15.57:0/3543665026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f792c0fcef0 0x7f792c0fd320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f791c004940 tx=0x7f791c009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:02.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.064+0000 7f7932a00700 1 -- 172.21.15.57:0/3543665026 shutdown_connections 2024-02-28T16:09:02.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.064+0000 7f7932a00700 1 --2- 172.21.15.57:0/3543665026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f792c0fe0e0 0x7f792c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.064+0000 7f7932a00700 1 --2- 172.21.15.57:0/3543665026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f792c0fcef0 0x7f792c0fd320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.064+0000 7f7932a00700 1 -- 172.21.15.57:0/3543665026 >> 172.21.15.57:0/3543665026 conn(0x7f792c0f8620 msgr2=0x7f792c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:02.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.064+0000 7f7932a00700 1 -- 172.21.15.57:0/3543665026 shutdown_connections 2024-02-28T16:09:02.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.064+0000 7f7932a00700 1 -- 172.21.15.57:0/3543665026 wait complete. 2024-02-28T16:09:02.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.064+0000 7f7932a00700 1 Processor -- start 2024-02-28T16:09:02.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.065+0000 7f7932a00700 1 -- start start 2024-02-28T16:09:02.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.065+0000 7f7932a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f792c0fcef0 0x7f792c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:02.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.065+0000 7f7932a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f792c0fe0e0 0x7f792c110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:02.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.065+0000 7f7932a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c110780 con 0x7f792c0fcef0 2024-02-28T16:09:02.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.065+0000 7f7932a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c110fd0 con 0x7f792c0fe0e0 2024-02-28T16:09:02.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.065+0000 7f792be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f792c0fcef0 0x7f792c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:02.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.065+0000 7f792be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f792c0fcef0 0x7f792c10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54468/0 (socket says 172.21.15.57:54468) 2024-02-28T16:09:02.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.065+0000 7f792be00700 1 -- 172.21.15.57:0/2552002715 learned_addr learned my addr 172.21.15.57:0/2552002715 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:02.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.066+0000 7f792b400700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f792c0fe0e0 0x7f792c110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:02.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.066+0000 7f792be00700 1 -- 172.21.15.57:0/2552002715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f792c0fe0e0 msgr2=0x7f792c110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:02.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.066+0000 7f792be00700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f792c0fe0e0 0x7f792c110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.066+0000 7f792be00700 1 -- 172.21.15.57:0/2552002715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c005040 con 0x7f792c0fcef0 2024-02-28T16:09:02.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.066+0000 7f792be00700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f792c0fcef0 0x7f792c10fc40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f791c000c00 tx=0x7f791c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:02.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.066+0000 7f7923e00700 1 -- 172.21.15.57:0/2552002715 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f791c00e040 con 0x7f792c0fcef0 2024-02-28T16:09:02.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.067+0000 7f7923e00700 1 -- 172.21.15.57:0/2552002715 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f791c00bcc0 con 0x7f792c0fcef0 2024-02-28T16:09:02.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.067+0000 7f7932a00700 1 -- 172.21.15.57:0/2552002715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c111250 con 0x7f792c0fcef0 2024-02-28T16:09:02.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.067+0000 7f7923e00700 1 -- 172.21.15.57:0/2552002715 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f791c013ea0 con 0x7f792c0fcef0 2024-02-28T16:09:02.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.067+0000 7f7932a00700 1 -- 172.21.15.57:0/2552002715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c111790 con 0x7f792c0fcef0 2024-02-28T16:09:02.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.068+0000 7f7932a00700 1 -- 172.21.15.57:0/2552002715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792c102210 con 0x7f792c0fcef0 2024-02-28T16:09:02.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.069+0000 7f7923e00700 1 -- 172.21.15.57:0/2552002715 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f791c013420 con 0x7f792c0fcef0 2024-02-28T16:09:02.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.071+0000 7f7923e00700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f791006d7f0 0x7f791006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:02.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.071+0000 7f7923e00700 1 -- 172.21.15.57:0/2552002715 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f791c08edf0 con 0x7f792c0fcef0 2024-02-28T16:09:02.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.071+0000 7f792b400700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f791006d7f0 0x7f791006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:02.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.072+0000 7f792b400700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f791006d7f0 0x7f791006fca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7918007fd0 tx=0x7f7918009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:02.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.085+0000 7f7923e00700 1 -- 172.21.15.57:0/2552002715 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f791c05c1f0 con 0x7f792c0fcef0 2024-02-28T16:09:02.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:02 smithi057 ceph-mon[93219]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:02.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:02 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3282014623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:09:02.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:02 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/7976880' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:09:02.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.329+0000 7f7932a00700 1 -- 172.21.15.57:0/2552002715 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f792c111a70 con 0x7f791006d7f0 2024-02-28T16:09:02.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.331+0000 7f7923e00700 1 -- 172.21.15.57:0/2552002715 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f792c111a70 con 0x7f791006d7f0 2024-02-28T16:09:02.323 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:09:02.323 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:09:02.323 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:09:02.323 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:09:02.324 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:09:02.324 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:09:02.324 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:09:02.324 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:09:02.324 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:09:02.324 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "10/21 daemons upgraded", 2024-02-28T16:09:02.324 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:09:02.324 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:09:02.324 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:09:02.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.334+0000 7f7932a00700 1 -- 172.21.15.57:0/2552002715 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f791006d7f0 msgr2=0x7f791006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:02.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.334+0000 7f7932a00700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f791006d7f0 0x7f791006fca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7918007fd0 tx=0x7f7918009040 comp rx=0 tx=0).stop 2024-02-28T16:09:02.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.334+0000 7f7932a00700 1 -- 172.21.15.57:0/2552002715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f792c0fcef0 msgr2=0x7f792c10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:02.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.334+0000 7f7932a00700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f792c0fcef0 0x7f792c10fc40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f791c000c00 tx=0x7f791c009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:02.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.334+0000 7f7932a00700 1 -- 172.21.15.57:0/2552002715 shutdown_connections 2024-02-28T16:09:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.334+0000 7f7932a00700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f791006d7f0 0x7f791006fca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.334+0000 7f7932a00700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f792c0fcef0 0x7f792c10fc40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.334+0000 7f7932a00700 1 --2- 172.21.15.57:0/2552002715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f792c0fe0e0 0x7f792c110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.334+0000 7f7932a00700 1 -- 172.21.15.57:0/2552002715 >> 172.21.15.57:0/2552002715 conn(0x7f792c0f8620 msgr2=0x7f792c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.335+0000 7f7932a00700 1 -- 172.21.15.57:0/2552002715 shutdown_connections 2024-02-28T16:09:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.335+0000 7f7932a00700 1 -- 172.21.15.57:0/2552002715 wait complete. 2024-02-28T16:09:02.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:02 smithi087 ceph-mon[82628]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:02.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:02 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3282014623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:09:02.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:02 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/7976880' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:09:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.492+0000 7fcb69800700 1 -- 172.21.15.57:0/4261912826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb64100380 msgr2=0x7fcb641007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.492+0000 7fcb69800700 1 --2- 172.21.15.57:0/4261912826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb64100380 0x7fcb641007d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb50004940 tx=0x7fcb50009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.493+0000 7fcb69800700 1 -- 172.21.15.57:0/4261912826 shutdown_connections 2024-02-28T16:09:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.493+0000 7fcb69800700 1 --2- 172.21.15.57:0/4261912826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb64100380 0x7fcb641007d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.493+0000 7fcb69800700 1 --2- 172.21.15.57:0/4261912826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb640ff170 0x7fcb640ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.493+0000 7fcb69800700 1 -- 172.21.15.57:0/4261912826 >> 172.21.15.57:0/4261912826 conn(0x7fcb640fa920 msgr2=0x7fcb640fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.493+0000 7fcb69800700 1 -- 172.21.15.57:0/4261912826 shutdown_connections 2024-02-28T16:09:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.493+0000 7fcb69800700 1 -- 172.21.15.57:0/4261912826 wait complete. 2024-02-28T16:09:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.494+0000 7fcb69800700 1 Processor -- start 2024-02-28T16:09:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.494+0000 7fcb69800700 1 -- start start 2024-02-28T16:09:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.494+0000 7fcb69800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb640ff170 0x7fcb64072780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.495+0000 7fcb69800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb64100380 0x7fcb64072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.495+0000 7fcb69800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64073310 con 0x7fcb64100380 2024-02-28T16:09:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.495+0000 7fcb69800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64073bb0 con 0x7fcb640ff170 2024-02-28T16:09:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.495+0000 7fcb62000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb64100380 0x7fcb64072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.495+0000 7fcb62000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb64100380 0x7fcb64072cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54486/0 (socket says 172.21.15.57:54486) 2024-02-28T16:09:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.495+0000 7fcb62000700 1 -- 172.21.15.57:0/2173322188 learned_addr learned my addr 172.21.15.57:0/2173322188 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.495+0000 7fcb62a00700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb640ff170 0x7fcb64072780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.495+0000 7fcb62000700 1 -- 172.21.15.57:0/2173322188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb640ff170 msgr2=0x7fcb64072780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.495+0000 7fcb62000700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb640ff170 0x7fcb64072780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.495+0000 7fcb62000700 1 -- 172.21.15.57:0/2173322188 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50005040 con 0x7fcb64100380 2024-02-28T16:09:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.496+0000 7fcb62000700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb64100380 0x7fcb64072cc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000b3b0 tx=0x7fcb50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.496+0000 7fcb5aa00700 1 -- 172.21.15.57:0/2173322188 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5000e040 con 0x7fcb64100380 2024-02-28T16:09:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.496+0000 7fcb5aa00700 1 -- 172.21.15.57:0/2173322188 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb5000bd90 con 0x7fcb64100380 2024-02-28T16:09:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.496+0000 7fcb5aa00700 1 -- 172.21.15.57:0/2173322188 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5001c630 con 0x7fcb64100380 2024-02-28T16:09:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.496+0000 7fcb69800700 1 -- 172.21.15.57:0/2173322188 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb64073e30 con 0x7fcb64100380 2024-02-28T16:09:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.496+0000 7fcb69800700 1 -- 172.21.15.57:0/2173322188 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb64074370 con 0x7fcb64100380 2024-02-28T16:09:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.497+0000 7fcb69800700 1 -- 172.21.15.57:0/2173322188 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6404bed0 con 0x7fcb64100380 2024-02-28T16:09:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.499+0000 7fcb5aa00700 1 -- 172.21.15.57:0/2173322188 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fcb500139f0 con 0x7fcb64100380 2024-02-28T16:09:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.499+0000 7fcb5aa00700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcb4806d8c0 0x7fcb4806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:02.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.500+0000 7fcb5aa00700 1 -- 172.21.15.57:0/2173322188 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fcb5008e460 con 0x7fcb64100380 2024-02-28T16:09:02.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.500+0000 7fcb62a00700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcb4806d8c0 0x7fcb4806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:02.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.500+0000 7fcb62a00700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcb4806d8c0 0x7fcb4806fd70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009fd0 tx=0x7fcb54009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.504+0000 7fcb5aa00700 1 -- 172.21.15.57:0/2173322188 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcb50057c60 con 0x7fcb64100380 2024-02-28T16:09:02.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.820+0000 7fcb69800700 1 -- 172.21.15.57:0/2173322188 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcb64107c50 con 0x7fcb64100380 2024-02-28T16:09:02.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.821+0000 7fcb5aa00700 1 -- 172.21.15.57:0/2173322188 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcb5005b320 con 0x7fcb64100380 2024-02-28T16:09:02.812 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:09:02.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.823+0000 7fcb69800700 1 -- 172.21.15.57:0/2173322188 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcb4806d8c0 msgr2=0x7fcb4806fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:02.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.823+0000 7fcb69800700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcb4806d8c0 0x7fcb4806fd70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009fd0 tx=0x7fcb54009f00 comp rx=0 tx=0).stop 2024-02-28T16:09:02.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.823+0000 7fcb69800700 1 -- 172.21.15.57:0/2173322188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb64100380 msgr2=0x7fcb64072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:02.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.823+0000 7fcb69800700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb64100380 0x7fcb64072cc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000b3b0 tx=0x7fcb50009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:02.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.824+0000 7fcb69800700 1 -- 172.21.15.57:0/2173322188 shutdown_connections 2024-02-28T16:09:02.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.824+0000 7fcb69800700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcb4806d8c0 0x7fcb4806fd70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.824+0000 7fcb69800700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb640ff170 0x7fcb64072780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.824+0000 7fcb69800700 1 --2- 172.21.15.57:0/2173322188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb64100380 0x7fcb64072cc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:02.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.824+0000 7fcb69800700 1 -- 172.21.15.57:0/2173322188 >> 172.21.15.57:0/2173322188 conn(0x7fcb640fa920 msgr2=0x7fcb641035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:02.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.824+0000 7fcb69800700 1 -- 172.21.15.57:0/2173322188 shutdown_connections 2024-02-28T16:09:02.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:02.824+0000 7fcb69800700 1 -- 172.21.15.57:0/2173322188 wait complete. 2024-02-28T16:09:03.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:03 smithi057 ceph-mon[93219]: pgmap v175: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:09:03.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:03 smithi057 ceph-mon[93219]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:03.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:03 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2173322188' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:09:03.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:03 smithi087 ceph-mon[82628]: pgmap v175: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:09:03.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:03 smithi087 ceph-mon[82628]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:03.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:03 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2173322188' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:09:05.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:04 smithi057 ceph-mon[93219]: pgmap v176: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-02-28T16:09:05.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:05.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:09:05.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:05.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:04 smithi087 ceph-mon[82628]: pgmap v176: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-02-28T16:09:05.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:05.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:09:05.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:07.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:07 smithi087 ceph-mon[82628]: pgmap v177: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-28T16:09:07.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:07 smithi057 ceph-mon[93219]: pgmap v177: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-28T16:09:09.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:09 smithi087 ceph-mon[82628]: pgmap v178: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:09:09.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:09 smithi057 ceph-mon[93219]: pgmap v178: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:09:10.828 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:09:10.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:09:11.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:11 smithi087 ceph-mon[82628]: pgmap v179: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:09:11.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:11 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:09:11.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:11 smithi087 ceph-mon[82628]: Upgrade: osd.4 is safe to restart 2024-02-28T16:09:11.855 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:11 smithi057 ceph-mon[93219]: pgmap v179: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:09:11.855 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:11 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:09:11.855 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:11 smithi057 ceph-mon[93219]: Upgrade: osd.4 is safe to restart 2024-02-28T16:09:13.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:13 smithi087 ceph-mon[82628]: pgmap v180: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:09:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:09:13.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:09:13.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:13 smithi057 ceph-mon[93219]: pgmap v180: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:09:13.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:13.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:09:13.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:09:14.636 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:14 smithi087 ceph-mon[82628]: Upgrade: Updating osd.4 2024-02-28T16:09:14.636 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:14 smithi087 ceph-mon[82628]: Deploying daemon osd.4 on smithi087 2024-02-28T16:09:14.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:14 smithi057 ceph-mon[93219]: Upgrade: Updating osd.4 2024-02-28T16:09:14.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:14 smithi057 ceph-mon[93219]: Deploying daemon osd.4 on smithi087 2024-02-28T16:09:15.782 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:15 smithi087 ceph-mon[82628]: pgmap v181: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:09:15.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:15 smithi057 ceph-mon[93219]: pgmap v181: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:09:17.837 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:17 smithi087 ceph-mon[82628]: pgmap v182: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:09:17.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:17 smithi057 ceph-mon[93219]: pgmap v182: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:09:18.215 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:17 smithi087 systemd[1]: Stopping Ceph osd.4 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:09:18.510 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:18 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[49412]: 2024-02-28T16:09:18.240+0000 7fdd47a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:09:18.510 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:18 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[49412]: 2024-02-28T16:09:18.240+0000 7fdd47a00700 -1 osd.4 87 *** Got signal Terminated *** 2024-02-28T16:09:18.510 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:18 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[49412]: 2024-02-28T16:09:18.240+0000 7fdd47a00700 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:09:18.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:18 smithi057 ceph-mon[93219]: osd.4 marked itself down and dead 2024-02-28T16:09:18.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:18 smithi087 ceph-mon[82628]: osd.4 marked itself down and dead 2024-02-28T16:09:19.465 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:19 smithi087 podman[96580]: 2024-02-28 16:09:19.044846327 +0000 UTC m=+0.930231672 container died 0b96b1484dbdcae054a295b173516e05ffe31089fe7e00222ca3ad9674e8b0c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4, RELEASE=quincy-c0f02e6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:09:19.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:19 smithi057 ceph-mon[93219]: pgmap v183: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:09:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:19 smithi057 ceph-mon[93219]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:09:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:19 smithi057 ceph-mon[93219]: osdmap e88: 6 total, 5 up, 6 in 2024-02-28T16:09:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:19.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:09:19.965 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:19 smithi087 podman[96580]: 2024-02-28 16:09:19.735203379 +0000 UTC m=+1.620588704 container cleanup 0b96b1484dbdcae054a295b173516e05ffe31089fe7e00222ca3ad9674e8b0c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=quincy-c0f02e6, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-28T16:09:19.965 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:19 smithi087 bash[96580]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4 2024-02-28T16:09:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:19 smithi087 ceph-mon[82628]: pgmap v183: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:09:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:19 smithi087 ceph-mon[82628]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:09:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:19 smithi087 ceph-mon[82628]: osdmap e88: 6 total, 5 up, 6 in 2024-02-28T16:09:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:09:20.464 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:20 smithi087 podman[96600]: 2024-02-28 16:09:20.045822283 +0000 UTC m=+0.980990674 container remove 0b96b1484dbdcae054a295b173516e05ffe31089fe7e00222ca3ad9674e8b0c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-c0f02e6, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-02-28T16:09:20.838 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:20 smithi057 ceph-mon[93219]: osdmap e89: 6 total, 5 up, 6 in 2024-02-28T16:09:20.862 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:20 smithi087 ceph-mon[82628]: osdmap e89: 6 total, 5 up, 6 in 2024-02-28T16:09:21.179 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:20 smithi087 podman[96690]: 2024-02-28 16:09:20.775758242 +0000 UTC m=+0.032083878 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:09:21.179 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:20 smithi087 podman[96690]: 2024-02-28 16:09:20.896755302 +0000 UTC m=+0.153080983 container create 20067a43e45a46a13b3fc911b9414ba1aee5c93786540aee02ca6497c0fceab0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:09:21.179 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:21 smithi087 podman[96690]: 2024-02-28 16:09:21.183520256 +0000 UTC m=+0.439845960 container init 20067a43e45a46a13b3fc911b9414ba1aee5c93786540aee02ca6497c0fceab0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-28T16:09:21.464 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:21 smithi087 podman[96690]: 2024-02-28 16:09:21.198103805 +0000 UTC m=+0.454429472 container start 20067a43e45a46a13b3fc911b9414ba1aee5c93786540aee02ca6497c0fceab0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:09:21.465 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:21 smithi087 podman[96690]: 2024-02-28 16:09:21.299161198 +0000 UTC m=+0.555486843 container attach 20067a43e45a46a13b3fc911b9414ba1aee5c93786540aee02ca6497c0fceab0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-02-28T16:09:21.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:21 smithi057 ceph-mon[93219]: pgmap v186: 65 pgs: 2 active+undersized, 2 active+undersized+degraded, 4 stale+active+clean, 57 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 5/333 objects degraded (1.502%) 2024-02-28T16:09:21.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:21 smithi057 ceph-mon[93219]: Health check failed: Degraded data redundancy: 5/333 objects degraded (1.502%), 2 pgs degraded (PG_DEGRADED) 2024-02-28T16:09:21.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:21 smithi087 ceph-mon[82628]: pgmap v186: 65 pgs: 2 active+undersized, 2 active+undersized+degraded, 4 stale+active+clean, 57 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 5/333 objects degraded (1.502%) 2024-02-28T16:09:21.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:21 smithi087 ceph-mon[82628]: Health check failed: Degraded data redundancy: 5/333 objects degraded (1.502%), 2 pgs degraded (PG_DEGRADED) 2024-02-28T16:09:21.965 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:21 smithi087 podman[96690]: 2024-02-28 16:09:21.635086948 +0000 UTC m=+0.891412619 container died 20067a43e45a46a13b3fc911b9414ba1aee5c93786540aee02ca6497c0fceab0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:09:22.715 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:22 smithi087 podman[96715]: 2024-02-28 16:09:22.469692505 +0000 UTC m=+0.819362110 container remove 20067a43e45a46a13b3fc911b9414ba1aee5c93786540aee02ca6497c0fceab0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-28T16:09:22.715 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:22 smithi087 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-28T16:09:22.715 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:22 smithi087 systemd[1]: Stopped Ceph osd.4 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:09:22.715 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:22 smithi087 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.4.service: Consumed 1min 49.604s CPU time. 2024-02-28T16:09:23.207 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:22 smithi087 systemd[1]: Starting Ceph osd.4 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:09:23.465 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:23 smithi087 podman[96812]: 2024-02-28 16:09:23.121224532 +0000 UTC m=+0.031881370 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:09:23.465 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:23 smithi087 podman[96812]: 2024-02-28 16:09:23.246009597 +0000 UTC m=+0.156666471 container create 3eeba9cdea71fd1118051690d22710fc4234ac5fb389a41132160bd0368d70be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, RELEASE=main-1fb5d10) 2024-02-28T16:09:23.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:23 smithi057 ceph-mon[93219]: pgmap v187: 65 pgs: 11 active+undersized, 12 active+undersized+degraded, 1 stale+active+clean, 41 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:09:23.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:23 smithi087 ceph-mon[82628]: pgmap v187: 65 pgs: 11 active+undersized, 12 active+undersized+degraded, 1 stale+active+clean, 41 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 44/333 objects degraded (13.213%) 2024-02-28T16:09:23.965 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:23 smithi087 podman[96812]: 2024-02-28 16:09:23.533471808 +0000 UTC m=+0.444128689 container init 3eeba9cdea71fd1118051690d22710fc4234ac5fb389a41132160bd0368d70be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:09:23.965 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:23 smithi087 podman[96812]: 2024-02-28 16:09:23.54492399 +0000 UTC m=+0.455580887 container start 3eeba9cdea71fd1118051690d22710fc4234ac5fb389a41132160bd0368d70be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=main-1fb5d10, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:09:23.965 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:23 smithi087 podman[96812]: 2024-02-28 16:09:23.648696166 +0000 UTC m=+0.559353093 container attach 3eeba9cdea71fd1118051690d22710fc4234ac5fb389a41132160bd0368d70be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-28T16:09:24.715 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate[96827]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:09:24.715 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate[96827]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 bash[96812]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 bash[96812]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 bash[96812]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 bash[96812]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 bash[96812]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 bash[96812]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 bash[96812]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate[96827]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate[96827]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate[96827]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate[96827]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate[96827]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-28T16:09:24.716 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:24 smithi087 podman[96812]: 2024-02-28 16:09:24.477581966 +0000 UTC m=+1.388238887 container died 3eeba9cdea71fd1118051690d22710fc4234ac5fb389a41132160bd0368d70be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222) 2024-02-28T16:09:25.549 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:25 smithi087 podman[96946]: 2024-02-28 16:09:25.261228393 +0000 UTC m=+0.764703603 container remove 3eeba9cdea71fd1118051690d22710fc4234ac5fb389a41132160bd0368d70be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-02-28T16:09:25.821 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:25 smithi087 ceph-mon[82628]: pgmap v188: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 55/333 objects degraded (16.517%) 2024-02-28T16:09:25.821 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:25 smithi087 podman[97009]: 2024-02-28 16:09:25.511361389 +0000 UTC m=+0.031350148 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:09:25.821 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:25 smithi087 podman[97009]: 2024-02-28 16:09:25.637078533 +0000 UTC m=+0.157067328 container create a98b26059f0afdec1b0e7cbf2b9c6eef6103d148883411bb64bd5ff98b1a2145 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-02-28T16:09:25.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:25 smithi057 ceph-mon[93219]: pgmap v188: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 55/333 objects degraded (16.517%) 2024-02-28T16:09:26.215 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:25 smithi087 podman[97009]: 2024-02-28 16:09:25.956865487 +0000 UTC m=+0.476854299 container init a98b26059f0afdec1b0e7cbf2b9c6eef6103d148883411bb64bd5ff98b1a2145 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-02-28T16:09:26.215 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:25 smithi087 podman[97009]: 2024-02-28 16:09:25.96890763 +0000 UTC m=+0.488896395 container start a98b26059f0afdec1b0e7cbf2b9c6eef6103d148883411bb64bd5ff98b1a2145 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-28T16:09:26.216 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:26 smithi087 ceph-osd[97027]: -- 172.21.15.87:0/2011504899 <== mon.1 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bbc4465680 con 0x55bbc442f000 2024-02-28T16:09:26.216 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:26 smithi087 bash[97009]: a98b26059f0afdec1b0e7cbf2b9c6eef6103d148883411bb64bd5ff98b1a2145 2024-02-28T16:09:26.216 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:26 smithi087 systemd[1]: Started Ceph osd.4 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:09:26.964 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:26 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:09:26.532+0000 7f50147757c0 -1 Falling back to public interface 2024-02-28T16:09:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:27 smithi087 ceph-mon[82628]: pgmap v189: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:09:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:09:27.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:27 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 55/333 objects degraded (16.517%), 16 pgs degraded (PG_DEGRADED) 2024-02-28T16:09:27.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:27 smithi057 ceph-mon[93219]: pgmap v189: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:09:27.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:27.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:27.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:09:27.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:27 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 55/333 objects degraded (16.517%), 16 pgs degraded (PG_DEGRADED) 2024-02-28T16:09:29.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:29 smithi087 ceph-mon[82628]: pgmap v190: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:09:29.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:29 smithi057 ceph-mon[93219]: pgmap v190: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:09:31.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:31 smithi057 ceph-mon[93219]: pgmap v191: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:09:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:31.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:31.964 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:31 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:09:31.705+0000 7f50147757c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-28T16:09:31.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:31 smithi087 ceph-mon[82628]: pgmap v191: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:09:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:32.537 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:32 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:09:32.244+0000 7f50147757c0 -1 osd.4 87 log_to_monitors true 2024-02-28T16:09:32.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:32 smithi057 ceph-mon[93219]: from='osd.4 [v2:172.21.15.87:6808/3757515598,v1:172.21.15.87:6809/3757515598]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:09:32.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:32 smithi057 ceph-mon[93219]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:09:32.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:32 smithi087 ceph-mon[82628]: from='osd.4 [v2:172.21.15.87:6808/3757515598,v1:172.21.15.87:6809/3757515598]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:09:32.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:32 smithi087 ceph-mon[82628]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:09:32.965 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:09:32 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:09:32.582+0000 7f5003c00700 -1 osd.4 87 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:09:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.989+0000 7f8fa9e00700 1 -- 172.21.15.57:0/2023640210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fa4103540 msgr2=0x7f8fa4103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.989+0000 7f8fa9e00700 1 --2- 172.21.15.57:0/2023640210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fa4103540 0x7f8fa4103950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8f94004940 tx=0x7f8f94009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.989+0000 7f8fa9e00700 1 -- 172.21.15.57:0/2023640210 shutdown_connections 2024-02-28T16:09:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.989+0000 7f8fa9e00700 1 --2- 172.21.15.57:0/2023640210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4104750 0x7f8fa4104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.989+0000 7f8fa9e00700 1 --2- 172.21.15.57:0/2023640210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fa4103540 0x7f8fa4103950 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.989+0000 7f8fa9e00700 1 -- 172.21.15.57:0/2023640210 >> 172.21.15.57:0/2023640210 conn(0x7f8fa40727d0 msgr2=0x7f8fa4074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.989+0000 7f8fa9e00700 1 -- 172.21.15.57:0/2023640210 shutdown_connections 2024-02-28T16:09:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.989+0000 7f8fa9e00700 1 -- 172.21.15.57:0/2023640210 wait complete. 2024-02-28T16:09:32.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.990+0000 7f8fa9e00700 1 Processor -- start 2024-02-28T16:09:32.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.990+0000 7f8fa9e00700 1 -- start start 2024-02-28T16:09:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.991+0000 7f8fa9e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4103540 0x7f8fa4113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.991+0000 7f8fa9e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fa4104750 0x7f8fa41144c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.991+0000 7f8fa9e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa4114ac0 con 0x7f8fa4104750 2024-02-28T16:09:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.991+0000 7f8fa9e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa4115360 con 0x7f8fa4103540 2024-02-28T16:09:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.991+0000 7f8fa2000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fa4104750 0x7f8fa41144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.991+0000 7f8fa2000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fa4104750 0x7f8fa41144c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44312/0 (socket says 172.21.15.57:44312) 2024-02-28T16:09:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.991+0000 7f8fa2000700 1 -- 172.21.15.57:0/655841928 learned_addr learned my addr 172.21.15.57:0/655841928 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.991+0000 7f8fa2a00700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4103540 0x7f8fa4113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.992+0000 7f8fa2000700 1 -- 172.21.15.57:0/655841928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4103540 msgr2=0x7f8fa4113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.992+0000 7f8fa2000700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4103540 0x7f8fa4113f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.992+0000 7f8fa2000700 1 -- 172.21.15.57:0/655841928 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94005040 con 0x7f8fa4104750 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.992+0000 7f8fa2a00700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4103540 0x7f8fa4113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.992+0000 7f8fa2000700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fa4104750 0x7f8fa41144c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8f90002a50 tx=0x7f8f900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.992+0000 7f8f9aa00700 1 -- 172.21.15.57:0/655841928 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f90007cc0 con 0x7f8fa4104750 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.992+0000 7f8f9aa00700 1 -- 172.21.15.57:0/655841928 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f9000f040 con 0x7f8fa4104750 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.992+0000 7f8f9aa00700 1 -- 172.21.15.57:0/655841928 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f90009640 con 0x7f8fa4104750 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.992+0000 7f8fa9e00700 1 -- 172.21.15.57:0/655841928 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa4115640 con 0x7f8fa4104750 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.992+0000 7f8fa9e00700 1 -- 172.21.15.57:0/655841928 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa4115b80 con 0x7f8fa4104750 2024-02-28T16:09:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.994+0000 7f8fa9e00700 1 -- 172.21.15.57:0/655841928 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa404bed0 con 0x7f8fa4104750 2024-02-28T16:09:32.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.995+0000 7f8f9aa00700 1 -- 172.21.15.57:0/655841928 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f8f900097a0 con 0x7f8fa4104750 2024-02-28T16:09:32.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.996+0000 7f8f9aa00700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f8806d7f0 0x7f8f8806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:32.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.996+0000 7f8f9aa00700 1 -- 172.21.15.57:0/655841928 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f8f9008cd30 con 0x7f8fa4104750 2024-02-28T16:09:32.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.996+0000 7f8fa2a00700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f8806d7f0 0x7f8f8806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:32.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:32.997+0000 7f8fa2a00700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f8806d7f0 0x7f8f8806fca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b3b0 tx=0x7f8f94009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:32.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.001+0000 7f8f9aa00700 1 -- 172.21.15.57:0/655841928 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8f9005a000 con 0x7f8fa4104750 2024-02-28T16:09:33.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.246+0000 7f8fa9e00700 1 -- 172.21.15.57:0/655841928 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fa4115fd0 con 0x7f8f8806d7f0 2024-02-28T16:09:33.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.249+0000 7f8f9aa00700 1 -- 172.21.15.57:0/655841928 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8fa4115fd0 con 0x7f8f8806d7f0 2024-02-28T16:09:33.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.252+0000 7f8fa9e00700 1 -- 172.21.15.57:0/655841928 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f8806d7f0 msgr2=0x7f8f8806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:33.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.252+0000 7f8fa9e00700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f8806d7f0 0x7f8f8806fca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b3b0 tx=0x7f8f94009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:33.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.252+0000 7f8fa9e00700 1 -- 172.21.15.57:0/655841928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fa4104750 msgr2=0x7f8fa41144c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:33.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.252+0000 7f8fa9e00700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fa4104750 0x7f8fa41144c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8f90002a50 tx=0x7f8f900046b0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.252+0000 7f8fa9e00700 1 -- 172.21.15.57:0/655841928 shutdown_connections 2024-02-28T16:09:33.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.252+0000 7f8fa9e00700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f8806d7f0 0x7f8f8806fca0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.252+0000 7f8fa9e00700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4103540 0x7f8fa4113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.252+0000 7f8fa9e00700 1 --2- 172.21.15.57:0/655841928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fa4104750 0x7f8fa41144c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.252+0000 7f8fa9e00700 1 -- 172.21.15.57:0/655841928 >> 172.21.15.57:0/655841928 conn(0x7f8fa40727d0 msgr2=0x7f8fa4107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.253+0000 7f8fa9e00700 1 -- 172.21.15.57:0/655841928 shutdown_connections 2024-02-28T16:09:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.253+0000 7f8fa9e00700 1 -- 172.21.15.57:0/655841928 wait complete. 2024-02-28T16:09:33.261 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:09:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.418+0000 7fd09dc00700 1 -- 172.21.15.57:0/3494641056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd098072890 msgr2=0x7fd098072ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.418+0000 7fd09dc00700 1 --2- 172.21.15.57:0/3494641056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd098072890 0x7fd098072ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd088004940 tx=0x7fd088009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.419+0000 7fd09dc00700 1 -- 172.21.15.57:0/3494641056 shutdown_connections 2024-02-28T16:09:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.419+0000 7fd09dc00700 1 --2- 172.21.15.57:0/3494641056 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd098073af0 0x7fd098073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.419+0000 7fd09dc00700 1 --2- 172.21.15.57:0/3494641056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd098072890 0x7fd098072ca0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.419+0000 7fd09dc00700 1 -- 172.21.15.57:0/3494641056 >> 172.21.15.57:0/3494641056 conn(0x7fd0980fa920 msgr2=0x7fd0980fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.419+0000 7fd09dc00700 1 -- 172.21.15.57:0/3494641056 shutdown_connections 2024-02-28T16:09:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.419+0000 7fd09dc00700 1 -- 172.21.15.57:0/3494641056 wait complete. 2024-02-28T16:09:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.420+0000 7fd09dc00700 1 Processor -- start 2024-02-28T16:09:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.420+0000 7fd09dc00700 1 -- start start 2024-02-28T16:09:33.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.421+0000 7fd09dc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd098072890 0x7fd098113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:33.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.421+0000 7fd09dc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd098073af0 0x7fd098114430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:33.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.421+0000 7fd09dc00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd098114a30 con 0x7fd098073af0 2024-02-28T16:09:33.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.421+0000 7fd09dc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0981152d0 con 0x7fd098072890 2024-02-28T16:09:33.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.421+0000 7fd096000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd098073af0 0x7fd098114430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:33.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.421+0000 7fd096000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd098073af0 0x7fd098114430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44326/0 (socket says 172.21.15.57:44326) 2024-02-28T16:09:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.421+0000 7fd096000700 1 -- 172.21.15.57:0/3882768962 learned_addr learned my addr 172.21.15.57:0/3882768962 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.421+0000 7fd096a00700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd098072890 0x7fd098113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.422+0000 7fd096000700 1 -- 172.21.15.57:0/3882768962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd098072890 msgr2=0x7fd098113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.422+0000 7fd096000700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd098072890 0x7fd098113ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.422+0000 7fd096000700 1 -- 172.21.15.57:0/3882768962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088005040 con 0x7fd098073af0 2024-02-28T16:09:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.422+0000 7fd096000700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd098073af0 0x7fd098114430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd08400eb70 tx=0x7fd08400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.422+0000 7fd08ea00700 1 -- 172.21.15.57:0/3882768962 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd084007cc0 con 0x7fd098073af0 2024-02-28T16:09:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.422+0000 7fd08ea00700 1 -- 172.21.15.57:0/3882768962 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd08400f040 con 0x7fd098073af0 2024-02-28T16:09:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.422+0000 7fd08ea00700 1 -- 172.21.15.57:0/3882768962 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd084009640 con 0x7fd098073af0 2024-02-28T16:09:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.422+0000 7fd09dc00700 1 -- 172.21.15.57:0/3882768962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd098115550 con 0x7fd098073af0 2024-02-28T16:09:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.422+0000 7fd09dc00700 1 -- 172.21.15.57:0/3882768962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd098115a90 con 0x7fd098073af0 2024-02-28T16:09:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.424+0000 7fd09dc00700 1 -- 172.21.15.57:0/3882768962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09804bed0 con 0x7fd098073af0 2024-02-28T16:09:33.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.425+0000 7fd08ea00700 1 -- 172.21.15.57:0/3882768962 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd0840097a0 con 0x7fd098073af0 2024-02-28T16:09:33.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.427+0000 7fd08ea00700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd07c06d7e0 0x7fd07c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:33.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.427+0000 7fd08ea00700 1 -- 172.21.15.57:0/3882768962 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fd08408cba0 con 0x7fd098073af0 2024-02-28T16:09:33.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.427+0000 7fd096a00700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd07c06d7e0 0x7fd07c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:33.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.428+0000 7fd096a00700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd07c06d7e0 0x7fd07c06fc90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd088000c00 tx=0x7fd088009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:33.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.431+0000 7fd08ea00700 1 -- 172.21.15.57:0/3882768962 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd084059e50 con 0x7fd098073af0 2024-02-28T16:09:33.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.691+0000 7fd09dc00700 1 -- 172.21.15.57:0/3882768962 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd09810ab80 con 0x7fd07c06d7e0 2024-02-28T16:09:33.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.692+0000 7fd08ea00700 1 -- 172.21.15.57:0/3882768962 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd09810ab80 con 0x7fd07c06d7e0 2024-02-28T16:09:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.695+0000 7fd09dc00700 1 -- 172.21.15.57:0/3882768962 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd07c06d7e0 msgr2=0x7fd07c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.695+0000 7fd09dc00700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd07c06d7e0 0x7fd07c06fc90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd088000c00 tx=0x7fd088009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.695+0000 7fd09dc00700 1 -- 172.21.15.57:0/3882768962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd098073af0 msgr2=0x7fd098114430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.695+0000 7fd09dc00700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd098073af0 0x7fd098114430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd08400eb70 tx=0x7fd08400b040 comp rx=0 tx=0).stop 2024-02-28T16:09:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.695+0000 7fd09dc00700 1 -- 172.21.15.57:0/3882768962 shutdown_connections 2024-02-28T16:09:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.695+0000 7fd09dc00700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd07c06d7e0 0x7fd07c06fc90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.695+0000 7fd09dc00700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd098072890 0x7fd098113ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.695+0000 7fd09dc00700 1 --2- 172.21.15.57:0/3882768962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd098073af0 0x7fd098114430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.695+0000 7fd09dc00700 1 -- 172.21.15.57:0/3882768962 >> 172.21.15.57:0/3882768962 conn(0x7fd0980fa920 msgr2=0x7fd098109460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.696+0000 7fd09dc00700 1 -- 172.21.15.57:0/3882768962 shutdown_connections 2024-02-28T16:09:33.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.696+0000 7fd09dc00700 1 -- 172.21.15.57:0/3882768962 wait complete. 2024-02-28T16:09:33.725 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:33 smithi087 ceph-mon[82628]: pgmap v192: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:09:33.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:33 smithi087 ceph-mon[82628]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T16:09:33.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:33 smithi087 ceph-mon[82628]: osdmap e90: 6 total, 5 up, 6 in 2024-02-28T16:09:33.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:33 smithi087 ceph-mon[82628]: from='osd.4 [v2:172.21.15.87:6808/3757515598,v1:172.21.15.87:6809/3757515598]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:09:33.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:33 smithi087 ceph-mon[82628]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:09:33.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:33.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.842+0000 7f2272200700 1 -- 172.21.15.57:0/1637553476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f226c0fe0e0 msgr2=0x7f226c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.842+0000 7f2272200700 1 --2- 172.21.15.57:0/1637553476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f226c0fe0e0 0x7f226c0fe550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2254004940 tx=0x7f2254009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.842+0000 7f2272200700 1 -- 172.21.15.57:0/1637553476 shutdown_connections 2024-02-28T16:09:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.842+0000 7f2272200700 1 --2- 172.21.15.57:0/1637553476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f226c0fe0e0 0x7f226c0fe550 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.842+0000 7f2272200700 1 --2- 172.21.15.57:0/1637553476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0fcef0 0x7f226c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.842+0000 7f2272200700 1 -- 172.21.15.57:0/1637553476 >> 172.21.15.57:0/1637553476 conn(0x7f226c0f8620 msgr2=0x7f226c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.842+0000 7f2272200700 1 -- 172.21.15.57:0/1637553476 shutdown_connections 2024-02-28T16:09:33.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.842+0000 7f2272200700 1 -- 172.21.15.57:0/1637553476 wait complete. 2024-02-28T16:09:33.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:33 smithi057 ceph-mon[93219]: pgmap v192: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:09:33.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:33 smithi057 ceph-mon[93219]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T16:09:33.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:33 smithi057 ceph-mon[93219]: osdmap e90: 6 total, 5 up, 6 in 2024-02-28T16:09:33.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:33 smithi057 ceph-mon[93219]: from='osd.4 [v2:172.21.15.87:6808/3757515598,v1:172.21.15.87:6809/3757515598]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:09:33.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:33 smithi057 ceph-mon[93219]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:09:33.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:33.836 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:33.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.843+0000 7f2272200700 1 Processor -- start 2024-02-28T16:09:33.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.843+0000 7f2272200700 1 -- start start 2024-02-28T16:09:33.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f2272200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0fcef0 0x7f226c10fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:33.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f2272200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f226c0fe0e0 0x7f226c1100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:33.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f2272200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c1106a0 con 0x7f226c0fe0e0 2024-02-28T16:09:33.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f2272200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c110f40 con 0x7f226c0fcef0 2024-02-28T16:09:33.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f2263e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f226c0fe0e0 0x7f226c1100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:33.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f2263e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f226c0fe0e0 0x7f226c1100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44342/0 (socket says 172.21.15.57:44342) 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f2263e00700 1 -- 172.21.15.57:0/1096283497 learned_addr learned my addr 172.21.15.57:0/1096283497 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f226b400700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0fcef0 0x7f226c10fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f2263e00700 1 -- 172.21.15.57:0/1096283497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0fcef0 msgr2=0x7f226c10fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f2263e00700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0fcef0 0x7f226c10fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.844+0000 7f2263e00700 1 -- 172.21.15.57:0/1096283497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254005040 con 0x7f226c0fe0e0 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.845+0000 7f2263e00700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f226c0fe0e0 0x7f226c1100a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f22540093b0 tx=0x7f2254009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.845+0000 7f2263400700 1 -- 172.21.15.57:0/1096283497 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f225400e040 con 0x7f226c0fe0e0 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.845+0000 7f2263400700 1 -- 172.21.15.57:0/1096283497 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f225400bcc0 con 0x7f226c0fe0e0 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.845+0000 7f2272200700 1 -- 172.21.15.57:0/1096283497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c1111c0 con 0x7f226c0fe0e0 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.845+0000 7f2263400700 1 -- 172.21.15.57:0/1096283497 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f225401c630 con 0x7f226c0fe0e0 2024-02-28T16:09:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.845+0000 7f2272200700 1 -- 172.21.15.57:0/1096283497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c111700 con 0x7f226c0fe0e0 2024-02-28T16:09:33.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.847+0000 7f2272200700 1 -- 172.21.15.57:0/1096283497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c102210 con 0x7f226c0fe0e0 2024-02-28T16:09:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.848+0000 7f2263400700 1 -- 172.21.15.57:0/1096283497 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f22540139f0 con 0x7f226c0fe0e0 2024-02-28T16:09:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.849+0000 7f2263400700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f225006d7e0 0x7f225006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.849+0000 7f2263400700 1 -- 172.21.15.57:0/1096283497 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f225408e460 con 0x7f226c0fe0e0 2024-02-28T16:09:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.849+0000 7f226b400700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f225006d7e0 0x7f225006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.850+0000 7f226b400700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f225006d7e0 0x7f225006fc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f225c009fd0 tx=0x7f225c009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:33.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:33.854+0000 7f2263400700 1 -- 172.21.15.57:0/1096283497 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f225405b710 con 0x7f226c0fe0e0 2024-02-28T16:09:34.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.086+0000 7f2272200700 1 -- 172.21.15.57:0/1096283497 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f226c111a50 con 0x7f225006d7e0 2024-02-28T16:09:34.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.115+0000 7f2263400700 1 -- 172.21.15.57:0/1096283497 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f226c111a50 con 0x7f225006d7e0 2024-02-28T16:09:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:09:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (7m) 74s ago 18m 14.2M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:09:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (3m) 74s ago 18m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:09:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (3m) 3s ago 17m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:09:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (7m) 74s ago 18m 75.3M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:09:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (11m) 74s ago 11m 125M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (11m) 74s ago 11m 68.0M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (11m) 3s ago 11m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (11m) 3s ago 11m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (6m) 74s ago 20m 506M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (5m) 3s ago 17m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (5m) 74s ago 20m 48.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (4m) 3s ago 17m 39.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (8m) 74s ago 18m 7906k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (6m) 3s ago 17m 7926k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (2m) 74s ago 16m 137M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (2m) 74s ago 15m 94.7M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (82s) 74s ago 14m 11.0M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:09:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (51s) 3s ago 14m 91.1M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:09:34.110 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (8s) 3s ago 13m 11.1M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:09:34.110 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (13m) 3s ago 13m 302M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 14a258168ae4 2024-02-28T16:09:34.110 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (5m) 74s ago 17m 53.5M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.118+0000 7f2272200700 1 -- 172.21.15.57:0/1096283497 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f225006d7e0 msgr2=0x7f225006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.118+0000 7f2272200700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f225006d7e0 0x7f225006fc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f225c009fd0 tx=0x7f225c009f00 comp rx=0 tx=0).stop 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.118+0000 7f2272200700 1 -- 172.21.15.57:0/1096283497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f226c0fe0e0 msgr2=0x7f226c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.118+0000 7f2272200700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f226c0fe0e0 0x7f226c1100a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f22540093b0 tx=0x7f2254009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.118+0000 7f2272200700 1 -- 172.21.15.57:0/1096283497 shutdown_connections 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.118+0000 7f2272200700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f225006d7e0 0x7f225006fc90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.118+0000 7f2272200700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0fcef0 0x7f226c10fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.118+0000 7f2272200700 1 --2- 172.21.15.57:0/1096283497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f226c0fe0e0 0x7f226c1100a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.118+0000 7f2272200700 1 -- 172.21.15.57:0/1096283497 >> 172.21.15.57:0/1096283497 conn(0x7f226c0f8620 msgr2=0x7f226c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.119+0000 7f2272200700 1 -- 172.21.15.57:0/1096283497 shutdown_connections 2024-02-28T16:09:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.119+0000 7f2272200700 1 -- 172.21.15.57:0/1096283497 wait complete. 2024-02-28T16:09:34.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.269+0000 7efd4ee00700 1 -- 172.21.15.57:0/839354541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd48103370 msgr2=0x7efd48103780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:34.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.269+0000 7efd4ee00700 1 --2- 172.21.15.57:0/839354541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd48103370 0x7efd48103780 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efd3c004940 tx=0x7efd3c009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:34.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.270+0000 7efd4ee00700 1 -- 172.21.15.57:0/839354541 shutdown_connections 2024-02-28T16:09:34.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.270+0000 7efd4ee00700 1 --2- 172.21.15.57:0/839354541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd48104580 0x7efd481049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.270+0000 7efd4ee00700 1 --2- 172.21.15.57:0/839354541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd48103370 0x7efd48103780 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.270+0000 7efd4ee00700 1 -- 172.21.15.57:0/839354541 >> 172.21.15.57:0/839354541 conn(0x7efd48072500 msgr2=0x7efd48074950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:34.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.270+0000 7efd4ee00700 1 -- 172.21.15.57:0/839354541 shutdown_connections 2024-02-28T16:09:34.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.270+0000 7efd4ee00700 1 -- 172.21.15.57:0/839354541 wait complete. 2024-02-28T16:09:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.271+0000 7efd4ee00700 1 Processor -- start 2024-02-28T16:09:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.271+0000 7efd4ee00700 1 -- start start 2024-02-28T16:09:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.271+0000 7efd4ee00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd48103370 0x7efd48113d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.271+0000 7efd4ee00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd48104580 0x7efd481142c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.271+0000 7efd4ee00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd48115080 con 0x7efd48104580 2024-02-28T16:09:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.271+0000 7efd4ee00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481151f0 con 0x7efd48103370 2024-02-28T16:09:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.271+0000 7efd4d000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd48104580 0x7efd481142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.271+0000 7efd4d000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd48104580 0x7efd481142c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44362/0 (socket says 172.21.15.57:44362) 2024-02-28T16:09:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.272+0000 7efd4d000700 1 -- 172.21.15.57:0/212454792 learned_addr learned my addr 172.21.15.57:0/212454792 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.272+0000 7efd4da00700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd48103370 0x7efd48113d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.272+0000 7efd4d000700 1 -- 172.21.15.57:0/212454792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd48103370 msgr2=0x7efd48113d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.272+0000 7efd4d000700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd48103370 0x7efd48113d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.272+0000 7efd4d000700 1 -- 172.21.15.57:0/212454792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c005040 con 0x7efd48104580 2024-02-28T16:09:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.272+0000 7efd4d000700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd48104580 0x7efd481142c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efd3400eb40 tx=0x7efd3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.272+0000 7efd45600700 1 -- 172.21.15.57:0/212454792 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd34007cc0 con 0x7efd48104580 2024-02-28T16:09:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.273+0000 7efd45600700 1 -- 172.21.15.57:0/212454792 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd3400f040 con 0x7efd48104580 2024-02-28T16:09:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.273+0000 7efd45600700 1 -- 172.21.15.57:0/212454792 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd34009620 con 0x7efd48104580 2024-02-28T16:09:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.273+0000 7efd4ee00700 1 -- 172.21.15.57:0/212454792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd48115410 con 0x7efd48104580 2024-02-28T16:09:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.273+0000 7efd4ee00700 1 -- 172.21.15.57:0/212454792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd481159d0 con 0x7efd48104580 2024-02-28T16:09:34.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.274+0000 7efd4ee00700 1 -- 172.21.15.57:0/212454792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4804bed0 con 0x7efd48104580 2024-02-28T16:09:34.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.275+0000 7efd45600700 1 -- 172.21.15.57:0/212454792 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7efd34009780 con 0x7efd48104580 2024-02-28T16:09:34.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.277+0000 7efd45600700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efd3006d7e0 0x7efd3006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:34.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.277+0000 7efd45600700 1 -- 172.21.15.57:0/212454792 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6585+0+0 (secure 0 0 0) 0x7efd3408cc10 con 0x7efd48104580 2024-02-28T16:09:34.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.278+0000 7efd4da00700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efd3006d7e0 0x7efd3006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:34.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.278+0000 7efd4da00700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efd3006d7e0 0x7efd3006fc90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00b0d0 tx=0x7efd3c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:34.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.282+0000 7efd45600700 1 -- 172.21.15.57:0/212454792 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efd34056460 con 0x7efd48104580 2024-02-28T16:09:34.604 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:09:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:09:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:09:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:09:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:09:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:09:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:09:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:09:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:09:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 5, 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 9 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.608+0000 7efd4ee00700 1 -- 172.21.15.57:0/212454792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd4810be50 con 0x7efd48104580 2024-02-28T16:09:34.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.609+0000 7efd45600700 1 -- 172.21.15.57:0/212454792 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7efd34059b20 con 0x7efd48104580 2024-02-28T16:09:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.613+0000 7efd4ee00700 1 -- 172.21.15.57:0/212454792 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efd3006d7e0 msgr2=0x7efd3006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.613+0000 7efd4ee00700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efd3006d7e0 0x7efd3006fc90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00b0d0 tx=0x7efd3c009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.613+0000 7efd4ee00700 1 -- 172.21.15.57:0/212454792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd48104580 msgr2=0x7efd481142c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.613+0000 7efd4ee00700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd48104580 0x7efd481142c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efd3400eb40 tx=0x7efd3400b040 comp rx=0 tx=0).stop 2024-02-28T16:09:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.614+0000 7efd4ee00700 1 -- 172.21.15.57:0/212454792 shutdown_connections 2024-02-28T16:09:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.614+0000 7efd4ee00700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efd3006d7e0 0x7efd3006fc90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.614+0000 7efd4ee00700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd48103370 0x7efd48113d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.614+0000 7efd4ee00700 1 --2- 172.21.15.57:0/212454792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd48104580 0x7efd481142c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.614+0000 7efd4ee00700 1 -- 172.21.15.57:0/212454792 >> 172.21.15.57:0/212454792 conn(0x7efd48072500 msgr2=0x7efd481077b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.614+0000 7efd4ee00700 1 -- 172.21.15.57:0/212454792 shutdown_connections 2024-02-28T16:09:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.614+0000 7efd4ee00700 1 -- 172.21.15.57:0/212454792 wait complete. 2024-02-28T16:09:34.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:34 smithi087 ceph-mon[82628]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:34.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:34 smithi087 ceph-mon[82628]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:09:34.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:34 smithi087 ceph-mon[82628]: osd.4 [v2:172.21.15.87:6808/3757515598,v1:172.21.15.87:6809/3757515598] boot 2024-02-28T16:09:34.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:34 smithi087 ceph-mon[82628]: osdmap e91: 6 total, 6 up, 6 in 2024-02-28T16:09:34.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:09:34.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:34.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:09:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.776+0000 7fa331200700 1 -- 172.21.15.57:0/4275173370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c100180 msgr2=0x7fa32c1005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.776+0000 7fa331200700 1 --2- 172.21.15.57:0/4275173370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c100180 0x7fa32c1005d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa318004940 tx=0x7fa318009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.776+0000 7fa331200700 1 -- 172.21.15.57:0/4275173370 shutdown_connections 2024-02-28T16:09:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.776+0000 7fa331200700 1 --2- 172.21.15.57:0/4275173370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c100180 0x7fa32c1005d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.776+0000 7fa331200700 1 --2- 172.21.15.57:0/4275173370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c0fef70 0x7fa32c0ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.776+0000 7fa331200700 1 -- 172.21.15.57:0/4275173370 >> 172.21.15.57:0/4275173370 conn(0x7fa32c0fa920 msgr2=0x7fa32c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.776+0000 7fa331200700 1 -- 172.21.15.57:0/4275173370 shutdown_connections 2024-02-28T16:09:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.776+0000 7fa331200700 1 -- 172.21.15.57:0/4275173370 wait complete. 2024-02-28T16:09:34.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.777+0000 7fa331200700 1 Processor -- start 2024-02-28T16:09:34.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.778+0000 7fa331200700 1 -- start start 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.778+0000 7fa331200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0fef70 0x7fa32c10f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.778+0000 7fa331200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c100180 0x7fa32c10fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.778+0000 7fa331200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c110490 con 0x7fa32c0fef70 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.778+0000 7fa331200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c110d30 con 0x7fa32c100180 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.778+0000 7fa32b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0fef70 0x7fa32c10f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.778+0000 7fa32b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0fef70 0x7fa32c10f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44386/0 (socket says 172.21.15.57:44386) 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.778+0000 7fa32b400700 1 -- 172.21.15.57:0/1408866764 learned_addr learned my addr 172.21.15.57:0/1408866764 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.779+0000 7fa32aa00700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c100180 0x7fa32c10fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.779+0000 7fa32b400700 1 -- 172.21.15.57:0/1408866764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c100180 msgr2=0x7fa32c10fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.779+0000 7fa32b400700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c100180 0x7fa32c10fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.779+0000 7fa32b400700 1 -- 172.21.15.57:0/1408866764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318005040 con 0x7fa32c0fef70 2024-02-28T16:09:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.779+0000 7fa32aa00700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c100180 0x7fa32c10fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:09:34.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.779+0000 7fa32b400700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0fef70 0x7fa32c10f950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00c8e0 tx=0x7fa31c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:34.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.779+0000 7fa323400700 1 -- 172.21.15.57:0/1408866764 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa31c00a940 con 0x7fa32c0fef70 2024-02-28T16:09:34.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.779+0000 7fa331200700 1 -- 172.21.15.57:0/1408866764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c111010 con 0x7fa32c0fef70 2024-02-28T16:09:34.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.779+0000 7fa323400700 1 -- 172.21.15.57:0/1408866764 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa31c00ce80 con 0x7fa32c0fef70 2024-02-28T16:09:34.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.780+0000 7fa323400700 1 -- 172.21.15.57:0/1408866764 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa31c0113a0 con 0x7fa32c0fef70 2024-02-28T16:09:34.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.780+0000 7fa331200700 1 -- 172.21.15.57:0/1408866764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c111550 con 0x7fa32c0fef70 2024-02-28T16:09:34.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.781+0000 7fa331200700 1 -- 172.21.15.57:0/1408866764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c04bed0 con 0x7fa32c0fef70 2024-02-28T16:09:34.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.782+0000 7fa323400700 1 -- 172.21.15.57:0/1408866764 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa31c012400 con 0x7fa32c0fef70 2024-02-28T16:09:34.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.783+0000 7fa323400700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa31006d7f0 0x7fa31006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:34.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.783+0000 7fa323400700 1 -- 172.21.15.57:0/1408866764 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fa31c08d070 con 0x7fa32c0fef70 2024-02-28T16:09:34.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.784+0000 7fa32aa00700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa31006d7f0 0x7fa31006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:34.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.784+0000 7fa32aa00700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa31006d7f0 0x7fa31006fca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa31800b7a0 tx=0x7fa318009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:34.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:34.789+0000 7fa323400700 1 -- 172.21.15.57:0/1408866764 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa31c05a320 con 0x7fa32c0fef70 2024-02-28T16:09:34.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:34 smithi057 ceph-mon[93219]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:34.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:34 smithi057 ceph-mon[93219]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:09:34.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:34 smithi057 ceph-mon[93219]: osd.4 [v2:172.21.15.87:6808/3757515598,v1:172.21.15.87:6809/3757515598] boot 2024-02-28T16:09:34.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:34 smithi057 ceph-mon[93219]: osdmap e91: 6 total, 6 up, 6 in 2024-02-28T16:09:34.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:09:34.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:34.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:09:35.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.050+0000 7fa331200700 1 -- 172.21.15.57:0/1408866764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa32c1111a0 con 0x7fa32c0fef70 2024-02-28T16:09:35.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.051+0000 7fa323400700 1 -- 172.21.15.57:0/1408866764 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1863 (secure 0 0 0) 0x7fa32c1111a0 con 0x7fa32c0fef70 2024-02-28T16:09:35.043 INFO:teuthology.orchestra.run.smithi057.stdout:e18 2024-02-28T16:09:35.043 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 18 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:06:28.521002+0000 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:09:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:09:35.045 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:09:35.046 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:09:35.046 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:09:35.046 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:09:35.046 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:09:35.046 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:09:35.046 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:09:35.046 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:09:35.046 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:09:35.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.053+0000 7fa331200700 1 -- 172.21.15.57:0/1408866764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa31006d7f0 msgr2=0x7fa31006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:35.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.053+0000 7fa331200700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa31006d7f0 0x7fa31006fca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa31800b7a0 tx=0x7fa318009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:35.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.053+0000 7fa331200700 1 -- 172.21.15.57:0/1408866764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0fef70 msgr2=0x7fa32c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:35.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.053+0000 7fa331200700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0fef70 0x7fa32c10f950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00c8e0 tx=0x7fa31c0044c0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.054+0000 7fa331200700 1 -- 172.21.15.57:0/1408866764 shutdown_connections 2024-02-28T16:09:35.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.054+0000 7fa331200700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa31006d7f0 0x7fa31006fca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.054+0000 7fa331200700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0fef70 0x7fa32c10f950 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.054+0000 7fa331200700 1 --2- 172.21.15.57:0/1408866764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c100180 0x7fa32c10fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.054+0000 7fa331200700 1 -- 172.21.15.57:0/1408866764 >> 172.21.15.57:0/1408866764 conn(0x7fa32c0fa920 msgr2=0x7fa32c1033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:35.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.054+0000 7fa331200700 1 -- 172.21.15.57:0/1408866764 shutdown_connections 2024-02-28T16:09:35.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.054+0000 7fa331200700 1 -- 172.21.15.57:0/1408866764 wait complete. 2024-02-28T16:09:35.048 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-02-28T16:09:35.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.213+0000 7f79f2200700 1 -- 172.21.15.57:0/2439356477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ec0fbe40 msgr2=0x7f79ec0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:35.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.213+0000 7f79f2200700 1 --2- 172.21.15.57:0/2439356477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ec0fbe40 0x7f79ec0fc250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f79dc004940 tx=0x7f79dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:35.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.213+0000 7f79f2200700 1 -- 172.21.15.57:0/2439356477 shutdown_connections 2024-02-28T16:09:35.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.213+0000 7f79f2200700 1 --2- 172.21.15.57:0/2439356477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79ec0fcfb0 0x7f79ec0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.213+0000 7f79f2200700 1 --2- 172.21.15.57:0/2439356477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ec0fbe40 0x7f79ec0fc250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.213+0000 7f79f2200700 1 -- 172.21.15.57:0/2439356477 >> 172.21.15.57:0/2439356477 conn(0x7f79ec0f74e0 msgr2=0x7f79ec0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:35.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.213+0000 7f79f2200700 1 -- 172.21.15.57:0/2439356477 shutdown_connections 2024-02-28T16:09:35.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.213+0000 7f79f2200700 1 -- 172.21.15.57:0/2439356477 wait complete. 2024-02-28T16:09:35.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.214+0000 7f79f2200700 1 Processor -- start 2024-02-28T16:09:35.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.215+0000 7f79f2200700 1 -- start start 2024-02-28T16:09:35.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.215+0000 7f79f2200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79ec0fcfb0 0x7f79ec10fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:35.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.215+0000 7f79f2200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ec1102d0 0x7f79ec1110c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:35.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.215+0000 7f79f2200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec110790 con 0x7f79ec1102d0 2024-02-28T16:09:35.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.215+0000 7f79f2200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec1108d0 con 0x7f79ec0fcfb0 2024-02-28T16:09:35.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.215+0000 7f79eaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ec1102d0 0x7f79ec1110c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:35.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.215+0000 7f79eaa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ec1102d0 0x7f79ec1110c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44408/0 (socket says 172.21.15.57:44408) 2024-02-28T16:09:35.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.215+0000 7f79eaa00700 1 -- 172.21.15.57:0/945897008 learned_addr learned my addr 172.21.15.57:0/945897008 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:35.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.216+0000 7f79eb400700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79ec0fcfb0 0x7f79ec10fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:35.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.216+0000 7f79eaa00700 1 -- 172.21.15.57:0/945897008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79ec0fcfb0 msgr2=0x7f79ec10fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:35.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.216+0000 7f79eaa00700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79ec0fcfb0 0x7f79ec10fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.216+0000 7f79eaa00700 1 -- 172.21.15.57:0/945897008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc005040 con 0x7f79ec1102d0 2024-02-28T16:09:35.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.216+0000 7f79eaa00700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ec1102d0 0x7f79ec1110c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c830 tx=0x7f79d8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:35.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.216+0000 7f79e3400700 1 -- 172.21.15.57:0/945897008 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d800a700 con 0x7f79ec1102d0 2024-02-28T16:09:35.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.217+0000 7f79e3400700 1 -- 172.21.15.57:0/945897008 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79d800ad30 con 0x7f79ec1102d0 2024-02-28T16:09:35.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.217+0000 7f79e3400700 1 -- 172.21.15.57:0/945897008 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d80113a0 con 0x7f79ec1102d0 2024-02-28T16:09:35.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.217+0000 7f79f2200700 1 -- 172.21.15.57:0/945897008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec111750 con 0x7f79ec1102d0 2024-02-28T16:09:35.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.217+0000 7f79f2200700 1 -- 172.21.15.57:0/945897008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec111c60 con 0x7f79ec1102d0 2024-02-28T16:09:35.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.218+0000 7f79f2200700 1 -- 172.21.15.57:0/945897008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec0fb1a0 con 0x7f79ec1102d0 2024-02-28T16:09:35.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.219+0000 7f79e3400700 1 -- 172.21.15.57:0/945897008 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f79d8012400 con 0x7f79ec1102d0 2024-02-28T16:09:35.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.220+0000 7f79e3400700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f79d006d7f0 0x7f79d006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:35.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.220+0000 7f79e3400700 1 -- 172.21.15.57:0/945897008 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f79d808cfe0 con 0x7f79ec1102d0 2024-02-28T16:09:35.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.220+0000 7f79eb400700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f79d006d7f0 0x7f79d006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:35.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.221+0000 7f79eb400700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f79d006d7f0 0x7f79d006fca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00b3b0 tx=0x7f79dc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:35.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.227+0000 7f79e3400700 1 -- 172.21.15.57:0/945897008 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f79d8056820 con 0x7f79ec1102d0 2024-02-28T16:09:35.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.477+0000 7f79f2200700 1 -- 172.21.15.57:0/945897008 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79ec065dd0 con 0x7f79d006d7f0 2024-02-28T16:09:35.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.480+0000 7f79e3400700 1 -- 172.21.15.57:0/945897008 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f79ec065dd0 con 0x7f79d006d7f0 2024-02-28T16:09:35.472 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:09:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:09:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:09:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:09:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:09:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:09:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:09:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:09:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:09:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "11/21 daemons upgraded", 2024-02-28T16:09:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:09:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:09:35.473 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:09:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 -- 172.21.15.57:0/945897008 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f79d006d7f0 msgr2=0x7f79d006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f79d006d7f0 0x7f79d006fca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00b3b0 tx=0x7f79dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 -- 172.21.15.57:0/945897008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ec1102d0 msgr2=0x7f79ec1110c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ec1102d0 0x7f79ec1110c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c830 tx=0x7f79d8004470 comp rx=0 tx=0).stop 2024-02-28T16:09:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 -- 172.21.15.57:0/945897008 shutdown_connections 2024-02-28T16:09:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f79d006d7f0 0x7f79d006fca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79ec0fcfb0 0x7f79ec10fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 --2- 172.21.15.57:0/945897008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ec1102d0 0x7f79ec1110c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 -- 172.21.15.57:0/945897008 >> 172.21.15.57:0/945897008 conn(0x7f79ec0f74e0 msgr2=0x7f79ec0656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 -- 172.21.15.57:0/945897008 shutdown_connections 2024-02-28T16:09:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.483+0000 7f79f2200700 1 -- 172.21.15.57:0/945897008 wait complete. 2024-02-28T16:09:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.630+0000 7f057a600700 1 -- 172.21.15.57:0/2751799992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05740fcef0 msgr2=0x7f05740fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.630+0000 7f057a600700 1 --2- 172.21.15.57:0/2751799992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05740fcef0 0x7f05740fd320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0564004940 tx=0x7f0564009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.630+0000 7f057a600700 1 -- 172.21.15.57:0/2751799992 shutdown_connections 2024-02-28T16:09:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.630+0000 7f057a600700 1 --2- 172.21.15.57:0/2751799992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05740fe0e0 0x7f05740fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.630+0000 7f057a600700 1 --2- 172.21.15.57:0/2751799992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05740fcef0 0x7f05740fd320 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.630+0000 7f057a600700 1 -- 172.21.15.57:0/2751799992 >> 172.21.15.57:0/2751799992 conn(0x7f05740f8620 msgr2=0x7f05740faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.630+0000 7f057a600700 1 -- 172.21.15.57:0/2751799992 shutdown_connections 2024-02-28T16:09:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.630+0000 7f057a600700 1 -- 172.21.15.57:0/2751799992 wait complete. 2024-02-28T16:09:35.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.631+0000 7f057a600700 1 Processor -- start 2024-02-28T16:09:35.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.631+0000 7f057a600700 1 -- start start 2024-02-28T16:09:35.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.631+0000 7f057a600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05740fcef0 0x7f057410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.631+0000 7f057a600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05740fe0e0 0x7f057410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.631+0000 7f057a600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057410e4b0 con 0x7f05740fcef0 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.631+0000 7f057a600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057410ed50 con 0x7f05740fe0e0 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.632+0000 7f0573400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05740fcef0 0x7f057410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.632+0000 7f0573400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05740fcef0 0x7f057410d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44430/0 (socket says 172.21.15.57:44430) 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.632+0000 7f0573400700 1 -- 172.21.15.57:0/2461679981 learned_addr learned my addr 172.21.15.57:0/2461679981 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.632+0000 7f056be00700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05740fe0e0 0x7f057410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.632+0000 7f0573400700 1 -- 172.21.15.57:0/2461679981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05740fe0e0 msgr2=0x7f057410deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.632+0000 7f0573400700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05740fe0e0 0x7f057410deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.632+0000 7f0573400700 1 -- 172.21.15.57:0/2461679981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564005040 con 0x7f05740fcef0 2024-02-28T16:09:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.632+0000 7f0573400700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05740fcef0 0x7f057410d970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0564000c00 tx=0x7f0564009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:35.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.633+0000 7f056b400700 1 -- 172.21.15.57:0/2461679981 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056400e040 con 0x7f05740fcef0 2024-02-28T16:09:35.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.633+0000 7f056b400700 1 -- 172.21.15.57:0/2461679981 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f056400bcc0 con 0x7f05740fcef0 2024-02-28T16:09:35.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.633+0000 7f057a600700 1 -- 172.21.15.57:0/2461679981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057410efd0 con 0x7f05740fcef0 2024-02-28T16:09:35.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.633+0000 7f056b400700 1 -- 172.21.15.57:0/2461679981 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0564013ea0 con 0x7f05740fcef0 2024-02-28T16:09:35.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.633+0000 7f057a600700 1 -- 172.21.15.57:0/2461679981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057410f510 con 0x7f05740fcef0 2024-02-28T16:09:35.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.634+0000 7f057a600700 1 -- 172.21.15.57:0/2461679981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057404bed0 con 0x7f05740fcef0 2024-02-28T16:09:35.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.635+0000 7f056b400700 1 -- 172.21.15.57:0/2461679981 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f0564013420 con 0x7f05740fcef0 2024-02-28T16:09:35.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.636+0000 7f056b400700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f055806d7f0 0x7f055806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:09:35.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.637+0000 7f056b400700 1 -- 172.21.15.57:0/2461679981 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f056408e2b0 con 0x7f05740fcef0 2024-02-28T16:09:35.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.637+0000 7f056be00700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f055806d7f0 0x7f055806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:09:35.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.637+0000 7f056be00700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f055806d7f0 0x7f055806fca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f055c004990 tx=0x7f055c009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:09:35.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.641+0000 7f056b400700 1 -- 172.21.15.57:0/2461679981 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f056405b560 con 0x7f05740fcef0 2024-02-28T16:09:35.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:35 smithi057 ceph-mon[93219]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:35 smithi057 ceph-mon[93219]: pgmap v195: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:09:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:35 smithi057 ceph-mon[93219]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:35 smithi057 ceph-mon[93219]: osdmap e92: 6 total, 6 up, 6 in 2024-02-28T16:09:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:35 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/212454792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:09:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:35 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1408866764' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:09:35.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.940+0000 7f057a600700 1 -- 172.21.15.57:0/2461679981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f057410f160 con 0x7f05740fcef0 2024-02-28T16:09:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.941+0000 7f056b400700 1 -- 172.21.15.57:0/2461679981 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1073 (secure 0 0 0) 0x7f057410f160 con 0x7f05740fcef0 2024-02-28T16:09:35.934 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_WARN Degraded data redundancy: 55/333 objects degraded (16.517%), 16 pgs degraded 2024-02-28T16:09:35.934 INFO:teuthology.orchestra.run.smithi057.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 55/333 objects degraded (16.517%), 16 pgs degraded 2024-02-28T16:09:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-02-28T16:09:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-02-28T16:09:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.6 is active+undersized+degraded, acting [1,0] 2024-02-28T16:09:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-02-28T16:09:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-02-28T16:09:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.a is active+undersized+degraded, acting [1,0] 2024-02-28T16:09:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-02-28T16:09:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-28T16:09:35.935 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-02-28T16:09:35.935 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-02-28T16:09:35.935 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-02-28T16:09:35.935 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-02-28T16:09:35.935 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-02-28T16:09:35.935 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-02-28T16:09:35.935 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-28T16:09:35.935 INFO:teuthology.orchestra.run.smithi057.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-02-28T16:09:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.944+0000 7f057a600700 1 -- 172.21.15.57:0/2461679981 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f055806d7f0 msgr2=0x7f055806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.944+0000 7f057a600700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f055806d7f0 0x7f055806fca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f055c004990 tx=0x7f055c009ee0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.944+0000 7f057a600700 1 -- 172.21.15.57:0/2461679981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05740fcef0 msgr2=0x7f057410d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:09:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.944+0000 7f057a600700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05740fcef0 0x7f057410d970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0564000c00 tx=0x7f0564009e30 comp rx=0 tx=0).stop 2024-02-28T16:09:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.944+0000 7f057a600700 1 -- 172.21.15.57:0/2461679981 shutdown_connections 2024-02-28T16:09:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.944+0000 7f057a600700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f055806d7f0 0x7f055806fca0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.944+0000 7f057a600700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05740fcef0 0x7f057410d970 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.944+0000 7f057a600700 1 --2- 172.21.15.57:0/2461679981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05740fe0e0 0x7f057410deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:09:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.944+0000 7f057a600700 1 -- 172.21.15.57:0/2461679981 >> 172.21.15.57:0/2461679981 conn(0x7f05740f8620 msgr2=0x7f05741013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:09:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.944+0000 7f057a600700 1 -- 172.21.15.57:0/2461679981 shutdown_connections 2024-02-28T16:09:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:09:35.945+0000 7f057a600700 1 -- 172.21.15.57:0/2461679981 wait complete. 2024-02-28T16:09:35.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:35 smithi087 ceph-mon[82628]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:35 smithi087 ceph-mon[82628]: pgmap v195: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 55/333 objects degraded (16.517%) 2024-02-28T16:09:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:35 smithi087 ceph-mon[82628]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:35 smithi087 ceph-mon[82628]: osdmap e92: 6 total, 6 up, 6 in 2024-02-28T16:09:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:35 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/212454792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:09:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:35 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1408866764' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:09:36.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:36 smithi057 ceph-mon[93219]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:36.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:36 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2461679981' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:09:36.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:36 smithi087 ceph-mon[82628]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:09:36.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:36 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2461679981' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:09:37.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:37 smithi057 ceph-mon[93219]: pgmap v197: 65 pgs: 6 active+undersized, 7 active+undersized+degraded, 52 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 17/333 objects degraded (5.105%) 2024-02-28T16:09:37.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:37 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 17/333 objects degraded (5.105%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:09:37.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:37 smithi087 ceph-mon[82628]: pgmap v197: 65 pgs: 6 active+undersized, 7 active+undersized+degraded, 52 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 17/333 objects degraded (5.105%) 2024-02-28T16:09:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:37 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 17/333 objects degraded (5.105%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: pgmap v198: 65 pgs: 2 active+undersized, 63 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:09:39.411 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:09:39.412 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: Upgrade: osd.5 is safe to restart 2024-02-28T16:09:39.412 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/333 objects degraded (5.105%), 7 pgs degraded) 2024-02-28T16:09:39.412 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:39 smithi087 ceph-mon[82628]: Cluster is now healthy 2024-02-28T16:09:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: pgmap v198: 65 pgs: 2 active+undersized, 63 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T16:09:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:09:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:09:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:09:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:09:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:09:39.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:09:39.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:09:39.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:09:39.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: Upgrade: osd.5 is safe to restart 2024-02-28T16:09:39.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/333 objects degraded (5.105%), 7 pgs degraded) 2024-02-28T16:09:39.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:39 smithi057 ceph-mon[93219]: Cluster is now healthy 2024-02-28T16:09:41.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:41 smithi057 ceph-mon[93219]: pgmap v199: 65 pgs: 65 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-28T16:09:41.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:41.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:09:41.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:09:41.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:41 smithi087 ceph-mon[82628]: pgmap v199: 65 pgs: 65 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-28T16:09:41.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:41.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:09:41.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:09:42.282 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:42 smithi087 ceph-mon[82628]: Upgrade: Updating osd.5 2024-02-28T16:09:42.283 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:42 smithi087 ceph-mon[82628]: Deploying daemon osd.5 on smithi087 2024-02-28T16:09:42.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:42 smithi057 ceph-mon[93219]: Upgrade: Updating osd.5 2024-02-28T16:09:42.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:42 smithi057 ceph-mon[93219]: Deploying daemon osd.5 on smithi087 2024-02-28T16:09:43.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:43 smithi057 ceph-mon[93219]: pgmap v200: 65 pgs: 65 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-02-28T16:09:43.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:43 smithi087 ceph-mon[82628]: pgmap v200: 65 pgs: 65 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-02-28T16:09:45.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:45 smithi057 ceph-mon[93219]: pgmap v201: 65 pgs: 65 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-28T16:09:45.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:45 smithi087 ceph-mon[82628]: pgmap v201: 65 pgs: 65 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-28T16:09:46.465 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:46 smithi087 systemd[1]: Stopping Ceph osd.5 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:09:46.965 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:46 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[56264]: 2024-02-28T16:09:46.530+0000 7fae60c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:09:46.965 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:46 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[56264]: 2024-02-28T16:09:46.530+0000 7fae60c00700 -1 osd.5 92 *** Got signal Terminated *** 2024-02-28T16:09:46.965 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:46 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[56264]: 2024-02-28T16:09:46.530+0000 7fae60c00700 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:09:47.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:47 smithi057 ceph-mon[93219]: pgmap v202: 65 pgs: 65 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:09:47.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:47 smithi057 ceph-mon[93219]: osd.5 marked itself down and dead 2024-02-28T16:09:47.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:47 smithi087 ceph-mon[82628]: pgmap v202: 65 pgs: 65 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:09:47.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:47 smithi087 ceph-mon[82628]: osd.5 marked itself down and dead 2024-02-28T16:09:48.149 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:47 smithi087 podman[101431]: 2024-02-28 16:09:47.868806167 +0000 UTC m=+1.482611221 container died 14a258168ae499c46497e65e674259252b6f3903210270f34d7d2a2489a90ce4 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5, ceph=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=quincy-c0f02e6, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-28T16:09:48.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:48 smithi057 ceph-mon[93219]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:09:48.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:48 smithi057 ceph-mon[93219]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-28T16:09:48.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:48 smithi057 ceph-mon[93219]: osdmap e93: 6 total, 5 up, 6 in 2024-02-28T16:09:48.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:48 smithi087 ceph-mon[82628]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:09:48.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:48 smithi087 ceph-mon[82628]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-28T16:09:48.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:48 smithi087 ceph-mon[82628]: osdmap e93: 6 total, 5 up, 6 in 2024-02-28T16:09:48.465 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:48 smithi087 podman[101431]: 2024-02-28 16:09:48.366856161 +0000 UTC m=+1.980661208 container cleanup 14a258168ae499c46497e65e674259252b6f3903210270f34d7d2a2489a90ce4 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=quincy-c0f02e6, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:09:48.465 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:48 smithi087 bash[101431]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5 2024-02-28T16:09:48.964 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:48 smithi087 podman[101451]: 2024-02-28 16:09:48.58522752 +0000 UTC m=+0.703173149 container remove 14a258168ae499c46497e65e674259252b6f3903210270f34d7d2a2489a90ce4 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, ceph=True, RELEASE=quincy-c0f02e6, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-02-28T16:09:49.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:49 smithi057 ceph-mon[93219]: pgmap v204: 65 pgs: 6 peering, 10 stale+active+clean, 49 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s 2024-02-28T16:09:49.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:49 smithi057 ceph-mon[93219]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-28T16:09:49.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:49 smithi057 ceph-mon[93219]: osdmap e94: 6 total, 5 up, 6 in 2024-02-28T16:09:49.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:49.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:09:49.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:49.465 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:49 smithi087 podman[101537]: 2024-02-28 16:09:49.275070578 +0000 UTC m=+0.038272753 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:09:49.465 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:49 smithi087 podman[101537]: 2024-02-28 16:09:49.39433677 +0000 UTC m=+0.157538981 container create 86630fc7110796fa95cb2fd8477080a1650bf79cf150f056642f5ad6a1524571 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-28T16:09:49.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:49 smithi087 ceph-mon[82628]: pgmap v204: 65 pgs: 6 peering, 10 stale+active+clean, 49 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s 2024-02-28T16:09:49.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:49 smithi087 ceph-mon[82628]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-28T16:09:49.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:49 smithi087 ceph-mon[82628]: osdmap e94: 6 total, 5 up, 6 in 2024-02-28T16:09:49.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:49.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:09:49.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:49.965 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:49 smithi087 podman[101537]: 2024-02-28 16:09:49.706141223 +0000 UTC m=+0.469343433 container init 86630fc7110796fa95cb2fd8477080a1650bf79cf150f056642f5ad6a1524571 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-02-28T16:09:49.965 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:49 smithi087 podman[101537]: 2024-02-28 16:09:49.717937075 +0000 UTC m=+0.481139264 container start 86630fc7110796fa95cb2fd8477080a1650bf79cf150f056642f5ad6a1524571 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True) 2024-02-28T16:09:49.965 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:49 smithi087 podman[101537]: 2024-02-28 16:09:49.821892719 +0000 UTC m=+0.585094983 container attach 86630fc7110796fa95cb2fd8477080a1650bf79cf150f056642f5ad6a1524571 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-02-28T16:09:50.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:50 smithi087 ceph-mon[82628]: Health check failed: Degraded data redundancy: 7/333 objects degraded (2.102%), 3 pgs degraded (PG_DEGRADED) 2024-02-28T16:09:50.465 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:50 smithi087 podman[101537]: 2024-02-28 16:09:50.145262858 +0000 UTC m=+0.908465076 container died 86630fc7110796fa95cb2fd8477080a1650bf79cf150f056642f5ad6a1524571 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_CLEAN=True) 2024-02-28T16:09:50.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:50 smithi057 ceph-mon[93219]: Health check failed: Degraded data redundancy: 7/333 objects degraded (2.102%), 3 pgs degraded (PG_DEGRADED) 2024-02-28T16:09:51.209 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:50 smithi087 podman[101562]: 2024-02-28 16:09:50.933858926 +0000 UTC m=+0.773875901 container remove 86630fc7110796fa95cb2fd8477080a1650bf79cf150f056642f5ad6a1524571 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240222) 2024-02-28T16:09:51.209 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:50 smithi087 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-28T16:09:51.209 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:50 smithi087 systemd[1]: Stopped Ceph osd.5 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:09:51.209 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:50 smithi087 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.5.service: Consumed 1min 57.280s CPU time. 2024-02-28T16:09:51.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:51 smithi087 ceph-mon[82628]: pgmap v206: 65 pgs: 2 active+undersized, 3 active+undersized+degraded, 6 peering, 7 stale+active+clean, 47 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/333 objects degraded (2.102%) 2024-02-28T16:09:51.465 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:51 smithi087 systemd[1]: Starting Ceph osd.5 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:09:51.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:51 smithi057 ceph-mon[93219]: pgmap v206: 65 pgs: 2 active+undersized, 3 active+undersized+degraded, 6 peering, 7 stale+active+clean, 47 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/333 objects degraded (2.102%) 2024-02-28T16:09:52.047 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:51 smithi087 podman[101663]: 2024-02-28 16:09:51.628276374 +0000 UTC m=+0.034508209 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:09:52.047 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:51 smithi087 podman[101663]: 2024-02-28 16:09:51.743410344 +0000 UTC m=+0.149642220 container create ed953a52670674b06b64af6ccbf46cb43fe5579734a29d4be43751dbc27b71ec (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, ceph=True) 2024-02-28T16:09:52.047 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 podman[101663]: 2024-02-28 16:09:52.055761946 +0000 UTC m=+0.461993824 container init ed953a52670674b06b64af6ccbf46cb43fe5579734a29d4be43751dbc27b71ec (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.build-date=20240222, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:09:52.464 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 podman[101663]: 2024-02-28 16:09:52.066334402 +0000 UTC m=+0.472566242 container start ed953a52670674b06b64af6ccbf46cb43fe5579734a29d4be43751dbc27b71ec (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10) 2024-02-28T16:09:52.464 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 podman[101663]: 2024-02-28 16:09:52.15421727 +0000 UTC m=+0.560449175 container attach ed953a52670674b06b64af6ccbf46cb43fe5579734a29d4be43751dbc27b71ec (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-28T16:09:53.216 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate[101678]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate[101678]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 bash[101663]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 bash[101663]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 bash[101663]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 bash[101663]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 bash[101663]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 bash[101663]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 bash[101663]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate[101678]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate[101678]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate[101678]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate[101678]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate[101678]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-28T16:09:53.217 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:52 smithi087 podman[101663]: 2024-02-28 16:09:52.993787838 +0000 UTC m=+1.400019740 container died ed953a52670674b06b64af6ccbf46cb43fe5579734a29d4be43751dbc27b71ec (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-28T16:09:53.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:53 smithi057 ceph-mon[93219]: pgmap v207: 65 pgs: 11 active+undersized, 9 active+undersized+degraded, 6 peering, 1 stale+active+clean, 38 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 37/333 objects degraded (11.111%) 2024-02-28T16:09:53.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:53 smithi087 ceph-mon[82628]: pgmap v207: 65 pgs: 11 active+undersized, 9 active+undersized+degraded, 6 peering, 1 stale+active+clean, 38 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 37/333 objects degraded (11.111%) 2024-02-28T16:09:54.169 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:53 smithi087 podman[101797]: 2024-02-28 16:09:53.816550555 +0000 UTC m=+0.803458222 container remove ed953a52670674b06b64af6ccbf46cb43fe5579734a29d4be43751dbc27b71ec (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-28T16:09:54.448 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:54 smithi087 ceph-mon[82628]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-28T16:09:54.448 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:54 smithi087 podman[101856]: 2024-02-28 16:09:54.084167403 +0000 UTC m=+0.038360264 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:09:54.448 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:54 smithi087 podman[101856]: 2024-02-28 16:09:54.267798875 +0000 UTC m=+0.221991747 container create cbdb6df47634487221ffeab4698ae7e0ffa6e4e511bd5901f83477470a015100 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-02-28T16:09:54.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:54 smithi057 ceph-mon[93219]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-28T16:09:54.964 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:54 smithi087 podman[101856]: 2024-02-28 16:09:54.596094714 +0000 UTC m=+0.550287630 container init cbdb6df47634487221ffeab4698ae7e0ffa6e4e511bd5901f83477470a015100 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-28T16:09:54.964 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:54 smithi087 podman[101856]: 2024-02-28 16:09:54.606309395 +0000 UTC m=+0.560502284 container start cbdb6df47634487221ffeab4698ae7e0ffa6e4e511bd5901f83477470a015100 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True) 2024-02-28T16:09:54.964 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:54 smithi087 ceph-osd[101875]: -- 172.21.15.87:0/930660808 <== mon.1 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f128b2b680 con 0x55f128af4c00 2024-02-28T16:09:54.964 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:54 smithi087 bash[101856]: cbdb6df47634487221ffeab4698ae7e0ffa6e4e511bd5901f83477470a015100 2024-02-28T16:09:54.964 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:54 smithi087 systemd[1]: Started Ceph osd.5 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:09:55.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:55 smithi087 ceph-mon[82628]: pgmap v208: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/333 objects degraded (15.315%) 2024-02-28T16:09:55.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:55.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:55.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:09:55.464 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:55 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:09:55.172+0000 7ffafcb0c7c0 -1 Falling back to public interface 2024-02-28T16:09:55.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:55 smithi057 ceph-mon[93219]: pgmap v208: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/333 objects degraded (15.315%) 2024-02-28T16:09:55.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:55.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:55.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:09:57.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:57 smithi057 ceph-mon[93219]: pgmap v209: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/333 objects degraded (15.315%) 2024-02-28T16:09:57.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:57 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 51/333 objects degraded (15.315%), 14 pgs degraded (PG_DEGRADED) 2024-02-28T16:09:57.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:57 smithi087 ceph-mon[82628]: pgmap v209: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/333 objects degraded (15.315%) 2024-02-28T16:09:57.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:57 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 51/333 objects degraded (15.315%), 14 pgs degraded (PG_DEGRADED) 2024-02-28T16:09:59.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:59 smithi057 ceph-mon[93219]: pgmap v210: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/333 objects degraded (15.315%) 2024-02-28T16:09:59.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:59 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:59.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:09:59 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:59.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:59 smithi087 ceph-mon[82628]: pgmap v210: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/333 objects degraded (15.315%) 2024-02-28T16:09:59.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:59 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:09:59.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:09:59 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:00.214 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:09:59 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:09:59.774+0000 7ffafcb0c7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-28T16:10:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: Health detail: HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 51/333 objects degraded (15.315%), 14 pgs degraded 2024-02-28T16:10:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: [WRN] OSD_DOWN: 1 osds down 2024-02-28T16:10:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: osd.5 (root=default,host=smithi087) is down 2024-02-28T16:10:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T16:10:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T16:10:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: [WRN] PG_DEGRADED: Degraded data redundancy: 51/333 objects degraded (15.315%), 14 pgs degraded 2024-02-28T16:10:00.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.b is active+undersized+degraded, acting [3,4] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.f is active+undersized+degraded, acting [4,0] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-02-28T16:10:00.679 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: from='osd.5 [v2:172.21.15.87:6816/2897063090,v1:172.21.15.87:6817/2897063090]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:10:00.680 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:00 smithi057 ceph-mon[93219]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:10:00.716 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:10:00.239+0000 7ffafcb0c7c0 -1 osd.5 92 log_to_monitors true 2024-02-28T16:10:00.716 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:10:00.338+0000 7ffaebe00700 -1 osd.5 92 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:10:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: Health detail: HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 51/333 objects degraded (15.315%), 14 pgs degraded 2024-02-28T16:10:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: [WRN] OSD_DOWN: 1 osds down 2024-02-28T16:10:00.716 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: osd.5 (root=default,host=smithi087) is down 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: [WRN] PG_DEGRADED: Degraded data redundancy: 51/333 objects degraded (15.315%), 14 pgs degraded 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.b is active+undersized+degraded, acting [3,4] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.f is active+undersized+degraded, acting [4,0] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-02-28T16:10:00.717 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-02-28T16:10:00.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-02-28T16:10:00.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-02-28T16:10:00.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: from='osd.5 [v2:172.21.15.87:6816/2897063090,v1:172.21.15.87:6817/2897063090]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:10:00.718 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:00 smithi087 ceph-mon[82628]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:10:01.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:01 smithi057 ceph-mon[93219]: pgmap v211: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/333 objects degraded (15.315%) 2024-02-28T16:10:01.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:01 smithi057 ceph-mon[93219]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T16:10:01.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:01 smithi057 ceph-mon[93219]: osdmap e95: 6 total, 5 up, 6 in 2024-02-28T16:10:01.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:01 smithi057 ceph-mon[93219]: from='osd.5 [v2:172.21.15.87:6816/2897063090,v1:172.21.15.87:6817/2897063090]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:10:01.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:01 smithi057 ceph-mon[93219]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:10:01.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:01 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:01.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:01 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:01.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:01 smithi087 ceph-mon[82628]: pgmap v211: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 269 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/333 objects degraded (15.315%) 2024-02-28T16:10:01.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:01 smithi087 ceph-mon[82628]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T16:10:01.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:01 smithi087 ceph-mon[82628]: osdmap e95: 6 total, 5 up, 6 in 2024-02-28T16:10:01.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:01 smithi087 ceph-mon[82628]: from='osd.5 [v2:172.21.15.87:6816/2897063090,v1:172.21.15.87:6817/2897063090]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:10:01.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:01 smithi087 ceph-mon[82628]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-02-28T16:10:01.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:01 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:01.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:01 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:02.425 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:02 smithi087 ceph-mon[82628]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:10:02.425 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:02 smithi087 ceph-mon[82628]: osd.5 [v2:172.21.15.87:6816/2897063090,v1:172.21.15.87:6817/2897063090] boot 2024-02-28T16:10:02.425 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:02 smithi087 ceph-mon[82628]: osdmap e96: 6 total, 6 up, 6 in 2024-02-28T16:10:02.425 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:02 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:10:02.425 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:02 smithi087 ceph-mon[82628]: osdmap e97: 6 total, 6 up, 6 in 2024-02-28T16:10:02.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:02 smithi057 ceph-mon[93219]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:10:02.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:02 smithi057 ceph-mon[93219]: osd.5 [v2:172.21.15.87:6816/2897063090,v1:172.21.15.87:6817/2897063090] boot 2024-02-28T16:10:02.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:02 smithi057 ceph-mon[93219]: osdmap e96: 6 total, 6 up, 6 in 2024-02-28T16:10:02.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:02 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:10:02.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:02 smithi057 ceph-mon[93219]: osdmap e97: 6 total, 6 up, 6 in 2024-02-28T16:10:03.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:03 smithi087 ceph-mon[82628]: pgmap v214: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 269 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 51/333 objects degraded (15.315%) 2024-02-28T16:10:03.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:03 smithi057 ceph-mon[93219]: pgmap v214: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 269 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 51/333 objects degraded (15.315%) 2024-02-28T16:10:05.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:05.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:10:05.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:04 smithi057 ceph-mon[93219]: pgmap v216: 65 pgs: 1 peering, 12 active+undersized, 10 active+undersized+degraded, 42 active+clean; 269 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/333 objects degraded (12.312%) 2024-02-28T16:10:05.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:05.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:10:05.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:04 smithi087 ceph-mon[82628]: pgmap v216: 65 pgs: 1 peering, 12 active+undersized, 10 active+undersized+degraded, 42 active+clean; 269 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/333 objects degraded (12.312%) 2024-02-28T16:10:06.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.117+0000 7f4a4e600700 1 -- 172.21.15.57:0/2961943703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a480ff150 msgr2=0x7f4a480ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:06.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.117+0000 7f4a4e600700 1 --2- 172.21.15.57:0/2961943703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a480ff150 0x7f4a480ff560 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4a38004940 tx=0x7f4a38009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:06.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.117+0000 7f4a4e600700 1 -- 172.21.15.57:0/2961943703 shutdown_connections 2024-02-28T16:10:06.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.117+0000 7f4a4e600700 1 --2- 172.21.15.57:0/2961943703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a48100360 0x7f4a481007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.117+0000 7f4a4e600700 1 --2- 172.21.15.57:0/2961943703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a480ff150 0x7f4a480ff560 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.117+0000 7f4a4e600700 1 -- 172.21.15.57:0/2961943703 >> 172.21.15.57:0/2961943703 conn(0x7f4a480fa920 msgr2=0x7f4a480fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:06.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.117+0000 7f4a4e600700 1 -- 172.21.15.57:0/2961943703 shutdown_connections 2024-02-28T16:10:06.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.117+0000 7f4a4e600700 1 -- 172.21.15.57:0/2961943703 wait complete. 2024-02-28T16:10:06.110 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:05 smithi057 ceph-mon[93219]: Health check update: Degraded data redundancy: 41/333 objects degraded (12.312%), 10 pgs degraded (PG_DEGRADED) 2024-02-28T16:10:06.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.118+0000 7f4a4e600700 1 Processor -- start 2024-02-28T16:10:06.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.118+0000 7f4a4e600700 1 -- start start 2024-02-28T16:10:06.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.118+0000 7f4a4e600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a480ff150 0x7f4a4810fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:06.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.119+0000 7f4a4e600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a48100360 0x7f4a481100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.119+0000 7f4a4e600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a481106b0 con 0x7f4a480ff150 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.119+0000 7f4a4e600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a48110f50 con 0x7f4a48100360 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.119+0000 7f4a47400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a480ff150 0x7f4a4810fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.119+0000 7f4a47400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a480ff150 0x7f4a4810fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55436/0 (socket says 172.21.15.57:55436) 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.119+0000 7f4a47400700 1 -- 172.21.15.57:0/1015355144 learned_addr learned my addr 172.21.15.57:0/1015355144 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.119+0000 7f4a46a00700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a48100360 0x7f4a481100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.119+0000 7f4a47400700 1 -- 172.21.15.57:0/1015355144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a48100360 msgr2=0x7f4a481100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.119+0000 7f4a47400700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a48100360 0x7f4a481100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.119+0000 7f4a47400700 1 -- 172.21.15.57:0/1015355144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a38005040 con 0x7f4a480ff150 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.120+0000 7f4a47400700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a480ff150 0x7f4a4810fb70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4a38000c00 tx=0x7f4a38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.120+0000 7f4a3f400700 1 -- 172.21.15.57:0/1015355144 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a3800e040 con 0x7f4a480ff150 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.120+0000 7f4a3f400700 1 -- 172.21.15.57:0/1015355144 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a3800bcc0 con 0x7f4a480ff150 2024-02-28T16:10:06.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.120+0000 7f4a4e600700 1 -- 172.21.15.57:0/1015355144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a481111d0 con 0x7f4a480ff150 2024-02-28T16:10:06.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.120+0000 7f4a3f400700 1 -- 172.21.15.57:0/1015355144 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a38013ea0 con 0x7f4a480ff150 2024-02-28T16:10:06.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.120+0000 7f4a4e600700 1 -- 172.21.15.57:0/1015355144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a48111710 con 0x7f4a480ff150 2024-02-28T16:10:06.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.121+0000 7f4a4e600700 1 -- 172.21.15.57:0/1015355144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4804bed0 con 0x7f4a480ff150 2024-02-28T16:10:06.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.123+0000 7f4a3f400700 1 -- 172.21.15.57:0/1015355144 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f4a38013420 con 0x7f4a480ff150 2024-02-28T16:10:06.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.123+0000 7f4a3f400700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4a2c06d7f0 0x7f4a2c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:06.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.124+0000 7f4a3f400700 1 -- 172.21.15.57:0/1015355144 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f4a3808e3b0 con 0x7f4a480ff150 2024-02-28T16:10:06.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.124+0000 7f4a46a00700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4a2c06d7f0 0x7f4a2c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:06.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.125+0000 7f4a46a00700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4a2c06d7f0 0x7f4a2c06fca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4a34007fd0 tx=0x7f4a34009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:06.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.129+0000 7f4a3f400700 1 -- 172.21.15.57:0/1015355144 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4a3805b5e0 con 0x7f4a480ff150 2024-02-28T16:10:06.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:05 smithi087 ceph-mon[82628]: Health check update: Degraded data redundancy: 41/333 objects degraded (12.312%), 10 pgs degraded (PG_DEGRADED) 2024-02-28T16:10:06.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.372+0000 7f4a4e600700 1 -- 172.21.15.57:0/1015355144 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a48104cb0 con 0x7f4a2c06d7f0 2024-02-28T16:10:06.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.374+0000 7f4a3f400700 1 -- 172.21.15.57:0/1015355144 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4a48104cb0 con 0x7f4a2c06d7f0 2024-02-28T16:10:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.377+0000 7f4a4e600700 1 -- 172.21.15.57:0/1015355144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4a2c06d7f0 msgr2=0x7f4a2c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.377+0000 7f4a4e600700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4a2c06d7f0 0x7f4a2c06fca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4a34007fd0 tx=0x7f4a34009040 comp rx=0 tx=0).stop 2024-02-28T16:10:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.377+0000 7f4a4e600700 1 -- 172.21.15.57:0/1015355144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a480ff150 msgr2=0x7f4a4810fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.377+0000 7f4a4e600700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a480ff150 0x7f4a4810fb70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4a38000c00 tx=0x7f4a38009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:06.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.377+0000 7f4a4e600700 1 -- 172.21.15.57:0/1015355144 shutdown_connections 2024-02-28T16:10:06.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.377+0000 7f4a4e600700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4a2c06d7f0 0x7f4a2c06fca0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.377+0000 7f4a4e600700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a480ff150 0x7f4a4810fb70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.377+0000 7f4a4e600700 1 --2- 172.21.15.57:0/1015355144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a48100360 0x7f4a481100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.377+0000 7f4a4e600700 1 -- 172.21.15.57:0/1015355144 >> 172.21.15.57:0/1015355144 conn(0x7f4a480fa920 msgr2=0x7f4a48103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:06.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.378+0000 7f4a4e600700 1 -- 172.21.15.57:0/1015355144 shutdown_connections 2024-02-28T16:10:06.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.378+0000 7f4a4e600700 1 -- 172.21.15.57:0/1015355144 wait complete. 2024-02-28T16:10:06.385 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:10:06.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.538+0000 7f1d34600700 1 -- 172.21.15.57:0/520760439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c073af0 msgr2=0x7f1d2c073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:06.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.538+0000 7f1d34600700 1 --2- 172.21.15.57:0/520760439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c073af0 0x7f1d2c073f60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1d18004940 tx=0x7f1d18009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:06.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.538+0000 7f1d34600700 1 -- 172.21.15.57:0/520760439 shutdown_connections 2024-02-28T16:10:06.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.538+0000 7f1d34600700 1 --2- 172.21.15.57:0/520760439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c073af0 0x7f1d2c073f60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.538+0000 7f1d34600700 1 --2- 172.21.15.57:0/520760439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c072890 0x7f1d2c072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.538+0000 7f1d34600700 1 -- 172.21.15.57:0/520760439 >> 172.21.15.57:0/520760439 conn(0x7f1d2c0fa920 msgr2=0x7f1d2c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:06.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.539+0000 7f1d34600700 1 -- 172.21.15.57:0/520760439 shutdown_connections 2024-02-28T16:10:06.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.539+0000 7f1d34600700 1 -- 172.21.15.57:0/520760439 wait complete. 2024-02-28T16:10:06.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.539+0000 7f1d34600700 1 Processor -- start 2024-02-28T16:10:06.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.540+0000 7f1d34600700 1 -- start start 2024-02-28T16:10:06.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.540+0000 7f1d34600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c072890 0x7f1d2c113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:06.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.540+0000 7f1d34600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c073af0 0x7f1d2c114530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:06.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.540+0000 7f1d34600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c114b30 con 0x7f1d2c073af0 2024-02-28T16:10:06.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.540+0000 7f1d34600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c1153d0 con 0x7f1d2c072890 2024-02-28T16:10:06.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.540+0000 7f1d31200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c073af0 0x7f1d2c114530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:06.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.540+0000 7f1d31200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c073af0 0x7f1d2c114530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55446/0 (socket says 172.21.15.57:55446) 2024-02-28T16:10:06.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.540+0000 7f1d31200700 1 -- 172.21.15.57:0/2106331729 learned_addr learned my addr 172.21.15.57:0/2106331729 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:06.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.541+0000 7f1d31c00700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c072890 0x7f1d2c113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:06.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.541+0000 7f1d31200700 1 -- 172.21.15.57:0/2106331729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c072890 msgr2=0x7f1d2c113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:06.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.541+0000 7f1d31200700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c072890 0x7f1d2c113ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.541+0000 7f1d31200700 1 -- 172.21.15.57:0/2106331729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18005040 con 0x7f1d2c073af0 2024-02-28T16:10:06.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.541+0000 7f1d31200700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c073af0 0x7f1d2c114530 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009180 tx=0x7f1d18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:06.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.541+0000 7f1d29600700 1 -- 172.21.15.57:0/2106331729 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d1800e040 con 0x7f1d2c073af0 2024-02-28T16:10:06.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.541+0000 7f1d29600700 1 -- 172.21.15.57:0/2106331729 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d18004290 con 0x7f1d2c073af0 2024-02-28T16:10:06.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.541+0000 7f1d29600700 1 -- 172.21.15.57:0/2106331729 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d18013ea0 con 0x7f1d2c073af0 2024-02-28T16:10:06.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.541+0000 7f1d34600700 1 -- 172.21.15.57:0/2106331729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c115650 con 0x7f1d2c073af0 2024-02-28T16:10:06.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.542+0000 7f1d34600700 1 -- 172.21.15.57:0/2106331729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c115b90 con 0x7f1d2c073af0 2024-02-28T16:10:06.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.543+0000 7f1d34600700 1 -- 172.21.15.57:0/2106331729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c04bed0 con 0x7f1d2c073af0 2024-02-28T16:10:06.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.544+0000 7f1d29600700 1 -- 172.21.15.57:0/2106331729 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1d1800bbf0 con 0x7f1d2c073af0 2024-02-28T16:10:06.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.545+0000 7f1d29600700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d1406d7e0 0x7f1d1406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:06.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.545+0000 7f1d29600700 1 -- 172.21.15.57:0/2106331729 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f1d1808e340 con 0x7f1d2c073af0 2024-02-28T16:10:06.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.545+0000 7f1d31c00700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d1406d7e0 0x7f1d1406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:06.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.546+0000 7f1d31c00700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d1406d7e0 0x7f1d1406fc90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1d20004550 tx=0x7f1d20009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:06.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.550+0000 7f1d29600700 1 -- 172.21.15.57:0/2106331729 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1d1805b670 con 0x7f1d2c073af0 2024-02-28T16:10:06.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.806+0000 7f1d34600700 1 -- 172.21.15.57:0/2106331729 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d2c1160b0 con 0x7f1d1406d7e0 2024-02-28T16:10:06.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.808+0000 7f1d29600700 1 -- 172.21.15.57:0/2106331729 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1d2c1160b0 con 0x7f1d1406d7e0 2024-02-28T16:10:06.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 -- 172.21.15.57:0/2106331729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d1406d7e0 msgr2=0x7f1d1406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:06.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d1406d7e0 0x7f1d1406fc90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1d20004550 tx=0x7f1d20009040 comp rx=0 tx=0).stop 2024-02-28T16:10:06.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 -- 172.21.15.57:0/2106331729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c073af0 msgr2=0x7f1d2c114530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:06.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c073af0 0x7f1d2c114530 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009180 tx=0x7f1d18009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:06.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 -- 172.21.15.57:0/2106331729 shutdown_connections 2024-02-28T16:10:06.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d1406d7e0 0x7f1d1406fc90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c072890 0x7f1d2c113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 --2- 172.21.15.57:0/2106331729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c073af0 0x7f1d2c114530 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 -- 172.21.15.57:0/2106331729 >> 172.21.15.57:0/2106331729 conn(0x7f1d2c0fa920 msgr2=0x7f1d2c109460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:06.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 -- 172.21.15.57:0/2106331729 shutdown_connections 2024-02-28T16:10:06.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.811+0000 7f1d34600700 1 -- 172.21.15.57:0/2106331729 wait complete. 2024-02-28T16:10:06.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.968+0000 7f15d8a00700 1 -- 172.21.15.57:0/2009524291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40ff150 msgr2=0x7f15d40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:06.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.968+0000 7f15d8a00700 1 --2- 172.21.15.57:0/2009524291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40ff150 0x7f15d40ff560 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f15c4004940 tx=0x7f15c4009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:06.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.968+0000 7f15d8a00700 1 -- 172.21.15.57:0/2009524291 shutdown_connections 2024-02-28T16:10:06.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.968+0000 7f15d8a00700 1 --2- 172.21.15.57:0/2009524291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d4100360 0x7f15d41007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.968+0000 7f15d8a00700 1 --2- 172.21.15.57:0/2009524291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40ff150 0x7f15d40ff560 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.968+0000 7f15d8a00700 1 -- 172.21.15.57:0/2009524291 >> 172.21.15.57:0/2009524291 conn(0x7f15d40fa920 msgr2=0x7f15d40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:06.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.968+0000 7f15d8a00700 1 -- 172.21.15.57:0/2009524291 shutdown_connections 2024-02-28T16:10:06.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.968+0000 7f15d8a00700 1 -- 172.21.15.57:0/2009524291 wait complete. 2024-02-28T16:10:06.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.969+0000 7f15d8a00700 1 Processor -- start 2024-02-28T16:10:06.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.969+0000 7f15d8a00700 1 -- start start 2024-02-28T16:10:06.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.969+0000 7f15d8a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40ff150 0x7f15d410fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:06.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.969+0000 7f15d8a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d4100360 0x7f15d41100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:06.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.969+0000 7f15d8a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d41106d0 con 0x7f15d40ff150 2024-02-28T16:10:06.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.969+0000 7f15d8a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d4110f70 con 0x7f15d4100360 2024-02-28T16:10:06.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.970+0000 7f15d1e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40ff150 0x7f15d410fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:06.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.970+0000 7f15d1e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40ff150 0x7f15d410fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55466/0 (socket says 172.21.15.57:55466) 2024-02-28T16:10:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.970+0000 7f15d1e00700 1 -- 172.21.15.57:0/3873518248 learned_addr learned my addr 172.21.15.57:0/3873518248 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.970+0000 7f15cbe00700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d4100360 0x7f15d41100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.970+0000 7f15d1e00700 1 -- 172.21.15.57:0/3873518248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d4100360 msgr2=0x7f15d41100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.970+0000 7f15d1e00700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d4100360 0x7f15d41100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.970+0000 7f15d1e00700 1 -- 172.21.15.57:0/3873518248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c4005040 con 0x7f15d40ff150 2024-02-28T16:10:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.971+0000 7f15d1e00700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40ff150 0x7f15d410fb90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15c4000c00 tx=0x7f15c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.971+0000 7f15ca000700 1 -- 172.21.15.57:0/3873518248 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15c400e040 con 0x7f15d40ff150 2024-02-28T16:10:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.971+0000 7f15ca000700 1 -- 172.21.15.57:0/3873518248 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15c400bbf0 con 0x7f15d40ff150 2024-02-28T16:10:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.971+0000 7f15d8a00700 1 -- 172.21.15.57:0/3873518248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d41111f0 con 0x7f15d40ff150 2024-02-28T16:10:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.971+0000 7f15ca000700 1 -- 172.21.15.57:0/3873518248 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15c401c630 con 0x7f15d40ff150 2024-02-28T16:10:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.972+0000 7f15d8a00700 1 -- 172.21.15.57:0/3873518248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d4111730 con 0x7f15d40ff150 2024-02-28T16:10:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.973+0000 7f15d8a00700 1 -- 172.21.15.57:0/3873518248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d404bed0 con 0x7f15d40ff150 2024-02-28T16:10:06.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:06 smithi087 ceph-mon[82628]: pgmap v217: 65 pgs: 1 peering, 64 active+clean; 269 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 2 op/s 2024-02-28T16:10:06.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:06 smithi087 ceph-mon[82628]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:06.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:06 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:06.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:06 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:06.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:06 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:06.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:06 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:06.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:06 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.974+0000 7f15ca000700 1 -- 172.21.15.57:0/3873518248 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f15c400bd60 con 0x7f15d40ff150 2024-02-28T16:10:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.974+0000 7f15ca000700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15b806d7f0 0x7f15b806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.975+0000 7f15ca000700 1 -- 172.21.15.57:0/3873518248 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f15c408e150 con 0x7f15d40ff150 2024-02-28T16:10:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.975+0000 7f15cbe00700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15b806d7f0 0x7f15b806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:06.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.976+0000 7f15cbe00700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15b806d7f0 0x7f15b806fca0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15bc004f40 tx=0x7f15bc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:06.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:06.980+0000 7f15ca000700 1 -- 172.21.15.57:0/3873518248 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f15c405b540 con 0x7f15d40ff150 2024-02-28T16:10:07.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:06 smithi057 ceph-mon[93219]: pgmap v217: 65 pgs: 1 peering, 64 active+clean; 269 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 2 op/s 2024-02-28T16:10:07.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:06 smithi057 ceph-mon[93219]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:07.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:06 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:07.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:06 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:07.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:06 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:07.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:06 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:07.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:06 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:07.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.222+0000 7f15d8a00700 1 -- 172.21.15.57:0/3873518248 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f15d4111ba0 con 0x7f15b806d7f0 2024-02-28T16:10:07.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.252+0000 7f15ca000700 1 -- 172.21.15.57:0/3873518248 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f15d4111ba0 con 0x7f15b806d7f0 2024-02-28T16:10:07.244 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:10:07.244 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (8m) 107s ago 19m 14.2M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:10:07.244 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (4m) 107s ago 19m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:10:07.244 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (4m) 8s ago 17m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:10:07.244 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (7m) 107s ago 18m 75.3M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:10:07.244 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (11m) 107s ago 11m 125M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:10:07.244 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (11m) 107s ago 11m 68.0M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:10:07.244 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (11m) 8s ago 11m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:10:07.244 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (11m) 8s ago 11m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (7m) 107s ago 20m 506M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (6m) 8s ago 17m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (5m) 107s ago 21m 48.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (5m) 8s ago 17m 40.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (8m) 107s ago 19m 7906k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (7m) 8s ago 17m 7922k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (3m) 107s ago 16m 137M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (2m) 107s ago 16m 94.7M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (115s) 107s ago 15m 11.0M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (84s) 8s ago 14m 92.1M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (41s) 8s ago 14m 87.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (13s) 8s ago 13m 11.1M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b cbdb6df47634 2024-02-28T16:10:07.245 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (6m) 107s ago 18m 53.5M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:10:07.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.255+0000 7f15d8a00700 1 -- 172.21.15.57:0/3873518248 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15b806d7f0 msgr2=0x7f15b806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:07.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.255+0000 7f15d8a00700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15b806d7f0 0x7f15b806fca0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15bc004f40 tx=0x7f15bc00b040 comp rx=0 tx=0).stop 2024-02-28T16:10:07.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.255+0000 7f15d8a00700 1 -- 172.21.15.57:0/3873518248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40ff150 msgr2=0x7f15d410fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:07.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.255+0000 7f15d8a00700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40ff150 0x7f15d410fb90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15c4000c00 tx=0x7f15c4009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:07.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.255+0000 7f15d8a00700 1 -- 172.21.15.57:0/3873518248 shutdown_connections 2024-02-28T16:10:07.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.255+0000 7f15d8a00700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f15b806d7f0 0x7f15b806fca0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.255+0000 7f15d8a00700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40ff150 0x7f15d410fb90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.255+0000 7f15d8a00700 1 --2- 172.21.15.57:0/3873518248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d4100360 0x7f15d41100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.255+0000 7f15d8a00700 1 -- 172.21.15.57:0/3873518248 >> 172.21.15.57:0/3873518248 conn(0x7f15d40fa920 msgr2=0x7f15d4103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:07.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.255+0000 7f15d8a00700 1 -- 172.21.15.57:0/3873518248 shutdown_connections 2024-02-28T16:10:07.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.256+0000 7f15d8a00700 1 -- 172.21.15.57:0/3873518248 wait complete. 2024-02-28T16:10:07.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.409+0000 7f7fde600700 1 -- 172.21.15.57:0/39676469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fd80fe0e0 msgr2=0x7f7fd80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:07.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.409+0000 7f7fde600700 1 --2- 172.21.15.57:0/39676469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fd80fe0e0 0x7f7fd80fe550 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4004940 tx=0x7f7fc4009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:07.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.409+0000 7f7fde600700 1 -- 172.21.15.57:0/39676469 shutdown_connections 2024-02-28T16:10:07.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.409+0000 7f7fde600700 1 --2- 172.21.15.57:0/39676469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fd80fe0e0 0x7f7fd80fe550 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.409+0000 7f7fde600700 1 --2- 172.21.15.57:0/39676469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fd80fcef0 0x7f7fd80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.409+0000 7f7fde600700 1 -- 172.21.15.57:0/39676469 >> 172.21.15.57:0/39676469 conn(0x7f7fd80f8620 msgr2=0x7f7fd80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:07.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.409+0000 7f7fde600700 1 -- 172.21.15.57:0/39676469 shutdown_connections 2024-02-28T16:10:07.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.409+0000 7f7fde600700 1 -- 172.21.15.57:0/39676469 wait complete. 2024-02-28T16:10:07.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.410+0000 7f7fde600700 1 Processor -- start 2024-02-28T16:10:07.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.410+0000 7f7fde600700 1 -- start start 2024-02-28T16:10:07.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.410+0000 7f7fde600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fd80fcef0 0x7f7fd810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:07.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.410+0000 7f7fde600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fd80fe0e0 0x7f7fd810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:07.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.410+0000 7f7fde600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd810e4b0 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.410+0000 7f7fde600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd810ed50 con 0x7f7fd80fcef0 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.411+0000 7f7fd6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fd80fe0e0 0x7f7fd810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.411+0000 7f7fd6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fd80fe0e0 0x7f7fd810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55490/0 (socket says 172.21.15.57:55490) 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.411+0000 7f7fd6a00700 1 -- 172.21.15.57:0/688608359 learned_addr learned my addr 172.21.15.57:0/688608359 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.411+0000 7f7fd7400700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fd80fcef0 0x7f7fd810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.411+0000 7f7fd6a00700 1 -- 172.21.15.57:0/688608359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fd80fcef0 msgr2=0x7f7fd810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.411+0000 7f7fd6a00700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fd80fcef0 0x7f7fd810d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.411+0000 7f7fd6a00700 1 -- 172.21.15.57:0/688608359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc4005040 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.412+0000 7f7fd6a00700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fd80fe0e0 0x7f7fd810deb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400b3b0 tx=0x7f7fc4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.412+0000 7f7fcf400700 1 -- 172.21.15.57:0/688608359 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fc400e040 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.412+0000 7f7fcf400700 1 -- 172.21.15.57:0/688608359 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fc400bd90 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.412+0000 7f7fde600700 1 -- 172.21.15.57:0/688608359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd810efd0 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.412+0000 7f7fcf400700 1 -- 172.21.15.57:0/688608359 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fc401c630 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.412+0000 7f7fde600700 1 -- 172.21.15.57:0/688608359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd810f510 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.413+0000 7f7fde600700 1 -- 172.21.15.57:0/688608359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd804bed0 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.414+0000 7f7fcf400700 1 -- 172.21.15.57:0/688608359 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f7fc40139f0 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.416+0000 7f7fcf400700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fbc06d7f0 0x7f7fbc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:07.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.416+0000 7f7fcf400700 1 -- 172.21.15.57:0/688608359 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f7fc408e490 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.416+0000 7f7fd7400700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fbc06d7f0 0x7f7fbc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:07.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.417+0000 7f7fd7400700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fbc06d7f0 0x7f7fbc06fca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80fcc30 tx=0x7f7fc800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:07.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.421+0000 7f7fcf400700 1 -- 172.21.15.57:0/688608359 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7fc405b7e0 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.736+0000 7f7fde600700 1 -- 172.21.15.57:0/688608359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7fd8105a30 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.738+0000 7f7fcf400700 1 -- 172.21.15.57:0/688608359 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f7fc405b370 con 0x7f7fd80fe0e0 2024-02-28T16:10:07.729 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:10:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:10:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:10:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4, 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 10 2024-02-28T16:10:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:10:07.731 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:10:07.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.740+0000 7f7fde600700 1 -- 172.21.15.57:0/688608359 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fbc06d7f0 msgr2=0x7f7fbc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:07.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.740+0000 7f7fde600700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fbc06d7f0 0x7f7fbc06fca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80fcc30 tx=0x7f7fc800b040 comp rx=0 tx=0).stop 2024-02-28T16:10:07.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.740+0000 7f7fde600700 1 -- 172.21.15.57:0/688608359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fd80fe0e0 msgr2=0x7f7fd810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:07.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.740+0000 7f7fde600700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fd80fe0e0 0x7f7fd810deb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400b3b0 tx=0x7f7fc4009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:07.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.740+0000 7f7fde600700 1 -- 172.21.15.57:0/688608359 shutdown_connections 2024-02-28T16:10:07.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.740+0000 7f7fde600700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fbc06d7f0 0x7f7fbc06fca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.740+0000 7f7fde600700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fd80fcef0 0x7f7fd810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.740+0000 7f7fde600700 1 --2- 172.21.15.57:0/688608359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fd80fe0e0 0x7f7fd810deb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.740+0000 7f7fde600700 1 -- 172.21.15.57:0/688608359 >> 172.21.15.57:0/688608359 conn(0x7f7fd80f8620 msgr2=0x7f7fd81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:07.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.741+0000 7f7fde600700 1 -- 172.21.15.57:0/688608359 shutdown_connections 2024-02-28T16:10:07.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.741+0000 7f7fde600700 1 -- 172.21.15.57:0/688608359 wait complete. 2024-02-28T16:10:07.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.891+0000 7efd1ca00700 1 -- 172.21.15.57:0/3915096052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd18100380 msgr2=0x7efd181007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.891+0000 7efd1ca00700 1 --2- 172.21.15.57:0/3915096052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd18100380 0x7efd181007d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efd04004940 tx=0x7efd04009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.891+0000 7efd1ca00700 1 -- 172.21.15.57:0/3915096052 shutdown_connections 2024-02-28T16:10:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.891+0000 7efd1ca00700 1 --2- 172.21.15.57:0/3915096052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd18100380 0x7efd181007d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.891+0000 7efd1ca00700 1 --2- 172.21.15.57:0/3915096052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd180ff170 0x7efd180ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.891+0000 7efd1ca00700 1 -- 172.21.15.57:0/3915096052 >> 172.21.15.57:0/3915096052 conn(0x7efd180fa920 msgr2=0x7efd180fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.891+0000 7efd1ca00700 1 -- 172.21.15.57:0/3915096052 shutdown_connections 2024-02-28T16:10:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.891+0000 7efd1ca00700 1 -- 172.21.15.57:0/3915096052 wait complete. 2024-02-28T16:10:07.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.892+0000 7efd1ca00700 1 Processor -- start 2024-02-28T16:10:07.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.892+0000 7efd1ca00700 1 -- start start 2024-02-28T16:10:07.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.892+0000 7efd1ca00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd180ff170 0x7efd1810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:07.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.893+0000 7efd1ca00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd18100380 0x7efd181100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.893+0000 7efd1ca00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd181106d0 con 0x7efd18100380 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.893+0000 7efd1ca00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd18110f70 con 0x7efd180ff170 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.893+0000 7efd15400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd18100380 0x7efd181100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.893+0000 7efd15400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd18100380 0x7efd181100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55504/0 (socket says 172.21.15.57:55504) 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.893+0000 7efd15400700 1 -- 172.21.15.57:0/1136333663 learned_addr learned my addr 172.21.15.57:0/1136333663 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.893+0000 7efd15e00700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd180ff170 0x7efd1810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.893+0000 7efd15400700 1 -- 172.21.15.57:0/1136333663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd180ff170 msgr2=0x7efd1810fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.893+0000 7efd15400700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd180ff170 0x7efd1810fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.893+0000 7efd15400700 1 -- 172.21.15.57:0/1136333663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd04005040 con 0x7efd18100380 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.894+0000 7efd15400700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd18100380 0x7efd181100d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd0400b3b0 tx=0x7efd04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.894+0000 7efd0e000700 1 -- 172.21.15.57:0/1136333663 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd0400e040 con 0x7efd18100380 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.894+0000 7efd0e000700 1 -- 172.21.15.57:0/1136333663 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd0400bd90 con 0x7efd18100380 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.894+0000 7efd0e000700 1 -- 172.21.15.57:0/1136333663 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd0401c630 con 0x7efd18100380 2024-02-28T16:10:07.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.894+0000 7efd1ca00700 1 -- 172.21.15.57:0/1136333663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd181111f0 con 0x7efd18100380 2024-02-28T16:10:07.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.894+0000 7efd1ca00700 1 -- 172.21.15.57:0/1136333663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd18111730 con 0x7efd18100380 2024-02-28T16:10:07.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.895+0000 7efd1ca00700 1 -- 172.21.15.57:0/1136333663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1804bed0 con 0x7efd18100380 2024-02-28T16:10:07.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.896+0000 7efd0e000700 1 -- 172.21.15.57:0/1136333663 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7efd040139f0 con 0x7efd18100380 2024-02-28T16:10:07.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.897+0000 7efd0e000700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcfc06d7f0 0x7efcfc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:07.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.897+0000 7efd0e000700 1 -- 172.21.15.57:0/1136333663 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6585+0+0 (secure 0 0 0) 0x7efd0408e460 con 0x7efd18100380 2024-02-28T16:10:07.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.898+0000 7efd15e00700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcfc06d7f0 0x7efcfc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:07.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.898+0000 7efd15e00700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcfc06d7f0 0x7efcfc06fca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efd08007fd0 tx=0x7efd08009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:07.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:07.902+0000 7efd0e000700 1 -- 172.21.15.57:0/1136333663 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efd0405b790 con 0x7efd18100380 2024-02-28T16:10:08.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.177+0000 7efd1ca00700 1 -- 172.21.15.57:0/1136333663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efd18107c50 con 0x7efd18100380 2024-02-28T16:10:08.170 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:08.170 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/333 objects degraded (12.312%), 10 pgs degraded) 2024-02-28T16:10:08.170 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:08.170 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:08.170 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:08.170 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:08.170 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:08.170 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: Upgrade: Setting container_image for all osd 2024-02-28T16:10:08.170 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: Upgrade: Setting require_osd_release to 19 squid 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-28T16:10:08.171 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:08.172 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:07 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/688608359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:08.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.179+0000 7efd0e000700 1 -- 172.21.15.57:0/1136333663 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1863 (secure 0 0 0) 0x7efd0405b320 con 0x7efd18100380 2024-02-28T16:10:08.172 INFO:teuthology.orchestra.run.smithi057.stdout:e18 2024-02-28T16:10:08.172 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:10:08.172 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:10:08.172 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:10:08.172 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:10:08.172 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 18 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:06:28.521002+0000 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:10:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452,1=24281} 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:14464} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.57:6828/3864009326,v1:172.21.15.57:6829/3864009326] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:10:08.174 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{1:24281} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:10:08.175 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:24293} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.87:6826/2094154189,v1:172.21.15.87:6827/2094154189] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:10:08.175 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:10:08.175 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:10:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.182+0000 7efd1ca00700 1 -- 172.21.15.57:0/1136333663 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcfc06d7f0 msgr2=0x7efcfc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.182+0000 7efd1ca00700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcfc06d7f0 0x7efcfc06fca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efd08007fd0 tx=0x7efd08009040 comp rx=0 tx=0).stop 2024-02-28T16:10:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.182+0000 7efd1ca00700 1 -- 172.21.15.57:0/1136333663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd18100380 msgr2=0x7efd181100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.182+0000 7efd1ca00700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd18100380 0x7efd181100d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd0400b3b0 tx=0x7efd04009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.182+0000 7efd1ca00700 1 -- 172.21.15.57:0/1136333663 shutdown_connections 2024-02-28T16:10:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.182+0000 7efd1ca00700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcfc06d7f0 0x7efcfc06fca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.182+0000 7efd1ca00700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd180ff170 0x7efd1810fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.182+0000 7efd1ca00700 1 --2- 172.21.15.57:0/1136333663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd18100380 0x7efd181100d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.182+0000 7efd1ca00700 1 -- 172.21.15.57:0/1136333663 >> 172.21.15.57:0/1136333663 conn(0x7efd180fa920 msgr2=0x7efd181035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.182+0000 7efd1ca00700 1 -- 172.21.15.57:0/1136333663 shutdown_connections 2024-02-28T16:10:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.183+0000 7efd1ca00700 1 -- 172.21.15.57:0/1136333663 wait complete. 2024-02-28T16:10:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-02-28T16:10:08.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:08.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/333 objects degraded (12.312%), 10 pgs degraded) 2024-02-28T16:10:08.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:08.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:08.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:08.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: Upgrade: Setting container_image for all osd 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-28T16:10:08.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-28T16:10:08.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-28T16:10:08.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: Upgrade: Setting require_osd_release to 19 squid 2024-02-28T16:10:08.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-28T16:10:08.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:08.218 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:07 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/688608359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.339+0000 7f6b8f400700 1 -- 172.21.15.57:0/2795074281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b880fe0e0 msgr2=0x7f6b880fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.339+0000 7f6b8f400700 1 --2- 172.21.15.57:0/2795074281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b880fe0e0 0x7f6b880fe550 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b74004940 tx=0x7f6b74009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.340+0000 7f6b8f400700 1 -- 172.21.15.57:0/2795074281 shutdown_connections 2024-02-28T16:10:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.340+0000 7f6b8f400700 1 --2- 172.21.15.57:0/2795074281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b880fe0e0 0x7f6b880fe550 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.340+0000 7f6b8f400700 1 --2- 172.21.15.57:0/2795074281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b880fcef0 0x7f6b880fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.340+0000 7f6b8f400700 1 -- 172.21.15.57:0/2795074281 >> 172.21.15.57:0/2795074281 conn(0x7f6b880f8620 msgr2=0x7f6b880faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.340+0000 7f6b8f400700 1 -- 172.21.15.57:0/2795074281 shutdown_connections 2024-02-28T16:10:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.340+0000 7f6b8f400700 1 -- 172.21.15.57:0/2795074281 wait complete. 2024-02-28T16:10:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.341+0000 7f6b8f400700 1 Processor -- start 2024-02-28T16:10:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.341+0000 7f6b8f400700 1 -- start start 2024-02-28T16:10:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.342+0000 7f6b8f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b880fcef0 0x7f6b8810fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.342+0000 7f6b8f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b880fe0e0 0x7f6b881100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.342+0000 7f6b8f400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b881106a0 con 0x7f6b880fe0e0 2024-02-28T16:10:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.342+0000 7f6b8f400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b88110f40 con 0x7f6b880fcef0 2024-02-28T16:10:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.342+0000 7f6b87e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b880fe0e0 0x7f6b881100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.342+0000 7f6b87e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b880fe0e0 0x7f6b881100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55526/0 (socket says 172.21.15.57:55526) 2024-02-28T16:10:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.342+0000 7f6b87e00700 1 -- 172.21.15.57:0/2357942667 learned_addr learned my addr 172.21.15.57:0/2357942667 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.342+0000 7f6b87e00700 1 -- 172.21.15.57:0/2357942667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b880fcef0 msgr2=0x7f6b8810fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.342+0000 7f6b87e00700 1 --2- 172.21.15.57:0/2357942667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b880fcef0 0x7f6b8810fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.343+0000 7f6b87e00700 1 -- 172.21.15.57:0/2357942667 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b74005040 con 0x7f6b880fe0e0 2024-02-28T16:10:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.343+0000 7f6b87e00700 1 --2- 172.21.15.57:0/2357942667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b880fe0e0 0x7f6b881100a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400b3b0 tx=0x7f6b74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.343+0000 7f6b84c00700 1 -- 172.21.15.57:0/2357942667 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b7400e040 con 0x7f6b880fe0e0 2024-02-28T16:10:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.343+0000 7f6b84c00700 1 -- 172.21.15.57:0/2357942667 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b7400bd90 con 0x7f6b880fe0e0 2024-02-28T16:10:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.343+0000 7f6b84c00700 1 -- 172.21.15.57:0/2357942667 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b7401c630 con 0x7f6b880fe0e0 2024-02-28T16:10:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.343+0000 7f6b8f400700 1 -- 172.21.15.57:0/2357942667 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b881111c0 con 0x7f6b880fe0e0 2024-02-28T16:10:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.343+0000 7f6b8f400700 1 -- 172.21.15.57:0/2357942667 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b88111700 con 0x7f6b880fe0e0 2024-02-28T16:10:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.345+0000 7f6b8f400700 1 -- 172.21.15.57:0/2357942667 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b88102210 con 0x7f6b880fe0e0 2024-02-28T16:10:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.346+0000 7f6b84c00700 1 -- 172.21.15.57:0/2357942667 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6b740139f0 con 0x7f6b880fe0e0 2024-02-28T16:10:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.346+0000 7f6b84c00700 1 --2- 172.21.15.57:0/2357942667 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6b7006d7f0 0x7f6b7006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.347+0000 7f6b84c00700 1 -- 172.21.15.57:0/2357942667 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f6b7408e460 con 0x7f6b880fe0e0 2024-02-28T16:10:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.347+0000 7f6b8ca00700 1 --2- 172.21.15.57:0/2357942667 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6b7006d7f0 0x7f6b7006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.347+0000 7f6b8ca00700 1 --2- 172.21.15.57:0/2357942667 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6b7006d7f0 0x7f6b7006fca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b880fcc30 tx=0x7f6b7c009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:08.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.351+0000 7f6b84c00700 1 -- 172.21.15.57:0/2357942667 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6b7405b790 con 0x7f6b880fe0e0 2024-02-28T16:10:08.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.591+0000 7f6b8f400700 1 -- 172.21.15.57:0/2357942667 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b8802b400 con 0x7f6b7006d7f0 2024-02-28T16:10:08.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.594+0000 7f6b84c00700 1 -- 172.21.15.57:0/2357942667 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6b8802b400 con 0x7f6b7006d7f0 2024-02-28T16:10:08.585 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:10:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:10:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:10:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:10:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:10:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "osd", 2024-02-28T16:10:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:10:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:10:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:10:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:10:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "12/21 daemons upgraded", 2024-02-28T16:10:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:10:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:10:08.586 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:10:08.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.596+0000 7f6b8f400700 1 -- 172.21.15.57:0/2357942667 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6b7006d7f0 msgr2=0x7f6b7006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:08.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.596+0000 7f6b8f400700 1 --2- 172.21.15.57:0/2357942667 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6b7006d7f0 0x7f6b7006fca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b880fcc30 tx=0x7f6b7c009ce0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.596+0000 7f6b8f400700 1 -- 172.21.15.57:0/2357942667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b880fe0e0 msgr2=0x7f6b881100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:08.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.596+0000 7f6b8f400700 1 --2- 172.21.15.57:0/2357942667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b880fe0e0 0x7f6b881100a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400b3b0 tx=0x7f6b74009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:08.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.597+0000 7f6b8f400700 1 -- 172.21.15.57:0/2357942667 shutdown_connections 2024-02-28T16:10:08.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.597+0000 7f6b8f400700 1 --2- 172.21.15.57:0/2357942667 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6b7006d7f0 0x7f6b7006fca0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.597+0000 7f6b8f400700 1 --2- 172.21.15.57:0/2357942667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b880fcef0 0x7f6b8810fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.597+0000 7f6b8f400700 1 --2- 172.21.15.57:0/2357942667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b880fe0e0 0x7f6b881100a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.597+0000 7f6b8f400700 1 -- 172.21.15.57:0/2357942667 >> 172.21.15.57:0/2357942667 conn(0x7f6b880f8620 msgr2=0x7f6b880ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:08.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.597+0000 7f6b8f400700 1 -- 172.21.15.57:0/2357942667 shutdown_connections 2024-02-28T16:10:08.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.597+0000 7f6b8f400700 1 -- 172.21.15.57:0/2357942667 wait complete. 2024-02-28T16:10:08.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.743+0000 7f5a29800700 1 -- 172.21.15.57:0/240104335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a24070860 msgr2=0x7f5a24070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:08.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.743+0000 7f5a29800700 1 --2- 172.21.15.57:0/240104335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a24070860 0x7f5a24070cd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5a10004940 tx=0x7f5a10009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:08.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.743+0000 7f5a29800700 1 -- 172.21.15.57:0/240104335 shutdown_connections 2024-02-28T16:10:08.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.743+0000 7f5a29800700 1 --2- 172.21.15.57:0/240104335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a24070860 0x7f5a24070cd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.743+0000 7f5a29800700 1 --2- 172.21.15.57:0/240104335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a24071eb0 0x7f5a24070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.743+0000 7f5a29800700 1 -- 172.21.15.57:0/240104335 >> 172.21.15.57:0/240104335 conn(0x7f5a240f8620 msgr2=0x7f5a240faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:08.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.743+0000 7f5a29800700 1 -- 172.21.15.57:0/240104335 shutdown_connections 2024-02-28T16:10:08.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.743+0000 7f5a29800700 1 -- 172.21.15.57:0/240104335 wait complete. 2024-02-28T16:10:08.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.744+0000 7f5a29800700 1 Processor -- start 2024-02-28T16:10:08.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.744+0000 7f5a29800700 1 -- start start 2024-02-28T16:10:08.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.745+0000 7f5a29800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a24070860 0x7f5a2410fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:08.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.745+0000 7f5a29800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a24071eb0 0x7f5a241100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:08.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.745+0000 7f5a29800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a241106c0 con 0x7f5a24070860 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.745+0000 7f5a29800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a24110f60 con 0x7f5a24071eb0 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.745+0000 7f5a22a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a24070860 0x7f5a2410fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.745+0000 7f5a22a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a24070860 0x7f5a2410fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55550/0 (socket says 172.21.15.57:55550) 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.745+0000 7f5a22a00700 1 -- 172.21.15.57:0/255254074 learned_addr learned my addr 172.21.15.57:0/255254074 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.745+0000 7f5a22000700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a24071eb0 0x7f5a241100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.745+0000 7f5a22a00700 1 -- 172.21.15.57:0/255254074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a24071eb0 msgr2=0x7f5a241100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.746+0000 7f5a22a00700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a24071eb0 0x7f5a241100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.746+0000 7f5a22a00700 1 -- 172.21.15.57:0/255254074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a10005040 con 0x7f5a24070860 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.746+0000 7f5a22a00700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a24070860 0x7f5a2410fb80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5a14002a50 tx=0x7f5a140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.746+0000 7f5a1aa00700 1 -- 172.21.15.57:0/255254074 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a14007cc0 con 0x7f5a24070860 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.746+0000 7f5a1aa00700 1 -- 172.21.15.57:0/255254074 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a1400f040 con 0x7f5a24070860 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.746+0000 7f5a1aa00700 1 -- 172.21.15.57:0/255254074 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a1400db70 con 0x7f5a24070860 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.746+0000 7f5a29800700 1 -- 172.21.15.57:0/255254074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a24111240 con 0x7f5a24070860 2024-02-28T16:10:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.746+0000 7f5a29800700 1 -- 172.21.15.57:0/255254074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a24111780 con 0x7f5a24070860 2024-02-28T16:10:08.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.747+0000 7f5a29800700 1 -- 172.21.15.57:0/255254074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2404bed0 con 0x7f5a24070860 2024-02-28T16:10:08.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.748+0000 7f5a1aa00700 1 -- 172.21.15.57:0/255254074 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f5a1400dd10 con 0x7f5a24070860 2024-02-28T16:10:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.749+0000 7f5a1aa00700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5a0806d7f0 0x7f5a0806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:08.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.749+0000 7f5a1aa00700 1 -- 172.21.15.57:0/255254074 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f5a1408c640 con 0x7f5a24070860 2024-02-28T16:10:08.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.749+0000 7f5a22000700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5a0806d7f0 0x7f5a0806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:08.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.750+0000 7f5a22000700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5a0806d7f0 0x7f5a0806fca0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000b840 tx=0x7f5a10009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:08.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:08.754+0000 7f5a1aa00700 1 -- 172.21.15.57:0/255254074 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5a140598f0 con 0x7f5a24070860 2024-02-28T16:10:09.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.067+0000 7f5a29800700 1 -- 172.21.15.57:0/255254074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5a24107c20 con 0x7f5a24070860 2024-02-28T16:10:09.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.067+0000 7f5a1aa00700 1 -- 172.21.15.57:0/255254074 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5a14059480 con 0x7f5a24070860 2024-02-28T16:10:09.059 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:10:09.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.070+0000 7f5a29800700 1 -- 172.21.15.57:0/255254074 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5a0806d7f0 msgr2=0x7f5a0806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:09.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.070+0000 7f5a29800700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5a0806d7f0 0x7f5a0806fca0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000b840 tx=0x7f5a10009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:09.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.070+0000 7f5a29800700 1 -- 172.21.15.57:0/255254074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a24070860 msgr2=0x7f5a2410fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:09.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.070+0000 7f5a29800700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a24070860 0x7f5a2410fb80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5a14002a50 tx=0x7f5a140046b0 comp rx=0 tx=0).stop 2024-02-28T16:10:09.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.070+0000 7f5a29800700 1 -- 172.21.15.57:0/255254074 shutdown_connections 2024-02-28T16:10:09.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.070+0000 7f5a29800700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5a0806d7f0 0x7f5a0806fca0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:09.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.070+0000 7f5a29800700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a24070860 0x7f5a2410fb80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:09.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.070+0000 7f5a29800700 1 --2- 172.21.15.57:0/255254074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a24071eb0 0x7f5a241100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:09.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.070+0000 7f5a29800700 1 -- 172.21.15.57:0/255254074 >> 172.21.15.57:0/255254074 conn(0x7f5a240f8620 msgr2=0x7f5a24102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:09.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.070+0000 7f5a29800700 1 -- 172.21.15.57:0/255254074 shutdown_connections 2024-02-28T16:10:09.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:09.071+0000 7f5a29800700 1 -- 172.21.15.57:0/255254074 wait complete. 2024-02-28T16:10:09.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:08 smithi057 ceph-mon[93219]: pgmap v218: 65 pgs: 65 active+clean; 269 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-02-28T16:10:09.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:08 smithi057 ceph-mon[93219]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-28T16:10:09.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:08 smithi057 ceph-mon[93219]: Cluster is now healthy 2024-02-28T16:10:09.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:08 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-28T16:10:09.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:08 smithi057 ceph-mon[93219]: osdmap e98: 6 total, 6 up, 6 in 2024-02-28T16:10:09.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:08 smithi057 ceph-mon[93219]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-28T16:10:09.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:08 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1136333663' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:10:09.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:08 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:09.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:08 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-28T16:10:09.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:08 smithi057 ceph-mon[93219]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:08 smithi087 ceph-mon[82628]: pgmap v218: 65 pgs: 65 active+clean; 269 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-02-28T16:10:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:08 smithi087 ceph-mon[82628]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-28T16:10:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:08 smithi087 ceph-mon[82628]: Cluster is now healthy 2024-02-28T16:10:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:08 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-28T16:10:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:08 smithi087 ceph-mon[82628]: osdmap e98: 6 total, 6 up, 6 in 2024-02-28T16:10:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:08 smithi087 ceph-mon[82628]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-28T16:10:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:08 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1136333663' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:10:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:08 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:08 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-28T16:10:09.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:08 smithi087 ceph-mon[82628]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:10.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: osdmap e99: 6 total, 6 up, 6 in 2024-02-28T16:10:10.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/255254074' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:10:10.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-28T16:10:10.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-28T16:10:10.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2024-02-28T16:10:10.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:10.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: Upgrade: Scaling down filesystem cephfs 2024-02-28T16:10:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:10.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: osdmap e99: 6 total, 6 up, 6 in 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/255254074' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:10.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: Upgrade: Scaling down filesystem cephfs 2024-02-28T16:10:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:10.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-28T16:10:11.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: pgmap v221: 65 pgs: 65 active+clean; 269 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: Cluster is now healthy 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.87:6826/3768145606,v1:172.21.15.87:6827/3768145606] up:boot 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.57:6828/3861545073,v1:172.21.15.57:6829/3861545073] up:boot 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: stopping daemon mds.cephfs.smithi087.fzjgef 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:stopping} 2 up:standby 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:11.178 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:11.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:11.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:11.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:11.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:11.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:11.179 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:10 smithi057 ceph-mon[93219]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-28T16:10:11.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: pgmap v221: 65 pgs: 65 active+clean; 269 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-28T16:10:11.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-28T16:10:11.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: Cluster is now healthy 2024-02-28T16:10:11.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-28T16:10:11.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.87:6826/3768145606,v1:172.21.15.87:6827/3768145606] up:boot 2024-02-28T16:10:11.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.57:6828/3861545073,v1:172.21.15.57:6829/3861545073] up:boot 2024-02-28T16:10:11.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: stopping daemon mds.cephfs.smithi087.fzjgef 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:active} 2 up:standby 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi087.fzjgef=up:stopping} 2 up:standby 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:11.216 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:11.217 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:10 smithi087 ceph-mon[82628]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-28T16:10:13.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:12 smithi057 ceph-mon[93219]: pgmap v222: 65 pgs: 65 active+clean; 269 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 2 op/s 2024-02-28T16:10:13.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:12 smithi087 ceph-mon[82628]: pgmap v222: 65 pgs: 65 active+clean; 269 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 2 op/s 2024-02-28T16:10:14.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:14 smithi087 ceph-mon[82628]: pgmap v223: 65 pgs: 65 active+clean; 269 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 383 B/s wr, 2 op/s 2024-02-28T16:10:14.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:14 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:15.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:14 smithi057 ceph-mon[93219]: pgmap v223: 65 pgs: 65 active+clean; 269 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 383 B/s wr, 2 op/s 2024-02-28T16:10:15.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:14 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:17.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:16 smithi087 ceph-mon[82628]: pgmap v224: 65 pgs: 65 active+clean; 269 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s 2024-02-28T16:10:17.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:16 smithi057 ceph-mon[93219]: pgmap v224: 65 pgs: 65 active+clean; 269 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s 2024-02-28T16:10:19.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:18 smithi087 ceph-mon[82628]: pgmap v225: 65 pgs: 65 active+clean; 269 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 847 B/s rd, 423 B/s wr, 2 op/s 2024-02-28T16:10:19.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:18 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:19.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:18 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:10:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:18 smithi057 ceph-mon[93219]: pgmap v225: 65 pgs: 65 active+clean; 269 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 847 B/s rd, 423 B/s wr, 2 op/s 2024-02-28T16:10:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:18 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:19.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:18 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:10:21.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:20 smithi057 ceph-mon[93219]: pgmap v226: 65 pgs: 65 active+clean; 269 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 744 B/s rd, 465 B/s wr, 2 op/s 2024-02-28T16:10:21.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:21.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:21.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:21.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:21.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:21.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:20 smithi087 ceph-mon[82628]: pgmap v226: 65 pgs: 65 active+clean; 269 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 744 B/s rd, 465 B/s wr, 2 op/s 2024-02-28T16:10:21.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:21.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:21.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:21.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:21.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:22.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:21 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:22.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:21 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:22.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:21 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:22.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:21 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:22.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:21 smithi057 ceph-mon[93219]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-28T16:10:22.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:21 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:22.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:21 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:22.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:21 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:22.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:21 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:22.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:21 smithi087 ceph-mon[82628]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-28T16:10:23.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:22 smithi057 ceph-mon[93219]: pgmap v227: 65 pgs: 65 active+clean; 269 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 853 B/s wr, 5 op/s 2024-02-28T16:10:23.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:22 smithi087 ceph-mon[82628]: pgmap v227: 65 pgs: 65 active+clean; 269 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 853 B/s wr, 5 op/s 2024-02-28T16:10:25.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:24 smithi057 ceph-mon[93219]: pgmap v228: 65 pgs: 65 active+clean; 253 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 5 op/s 2024-02-28T16:10:25.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:24 smithi087 ceph-mon[82628]: pgmap v228: 65 pgs: 65 active+clean; 253 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 5 op/s 2024-02-28T16:10:27.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:26 smithi057 ceph-mon[93219]: pgmap v229: 65 pgs: 65 active+clean; 185 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 6 op/s 2024-02-28T16:10:27.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:27 smithi087 ceph-mon[82628]: pgmap v229: 65 pgs: 65 active+clean; 185 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 6 op/s 2024-02-28T16:10:29.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:29 smithi057 ceph-mon[93219]: pgmap v230: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-28T16:10:29.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:29 smithi087 ceph-mon[82628]: pgmap v230: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-28T16:10:31.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:31 smithi057 ceph-mon[93219]: pgmap v231: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-28T16:10:31.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:31.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:31 smithi087 ceph-mon[82628]: pgmap v231: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-28T16:10:31.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:33 smithi057 ceph-mon[93219]: pgmap v232: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 7 op/s 2024-02-28T16:10:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:33 smithi057 ceph-mon[93219]: daemon mds.cephfs.smithi087.fzjgef finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-02-28T16:10:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:33.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:33.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:33.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:33.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:33.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:33.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:33.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:33 smithi087 ceph-mon[82628]: pgmap v232: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 7 op/s 2024-02-28T16:10:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:33 smithi087 ceph-mon[82628]: daemon mds.cephfs.smithi087.fzjgef finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-02-28T16:10:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:33.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:33.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:33.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:33.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:33.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:34.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:34 smithi057 ceph-mon[93219]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-28T16:10:34.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:34 smithi057 ceph-mon[93219]: mds.1 [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] down:stopped 2024-02-28T16:10:34.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:34 smithi057 ceph-mon[93219]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 2 up:standby 2024-02-28T16:10:34.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:10:34.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:34 smithi087 ceph-mon[82628]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-28T16:10:34.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:34 smithi087 ceph-mon[82628]: mds.1 [v2:172.21.15.87:6824/82197361,v1:172.21.15.87:6825/82197361] down:stopped 2024-02-28T16:10:34.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:34 smithi087 ceph-mon[82628]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 2 up:standby 2024-02-28T16:10:34.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:10:35.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:35 smithi057 ceph-mon[93219]: pgmap v233: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 3 op/s 2024-02-28T16:10:35.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:35 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.87:6824/456812589,v1:172.21.15.87:6825/456812589] up:boot 2024-02-28T16:10:35.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:35 smithi057 ceph-mon[93219]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 3 up:standby 2024-02-28T16:10:35.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:10:35.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:35 smithi087 ceph-mon[82628]: pgmap v233: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 3 op/s 2024-02-28T16:10:35.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:35 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.87:6824/456812589,v1:172.21.15.87:6825/456812589] up:boot 2024-02-28T16:10:35.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:35 smithi087 ceph-mon[82628]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 3 up:standby 2024-02-28T16:10:35.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:10:37.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:37 smithi057 ceph-mon[93219]: pgmap v234: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-02-28T16:10:37.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:37 smithi087 ceph-mon[82628]: pgmap v234: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-02-28T16:10:39.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.239+0000 7f1f5da00700 1 -- 172.21.15.57:0/3735588533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58104580 msgr2=0x7f1f581049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:39.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.239+0000 7f1f5da00700 1 --2- 172.21.15.57:0/3735588533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58104580 0x7f1f581049d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f44004940 tx=0x7f1f44009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:39.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.239+0000 7f1f5da00700 1 -- 172.21.15.57:0/3735588533 shutdown_connections 2024-02-28T16:10:39.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.239+0000 7f1f5da00700 1 --2- 172.21.15.57:0/3735588533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58104580 0x7f1f581049d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.239+0000 7f1f5da00700 1 --2- 172.21.15.57:0/3735588533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58103370 0x7f1f58103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.239+0000 7f1f5da00700 1 -- 172.21.15.57:0/3735588533 >> 172.21.15.57:0/3735588533 conn(0x7f1f580727d0 msgr2=0x7f1f58074c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:39.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.240+0000 7f1f5da00700 1 -- 172.21.15.57:0/3735588533 shutdown_connections 2024-02-28T16:10:39.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.240+0000 7f1f5da00700 1 -- 172.21.15.57:0/3735588533 wait complete. 2024-02-28T16:10:39.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.241+0000 7f1f5da00700 1 Processor -- start 2024-02-28T16:10:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.241+0000 7f1f5da00700 1 -- start start 2024-02-28T16:10:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.241+0000 7f1f5da00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58103370 0x7f1f58113d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.241+0000 7f1f5da00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58104580 0x7f1f581142d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.241+0000 7f1f5da00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f581150c0 con 0x7f1f58103370 2024-02-28T16:10:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.241+0000 7f1f5da00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58115230 con 0x7f1f58104580 2024-02-28T16:10:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.242+0000 7f1f57e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58103370 0x7f1f58113d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.242+0000 7f1f57e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58103370 0x7f1f58113d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35584/0 (socket says 172.21.15.57:35584) 2024-02-28T16:10:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.242+0000 7f1f57e00700 1 -- 172.21.15.57:0/44439889 learned_addr learned my addr 172.21.15.57:0/44439889 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.242+0000 7f1f57400700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58104580 0x7f1f581142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.242+0000 7f1f57e00700 1 -- 172.21.15.57:0/44439889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58104580 msgr2=0x7f1f581142d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.242+0000 7f1f57e00700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58104580 0x7f1f581142d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.242+0000 7f1f57e00700 1 -- 172.21.15.57:0/44439889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44005040 con 0x7f1f58103370 2024-02-28T16:10:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.243+0000 7f1f57e00700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58103370 0x7f1f58113d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f48002a80 tx=0x7f1f48004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.243+0000 7f1f4fe00700 1 -- 172.21.15.57:0/44439889 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f48007cc0 con 0x7f1f58103370 2024-02-28T16:10:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.243+0000 7f1f5da00700 1 -- 172.21.15.57:0/44439889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f58115510 con 0x7f1f58103370 2024-02-28T16:10:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.243+0000 7f1f4fe00700 1 -- 172.21.15.57:0/44439889 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f4800f040 con 0x7f1f58103370 2024-02-28T16:10:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.243+0000 7f1f4fe00700 1 -- 172.21.15.57:0/44439889 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f4800da30 con 0x7f1f58103370 2024-02-28T16:10:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.243+0000 7f1f5da00700 1 -- 172.21.15.57:0/44439889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f58115ad0 con 0x7f1f58103370 2024-02-28T16:10:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.244+0000 7f1f5da00700 1 -- 172.21.15.57:0/44439889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5805f5c0 con 0x7f1f58103370 2024-02-28T16:10:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.245+0000 7f1f4fe00700 1 -- 172.21.15.57:0/44439889 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1f4800db90 con 0x7f1f58103370 2024-02-28T16:10:39.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.246+0000 7f1f4fe00700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f3c06d7f0 0x7f1f3c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:39.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.247+0000 7f1f4fe00700 1 -- 172.21.15.57:0/44439889 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f1f4808cd90 con 0x7f1f58103370 2024-02-28T16:10:39.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.247+0000 7f1f57400700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f3c06d7f0 0x7f1f3c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:39.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.248+0000 7f1f57400700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f3c06d7f0 0x7f1f3c06fca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1f58113b20 tx=0x7f1f44009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:39.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.252+0000 7f1f4fe00700 1 -- 172.21.15.57:0/44439889 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1f48056490 con 0x7f1f58103370 2024-02-28T16:10:39.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:39 smithi057 ceph-mon[93219]: pgmap v235: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-28T16:10:39.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:39 smithi087 ceph-mon[82628]: pgmap v235: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-28T16:10:39.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.499+0000 7f1f5da00700 1 -- 172.21.15.57:0/44439889 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f5804bf80 con 0x7f1f3c06d7f0 2024-02-28T16:10:39.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.503+0000 7f1f4fe00700 1 -- 172.21.15.57:0/44439889 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1f5804bf80 con 0x7f1f3c06d7f0 2024-02-28T16:10:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.505+0000 7f1f5da00700 1 -- 172.21.15.57:0/44439889 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f3c06d7f0 msgr2=0x7f1f3c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.505+0000 7f1f5da00700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f3c06d7f0 0x7f1f3c06fca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1f58113b20 tx=0x7f1f44009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.506+0000 7f1f5da00700 1 -- 172.21.15.57:0/44439889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58103370 msgr2=0x7f1f58113d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.506+0000 7f1f5da00700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58103370 0x7f1f58113d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f48002a80 tx=0x7f1f48004600 comp rx=0 tx=0).stop 2024-02-28T16:10:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.506+0000 7f1f5da00700 1 -- 172.21.15.57:0/44439889 shutdown_connections 2024-02-28T16:10:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.506+0000 7f1f5da00700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1f3c06d7f0 0x7f1f3c06fca0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.506+0000 7f1f5da00700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f58103370 0x7f1f58113d90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.506+0000 7f1f5da00700 1 --2- 172.21.15.57:0/44439889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f58104580 0x7f1f581142d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.506+0000 7f1f5da00700 1 -- 172.21.15.57:0/44439889 >> 172.21.15.57:0/44439889 conn(0x7f1f580727d0 msgr2=0x7f1f581077b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:39.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.506+0000 7f1f5da00700 1 -- 172.21.15.57:0/44439889 shutdown_connections 2024-02-28T16:10:39.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.506+0000 7f1f5da00700 1 -- 172.21.15.57:0/44439889 wait complete. 2024-02-28T16:10:39.514 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:10:39.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.667+0000 7f2814e00700 1 -- 172.21.15.57:0/329353032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28100708c0 msgr2=0x7f2810070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:39.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.667+0000 7f2814e00700 1 --2- 172.21.15.57:0/329353032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28100708c0 0x7f2810070d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f27f8004940 tx=0x7f27f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:39.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.667+0000 7f2814e00700 1 -- 172.21.15.57:0/329353032 shutdown_connections 2024-02-28T16:10:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.667+0000 7f2814e00700 1 --2- 172.21.15.57:0/329353032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28100708c0 0x7f2810070d10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.667+0000 7f2814e00700 1 --2- 172.21.15.57:0/329353032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2810071f10 0x7f2810070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.667+0000 7f2814e00700 1 -- 172.21.15.57:0/329353032 >> 172.21.15.57:0/329353032 conn(0x7f28100f8620 msgr2=0x7f28100faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.667+0000 7f2814e00700 1 -- 172.21.15.57:0/329353032 shutdown_connections 2024-02-28T16:10:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.668+0000 7f2814e00700 1 -- 172.21.15.57:0/329353032 wait complete. 2024-02-28T16:10:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.668+0000 7f2814e00700 1 Processor -- start 2024-02-28T16:10:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.668+0000 7f2814e00700 1 -- start start 2024-02-28T16:10:39.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.669+0000 7f2814e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28100708c0 0x7f281010fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:39.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.669+0000 7f2814e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2810071f10 0x7f2810110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.669+0000 7f2814e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28101107c0 con 0x7f28100708c0 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.669+0000 7f2814e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2810111000 con 0x7f2810071f10 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.669+0000 7f280de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28100708c0 0x7f281010fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.669+0000 7f280de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28100708c0 0x7f281010fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35600/0 (socket says 172.21.15.57:35600) 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.669+0000 7f280de00700 1 -- 172.21.15.57:0/1226285833 learned_addr learned my addr 172.21.15.57:0/1226285833 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.670+0000 7f280de00700 1 -- 172.21.15.57:0/1226285833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2810071f10 msgr2=0x7f2810110130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.670+0000 7f280de00700 1 --2- 172.21.15.57:0/1226285833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2810071f10 0x7f2810110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.670+0000 7f280de00700 1 -- 172.21.15.57:0/1226285833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f8005040 con 0x7f28100708c0 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.670+0000 7f280de00700 1 --2- 172.21.15.57:0/1226285833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28100708c0 0x7f281010fbf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f280000bbb0 tx=0x7f2800009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.670+0000 7f2806a00700 1 -- 172.21.15.57:0/1226285833 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28000092e0 con 0x7f28100708c0 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.670+0000 7f2806a00700 1 -- 172.21.15.57:0/1226285833 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f280000cbd0 con 0x7f28100708c0 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.670+0000 7f2806a00700 1 -- 172.21.15.57:0/1226285833 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2800007400 con 0x7f28100708c0 2024-02-28T16:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.670+0000 7f2814e00700 1 -- 172.21.15.57:0/1226285833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28101112e0 con 0x7f28100708c0 2024-02-28T16:10:39.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.670+0000 7f2814e00700 1 -- 172.21.15.57:0/1226285833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2810111820 con 0x7f28100708c0 2024-02-28T16:10:39.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.671+0000 7f2814e00700 1 -- 172.21.15.57:0/1226285833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281004bed0 con 0x7f28100708c0 2024-02-28T16:10:39.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.673+0000 7f2806a00700 1 -- 172.21.15.57:0/1226285833 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2800012070 con 0x7f28100708c0 2024-02-28T16:10:39.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.674+0000 7f2806a00700 1 --2- 172.21.15.57:0/1226285833 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f27f406d7f0 0x7f27f406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:39.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.674+0000 7f2806a00700 1 -- 172.21.15.57:0/1226285833 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f280008cbc0 con 0x7f28100708c0 2024-02-28T16:10:39.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.674+0000 7f2805400700 1 --2- 172.21.15.57:0/1226285833 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f27f406d7f0 0x7f27f406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:39.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.675+0000 7f2805400700 1 --2- 172.21.15.57:0/1226285833 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f27f406d7f0 0x7f27f406fca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f27f8004f90 tx=0x7f27f8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:39.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.679+0000 7f2806a00700 1 -- 172.21.15.57:0/1226285833 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2800059e70 con 0x7f28100708c0 2024-02-28T16:10:39.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.922+0000 7f2814e00700 1 -- 172.21.15.57:0/1226285833 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f28101044f0 con 0x7f27f406d7f0 2024-02-28T16:10:39.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.924+0000 7f2806a00700 1 -- 172.21.15.57:0/1226285833 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f28101044f0 con 0x7f27f406d7f0 2024-02-28T16:10:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 -- 172.21.15.57:0/1226285833 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f27f406d7f0 msgr2=0x7f27f406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 --2- 172.21.15.57:0/1226285833 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f27f406d7f0 0x7f27f406fca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f27f8004f90 tx=0x7f27f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 -- 172.21.15.57:0/1226285833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28100708c0 msgr2=0x7f281010fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 --2- 172.21.15.57:0/1226285833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28100708c0 0x7f281010fbf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f280000bbb0 tx=0x7f2800009840 comp rx=0 tx=0).stop 2024-02-28T16:10:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 -- 172.21.15.57:0/1226285833 shutdown_connections 2024-02-28T16:10:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 --2- 172.21.15.57:0/1226285833 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f27f406d7f0 0x7f27f406fca0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 --2- 172.21.15.57:0/1226285833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28100708c0 0x7f281010fbf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 --2- 172.21.15.57:0/1226285833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2810071f10 0x7f2810110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 -- 172.21.15.57:0/1226285833 >> 172.21.15.57:0/1226285833 conn(0x7f28100f8620 msgr2=0x7f2810102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 -- 172.21.15.57:0/1226285833 shutdown_connections 2024-02-28T16:10:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:39.927+0000 7f2814e00700 1 -- 172.21.15.57:0/1226285833 wait complete. 2024-02-28T16:10:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.084+0000 7f14cb200700 1 -- 172.21.15.57:0/988264412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14c40708c0 msgr2=0x7f14c4070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.084+0000 7f14cb200700 1 --2- 172.21.15.57:0/988264412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14c40708c0 0x7f14c4070d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f14b0004940 tx=0x7f14b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.084+0000 7f14cb200700 1 -- 172.21.15.57:0/988264412 shutdown_connections 2024-02-28T16:10:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.084+0000 7f14cb200700 1 --2- 172.21.15.57:0/988264412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14c40708c0 0x7f14c4070d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.084+0000 7f14cb200700 1 --2- 172.21.15.57:0/988264412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14c4071f10 0x7f14c4070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.084+0000 7f14cb200700 1 -- 172.21.15.57:0/988264412 >> 172.21.15.57:0/988264412 conn(0x7f14c40f8620 msgr2=0x7f14c40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.084+0000 7f14cb200700 1 -- 172.21.15.57:0/988264412 shutdown_connections 2024-02-28T16:10:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.084+0000 7f14cb200700 1 -- 172.21.15.57:0/988264412 wait complete. 2024-02-28T16:10:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.085+0000 7f14cb200700 1 Processor -- start 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.086+0000 7f14cb200700 1 -- start start 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.086+0000 7f14cb200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14c40708c0 0x7f14c410fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.086+0000 7f14cb200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14c4071f10 0x7f14c4110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.086+0000 7f14cb200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c41107c0 con 0x7f14c4071f10 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.086+0000 7f14cb200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4111000 con 0x7f14c40708c0 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.086+0000 7f14c3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14c4071f10 0x7f14c4110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.086+0000 7f14c3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14c4071f10 0x7f14c4110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35620/0 (socket says 172.21.15.57:35620) 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.086+0000 7f14c3400700 1 -- 172.21.15.57:0/1856865882 learned_addr learned my addr 172.21.15.57:0/1856865882 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.087+0000 7f14c3e00700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14c40708c0 0x7f14c410fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.087+0000 7f14c3400700 1 -- 172.21.15.57:0/1856865882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14c40708c0 msgr2=0x7f14c410fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.087+0000 7f14c3400700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14c40708c0 0x7f14c410fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.087+0000 7f14c3400700 1 -- 172.21.15.57:0/1856865882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b0005040 con 0x7f14c4071f10 2024-02-28T16:10:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.087+0000 7f14c3400700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14c4071f10 0x7f14c4110130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000c00 tx=0x7f14b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.087+0000 7f14bbe00700 1 -- 172.21.15.57:0/1856865882 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b000e040 con 0x7f14c4071f10 2024-02-28T16:10:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.087+0000 7f14bbe00700 1 -- 172.21.15.57:0/1856865882 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14b0004290 con 0x7f14c4071f10 2024-02-28T16:10:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.087+0000 7f14cb200700 1 -- 172.21.15.57:0/1856865882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c4111280 con 0x7f14c4071f10 2024-02-28T16:10:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.088+0000 7f14bbe00700 1 -- 172.21.15.57:0/1856865882 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b001c630 con 0x7f14c4071f10 2024-02-28T16:10:40.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.088+0000 7f14cb200700 1 -- 172.21.15.57:0/1856865882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c41117c0 con 0x7f14c4071f10 2024-02-28T16:10:40.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.089+0000 7f14cb200700 1 -- 172.21.15.57:0/1856865882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c404bed0 con 0x7f14c4071f10 2024-02-28T16:10:40.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.090+0000 7f14bbe00700 1 -- 172.21.15.57:0/1856865882 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f14b000bc60 con 0x7f14c4071f10 2024-02-28T16:10:40.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.091+0000 7f14bbe00700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14a806d7e0 0x7f14a806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:40.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.091+0000 7f14bbe00700 1 -- 172.21.15.57:0/1856865882 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f14b008e400 con 0x7f14c4071f10 2024-02-28T16:10:40.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.091+0000 7f14c3e00700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14a806d7e0 0x7f14a806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:40.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.092+0000 7f14c3e00700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14a806d7e0 0x7f14a806fc90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14b4006fd0 tx=0x7f14b4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.096+0000 7f14bbe00700 1 -- 172.21.15.57:0/1856865882 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f14b005b6b0 con 0x7f14c4071f10 2024-02-28T16:10:40.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:40 smithi057 ceph-mon[93219]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:40.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.340+0000 7f14cb200700 1 -- 172.21.15.57:0/1856865882 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f14c4111c20 con 0x7f14a806d7e0 2024-02-28T16:10:40.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.371+0000 7f14bbe00700 1 -- 172.21.15.57:0/1856865882 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f14c4111c20 con 0x7f14a806d7e0 2024-02-28T16:10:40.363 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:10:40.363 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (9m) 2m ago 19m 14.2M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:10:40.363 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (4m) 2m ago 20m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:10:40.363 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (4m) 41s ago 18m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (8m) 2m ago 19m 75.3M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (12m) 2m ago 12m 125M - 17.2.7-535-gc0f02e60 1c37ed371348 194cf3650a85 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (12m) 2m ago 12m 68.0M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (12m) 41s ago 12m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (12m) 41s ago 12m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (7m) 2m ago 21m 506M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (6m) 41s ago 18m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (6m) 2m ago 21m 48.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (5m) 41s ago 18m 40.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (9m) 2m ago 19m 7906k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (8m) 41s ago 18m 7922k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (4m) 2m ago 17m 137M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:10:40.364 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (3m) 2m ago 16m 94.7M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:10:40.365 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (2m) 2m ago 16m 11.0M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:10:40.365 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (117s) 41s ago 15m 92.1M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:10:40.365 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (74s) 41s ago 14m 87.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:10:40.365 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (46s) 41s ago 14m 11.1M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b cbdb6df47634 2024-02-28T16:10:40.365 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (6m) 2m ago 18m 53.5M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:10:40.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.374+0000 7f14cb200700 1 -- 172.21.15.57:0/1856865882 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14a806d7e0 msgr2=0x7f14a806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:40.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.374+0000 7f14cb200700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14a806d7e0 0x7f14a806fc90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14b4006fd0 tx=0x7f14b4008040 comp rx=0 tx=0).stop 2024-02-28T16:10:40.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.374+0000 7f14cb200700 1 -- 172.21.15.57:0/1856865882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14c4071f10 msgr2=0x7f14c4110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:40.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.374+0000 7f14cb200700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14c4071f10 0x7f14c4110130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000c00 tx=0x7f14b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:40.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.375+0000 7f14cb200700 1 -- 172.21.15.57:0/1856865882 shutdown_connections 2024-02-28T16:10:40.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.375+0000 7f14cb200700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14a806d7e0 0x7f14a806fc90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.375+0000 7f14cb200700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14c40708c0 0x7f14c410fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.375+0000 7f14cb200700 1 --2- 172.21.15.57:0/1856865882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14c4071f10 0x7f14c4110130 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.375+0000 7f14cb200700 1 -- 172.21.15.57:0/1856865882 >> 172.21.15.57:0/1856865882 conn(0x7f14c40f8620 msgr2=0x7f14c4102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:40.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.375+0000 7f14cb200700 1 -- 172.21.15.57:0/1856865882 shutdown_connections 2024-02-28T16:10:40.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.375+0000 7f14cb200700 1 -- 172.21.15.57:0/1856865882 wait complete. 2024-02-28T16:10:40.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:40 smithi087 ceph-mon[82628]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:40.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.535+0000 7f5321800700 1 -- 172.21.15.57:0/849798609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c0ff150 msgr2=0x7f531c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:40.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.535+0000 7f5321800700 1 --2- 172.21.15.57:0/849798609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c0ff150 0x7f531c0ff560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f530c004940 tx=0x7f530c009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.535+0000 7f5321800700 1 -- 172.21.15.57:0/849798609 shutdown_connections 2024-02-28T16:10:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.535+0000 7f5321800700 1 --2- 172.21.15.57:0/849798609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c100360 0x7f531c1007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.535+0000 7f5321800700 1 --2- 172.21.15.57:0/849798609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c0ff150 0x7f531c0ff560 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.535+0000 7f5321800700 1 -- 172.21.15.57:0/849798609 >> 172.21.15.57:0/849798609 conn(0x7f531c0fa920 msgr2=0x7f531c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.535+0000 7f5321800700 1 -- 172.21.15.57:0/849798609 shutdown_connections 2024-02-28T16:10:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.535+0000 7f5321800700 1 -- 172.21.15.57:0/849798609 wait complete. 2024-02-28T16:10:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.536+0000 7f5321800700 1 Processor -- start 2024-02-28T16:10:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.536+0000 7f5321800700 1 -- start start 2024-02-28T16:10:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.536+0000 7f5321800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c0ff150 0x7f531c10fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.536+0000 7f5321800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c100360 0x7f531c1100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.536+0000 7f5321800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c1106d0 con 0x7f531c0ff150 2024-02-28T16:10:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.536+0000 7f5321800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c110f70 con 0x7f531c100360 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.537+0000 7f531aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c0ff150 0x7f531c10fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.537+0000 7f531aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c0ff150 0x7f531c10fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35630/0 (socket says 172.21.15.57:35630) 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.537+0000 7f531aa00700 1 -- 172.21.15.57:0/473958523 learned_addr learned my addr 172.21.15.57:0/473958523 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.537+0000 7f531a000700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c100360 0x7f531c1100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.537+0000 7f531aa00700 1 -- 172.21.15.57:0/473958523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c100360 msgr2=0x7f531c1100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.537+0000 7f531aa00700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c100360 0x7f531c1100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.537+0000 7f531aa00700 1 -- 172.21.15.57:0/473958523 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c005040 con 0x7f531c0ff150 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.537+0000 7f531aa00700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c0ff150 0x7f531c10fb90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f530c000c00 tx=0x7f530c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.538+0000 7f5312a00700 1 -- 172.21.15.57:0/473958523 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f530c00e040 con 0x7f531c0ff150 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.538+0000 7f5312a00700 1 -- 172.21.15.57:0/473958523 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f530c00bcc0 con 0x7f531c0ff150 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.538+0000 7f5321800700 1 -- 172.21.15.57:0/473958523 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c1111f0 con 0x7f531c0ff150 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.538+0000 7f5312a00700 1 -- 172.21.15.57:0/473958523 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f530c013ea0 con 0x7f531c0ff150 2024-02-28T16:10:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.538+0000 7f5321800700 1 -- 172.21.15.57:0/473958523 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c111730 con 0x7f531c0ff150 2024-02-28T16:10:40.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.539+0000 7f5321800700 1 -- 172.21.15.57:0/473958523 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c04bed0 con 0x7f531c0ff150 2024-02-28T16:10:40.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.540+0000 7f5312a00700 1 -- 172.21.15.57:0/473958523 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f530c013420 con 0x7f531c0ff150 2024-02-28T16:10:40.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.541+0000 7f5312a00700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f530006d7f0 0x7f530006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:40.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.541+0000 7f5312a00700 1 -- 172.21.15.57:0/473958523 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f530c08e2b0 con 0x7f531c0ff150 2024-02-28T16:10:40.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.541+0000 7f531a000700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f530006d7f0 0x7f530006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:40.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.542+0000 7f531a000700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f530006d7f0 0x7f530006fca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5308007fd0 tx=0x7f5308009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.546+0000 7f5312a00700 1 -- 172.21.15.57:0/473958523 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f530c05b560 con 0x7f531c0ff150 2024-02-28T16:10:40.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.863+0000 7f5321800700 1 -- 172.21.15.57:0/473958523 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f531c1161b0 con 0x7f531c0ff150 2024-02-28T16:10:40.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.864+0000 7f5312a00700 1 -- 172.21.15.57:0/473958523 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f530c05b0f0 con 0x7f531c0ff150 2024-02-28T16:10:40.856 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:10:40.856 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:10:40.856 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:10:40.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:10:40.856 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:10:40.856 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4, 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 10 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:10:40.857 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:10:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.866+0000 7f5321800700 1 -- 172.21.15.57:0/473958523 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f530006d7f0 msgr2=0x7f530006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.866+0000 7f5321800700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f530006d7f0 0x7f530006fca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5308007fd0 tx=0x7f5308009040 comp rx=0 tx=0).stop 2024-02-28T16:10:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.866+0000 7f5321800700 1 -- 172.21.15.57:0/473958523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c0ff150 msgr2=0x7f531c10fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.866+0000 7f5321800700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c0ff150 0x7f531c10fb90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f530c000c00 tx=0x7f530c009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.867+0000 7f5321800700 1 -- 172.21.15.57:0/473958523 shutdown_connections 2024-02-28T16:10:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.867+0000 7f5321800700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f530006d7f0 0x7f530006fca0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.867+0000 7f5321800700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c0ff150 0x7f531c10fb90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.867+0000 7f5321800700 1 --2- 172.21.15.57:0/473958523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c100360 0x7f531c1100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:40.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.867+0000 7f5321800700 1 -- 172.21.15.57:0/473958523 >> 172.21.15.57:0/473958523 conn(0x7f531c0fa920 msgr2=0x7f531c103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:40.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.867+0000 7f5321800700 1 -- 172.21.15.57:0/473958523 shutdown_connections 2024-02-28T16:10:40.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:40.867+0000 7f5321800700 1 -- 172.21.15.57:0/473958523 wait complete. 2024-02-28T16:10:41.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.022+0000 7fb07b000700 1 -- 172.21.15.57:0/1933426277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb074104750 msgr2=0x7fb074104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:41.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.022+0000 7fb07b000700 1 --2- 172.21.15.57:0/1933426277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb074104750 0x7fb074104ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb05c004940 tx=0x7fb05c009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:41.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.022+0000 7fb07b000700 1 -- 172.21.15.57:0/1933426277 shutdown_connections 2024-02-28T16:10:41.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.022+0000 7fb07b000700 1 --2- 172.21.15.57:0/1933426277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb074104750 0x7fb074104ba0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.022+0000 7fb07b000700 1 --2- 172.21.15.57:0/1933426277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb074103540 0x7fb074103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.022+0000 7fb07b000700 1 -- 172.21.15.57:0/1933426277 >> 172.21.15.57:0/1933426277 conn(0x7fb0740727d0 msgr2=0x7fb074074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:41.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.022+0000 7fb07b000700 1 -- 172.21.15.57:0/1933426277 shutdown_connections 2024-02-28T16:10:41.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.022+0000 7fb07b000700 1 -- 172.21.15.57:0/1933426277 wait complete. 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.023+0000 7fb07b000700 1 Processor -- start 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.023+0000 7fb07b000700 1 -- start start 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.023+0000 7fb07b000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb074103540 0x7fb074113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.023+0000 7fb07b000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb074104750 0x7fb0741144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.023+0000 7fb07b000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb074114aa0 con 0x7fb074104750 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.023+0000 7fb07b000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb074115340 con 0x7fb074103540 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.023+0000 7fb06be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb074104750 0x7fb0741144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.023+0000 7fb06be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb074104750 0x7fb0741144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35638/0 (socket says 172.21.15.57:35638) 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.023+0000 7fb06be00700 1 -- 172.21.15.57:0/895232975 learned_addr learned my addr 172.21.15.57:0/895232975 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.024+0000 7fb06be00700 1 -- 172.21.15.57:0/895232975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb074103540 msgr2=0x7fb074113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:41.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.024+0000 7fb06be00700 1 --2- 172.21.15.57:0/895232975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb074103540 0x7fb074113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.024+0000 7fb06be00700 1 -- 172.21.15.57:0/895232975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c005040 con 0x7fb074104750 2024-02-28T16:10:41.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.024+0000 7fb06be00700 1 --2- 172.21.15.57:0/895232975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb074104750 0x7fb0741144a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00b3b0 tx=0x7fb05c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:41.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.024+0000 7fb070c00700 1 -- 172.21.15.57:0/895232975 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05c00e040 con 0x7fb074104750 2024-02-28T16:10:41.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.024+0000 7fb070c00700 1 -- 172.21.15.57:0/895232975 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb05c00bd90 con 0x7fb074104750 2024-02-28T16:10:41.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.024+0000 7fb070c00700 1 -- 172.21.15.57:0/895232975 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05c01c630 con 0x7fb074104750 2024-02-28T16:10:41.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.024+0000 7fb07b000700 1 -- 172.21.15.57:0/895232975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0741155c0 con 0x7fb074104750 2024-02-28T16:10:41.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.025+0000 7fb07b000700 1 -- 172.21.15.57:0/895232975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb074115b00 con 0x7fb074104750 2024-02-28T16:10:41.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.025+0000 7fb07b000700 1 -- 172.21.15.57:0/895232975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07404bed0 con 0x7fb074104750 2024-02-28T16:10:41.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.027+0000 7fb070c00700 1 -- 172.21.15.57:0/895232975 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb05c0139f0 con 0x7fb074104750 2024-02-28T16:10:41.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.027+0000 7fb070c00700 1 --2- 172.21.15.57:0/895232975 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb05806d7f0 0x7fb05806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:41.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.028+0000 7fb070c00700 1 -- 172.21.15.57:0/895232975 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fb05c08e460 con 0x7fb074104750 2024-02-28T16:10:41.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.028+0000 7fb073e00700 1 --2- 172.21.15.57:0/895232975 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb05806d7f0 0x7fb05806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:41.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.028+0000 7fb073e00700 1 --2- 172.21.15.57:0/895232975 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb05806d7f0 0x7fb05806fca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb0741045b0 tx=0x7fb064009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:41.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.032+0000 7fb070c00700 1 -- 172.21.15.57:0/895232975 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb05c05b790 con 0x7fb074104750 2024-02-28T16:10:41.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:41 smithi057 ceph-mon[93219]: pgmap v236: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:10:41.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:41 smithi057 ceph-mon[93219]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:41.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:41 smithi057 ceph-mon[93219]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:41.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:41 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/473958523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:41.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.302+0000 7fb07b000700 1 -- 172.21.15.57:0/895232975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb07411a580 con 0x7fb074104750 2024-02-28T16:10:41.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.303+0000 7fb070c00700 1 -- 172.21.15.57:0/895232975 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1844 (secure 0 0 0) 0x7fb05c05b320 con 0x7fb074104750 2024-02-28T16:10:41.296 INFO:teuthology.orchestra.run.smithi057.stdout:e23 2024-02-28T16:10:41.296 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:10:41.296 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:10:41.296 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:10:41.296 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:10:41.296 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:10:41.296 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 22 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:10:32.273940+0000 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:10:41.297 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 1 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:in 0 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=14452} 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 1 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:10:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:10:41.299 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:14452} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.57:6826/1436733447,v1:172.21.15.57:6827/1436733447] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:10:41.299 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:10:41.299 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:10:41.299 INFO:teuthology.orchestra.run.smithi057.stdout:Standby daemons: 2024-02-28T16:10:41.299 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:10:41.299 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{-1:34456} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.57:6828/3861545073,v1:172.21.15.57:6829/3861545073] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:10:41.299 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/3768145606,v1:172.21.15.87:6827/3768145606] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:10:41.299 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.87:6824/456812589,v1:172.21.15.87:6825/456812589] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:10:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.306+0000 7fb07b000700 1 -- 172.21.15.57:0/895232975 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb05806d7f0 msgr2=0x7fb05806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.306+0000 7fb07b000700 1 --2- 172.21.15.57:0/895232975 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb05806d7f0 0x7fb05806fca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb0741045b0 tx=0x7fb064009ce0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.306+0000 7fb07b000700 1 -- 172.21.15.57:0/895232975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb074104750 msgr2=0x7fb0741144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.306+0000 7fb07b000700 1 --2- 172.21.15.57:0/895232975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb074104750 0x7fb0741144a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00b3b0 tx=0x7fb05c009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.306+0000 7fb07b000700 1 -- 172.21.15.57:0/895232975 shutdown_connections 2024-02-28T16:10:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.306+0000 7fb07b000700 1 --2- 172.21.15.57:0/895232975 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb05806d7f0 0x7fb05806fca0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.306+0000 7fb07b000700 1 --2- 172.21.15.57:0/895232975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb074103540 0x7fb074113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.306+0000 7fb07b000700 1 --2- 172.21.15.57:0/895232975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb074104750 0x7fb0741144a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.306+0000 7fb07b000700 1 -- 172.21.15.57:0/895232975 >> 172.21.15.57:0/895232975 conn(0x7fb0740727d0 msgr2=0x7fb074107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.306+0000 7fb07b000700 1 -- 172.21.15.57:0/895232975 shutdown_connections 2024-02-28T16:10:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.307+0000 7fb07b000700 1 -- 172.21.15.57:0/895232975 wait complete. 2024-02-28T16:10:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 23 2024-02-28T16:10:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.451+0000 7fa9e2000700 1 -- 172.21.15.57:0/2249384892 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9d400bcb0 con 0x7fa9e40fcef0 2024-02-28T16:10:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.452+0000 7fa9ea000700 1 -- 172.21.15.57:0/2249384892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9e40fcef0 msgr2=0x7fa9e40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.452+0000 7fa9ea000700 1 --2- 172.21.15.57:0/2249384892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9e40fcef0 0x7fa9e40fd320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4004940 tx=0x7fa9d4009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.452+0000 7fa9ea000700 1 -- 172.21.15.57:0/2249384892 shutdown_connections 2024-02-28T16:10:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.452+0000 7fa9ea000700 1 --2- 172.21.15.57:0/2249384892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9e40fe0e0 0x7fa9e40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.452+0000 7fa9ea000700 1 --2- 172.21.15.57:0/2249384892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9e40fcef0 0x7fa9e40fd320 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.452+0000 7fa9ea000700 1 -- 172.21.15.57:0/2249384892 >> 172.21.15.57:0/2249384892 conn(0x7fa9e40f8620 msgr2=0x7fa9e40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.452+0000 7fa9ea000700 1 -- 172.21.15.57:0/2249384892 shutdown_connections 2024-02-28T16:10:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.452+0000 7fa9ea000700 1 -- 172.21.15.57:0/2249384892 wait complete. 2024-02-28T16:10:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.453+0000 7fa9ea000700 1 Processor -- start 2024-02-28T16:10:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.454+0000 7fa9ea000700 1 -- start start 2024-02-28T16:10:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.454+0000 7fa9ea000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9e40fcef0 0x7fa9e410fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.454+0000 7fa9ea000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9e40fe0e0 0x7fa9e41100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.454+0000 7fa9ea000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4110750 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.454+0000 7fa9ea000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4110f90 con 0x7fa9e40fcef0 2024-02-28T16:10:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.454+0000 7fa9e2a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9e40fe0e0 0x7fa9e41100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.455+0000 7fa9e2a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9e40fe0e0 0x7fa9e41100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35652/0 (socket says 172.21.15.57:35652) 2024-02-28T16:10:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.455+0000 7fa9e2a00700 1 -- 172.21.15.57:0/1655844685 learned_addr learned my addr 172.21.15.57:0/1655844685 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.455+0000 7fa9e3400700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9e40fcef0 0x7fa9e410fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.455+0000 7fa9e2a00700 1 -- 172.21.15.57:0/1655844685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9e40fcef0 msgr2=0x7fa9e410fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.455+0000 7fa9e2a00700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9e40fcef0 0x7fa9e410fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.455+0000 7fa9e2a00700 1 -- 172.21.15.57:0/1655844685 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4005040 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.455+0000 7fa9e2a00700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9e40fe0e0 0x7fa9e41100c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000b790 tx=0x7fa9d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.456+0000 7fa9db400700 1 -- 172.21.15.57:0/1655844685 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9d000f770 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.456+0000 7fa9db400700 1 -- 172.21.15.57:0/1655844685 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9d000fda0 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.456+0000 7fa9db400700 1 -- 172.21.15.57:0/1655844685 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9d000d310 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.456+0000 7fa9ea000700 1 -- 172.21.15.57:0/1655844685 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e4111270 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.456+0000 7fa9ea000700 1 -- 172.21.15.57:0/1655844685 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e41117b0 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.458+0000 7fa9ea000700 1 -- 172.21.15.57:0/1655844685 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e404bed0 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.458+0000 7fa9db400700 1 -- 172.21.15.57:0/1655844685 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa9d0010420 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.459+0000 7fa9db400700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa9c806d7e0 0x7fa9c806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.459+0000 7fa9db400700 1 -- 172.21.15.57:0/1655844685 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fa9d008cf70 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.460+0000 7fa9e3400700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa9c806d7e0 0x7fa9c806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.460+0000 7fa9e3400700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa9c806d7e0 0x7fa9c806fc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400b3b0 tx=0x7fa9d4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:41.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.468+0000 7fa9db400700 1 -- 172.21.15.57:0/1655844685 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa9d005a2a0 con 0x7fa9e40fe0e0 2024-02-28T16:10:41.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:41 smithi087 ceph-mon[82628]: pgmap v236: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:10:41.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:41 smithi087 ceph-mon[82628]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:41.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:41 smithi087 ceph-mon[82628]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:41.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:41 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/473958523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:41.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.730+0000 7fa9ea000700 1 -- 172.21.15.57:0/1655844685 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9e4111cc0 con 0x7fa9c806d7e0 2024-02-28T16:10:41.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.732+0000 7fa9db400700 1 -- 172.21.15.57:0/1655844685 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa9e4111cc0 con 0x7fa9c806d7e0 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "osd", 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:10:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "12/21 daemons upgraded", 2024-02-28T16:10:41.729 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:10:41.729 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:10:41.729 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:10:41.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.736+0000 7fa9ea000700 1 -- 172.21.15.57:0/1655844685 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa9c806d7e0 msgr2=0x7fa9c806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.736+0000 7fa9ea000700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa9c806d7e0 0x7fa9c806fc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400b3b0 tx=0x7fa9d4009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.736+0000 7fa9ea000700 1 -- 172.21.15.57:0/1655844685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9e40fe0e0 msgr2=0x7fa9e41100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.736+0000 7fa9ea000700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9e40fe0e0 0x7fa9e41100c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000b790 tx=0x7fa9d0009250 comp rx=0 tx=0).stop 2024-02-28T16:10:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.737+0000 7fa9ea000700 1 -- 172.21.15.57:0/1655844685 shutdown_connections 2024-02-28T16:10:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.737+0000 7fa9ea000700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa9c806d7e0 0x7fa9c806fc90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.737+0000 7fa9ea000700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9e40fcef0 0x7fa9e410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.737+0000 7fa9ea000700 1 --2- 172.21.15.57:0/1655844685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9e40fe0e0 0x7fa9e41100c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.737+0000 7fa9ea000700 1 -- 172.21.15.57:0/1655844685 >> 172.21.15.57:0/1655844685 conn(0x7fa9e40f8620 msgr2=0x7fa9e40fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.737+0000 7fa9ea000700 1 -- 172.21.15.57:0/1655844685 shutdown_connections 2024-02-28T16:10:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.737+0000 7fa9ea000700 1 -- 172.21.15.57:0/1655844685 wait complete. 2024-02-28T16:10:41.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.895+0000 7f4d6a200700 1 -- 172.21.15.57:0/3591735850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d640ff170 msgr2=0x7f4d640ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:41.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.895+0000 7f4d6a200700 1 --2- 172.21.15.57:0/3591735850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d640ff170 0x7f4d640ff580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4d54004940 tx=0x7f4d54009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:41.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.895+0000 7f4d6a200700 1 -- 172.21.15.57:0/3591735850 shutdown_connections 2024-02-28T16:10:41.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.895+0000 7f4d6a200700 1 --2- 172.21.15.57:0/3591735850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d64100380 0x7f4d641007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.895+0000 7f4d6a200700 1 --2- 172.21.15.57:0/3591735850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d640ff170 0x7f4d640ff580 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.895+0000 7f4d6a200700 1 -- 172.21.15.57:0/3591735850 >> 172.21.15.57:0/3591735850 conn(0x7f4d640fa920 msgr2=0x7f4d640fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:41.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.895+0000 7f4d6a200700 1 -- 172.21.15.57:0/3591735850 shutdown_connections 2024-02-28T16:10:41.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.895+0000 7f4d6a200700 1 -- 172.21.15.57:0/3591735850 wait complete. 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.896+0000 7f4d6a200700 1 Processor -- start 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.896+0000 7f4d6a200700 1 -- start start 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.896+0000 7f4d6a200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d640ff170 0x7f4d6410fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.896+0000 7f4d6a200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d64100380 0x7f4d64110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.896+0000 7f4d6a200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d641107a0 con 0x7f4d640ff170 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.896+0000 7f4d6a200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d64110fe0 con 0x7f4d64100380 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.896+0000 7f4d63400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d640ff170 0x7f4d6410fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.897+0000 7f4d63400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d640ff170 0x7f4d6410fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40616/0 (socket says 172.21.15.57:40616) 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.897+0000 7f4d63400700 1 -- 172.21.15.57:0/403040742 learned_addr learned my addr 172.21.15.57:0/403040742 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.897+0000 7f4d63400700 1 -- 172.21.15.57:0/403040742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d64100380 msgr2=0x7f4d64110110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:41.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.897+0000 7f4d63400700 1 --2- 172.21.15.57:0/403040742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d64100380 0x7f4d64110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:41.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.897+0000 7f4d63400700 1 -- 172.21.15.57:0/403040742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d54005040 con 0x7f4d640ff170 2024-02-28T16:10:41.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.897+0000 7f4d63400700 1 --2- 172.21.15.57:0/403040742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d640ff170 0x7f4d6410fbd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000c00 tx=0x7f4d54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:41.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.897+0000 7f4d5b400700 1 -- 172.21.15.57:0/403040742 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d5400e040 con 0x7f4d640ff170 2024-02-28T16:10:41.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.898+0000 7f4d5b400700 1 -- 172.21.15.57:0/403040742 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d5400bcc0 con 0x7f4d640ff170 2024-02-28T16:10:41.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.898+0000 7f4d6a200700 1 -- 172.21.15.57:0/403040742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d64111260 con 0x7f4d640ff170 2024-02-28T16:10:41.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.898+0000 7f4d6a200700 1 -- 172.21.15.57:0/403040742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d641117a0 con 0x7f4d640ff170 2024-02-28T16:10:41.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.898+0000 7f4d5b400700 1 -- 172.21.15.57:0/403040742 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d54013ea0 con 0x7f4d640ff170 2024-02-28T16:10:41.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.899+0000 7f4d6a200700 1 -- 172.21.15.57:0/403040742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6404bed0 con 0x7f4d640ff170 2024-02-28T16:10:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.900+0000 7f4d5b400700 1 -- 172.21.15.57:0/403040742 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f4d54013420 con 0x7f4d640ff170 2024-02-28T16:10:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.901+0000 7f4d5b400700 1 --2- 172.21.15.57:0/403040742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d4806d7f0 0x7f4d4806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:10:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.901+0000 7f4d5b400700 1 -- 172.21.15.57:0/403040742 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f4d5408e310 con 0x7f4d640ff170 2024-02-28T16:10:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.901+0000 7f4d62a00700 1 --2- 172.21.15.57:0/403040742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d4806d7f0 0x7f4d4806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:10:41.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.902+0000 7f4d62a00700 1 --2- 172.21.15.57:0/403040742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d4806d7f0 0x7f4d4806fca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4d50006fd0 tx=0x7f4d50006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:10:41.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:41.910+0000 7f4d5b400700 1 -- 172.21.15.57:0/403040742 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4d5405b5e0 con 0x7f4d640ff170 2024-02-28T16:10:42.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.219+0000 7f4d6a200700 1 -- 172.21.15.57:0/403040742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4d64107cd0 con 0x7f4d640ff170 2024-02-28T16:10:42.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.220+0000 7f4d5b400700 1 -- 172.21.15.57:0/403040742 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4d5405b170 con 0x7f4d640ff170 2024-02-28T16:10:42.212 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:10:42.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.222+0000 7f4d6a200700 1 -- 172.21.15.57:0/403040742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d4806d7f0 msgr2=0x7f4d4806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:42.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.222+0000 7f4d6a200700 1 --2- 172.21.15.57:0/403040742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d4806d7f0 0x7f4d4806fca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4d50006fd0 tx=0x7f4d50006db0 comp rx=0 tx=0).stop 2024-02-28T16:10:42.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.222+0000 7f4d6a200700 1 -- 172.21.15.57:0/403040742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d640ff170 msgr2=0x7f4d6410fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:10:42.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.223+0000 7f4d6a200700 1 --2- 172.21.15.57:0/403040742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d640ff170 0x7f4d6410fbd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000c00 tx=0x7f4d54009e30 comp rx=0 tx=0).stop 2024-02-28T16:10:42.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.223+0000 7f4d6a200700 1 -- 172.21.15.57:0/403040742 shutdown_connections 2024-02-28T16:10:42.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.223+0000 7f4d6a200700 1 --2- 172.21.15.57:0/403040742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d4806d7f0 0x7f4d4806fca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:42.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.223+0000 7f4d6a200700 1 --2- 172.21.15.57:0/403040742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d640ff170 0x7f4d6410fbd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:42.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.223+0000 7f4d6a200700 1 --2- 172.21.15.57:0/403040742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d64100380 0x7f4d64110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:10:42.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.223+0000 7f4d6a200700 1 -- 172.21.15.57:0/403040742 >> 172.21.15.57:0/403040742 conn(0x7f4d640fa920 msgr2=0x7f4d641035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:10:42.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.223+0000 7f4d6a200700 1 -- 172.21.15.57:0/403040742 shutdown_connections 2024-02-28T16:10:42.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:10:42.223+0000 7f4d6a200700 1 -- 172.21.15.57:0/403040742 wait complete. 2024-02-28T16:10:42.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:42 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/895232975' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:10:42.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:42 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/895232975' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:10:43.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:43 smithi087 ceph-mon[82628]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:43.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:43 smithi087 ceph-mon[82628]: pgmap v237: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:10:43.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:43 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/403040742' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:10:43.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:43 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:43.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:43 smithi057 ceph-mon[93219]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:10:43.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:43 smithi057 ceph-mon[93219]: pgmap v237: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:10:43.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:43 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/403040742' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:10:43.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:43 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:44.865 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:44.865 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:44.865 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:44.865 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:44.865 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:44.865 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:44.865 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:44.865 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:44.866 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:44.866 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:44.866 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:44 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi057.eztwsd"]}]: dispatch 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:10:44.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:44 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi057.eztwsd"]}]: dispatch 2024-02-28T16:10:45.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:45 smithi057 ceph-mon[93219]: pgmap v238: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:10:45.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:45 smithi057 ceph-mon[93219]: Upgrade: It appears safe to stop mds.cephfs.smithi057.eztwsd 2024-02-28T16:10:45.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:45 smithi087 ceph-mon[82628]: pgmap v238: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:10:45.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:45 smithi087 ceph-mon[82628]: Upgrade: It appears safe to stop mds.cephfs.smithi057.eztwsd 2024-02-28T16:10:47.465 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:47 smithi057 ceph-mon[93219]: pgmap v239: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:10:47.465 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:47 smithi057 ceph-mon[93219]: Upgrade: Updating mds.cephfs.smithi057.eztwsd 2024-02-28T16:10:47.465 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:47.465 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.eztwsd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:10:47.466 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:47.466 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:47 smithi057 ceph-mon[93219]: Deploying daemon mds.cephfs.smithi057.eztwsd on smithi057 2024-02-28T16:10:47.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:47 smithi087 ceph-mon[82628]: pgmap v239: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:10:47.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:47 smithi087 ceph-mon[82628]: Upgrade: Updating mds.cephfs.smithi057.eztwsd 2024-02-28T16:10:47.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:47.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.eztwsd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:10:47.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:10:47.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:47 smithi087 ceph-mon[82628]: Deploying daemon mds.cephfs.smithi057.eztwsd on smithi057 2024-02-28T16:10:49.537 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:49 smithi057 ceph-mon[93219]: pgmap v240: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:10:49.537 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:10:49.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:49 smithi087 ceph-mon[82628]: pgmap v240: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:10:49.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:10:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:49 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057[93215]: 2024-02-28T16:10:49.544+0000 7fb8d1a00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:10:50.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:50 smithi057 ceph-mon[93219]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:10:50.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:50 smithi057 ceph-mon[93219]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:10:50.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:50 smithi057 ceph-mon[93219]: osdmap e100: 6 total, 6 up, 6 in 2024-02-28T16:10:50.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:50 smithi057 ceph-mon[93219]: Standby daemon mds.cephfs.smithi057.qwatmu assigned to filesystem cephfs as rank 0 2024-02-28T16:10:50.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:50 smithi057 ceph-mon[93219]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:10:50.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:50 smithi057 ceph-mon[93219]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:10:50.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:50 smithi057 ceph-mon[93219]: fsmap cephfs:1/1 {0=cephfs.smithi057.qwatmu=up:replay} 2 up:standby 2024-02-28T16:10:50.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:50 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:10:50.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:50 smithi087 ceph-mon[82628]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:10:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:50 smithi087 ceph-mon[82628]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:10:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:50 smithi087 ceph-mon[82628]: osdmap e100: 6 total, 6 up, 6 in 2024-02-28T16:10:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:50 smithi087 ceph-mon[82628]: Standby daemon mds.cephfs.smithi057.qwatmu assigned to filesystem cephfs as rank 0 2024-02-28T16:10:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:50 smithi087 ceph-mon[82628]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:10:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:50 smithi087 ceph-mon[82628]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:10:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:50 smithi087 ceph-mon[82628]: fsmap cephfs:1/1 {0=cephfs.smithi057.qwatmu=up:replay} 2 up:standby 2024-02-28T16:10:50.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:50 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:10:51.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:51 smithi057 ceph-mon[93219]: pgmap v242: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:10:51.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:51 smithi087 ceph-mon[82628]: pgmap v242: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:10:53.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:53 smithi057 ceph-mon[93219]: pgmap v243: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-02-28T16:10:53.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:53 smithi087 ceph-mon[82628]: pgmap v243: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-02-28T16:10:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:55 smithi057 ceph-mon[93219]: pgmap v244: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 3 op/s 2024-02-28T16:10:55.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:55 smithi087 ceph-mon[82628]: pgmap v244: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 3 op/s 2024-02-28T16:10:57.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:57 smithi057 ceph-mon[93219]: pgmap v245: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:10:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:57 smithi057 ceph-mon[93219]: reconnect by client.14516 192.168.0.1:0/757520085 after 0.00199997 2024-02-28T16:10:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:57 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.57:6828/3861545073,v1:172.21.15.57:6829/3861545073] up:reconnect 2024-02-28T16:10:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:57 smithi057 ceph-mon[93219]: fsmap cephfs:1/1 {0=cephfs.smithi057.qwatmu=up:reconnect} 2 up:standby 2024-02-28T16:10:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:57 smithi057 ceph-mon[93219]: reconnect by client.24333 192.168.0.1:0/1820173252 after 0.00299996 2024-02-28T16:10:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:57 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:57 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:57.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:57 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:57.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:57 smithi087 ceph-mon[82628]: pgmap v245: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:10:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:57 smithi087 ceph-mon[82628]: reconnect by client.14516 192.168.0.1:0/757520085 after 0.00199997 2024-02-28T16:10:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:57 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.57:6828/3861545073,v1:172.21.15.57:6829/3861545073] up:reconnect 2024-02-28T16:10:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:57 smithi087 ceph-mon[82628]: fsmap cephfs:1/1 {0=cephfs.smithi057.qwatmu=up:reconnect} 2 up:standby 2024-02-28T16:10:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:57 smithi087 ceph-mon[82628]: reconnect by client.24333 192.168.0.1:0/1820173252 after 0.00299996 2024-02-28T16:10:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:57 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:57 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:10:57.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:57 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:10:58.880 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:58 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.57:6828/3861545073,v1:172.21.15.57:6829/3861545073] up:rejoin 2024-02-28T16:10:58.880 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:58 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] up:boot 2024-02-28T16:10:58.880 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:58 smithi057 ceph-mon[93219]: fsmap cephfs:1/1 {0=cephfs.smithi057.qwatmu=up:rejoin} 3 up:standby 2024-02-28T16:10:58.880 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:58 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:10:58.880 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:58 smithi057 ceph-mon[93219]: daemon mds.cephfs.smithi057.qwatmu is now active in filesystem cephfs as rank 0 2024-02-28T16:10:58.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:58 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.57:6828/3861545073,v1:172.21.15.57:6829/3861545073] up:rejoin 2024-02-28T16:10:58.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:58 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] up:boot 2024-02-28T16:10:58.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:58 smithi087 ceph-mon[82628]: fsmap cephfs:1/1 {0=cephfs.smithi057.qwatmu=up:rejoin} 3 up:standby 2024-02-28T16:10:58.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:58 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:10:58.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:58 smithi087 ceph-mon[82628]: daemon mds.cephfs.smithi057.qwatmu is now active in filesystem cephfs as rank 0 2024-02-28T16:10:59.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:59 smithi057 ceph-mon[93219]: pgmap v246: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-02-28T16:10:59.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:59 smithi057 ceph-mon[93219]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:10:59.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:59 smithi057 ceph-mon[93219]: Cluster is now healthy 2024-02-28T16:10:59.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:59 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.57:6828/3861545073,v1:172.21.15.57:6829/3861545073] up:active 2024-02-28T16:10:59.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:10:59 smithi057 ceph-mon[93219]: fsmap cephfs:1 {0=cephfs.smithi057.qwatmu=up:active} 3 up:standby 2024-02-28T16:10:59.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:59 smithi087 ceph-mon[82628]: pgmap v246: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-02-28T16:10:59.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:59 smithi087 ceph-mon[82628]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:10:59.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:59 smithi087 ceph-mon[82628]: Cluster is now healthy 2024-02-28T16:10:59.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:59 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.57:6828/3861545073,v1:172.21.15.57:6829/3861545073] up:active 2024-02-28T16:10:59.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:10:59 smithi087 ceph-mon[82628]: fsmap cephfs:1 {0=cephfs.smithi057.qwatmu=up:active} 3 up:standby 2024-02-28T16:11:01.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:01 smithi057 ceph-mon[93219]: pgmap v247: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:11:01.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:01 smithi087 ceph-mon[82628]: pgmap v247: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:11:03.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:03 smithi057 ceph-mon[93219]: pgmap v248: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-02-28T16:11:03.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:03 smithi087 ceph-mon[82628]: pgmap v248: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-02-28T16:11:04.756 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:11:04.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:11:05.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:05 smithi057 ceph-mon[93219]: pgmap v249: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-02-28T16:11:05.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:05 smithi087 ceph-mon[82628]: pgmap v249: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-02-28T16:11:07.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:07 smithi057 ceph-mon[93219]: pgmap v250: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T16:11:07.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:07 smithi087 ceph-mon[82628]: pgmap v250: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T16:11:09.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:09 smithi057 ceph-mon[93219]: pgmap v251: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:11:09.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:09.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:09 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:09.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:09 smithi087 ceph-mon[82628]: pgmap v251: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:11:09.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:09.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:09 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:11.814 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:11 smithi057 ceph-mon[93219]: pgmap v252: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:11:11.814 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:11 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:11.814 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:11 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:11.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:11 smithi087 ceph-mon[82628]: pgmap v252: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:11:11.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:11 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:11.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:11 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:12.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.383+0000 7f7728e00700 1 -- 172.21.15.57:0/2931907932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77240708c0 msgr2=0x7f7724070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:12.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.383+0000 7f7728e00700 1 --2- 172.21.15.57:0/2931907932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77240708c0 0x7f7724070d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7710004940 tx=0x7f7710009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:12.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.383+0000 7f7728e00700 1 -- 172.21.15.57:0/2931907932 shutdown_connections 2024-02-28T16:11:12.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.383+0000 7f7728e00700 1 --2- 172.21.15.57:0/2931907932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77240708c0 0x7f7724070d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:12.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.383+0000 7f7728e00700 1 --2- 172.21.15.57:0/2931907932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7724071f10 0x7f7724070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:12.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.383+0000 7f7728e00700 1 -- 172.21.15.57:0/2931907932 >> 172.21.15.57:0/2931907932 conn(0x7f77240f8620 msgr2=0x7f77240faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:12.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.383+0000 7f7728e00700 1 -- 172.21.15.57:0/2931907932 shutdown_connections 2024-02-28T16:11:12.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.383+0000 7f7728e00700 1 -- 172.21.15.57:0/2931907932 wait complete. 2024-02-28T16:11:12.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.384+0000 7f7728e00700 1 Processor -- start 2024-02-28T16:11:12.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.384+0000 7f7728e00700 1 -- start start 2024-02-28T16:11:12.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7728e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77240708c0 0x7f772410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:12.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7728e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7724071f10 0x7f77241100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:12.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7728e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77241106b0 con 0x7f77240708c0 2024-02-28T16:11:12.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7728e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7724110f50 con 0x7f7724071f10 2024-02-28T16:11:12.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7721e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77240708c0 0x7f772410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:12.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7721e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77240708c0 0x7f772410fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40530/0 (socket says 172.21.15.57:40530) 2024-02-28T16:11:12.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7721e00700 1 -- 172.21.15.57:0/2252668146 learned_addr learned my addr 172.21.15.57:0/2252668146 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:12.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7721400700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7724071f10 0x7f77241100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:12.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7721e00700 1 -- 172.21.15.57:0/2252668146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7724071f10 msgr2=0x7f77241100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:12.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7721e00700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7724071f10 0x7f77241100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:12.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.385+0000 7f7721e00700 1 -- 172.21.15.57:0/2252668146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710005040 con 0x7f77240708c0 2024-02-28T16:11:12.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.386+0000 7f7721e00700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77240708c0 0x7f772410fb70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7714002a50 tx=0x7f77140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:12.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.386+0000 7f771a000700 1 -- 172.21.15.57:0/2252668146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7714007cc0 con 0x7f77240708c0 2024-02-28T16:11:12.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.386+0000 7f771a000700 1 -- 172.21.15.57:0/2252668146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f771400f040 con 0x7f77240708c0 2024-02-28T16:11:12.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.386+0000 7f7728e00700 1 -- 172.21.15.57:0/2252668146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7724111230 con 0x7f77240708c0 2024-02-28T16:11:12.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.386+0000 7f771a000700 1 -- 172.21.15.57:0/2252668146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7714009640 con 0x7f77240708c0 2024-02-28T16:11:12.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.386+0000 7f7728e00700 1 -- 172.21.15.57:0/2252668146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7724111770 con 0x7f77240708c0 2024-02-28T16:11:12.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.387+0000 7f7728e00700 1 -- 172.21.15.57:0/2252668146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772404bed0 con 0x7f77240708c0 2024-02-28T16:11:12.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.389+0000 7f771a000700 1 -- 172.21.15.57:0/2252668146 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f77140097a0 con 0x7f77240708c0 2024-02-28T16:11:12.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.390+0000 7f771a000700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f770806d7f0 0x7f770806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:12.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.390+0000 7f771a000700 1 -- 172.21.15.57:0/2252668146 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f771408cd60 con 0x7f77240708c0 2024-02-28T16:11:12.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.390+0000 7f7721400700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f770806d7f0 0x7f770806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:12.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.391+0000 7f7721400700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f770806d7f0 0x7f770806fca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7710004f90 tx=0x7f7710009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:12.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.396+0000 7f771a000700 1 -- 172.21.15.57:0/2252668146 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7714091070 con 0x7f77240708c0 2024-02-28T16:11:12.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.629+0000 7f7728e00700 1 -- 172.21.15.57:0/2252668146 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77241044f0 con 0x7f770806d7f0 2024-02-28T16:11:12.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.632+0000 7f771a000700 1 -- 172.21.15.57:0/2252668146 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f77241044f0 con 0x7f770806d7f0 2024-02-28T16:11:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 -- 172.21.15.57:0/2252668146 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f770806d7f0 msgr2=0x7f770806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f770806d7f0 0x7f770806fca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7710004f90 tx=0x7f7710009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 -- 172.21.15.57:0/2252668146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77240708c0 msgr2=0x7f772410fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77240708c0 0x7f772410fb70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7714002a50 tx=0x7f77140046b0 comp rx=0 tx=0).stop 2024-02-28T16:11:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 -- 172.21.15.57:0/2252668146 shutdown_connections 2024-02-28T16:11:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f770806d7f0 0x7f770806fca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77240708c0 0x7f772410fb70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 --2- 172.21.15.57:0/2252668146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7724071f10 0x7f77241100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 -- 172.21.15.57:0/2252668146 >> 172.21.15.57:0/2252668146 conn(0x7f77240f8620 msgr2=0x7f7724102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:12.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 -- 172.21.15.57:0/2252668146 shutdown_connections 2024-02-28T16:11:12.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.635+0000 7f7728e00700 1 -- 172.21.15.57:0/2252668146 wait complete. 2024-02-28T16:11:12.641 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:11:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.790+0000 7f1b75e00700 1 -- 172.21.15.57:0/939136311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b700fcfb0 msgr2=0x7f1b700fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.790+0000 7f1b75e00700 1 --2- 172.21.15.57:0/939136311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b700fcfb0 0x7f1b700fd420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c004940 tx=0x7f1b5c009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.790+0000 7f1b75e00700 1 -- 172.21.15.57:0/939136311 shutdown_connections 2024-02-28T16:11:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.790+0000 7f1b75e00700 1 --2- 172.21.15.57:0/939136311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b700fcfb0 0x7f1b700fd420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.790+0000 7f1b75e00700 1 --2- 172.21.15.57:0/939136311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700fbe40 0x7f1b700fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.790+0000 7f1b75e00700 1 -- 172.21.15.57:0/939136311 >> 172.21.15.57:0/939136311 conn(0x7f1b700f74e0 msgr2=0x7f1b700f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.790+0000 7f1b75e00700 1 -- 172.21.15.57:0/939136311 shutdown_connections 2024-02-28T16:11:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.790+0000 7f1b75e00700 1 -- 172.21.15.57:0/939136311 wait complete. 2024-02-28T16:11:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.791+0000 7f1b75e00700 1 Processor -- start 2024-02-28T16:11:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.791+0000 7f1b75e00700 1 -- start start 2024-02-28T16:11:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.792+0000 7f1b75e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b700fbe40 0x7f1b701129f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.792+0000 7f1b75e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700fcfb0 0x7f1b70114f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.792+0000 7f1b75e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b70066350 con 0x7f1b700fbe40 2024-02-28T16:11:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.792+0000 7f1b75e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b70066490 con 0x7f1b700fcfb0 2024-02-28T16:11:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.792+0000 7f1b6ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b700fbe40 0x7f1b701129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.792+0000 7f1b6ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b700fbe40 0x7f1b701129f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40556/0 (socket says 172.21.15.57:40556) 2024-02-28T16:11:12.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.792+0000 7f1b6ea00700 1 -- 172.21.15.57:0/600727239 learned_addr learned my addr 172.21.15.57:0/600727239 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:12.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.793+0000 7f1b6e000700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700fcfb0 0x7f1b70114f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:12.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.793+0000 7f1b6ea00700 1 -- 172.21.15.57:0/600727239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700fcfb0 msgr2=0x7f1b70114f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:12.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.793+0000 7f1b6ea00700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700fcfb0 0x7f1b70114f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:12.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.793+0000 7f1b6ea00700 1 -- 172.21.15.57:0/600727239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c005040 con 0x7f1b700fbe40 2024-02-28T16:11:12.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.793+0000 7f1b6ea00700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b700fbe40 0x7f1b701129f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b60002a80 tx=0x7f1b600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:12.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.794+0000 7f1b66a00700 1 -- 172.21.15.57:0/600727239 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b60007cc0 con 0x7f1b700fbe40 2024-02-28T16:11:12.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.794+0000 7f1b66a00700 1 -- 172.21.15.57:0/600727239 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b6000f040 con 0x7f1b700fbe40 2024-02-28T16:11:12.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.794+0000 7f1b75e00700 1 -- 172.21.15.57:0/600727239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b70115480 con 0x7f1b700fbe40 2024-02-28T16:11:12.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.794+0000 7f1b66a00700 1 -- 172.21.15.57:0/600727239 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b6000dac0 con 0x7f1b700fbe40 2024-02-28T16:11:12.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.794+0000 7f1b75e00700 1 -- 172.21.15.57:0/600727239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b70115880 con 0x7f1b700fbe40 2024-02-28T16:11:12.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.795+0000 7f1b75e00700 1 -- 172.21.15.57:0/600727239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7004bed0 con 0x7f1b700fbe40 2024-02-28T16:11:12.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.796+0000 7f1b66a00700 1 -- 172.21.15.57:0/600727239 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1b6000dcc0 con 0x7f1b700fbe40 2024-02-28T16:11:12.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.797+0000 7f1b66a00700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1b5406d7f0 0x7f1b5406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:12.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.797+0000 7f1b66a00700 1 -- 172.21.15.57:0/600727239 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f1b6008cb50 con 0x7f1b700fbe40 2024-02-28T16:11:12.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.798+0000 7f1b6e000700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1b5406d7f0 0x7f1b5406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:12.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.798+0000 7f1b6e000700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1b5406d7f0 0x7f1b5406fca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0043d0 tx=0x7f1b5c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:12.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:12.803+0000 7f1b66a00700 1 -- 172.21.15.57:0/600727239 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1b60056320 con 0x7f1b700fbe40 2024-02-28T16:11:13.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.043+0000 7f1b75e00700 1 -- 172.21.15.57:0/600727239 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b70101990 con 0x7f1b5406d7f0 2024-02-28T16:11:13.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.045+0000 7f1b66a00700 1 -- 172.21.15.57:0/600727239 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1b70101990 con 0x7f1b5406d7f0 2024-02-28T16:11:13.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.047+0000 7f1b75e00700 1 -- 172.21.15.57:0/600727239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1b5406d7f0 msgr2=0x7f1b5406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.047+0000 7f1b75e00700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1b5406d7f0 0x7f1b5406fca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0043d0 tx=0x7f1b5c009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:13.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.048+0000 7f1b75e00700 1 -- 172.21.15.57:0/600727239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b700fbe40 msgr2=0x7f1b701129f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.048+0000 7f1b75e00700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b700fbe40 0x7f1b701129f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b60002a80 tx=0x7f1b600046b0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.048+0000 7f1b75e00700 1 -- 172.21.15.57:0/600727239 shutdown_connections 2024-02-28T16:11:13.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.048+0000 7f1b75e00700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1b5406d7f0 0x7f1b5406fca0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.048+0000 7f1b75e00700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b700fbe40 0x7f1b701129f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.048+0000 7f1b75e00700 1 --2- 172.21.15.57:0/600727239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700fcfb0 0x7f1b70114f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.048+0000 7f1b75e00700 1 -- 172.21.15.57:0/600727239 >> 172.21.15.57:0/600727239 conn(0x7f1b700f74e0 msgr2=0x7f1b70100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:13.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.048+0000 7f1b75e00700 1 -- 172.21.15.57:0/600727239 shutdown_connections 2024-02-28T16:11:13.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.048+0000 7f1b75e00700 1 -- 172.21.15.57:0/600727239 wait complete. 2024-02-28T16:11:13.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.203+0000 7fd417200700 1 -- 172.21.15.57:0/2557692445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4100fda80 msgr2=0x7fd4100ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.203+0000 7fd417200700 1 --2- 172.21.15.57:0/2557692445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4100fda80 0x7fd4100ffe60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd400009ce0 tx=0x7fd400004d10 comp rx=0 tx=0).stop 2024-02-28T16:11:13.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.203+0000 7fd417200700 1 -- 172.21.15.57:0/2557692445 shutdown_connections 2024-02-28T16:11:13.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.203+0000 7fd417200700 1 --2- 172.21.15.57:0/2557692445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4101003a0 0x7fd410102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.203+0000 7fd417200700 1 --2- 172.21.15.57:0/2557692445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4100fda80 0x7fd4100ffe60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.203+0000 7fd417200700 1 -- 172.21.15.57:0/2557692445 >> 172.21.15.57:0/2557692445 conn(0x7fd4100f74e0 msgr2=0x7fd4100f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:13.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.203+0000 7fd417200700 1 -- 172.21.15.57:0/2557692445 shutdown_connections 2024-02-28T16:11:13.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.203+0000 7fd417200700 1 -- 172.21.15.57:0/2557692445 wait complete. 2024-02-28T16:11:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.205+0000 7fd417200700 1 Processor -- start 2024-02-28T16:11:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.205+0000 7fd417200700 1 -- start start 2024-02-28T16:11:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.205+0000 7fd417200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4100fda80 0x7fd41010fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:13.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.205+0000 7fd417200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4101003a0 0x7fd4101102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:13.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.205+0000 7fd417200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd410111070 con 0x7fd4101003a0 2024-02-28T16:11:13.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.205+0000 7fd417200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4101111e0 con 0x7fd4100fda80 2024-02-28T16:11:13.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.206+0000 7fd407400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4101003a0 0x7fd4101102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:13.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.206+0000 7fd407400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4101003a0 0x7fd4101102b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40572/0 (socket says 172.21.15.57:40572) 2024-02-28T16:11:13.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.206+0000 7fd407400700 1 -- 172.21.15.57:0/2603151665 learned_addr learned my addr 172.21.15.57:0/2603151665 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:13.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.206+0000 7fd40fe00700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4100fda80 0x7fd41010fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:13.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.206+0000 7fd407400700 1 -- 172.21.15.57:0/2603151665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4100fda80 msgr2=0x7fd41010fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.206+0000 7fd407400700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4100fda80 0x7fd41010fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.206+0000 7fd407400700 1 -- 172.21.15.57:0/2603151665 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009940 con 0x7fd4101003a0 2024-02-28T16:11:13.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.207+0000 7fd407400700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4101003a0 0x7fd4101102b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8002a50 tx=0x7fd3f80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:13.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.207+0000 7fd40cc00700 1 -- 172.21.15.57:0/2603151665 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f8007cc0 con 0x7fd4101003a0 2024-02-28T16:11:13.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.207+0000 7fd40cc00700 1 -- 172.21.15.57:0/2603151665 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3f800f040 con 0x7fd4101003a0 2024-02-28T16:11:13.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.207+0000 7fd40cc00700 1 -- 172.21.15.57:0/2603151665 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f8009640 con 0x7fd4101003a0 2024-02-28T16:11:13.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.207+0000 7fd417200700 1 -- 172.21.15.57:0/2603151665 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd410111460 con 0x7fd4101003a0 2024-02-28T16:11:13.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.207+0000 7fd417200700 1 -- 172.21.15.57:0/2603151665 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd410111950 con 0x7fd4101003a0 2024-02-28T16:11:13.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.208+0000 7fd417200700 1 -- 172.21.15.57:0/2603151665 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41004bed0 con 0x7fd4101003a0 2024-02-28T16:11:13.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.210+0000 7fd40cc00700 1 -- 172.21.15.57:0/2603151665 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd3f80097c0 con 0x7fd4101003a0 2024-02-28T16:11:13.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.211+0000 7fd40cc00700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd3f406d7f0 0x7fd3f406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.212+0000 7fd40cc00700 1 -- 172.21.15.57:0/2603151665 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fd3f808cdd0 con 0x7fd4101003a0 2024-02-28T16:11:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.212+0000 7fd40fe00700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd3f406d7f0 0x7fd3f406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.212+0000 7fd40fe00700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd3f406d7f0 0x7fd3f406fca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd400009470 tx=0x7fd400004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:13.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.219+0000 7fd40cc00700 1 -- 172.21.15.57:0/2603151665 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd3f8056480 con 0x7fd4101003a0 2024-02-28T16:11:13.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.457+0000 7fd417200700 1 -- 172.21.15.57:0/2603151665 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd410111de0 con 0x7fd3f406d7f0 2024-02-28T16:11:13.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.475+0000 7fd40cc00700 1 -- 172.21.15.57:0/2603151665 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd410111de0 con 0x7fd3f406d7f0 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (9m) 5s ago 20m 15.1M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (5m) 5s ago 20m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (5m) 74s ago 19m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (8m) 5s ago 19m 76.1M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (16s) 5s ago 13m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b df14dcf6973e 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (12m) 5s ago 12m 169M - 17.2.7-535-gc0f02e60 1c37ed371348 7d7bd8c52046 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (13m) 74s ago 13m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (12m) 74s ago 12m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (8m) 5s ago 22m 509M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (7m) 74s ago 18m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (6m) 5s ago 22m 55.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (6m) 74s ago 18m 40.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:11:13.467 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (9m) 5s ago 20m 8028k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:11:13.468 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (8m) 74s ago 18m 7922k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:11:13.468 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (4m) 5s ago 17m 132M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:11:13.468 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (3m) 5s ago 17m 103M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:11:13.468 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (3m) 5s ago 16m 97.3M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:11:13.468 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (2m) 74s ago 16m 92.1M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:11:13.468 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (107s) 74s ago 15m 87.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:11:13.468 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (79s) 74s ago 14m 11.1M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b cbdb6df47634 2024-02-28T16:11:13.468 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (7m) 5s ago 19m 55.3M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:11:13.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 -- 172.21.15.57:0/2603151665 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd3f406d7f0 msgr2=0x7fd3f406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd3f406d7f0 0x7fd3f406fca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd400009470 tx=0x7fd400004d10 comp rx=0 tx=0).stop 2024-02-28T16:11:13.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 -- 172.21.15.57:0/2603151665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4101003a0 msgr2=0x7fd4101102b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4101003a0 0x7fd4101102b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8002a50 tx=0x7fd3f80046b0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 -- 172.21.15.57:0/2603151665 shutdown_connections 2024-02-28T16:11:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd3f406d7f0 0x7fd3f406fca0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4100fda80 0x7fd41010fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 --2- 172.21.15.57:0/2603151665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4101003a0 0x7fd4101102b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 -- 172.21.15.57:0/2603151665 >> 172.21.15.57:0/2603151665 conn(0x7fd4100f74e0 msgr2=0x7fd4100fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 -- 172.21.15.57:0/2603151665 shutdown_connections 2024-02-28T16:11:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.478+0000 7fd417200700 1 -- 172.21.15.57:0/2603151665 wait complete. 2024-02-28T16:11:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.629+0000 7fc0ee600700 1 -- 172.21.15.57:0/3116909936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0e80663c0 msgr2=0x7fc0e8101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.629+0000 7fc0ee600700 1 --2- 172.21.15.57:0/3116909936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0e80663c0 0x7fc0e8101f10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8004940 tx=0x7fc0d8009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.629+0000 7fc0ee600700 1 -- 172.21.15.57:0/3116909936 shutdown_connections 2024-02-28T16:11:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.629+0000 7fc0ee600700 1 --2- 172.21.15.57:0/3116909936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e8102450 0x7fc0e8104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.629+0000 7fc0ee600700 1 --2- 172.21.15.57:0/3116909936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0e80663c0 0x7fc0e8101f10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.629+0000 7fc0ee600700 1 -- 172.21.15.57:0/3116909936 >> 172.21.15.57:0/3116909936 conn(0x7fc0e80f74e0 msgr2=0x7fc0e80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:13.621 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:13 smithi057 ceph-mon[93219]: pgmap v253: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:11:13.621 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:13 smithi057 ceph-mon[93219]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:13.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.630+0000 7fc0ee600700 1 -- 172.21.15.57:0/3116909936 shutdown_connections 2024-02-28T16:11:13.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.630+0000 7fc0ee600700 1 -- 172.21.15.57:0/3116909936 wait complete. 2024-02-28T16:11:13.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.631+0000 7fc0ee600700 1 Processor -- start 2024-02-28T16:11:13.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.631+0000 7fc0ee600700 1 -- start start 2024-02-28T16:11:13.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.631+0000 7fc0ee600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e80663c0 0x7fc0e810fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:13.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.632+0000 7fc0ee600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0e8102450 0x7fc0e8110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:13.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.632+0000 7fc0ee600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8110700 con 0x7fc0e8102450 2024-02-28T16:11:13.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.632+0000 7fc0ee600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8110fa0 con 0x7fc0e80663c0 2024-02-28T16:11:13.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.632+0000 7fc0e6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0e8102450 0x7fc0e8110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:13.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.632+0000 7fc0e6a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0e8102450 0x7fc0e8110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40590/0 (socket says 172.21.15.57:40590) 2024-02-28T16:11:13.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.632+0000 7fc0e6a00700 1 -- 172.21.15.57:0/1955387935 learned_addr learned my addr 172.21.15.57:0/1955387935 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:13.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.632+0000 7fc0e7400700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e80663c0 0x7fc0e810fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.633+0000 7fc0e6a00700 1 -- 172.21.15.57:0/1955387935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e80663c0 msgr2=0x7fc0e810fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.633+0000 7fc0e6a00700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e80663c0 0x7fc0e810fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.633+0000 7fc0e6a00700 1 -- 172.21.15.57:0/1955387935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8005040 con 0x7fc0e8102450 2024-02-28T16:11:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.633+0000 7fc0e6a00700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0e8102450 0x7fc0e8110100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4002a80 tx=0x7fc0d4004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.633+0000 7fc0df400700 1 -- 172.21.15.57:0/1955387935 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0d4004e80 con 0x7fc0e8102450 2024-02-28T16:11:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.633+0000 7fc0df400700 1 -- 172.21.15.57:0/1955387935 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0d400f040 con 0x7fc0e8102450 2024-02-28T16:11:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.633+0000 7fc0df400700 1 -- 172.21.15.57:0/1955387935 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0d400daa0 con 0x7fc0e8102450 2024-02-28T16:11:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.634+0000 7fc0ee600700 1 -- 172.21.15.57:0/1955387935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e8111280 con 0x7fc0e8102450 2024-02-28T16:11:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.634+0000 7fc0ee600700 1 -- 172.21.15.57:0/1955387935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e81117c0 con 0x7fc0e8102450 2024-02-28T16:11:13.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.635+0000 7fc0ee600700 1 -- 172.21.15.57:0/1955387935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e804bed0 con 0x7fc0e8102450 2024-02-28T16:11:13.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.637+0000 7fc0df400700 1 -- 172.21.15.57:0/1955387935 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc0d4007cc0 con 0x7fc0e8102450 2024-02-28T16:11:13.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.638+0000 7fc0df400700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0cc06d7f0 0x7fc0cc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:13.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.638+0000 7fc0df400700 1 -- 172.21.15.57:0/1955387935 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fc0d408c600 con 0x7fc0e8102450 2024-02-28T16:11:13.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.638+0000 7fc0e7400700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0cc06d7f0 0x7fc0cc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:13.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.639+0000 7fc0e7400700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0cc06d7f0 0x7fc0cc06fca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80043d0 tx=0x7fc0d8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:13.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.643+0000 7fc0df400700 1 -- 172.21.15.57:0/1955387935 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc0d4059860 con 0x7fc0e8102450 2024-02-28T16:11:13.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.952+0000 7fc0ee600700 1 -- 172.21.15.57:0/1955387935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc0e8107c60 con 0x7fc0e8102450 2024-02-28T16:11:13.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.953+0000 7fc0df400700 1 -- 172.21.15.57:0/1955387935 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fc0d40593f0 con 0x7fc0e8102450 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:11:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:11:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 3, 2024-02-28T16:11:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:11:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:11:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:11:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 3, 2024-02-28T16:11:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 11 2024-02-28T16:11:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:11:13.946 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:11:13.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.956+0000 7fc0ee600700 1 -- 172.21.15.57:0/1955387935 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0cc06d7f0 msgr2=0x7fc0cc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.956+0000 7fc0ee600700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0cc06d7f0 0x7fc0cc06fca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80043d0 tx=0x7fc0d8009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:13.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.956+0000 7fc0ee600700 1 -- 172.21.15.57:0/1955387935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0e8102450 msgr2=0x7fc0e8110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:13.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.956+0000 7fc0ee600700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0e8102450 0x7fc0e8110100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4002a80 tx=0x7fc0d4004630 comp rx=0 tx=0).stop 2024-02-28T16:11:13.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.956+0000 7fc0ee600700 1 -- 172.21.15.57:0/1955387935 shutdown_connections 2024-02-28T16:11:13.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.956+0000 7fc0ee600700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc0cc06d7f0 0x7fc0cc06fca0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.956+0000 7fc0ee600700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e80663c0 0x7fc0e810fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.956+0000 7fc0ee600700 1 --2- 172.21.15.57:0/1955387935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0e8102450 0x7fc0e8110100 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:13.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.956+0000 7fc0ee600700 1 -- 172.21.15.57:0/1955387935 >> 172.21.15.57:0/1955387935 conn(0x7fc0e80f74e0 msgr2=0x7fc0e80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:13.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.957+0000 7fc0ee600700 1 -- 172.21.15.57:0/1955387935 shutdown_connections 2024-02-28T16:11:13.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:13.957+0000 7fc0ee600700 1 -- 172.21.15.57:0/1955387935 wait complete. 2024-02-28T16:11:13.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:13 smithi087 ceph-mon[82628]: pgmap v253: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:11:13.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:13 smithi087 ceph-mon[82628]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:14.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.109+0000 7f1d4de00700 1 -- 172.21.15.57:0/792482639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d480fcef0 msgr2=0x7f1d480fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.109+0000 7f1d4de00700 1 --2- 172.21.15.57:0/792482639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d480fcef0 0x7f1d480fd320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d38004940 tx=0x7f1d38009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.109+0000 7f1d4de00700 1 -- 172.21.15.57:0/792482639 shutdown_connections 2024-02-28T16:11:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.109+0000 7f1d4de00700 1 --2- 172.21.15.57:0/792482639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fe0e0 0x7f1d480fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.109+0000 7f1d4de00700 1 --2- 172.21.15.57:0/792482639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d480fcef0 0x7f1d480fd320 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.109+0000 7f1d4de00700 1 -- 172.21.15.57:0/792482639 >> 172.21.15.57:0/792482639 conn(0x7f1d480f8620 msgr2=0x7f1d480faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.109+0000 7f1d4de00700 1 -- 172.21.15.57:0/792482639 shutdown_connections 2024-02-28T16:11:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.109+0000 7f1d4de00700 1 -- 172.21.15.57:0/792482639 wait complete. 2024-02-28T16:11:14.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.110+0000 7f1d4de00700 1 Processor -- start 2024-02-28T16:11:14.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.110+0000 7f1d4de00700 1 -- start start 2024-02-28T16:11:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.111+0000 7f1d4de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d480fcef0 0x7f1d4810fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.111+0000 7f1d4de00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fe0e0 0x7f1d48110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.111+0000 7f1d4de00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48110780 con 0x7f1d480fcef0 2024-02-28T16:11:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.111+0000 7f1d4de00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48110fd0 con 0x7f1d480fe0e0 2024-02-28T16:11:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.111+0000 7f1d46a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d480fcef0 0x7f1d4810fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.111+0000 7f1d46a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d480fcef0 0x7f1d4810fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40612/0 (socket says 172.21.15.57:40612) 2024-02-28T16:11:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.111+0000 7f1d46a00700 1 -- 172.21.15.57:0/894847386 learned_addr learned my addr 172.21.15.57:0/894847386 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.111+0000 7f1d46a00700 1 -- 172.21.15.57:0/894847386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fe0e0 msgr2=0x7f1d48110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.111+0000 7f1d46a00700 1 --2- 172.21.15.57:0/894847386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fe0e0 0x7f1d48110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.111+0000 7f1d46a00700 1 -- 172.21.15.57:0/894847386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d38005040 con 0x7f1d480fcef0 2024-02-28T16:11:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.112+0000 7f1d46a00700 1 --2- 172.21.15.57:0/894847386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d480fcef0 0x7f1d4810fc40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1d38000c00 tx=0x7f1d38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.112+0000 7f1d3ea00700 1 -- 172.21.15.57:0/894847386 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d3800e040 con 0x7f1d480fcef0 2024-02-28T16:11:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.112+0000 7f1d4de00700 1 -- 172.21.15.57:0/894847386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d48111250 con 0x7f1d480fcef0 2024-02-28T16:11:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.112+0000 7f1d3ea00700 1 -- 172.21.15.57:0/894847386 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d3800bcc0 con 0x7f1d480fcef0 2024-02-28T16:11:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.112+0000 7f1d4de00700 1 -- 172.21.15.57:0/894847386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d48111790 con 0x7f1d480fcef0 2024-02-28T16:11:14.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.112+0000 7f1d3ea00700 1 -- 172.21.15.57:0/894847386 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d380255e0 con 0x7f1d480fcef0 2024-02-28T16:11:14.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.113+0000 7f1d4de00700 1 -- 172.21.15.57:0/894847386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d48102210 con 0x7f1d480fcef0 2024-02-28T16:11:14.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.115+0000 7f1d3ea00700 1 -- 172.21.15.57:0/894847386 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1d38013980 con 0x7f1d480fcef0 2024-02-28T16:11:14.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.116+0000 7f1d3ea00700 1 --2- 172.21.15.57:0/894847386 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d2c06d7e0 0x7f1d2c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.116+0000 7f1d3ea00700 1 -- 172.21.15.57:0/894847386 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f1d3808ee10 con 0x7f1d480fcef0 2024-02-28T16:11:14.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.116+0000 7f1d46000700 1 --2- 172.21.15.57:0/894847386 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d2c06d7e0 0x7f1d2c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:14.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.117+0000 7f1d46000700 1 --2- 172.21.15.57:0/894847386 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d2c06d7e0 0x7f1d2c06fc90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1d34004d00 tx=0x7f1d34009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:14.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.123+0000 7f1d3ea00700 1 -- 172.21.15.57:0/894847386 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1d3805c110 con 0x7f1d480fcef0 2024-02-28T16:11:14.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.396+0000 7f1d4de00700 1 -- 172.21.15.57:0/894847386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1d48105a30 con 0x7f1d480fcef0 2024-02-28T16:11:14.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.396+0000 7f1d3ea00700 1 -- 172.21.15.57:0/894847386 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1845 (secure 0 0 0) 0x7f1d3805bca0 con 0x7f1d480fcef0 2024-02-28T16:11:14.388 INFO:teuthology.orchestra.run.smithi057.stdout:e28 2024-02-28T16:11:14.388 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:11:14.388 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:11:14.388 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:11:14.388 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:11:14.388 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:11:14.388 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:11:14.388 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 28 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:10:57.644767+0000 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 100 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 1 2024-02-28T16:11:14.389 INFO:teuthology.orchestra.run.smithi057.stdout:in 0 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=34456} 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 1 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{0:34456} state up:active seq 15 join_fscid=1 addr [v2:172.21.15.57:6828/3861545073,v1:172.21.15.57:6829/3861545073] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:Standby daemons: 2024-02-28T16:11:14.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:11:14.391 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{-1:34490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:11:14.391 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/3768145606,v1:172.21.15.87:6827/3768145606] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:11:14.391 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.87:6824/456812589,v1:172.21.15.87:6825/456812589] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:11:14.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.400+0000 7f1d4de00700 1 -- 172.21.15.57:0/894847386 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d2c06d7e0 msgr2=0x7f1d2c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.400+0000 7f1d4de00700 1 --2- 172.21.15.57:0/894847386 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d2c06d7e0 0x7f1d2c06fc90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1d34004d00 tx=0x7f1d34009ce0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.400+0000 7f1d4de00700 1 -- 172.21.15.57:0/894847386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d480fcef0 msgr2=0x7f1d4810fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.400+0000 7f1d4de00700 1 --2- 172.21.15.57:0/894847386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d480fcef0 0x7f1d4810fc40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1d38000c00 tx=0x7f1d38009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:14.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.400+0000 7f1d4de00700 1 -- 172.21.15.57:0/894847386 shutdown_connections 2024-02-28T16:11:14.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.400+0000 7f1d4de00700 1 --2- 172.21.15.57:0/894847386 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1d2c06d7e0 0x7f1d2c06fc90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.400+0000 7f1d4de00700 1 --2- 172.21.15.57:0/894847386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d480fcef0 0x7f1d4810fc40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.400+0000 7f1d4de00700 1 --2- 172.21.15.57:0/894847386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fe0e0 0x7f1d48110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.400+0000 7f1d4de00700 1 -- 172.21.15.57:0/894847386 >> 172.21.15.57:0/894847386 conn(0x7f1d480f8620 msgr2=0x7f1d480ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:14.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.401+0000 7f1d4de00700 1 -- 172.21.15.57:0/894847386 shutdown_connections 2024-02-28T16:11:14.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.401+0000 7f1d4de00700 1 -- 172.21.15.57:0/894847386 wait complete. 2024-02-28T16:11:14.393 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 28 2024-02-28T16:11:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.554+0000 7f8b4cc00700 1 -- 172.21.15.57:0/1874867636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b480fcef0 msgr2=0x7f8b480fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.554+0000 7f8b4cc00700 1 --2- 172.21.15.57:0/1874867636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b480fcef0 0x7f8b480fd320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8b38004940 tx=0x7f8b38009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.554+0000 7f8b4cc00700 1 -- 172.21.15.57:0/1874867636 shutdown_connections 2024-02-28T16:11:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.554+0000 7f8b4cc00700 1 --2- 172.21.15.57:0/1874867636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b480fe0e0 0x7f8b480fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.554+0000 7f8b4cc00700 1 --2- 172.21.15.57:0/1874867636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b480fcef0 0x7f8b480fd320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.554+0000 7f8b4cc00700 1 -- 172.21.15.57:0/1874867636 >> 172.21.15.57:0/1874867636 conn(0x7f8b480f8620 msgr2=0x7f8b480faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.554+0000 7f8b4cc00700 1 -- 172.21.15.57:0/1874867636 shutdown_connections 2024-02-28T16:11:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.555+0000 7f8b4cc00700 1 -- 172.21.15.57:0/1874867636 wait complete. 2024-02-28T16:11:14.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.555+0000 7f8b4cc00700 1 Processor -- start 2024-02-28T16:11:14.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.556+0000 7f8b4cc00700 1 -- start start 2024-02-28T16:11:14.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.556+0000 7f8b4cc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b480fcef0 0x7f8b4810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.556+0000 7f8b4cc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b480fe0e0 0x7f8b481100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.556+0000 7f8b4cc00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b481106d0 con 0x7f8b480fcef0 2024-02-28T16:11:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.556+0000 7f8b4cc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48110f70 con 0x7f8b480fe0e0 2024-02-28T16:11:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.556+0000 7f8b45e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b480fcef0 0x7f8b4810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.556+0000 7f8b45e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b480fcef0 0x7f8b4810fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40632/0 (socket says 172.21.15.57:40632) 2024-02-28T16:11:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.556+0000 7f8b45e00700 1 -- 172.21.15.57:0/3423831464 learned_addr learned my addr 172.21.15.57:0/3423831464 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.557+0000 7f8b45400700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b480fe0e0 0x7f8b481100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.557+0000 7f8b45e00700 1 -- 172.21.15.57:0/3423831464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b480fe0e0 msgr2=0x7f8b481100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.557+0000 7f8b45e00700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b480fe0e0 0x7f8b481100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.557+0000 7f8b45e00700 1 -- 172.21.15.57:0/3423831464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38005040 con 0x7f8b480fcef0 2024-02-28T16:11:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.557+0000 7f8b45e00700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b480fcef0 0x7f8b4810fb90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8b38000c00 tx=0x7f8b38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.558+0000 7f8b3e000700 1 -- 172.21.15.57:0/3423831464 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b3800e040 con 0x7f8b480fcef0 2024-02-28T16:11:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.558+0000 7f8b3e000700 1 -- 172.21.15.57:0/3423831464 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b3800bcc0 con 0x7f8b480fcef0 2024-02-28T16:11:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.558+0000 7f8b3e000700 1 -- 172.21.15.57:0/3423831464 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b38013ea0 con 0x7f8b480fcef0 2024-02-28T16:11:14.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.558+0000 7f8b4cc00700 1 -- 172.21.15.57:0/3423831464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b481111f0 con 0x7f8b480fcef0 2024-02-28T16:11:14.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.558+0000 7f8b4cc00700 1 -- 172.21.15.57:0/3423831464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b48111730 con 0x7f8b480fcef0 2024-02-28T16:11:14.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.559+0000 7f8b4cc00700 1 -- 172.21.15.57:0/3423831464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b48102210 con 0x7f8b480fcef0 2024-02-28T16:11:14.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.560+0000 7f8b3e000700 1 -- 172.21.15.57:0/3423831464 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f8b38013420 con 0x7f8b480fcef0 2024-02-28T16:11:14.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.561+0000 7f8b3e000700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8b2c06d7f0 0x7f8b2c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.561+0000 7f8b3e000700 1 -- 172.21.15.57:0/3423831464 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f8b3808e360 con 0x7f8b480fcef0 2024-02-28T16:11:14.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.561+0000 7f8b45400700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8b2c06d7f0 0x7f8b2c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:14.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.562+0000 7f8b45400700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8b2c06d7f0 0x7f8b2c06fca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b34004990 tx=0x7f8b34009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:14.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.566+0000 7f8b3e000700 1 -- 172.21.15.57:0/3423831464 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8b3805b5e0 con 0x7f8b480fcef0 2024-02-28T16:11:14.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:14 smithi057 ceph-mon[93219]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:14.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:14 smithi057 ceph-mon[93219]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:14.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:14 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1955387935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:14.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:14 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/894847386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:11:14.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.830+0000 7f8b4cc00700 1 -- 172.21.15.57:0/3423831464 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b48111a80 con 0x7f8b2c06d7f0 2024-02-28T16:11:14.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.832+0000 7f8b3e000700 1 -- 172.21.15.57:0/3423831464 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8b48111a80 con 0x7f8b2c06d7f0 2024-02-28T16:11:14.823 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:11:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:11:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:11:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:11:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:11:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "osd", 2024-02-28T16:11:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:11:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:11:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:11:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:11:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "13/21 daemons upgraded", 2024-02-28T16:11:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T16:11:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:11:14.824 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.834+0000 7f8b4cc00700 1 -- 172.21.15.57:0/3423831464 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8b2c06d7f0 msgr2=0x7f8b2c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.834+0000 7f8b4cc00700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8b2c06d7f0 0x7f8b2c06fca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b34004990 tx=0x7f8b34009ee0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.835+0000 7f8b4cc00700 1 -- 172.21.15.57:0/3423831464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b480fcef0 msgr2=0x7f8b4810fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.835+0000 7f8b4cc00700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b480fcef0 0x7f8b4810fb90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8b38000c00 tx=0x7f8b38009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.835+0000 7f8b4cc00700 1 -- 172.21.15.57:0/3423831464 shutdown_connections 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.835+0000 7f8b4cc00700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8b2c06d7f0 0x7f8b2c06fca0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.835+0000 7f8b4cc00700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b480fcef0 0x7f8b4810fb90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.835+0000 7f8b4cc00700 1 --2- 172.21.15.57:0/3423831464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b480fe0e0 0x7f8b481100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.835+0000 7f8b4cc00700 1 -- 172.21.15.57:0/3423831464 >> 172.21.15.57:0/3423831464 conn(0x7f8b480f8620 msgr2=0x7f8b480ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.835+0000 7f8b4cc00700 1 -- 172.21.15.57:0/3423831464 shutdown_connections 2024-02-28T16:11:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.835+0000 7f8b4cc00700 1 -- 172.21.15.57:0/3423831464 wait complete. 2024-02-28T16:11:14.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:14 smithi087 ceph-mon[82628]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:14.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:14 smithi087 ceph-mon[82628]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:14.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:14 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1955387935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:14.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:14 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/894847386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:11:14.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.986+0000 7fbc8b200700 1 -- 172.21.15.57:0/4087528776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84070840 msgr2=0x7fbc84070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.986+0000 7fbc8b200700 1 --2- 172.21.15.57:0/4087528776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84070840 0x7fbc84070cb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbc70004940 tx=0x7fbc70009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:14.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.987+0000 7fbc8b200700 1 -- 172.21.15.57:0/4087528776 shutdown_connections 2024-02-28T16:11:14.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.987+0000 7fbc8b200700 1 --2- 172.21.15.57:0/4087528776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84070840 0x7fbc84070cb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.987+0000 7fbc8b200700 1 --2- 172.21.15.57:0/4087528776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc84071e90 0x7fbc84070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.987+0000 7fbc8b200700 1 -- 172.21.15.57:0/4087528776 >> 172.21.15.57:0/4087528776 conn(0x7fbc840f8620 msgr2=0x7fbc840faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:14.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.987+0000 7fbc8b200700 1 -- 172.21.15.57:0/4087528776 shutdown_connections 2024-02-28T16:11:14.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.987+0000 7fbc8b200700 1 -- 172.21.15.57:0/4087528776 wait complete. 2024-02-28T16:11:14.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.988+0000 7fbc8b200700 1 Processor -- start 2024-02-28T16:11:14.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.988+0000 7fbc8b200700 1 -- start start 2024-02-28T16:11:14.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.988+0000 7fbc8b200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc84070840 0x7fbc8410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.988+0000 7fbc8b200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84071e90 0x7fbc84110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.989+0000 7fbc8b200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84110680 con 0x7fbc84071e90 2024-02-28T16:11:14.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.989+0000 7fbc8b200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84110f20 con 0x7fbc84070840 2024-02-28T16:11:14.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.989+0000 7fbc83400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84071e90 0x7fbc84110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:14.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.989+0000 7fbc83400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84071e90 0x7fbc84110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40638/0 (socket says 172.21.15.57:40638) 2024-02-28T16:11:14.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.989+0000 7fbc83400700 1 -- 172.21.15.57:0/3706787037 learned_addr learned my addr 172.21.15.57:0/3706787037 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:14.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.989+0000 7fbc83e00700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc84070840 0x7fbc8410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:14.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.989+0000 7fbc83400700 1 -- 172.21.15.57:0/3706787037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc84070840 msgr2=0x7fbc8410fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:14.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.989+0000 7fbc83400700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc84070840 0x7fbc8410fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:14.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.989+0000 7fbc83400700 1 -- 172.21.15.57:0/3706787037 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc70005040 con 0x7fbc84071e90 2024-02-28T16:11:14.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.990+0000 7fbc83400700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84071e90 0x7fbc84110080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009fd0 tx=0x7fbc70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:14.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.990+0000 7fbc7be00700 1 -- 172.21.15.57:0/3706787037 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7000e040 con 0x7fbc84071e90 2024-02-28T16:11:14.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.990+0000 7fbc7be00700 1 -- 172.21.15.57:0/3706787037 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc7000bcc0 con 0x7fbc84071e90 2024-02-28T16:11:14.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.990+0000 7fbc7be00700 1 -- 172.21.15.57:0/3706787037 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7001c630 con 0x7fbc84071e90 2024-02-28T16:11:14.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.990+0000 7fbc8b200700 1 -- 172.21.15.57:0/3706787037 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc841111a0 con 0x7fbc84071e90 2024-02-28T16:11:14.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.990+0000 7fbc8b200700 1 -- 172.21.15.57:0/3706787037 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc841116e0 con 0x7fbc84071e90 2024-02-28T16:11:14.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.991+0000 7fbc8b200700 1 -- 172.21.15.57:0/3706787037 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8404bed0 con 0x7fbc84071e90 2024-02-28T16:11:14.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.992+0000 7fbc7be00700 1 -- 172.21.15.57:0/3706787037 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fbc70013980 con 0x7fbc84071e90 2024-02-28T16:11:14.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.993+0000 7fbc7be00700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc6806d7f0 0x7fbc6806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:14.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.994+0000 7fbc7be00700 1 -- 172.21.15.57:0/3706787037 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fbc7008e420 con 0x7fbc84071e90 2024-02-28T16:11:14.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.994+0000 7fbc83e00700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc6806d7f0 0x7fbc6806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:14.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.995+0000 7fbc83e00700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc6806d7f0 0x7fbc6806fca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbc74004990 tx=0x7fbc74009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:14.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:14.999+0000 7fbc7be00700 1 -- 172.21.15.57:0/3706787037 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbc7005b700 con 0x7fbc84071e90 2024-02-28T16:11:15.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.327+0000 7fbc8b200700 1 -- 172.21.15.57:0/3706787037 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbc84107c00 con 0x7fbc84071e90 2024-02-28T16:11:15.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.327+0000 7fbc7be00700 1 -- 172.21.15.57:0/3706787037 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbc7005b290 con 0x7fbc84071e90 2024-02-28T16:11:15.319 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:11:15.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.330+0000 7fbc8b200700 1 -- 172.21.15.57:0/3706787037 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc6806d7f0 msgr2=0x7fbc6806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:15.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.330+0000 7fbc8b200700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc6806d7f0 0x7fbc6806fca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbc74004990 tx=0x7fbc74009ee0 comp rx=0 tx=0).stop 2024-02-28T16:11:15.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.330+0000 7fbc8b200700 1 -- 172.21.15.57:0/3706787037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84071e90 msgr2=0x7fbc84110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:15.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.330+0000 7fbc8b200700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84071e90 0x7fbc84110080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009fd0 tx=0x7fbc70009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:15.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.331+0000 7fbc8b200700 1 -- 172.21.15.57:0/3706787037 shutdown_connections 2024-02-28T16:11:15.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.331+0000 7fbc8b200700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fbc6806d7f0 0x7fbc6806fca0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:15.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.331+0000 7fbc8b200700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc84070840 0x7fbc8410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:15.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.331+0000 7fbc8b200700 1 --2- 172.21.15.57:0/3706787037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84071e90 0x7fbc84110080 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:15.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.331+0000 7fbc8b200700 1 -- 172.21.15.57:0/3706787037 >> 172.21.15.57:0/3706787037 conn(0x7fbc840f8620 msgr2=0x7fbc84102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:15.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.331+0000 7fbc8b200700 1 -- 172.21.15.57:0/3706787037 shutdown_connections 2024-02-28T16:11:15.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:15.331+0000 7fbc8b200700 1 -- 172.21.15.57:0/3706787037 wait complete. 2024-02-28T16:11:15.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:15 smithi057 ceph-mon[93219]: pgmap v254: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-28T16:11:15.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:15 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3706787037' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:11:15.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:15 smithi087 ceph-mon[82628]: pgmap v254: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-28T16:11:15.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:15 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3706787037' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:11:16.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:16.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:16 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi057.qwatmu"]}]: dispatch 2024-02-28T16:11:16.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:16.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:16 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi057.qwatmu"]}]: dispatch 2024-02-28T16:11:17.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:17 smithi057 ceph-mon[93219]: Detected new or changed devices on smithi057 2024-02-28T16:11:17.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:17 smithi057 ceph-mon[93219]: pgmap v255: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:17.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:17 smithi057 ceph-mon[93219]: Upgrade: It appears safe to stop mds.cephfs.smithi057.qwatmu 2024-02-28T16:11:17.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:17 smithi087 ceph-mon[82628]: Detected new or changed devices on smithi057 2024-02-28T16:11:17.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:17 smithi087 ceph-mon[82628]: pgmap v255: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:17.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:17 smithi087 ceph-mon[82628]: Upgrade: It appears safe to stop mds.cephfs.smithi057.qwatmu 2024-02-28T16:11:19.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:19 smithi057 ceph-mon[93219]: pgmap v256: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:19.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:19 smithi057 ceph-mon[93219]: Upgrade: Updating mds.cephfs.smithi057.qwatmu 2024-02-28T16:11:19.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:19.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.qwatmu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:11:19.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:11:19.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:19 smithi057 ceph-mon[93219]: Deploying daemon mds.cephfs.smithi057.qwatmu on smithi057 2024-02-28T16:11:19.704 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:11:19.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:19 smithi087 ceph-mon[82628]: pgmap v256: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:19.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:19 smithi087 ceph-mon[82628]: Upgrade: Updating mds.cephfs.smithi057.qwatmu 2024-02-28T16:11:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi057.qwatmu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:11:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:11:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:19 smithi087 ceph-mon[82628]: Deploying daemon mds.cephfs.smithi057.qwatmu on smithi057 2024-02-28T16:11:19.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:11:21.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:21 smithi057 ceph-mon[93219]: pgmap v257: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:21.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:21 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057[93215]: 2024-02-28T16:11:21.561+0000 7fb8d1a00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:11:21.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:21 smithi087 ceph-mon[82628]: pgmap v257: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:22.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:22 smithi057 ceph-mon[93219]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:11:22.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:22 smithi057 ceph-mon[93219]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:11:22.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:22 smithi057 ceph-mon[93219]: osdmap e101: 6 total, 6 up, 6 in 2024-02-28T16:11:22.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:22 smithi057 ceph-mon[93219]: Standby daemon mds.cephfs.smithi057.eztwsd assigned to filesystem cephfs as rank 0 2024-02-28T16:11:22.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:22 smithi057 ceph-mon[93219]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:11:22.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:22 smithi057 ceph-mon[93219]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:11:22.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:22 smithi057 ceph-mon[93219]: fsmap cephfs:1/1 {0=cephfs.smithi057.eztwsd=up:replay} 2 up:standby 2024-02-28T16:11:22.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:22 smithi087 ceph-mon[82628]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:11:22.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:22 smithi087 ceph-mon[82628]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:11:22.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:22 smithi087 ceph-mon[82628]: osdmap e101: 6 total, 6 up, 6 in 2024-02-28T16:11:22.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:22 smithi087 ceph-mon[82628]: Standby daemon mds.cephfs.smithi057.eztwsd assigned to filesystem cephfs as rank 0 2024-02-28T16:11:22.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:22 smithi087 ceph-mon[82628]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:11:22.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:22 smithi087 ceph-mon[82628]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:11:22.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:22 smithi087 ceph-mon[82628]: fsmap cephfs:1/1 {0=cephfs.smithi057.eztwsd=up:replay} 2 up:standby 2024-02-28T16:11:23.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:23 smithi057 ceph-mon[93219]: pgmap v259: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:23.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:23 smithi087 ceph-mon[82628]: pgmap v259: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:25.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:25 smithi057 ceph-mon[93219]: pgmap v260: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-02-28T16:11:25.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:11:25.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:25 smithi087 ceph-mon[82628]: pgmap v260: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-02-28T16:11:25.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:11:27.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:27 smithi057 ceph-mon[93219]: pgmap v261: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-02-28T16:11:27.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:27 smithi087 ceph-mon[82628]: pgmap v261: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-02-28T16:11:29.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:29 smithi057 ceph-mon[93219]: pgmap v262: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-02-28T16:11:29.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:29 smithi057 ceph-mon[93219]: reconnect by client.14516 192.168.0.1:0/757520085 after 0.00399994 2024-02-28T16:11:29.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:29 smithi057 ceph-mon[93219]: reconnect by client.24333 192.168.0.1:0/1820173252 after 0.00399994 2024-02-28T16:11:29.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:29 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] up:reconnect 2024-02-28T16:11:29.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:29 smithi057 ceph-mon[93219]: fsmap cephfs:1/1 {0=cephfs.smithi057.eztwsd=up:reconnect} 2 up:standby 2024-02-28T16:11:29.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:29 smithi087 ceph-mon[82628]: pgmap v262: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-02-28T16:11:29.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:29 smithi087 ceph-mon[82628]: reconnect by client.14516 192.168.0.1:0/757520085 after 0.00399994 2024-02-28T16:11:29.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:29 smithi087 ceph-mon[82628]: reconnect by client.24333 192.168.0.1:0/1820173252 after 0.00399994 2024-02-28T16:11:29.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:29 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] up:reconnect 2024-02-28T16:11:29.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:29 smithi087 ceph-mon[82628]: fsmap cephfs:1/1 {0=cephfs.smithi057.eztwsd=up:reconnect} 2 up:standby 2024-02-28T16:11:30.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:30 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] up:rejoin 2024-02-28T16:11:30.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:30 smithi057 ceph-mon[93219]: fsmap cephfs:1/1 {0=cephfs.smithi057.eztwsd=up:rejoin} 2 up:standby 2024-02-28T16:11:30.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:30 smithi057 ceph-mon[93219]: daemon mds.cephfs.smithi057.eztwsd is now active in filesystem cephfs as rank 0 2024-02-28T16:11:30.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:30 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] up:rejoin 2024-02-28T16:11:30.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:30 smithi087 ceph-mon[82628]: fsmap cephfs:1/1 {0=cephfs.smithi057.eztwsd=up:rejoin} 2 up:standby 2024-02-28T16:11:30.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:30 smithi087 ceph-mon[82628]: daemon mds.cephfs.smithi057.eztwsd is now active in filesystem cephfs as rank 0 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:31 smithi057 ceph-mon[93219]: pgmap v263: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:31 smithi057 ceph-mon[93219]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:31 smithi057 ceph-mon[93219]: Cluster is now healthy 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:31 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] up:active 2024-02-28T16:11:31.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:31 smithi057 ceph-mon[93219]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 2 up:standby 2024-02-28T16:11:31.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:31 smithi087 ceph-mon[82628]: pgmap v263: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:11:31.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:31 smithi087 ceph-mon[82628]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:11:31.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:31 smithi087 ceph-mon[82628]: Cluster is now healthy 2024-02-28T16:11:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:31 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] up:active 2024-02-28T16:11:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:31 smithi087 ceph-mon[82628]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 2 up:standby 2024-02-28T16:11:33.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:33 smithi057 ceph-mon[93219]: pgmap v264: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 198 B/s wr, 5 op/s 2024-02-28T16:11:33.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:33 smithi087 ceph-mon[82628]: pgmap v264: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 198 B/s wr, 5 op/s 2024-02-28T16:11:34.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:34 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.57:6828/2553742021,v1:172.21.15.57:6829/2553742021] up:boot 2024-02-28T16:11:34.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:34 smithi057 ceph-mon[93219]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 3 up:standby 2024-02-28T16:11:34.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:11:34.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:34.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:34.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:34.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:11:34.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:34 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.57:6828/2553742021,v1:172.21.15.57:6829/2553742021] up:boot 2024-02-28T16:11:34.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:34 smithi087 ceph-mon[82628]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 3 up:standby 2024-02-28T16:11:34.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:11:34.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:34.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:34.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:34.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:11:35.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:35 smithi057 ceph-mon[93219]: pgmap v265: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-28T16:11:35.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:35 smithi087 ceph-mon[82628]: pgmap v265: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-28T16:11:36.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:36 smithi057 ceph-mon[93219]: pgmap v266: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-02-28T16:11:36.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:36 smithi087 ceph-mon[82628]: pgmap v266: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-02-28T16:11:39.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:38 smithi057 ceph-mon[93219]: pgmap v267: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-02-28T16:11:39.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:38 smithi087 ceph-mon[82628]: pgmap v267: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-02-28T16:11:41.555 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:41 smithi057 ceph-mon[93219]: pgmap v268: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-28T16:11:41.555 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:41.555 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:41.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:41 smithi087 ceph-mon[82628]: pgmap v268: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-28T16:11:41.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:41.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:43.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:43 smithi057 ceph-mon[93219]: pgmap v269: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 794 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-28T16:11:43.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:43 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:43.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:43 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:43.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:43 smithi087 ceph-mon[82628]: pgmap v269: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 794 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-28T16:11:43.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:43 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:43.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:43 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.496+0000 7f4531e00700 1 -- 172.21.15.57:0/2695728255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f452c070840 msgr2=0x7f452c070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.496+0000 7f4531e00700 1 --2- 172.21.15.57:0/2695728255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f452c070840 0x7f452c070cb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4518004940 tx=0x7f4518009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.496+0000 7f4531e00700 1 -- 172.21.15.57:0/2695728255 shutdown_connections 2024-02-28T16:11:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.496+0000 7f4531e00700 1 --2- 172.21.15.57:0/2695728255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f452c070840 0x7f452c070cb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.496+0000 7f4531e00700 1 --2- 172.21.15.57:0/2695728255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f452c071e90 0x7f452c070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.496+0000 7f4531e00700 1 -- 172.21.15.57:0/2695728255 >> 172.21.15.57:0/2695728255 conn(0x7f452c0f8620 msgr2=0x7f452c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.497+0000 7f4531e00700 1 -- 172.21.15.57:0/2695728255 shutdown_connections 2024-02-28T16:11:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.497+0000 7f4531e00700 1 -- 172.21.15.57:0/2695728255 wait complete. 2024-02-28T16:11:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.498+0000 7f4531e00700 1 Processor -- start 2024-02-28T16:11:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.498+0000 7f4531e00700 1 -- start start 2024-02-28T16:11:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.498+0000 7f4531e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f452c070840 0x7f452c10fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.498+0000 7f4531e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f452c071e90 0x7f452c1100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.498+0000 7f4531e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c1106a0 con 0x7f452c070840 2024-02-28T16:11:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.498+0000 7f4531e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c110f40 con 0x7f452c071e90 2024-02-28T16:11:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.499+0000 7f452aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f452c070840 0x7f452c10fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.499+0000 7f452aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f452c070840 0x7f452c10fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41626/0 (socket says 172.21.15.57:41626) 2024-02-28T16:11:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.499+0000 7f452aa00700 1 -- 172.21.15.57:0/2439321868 learned_addr learned my addr 172.21.15.57:0/2439321868 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.499+0000 7f452a000700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f452c071e90 0x7f452c1100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:45.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.499+0000 7f452aa00700 1 -- 172.21.15.57:0/2439321868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f452c071e90 msgr2=0x7f452c1100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:45.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.499+0000 7f452aa00700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f452c071e90 0x7f452c1100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:45.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.499+0000 7f452aa00700 1 -- 172.21.15.57:0/2439321868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4518005040 con 0x7f452c070840 2024-02-28T16:11:45.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.500+0000 7f452aa00700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f452c070840 0x7f452c10fb60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f451c00c810 tx=0x7f451c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:45.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.500+0000 7f4522a00700 1 -- 172.21.15.57:0/2439321868 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f451c012810 con 0x7f452c070840 2024-02-28T16:11:45.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.500+0000 7f4522a00700 1 -- 172.21.15.57:0/2439321868 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f451c012e40 con 0x7f452c070840 2024-02-28T16:11:45.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.500+0000 7f4522a00700 1 -- 172.21.15.57:0/2439321868 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f451c00a370 con 0x7f452c070840 2024-02-28T16:11:45.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.500+0000 7f4531e00700 1 -- 172.21.15.57:0/2439321868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452c111220 con 0x7f452c070840 2024-02-28T16:11:45.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.500+0000 7f4531e00700 1 -- 172.21.15.57:0/2439321868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c111760 con 0x7f452c070840 2024-02-28T16:11:45.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.501+0000 7f4531e00700 1 -- 172.21.15.57:0/2439321868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452c04bed0 con 0x7f452c070840 2024-02-28T16:11:45.494 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:45 smithi057 ceph-mon[93219]: pgmap v270: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-02-28T16:11:45.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.503+0000 7f4522a00700 1 -- 172.21.15.57:0/2439321868 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f451c011810 con 0x7f452c070840 2024-02-28T16:11:45.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.503+0000 7f4522a00700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f451006d7f0 0x7f451006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:45.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.504+0000 7f4522a00700 1 -- 172.21.15.57:0/2439321868 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f451c08d3b0 con 0x7f452c070840 2024-02-28T16:11:45.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.504+0000 7f452a000700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f451006d7f0 0x7f451006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:45.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.505+0000 7f452a000700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f451006d7f0 0x7f451006fca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f451800b020 tx=0x7f4518009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:45.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.509+0000 7f4522a00700 1 -- 172.21.15.57:0/2439321868 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f451c05a650 con 0x7f452c070840 2024-02-28T16:11:45.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:45 smithi087 ceph-mon[82628]: pgmap v270: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-02-28T16:11:45.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.756+0000 7f4531e00700 1 -- 172.21.15.57:0/2439321868 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f452c111c20 con 0x7f451006d7f0 2024-02-28T16:11:45.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.757+0000 7f4522a00700 1 -- 172.21.15.57:0/2439321868 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f452c111c20 con 0x7f451006d7f0 2024-02-28T16:11:45.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.760+0000 7f4531e00700 1 -- 172.21.15.57:0/2439321868 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f451006d7f0 msgr2=0x7f451006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:45.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.760+0000 7f4531e00700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f451006d7f0 0x7f451006fca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f451800b020 tx=0x7f4518009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:45.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.760+0000 7f4531e00700 1 -- 172.21.15.57:0/2439321868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f452c070840 msgr2=0x7f452c10fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:45.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.760+0000 7f4531e00700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f452c070840 0x7f452c10fb60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f451c00c810 tx=0x7f451c004470 comp rx=0 tx=0).stop 2024-02-28T16:11:45.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.760+0000 7f4531e00700 1 -- 172.21.15.57:0/2439321868 shutdown_connections 2024-02-28T16:11:45.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.760+0000 7f4531e00700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f451006d7f0 0x7f451006fca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:45.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.760+0000 7f4531e00700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f452c070840 0x7f452c10fb60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:45.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.760+0000 7f4531e00700 1 --2- 172.21.15.57:0/2439321868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f452c071e90 0x7f452c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:45.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.760+0000 7f4531e00700 1 -- 172.21.15.57:0/2439321868 >> 172.21.15.57:0/2439321868 conn(0x7f452c0f8620 msgr2=0x7f452c102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:45.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.761+0000 7f4531e00700 1 -- 172.21.15.57:0/2439321868 shutdown_connections 2024-02-28T16:11:45.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.761+0000 7f4531e00700 1 -- 172.21.15.57:0/2439321868 wait complete. 2024-02-28T16:11:45.769 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:11:45.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.932+0000 7fc595800700 1 -- 172.21.15.57:0/4186667855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5900fe0e0 msgr2=0x7fc5900fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:45.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.932+0000 7fc595800700 1 --2- 172.21.15.57:0/4186667855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5900fe0e0 0x7fc5900fe550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc57c004940 tx=0x7fc57c009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:45.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.933+0000 7fc595800700 1 -- 172.21.15.57:0/4186667855 shutdown_connections 2024-02-28T16:11:45.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.933+0000 7fc595800700 1 --2- 172.21.15.57:0/4186667855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5900fe0e0 0x7fc5900fe550 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:45.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.933+0000 7fc595800700 1 --2- 172.21.15.57:0/4186667855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5900fcef0 0x7fc5900fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:45.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.933+0000 7fc595800700 1 -- 172.21.15.57:0/4186667855 >> 172.21.15.57:0/4186667855 conn(0x7fc5900f8620 msgr2=0x7fc5900faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:45.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.933+0000 7fc595800700 1 -- 172.21.15.57:0/4186667855 shutdown_connections 2024-02-28T16:11:45.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.933+0000 7fc595800700 1 -- 172.21.15.57:0/4186667855 wait complete. 2024-02-28T16:11:45.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.934+0000 7fc595800700 1 Processor -- start 2024-02-28T16:11:45.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.935+0000 7fc595800700 1 -- start start 2024-02-28T16:11:45.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.935+0000 7fc595800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5900fcef0 0x7fc59010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:45.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.935+0000 7fc595800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5900fe0e0 0x7fc59010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:45.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.935+0000 7fc595800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59010e4b0 con 0x7fc5900fcef0 2024-02-28T16:11:45.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.935+0000 7fc595800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59010ed50 con 0x7fc5900fe0e0 2024-02-28T16:11:45.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.935+0000 7fc58ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5900fcef0 0x7fc59010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:45.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.935+0000 7fc58ea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5900fcef0 0x7fc59010d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41644/0 (socket says 172.21.15.57:41644) 2024-02-28T16:11:45.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.936+0000 7fc58ea00700 1 -- 172.21.15.57:0/2028964957 learned_addr learned my addr 172.21.15.57:0/2028964957 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:45.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.936+0000 7fc58e000700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5900fe0e0 0x7fc59010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:45.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.936+0000 7fc58ea00700 1 -- 172.21.15.57:0/2028964957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5900fe0e0 msgr2=0x7fc59010deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:45.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.936+0000 7fc58ea00700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5900fe0e0 0x7fc59010deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:45.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.936+0000 7fc58ea00700 1 -- 172.21.15.57:0/2028964957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c005040 con 0x7fc5900fcef0 2024-02-28T16:11:45.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.936+0000 7fc58ea00700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5900fcef0 0x7fc59010d970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc580002a80 tx=0x7fc580004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:45.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.937+0000 7fc586a00700 1 -- 172.21.15.57:0/2028964957 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc580007cc0 con 0x7fc5900fcef0 2024-02-28T16:11:45.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.937+0000 7fc586a00700 1 -- 172.21.15.57:0/2028964957 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc58000f040 con 0x7fc5900fcef0 2024-02-28T16:11:45.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.937+0000 7fc595800700 1 -- 172.21.15.57:0/2028964957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59010f030 con 0x7fc5900fcef0 2024-02-28T16:11:45.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.937+0000 7fc586a00700 1 -- 172.21.15.57:0/2028964957 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc58000dad0 con 0x7fc5900fcef0 2024-02-28T16:11:45.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.937+0000 7fc595800700 1 -- 172.21.15.57:0/2028964957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59010f570 con 0x7fc5900fcef0 2024-02-28T16:11:45.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.938+0000 7fc595800700 1 -- 172.21.15.57:0/2028964957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59004bed0 con 0x7fc5900fcef0 2024-02-28T16:11:45.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.939+0000 7fc586a00700 1 -- 172.21.15.57:0/2028964957 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc58000dc30 con 0x7fc5900fcef0 2024-02-28T16:11:45.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.941+0000 7fc586a00700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc57406d7f0 0x7fc57406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:45.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.941+0000 7fc586a00700 1 -- 172.21.15.57:0/2028964957 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fc58008cd60 con 0x7fc5900fcef0 2024-02-28T16:11:45.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.941+0000 7fc58e000700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc57406d7f0 0x7fc57406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:45.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.942+0000 7fc58e000700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc57406d7f0 0x7fc57406fca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00b3b0 tx=0x7fc57c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:45.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:45.946+0000 7fc586a00700 1 -- 172.21.15.57:0/2028964957 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc580091070 con 0x7fc5900fcef0 2024-02-28T16:11:46.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.192+0000 7fc595800700 1 -- 172.21.15.57:0/2028964957 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc590102ac0 con 0x7fc57406d7f0 2024-02-28T16:11:46.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.194+0000 7fc586a00700 1 -- 172.21.15.57:0/2028964957 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc590102ac0 con 0x7fc57406d7f0 2024-02-28T16:11:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 -- 172.21.15.57:0/2028964957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc57406d7f0 msgr2=0x7fc57406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc57406d7f0 0x7fc57406fca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00b3b0 tx=0x7fc57c009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 -- 172.21.15.57:0/2028964957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5900fcef0 msgr2=0x7fc59010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5900fcef0 0x7fc59010d970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc580002a80 tx=0x7fc580004600 comp rx=0 tx=0).stop 2024-02-28T16:11:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 -- 172.21.15.57:0/2028964957 shutdown_connections 2024-02-28T16:11:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc57406d7f0 0x7fc57406fca0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5900fcef0 0x7fc59010d970 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 --2- 172.21.15.57:0/2028964957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5900fe0e0 0x7fc59010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 -- 172.21.15.57:0/2028964957 >> 172.21.15.57:0/2028964957 conn(0x7fc5900f8620 msgr2=0x7fc5901013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:46.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 -- 172.21.15.57:0/2028964957 shutdown_connections 2024-02-28T16:11:46.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.197+0000 7fc595800700 1 -- 172.21.15.57:0/2028964957 wait complete. 2024-02-28T16:11:46.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.341+0000 7f95b6400700 1 -- 172.21.15.57:0/1556846015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95b00fe0e0 msgr2=0x7f95b00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:46.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.341+0000 7f95b6400700 1 --2- 172.21.15.57:0/1556846015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95b00fe0e0 0x7f95b00fe550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f959c004940 tx=0x7f959c009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:46.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.342+0000 7f95b6400700 1 -- 172.21.15.57:0/1556846015 shutdown_connections 2024-02-28T16:11:46.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.342+0000 7f95b6400700 1 --2- 172.21.15.57:0/1556846015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95b00fe0e0 0x7f95b00fe550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.342+0000 7f95b6400700 1 --2- 172.21.15.57:0/1556846015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b00fcef0 0x7f95b00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.342+0000 7f95b6400700 1 -- 172.21.15.57:0/1556846015 >> 172.21.15.57:0/1556846015 conn(0x7f95b00f8620 msgr2=0x7f95b00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:46.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.342+0000 7f95b6400700 1 -- 172.21.15.57:0/1556846015 shutdown_connections 2024-02-28T16:11:46.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.342+0000 7f95b6400700 1 -- 172.21.15.57:0/1556846015 wait complete. 2024-02-28T16:11:46.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.343+0000 7f95b6400700 1 Processor -- start 2024-02-28T16:11:46.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.343+0000 7f95b6400700 1 -- start start 2024-02-28T16:11:46.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.343+0000 7f95b6400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95b00fcef0 0x7f95b0071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:46.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.343+0000 7f95b6400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b00fe0e0 0x7f95b00702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:46.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.343+0000 7f95b6400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00708e0 con 0x7f95b00fcef0 2024-02-28T16:11:46.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.343+0000 7f95b6400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0070a50 con 0x7f95b00fe0e0 2024-02-28T16:11:46.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.344+0000 7f95af400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95b00fcef0 0x7f95b0071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:46.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.344+0000 7f95af400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95b00fcef0 0x7f95b0071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41664/0 (socket says 172.21.15.57:41664) 2024-02-28T16:11:46.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.344+0000 7f95af400700 1 -- 172.21.15.57:0/2086668271 learned_addr learned my addr 172.21.15.57:0/2086668271 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:46.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.344+0000 7f95aea00700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b00fe0e0 0x7f95b00702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:46.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.344+0000 7f95af400700 1 -- 172.21.15.57:0/2086668271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b00fe0e0 msgr2=0x7f95b00702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:46.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.344+0000 7f95af400700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b00fe0e0 0x7f95b00702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.344+0000 7f95af400700 1 -- 172.21.15.57:0/2086668271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c005040 con 0x7f95b00fcef0 2024-02-28T16:11:46.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.345+0000 7f95af400700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95b00fcef0 0x7f95b0071e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f95a0002a50 tx=0x7f95a0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:46.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.345+0000 7f95a7400700 1 -- 172.21.15.57:0/2086668271 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95a0007cc0 con 0x7f95b00fcef0 2024-02-28T16:11:46.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.345+0000 7f95a7400700 1 -- 172.21.15.57:0/2086668271 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95a000f040 con 0x7f95b00fcef0 2024-02-28T16:11:46.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.345+0000 7f95a7400700 1 -- 172.21.15.57:0/2086668271 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95a000da40 con 0x7f95b00fcef0 2024-02-28T16:11:46.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.345+0000 7f95b6400700 1 -- 172.21.15.57:0/2086668271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b0070d30 con 0x7f95b00fcef0 2024-02-28T16:11:46.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.345+0000 7f95b6400700 1 -- 172.21.15.57:0/2086668271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b01159c0 con 0x7f95b00fcef0 2024-02-28T16:11:46.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.346+0000 7f95b6400700 1 -- 172.21.15.57:0/2086668271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b004bed0 con 0x7f95b00fcef0 2024-02-28T16:11:46.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.347+0000 7f95a7400700 1 -- 172.21.15.57:0/2086668271 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f95a00097c0 con 0x7f95b00fcef0 2024-02-28T16:11:46.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.349+0000 7f95a7400700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f959406d7f0 0x7f959406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:46.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.349+0000 7f95a7400700 1 -- 172.21.15.57:0/2086668271 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f95a008cde0 con 0x7f95b00fcef0 2024-02-28T16:11:46.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.349+0000 7f95aea00700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f959406d7f0 0x7f959406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:46.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.350+0000 7f95aea00700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f959406d7f0 0x7f959406fca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f959c00b020 tx=0x7f959c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:46.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.355+0000 7f95a7400700 1 -- 172.21.15.57:0/2086668271 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f95a0059cd0 con 0x7f95b00fcef0 2024-02-28T16:11:46.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.592+0000 7f95b6400700 1 -- 172.21.15.57:0/2086668271 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f95b0102ac0 con 0x7f959406d7f0 2024-02-28T16:11:46.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.603+0000 7f95a7400700 1 -- 172.21.15.57:0/2086668271 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f95b0102ac0 con 0x7f959406d7f0 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (10m) 6s ago 20m 15.1M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (5m) 6s ago 21m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (5m) 107s ago 19m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (9m) 6s ago 20m 76.1M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (49s) 6s ago 13m 66.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b df14dcf6973e 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (13s) 6s ago 13m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 977aa1867016 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (13m) 107s ago 13m 115M - 17.2.7-535-gc0f02e60 1c37ed371348 7a3ca62e4b66 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (13m) 107s ago 13m 55.0M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (9m) 6s ago 22m 510M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (7m) 107s ago 19m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (7m) 6s ago 22m 56.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:11:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (6m) 107s ago 19m 40.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:11:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (10m) 6s ago 21m 8066k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:11:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (9m) 107s ago 19m 7922k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:11:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (5m) 6s ago 18m 134M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:11:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (4m) 6s ago 17m 105M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:11:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (3m) 6s ago 17m 98.0M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:11:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (3m) 107s ago 16m 92.1M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:11:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (2m) 107s ago 16m 87.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:11:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (112s) 107s ago 15m 11.1M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b cbdb6df47634 2024-02-28T16:11:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (8m) 6s ago 20m 55.4M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:11:46.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 -- 172.21.15.57:0/2086668271 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f959406d7f0 msgr2=0x7f959406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:46.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f959406d7f0 0x7f959406fca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f959c00b020 tx=0x7f959c009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:46.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 -- 172.21.15.57:0/2086668271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95b00fcef0 msgr2=0x7f95b0071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:46.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95b00fcef0 0x7f95b0071e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f95a0002a50 tx=0x7f95a0004600 comp rx=0 tx=0).stop 2024-02-28T16:11:46.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 -- 172.21.15.57:0/2086668271 shutdown_connections 2024-02-28T16:11:46.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f959406d7f0 0x7f959406fca0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95b00fcef0 0x7f95b0071e60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 --2- 172.21.15.57:0/2086668271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b00fe0e0 0x7f95b00702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 -- 172.21.15.57:0/2086668271 >> 172.21.15.57:0/2086668271 conn(0x7f95b00f8620 msgr2=0x7f95b01013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:46.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 -- 172.21.15.57:0/2086668271 shutdown_connections 2024-02-28T16:11:46.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.606+0000 7f95b6400700 1 -- 172.21.15.57:0/2086668271 wait complete. 2024-02-28T16:11:46.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.752+0000 7fb7dca00700 1 -- 172.21.15.57:0/2761199495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7d80fcef0 msgr2=0x7fb7d80fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:46.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.752+0000 7fb7dca00700 1 --2- 172.21.15.57:0/2761199495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7d80fcef0 0x7fb7d80fd320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009ce0 tx=0x7fb7c8004d10 comp rx=0 tx=0).stop 2024-02-28T16:11:46.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.753+0000 7fb7dca00700 1 -- 172.21.15.57:0/2761199495 shutdown_connections 2024-02-28T16:11:46.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.753+0000 7fb7dca00700 1 --2- 172.21.15.57:0/2761199495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d80fe0e0 0x7fb7d80fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.753+0000 7fb7dca00700 1 --2- 172.21.15.57:0/2761199495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7d80fcef0 0x7fb7d80fd320 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.753+0000 7fb7dca00700 1 -- 172.21.15.57:0/2761199495 >> 172.21.15.57:0/2761199495 conn(0x7fb7d80f8620 msgr2=0x7fb7d80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:46.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.753+0000 7fb7dca00700 1 -- 172.21.15.57:0/2761199495 shutdown_connections 2024-02-28T16:11:46.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.753+0000 7fb7dca00700 1 -- 172.21.15.57:0/2761199495 wait complete. 2024-02-28T16:11:46.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.754+0000 7fb7dca00700 1 Processor -- start 2024-02-28T16:11:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.754+0000 7fb7dca00700 1 -- start start 2024-02-28T16:11:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.754+0000 7fb7dca00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d80fcef0 0x7fb7d810fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.754+0000 7fb7dca00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7d80fe0e0 0x7fb7d81102d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.754+0000 7fb7dca00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d81110c0 con 0x7fb7d80fe0e0 2024-02-28T16:11:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.754+0000 7fb7dca00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8111230 con 0x7fb7d80fcef0 2024-02-28T16:11:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.755+0000 7fb7d5400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7d80fe0e0 0x7fb7d81102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.755+0000 7fb7d5400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7d80fe0e0 0x7fb7d81102d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41672/0 (socket says 172.21.15.57:41672) 2024-02-28T16:11:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.755+0000 7fb7d5400700 1 -- 172.21.15.57:0/4087774203 learned_addr learned my addr 172.21.15.57:0/4087774203 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.755+0000 7fb7d5e00700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d80fcef0 0x7fb7d810fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.755+0000 7fb7d5400700 1 -- 172.21.15.57:0/4087774203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d80fcef0 msgr2=0x7fb7d810fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.755+0000 7fb7d5400700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d80fcef0 0x7fb7d810fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.755+0000 7fb7d5400700 1 -- 172.21.15.57:0/4087774203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c8009940 con 0x7fb7d80fe0e0 2024-02-28T16:11:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.756+0000 7fb7d5400700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7d80fe0e0 0x7fb7d81102d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400c830 tx=0x7fb7c4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.756+0000 7fb7ce000700 1 -- 172.21.15.57:0/4087774203 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7c40106f0 con 0x7fb7d80fe0e0 2024-02-28T16:11:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.756+0000 7fb7ce000700 1 -- 172.21.15.57:0/4087774203 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7c4010d20 con 0x7fb7d80fe0e0 2024-02-28T16:11:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.756+0000 7fb7ce000700 1 -- 172.21.15.57:0/4087774203 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7c40113a0 con 0x7fb7d80fe0e0 2024-02-28T16:11:46.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.756+0000 7fb7dca00700 1 -- 172.21.15.57:0/4087774203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d8111510 con 0x7fb7d80fe0e0 2024-02-28T16:11:46.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.756+0000 7fb7dca00700 1 -- 172.21.15.57:0/4087774203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d8111a50 con 0x7fb7d80fe0e0 2024-02-28T16:11:46.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.758+0000 7fb7dca00700 1 -- 172.21.15.57:0/4087774203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d8102210 con 0x7fb7d80fe0e0 2024-02-28T16:11:46.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.759+0000 7fb7ce000700 1 -- 172.21.15.57:0/4087774203 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb7c4012400 con 0x7fb7d80fe0e0 2024-02-28T16:11:46.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.759+0000 7fb7ce000700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb7bc06d8a0 0x7fb7bc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:46.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.760+0000 7fb7ce000700 1 -- 172.21.15.57:0/4087774203 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fb7c408cf60 con 0x7fb7d80fe0e0 2024-02-28T16:11:46.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.760+0000 7fb7d5e00700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb7bc06d8a0 0x7fb7bc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:46.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.761+0000 7fb7d5e00700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb7bc06d8a0 0x7fb7bc06fd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8110b50 tx=0x7fb7c8004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:46.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:46.765+0000 7fb7ce000700 1 -- 172.21.15.57:0/4087774203 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb7c40566b0 con 0x7fb7d80fe0e0 2024-02-28T16:11:47.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.068+0000 7fb7dca00700 1 -- 172.21.15.57:0/4087774203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb7d8111d20 con 0x7fb7d80fe0e0 2024-02-28T16:11:47.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.069+0000 7fb7ce000700 1 -- 172.21.15.57:0/4087774203 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fb7c4059d70 con 0x7fb7d80fe0e0 2024-02-28T16:11:47.061 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2, 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:11:47.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:11:47.063 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:11:47.063 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2, 2024-02-28T16:11:47.063 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 12 2024-02-28T16:11:47.063 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:11:47.063 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:11:47.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 -- 172.21.15.57:0/4087774203 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb7bc06d8a0 msgr2=0x7fb7bc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb7bc06d8a0 0x7fb7bc06fd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8110b50 tx=0x7fb7c8004d10 comp rx=0 tx=0).stop 2024-02-28T16:11:47.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 -- 172.21.15.57:0/4087774203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7d80fe0e0 msgr2=0x7fb7d81102d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7d80fe0e0 0x7fb7d81102d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400c830 tx=0x7fb7c4004470 comp rx=0 tx=0).stop 2024-02-28T16:11:47.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 -- 172.21.15.57:0/4087774203 shutdown_connections 2024-02-28T16:11:47.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb7bc06d8a0 0x7fb7bc06fd50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d80fcef0 0x7fb7d810fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 --2- 172.21.15.57:0/4087774203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7d80fe0e0 0x7fb7d81102d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 -- 172.21.15.57:0/4087774203 >> 172.21.15.57:0/4087774203 conn(0x7fb7d80f8620 msgr2=0x7fb7d80ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:47.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 -- 172.21.15.57:0/4087774203 shutdown_connections 2024-02-28T16:11:47.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.072+0000 7fb7dca00700 1 -- 172.21.15.57:0/4087774203 wait complete. 2024-02-28T16:11:47.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.221+0000 7f3888c00700 1 -- 172.21.15.57:0/3600741900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3884071f10 msgr2=0x7f3884070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.221+0000 7f3888c00700 1 --2- 172.21.15.57:0/3600741900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3884071f10 0x7f3884070380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3874004940 tx=0x7f3874009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:47.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.221+0000 7f3888c00700 1 -- 172.21.15.57:0/3600741900 shutdown_connections 2024-02-28T16:11:47.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.221+0000 7f3888c00700 1 --2- 172.21.15.57:0/3600741900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840708c0 0x7f3884070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.221+0000 7f3888c00700 1 --2- 172.21.15.57:0/3600741900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3884071f10 0x7f3884070380 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.221+0000 7f3888c00700 1 -- 172.21.15.57:0/3600741900 >> 172.21.15.57:0/3600741900 conn(0x7f38840f83e0 msgr2=0x7f38840fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:47.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.221+0000 7f3888c00700 1 -- 172.21.15.57:0/3600741900 shutdown_connections 2024-02-28T16:11:47.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.221+0000 7f3888c00700 1 -- 172.21.15.57:0/3600741900 wait complete. 2024-02-28T16:11:47.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.222+0000 7f3888c00700 1 Processor -- start 2024-02-28T16:11:47.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.222+0000 7f3888c00700 1 -- start start 2024-02-28T16:11:47.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.223+0000 7f3888c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38840708c0 0x7f388410f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:47.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.223+0000 7f3888c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3884071f10 0x7f388410fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:47.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.223+0000 7f3888c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3884110490 con 0x7f38840708c0 2024-02-28T16:11:47.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.223+0000 7f3888c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3884110d30 con 0x7f3884071f10 2024-02-28T16:11:47.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.223+0000 7f3883400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38840708c0 0x7f388410f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:47.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.223+0000 7f3883400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38840708c0 0x7f388410f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41692/0 (socket says 172.21.15.57:41692) 2024-02-28T16:11:47.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.223+0000 7f3883400700 1 -- 172.21.15.57:0/3153010289 learned_addr learned my addr 172.21.15.57:0/3153010289 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:47.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.223+0000 7f3883400700 1 -- 172.21.15.57:0/3153010289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3884071f10 msgr2=0x7f388410fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.223+0000 7f3883400700 1 --2- 172.21.15.57:0/3153010289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3884071f10 0x7f388410fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.223+0000 7f3883400700 1 -- 172.21.15.57:0/3153010289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3874005040 con 0x7f38840708c0 2024-02-28T16:11:47.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.224+0000 7f3883400700 1 --2- 172.21.15.57:0/3153010289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38840708c0 0x7f388410f950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3874009380 tx=0x7f3874009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:47.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.224+0000 7f387b400700 1 -- 172.21.15.57:0/3153010289 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f387400e040 con 0x7f38840708c0 2024-02-28T16:11:47.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.224+0000 7f387b400700 1 -- 172.21.15.57:0/3153010289 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f387400bc60 con 0x7f38840708c0 2024-02-28T16:11:47.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.224+0000 7f387b400700 1 -- 172.21.15.57:0/3153010289 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f387401c630 con 0x7f38840708c0 2024-02-28T16:11:47.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.224+0000 7f3888c00700 1 -- 172.21.15.57:0/3153010289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3884110fb0 con 0x7f38840708c0 2024-02-28T16:11:47.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.224+0000 7f3888c00700 1 -- 172.21.15.57:0/3153010289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38841114f0 con 0x7f38840708c0 2024-02-28T16:11:47.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.225+0000 7f3888c00700 1 -- 172.21.15.57:0/3153010289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388404bed0 con 0x7f38840708c0 2024-02-28T16:11:47.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.227+0000 7f387b400700 1 -- 172.21.15.57:0/3153010289 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f38740139f0 con 0x7f38840708c0 2024-02-28T16:11:47.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.227+0000 7f387b400700 1 --2- 172.21.15.57:0/3153010289 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f386806d7f0 0x7f386806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:47.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.228+0000 7f387b400700 1 -- 172.21.15.57:0/3153010289 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f387408e400 con 0x7f38840708c0 2024-02-28T16:11:47.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.228+0000 7f387be00700 1 --2- 172.21.15.57:0/3153010289 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f386806d7f0 0x7f386806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:47.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.228+0000 7f387be00700 1 --2- 172.21.15.57:0/3153010289 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f386806d7f0 0x7f386806fca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f386c004d00 tx=0x7f386c009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:47.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.232+0000 7f387b400700 1 -- 172.21.15.57:0/3153010289 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f387405b680 con 0x7f38840708c0 2024-02-28T16:11:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.516+0000 7f3888c00700 1 -- 172.21.15.57:0/3153010289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3884111140 con 0x7f38840708c0 2024-02-28T16:11:47.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.517+0000 7f387b400700 1 -- 172.21.15.57:0/3153010289 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) v1 ==== 76+0+1867 (secure 0 0 0) 0x7f3884111140 con 0x7f38840708c0 2024-02-28T16:11:47.510 INFO:teuthology.orchestra.run.smithi057.stdout:e34 2024-02-28T16:11:47.510 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 33 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:11:29.712983+0000 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:11:47.511 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 101 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 1 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:in 0 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=34490} 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 1 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:11:47.512 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:11:47.513 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:11:47.513 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:11:47.513 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:34490} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:11:47.513 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:11:47.513 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:11:47.513 INFO:teuthology.orchestra.run.smithi057.stdout:Standby daemons: 2024-02-28T16:11:47.513 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:11:47.513 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{-1:34522} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.57:6828/2553742021,v1:172.21.15.57:6829/2553742021] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:11:47.513 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/3768145606,v1:172.21.15.87:6827/3768145606] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:11:47.513 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.87:6824/456812589,v1:172.21.15.87:6825/456812589] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:11:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.520+0000 7f3888c00700 1 -- 172.21.15.57:0/3153010289 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f386806d7f0 msgr2=0x7f386806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.520+0000 7f3888c00700 1 --2- 172.21.15.57:0/3153010289 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f386806d7f0 0x7f386806fca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f386c004d00 tx=0x7f386c009ce0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.520+0000 7f3888c00700 1 -- 172.21.15.57:0/3153010289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38840708c0 msgr2=0x7f388410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.520+0000 7f3888c00700 1 --2- 172.21.15.57:0/3153010289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38840708c0 0x7f388410f950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3874009380 tx=0x7f3874009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.520+0000 7f3888c00700 1 -- 172.21.15.57:0/3153010289 shutdown_connections 2024-02-28T16:11:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.520+0000 7f3888c00700 1 --2- 172.21.15.57:0/3153010289 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f386806d7f0 0x7f386806fca0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.520+0000 7f3888c00700 1 --2- 172.21.15.57:0/3153010289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38840708c0 0x7f388410f950 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.520+0000 7f3888c00700 1 --2- 172.21.15.57:0/3153010289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3884071f10 0x7f388410fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.520+0000 7f3888c00700 1 -- 172.21.15.57:0/3153010289 >> 172.21.15.57:0/3153010289 conn(0x7f38840f83e0 msgr2=0x7f3884102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.521+0000 7f3888c00700 1 -- 172.21.15.57:0/3153010289 shutdown_connections 2024-02-28T16:11:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.521+0000 7f3888c00700 1 -- 172.21.15.57:0/3153010289 wait complete. 2024-02-28T16:11:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 34 2024-02-28T16:11:47.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.673+0000 7fb664000700 1 -- 172.21.15.57:0/4268633012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb65c0fcef0 msgr2=0x7fb65c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.673+0000 7fb664000700 1 --2- 172.21.15.57:0/4268633012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb65c0fcef0 0x7fb65c0fd320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb650004940 tx=0x7fb650009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.673+0000 7fb664000700 1 -- 172.21.15.57:0/4268633012 shutdown_connections 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.673+0000 7fb664000700 1 --2- 172.21.15.57:0/4268633012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c0fe0e0 0x7fb65c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.673+0000 7fb664000700 1 --2- 172.21.15.57:0/4268633012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb65c0fcef0 0x7fb65c0fd320 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.673+0000 7fb664000700 1 -- 172.21.15.57:0/4268633012 >> 172.21.15.57:0/4268633012 conn(0x7fb65c0f8620 msgr2=0x7fb65c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.673+0000 7fb664000700 1 -- 172.21.15.57:0/4268633012 shutdown_connections 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.673+0000 7fb664000700 1 -- 172.21.15.57:0/4268633012 wait complete. 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.674+0000 7fb664000700 1 Processor -- start 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.674+0000 7fb664000700 1 -- start start 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.674+0000 7fb664000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb65c0fcef0 0x7fb65c10fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.674+0000 7fb664000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c0fe0e0 0x7fb65c1100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.675+0000 7fb664000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c1106c0 con 0x7fb65c0fcef0 2024-02-28T16:11:47.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.675+0000 7fb664000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c110f60 con 0x7fb65c0fe0e0 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.675+0000 7fb661600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb65c0fcef0 0x7fb65c10fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.675+0000 7fb661600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb65c0fcef0 0x7fb65c10fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41712/0 (socket says 172.21.15.57:41712) 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.675+0000 7fb661600700 1 -- 172.21.15.57:0/2737891296 learned_addr learned my addr 172.21.15.57:0/2737891296 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.675+0000 7fb660c00700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c0fe0e0 0x7fb65c1100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.675+0000 7fb661600700 1 -- 172.21.15.57:0/2737891296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c0fe0e0 msgr2=0x7fb65c1100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.675+0000 7fb661600700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c0fe0e0 0x7fb65c1100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.675+0000 7fb661600700 1 -- 172.21.15.57:0/2737891296 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650005040 con 0x7fb65c0fcef0 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.676+0000 7fb661600700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb65c0fcef0 0x7fb65c10fb80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb650000c00 tx=0x7fb650009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.676+0000 7fb659600700 1 -- 172.21.15.57:0/2737891296 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb65000e040 con 0x7fb65c0fcef0 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.676+0000 7fb659600700 1 -- 172.21.15.57:0/2737891296 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb65000bcc0 con 0x7fb65c0fcef0 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.676+0000 7fb659600700 1 -- 172.21.15.57:0/2737891296 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb650013ea0 con 0x7fb65c0fcef0 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.676+0000 7fb664000700 1 -- 172.21.15.57:0/2737891296 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65c1111e0 con 0x7fb65c0fcef0 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.676+0000 7fb664000700 1 -- 172.21.15.57:0/2737891296 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65c111720 con 0x7fb65c0fcef0 2024-02-28T16:11:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.677+0000 7fb664000700 1 -- 172.21.15.57:0/2737891296 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65c102210 con 0x7fb65c0fcef0 2024-02-28T16:11:47.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.678+0000 7fb659600700 1 -- 172.21.15.57:0/2737891296 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb650013420 con 0x7fb65c0fcef0 2024-02-28T16:11:47.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.679+0000 7fb659600700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb64406d7f0 0x7fb64406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:47.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.679+0000 7fb659600700 1 -- 172.21.15.57:0/2737891296 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fb65008e360 con 0x7fb65c0fcef0 2024-02-28T16:11:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.679+0000 7fb660c00700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb64406d7f0 0x7fb64406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.680+0000 7fb660c00700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb64406d7f0 0x7fb64406fca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb64c004d60 tx=0x7fb64c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:47.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.684+0000 7fb659600700 1 -- 172.21.15.57:0/2737891296 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb65005b560 con 0x7fb65c0fcef0 2024-02-28T16:11:47.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:47 smithi057 ceph-mon[93219]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:47.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:47 smithi057 ceph-mon[93219]: pgmap v271: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-28T16:11:47.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:47 smithi057 ceph-mon[93219]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:47.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:47 smithi057 ceph-mon[93219]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:47.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:47 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/4087774203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:47.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:47 smithi087 ceph-mon[82628]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:47.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:47 smithi087 ceph-mon[82628]: pgmap v271: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-28T16:11:47.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:47 smithi087 ceph-mon[82628]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:47.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:47 smithi087 ceph-mon[82628]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:47.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:47 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/4087774203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:47.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.934+0000 7fb664000700 1 -- 172.21.15.57:0/2737891296 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb65c111a50 con 0x7fb64406d7f0 2024-02-28T16:11:47.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.935+0000 7fb659600700 1 -- 172.21.15.57:0/2737891296 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb65c111a50 con 0x7fb64406d7f0 2024-02-28T16:11:47.928 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:11:47.928 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:11:47.928 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:11:47.928 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:11:47.928 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:11:47.928 INFO:teuthology.orchestra.run.smithi057.stdout: "osd", 2024-02-28T16:11:47.929 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:11:47.929 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:11:47.929 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:11:47.929 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:11:47.929 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "14/21 daemons upgraded", 2024-02-28T16:11:47.929 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T16:11:47.929 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:11:47.929 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:11:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 -- 172.21.15.57:0/2737891296 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb64406d7f0 msgr2=0x7fb64406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb64406d7f0 0x7fb64406fca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb64c004d60 tx=0x7fb64c00b040 comp rx=0 tx=0).stop 2024-02-28T16:11:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 -- 172.21.15.57:0/2737891296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb65c0fcef0 msgr2=0x7fb65c10fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb65c0fcef0 0x7fb65c10fb80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb650000c00 tx=0x7fb650009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 -- 172.21.15.57:0/2737891296 shutdown_connections 2024-02-28T16:11:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb64406d7f0 0x7fb64406fca0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb65c0fcef0 0x7fb65c10fb80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 --2- 172.21.15.57:0/2737891296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c0fe0e0 0x7fb65c1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:47.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 -- 172.21.15.57:0/2737891296 >> 172.21.15.57:0/2737891296 conn(0x7fb65c0f8620 msgr2=0x7fb65c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:47.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 -- 172.21.15.57:0/2737891296 shutdown_connections 2024-02-28T16:11:47.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:47.939+0000 7fb664000700 1 -- 172.21.15.57:0/2737891296 wait complete. 2024-02-28T16:11:48.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.092+0000 7f5841800700 1 -- 172.21.15.57:0/2749476257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583c104750 msgr2=0x7f583c104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:48.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.092+0000 7f5841800700 1 --2- 172.21.15.57:0/2749476257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583c104750 0x7f583c104ba0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5828004940 tx=0x7f5828009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:48.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.093+0000 7f5841800700 1 -- 172.21.15.57:0/2749476257 shutdown_connections 2024-02-28T16:11:48.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.093+0000 7f5841800700 1 --2- 172.21.15.57:0/2749476257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583c104750 0x7f583c104ba0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.093+0000 7f5841800700 1 --2- 172.21.15.57:0/2749476257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f583c103540 0x7f583c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.093+0000 7f5841800700 1 -- 172.21.15.57:0/2749476257 >> 172.21.15.57:0/2749476257 conn(0x7f583c0727d0 msgr2=0x7f583c074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:48.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.093+0000 7f5841800700 1 -- 172.21.15.57:0/2749476257 shutdown_connections 2024-02-28T16:11:48.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.093+0000 7f5841800700 1 -- 172.21.15.57:0/2749476257 wait complete. 2024-02-28T16:11:48.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.094+0000 7f5841800700 1 Processor -- start 2024-02-28T16:11:48.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.094+0000 7f5841800700 1 -- start start 2024-02-28T16:11:48.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.094+0000 7f5841800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f583c103540 0x7f583c113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:48.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.094+0000 7f5841800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583c104750 0x7f583c1144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:48.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.094+0000 7f5841800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c114aa0 con 0x7f583c104750 2024-02-28T16:11:48.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.094+0000 7f5841800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c115340 con 0x7f583c103540 2024-02-28T16:11:48.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.095+0000 7f583a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583c104750 0x7f583c1144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:48.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.095+0000 7f583a000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583c104750 0x7f583c1144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41724/0 (socket says 172.21.15.57:41724) 2024-02-28T16:11:48.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.095+0000 7f583a000700 1 -- 172.21.15.57:0/3182626093 learned_addr learned my addr 172.21.15.57:0/3182626093 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:11:48.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.095+0000 7f583aa00700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f583c103540 0x7f583c113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:48.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.095+0000 7f583a000700 1 -- 172.21.15.57:0/3182626093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f583c103540 msgr2=0x7f583c113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:48.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.095+0000 7f583a000700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f583c103540 0x7f583c113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.095+0000 7f583a000700 1 -- 172.21.15.57:0/3182626093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828005040 con 0x7f583c104750 2024-02-28T16:11:48.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.095+0000 7f583a000700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583c104750 0x7f583c1144a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f582800b3b0 tx=0x7f5828009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:48.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.096+0000 7f5832a00700 1 -- 172.21.15.57:0/3182626093 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582800e040 con 0x7f583c104750 2024-02-28T16:11:48.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.096+0000 7f5832a00700 1 -- 172.21.15.57:0/3182626093 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f582800bd90 con 0x7f583c104750 2024-02-28T16:11:48.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.096+0000 7f5841800700 1 -- 172.21.15.57:0/3182626093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c1155c0 con 0x7f583c104750 2024-02-28T16:11:48.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.096+0000 7f5832a00700 1 -- 172.21.15.57:0/3182626093 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582801c630 con 0x7f583c104750 2024-02-28T16:11:48.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.096+0000 7f5841800700 1 -- 172.21.15.57:0/3182626093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c115b00 con 0x7f583c104750 2024-02-28T16:11:48.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.097+0000 7f5841800700 1 -- 172.21.15.57:0/3182626093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c04bed0 con 0x7f583c104750 2024-02-28T16:11:48.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.098+0000 7f5832a00700 1 -- 172.21.15.57:0/3182626093 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f5828013980 con 0x7f583c104750 2024-02-28T16:11:48.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.099+0000 7f5832a00700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f582006d7f0 0x7f582006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:11:48.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.099+0000 7f5832a00700 1 -- 172.21.15.57:0/3182626093 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f582808e440 con 0x7f583c104750 2024-02-28T16:11:48.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.099+0000 7f583aa00700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f582006d7f0 0x7f582006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:11:48.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.100+0000 7f583aa00700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f582006d7f0 0x7f582006fca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f583c1045b0 tx=0x7f582c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:11:48.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.103+0000 7f5832a00700 1 -- 172.21.15.57:0/3182626093 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f582805b6c0 con 0x7f583c104750 2024-02-28T16:11:48.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.403+0000 7f5841800700 1 -- 172.21.15.57:0/3182626093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f583c10c020 con 0x7f583c104750 2024-02-28T16:11:48.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.404+0000 7f5832a00700 1 -- 172.21.15.57:0/3182626093 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f582805b250 con 0x7f583c104750 2024-02-28T16:11:48.396 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:11:48.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.406+0000 7f5841800700 1 -- 172.21.15.57:0/3182626093 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f582006d7f0 msgr2=0x7f582006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.406+0000 7f5841800700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f582006d7f0 0x7f582006fca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f583c1045b0 tx=0x7f582c009040 comp rx=0 tx=0).stop 2024-02-28T16:11:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.406+0000 7f5841800700 1 -- 172.21.15.57:0/3182626093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583c104750 msgr2=0x7f583c1144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:11:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.406+0000 7f5841800700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583c104750 0x7f583c1144a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f582800b3b0 tx=0x7f5828009e30 comp rx=0 tx=0).stop 2024-02-28T16:11:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.407+0000 7f5841800700 1 -- 172.21.15.57:0/3182626093 shutdown_connections 2024-02-28T16:11:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.407+0000 7f5841800700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f582006d7f0 0x7f582006fca0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.407+0000 7f5841800700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f583c103540 0x7f583c113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.407+0000 7f5841800700 1 --2- 172.21.15.57:0/3182626093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583c104750 0x7f583c1144a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:11:48.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.407+0000 7f5841800700 1 -- 172.21.15.57:0/3182626093 >> 172.21.15.57:0/3182626093 conn(0x7f583c0727d0 msgr2=0x7f583c107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:11:48.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.407+0000 7f5841800700 1 -- 172.21.15.57:0/3182626093 shutdown_connections 2024-02-28T16:11:48.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:11:48.407+0000 7f5841800700 1 -- 172.21.15.57:0/3182626093 wait complete. 2024-02-28T16:11:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3153010289' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:11:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:11:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:11:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:48.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:48.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:48.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi087.fzjgef"]}]: dispatch 2024-02-28T16:11:48.678 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:48 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3182626093' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:11:48.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3153010289' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:11:48.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:48.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:48.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:11:48.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:11:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:11:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:11:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi087.fzjgef"]}]: dispatch 2024-02-28T16:11:48.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:48 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3182626093' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:11:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:49 smithi057 ceph-mon[93219]: pgmap v272: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:49 smithi057 ceph-mon[93219]: Upgrade: It appears safe to stop mds.cephfs.smithi087.fzjgef 2024-02-28T16:11:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:49 smithi057 ceph-mon[93219]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:49.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:11:49.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:49 smithi087 ceph-mon[82628]: pgmap v272: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:49.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:49 smithi087 ceph-mon[82628]: Upgrade: It appears safe to stop mds.cephfs.smithi087.fzjgef 2024-02-28T16:11:49.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:49 smithi087 ceph-mon[82628]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:11:49.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:11:51.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:51 smithi087 ceph-mon[82628]: pgmap v273: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:51.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:51 smithi087 ceph-mon[82628]: Upgrade: Updating mds.cephfs.smithi087.fzjgef 2024-02-28T16:11:51.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:51.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.fzjgef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:11:51.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:11:51.528 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:51 smithi087 ceph-mon[82628]: Deploying daemon mds.cephfs.smithi087.fzjgef on smithi087 2024-02-28T16:11:51.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:51 smithi057 ceph-mon[93219]: pgmap v273: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:51.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:51 smithi057 ceph-mon[93219]: Upgrade: Updating mds.cephfs.smithi087.fzjgef 2024-02-28T16:11:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:11:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.fzjgef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:11:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:11:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:51 smithi057 ceph-mon[93219]: Deploying daemon mds.cephfs.smithi087.fzjgef on smithi087 2024-02-28T16:11:53.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:53 smithi087 ceph-mon[82628]: pgmap v274: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:53.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:53 smithi057 ceph-mon[93219]: pgmap v274: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:55.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:55 smithi057 ceph-mon[93219]: pgmap v275: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:55.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:55 smithi057 ceph-mon[93219]: osdmap e102: 6 total, 6 up, 6 in 2024-02-28T16:11:55.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:55 smithi057 ceph-mon[93219]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 2 up:standby 2024-02-28T16:11:55.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:55 smithi087 ceph-mon[82628]: pgmap v275: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:55.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:55 smithi087 ceph-mon[82628]: osdmap e102: 6 total, 6 up, 6 in 2024-02-28T16:11:55.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:55 smithi087 ceph-mon[82628]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 2 up:standby 2024-02-28T16:11:57.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:57 smithi087 ceph-mon[82628]: pgmap v277: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:57.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:57 smithi057 ceph-mon[93219]: pgmap v277: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:59.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:11:59 smithi057 ceph-mon[93219]: pgmap v278: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:11:59.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:11:59 smithi087 ceph-mon[82628]: pgmap v278: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:00.816 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:00.817 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:00.817 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:00.817 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:00 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.87:6824/571403132,v1:172.21.15.87:6825/571403132] up:boot 2024-02-28T16:12:00.817 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:00 smithi087 ceph-mon[82628]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 3 up:standby 2024-02-28T16:12:00.817 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:00 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:12:00.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:00.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:00.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:00.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:00 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.87:6824/571403132,v1:172.21.15.87:6825/571403132] up:boot 2024-02-28T16:12:00.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:00 smithi057 ceph-mon[93219]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 3 up:standby 2024-02-28T16:12:00.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:00 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:12:01.777 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:01 smithi087 ceph-mon[82628]: pgmap v279: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:01.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:01 smithi057 ceph-mon[93219]: pgmap v279: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:03.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:03 smithi057 ceph-mon[93219]: pgmap v280: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:03.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:03 smithi087 ceph-mon[82628]: pgmap v280: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:04.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:12:04.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:04.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:04.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:12:04.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:04.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:05.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:05 smithi057 ceph-mon[93219]: pgmap v281: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:05.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:05 smithi087 ceph-mon[82628]: pgmap v281: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:07.520 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:07 smithi087 ceph-mon[82628]: pgmap v282: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:07.521 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:07.521 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:07.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:07 smithi057 ceph-mon[93219]: pgmap v282: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:07.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:07.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:09.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:09 smithi087 ceph-mon[82628]: pgmap v283: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:09.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:09 smithi057 ceph-mon[93219]: pgmap v283: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:11.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:11 smithi087 ceph-mon[82628]: pgmap v284: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:11.559 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:11 smithi057 ceph-mon[93219]: pgmap v284: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:13.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: pgmap v285: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:13.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: Detected new or changed devices on smithi087 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi087.whebmo"]}]: dispatch 2024-02-28T16:12:13.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:13 smithi057 ceph-mon[93219]: Upgrade: It appears safe to stop mds.cephfs.smithi087.whebmo 2024-02-28T16:12:13.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: pgmap v285: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:13.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: Detected new or changed devices on smithi087 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi087.whebmo"]}]: dispatch 2024-02-28T16:12:13.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:13 smithi087 ceph-mon[82628]: Upgrade: It appears safe to stop mds.cephfs.smithi087.whebmo 2024-02-28T16:12:15.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:15 smithi057 ceph-mon[93219]: pgmap v286: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:15.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:15 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:15.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:15 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.whebmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:12:15.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:15 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:12:15.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:15 smithi087 ceph-mon[82628]: pgmap v286: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:15.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:15 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:15.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:15 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.whebmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:12:15.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:15 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:12:16.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:16 smithi057 ceph-mon[93219]: Upgrade: Updating mds.cephfs.smithi087.whebmo 2024-02-28T16:12:16.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:16 smithi057 ceph-mon[93219]: Deploying daemon mds.cephfs.smithi087.whebmo on smithi087 2024-02-28T16:12:16.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:16 smithi087 ceph-mon[82628]: Upgrade: Updating mds.cephfs.smithi087.whebmo 2024-02-28T16:12:16.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:16 smithi087 ceph-mon[82628]: Deploying daemon mds.cephfs.smithi087.whebmo on smithi087 2024-02-28T16:12:17.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:17 smithi087 ceph-mon[82628]: pgmap v287: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:17.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:17 smithi057 ceph-mon[93219]: pgmap v287: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:18.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.579+0000 7f2133200700 1 -- 172.21.15.57:0/428552806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f212c066c70 msgr2=0x7f212c0ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:18.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.579+0000 7f2133200700 1 --2- 172.21.15.57:0/428552806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f212c066c70 0x7f212c0ffaf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f211c009ce0 tx=0x7f211c004d10 comp rx=0 tx=0).stop 2024-02-28T16:12:18.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.579+0000 7f2133200700 1 -- 172.21.15.57:0/428552806 shutdown_connections 2024-02-28T16:12:18.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.579+0000 7f2133200700 1 --2- 172.21.15.57:0/428552806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f212c1000c0 0x7f212c102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:18.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.579+0000 7f2133200700 1 --2- 172.21.15.57:0/428552806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f212c066c70 0x7f212c0ffaf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:18.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.579+0000 7f2133200700 1 -- 172.21.15.57:0/428552806 >> 172.21.15.57:0/428552806 conn(0x7f212c0f7500 msgr2=0x7f212c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:18.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.579+0000 7f2133200700 1 -- 172.21.15.57:0/428552806 shutdown_connections 2024-02-28T16:12:18.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.579+0000 7f2133200700 1 -- 172.21.15.57:0/428552806 wait complete. 2024-02-28T16:12:18.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.580+0000 7f2133200700 1 Processor -- start 2024-02-28T16:12:18.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.580+0000 7f2133200700 1 -- start start 2024-02-28T16:12:18.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.580+0000 7f2133200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f212c066c70 0x7f212c10dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:18.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.580+0000 7f2133200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f212c1000c0 0x7f212c10e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:18.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.580+0000 7f2133200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c10e620 con 0x7f212c1000c0 2024-02-28T16:12:18.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.580+0000 7f2133200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c10eec0 con 0x7f212c066c70 2024-02-28T16:12:18.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.581+0000 7f212b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f212c1000c0 0x7f212c10e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:18.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.581+0000 7f212b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f212c1000c0 0x7f212c10e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56610/0 (socket says 172.21.15.57:56610) 2024-02-28T16:12:18.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.581+0000 7f212b400700 1 -- 172.21.15.57:0/1014296955 learned_addr learned my addr 172.21.15.57:0/1014296955 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:18.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.581+0000 7f212be00700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f212c066c70 0x7f212c10dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:18.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.581+0000 7f212b400700 1 -- 172.21.15.57:0/1014296955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f212c066c70 msgr2=0x7f212c10dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:18.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.581+0000 7f212b400700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f212c066c70 0x7f212c10dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:18.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.581+0000 7f212b400700 1 -- 172.21.15.57:0/1014296955 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c009940 con 0x7f212c1000c0 2024-02-28T16:12:18.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.581+0000 7f212be00700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f212c066c70 0x7f212c10dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:12:18.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.582+0000 7f212b400700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f212c1000c0 0x7f212c10e020 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2118002a50 tx=0x7f2118004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:18.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.582+0000 7f2123e00700 1 -- 172.21.15.57:0/1014296955 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2118007cc0 con 0x7f212c1000c0 2024-02-28T16:12:18.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.582+0000 7f2123e00700 1 -- 172.21.15.57:0/1014296955 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f211800f040 con 0x7f212c1000c0 2024-02-28T16:12:18.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.582+0000 7f2133200700 1 -- 172.21.15.57:0/1014296955 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c10f1a0 con 0x7f212c1000c0 2024-02-28T16:12:18.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.582+0000 7f2123e00700 1 -- 172.21.15.57:0/1014296955 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f211800daf0 con 0x7f212c1000c0 2024-02-28T16:12:18.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.582+0000 7f2133200700 1 -- 172.21.15.57:0/1014296955 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c10f6e0 con 0x7f212c1000c0 2024-02-28T16:12:18.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.583+0000 7f2133200700 1 -- 172.21.15.57:0/1014296955 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c107a70 con 0x7f212c1000c0 2024-02-28T16:12:18.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.585+0000 7f2123e00700 1 -- 172.21.15.57:0/1014296955 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2118009810 con 0x7f212c1000c0 2024-02-28T16:12:18.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.586+0000 7f2123e00700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f211006d7e0 0x7f211006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:18.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.586+0000 7f2123e00700 1 -- 172.21.15.57:0/1014296955 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f211808ce50 con 0x7f212c1000c0 2024-02-28T16:12:18.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.586+0000 7f212be00700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f211006d7e0 0x7f211006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:18.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.587+0000 7f212be00700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f211006d7e0 0x7f211006fc90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f211c00b740 tx=0x7f211c004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:18.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.591+0000 7f2123e00700 1 -- 172.21.15.57:0/1014296955 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2118059fd0 con 0x7f212c1000c0 2024-02-28T16:12:18.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:18.841+0000 7f2133200700 1 -- 172.21.15.57:0/1014296955 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f212c10f970 con 0x7f211006d7e0 2024-02-28T16:12:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.189+0000 7f2123e00700 1 -- 172.21.15.57:0/1014296955 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f212c10f970 con 0x7f211006d7e0 2024-02-28T16:12:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.193+0000 7f2133200700 1 -- 172.21.15.57:0/1014296955 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f211006d7e0 msgr2=0x7f211006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.193+0000 7f2133200700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f211006d7e0 0x7f211006fc90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f211c00b740 tx=0x7f211c004d10 comp rx=0 tx=0).stop 2024-02-28T16:12:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.193+0000 7f2133200700 1 -- 172.21.15.57:0/1014296955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f212c1000c0 msgr2=0x7f212c10e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.193+0000 7f2133200700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f212c1000c0 0x7f212c10e020 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2118002a50 tx=0x7f2118004600 comp rx=0 tx=0).stop 2024-02-28T16:12:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.193+0000 7f2133200700 1 -- 172.21.15.57:0/1014296955 shutdown_connections 2024-02-28T16:12:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.193+0000 7f2133200700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f211006d7e0 0x7f211006fc90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.193+0000 7f2133200700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f212c066c70 0x7f212c10dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.193+0000 7f2133200700 1 --2- 172.21.15.57:0/1014296955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f212c1000c0 0x7f212c10e020 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.193+0000 7f2133200700 1 -- 172.21.15.57:0/1014296955 >> 172.21.15.57:0/1014296955 conn(0x7f212c0f7500 msgr2=0x7f212c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.194+0000 7f2133200700 1 -- 172.21.15.57:0/1014296955 shutdown_connections 2024-02-28T16:12:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.194+0000 7f2133200700 1 -- 172.21.15.57:0/1014296955 wait complete. 2024-02-28T16:12:19.201 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:12:19.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.353+0000 7fa9b3a00700 1 -- 172.21.15.57:0/2613003671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ac073af0 msgr2=0x7fa9ac073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.353+0000 7fa9b3a00700 1 --2- 172.21.15.57:0/2613003671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ac073af0 0x7fa9ac073f60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa998004940 tx=0x7fa998009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.354+0000 7fa9b3a00700 1 -- 172.21.15.57:0/2613003671 shutdown_connections 2024-02-28T16:12:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.354+0000 7fa9b3a00700 1 --2- 172.21.15.57:0/2613003671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ac073af0 0x7fa9ac073f60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.354+0000 7fa9b3a00700 1 --2- 172.21.15.57:0/2613003671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9ac072890 0x7fa9ac072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.354+0000 7fa9b3a00700 1 -- 172.21.15.57:0/2613003671 >> 172.21.15.57:0/2613003671 conn(0x7fa9ac0fa920 msgr2=0x7fa9ac0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.354+0000 7fa9b3a00700 1 -- 172.21.15.57:0/2613003671 shutdown_connections 2024-02-28T16:12:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.354+0000 7fa9b3a00700 1 -- 172.21.15.57:0/2613003671 wait complete. 2024-02-28T16:12:19.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.355+0000 7fa9b3a00700 1 Processor -- start 2024-02-28T16:12:19.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.355+0000 7fa9b3a00700 1 -- start start 2024-02-28T16:12:19.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.355+0000 7fa9b3a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9ac072890 0x7fa9ac113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:19.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.355+0000 7fa9b3a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ac073af0 0x7fa9ac1144c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:19.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.355+0000 7fa9b3a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac114ac0 con 0x7fa9ac073af0 2024-02-28T16:12:19.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.355+0000 7fa9b3a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac115360 con 0x7fa9ac072890 2024-02-28T16:12:19.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.356+0000 7fa9abe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ac073af0 0x7fa9ac1144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:19.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.356+0000 7fa9abe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ac073af0 0x7fa9ac1144c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56634/0 (socket says 172.21.15.57:56634) 2024-02-28T16:12:19.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.356+0000 7fa9abe00700 1 -- 172.21.15.57:0/332898957 learned_addr learned my addr 172.21.15.57:0/332898957 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:19.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.356+0000 7fa9b1000700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9ac072890 0x7fa9ac113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:19.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.356+0000 7fa9abe00700 1 -- 172.21.15.57:0/332898957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9ac072890 msgr2=0x7fa9ac113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.356+0000 7fa9abe00700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9ac072890 0x7fa9ac113f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.356+0000 7fa9abe00700 1 -- 172.21.15.57:0/332898957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998005040 con 0x7fa9ac073af0 2024-02-28T16:12:19.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.356+0000 7fa9b1000700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9ac072890 0x7fa9ac113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:12:19.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.357+0000 7fa9abe00700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ac073af0 0x7fa9ac1144c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa998009fd0 tx=0x7fa998009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:19.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.357+0000 7fa9a8c00700 1 -- 172.21.15.57:0/332898957 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa99800e040 con 0x7fa9ac073af0 2024-02-28T16:12:19.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.357+0000 7fa9a8c00700 1 -- 172.21.15.57:0/332898957 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa99800bcc0 con 0x7fa9ac073af0 2024-02-28T16:12:19.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.357+0000 7fa9b3a00700 1 -- 172.21.15.57:0/332898957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ac1155e0 con 0x7fa9ac073af0 2024-02-28T16:12:19.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.357+0000 7fa9a8c00700 1 -- 172.21.15.57:0/332898957 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa99801c630 con 0x7fa9ac073af0 2024-02-28T16:12:19.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.357+0000 7fa9b3a00700 1 -- 172.21.15.57:0/332898957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ac115b20 con 0x7fa9ac073af0 2024-02-28T16:12:19.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.358+0000 7fa9b3a00700 1 -- 172.21.15.57:0/332898957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ac04bed0 con 0x7fa9ac073af0 2024-02-28T16:12:19.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.359+0000 7fa9a8c00700 1 -- 172.21.15.57:0/332898957 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa998013980 con 0x7fa9ac073af0 2024-02-28T16:12:19.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.361+0000 7fa9a8c00700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa99406d7f0 0x7fa99406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:19.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.361+0000 7fa9a8c00700 1 -- 172.21.15.57:0/332898957 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fa99808e480 con 0x7fa9ac073af0 2024-02-28T16:12:19.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.361+0000 7fa9b1000700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa99406d7f0 0x7fa99406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:19.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.362+0000 7fa9b1000700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa99406d7f0 0x7fa99406fca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0007fd0 tx=0x7fa9a0009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:19.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.365+0000 7fa9a8c00700 1 -- 172.21.15.57:0/332898957 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa99805b700 con 0x7fa9ac073af0 2024-02-28T16:12:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:19 smithi057 ceph-mon[93219]: pgmap v288: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:19 smithi057 ceph-mon[93219]: osdmap e103: 6 total, 6 up, 6 in 2024-02-28T16:12:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:19 smithi057 ceph-mon[93219]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 2 up:standby 2024-02-28T16:12:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:12:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:19 smithi087 ceph-mon[82628]: pgmap v288: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:19 smithi087 ceph-mon[82628]: osdmap e103: 6 total, 6 up, 6 in 2024-02-28T16:12:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:19 smithi087 ceph-mon[82628]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 2 up:standby 2024-02-28T16:12:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:12:19.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.612+0000 7fa9b3a00700 1 -- 172.21.15.57:0/332898957 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9ac116050 con 0x7fa99406d7f0 2024-02-28T16:12:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.615+0000 7fa9a8c00700 1 -- 172.21.15.57:0/332898957 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa9ac116050 con 0x7fa99406d7f0 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.618+0000 7fa9b3a00700 1 -- 172.21.15.57:0/332898957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa99406d7f0 msgr2=0x7fa99406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.618+0000 7fa9b3a00700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa99406d7f0 0x7fa99406fca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0007fd0 tx=0x7fa9a0009040 comp rx=0 tx=0).stop 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.618+0000 7fa9b3a00700 1 -- 172.21.15.57:0/332898957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ac073af0 msgr2=0x7fa9ac1144c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.618+0000 7fa9b3a00700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ac073af0 0x7fa9ac1144c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa998009fd0 tx=0x7fa998009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.618+0000 7fa9b3a00700 1 -- 172.21.15.57:0/332898957 shutdown_connections 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.618+0000 7fa9b3a00700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa99406d7f0 0x7fa99406fca0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.618+0000 7fa9b3a00700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9ac072890 0x7fa9ac113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.618+0000 7fa9b3a00700 1 --2- 172.21.15.57:0/332898957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ac073af0 0x7fa9ac1144c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.618+0000 7fa9b3a00700 1 -- 172.21.15.57:0/332898957 >> 172.21.15.57:0/332898957 conn(0x7fa9ac0fa920 msgr2=0x7fa9ac109460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.619+0000 7fa9b3a00700 1 -- 172.21.15.57:0/332898957 shutdown_connections 2024-02-28T16:12:19.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.619+0000 7fa9b3a00700 1 -- 172.21.15.57:0/332898957 wait complete. 2024-02-28T16:12:19.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.778+0000 7f73b5600700 1 -- 172.21.15.57:0/3987172136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00fe0e0 msgr2=0x7f73b00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.778+0000 7f73b5600700 1 --2- 172.21.15.57:0/3987172136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00fe0e0 0x7f73b00fe550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f739c004940 tx=0x7f739c009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.778+0000 7f73b5600700 1 -- 172.21.15.57:0/3987172136 shutdown_connections 2024-02-28T16:12:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.778+0000 7f73b5600700 1 --2- 172.21.15.57:0/3987172136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00fe0e0 0x7f73b00fe550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.778+0000 7f73b5600700 1 --2- 172.21.15.57:0/3987172136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73b00fcef0 0x7f73b00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.778+0000 7f73b5600700 1 -- 172.21.15.57:0/3987172136 >> 172.21.15.57:0/3987172136 conn(0x7f73b00f8620 msgr2=0x7f73b00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.778+0000 7f73b5600700 1 -- 172.21.15.57:0/3987172136 shutdown_connections 2024-02-28T16:12:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.778+0000 7f73b5600700 1 -- 172.21.15.57:0/3987172136 wait complete. 2024-02-28T16:12:19.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.779+0000 7f73b5600700 1 Processor -- start 2024-02-28T16:12:19.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.779+0000 7f73b5600700 1 -- start start 2024-02-28T16:12:19.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73b5600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00fcef0 0x7f73b010fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:19.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73b5600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73b00fe0e0 0x7f73b01100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:19.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73b5600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0110740 con 0x7f73b00fcef0 2024-02-28T16:12:19.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73b5600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0110f80 con 0x7f73b00fe0e0 2024-02-28T16:12:19.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73aea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00fcef0 0x7f73b010fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:19.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73aea00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00fcef0 0x7f73b010fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56664/0 (socket says 172.21.15.57:56664) 2024-02-28T16:12:19.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73aea00700 1 -- 172.21.15.57:0/911598789 learned_addr learned my addr 172.21.15.57:0/911598789 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:19.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73ae000700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73b00fe0e0 0x7f73b01100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:19.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73aea00700 1 -- 172.21.15.57:0/911598789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73b00fe0e0 msgr2=0x7f73b01100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:19.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73aea00700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73b00fe0e0 0x7f73b01100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:19.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.780+0000 7f73aea00700 1 -- 172.21.15.57:0/911598789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c005040 con 0x7f73b00fcef0 2024-02-28T16:12:19.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.781+0000 7f73aea00700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00fcef0 0x7f73b010fb70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f73a000bae0 tx=0x7f73a0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:19.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.781+0000 7f73a6a00700 1 -- 172.21.15.57:0/911598789 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a000c8c0 con 0x7f73b00fcef0 2024-02-28T16:12:19.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.781+0000 7f73a6a00700 1 -- 172.21.15.57:0/911598789 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73a0014410 con 0x7f73b00fcef0 2024-02-28T16:12:19.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.781+0000 7f73a6a00700 1 -- 172.21.15.57:0/911598789 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a0007610 con 0x7f73b00fcef0 2024-02-28T16:12:19.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.781+0000 7f73b5600700 1 -- 172.21.15.57:0/911598789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b0111260 con 0x7f73b00fcef0 2024-02-28T16:12:19.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.781+0000 7f73b5600700 1 -- 172.21.15.57:0/911598789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b0111750 con 0x7f73b00fcef0 2024-02-28T16:12:19.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.782+0000 7f73b5600700 1 -- 172.21.15.57:0/911598789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b0102210 con 0x7f73b00fcef0 2024-02-28T16:12:19.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.784+0000 7f73a6a00700 1 -- 172.21.15.57:0/911598789 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f73a0014580 con 0x7f73b00fcef0 2024-02-28T16:12:19.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.784+0000 7f73a6a00700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f739406d7f0 0x7f739406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:19.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.785+0000 7f73a6a00700 1 -- 172.21.15.57:0/911598789 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f73a008d130 con 0x7f73b00fcef0 2024-02-28T16:12:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.785+0000 7f73ae000700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f739406d7f0 0x7f739406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.786+0000 7f73ae000700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f739406d7f0 0x7f739406fca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f739c00b840 tx=0x7f739c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:19.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:19.789+0000 7f73a6a00700 1 -- 172.21.15.57:0/911598789 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f73a005a330 con 0x7f73b00fcef0 2024-02-28T16:12:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.028+0000 7f73b5600700 1 -- 172.21.15.57:0/911598789 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f73b0111b30 con 0x7f739406d7f0 2024-02-28T16:12:20.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.044+0000 7f73a6a00700 1 -- 172.21.15.57:0/911598789 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f73b0111b30 con 0x7f739406d7f0 2024-02-28T16:12:20.035 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (10m) 39s ago 21m 15.1M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (6m) 39s ago 21m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (6m) 15s ago 20m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (9m) 39s ago 21m 76.1M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (83s) 39s ago 14m 66.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b df14dcf6973e 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (46s) 39s ago 14m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 977aa1867016 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (21s) 15s ago 14m 9911k - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1ee4a125f5b 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (13m) 15s ago 13m 10.9M - 17.2.7-535-gc0f02e60 1c37ed371348 b794b9e874cb 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (9m) 39s ago 23m 510M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (8m) 15s ago 19m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (7m) 39s ago 23m 56.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (7m) 15s ago 19m 44.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:12:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (10m) 39s ago 21m 8066k - 1.5.0 0da6a335fe13 1877fab2cf12 2024-02-28T16:12:20.037 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (9m) 15s ago 20m 8224k - 1.5.0 0da6a335fe13 c04a4c9f89df 2024-02-28T16:12:20.037 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (5m) 39s ago 18m 134M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:12:20.037 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (4m) 39s ago 18m 105M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:12:20.037 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (4m) 39s ago 17m 98.0M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:12:20.037 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (3m) 15s ago 17m 106M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:12:20.037 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (2m) 15s ago 16m 92.9M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:12:20.037 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (2m) 15s ago 15m 93.5M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b cbdb6df47634 2024-02-28T16:12:20.037 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (8m) 39s ago 20m 55.4M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:12:20.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 -- 172.21.15.57:0/911598789 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f739406d7f0 msgr2=0x7f739406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f739406d7f0 0x7f739406fca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f739c00b840 tx=0x7f739c009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:20.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 -- 172.21.15.57:0/911598789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00fcef0 msgr2=0x7f73b010fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00fcef0 0x7f73b010fb70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f73a000bae0 tx=0x7f73a0009810 comp rx=0 tx=0).stop 2024-02-28T16:12:20.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 -- 172.21.15.57:0/911598789 shutdown_connections 2024-02-28T16:12:20.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f739406d7f0 0x7f739406fca0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00fcef0 0x7f73b010fb70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 --2- 172.21.15.57:0/911598789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73b00fe0e0 0x7f73b01100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 -- 172.21.15.57:0/911598789 >> 172.21.15.57:0/911598789 conn(0x7f73b00f8620 msgr2=0x7f73b00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:20.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 -- 172.21.15.57:0/911598789 shutdown_connections 2024-02-28T16:12:20.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.048+0000 7f73b5600700 1 -- 172.21.15.57:0/911598789 wait complete. 2024-02-28T16:12:20.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.203+0000 7f045a400700 1 -- 172.21.15.57:0/3214481837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0454103540 msgr2=0x7f0454103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.203+0000 7f045a400700 1 --2- 172.21.15.57:0/3214481837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0454103540 0x7f0454103950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0444004940 tx=0x7f0444009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:20.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.204+0000 7f045a400700 1 -- 172.21.15.57:0/3214481837 shutdown_connections 2024-02-28T16:12:20.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.204+0000 7f045a400700 1 --2- 172.21.15.57:0/3214481837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0454104750 0x7f0454104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.204+0000 7f045a400700 1 --2- 172.21.15.57:0/3214481837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0454103540 0x7f0454103950 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.204+0000 7f045a400700 1 -- 172.21.15.57:0/3214481837 >> 172.21.15.57:0/3214481837 conn(0x7f04540727d0 msgr2=0x7f0454074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:20.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.204+0000 7f045a400700 1 -- 172.21.15.57:0/3214481837 shutdown_connections 2024-02-28T16:12:20.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.204+0000 7f045a400700 1 -- 172.21.15.57:0/3214481837 wait complete. 2024-02-28T16:12:20.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.205+0000 7f045a400700 1 Processor -- start 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.205+0000 7f045a400700 1 -- start start 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.205+0000 7f045a400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0454103540 0x7f0454113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.205+0000 7f045a400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0454104750 0x7f04541144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.205+0000 7f045a400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454114aa0 con 0x7f0454103540 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.205+0000 7f045a400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454115340 con 0x7f0454104750 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.205+0000 7f0453400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0454103540 0x7f0454113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.205+0000 7f0453400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0454103540 0x7f0454113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56684/0 (socket says 172.21.15.57:56684) 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.205+0000 7f0453400700 1 -- 172.21.15.57:0/4015045633 learned_addr learned my addr 172.21.15.57:0/4015045633 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.206+0000 7f0452a00700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0454104750 0x7f04541144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.206+0000 7f0453400700 1 -- 172.21.15.57:0/4015045633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0454104750 msgr2=0x7f04541144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.206+0000 7f0453400700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0454104750 0x7f04541144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.206+0000 7f0453400700 1 -- 172.21.15.57:0/4015045633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444005040 con 0x7f0454103540 2024-02-28T16:12:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.206+0000 7f0452a00700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0454104750 0x7f04541144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:12:20.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.206+0000 7f0453400700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0454103540 0x7f0454113f60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0444009360 tx=0x7f0444009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.206+0000 7f044b400700 1 -- 172.21.15.57:0/4015045633 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f044400e040 con 0x7f0454103540 2024-02-28T16:12:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.207+0000 7f044b400700 1 -- 172.21.15.57:0/4015045633 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0444004290 con 0x7f0454103540 2024-02-28T16:12:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.207+0000 7f045a400700 1 -- 172.21.15.57:0/4015045633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04541155c0 con 0x7f0454103540 2024-02-28T16:12:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.207+0000 7f044b400700 1 -- 172.21.15.57:0/4015045633 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f044401c630 con 0x7f0454103540 2024-02-28T16:12:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.207+0000 7f045a400700 1 -- 172.21.15.57:0/4015045633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0454115b00 con 0x7f0454103540 2024-02-28T16:12:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.208+0000 7f045a400700 1 -- 172.21.15.57:0/4015045633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045404bed0 con 0x7f0454103540 2024-02-28T16:12:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.209+0000 7f044b400700 1 -- 172.21.15.57:0/4015045633 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f044400bcc0 con 0x7f0454103540 2024-02-28T16:12:20.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.210+0000 7f044b400700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f043806d7f0 0x7f043806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:20.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.210+0000 7f044b400700 1 -- 172.21.15.57:0/4015045633 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f044408e4c0 con 0x7f0454103540 2024-02-28T16:12:20.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.210+0000 7f0452a00700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f043806d7f0 0x7f043806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:20.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.211+0000 7f0452a00700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f043806d7f0 0x7f043806fca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0440007fd0 tx=0x7f0440009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:20.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.214+0000 7f044b400700 1 -- 172.21.15.57:0/4015045633 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f044405b6c0 con 0x7f0454103540 2024-02-28T16:12:20.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:20 smithi057 ceph-mon[93219]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:20.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:20 smithi057 ceph-mon[93219]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:20.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:20 smithi087 ceph-mon[82628]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:20.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:20 smithi087 ceph-mon[82628]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:20.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.530+0000 7f045a400700 1 -- 172.21.15.57:0/4015045633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0454116170 con 0x7f0454103540 2024-02-28T16:12:20.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.532+0000 7f044b400700 1 -- 172.21.15.57:0/4015045633 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f044405b250 con 0x7f0454103540 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:12:20.523 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:12:20.524 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T16:12:20.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:12:20.524 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:12:20.524 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 13 2024-02-28T16:12:20.524 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:12:20.524 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.534+0000 7f045a400700 1 -- 172.21.15.57:0/4015045633 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f043806d7f0 msgr2=0x7f043806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.534+0000 7f045a400700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f043806d7f0 0x7f043806fca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0440007fd0 tx=0x7f0440009040 comp rx=0 tx=0).stop 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.534+0000 7f045a400700 1 -- 172.21.15.57:0/4015045633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0454103540 msgr2=0x7f0454113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.534+0000 7f045a400700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0454103540 0x7f0454113f60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0444009360 tx=0x7f0444009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.535+0000 7f045a400700 1 -- 172.21.15.57:0/4015045633 shutdown_connections 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.535+0000 7f045a400700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f043806d7f0 0x7f043806fca0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.535+0000 7f045a400700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0454103540 0x7f0454113f60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.535+0000 7f045a400700 1 --2- 172.21.15.57:0/4015045633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0454104750 0x7f04541144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.535+0000 7f045a400700 1 -- 172.21.15.57:0/4015045633 >> 172.21.15.57:0/4015045633 conn(0x7f04540727d0 msgr2=0x7f0454107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.535+0000 7f045a400700 1 -- 172.21.15.57:0/4015045633 shutdown_connections 2024-02-28T16:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.535+0000 7f045a400700 1 -- 172.21.15.57:0/4015045633 wait complete. 2024-02-28T16:12:20.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.691+0000 7faebe200700 1 -- 172.21.15.57:0/1626726021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb8100360 msgr2=0x7faeb81007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.691+0000 7faebe200700 1 --2- 172.21.15.57:0/1626726021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb8100360 0x7faeb81007b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faea4004940 tx=0x7faea4009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.691+0000 7faebe200700 1 -- 172.21.15.57:0/1626726021 shutdown_connections 2024-02-28T16:12:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.691+0000 7faebe200700 1 --2- 172.21.15.57:0/1626726021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb8100360 0x7faeb81007b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.691+0000 7faebe200700 1 --2- 172.21.15.57:0/1626726021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb80ff150 0x7faeb80ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.691+0000 7faebe200700 1 -- 172.21.15.57:0/1626726021 >> 172.21.15.57:0/1626726021 conn(0x7faeb80fa920 msgr2=0x7faeb80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.691+0000 7faebe200700 1 -- 172.21.15.57:0/1626726021 shutdown_connections 2024-02-28T16:12:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.692+0000 7faebe200700 1 -- 172.21.15.57:0/1626726021 wait complete. 2024-02-28T16:12:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.693+0000 7faebe200700 1 Processor -- start 2024-02-28T16:12:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.693+0000 7faebe200700 1 -- start start 2024-02-28T16:12:20.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.693+0000 7faebe200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb80ff150 0x7faeb810fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:20.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.693+0000 7faebe200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb8100360 0x7faeb81100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:20.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.693+0000 7faebe200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8110780 con 0x7faeb80ff150 2024-02-28T16:12:20.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.693+0000 7faebe200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8110fc0 con 0x7faeb8100360 2024-02-28T16:12:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.693+0000 7faeb7400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb80ff150 0x7faeb810fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.694+0000 7faeb7400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb80ff150 0x7faeb810fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56702/0 (socket says 172.21.15.57:56702) 2024-02-28T16:12:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.694+0000 7faeb7400700 1 -- 172.21.15.57:0/1523722855 learned_addr learned my addr 172.21.15.57:0/1523722855 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.694+0000 7faeb6a00700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb8100360 0x7faeb81100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.694+0000 7faeb7400700 1 -- 172.21.15.57:0/1523722855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb8100360 msgr2=0x7faeb81100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.694+0000 7faeb7400700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb8100360 0x7faeb81100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.694+0000 7faeb7400700 1 -- 172.21.15.57:0/1523722855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea4005040 con 0x7faeb80ff150 2024-02-28T16:12:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.694+0000 7faeb7400700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb80ff150 0x7faeb810fbb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faea800b790 tx=0x7faea8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.695+0000 7faeaf400700 1 -- 172.21.15.57:0/1523722855 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea800f6f0 con 0x7faeb80ff150 2024-02-28T16:12:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.695+0000 7faeaf400700 1 -- 172.21.15.57:0/1523722855 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faea800fd20 con 0x7faeb80ff150 2024-02-28T16:12:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.695+0000 7faebe200700 1 -- 172.21.15.57:0/1523722855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb81112a0 con 0x7faeb80ff150 2024-02-28T16:12:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.695+0000 7faeaf400700 1 -- 172.21.15.57:0/1523722855 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea80103a0 con 0x7faeb80ff150 2024-02-28T16:12:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.695+0000 7faebe200700 1 -- 172.21.15.57:0/1523722855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb81117e0 con 0x7faeb80ff150 2024-02-28T16:12:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.696+0000 7faebe200700 1 -- 172.21.15.57:0/1523722855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb804bed0 con 0x7faeb80ff150 2024-02-28T16:12:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.697+0000 7faeaf400700 1 -- 172.21.15.57:0/1523722855 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7faea8011400 con 0x7faeb80ff150 2024-02-28T16:12:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.698+0000 7faeaf400700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9c06d7e0 0x7fae9c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.698+0000 7faeaf400700 1 -- 172.21.15.57:0/1523722855 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7faea808ce50 con 0x7faeb80ff150 2024-02-28T16:12:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.698+0000 7faeb6a00700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9c06d7e0 0x7fae9c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.699+0000 7faeb6a00700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9c06d7e0 0x7fae9c06fc90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faea4004f90 tx=0x7faea4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:20.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.703+0000 7faeaf400700 1 -- 172.21.15.57:0/1523722855 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faea805a050 con 0x7faeb80ff150 2024-02-28T16:12:20.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.973+0000 7faebe200700 1 -- 172.21.15.57:0/1523722855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faeb8111d20 con 0x7faeb80ff150 2024-02-28T16:12:20.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.974+0000 7faeaf400700 1 -- 172.21.15.57:0/1523722855 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1691 (secure 0 0 0) 0x7faea8059be0 con 0x7faeb80ff150 2024-02-28T16:12:20.966 INFO:teuthology.orchestra.run.smithi057.stdout:e37 2024-02-28T16:12:20.966 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:12:20.966 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:12:20.966 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:12:20.966 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:12:20.966 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:12:20.966 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:12:20.966 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 33 2024-02-28T16:12:20.966 INFO:teuthology.orchestra.run.smithi057.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:12:20.966 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:11:29.712983+0000 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 101 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 1 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:in 0 2024-02-28T16:12:20.967 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=34490} 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 1 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:34490} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:Standby daemons: 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:12:20.968 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{-1:34522} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.57:6828/2553742021,v1:172.21.15.57:6829/2553742021] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:12:20.969 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{-1:44391} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.87:6824/571403132,v1:172.21.15.87:6825/571403132] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.978+0000 7faebe200700 1 -- 172.21.15.57:0/1523722855 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9c06d7e0 msgr2=0x7fae9c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.978+0000 7faebe200700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9c06d7e0 0x7fae9c06fc90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faea4004f90 tx=0x7faea4009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.978+0000 7faebe200700 1 -- 172.21.15.57:0/1523722855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb80ff150 msgr2=0x7faeb810fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.978+0000 7faebe200700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb80ff150 0x7faeb810fbb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faea800b790 tx=0x7faea8009220 comp rx=0 tx=0).stop 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.978+0000 7faebe200700 1 -- 172.21.15.57:0/1523722855 shutdown_connections 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.978+0000 7faebe200700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9c06d7e0 0x7fae9c06fc90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.978+0000 7faebe200700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb80ff150 0x7faeb810fbb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.978+0000 7faebe200700 1 --2- 172.21.15.57:0/1523722855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb8100360 0x7faeb81100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.978+0000 7faebe200700 1 -- 172.21.15.57:0/1523722855 >> 172.21.15.57:0/1523722855 conn(0x7faeb80fa920 msgr2=0x7faeb8103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.979+0000 7faebe200700 1 -- 172.21.15.57:0/1523722855 shutdown_connections 2024-02-28T16:12:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:20.979+0000 7faebe200700 1 -- 172.21.15.57:0/1523722855 wait complete. 2024-02-28T16:12:20.971 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 37 2024-02-28T16:12:21.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.125+0000 7f275d800700 1 -- 172.21.15.57:0/1250341444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2758072890 msgr2=0x7f2758072ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:21.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.125+0000 7f275d800700 1 --2- 172.21.15.57:0/1250341444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2758072890 0x7f2758072ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2748004940 tx=0x7f2748009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:21.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.125+0000 7f275d800700 1 -- 172.21.15.57:0/1250341444 shutdown_connections 2024-02-28T16:12:21.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.125+0000 7f275d800700 1 --2- 172.21.15.57:0/1250341444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2758073af0 0x7f2758073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.125+0000 7f275d800700 1 --2- 172.21.15.57:0/1250341444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2758072890 0x7f2758072ca0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.125+0000 7f275d800700 1 -- 172.21.15.57:0/1250341444 >> 172.21.15.57:0/1250341444 conn(0x7f27580fa760 msgr2=0x7f27580fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:21.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.125+0000 7f275d800700 1 -- 172.21.15.57:0/1250341444 shutdown_connections 2024-02-28T16:12:21.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.125+0000 7f275d800700 1 -- 172.21.15.57:0/1250341444 wait complete. 2024-02-28T16:12:21.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.126+0000 7f275d800700 1 Processor -- start 2024-02-28T16:12:21.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.126+0000 7f275d800700 1 -- start start 2024-02-28T16:12:21.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.127+0000 7f275d800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2758073af0 0x7f2758113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:21.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.127+0000 7f275d800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2758114420 0x7f27581152c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:21.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.127+0000 7f275d800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27581148e0 con 0x7f2758114420 2024-02-28T16:12:21.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.127+0000 7f275d800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2758114a20 con 0x7f2758073af0 2024-02-28T16:12:21.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.127+0000 7f2757400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2758114420 0x7f27581152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:21.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.127+0000 7f2757400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2758114420 0x7f27581152c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56728/0 (socket says 172.21.15.57:56728) 2024-02-28T16:12:21.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.127+0000 7f2757400700 1 -- 172.21.15.57:0/2181517842 learned_addr learned my addr 172.21.15.57:0/2181517842 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:21.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.127+0000 7f2757e00700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2758073af0 0x7f2758113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:21.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.128+0000 7f2757400700 1 -- 172.21.15.57:0/2181517842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2758073af0 msgr2=0x7f2758113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:21.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.128+0000 7f2757400700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2758073af0 0x7f2758113ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.128+0000 7f2757400700 1 -- 172.21.15.57:0/2181517842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748005040 con 0x7f2758114420 2024-02-28T16:12:21.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.128+0000 7f2757400700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2758114420 0x7f27581152c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2744002a50 tx=0x7f27440046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:21.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.128+0000 7f274fe00700 1 -- 172.21.15.57:0/2181517842 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2744007cc0 con 0x7f2758114420 2024-02-28T16:12:21.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.129+0000 7f274fe00700 1 -- 172.21.15.57:0/2181517842 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f274400f040 con 0x7f2758114420 2024-02-28T16:12:21.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.129+0000 7f274fe00700 1 -- 172.21.15.57:0/2181517842 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2744009640 con 0x7f2758114420 2024-02-28T16:12:21.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.129+0000 7f275d800700 1 -- 172.21.15.57:0/2181517842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2758115920 con 0x7f2758114420 2024-02-28T16:12:21.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.129+0000 7f275d800700 1 -- 172.21.15.57:0/2181517842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2758115eb0 con 0x7f2758114420 2024-02-28T16:12:21.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.130+0000 7f275d800700 1 -- 172.21.15.57:0/2181517842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275804bed0 con 0x7f2758114420 2024-02-28T16:12:21.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.133+0000 7f274fe00700 1 -- 172.21.15.57:0/2181517842 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f27440097a0 con 0x7f2758114420 2024-02-28T16:12:21.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.134+0000 7f274fe00700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f273c06d7f0 0x7f273c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:21.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.134+0000 7f274fe00700 1 -- 172.21.15.57:0/2181517842 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f274408cdc0 con 0x7f2758114420 2024-02-28T16:12:21.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.135+0000 7f2757e00700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f273c06d7f0 0x7f273c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:21.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.135+0000 7f2757e00700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f273c06d7f0 0x7f273c06fca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f274800b3b0 tx=0x7f2748009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:21.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.139+0000 7f274fe00700 1 -- 172.21.15.57:0/2181517842 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2744090030 con 0x7f2758114420 2024-02-28T16:12:21.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.373+0000 7f275d800700 1 -- 172.21.15.57:0/2181517842 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f275810aa20 con 0x7f273c06d7f0 2024-02-28T16:12:21.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.375+0000 7f274fe00700 1 -- 172.21.15.57:0/2181517842 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f275810aa20 con 0x7f273c06d7f0 2024-02-28T16:12:21.367 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:12:21.367 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:12:21.367 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:12:21.367 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:12:21.367 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:12:21.367 INFO:teuthology.orchestra.run.smithi057.stdout: "osd", 2024-02-28T16:12:21.367 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:12:21.367 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:12:21.367 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:12:21.367 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:12:21.368 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "15/21 daemons upgraded", 2024-02-28T16:12:21.368 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T16:12:21.368 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:12:21.368 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:12:21.368 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:21 smithi057 ceph-mon[93219]: pgmap v290: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:21.368 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:21 smithi057 ceph-mon[93219]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:21.368 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:21 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:12:21.368 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:21 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/4015045633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:21.368 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:21 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1523722855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:12:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.378+0000 7f275d800700 1 -- 172.21.15.57:0/2181517842 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f273c06d7f0 msgr2=0x7f273c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.378+0000 7f275d800700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f273c06d7f0 0x7f273c06fca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f274800b3b0 tx=0x7f2748009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.378+0000 7f275d800700 1 -- 172.21.15.57:0/2181517842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2758114420 msgr2=0x7f27581152c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:21.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.378+0000 7f275d800700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2758114420 0x7f27581152c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2744002a50 tx=0x7f27440046b0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.379+0000 7f275d800700 1 -- 172.21.15.57:0/2181517842 shutdown_connections 2024-02-28T16:12:21.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.379+0000 7f275d800700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f273c06d7f0 0x7f273c06fca0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.379+0000 7f275d800700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2758073af0 0x7f2758113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.379+0000 7f275d800700 1 --2- 172.21.15.57:0/2181517842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2758114420 0x7f27581152c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.379+0000 7f275d800700 1 -- 172.21.15.57:0/2181517842 >> 172.21.15.57:0/2181517842 conn(0x7f27580fa760 msgr2=0x7f27581092a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:21.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.379+0000 7f275d800700 1 -- 172.21.15.57:0/2181517842 shutdown_connections 2024-02-28T16:12:21.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.379+0000 7f275d800700 1 -- 172.21.15.57:0/2181517842 wait complete. 2024-02-28T16:12:21.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:21 smithi087 ceph-mon[82628]: pgmap v290: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:21.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:21 smithi087 ceph-mon[82628]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:21.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:21 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:12:21.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:21 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/4015045633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:21.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:21 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1523722855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:12:21.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.533+0000 7f1283e00700 1 -- 172.21.15.57:0/744920614 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1274012410 con 0x7f12840fcef0 2024-02-28T16:12:21.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.533+0000 7f128bc00700 1 -- 172.21.15.57:0/744920614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840fcef0 msgr2=0x7f12840fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:21.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.533+0000 7f128bc00700 1 --2- 172.21.15.57:0/744920614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840fcef0 0x7f12840fd320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1274009ce0 tx=0x7f1274004d10 comp rx=0 tx=0).stop 2024-02-28T16:12:21.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.533+0000 7f128bc00700 1 -- 172.21.15.57:0/744920614 shutdown_connections 2024-02-28T16:12:21.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.533+0000 7f128bc00700 1 --2- 172.21.15.57:0/744920614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12840fe0e0 0x7f12840fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.533+0000 7f128bc00700 1 --2- 172.21.15.57:0/744920614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840fcef0 0x7f12840fd320 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.533+0000 7f128bc00700 1 -- 172.21.15.57:0/744920614 >> 172.21.15.57:0/744920614 conn(0x7f12840f8620 msgr2=0x7f12840faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:21.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.534+0000 7f128bc00700 1 -- 172.21.15.57:0/744920614 shutdown_connections 2024-02-28T16:12:21.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.534+0000 7f128bc00700 1 -- 172.21.15.57:0/744920614 wait complete. 2024-02-28T16:12:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.534+0000 7f128bc00700 1 Processor -- start 2024-02-28T16:12:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.535+0000 7f128bc00700 1 -- start start 2024-02-28T16:12:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.535+0000 7f128bc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12840fcef0 0x7f1284071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.535+0000 7f128bc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840fe0e0 0x7f12840702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.535+0000 7f128bc00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1284070970 con 0x7f12840fe0e0 2024-02-28T16:12:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.535+0000 7f128bc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1284070ae0 con 0x7f12840fcef0 2024-02-28T16:12:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.535+0000 7f127be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840fe0e0 0x7f12840702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.535+0000 7f127be00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840fe0e0 0x7f12840702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56748/0 (socket says 172.21.15.57:56748) 2024-02-28T16:12:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.535+0000 7f127be00700 1 -- 172.21.15.57:0/2758409446 learned_addr learned my addr 172.21.15.57:0/2758409446 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:21.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.536+0000 7f1289200700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12840fcef0 0x7f1284071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:21.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.536+0000 7f127be00700 1 -- 172.21.15.57:0/2758409446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12840fcef0 msgr2=0x7f1284071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.536+0000 7f127be00700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12840fcef0 0x7f1284071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.536+0000 7f127be00700 1 -- 172.21.15.57:0/2758409446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274009940 con 0x7f12840fe0e0 2024-02-28T16:12:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.536+0000 7f127be00700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840fe0e0 0x7f12840702e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f126c00b790 tx=0x7f126c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.536+0000 7f1281600700 1 -- 172.21.15.57:0/2758409446 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f126c00f770 con 0x7f12840fe0e0 2024-02-28T16:12:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.536+0000 7f1281600700 1 -- 172.21.15.57:0/2758409446 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f126c00fda0 con 0x7f12840fe0e0 2024-02-28T16:12:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.536+0000 7f128bc00700 1 -- 172.21.15.57:0/2758409446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1284070dc0 con 0x7f12840fe0e0 2024-02-28T16:12:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.536+0000 7f1281600700 1 -- 172.21.15.57:0/2758409446 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f126c00d310 con 0x7f12840fe0e0 2024-02-28T16:12:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.537+0000 7f128bc00700 1 -- 172.21.15.57:0/2758409446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1284071140 con 0x7f12840fe0e0 2024-02-28T16:12:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.538+0000 7f128bc00700 1 -- 172.21.15.57:0/2758409446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128404bed0 con 0x7f12840fe0e0 2024-02-28T16:12:21.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.539+0000 7f1281600700 1 -- 172.21.15.57:0/2758409446 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f126c010420 con 0x7f12840fe0e0 2024-02-28T16:12:21.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.540+0000 7f1281600700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126806d7e0 0x7f126806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:21.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.540+0000 7f1281600700 1 -- 172.21.15.57:0/2758409446 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f126c08cff0 con 0x7f12840fe0e0 2024-02-28T16:12:21.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.540+0000 7f1289200700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126806d7e0 0x7f126806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:21.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.541+0000 7f1289200700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126806d7e0 0x7f126806fc90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1274009cb0 tx=0x7f1274004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:21.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.545+0000 7f1281600700 1 -- 172.21.15.57:0/2758409446 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f126c05a2d0 con 0x7f12840fe0e0 2024-02-28T16:12:21.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.866+0000 7f128bc00700 1 -- 172.21.15.57:0/2758409446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1284116040 con 0x7f12840fe0e0 2024-02-28T16:12:21.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.867+0000 7f1281600700 1 -- 172.21.15.57:0/2758409446 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f126c059e60 con 0x7f12840fe0e0 2024-02-28T16:12:21.858 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:12:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 -- 172.21.15.57:0/2758409446 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126806d7e0 msgr2=0x7f126806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126806d7e0 0x7f126806fc90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1274009cb0 tx=0x7f1274004d10 comp rx=0 tx=0).stop 2024-02-28T16:12:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 -- 172.21.15.57:0/2758409446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840fe0e0 msgr2=0x7f12840702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840fe0e0 0x7f12840702e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f126c00b790 tx=0x7f126c009250 comp rx=0 tx=0).stop 2024-02-28T16:12:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 -- 172.21.15.57:0/2758409446 shutdown_connections 2024-02-28T16:12:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f126806d7e0 0x7f126806fc90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12840fcef0 0x7f1284071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 --2- 172.21.15.57:0/2758409446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12840fe0e0 0x7f12840702e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 -- 172.21.15.57:0/2758409446 >> 172.21.15.57:0/2758409446 conn(0x7f12840f8620 msgr2=0x7f12841013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 -- 172.21.15.57:0/2758409446 shutdown_connections 2024-02-28T16:12:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:21.870+0000 7f128bc00700 1 -- 172.21.15.57:0/2758409446 wait complete. 2024-02-28T16:12:22.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:22 smithi057 ceph-mon[93219]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:22.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:22 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2758409446' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:12:22.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:22 smithi087 ceph-mon[82628]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:22.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:22 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2758409446' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:12:23.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:23 smithi087 ceph-mon[82628]: pgmap v291: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:23.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:23 smithi057 ceph-mon[93219]: pgmap v291: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:25.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:24 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:25.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:24 smithi057 ceph-mon[93219]: pgmap v292: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:25.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:24 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:25.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:24 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:25.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:24 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.87:6826/2114762616,v1:172.21.15.87:6827/2114762616] up:boot 2024-02-28T16:12:25.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:24 smithi057 ceph-mon[93219]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 3 up:standby 2024-02-28T16:12:25.177 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:24 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:12:25.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:24 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:25.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:24 smithi087 ceph-mon[82628]: pgmap v292: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:25.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:24 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:25.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:24 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:25.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:24 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.87:6826/2114762616,v1:172.21.15.87:6827/2114762616] up:boot 2024-02-28T16:12:25.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:24 smithi087 ceph-mon[82628]: fsmap cephfs:1 {0=cephfs.smithi057.eztwsd=up:active} 3 up:standby 2024-02-28T16:12:25.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:24 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:12:27.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:26 smithi057 ceph-mon[93219]: pgmap v293: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:27.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:26 smithi087 ceph-mon[82628]: pgmap v293: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:28.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:28 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:28.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:28 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:28.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:28 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:28.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:28 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:29.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:29 smithi057 ceph-mon[93219]: pgmap v294: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:29.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:29 smithi087 ceph-mon[82628]: pgmap v294: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:30.908 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:30 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:30.908 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:30 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:30.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:30 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:30.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:30 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:31.860 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:31 smithi087 ceph-mon[82628]: pgmap v295: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:31.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:31 smithi057 ceph-mon[93219]: pgmap v295: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:33.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:33 smithi057 ceph-mon[93219]: pgmap v296: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:33.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:33 smithi087 ceph-mon[82628]: pgmap v296: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:34.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:12:34.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:12:35.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:35 smithi057 ceph-mon[93219]: pgmap v297: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:35.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:35.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:35.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:12:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:12:35.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:35 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:35.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:35 smithi087 ceph-mon[82628]: pgmap v297: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:35.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:35.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:35.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:12:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:12:35.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:35 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:12:36.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi057.eztwsd"}]': finished 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi057.qwatmu"}]': finished 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.fzjgef"}]': finished 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.whebmo"}]': finished 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: daemon mds.cephfs.smithi057.qwatmu assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi057.qwatmu=up:starting} 2 up:standby 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-28T16:12:36.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:36 smithi057 ceph-mon[93219]: daemon mds.cephfs.smithi057.qwatmu is now active in filesystem cephfs as rank 1 2024-02-28T16:12:36.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:36.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:36.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:36.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:36.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:36.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:36.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi057.eztwsd"}]: dispatch 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi057.eztwsd"}]': finished 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi057.qwatmu"}]: dispatch 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi057.qwatmu"}]': finished 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.fzjgef"}]: dispatch 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.fzjgef"}]': finished 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.whebmo"}]: dispatch 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.whebmo"}]': finished 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: daemon mds.cephfs.smithi057.qwatmu assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi057.qwatmu=up:starting} 2 up:standby 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:36.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-28T16:12:36.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:36 smithi087 ceph-mon[82628]: daemon mds.cephfs.smithi057.qwatmu is now active in filesystem cephfs as rank 1 2024-02-28T16:12:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: Upgrade: Setting container_image for all mds 2024-02-28T16:12:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-02-28T16:12:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: pgmap v298: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-28T16:12:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-28T16:12:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: mds.? [v2:172.21.15.57:6828/2553742021,v1:172.21.15.57:6829/2553742021] up:active 2024-02-28T16:12:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi057.qwatmu=up:active} 2 up:standby 2024-02-28T16:12:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi057.qwatmu=up:active} 2 up:standby-replay 2024-02-28T16:12:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:37 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: Upgrade: Setting container_image for all mds 2024-02-28T16:12:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-02-28T16:12:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: pgmap v298: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail 2024-02-28T16:12:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-28T16:12:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-28T16:12:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: mds.? [v2:172.21.15.57:6828/2553742021,v1:172.21.15.57:6829/2553742021] up:active 2024-02-28T16:12:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi057.qwatmu=up:active} 2 up:standby 2024-02-28T16:12:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: fsmap cephfs:2 {0=cephfs.smithi057.eztwsd=up:active,1=cephfs.smithi057.qwatmu=up:active} 2 up:standby-replay 2024-02-28T16:12:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:37.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:37 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:38.917 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:38 smithi057 ceph-mon[93219]: Upgrade: Setting container_image for all rgw 2024-02-28T16:12:38.918 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:38 smithi057 ceph-mon[93219]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T16:12:38.918 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:38 smithi057 ceph-mon[93219]: Upgrade: Setting container_image for all ceph-exporter 2024-02-28T16:12:38.918 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:38 smithi057 ceph-mon[93219]: Upgrade: Setting container_image for all iscsi 2024-02-28T16:12:38.918 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:38 smithi057 ceph-mon[93219]: Upgrade: Setting container_image for all nfs 2024-02-28T16:12:38.918 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:38 smithi057 ceph-mon[93219]: Upgrade: Setting container_image for all nvmeof 2024-02-28T16:12:38.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:38 smithi087 ceph-mon[82628]: Upgrade: Setting container_image for all rgw 2024-02-28T16:12:38.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:38 smithi087 ceph-mon[82628]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T16:12:38.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:38 smithi087 ceph-mon[82628]: Upgrade: Setting container_image for all ceph-exporter 2024-02-28T16:12:38.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:38 smithi087 ceph-mon[82628]: Upgrade: Setting container_image for all iscsi 2024-02-28T16:12:38.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:38 smithi087 ceph-mon[82628]: Upgrade: Setting container_image for all nfs 2024-02-28T16:12:38.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:38 smithi087 ceph-mon[82628]: Upgrade: Setting container_image for all nvmeof 2024-02-28T16:12:39.869 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:39 smithi057 ceph-mon[93219]: pgmap v299: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 0 op/s 2024-02-28T16:12:39.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:39 smithi087 ceph-mon[82628]: pgmap v299: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 0 op/s 2024-02-28T16:12:40.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:40 smithi087 ceph-mon[82628]: pgmap v300: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 5 op/s 2024-02-28T16:12:40.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:40 smithi087 ceph-mon[82628]: Upgrade: Updating node-exporter.smithi057 (1/2) 2024-02-28T16:12:40.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:40 smithi087 ceph-mon[82628]: Deploying daemon node-exporter.smithi057 on smithi057 2024-02-28T16:12:41.081 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:40 smithi057 ceph-mon[93219]: pgmap v300: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 5 op/s 2024-02-28T16:12:41.081 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:40 smithi057 ceph-mon[93219]: Upgrade: Updating node-exporter.smithi057 (1/2) 2024-02-28T16:12:41.081 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:40 smithi057 ceph-mon[93219]: Deploying daemon node-exporter.smithi057 on smithi057 2024-02-28T16:12:43.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:42 smithi057 ceph-mon[93219]: pgmap v301: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s rd, 85 B/s wr, 8 op/s 2024-02-28T16:12:43.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:42 smithi087 ceph-mon[82628]: pgmap v301: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s rd, 85 B/s wr, 8 op/s 2024-02-28T16:12:45.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:45 smithi057 ceph-mon[93219]: pgmap v302: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 10 op/s 2024-02-28T16:12:45.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:45 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:45.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:45 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:45.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:45 smithi087 ceph-mon[82628]: pgmap v302: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 10 op/s 2024-02-28T16:12:45.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:45 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:45.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:45 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:47.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:47 smithi087 ceph-mon[82628]: pgmap v303: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 12 op/s 2024-02-28T16:12:47.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:47 smithi057 ceph-mon[93219]: pgmap v303: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 12 op/s 2024-02-28T16:12:48.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:48 smithi057 ceph-mon[93219]: Upgrade: Updating node-exporter.smithi087 (2/2) 2024-02-28T16:12:48.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:48 smithi057 ceph-mon[93219]: Deploying daemon node-exporter.smithi087 on smithi087 2024-02-28T16:12:48.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:48 smithi087 ceph-mon[82628]: Upgrade: Updating node-exporter.smithi087 (2/2) 2024-02-28T16:12:48.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:48 smithi087 ceph-mon[82628]: Deploying daemon node-exporter.smithi087 on smithi087 2024-02-28T16:12:49.438 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:49 smithi087 ceph-mon[82628]: pgmap v304: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 12 op/s 2024-02-28T16:12:49.438 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:12:49.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:49 smithi057 ceph-mon[93219]: pgmap v304: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 12 op/s 2024-02-28T16:12:49.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:12:51.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:51 smithi057 ceph-mon[93219]: pgmap v305: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 12 op/s 2024-02-28T16:12:51.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:51.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:51.677 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:51 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:51.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:51 smithi087 ceph-mon[82628]: pgmap v305: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 12 op/s 2024-02-28T16:12:51.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:51.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:51.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:51 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:12:52.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.035+0000 7f22b1000700 1 -- 172.21.15.57:0/4070097996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ac0fff20 msgr2=0x7f22ac102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.035+0000 7f22b1000700 1 --2- 172.21.15.57:0/4070097996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ac0fff20 0x7f22ac102320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2298004940 tx=0x7f2298009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:52.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.035+0000 7f22b1000700 1 -- 172.21.15.57:0/4070097996 shutdown_connections 2024-02-28T16:12:52.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.035+0000 7f22b1000700 1 --2- 172.21.15.57:0/4070097996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ac0fff20 0x7f22ac102320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.035+0000 7f22b1000700 1 --2- 172.21.15.57:0/4070097996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22ac066380 0x7f22ac0ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.035+0000 7f22b1000700 1 -- 172.21.15.57:0/4070097996 >> 172.21.15.57:0/4070097996 conn(0x7f22ac0f72c0 msgr2=0x7f22ac0f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:52.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.035+0000 7f22b1000700 1 -- 172.21.15.57:0/4070097996 shutdown_connections 2024-02-28T16:12:52.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.035+0000 7f22b1000700 1 -- 172.21.15.57:0/4070097996 wait complete. 2024-02-28T16:12:52.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.036+0000 7f22b1000700 1 Processor -- start 2024-02-28T16:12:52.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.036+0000 7f22b1000700 1 -- start start 2024-02-28T16:12:52.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.037+0000 7f22b1000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ac066380 0x7f22ac10f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.037+0000 7f22b1000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22ac0fff20 0x7f22ac10fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.037+0000 7f22b1000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac1103d0 con 0x7f22ac066380 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.037+0000 7f22b1000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac110c70 con 0x7f22ac0fff20 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.037+0000 7f22ab400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ac066380 0x7f22ac10f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.037+0000 7f22ab400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ac066380 0x7f22ac10f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44306/0 (socket says 172.21.15.57:44306) 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.037+0000 7f22ab400700 1 -- 172.21.15.57:0/2424772635 learned_addr learned my addr 172.21.15.57:0/2424772635 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.037+0000 7f22aaa00700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22ac0fff20 0x7f22ac10fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.038+0000 7f22ab400700 1 -- 172.21.15.57:0/2424772635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22ac0fff20 msgr2=0x7f22ac10fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.038+0000 7f22ab400700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22ac0fff20 0x7f22ac10fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.038+0000 7f22ab400700 1 -- 172.21.15.57:0/2424772635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298005040 con 0x7f22ac066380 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.038+0000 7f22ab400700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ac066380 0x7f22ac10f890 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f229c00eb40 tx=0x7f229c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.038+0000 7f22a3400700 1 -- 172.21.15.57:0/2424772635 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f229c007cc0 con 0x7f22ac066380 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.038+0000 7f22a3400700 1 -- 172.21.15.57:0/2424772635 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f229c00f040 con 0x7f22ac066380 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.038+0000 7f22b1000700 1 -- 172.21.15.57:0/2424772635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac110ef0 con 0x7f22ac066380 2024-02-28T16:12:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.039+0000 7f22a3400700 1 -- 172.21.15.57:0/2424772635 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f229c00ca10 con 0x7f22ac066380 2024-02-28T16:12:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.039+0000 7f22b1000700 1 -- 172.21.15.57:0/2424772635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac111430 con 0x7f22ac066380 2024-02-28T16:12:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.040+0000 7f22b1000700 1 -- 172.21.15.57:0/2424772635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac04bed0 con 0x7f22ac066380 2024-02-28T16:12:52.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.041+0000 7f22a3400700 1 -- 172.21.15.57:0/2424772635 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f229c00cc80 con 0x7f22ac066380 2024-02-28T16:12:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.042+0000 7f22a3400700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f229006d7e0 0x7f229006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.042+0000 7f22a3400700 1 -- 172.21.15.57:0/2424772635 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f229c08cbc0 con 0x7f22ac066380 2024-02-28T16:12:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.043+0000 7f22aaa00700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f229006d7e0 0x7f229006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.043+0000 7f22aaa00700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f229006d7e0 0x7f229006fc90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f22980045a0 tx=0x7f2298009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:52.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.048+0000 7f22a3400700 1 -- 172.21.15.57:0/2424772635 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f229c059e90 con 0x7f22ac066380 2024-02-28T16:12:52.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.325+0000 7f22b1000700 1 -- 172.21.15.57:0/2424772635 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22ac111aa0 con 0x7f229006d7e0 2024-02-28T16:12:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.327+0000 7f22a3400700 1 -- 172.21.15.57:0/2424772635 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f22ac111aa0 con 0x7f229006d7e0 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.330+0000 7f22b1000700 1 -- 172.21.15.57:0/2424772635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f229006d7e0 msgr2=0x7f229006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.330+0000 7f22b1000700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f229006d7e0 0x7f229006fc90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f22980045a0 tx=0x7f2298009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.330+0000 7f22b1000700 1 -- 172.21.15.57:0/2424772635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ac066380 msgr2=0x7f22ac10f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.330+0000 7f22b1000700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ac066380 0x7f22ac10f890 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f229c00eb40 tx=0x7f229c00b040 comp rx=0 tx=0).stop 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.331+0000 7f22b1000700 1 -- 172.21.15.57:0/2424772635 shutdown_connections 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.331+0000 7f22b1000700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f229006d7e0 0x7f229006fc90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.331+0000 7f22b1000700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ac066380 0x7f22ac10f890 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.331+0000 7f22b1000700 1 --2- 172.21.15.57:0/2424772635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22ac0fff20 0x7f22ac10fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.331+0000 7f22b1000700 1 -- 172.21.15.57:0/2424772635 >> 172.21.15.57:0/2424772635 conn(0x7f22ac0f72c0 msgr2=0x7f22ac0f7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.331+0000 7f22b1000700 1 -- 172.21.15.57:0/2424772635 shutdown_connections 2024-02-28T16:12:52.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.331+0000 7f22b1000700 1 -- 172.21.15.57:0/2424772635 wait complete. 2024-02-28T16:12:52.339 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:12:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.497+0000 7f4d86a00700 1 -- 172.21.15.57:0/2575240466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d800708c0 msgr2=0x7f4d80070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.497+0000 7f4d86a00700 1 --2- 172.21.15.57:0/2575240466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d800708c0 0x7f4d80070d10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4d68004940 tx=0x7f4d68009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.497+0000 7f4d86a00700 1 -- 172.21.15.57:0/2575240466 shutdown_connections 2024-02-28T16:12:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.497+0000 7f4d86a00700 1 --2- 172.21.15.57:0/2575240466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d800708c0 0x7f4d80070d10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.497+0000 7f4d86a00700 1 --2- 172.21.15.57:0/2575240466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d80071f10 0x7f4d80070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.497+0000 7f4d86a00700 1 -- 172.21.15.57:0/2575240466 >> 172.21.15.57:0/2575240466 conn(0x7f4d800f8620 msgr2=0x7f4d800faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:52.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.497+0000 7f4d86a00700 1 -- 172.21.15.57:0/2575240466 shutdown_connections 2024-02-28T16:12:52.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.497+0000 7f4d86a00700 1 -- 172.21.15.57:0/2575240466 wait complete. 2024-02-28T16:12:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.498+0000 7f4d86a00700 1 Processor -- start 2024-02-28T16:12:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.498+0000 7f4d86a00700 1 -- start start 2024-02-28T16:12:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.498+0000 7f4d86a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d800708c0 0x7f4d8010fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.498+0000 7f4d86a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d80071f10 0x7f4d801100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.498+0000 7f4d86a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801106d0 con 0x7f4d80071f10 2024-02-28T16:12:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.498+0000 7f4d86a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80110f70 con 0x7f4d800708c0 2024-02-28T16:12:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.499+0000 7f4d77e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d80071f10 0x7f4d801100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.499+0000 7f4d77e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d80071f10 0x7f4d801100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44336/0 (socket says 172.21.15.57:44336) 2024-02-28T16:12:52.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.499+0000 7f4d77e00700 1 -- 172.21.15.57:0/1090890730 learned_addr learned my addr 172.21.15.57:0/1090890730 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:52.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.499+0000 7f4d7fe00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d800708c0 0x7f4d8010fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.499+0000 7f4d77e00700 1 -- 172.21.15.57:0/1090890730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d800708c0 msgr2=0x7f4d8010fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.499+0000 7f4d77e00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d800708c0 0x7f4d8010fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.499+0000 7f4d77e00700 1 -- 172.21.15.57:0/1090890730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d68005040 con 0x7f4d80071f10 2024-02-28T16:12:52.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.499+0000 7f4d77e00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d80071f10 0x7f4d801100d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009fd0 tx=0x7f4d68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.500+0000 7f4d7cc00700 1 -- 172.21.15.57:0/1090890730 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d6800e040 con 0x7f4d80071f10 2024-02-28T16:12:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.500+0000 7f4d7cc00700 1 -- 172.21.15.57:0/1090890730 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d68004290 con 0x7f4d80071f10 2024-02-28T16:12:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.500+0000 7f4d7cc00700 1 -- 172.21.15.57:0/1090890730 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d6801c630 con 0x7f4d80071f10 2024-02-28T16:12:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.500+0000 7f4d86a00700 1 -- 172.21.15.57:0/1090890730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d801111f0 con 0x7f4d80071f10 2024-02-28T16:12:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.500+0000 7f4d86a00700 1 -- 172.21.15.57:0/1090890730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d80111730 con 0x7f4d80071f10 2024-02-28T16:12:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.501+0000 7f4d86a00700 1 -- 172.21.15.57:0/1090890730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8004bed0 con 0x7f4d80071f10 2024-02-28T16:12:52.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.502+0000 7f4d7cc00700 1 -- 172.21.15.57:0/1090890730 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f4d6800bc60 con 0x7f4d80071f10 2024-02-28T16:12:52.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.503+0000 7f4d7cc00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d6406d7f0 0x7f4d6406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.503+0000 7f4d7cc00700 1 -- 172.21.15.57:0/1090890730 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f4d6808e440 con 0x7f4d80071f10 2024-02-28T16:12:52.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.503+0000 7f4d7fe00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d6406d7f0 0x7f4d6406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.504+0000 7f4d7fe00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d6406d7f0 0x7f4d6406fca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d70004990 tx=0x7f4d70009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:52.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.508+0000 7f4d7cc00700 1 -- 172.21.15.57:0/1090890730 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4d6805b640 con 0x7f4d80071f10 2024-02-28T16:12:52.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.758+0000 7f4d86a00700 1 -- 172.21.15.57:0/1090890730 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d80111c40 con 0x7f4d6406d7f0 2024-02-28T16:12:52.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.761+0000 7f4d7cc00700 1 -- 172.21.15.57:0/1090890730 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f4d80111c40 con 0x7f4d6406d7f0 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.763+0000 7f4d86a00700 1 -- 172.21.15.57:0/1090890730 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d6406d7f0 msgr2=0x7f4d6406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.763+0000 7f4d86a00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d6406d7f0 0x7f4d6406fca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d70004990 tx=0x7f4d70009ee0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.763+0000 7f4d86a00700 1 -- 172.21.15.57:0/1090890730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d80071f10 msgr2=0x7f4d801100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.763+0000 7f4d86a00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d80071f10 0x7f4d801100d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009fd0 tx=0x7f4d68009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.764+0000 7f4d86a00700 1 -- 172.21.15.57:0/1090890730 shutdown_connections 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.764+0000 7f4d86a00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f4d6406d7f0 0x7f4d6406fca0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.764+0000 7f4d86a00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d800708c0 0x7f4d8010fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.764+0000 7f4d86a00700 1 --2- 172.21.15.57:0/1090890730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d80071f10 0x7f4d801100d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.764+0000 7f4d86a00700 1 -- 172.21.15.57:0/1090890730 >> 172.21.15.57:0/1090890730 conn(0x7f4d800f8620 msgr2=0x7f4d80102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.764+0000 7f4d86a00700 1 -- 172.21.15.57:0/1090890730 shutdown_connections 2024-02-28T16:12:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.764+0000 7f4d86a00700 1 -- 172.21.15.57:0/1090890730 wait complete. 2024-02-28T16:12:52.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.928+0000 7f9b1d600700 1 -- 172.21.15.57:0/549428274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b180fe0e0 msgr2=0x7f9b180fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.928+0000 7f9b1d600700 1 --2- 172.21.15.57:0/549428274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b180fe0e0 0x7f9b180fe550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9b00004940 tx=0x7f9b00009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:52.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.928+0000 7f9b1d600700 1 -- 172.21.15.57:0/549428274 shutdown_connections 2024-02-28T16:12:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.928+0000 7f9b1d600700 1 --2- 172.21.15.57:0/549428274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b180fe0e0 0x7f9b180fe550 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.928+0000 7f9b1d600700 1 --2- 172.21.15.57:0/549428274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b180fcef0 0x7f9b180fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.928+0000 7f9b1d600700 1 -- 172.21.15.57:0/549428274 >> 172.21.15.57:0/549428274 conn(0x7f9b180f8620 msgr2=0x7f9b180faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.928+0000 7f9b1d600700 1 -- 172.21.15.57:0/549428274 shutdown_connections 2024-02-28T16:12:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.928+0000 7f9b1d600700 1 -- 172.21.15.57:0/549428274 wait complete. 2024-02-28T16:12:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.929+0000 7f9b1d600700 1 Processor -- start 2024-02-28T16:12:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.930+0000 7f9b1d600700 1 -- start start 2024-02-28T16:12:52.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.930+0000 7f9b1d600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b180fcef0 0x7f9b18071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.930+0000 7f9b1d600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b180fe0e0 0x7f9b180702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.930+0000 7f9b1d600700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b181115d0 con 0x7f9b180fe0e0 2024-02-28T16:12:52.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.930+0000 7f9b1d600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18111740 con 0x7f9b180fcef0 2024-02-28T16:12:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.931+0000 7f9b16a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b180fcef0 0x7f9b18071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.931+0000 7f9b0e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b180fe0e0 0x7f9b180702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.931+0000 7f9b16a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b180fcef0 0x7f9b18071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:38902/0 (socket says 172.21.15.57:38902) 2024-02-28T16:12:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.931+0000 7f9b16a00700 1 -- 172.21.15.57:0/2496125742 learned_addr learned my addr 172.21.15.57:0/2496125742 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.931+0000 7f9b16a00700 1 -- 172.21.15.57:0/2496125742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b180fe0e0 msgr2=0x7f9b180702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.931+0000 7f9b16a00700 1 --2- 172.21.15.57:0/2496125742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b180fe0e0 0x7f9b180702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.931+0000 7f9b16a00700 1 -- 172.21.15.57:0/2496125742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00005040 con 0x7f9b180fcef0 2024-02-28T16:12:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.932+0000 7f9b16a00700 1 --2- 172.21.15.57:0/2496125742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b180fcef0 0x7f9b18071e60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800eb70 tx=0x7f9b0800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.932+0000 7f9b0f400700 1 -- 172.21.15.57:0/2496125742 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b08007cc0 con 0x7f9b180fcef0 2024-02-28T16:12:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.932+0000 7f9b0f400700 1 -- 172.21.15.57:0/2496125742 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b0800f040 con 0x7f9b180fcef0 2024-02-28T16:12:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.932+0000 7f9b0f400700 1 -- 172.21.15.57:0/2496125742 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b0800cb20 con 0x7f9b180fcef0 2024-02-28T16:12:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.932+0000 7f9b1d600700 1 -- 172.21.15.57:0/2496125742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b180708e0 con 0x7f9b180fcef0 2024-02-28T16:12:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.932+0000 7f9b1d600700 1 -- 172.21.15.57:0/2496125742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b18070e20 con 0x7f9b180fcef0 2024-02-28T16:12:52.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.934+0000 7f9b1d600700 1 -- 172.21.15.57:0/2496125742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1804bed0 con 0x7f9b180fcef0 2024-02-28T16:12:52.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.935+0000 7f9b0f400700 1 -- 172.21.15.57:0/2496125742 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f9b0800cc80 con 0x7f9b180fcef0 2024-02-28T16:12:52.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.936+0000 7f9b0f400700 1 --2- 172.21.15.57:0/2496125742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9af806d7f0 0x7f9af806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:52.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.936+0000 7f9b0f400700 1 -- 172.21.15.57:0/2496125742 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f9b0808ca00 con 0x7f9b180fcef0 2024-02-28T16:12:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.936+0000 7f9b0e000700 1 --2- 172.21.15.57:0/2496125742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9af806d7f0 0x7f9af806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.937+0000 7f9b0e000700 1 --2- 172.21.15.57:0/2496125742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9af806d7f0 0x7f9af806fca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9b000045a0 tx=0x7f9b00009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:52.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:52.943+0000 7f9b0f400700 1 -- 172.21.15.57:0/2496125742 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9b08059cb0 con 0x7f9b180fcef0 2024-02-28T16:12:53.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.183+0000 7f9b1d600700 1 -- 172.21.15.57:0/2496125742 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b18102ac0 con 0x7f9af806d7f0 2024-02-28T16:12:53.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.195+0000 7f9b0f400700 1 -- 172.21.15.57:0/2496125742 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f9b18102ac0 con 0x7f9af806d7f0 2024-02-28T16:12:53.187 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:12:53.187 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (11m) 72s ago 21m 15.1M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:12:53.187 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (6m) 72s ago 22m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:12:53.187 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (6m) 25s ago 20m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:12:53.187 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (10m) 72s ago 21m 76.1M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:12:53.187 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (116s) 72s ago 14m 66.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b df14dcf6973e 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (80s) 72s ago 14m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 977aa1867016 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (54s) 25s ago 14m 11.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1ee4a125f5b 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (29s) 25s ago 14m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b0b892c8725f 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (10m) 72s ago 23m 510M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (8m) 25s ago 20m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (8m) 72s ago 23m 56.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (7m) 25s ago 20m 43.1M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 starting - - - - 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 starting - - - - 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (6m) 72s ago 19m 134M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (5m) 72s ago 18m 105M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:12:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (4m) 72s ago 18m 98.0M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:12:53.189 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (4m) 25s ago 17m 106M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:12:53.189 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (3m) 25s ago 17m 93.0M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:12:53.189 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (2m) 25s ago 16m 93.6M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b cbdb6df47634 2024-02-28T16:12:53.189 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (9m) 72s ago 21m 55.4M - 2.43.0 a07b618ecd1d 15860490ba58 2024-02-28T16:12:53.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.198+0000 7f9b1d600700 1 -- 172.21.15.57:0/2496125742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9af806d7f0 msgr2=0x7f9af806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:53.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.198+0000 7f9b1d600700 1 --2- 172.21.15.57:0/2496125742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9af806d7f0 0x7f9af806fca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9b000045a0 tx=0x7f9b00009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.198+0000 7f9b1d600700 1 -- 172.21.15.57:0/2496125742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b180fcef0 msgr2=0x7f9b18071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.198+0000 7f9b1d600700 1 --2- 172.21.15.57:0/2496125742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b180fcef0 0x7f9b18071e60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800eb70 tx=0x7f9b0800b040 comp rx=0 tx=0).stop 2024-02-28T16:12:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.198+0000 7f9b1d600700 1 -- 172.21.15.57:0/2496125742 shutdown_connections 2024-02-28T16:12:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.198+0000 7f9b1d600700 1 --2- 172.21.15.57:0/2496125742 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9af806d7f0 0x7f9af806fca0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.199+0000 7f9b1d600700 1 --2- 172.21.15.57:0/2496125742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b180fcef0 0x7f9b18071e60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.199+0000 7f9b1d600700 1 --2- 172.21.15.57:0/2496125742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b180fe0e0 0x7f9b180702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.199+0000 7f9b1d600700 1 -- 172.21.15.57:0/2496125742 >> 172.21.15.57:0/2496125742 conn(0x7f9b180f8620 msgr2=0x7f9b181013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.199+0000 7f9b1d600700 1 -- 172.21.15.57:0/2496125742 shutdown_connections 2024-02-28T16:12:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.199+0000 7f9b1d600700 1 -- 172.21.15.57:0/2496125742 wait complete. 2024-02-28T16:12:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.351+0000 7faedec00700 1 -- 172.21.15.57:0/604678423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed8071f10 msgr2=0x7faed8070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.351+0000 7faedec00700 1 --2- 172.21.15.57:0/604678423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed8071f10 0x7faed8070380 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faec8004940 tx=0x7faec8009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.351+0000 7faedec00700 1 -- 172.21.15.57:0/604678423 shutdown_connections 2024-02-28T16:12:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.351+0000 7faedec00700 1 --2- 172.21.15.57:0/604678423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed80708c0 0x7faed8070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.351+0000 7faedec00700 1 --2- 172.21.15.57:0/604678423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed8071f10 0x7faed8070380 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.351+0000 7faedec00700 1 -- 172.21.15.57:0/604678423 >> 172.21.15.57:0/604678423 conn(0x7faed80f8620 msgr2=0x7faed80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.352+0000 7faedec00700 1 -- 172.21.15.57:0/604678423 shutdown_connections 2024-02-28T16:12:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.352+0000 7faedec00700 1 -- 172.21.15.57:0/604678423 wait complete. 2024-02-28T16:12:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.352+0000 7faedec00700 1 Processor -- start 2024-02-28T16:12:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.353+0000 7faedec00700 1 -- start start 2024-02-28T16:12:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.353+0000 7faedec00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed80708c0 0x7faed810fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.353+0000 7faedec00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed8071f10 0x7faed81100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.353+0000 7faedec00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed81106e0 con 0x7faed80708c0 2024-02-28T16:12:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.353+0000 7faedec00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed8110f80 con 0x7faed8071f10 2024-02-28T16:12:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.353+0000 7faed7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed80708c0 0x7faed810fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.353+0000 7faed7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed80708c0 0x7faed810fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44364/0 (socket says 172.21.15.57:44364) 2024-02-28T16:12:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.353+0000 7faed7e00700 1 -- 172.21.15.57:0/3940314010 learned_addr learned my addr 172.21.15.57:0/3940314010 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:53.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.354+0000 7faed7400700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed8071f10 0x7faed81100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:53.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.354+0000 7faed7e00700 1 -- 172.21.15.57:0/3940314010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed8071f10 msgr2=0x7faed81100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:53.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.354+0000 7faed7e00700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed8071f10 0x7faed81100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.354+0000 7faed7e00700 1 -- 172.21.15.57:0/3940314010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8005040 con 0x7faed80708c0 2024-02-28T16:12:53.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.354+0000 7faed7400700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed8071f10 0x7faed81100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:12:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.354+0000 7faed7e00700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed80708c0 0x7faed810fba0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faec8009fd0 tx=0x7faec8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.354+0000 7faecfe00700 1 -- 172.21.15.57:0/3940314010 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec800e040 con 0x7faed80708c0 2024-02-28T16:12:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.354+0000 7faecfe00700 1 -- 172.21.15.57:0/3940314010 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faec8004290 con 0x7faed80708c0 2024-02-28T16:12:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.354+0000 7faedec00700 1 -- 172.21.15.57:0/3940314010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed8111200 con 0x7faed80708c0 2024-02-28T16:12:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.354+0000 7faecfe00700 1 -- 172.21.15.57:0/3940314010 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec801c630 con 0x7faed80708c0 2024-02-28T16:12:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.355+0000 7faedec00700 1 -- 172.21.15.57:0/3940314010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed8111740 con 0x7faed80708c0 2024-02-28T16:12:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.356+0000 7faedec00700 1 -- 172.21.15.57:0/3940314010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed804bed0 con 0x7faed80708c0 2024-02-28T16:12:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.357+0000 7faecfe00700 1 -- 172.21.15.57:0/3940314010 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7faec800bc60 con 0x7faed80708c0 2024-02-28T16:12:53.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.358+0000 7faecfe00700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7faebc06d7f0 0x7faebc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:53.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.358+0000 7faecfe00700 1 -- 172.21.15.57:0/3940314010 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7faec808e4b0 con 0x7faed80708c0 2024-02-28T16:12:53.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.358+0000 7faed7400700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7faebc06d7f0 0x7faebc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:53.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.359+0000 7faed7400700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7faebc06d7f0 0x7faebc06fca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faec4007fd0 tx=0x7faec4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:53.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.366+0000 7faecfe00700 1 -- 172.21.15.57:0/3940314010 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faec805b6d0 con 0x7faed80708c0 2024-02-28T16:12:53.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:53 smithi057 ceph-mon[93219]: pgmap v306: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 8.1 MiB/s rd, 170 B/s wr, 8 op/s 2024-02-28T16:12:53.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:53 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:53.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:53 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:53.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:53 smithi057 ceph-mon[93219]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:53.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:53 smithi087 ceph-mon[82628]: pgmap v306: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 8.1 MiB/s rd, 170 B/s wr, 8 op/s 2024-02-28T16:12:53.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:53 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:53.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:53 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:53.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:53 smithi087 ceph-mon[82628]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.692+0000 7faedec00700 1 -- 172.21.15.57:0/3940314010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faed8111de0 con 0x7faed80708c0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.693+0000 7faecfe00700 1 -- 172.21.15.57:0/3940314010 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7faec805b260 con 0x7faed80708c0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:12:53.686 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:12:53.686 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:12:53.686 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:12:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.695+0000 7faedec00700 1 -- 172.21.15.57:0/3940314010 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7faebc06d7f0 msgr2=0x7faebc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.695+0000 7faedec00700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7faebc06d7f0 0x7faebc06fca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faec4007fd0 tx=0x7faec4009040 comp rx=0 tx=0).stop 2024-02-28T16:12:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.695+0000 7faedec00700 1 -- 172.21.15.57:0/3940314010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed80708c0 msgr2=0x7faed810fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.695+0000 7faedec00700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed80708c0 0x7faed810fba0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faec8009fd0 tx=0x7faec8009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.696+0000 7faedec00700 1 -- 172.21.15.57:0/3940314010 shutdown_connections 2024-02-28T16:12:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.696+0000 7faedec00700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7faebc06d7f0 0x7faebc06fca0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.696+0000 7faedec00700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed80708c0 0x7faed810fba0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.696+0000 7faedec00700 1 --2- 172.21.15.57:0/3940314010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed8071f10 0x7faed81100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.696+0000 7faedec00700 1 -- 172.21.15.57:0/3940314010 >> 172.21.15.57:0/3940314010 conn(0x7faed80f8620 msgr2=0x7faed8102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.696+0000 7faedec00700 1 -- 172.21.15.57:0/3940314010 shutdown_connections 2024-02-28T16:12:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.696+0000 7faedec00700 1 -- 172.21.15.57:0/3940314010 wait complete. 2024-02-28T16:12:53.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.855+0000 7f14fc400700 1 -- 172.21.15.57:0/627343909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14f40fcef0 msgr2=0x7f14f40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:53.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.855+0000 7f14fc400700 1 --2- 172.21.15.57:0/627343909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14f40fcef0 0x7f14f40fd320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f14e8004940 tx=0x7f14e8009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:53.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.855+0000 7f14fc400700 1 -- 172.21.15.57:0/627343909 shutdown_connections 2024-02-28T16:12:53.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.855+0000 7f14fc400700 1 --2- 172.21.15.57:0/627343909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14f40fe0e0 0x7f14f40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.855+0000 7f14fc400700 1 --2- 172.21.15.57:0/627343909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14f40fcef0 0x7f14f40fd320 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.855+0000 7f14fc400700 1 -- 172.21.15.57:0/627343909 >> 172.21.15.57:0/627343909 conn(0x7f14f40f8620 msgr2=0x7f14f40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.855+0000 7f14fc400700 1 -- 172.21.15.57:0/627343909 shutdown_connections 2024-02-28T16:12:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.855+0000 7f14fc400700 1 -- 172.21.15.57:0/627343909 wait complete. 2024-02-28T16:12:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.856+0000 7f14fc400700 1 Processor -- start 2024-02-28T16:12:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.856+0000 7f14fc400700 1 -- start start 2024-02-28T16:12:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.856+0000 7f14fc400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14f40fcef0 0x7f14f410fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.856+0000 7f14fc400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14f40fe0e0 0x7f14f41100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.857+0000 7f14fc400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f41106f0 con 0x7f14f40fcef0 2024-02-28T16:12:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.857+0000 7f14fc400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f4110f90 con 0x7f14f40fe0e0 2024-02-28T16:12:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.857+0000 7f14f9a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14f40fcef0 0x7f14f410fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.857+0000 7f14f9a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14f40fcef0 0x7f14f410fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44380/0 (socket says 172.21.15.57:44380) 2024-02-28T16:12:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.857+0000 7f14f9a00700 1 -- 172.21.15.57:0/1522587378 learned_addr learned my addr 172.21.15.57:0/1522587378 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.857+0000 7f14f9a00700 1 -- 172.21.15.57:0/1522587378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14f40fe0e0 msgr2=0x7f14f41100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.857+0000 7f14f9000700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14f40fe0e0 0x7f14f41100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.857+0000 7f14f9a00700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14f40fe0e0 0x7f14f41100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.857+0000 7f14f9a00700 1 -- 172.21.15.57:0/1522587378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e8005040 con 0x7f14f40fcef0 2024-02-28T16:12:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.858+0000 7f14f9a00700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14f40fcef0 0x7f14f410fbb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f14e8000c00 tx=0x7f14e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.858+0000 7f14f1600700 1 -- 172.21.15.57:0/1522587378 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e800e040 con 0x7f14f40fcef0 2024-02-28T16:12:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.858+0000 7f14f1600700 1 -- 172.21.15.57:0/1522587378 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14e800bcc0 con 0x7f14f40fcef0 2024-02-28T16:12:53.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.858+0000 7f14fc400700 1 -- 172.21.15.57:0/1522587378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f4111210 con 0x7f14f40fcef0 2024-02-28T16:12:53.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.858+0000 7f14f1600700 1 -- 172.21.15.57:0/1522587378 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e8013ea0 con 0x7f14f40fcef0 2024-02-28T16:12:53.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.858+0000 7f14fc400700 1 -- 172.21.15.57:0/1522587378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f4111750 con 0x7f14f40fcef0 2024-02-28T16:12:53.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.860+0000 7f14fc400700 1 -- 172.21.15.57:0/1522587378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f4102210 con 0x7f14f40fcef0 2024-02-28T16:12:53.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.861+0000 7f14f1600700 1 -- 172.21.15.57:0/1522587378 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f14e8013420 con 0x7f14f40fcef0 2024-02-28T16:12:53.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.862+0000 7f14f1600700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14dc06d7f0 0x7f14dc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:53.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.862+0000 7f14f1600700 1 -- 172.21.15.57:0/1522587378 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f14e808e2c0 con 0x7f14f40fcef0 2024-02-28T16:12:53.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.862+0000 7f14f9000700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14dc06d7f0 0x7f14dc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:53.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.863+0000 7f14f9000700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14dc06d7f0 0x7f14dc06fca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f14e0004d60 tx=0x7f14e000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:53.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:53.867+0000 7f14f1600700 1 -- 172.21.15.57:0/1522587378 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f14e805b560 con 0x7f14f40fcef0 2024-02-28T16:12:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.158+0000 7f14fc400700 1 -- 172.21.15.57:0/1522587378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f14f402b340 con 0x7f14f40fcef0 2024-02-28T16:12:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.159+0000 7f14f1600700 1 -- 172.21.15.57:0/1522587378 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1889 (secure 0 0 0) 0x7f14e805b0f0 con 0x7f14f40fcef0 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:e41 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 41 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:12:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:12:37.537945+0000 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 101 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=34490,1=34522} 2024-02-28T16:12:54.153 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:34490} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{0:44391} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6824/571403132,v1:172.21.15.87:6825/571403132] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{1:34522} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.57:6828/2553742021,v1:172.21.15.57:6829/2553742021] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:44405} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/2114762616,v1:172.21.15.87:6827/2114762616] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:12:54.154 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:12:54.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.163+0000 7f14fc400700 1 -- 172.21.15.57:0/1522587378 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14dc06d7f0 msgr2=0x7f14dc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:54.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.163+0000 7f14fc400700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14dc06d7f0 0x7f14dc06fca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f14e0004d60 tx=0x7f14e000b040 comp rx=0 tx=0).stop 2024-02-28T16:12:54.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.163+0000 7f14fc400700 1 -- 172.21.15.57:0/1522587378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14f40fcef0 msgr2=0x7f14f410fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:54.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.163+0000 7f14fc400700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14f40fcef0 0x7f14f410fbb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f14e8000c00 tx=0x7f14e8009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:54.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.163+0000 7f14fc400700 1 -- 172.21.15.57:0/1522587378 shutdown_connections 2024-02-28T16:12:54.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.163+0000 7f14fc400700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f14dc06d7f0 0x7f14dc06fca0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.163+0000 7f14fc400700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14f40fcef0 0x7f14f410fbb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.163+0000 7f14fc400700 1 --2- 172.21.15.57:0/1522587378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14f40fe0e0 0x7f14f41100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.163+0000 7f14fc400700 1 -- 172.21.15.57:0/1522587378 >> 172.21.15.57:0/1522587378 conn(0x7f14f40f8620 msgr2=0x7f14f40ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:54.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.164+0000 7f14fc400700 1 -- 172.21.15.57:0/1522587378 shutdown_connections 2024-02-28T16:12:54.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.164+0000 7f14fc400700 1 -- 172.21.15.57:0/1522587378 wait complete. 2024-02-28T16:12:54.157 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2024-02-28T16:12:54.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.329+0000 7f8f46a00700 1 -- 172.21.15.57:0/3018516598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f400fe0e0 msgr2=0x7f8f400fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:54.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.329+0000 7f8f46a00700 1 --2- 172.21.15.57:0/3018516598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f400fe0e0 0x7f8f400fe550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c004940 tx=0x7f8f2c009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:54.321 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:54 smithi057 ceph-mon[93219]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:54.321 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:54 smithi057 ceph-mon[93219]: from='client.44417 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:54.321 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:54 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3940314010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:54.321 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:54 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1522587378' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:12:54.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.329+0000 7f8f46a00700 1 -- 172.21.15.57:0/3018516598 shutdown_connections 2024-02-28T16:12:54.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.329+0000 7f8f46a00700 1 --2- 172.21.15.57:0/3018516598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f400fe0e0 0x7f8f400fe550 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.329+0000 7f8f46a00700 1 --2- 172.21.15.57:0/3018516598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400fcef0 0x7f8f400fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.329+0000 7f8f46a00700 1 -- 172.21.15.57:0/3018516598 >> 172.21.15.57:0/3018516598 conn(0x7f8f400f8620 msgr2=0x7f8f400faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:54.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.329+0000 7f8f46a00700 1 -- 172.21.15.57:0/3018516598 shutdown_connections 2024-02-28T16:12:54.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.329+0000 7f8f46a00700 1 -- 172.21.15.57:0/3018516598 wait complete. 2024-02-28T16:12:54.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.330+0000 7f8f46a00700 1 Processor -- start 2024-02-28T16:12:54.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.330+0000 7f8f46a00700 1 -- start start 2024-02-28T16:12:54.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.331+0000 7f8f46a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400fcef0 0x7f8f40071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:54.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.331+0000 7f8f46a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f400fe0e0 0x7f8f400702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:54.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.331+0000 7f8f46a00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400708e0 con 0x7f8f400fe0e0 2024-02-28T16:12:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.331+0000 7f8f46a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40070a50 con 0x7f8f400fcef0 2024-02-28T16:12:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.331+0000 7f8f3f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f400fe0e0 0x7f8f400702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.331+0000 7f8f3fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400fcef0 0x7f8f40071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.331+0000 7f8f3fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400fcef0 0x7f8f40071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:38956/0 (socket says 172.21.15.57:38956) 2024-02-28T16:12:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.331+0000 7f8f3f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f400fe0e0 0x7f8f400702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44404/0 (socket says 172.21.15.57:44404) 2024-02-28T16:12:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.331+0000 7f8f3fe00700 1 -- 172.21.15.57:0/2301318531 learned_addr learned my addr 172.21.15.57:0/2301318531 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.332+0000 7f8f3f400700 1 -- 172.21.15.57:0/2301318531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400fcef0 msgr2=0x7f8f40071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.332+0000 7f8f3f400700 1 --2- 172.21.15.57:0/2301318531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400fcef0 0x7f8f40071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.332+0000 7f8f3f400700 1 -- 172.21.15.57:0/2301318531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c005040 con 0x7f8f400fe0e0 2024-02-28T16:12:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.332+0000 7f8f3f400700 1 --2- 172.21.15.57:0/2301318531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f400fe0e0 0x7f8f400702e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c000c00 tx=0x7f8f2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.333+0000 7f8f37e00700 1 -- 172.21.15.57:0/2301318531 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2c00e040 con 0x7f8f400fe0e0 2024-02-28T16:12:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.333+0000 7f8f37e00700 1 -- 172.21.15.57:0/2301318531 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f2c004290 con 0x7f8f400fe0e0 2024-02-28T16:12:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.333+0000 7f8f46a00700 1 -- 172.21.15.57:0/2301318531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f40070cd0 con 0x7f8f400fe0e0 2024-02-28T16:12:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.333+0000 7f8f37e00700 1 -- 172.21.15.57:0/2301318531 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2c01c3f0 con 0x7f8f400fe0e0 2024-02-28T16:12:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.333+0000 7f8f46a00700 1 -- 172.21.15.57:0/2301318531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f401159a0 con 0x7f8f400fe0e0 2024-02-28T16:12:54.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.334+0000 7f8f46a00700 1 -- 172.21.15.57:0/2301318531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4004bed0 con 0x7f8f400fe0e0 2024-02-28T16:12:54.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.336+0000 7f8f37e00700 1 -- 172.21.15.57:0/2301318531 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f8f2c00bbf0 con 0x7f8f400fe0e0 2024-02-28T16:12:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.337+0000 7f8f37e00700 1 --2- 172.21.15.57:0/2301318531 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f2406d7f0 0x7f8f2406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.337+0000 7f8f37e00700 1 -- 172.21.15.57:0/2301318531 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f8f2c08e220 con 0x7f8f400fe0e0 2024-02-28T16:12:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.338+0000 7f8f3fe00700 1 --2- 172.21.15.57:0/2301318531 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f2406d7f0 0x7f8f2406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:54.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.339+0000 7f8f3fe00700 1 --2- 172.21.15.57:0/2301318531 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f2406d7f0 0x7f8f2406fca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8f40071bf0 tx=0x7f8f3000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:54.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.342+0000 7f8f37e00700 1 -- 172.21.15.57:0/2301318531 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8f2c05b560 con 0x7f8f400fe0e0 2024-02-28T16:12:54.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:54 smithi087 ceph-mon[82628]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:54.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:54 smithi087 ceph-mon[82628]: from='client.44417 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:54.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:54 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3940314010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:12:54.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:54 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1522587378' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:12:54.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.598+0000 7f8f46a00700 1 -- 172.21.15.57:0/2301318531 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f40102ac0 con 0x7f8f2406d7f0 2024-02-28T16:12:54.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.600+0000 7f8f37e00700 1 -- 172.21.15.57:0/2301318531 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f8f40102ac0 con 0x7f8f2406d7f0 2024-02-28T16:12:54.592 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:12:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:12:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:12:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:12:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:12:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:12:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:12:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "osd", 2024-02-28T16:12:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "mds", 2024-02-28T16:12:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:12:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:12:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "16/21 daemons upgraded", 2024-02-28T16:12:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-28T16:12:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:12:54.593 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:12:54.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 -- 172.21.15.57:0/2301318531 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f2406d7f0 msgr2=0x7f8f2406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:54.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 --2- 172.21.15.57:0/2301318531 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f2406d7f0 0x7f8f2406fca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8f40071bf0 tx=0x7f8f3000b040 comp rx=0 tx=0).stop 2024-02-28T16:12:54.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 -- 172.21.15.57:0/2301318531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f400fe0e0 msgr2=0x7f8f400702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:54.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 --2- 172.21.15.57:0/2301318531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f400fe0e0 0x7f8f400702e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c000c00 tx=0x7f8f2c009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:54.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 -- 172.21.15.57:0/2301318531 shutdown_connections 2024-02-28T16:12:54.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 --2- 172.21.15.57:0/2301318531 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f2406d7f0 0x7f8f2406fca0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 --2- 172.21.15.57:0/2301318531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400fcef0 0x7f8f40071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 --2- 172.21.15.57:0/2301318531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f400fe0e0 0x7f8f400702e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 -- 172.21.15.57:0/2301318531 >> 172.21.15.57:0/2301318531 conn(0x7f8f400f8620 msgr2=0x7f8f401013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:54.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 -- 172.21.15.57:0/2301318531 shutdown_connections 2024-02-28T16:12:54.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.603+0000 7f8f46a00700 1 -- 172.21.15.57:0/2301318531 wait complete. 2024-02-28T16:12:54.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.757+0000 7f060b000700 1 -- 172.21.15.57:0/166986496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0604070840 msgr2=0x7f0604070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.757+0000 7f060b000700 1 --2- 172.21.15.57:0/166986496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0604070840 0x7f0604070cb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f05f0004940 tx=0x7f05f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.758+0000 7f060b000700 1 -- 172.21.15.57:0/166986496 shutdown_connections 2024-02-28T16:12:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.758+0000 7f060b000700 1 --2- 172.21.15.57:0/166986496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0604070840 0x7f0604070cb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.758+0000 7f060b000700 1 --2- 172.21.15.57:0/166986496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0604071e90 0x7f0604070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.758+0000 7f060b000700 1 -- 172.21.15.57:0/166986496 >> 172.21.15.57:0/166986496 conn(0x7f06040f8620 msgr2=0x7f06040faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.758+0000 7f060b000700 1 -- 172.21.15.57:0/166986496 shutdown_connections 2024-02-28T16:12:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.758+0000 7f060b000700 1 -- 172.21.15.57:0/166986496 wait complete. 2024-02-28T16:12:54.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.759+0000 7f060b000700 1 Processor -- start 2024-02-28T16:12:54.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.759+0000 7f060b000700 1 -- start start 2024-02-28T16:12:54.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f060b000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0604070840 0x7f060410fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:54.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f060b000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0604071e90 0x7f0604110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:54.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f060b000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0604110610 con 0x7f0604071e90 2024-02-28T16:12:54.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f060b000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0604110eb0 con 0x7f0604070840 2024-02-28T16:12:54.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f0603400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0604071e90 0x7f0604110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:54.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f0603400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0604071e90 0x7f0604110010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44418/0 (socket says 172.21.15.57:44418) 2024-02-28T16:12:54.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f0603400700 1 -- 172.21.15.57:0/3651402800 learned_addr learned my addr 172.21.15.57:0/3651402800 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:12:54.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f0603e00700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0604070840 0x7f060410fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:54.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f0603400700 1 -- 172.21.15.57:0/3651402800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0604070840 msgr2=0x7f060410fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:54.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f0603400700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0604070840 0x7f060410fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:54.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.760+0000 7f0603400700 1 -- 172.21.15.57:0/3651402800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0005040 con 0x7f0604071e90 2024-02-28T16:12:54.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.761+0000 7f0603400700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0604071e90 0x7f0604110010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f05f00093b0 tx=0x7f05f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:54.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.761+0000 7f05fbe00700 1 -- 172.21.15.57:0/3651402800 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05f000e040 con 0x7f0604071e90 2024-02-28T16:12:54.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.761+0000 7f05fbe00700 1 -- 172.21.15.57:0/3651402800 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05f000bcc0 con 0x7f0604071e90 2024-02-28T16:12:54.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.761+0000 7f05fbe00700 1 -- 172.21.15.57:0/3651402800 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05f001c630 con 0x7f0604071e90 2024-02-28T16:12:54.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.761+0000 7f060b000700 1 -- 172.21.15.57:0/3651402800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0604111130 con 0x7f0604071e90 2024-02-28T16:12:54.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.762+0000 7f060b000700 1 -- 172.21.15.57:0/3651402800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0604111670 con 0x7f0604071e90 2024-02-28T16:12:54.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.763+0000 7f060b000700 1 -- 172.21.15.57:0/3651402800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060404bed0 con 0x7f0604071e90 2024-02-28T16:12:54.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.764+0000 7f05fbe00700 1 -- 172.21.15.57:0/3651402800 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f05f00139f0 con 0x7f0604071e90 2024-02-28T16:12:54.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.765+0000 7f05fbe00700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f05e806d7e0 0x7f05e806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:54.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.765+0000 7f05fbe00700 1 -- 172.21.15.57:0/3651402800 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f05f008e420 con 0x7f0604071e90 2024-02-28T16:12:54.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.766+0000 7f0603e00700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f05e806d7e0 0x7f05e806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:54.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.767+0000 7f0603e00700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f05e806d7e0 0x7f05e806fc90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f05f4007fd0 tx=0x7f05f4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:54.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:54.771+0000 7f05fbe00700 1 -- 172.21.15.57:0/3651402800 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f05f005b6a0 con 0x7f0604071e90 2024-02-28T16:12:55.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.106+0000 7f060b000700 1 -- 172.21.15.57:0/3651402800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0604107c00 con 0x7f0604071e90 2024-02-28T16:12:55.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.106+0000 7f05fbe00700 1 -- 172.21.15.57:0/3651402800 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f05f005b230 con 0x7f0604071e90 2024-02-28T16:12:55.099 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:12:55.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.109+0000 7f060b000700 1 -- 172.21.15.57:0/3651402800 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f05e806d7e0 msgr2=0x7f05e806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:55.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.109+0000 7f060b000700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f05e806d7e0 0x7f05e806fc90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f05f4007fd0 tx=0x7f05f4009040 comp rx=0 tx=0).stop 2024-02-28T16:12:55.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.109+0000 7f060b000700 1 -- 172.21.15.57:0/3651402800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0604071e90 msgr2=0x7f0604110010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:55.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.109+0000 7f060b000700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0604071e90 0x7f0604110010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f05f00093b0 tx=0x7f05f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:12:55.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.109+0000 7f060b000700 1 -- 172.21.15.57:0/3651402800 shutdown_connections 2024-02-28T16:12:55.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.109+0000 7f060b000700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f05e806d7e0 0x7f05e806fc90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:55.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.109+0000 7f060b000700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0604070840 0x7f060410fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:55.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.109+0000 7f060b000700 1 --2- 172.21.15.57:0/3651402800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0604071e90 0x7f0604110010 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:55.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.109+0000 7f060b000700 1 -- 172.21.15.57:0/3651402800 >> 172.21.15.57:0/3651402800 conn(0x7f06040f8620 msgr2=0x7f0604102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:55.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.110+0000 7f060b000700 1 -- 172.21.15.57:0/3651402800 shutdown_connections 2024-02-28T16:12:55.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:12:55.110+0000 7f060b000700 1 -- 172.21.15.57:0/3651402800 wait complete. 2024-02-28T16:12:55.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:55 smithi087 ceph-mon[82628]: pgmap v307: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 85 B/s wr, 5 op/s 2024-02-28T16:12:55.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:55 smithi087 ceph-mon[82628]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:55.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:55 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3651402800' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:12:55.644 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:55 smithi057 ceph-mon[93219]: pgmap v307: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 85 B/s wr, 5 op/s 2024-02-28T16:12:55.644 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:55 smithi057 ceph-mon[93219]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:12:55.644 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:55 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3651402800' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:12:56.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:56.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:56 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:56.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:56 smithi057 ceph-mon[93219]: pgmap v308: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4 op/s 2024-02-28T16:12:56.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:56.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:56 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:56.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:56 smithi087 ceph-mon[82628]: pgmap v308: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4 op/s 2024-02-28T16:12:59.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:58 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:59.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:58 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:59.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:58 smithi087 ceph-mon[82628]: pgmap v309: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:12:59.054 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:58 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:59.054 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:12:58 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:59.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:58 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:59.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:58 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:59.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:58 smithi057 ceph-mon[93219]: pgmap v309: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:12:59.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:58 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:12:59.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:12:58 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:01.386 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:01 smithi057 ceph-mon[93219]: pgmap v310: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:01.386 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:01 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:01.386 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:01 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:01.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:01 smithi087 ceph-mon[82628]: pgmap v310: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:01.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:01 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:01.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:01 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:03.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:03 smithi087 ceph-mon[82628]: pgmap v311: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:03.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:03 smithi057 ceph-mon[93219]: pgmap v311: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:04.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:04.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:04.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:13:04.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:04.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:04.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:13:05.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:05 smithi057 ceph-mon[93219]: pgmap v312: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:05.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:05 smithi087 ceph-mon[82628]: pgmap v312: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: pgmap v313: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:07 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: pgmap v313: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:13:07.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:07.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:07.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:13:07.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:13:07.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:07.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:07.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:07 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:09.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:09 smithi057 ceph-mon[93219]: pgmap v314: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:09.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:09 smithi087 ceph-mon[82628]: pgmap v314: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:10.278 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:10 smithi057 ceph-mon[93219]: Upgrade: Updating prometheus.smithi057 2024-02-28T16:13:10.278 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:10 smithi057 ceph-mon[93219]: Deploying daemon prometheus.smithi057 on smithi057 2024-02-28T16:13:10.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:10 smithi087 ceph-mon[82628]: Upgrade: Updating prometheus.smithi057 2024-02-28T16:13:10.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:10 smithi087 ceph-mon[82628]: Deploying daemon prometheus.smithi057 on smithi057 2024-02-28T16:13:11.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:11 smithi057 ceph-mon[93219]: pgmap v315: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:11.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:11 smithi087 ceph-mon[82628]: pgmap v315: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:13.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:13 smithi057 ceph-mon[93219]: pgmap v316: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:13.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:13 smithi087 ceph-mon[82628]: pgmap v316: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:15.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:15 smithi057 ceph-mon[93219]: pgmap v317: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:15.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:15 smithi087 ceph-mon[82628]: pgmap v317: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:17.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:17 smithi057 ceph-mon[93219]: pgmap v318: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:13:17.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:17 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:17.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:17 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:17.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:17 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:17.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:17 smithi087 ceph-mon[82628]: pgmap v318: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:13:17.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:17 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:17.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:17 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:17.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:17 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:19 smithi057 ceph-mon[93219]: pgmap v319: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:13:19.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:19 smithi087 ceph-mon[82628]: pgmap v319: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:19.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:13:21.407 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:21 smithi057 ceph-mon[93219]: pgmap v320: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:21.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:21 smithi087 ceph-mon[82628]: pgmap v320: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:23.423 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:23 smithi087 ceph-mon[82628]: pgmap v321: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:23.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:23 smithi057 ceph-mon[93219]: pgmap v321: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:24.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:24 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:24.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:24 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:24.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:24 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:24.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:24 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:25.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.281+0000 7f36d0e00700 1 -- 172.21.15.57:0/3441877706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36cc0663e0 msgr2=0x7f36cc101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.281+0000 7f36d0e00700 1 --2- 172.21.15.57:0/3441877706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36cc0663e0 0x7f36cc101ef0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f36bc004940 tx=0x7f36bc009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:25.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.281+0000 7f36d0e00700 1 -- 172.21.15.57:0/3441877706 shutdown_connections 2024-02-28T16:13:25.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.281+0000 7f36d0e00700 1 --2- 172.21.15.57:0/3441877706 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36cc102430 0x7f36cc104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.281+0000 7f36d0e00700 1 --2- 172.21.15.57:0/3441877706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36cc0663e0 0x7f36cc101ef0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.281+0000 7f36d0e00700 1 -- 172.21.15.57:0/3441877706 >> 172.21.15.57:0/3441877706 conn(0x7f36cc0f74e0 msgr2=0x7f36cc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:25.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.281+0000 7f36d0e00700 1 -- 172.21.15.57:0/3441877706 shutdown_connections 2024-02-28T16:13:25.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.281+0000 7f36d0e00700 1 -- 172.21.15.57:0/3441877706 wait complete. 2024-02-28T16:13:25.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.282+0000 7f36d0e00700 1 Processor -- start 2024-02-28T16:13:25.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.282+0000 7f36d0e00700 1 -- start start 2024-02-28T16:13:25.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.282+0000 7f36d0e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36cc0663e0 0x7f36cc10fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:25.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.282+0000 7f36d0e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36cc102430 0x7f36cc1100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:25.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.282+0000 7f36d0e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc1106f0 con 0x7f36cc0663e0 2024-02-28T16:13:25.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.282+0000 7f36d0e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc110f90 con 0x7f36cc102430 2024-02-28T16:13:25.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.283+0000 7f36c9e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36cc0663e0 0x7f36cc10fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:25.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.283+0000 7f36c9e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36cc0663e0 0x7f36cc10fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33812/0 (socket says 172.21.15.57:33812) 2024-02-28T16:13:25.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.283+0000 7f36c9e00700 1 -- 172.21.15.57:0/3669608452 learned_addr learned my addr 172.21.15.57:0/3669608452 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:25.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.283+0000 7f36c9400700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36cc102430 0x7f36cc1100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:25.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.283+0000 7f36c9e00700 1 -- 172.21.15.57:0/3669608452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36cc102430 msgr2=0x7f36cc1100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.283+0000 7f36c9e00700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36cc102430 0x7f36cc1100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.283+0000 7f36c9e00700 1 -- 172.21.15.57:0/3669608452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc005040 con 0x7f36cc0663e0 2024-02-28T16:13:25.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.283+0000 7f36c9e00700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36cc0663e0 0x7f36cc10fbb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00b3b0 tx=0x7f36bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:25.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.284+0000 7f36c2000700 1 -- 172.21.15.57:0/3669608452 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36bc00e040 con 0x7f36cc0663e0 2024-02-28T16:13:25.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.284+0000 7f36c2000700 1 -- 172.21.15.57:0/3669608452 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36bc00bd90 con 0x7f36cc0663e0 2024-02-28T16:13:25.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.284+0000 7f36c2000700 1 -- 172.21.15.57:0/3669608452 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36bc01c630 con 0x7f36cc0663e0 2024-02-28T16:13:25.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.284+0000 7f36d0e00700 1 -- 172.21.15.57:0/3669608452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36cc111210 con 0x7f36cc0663e0 2024-02-28T16:13:25.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.284+0000 7f36d0e00700 1 -- 172.21.15.57:0/3669608452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36cc111750 con 0x7f36cc0663e0 2024-02-28T16:13:25.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.285+0000 7f36d0e00700 1 -- 172.21.15.57:0/3669608452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36cc04bed0 con 0x7f36cc0663e0 2024-02-28T16:13:25.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.286+0000 7f36c2000700 1 -- 172.21.15.57:0/3669608452 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f36bc0139f0 con 0x7f36cc0663e0 2024-02-28T16:13:25.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.287+0000 7f36c2000700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f36b006d7f0 0x7f36b006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:25.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.287+0000 7f36c2000700 1 -- 172.21.15.57:0/3669608452 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f36bc08e510 con 0x7f36cc0663e0 2024-02-28T16:13:25.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.288+0000 7f36c9400700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f36b006d7f0 0x7f36b006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:25.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.288+0000 7f36c9400700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f36b006d7f0 0x7f36b006fca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f36b8007fd0 tx=0x7f36b8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:25.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.293+0000 7f36c2000700 1 -- 172.21.15.57:0/3669608452 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f36bc05b790 con 0x7f36cc0663e0 2024-02-28T16:13:25.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.543+0000 7f36d0e00700 1 -- 172.21.15.57:0/3669608452 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36cc103090 con 0x7f36b006d7f0 2024-02-28T16:13:25.534 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:25 smithi057 ceph-mon[93219]: pgmap v322: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:25.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.547+0000 7f36c2000700 1 -- 172.21.15.57:0/3669608452 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f36cc103090 con 0x7f36b006d7f0 2024-02-28T16:13:25.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.550+0000 7f36d0e00700 1 -- 172.21.15.57:0/3669608452 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f36b006d7f0 msgr2=0x7f36b006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.550+0000 7f36d0e00700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f36b006d7f0 0x7f36b006fca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f36b8007fd0 tx=0x7f36b8009040 comp rx=0 tx=0).stop 2024-02-28T16:13:25.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.550+0000 7f36d0e00700 1 -- 172.21.15.57:0/3669608452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36cc0663e0 msgr2=0x7f36cc10fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.550+0000 7f36d0e00700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36cc0663e0 0x7f36cc10fbb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00b3b0 tx=0x7f36bc009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:25.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.551+0000 7f36d0e00700 1 -- 172.21.15.57:0/3669608452 shutdown_connections 2024-02-28T16:13:25.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.551+0000 7f36d0e00700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f36b006d7f0 0x7f36b006fca0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.551+0000 7f36d0e00700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36cc0663e0 0x7f36cc10fbb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.551+0000 7f36d0e00700 1 --2- 172.21.15.57:0/3669608452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36cc102430 0x7f36cc1100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.551+0000 7f36d0e00700 1 -- 172.21.15.57:0/3669608452 >> 172.21.15.57:0/3669608452 conn(0x7f36cc0f74e0 msgr2=0x7f36cc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:25.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.551+0000 7f36d0e00700 1 -- 172.21.15.57:0/3669608452 shutdown_connections 2024-02-28T16:13:25.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.551+0000 7f36d0e00700 1 -- 172.21.15.57:0/3669608452 wait complete. 2024-02-28T16:13:25.559 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:13:25.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.704+0000 7faeb8000700 1 -- 172.21.15.57:0/1525626218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb0071f10 msgr2=0x7faeb0070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.704+0000 7faeb8000700 1 --2- 172.21.15.57:0/1525626218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb0071f10 0x7faeb0070380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faea4004940 tx=0x7faea4009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.704+0000 7faeb8000700 1 -- 172.21.15.57:0/1525626218 shutdown_connections 2024-02-28T16:13:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.704+0000 7faeb8000700 1 --2- 172.21.15.57:0/1525626218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb00708c0 0x7faeb0070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.704+0000 7faeb8000700 1 --2- 172.21.15.57:0/1525626218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb0071f10 0x7faeb0070380 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.704+0000 7faeb8000700 1 -- 172.21.15.57:0/1525626218 >> 172.21.15.57:0/1525626218 conn(0x7faeb00f8620 msgr2=0x7faeb00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.705+0000 7faeb8000700 1 -- 172.21.15.57:0/1525626218 shutdown_connections 2024-02-28T16:13:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.705+0000 7faeb8000700 1 -- 172.21.15.57:0/1525626218 wait complete. 2024-02-28T16:13:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.706+0000 7faeb8000700 1 Processor -- start 2024-02-28T16:13:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.706+0000 7faeb8000700 1 -- start start 2024-02-28T16:13:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.706+0000 7faeb8000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb00708c0 0x7faeb010fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.706+0000 7faeb8000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb0071f10 0x7faeb01100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.706+0000 7faeb8000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb01106e0 con 0x7faeb0071f10 2024-02-28T16:13:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.706+0000 7faeb8000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0110f80 con 0x7faeb00708c0 2024-02-28T16:13:25.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.706+0000 7faeb4c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb0071f10 0x7faeb01100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:25.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.707+0000 7faeb4c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb0071f10 0x7faeb01100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33826/0 (socket says 172.21.15.57:33826) 2024-02-28T16:13:25.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.707+0000 7faeb4c00700 1 -- 172.21.15.57:0/2490573083 learned_addr learned my addr 172.21.15.57:0/2490573083 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:25.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.707+0000 7faeb5600700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb00708c0 0x7faeb010fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.707+0000 7faeb4c00700 1 -- 172.21.15.57:0/2490573083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb00708c0 msgr2=0x7faeb010fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.707+0000 7faeb4c00700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb00708c0 0x7faeb010fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.707+0000 7faeb4c00700 1 -- 172.21.15.57:0/2490573083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea4005040 con 0x7faeb0071f10 2024-02-28T16:13:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.707+0000 7faeb4c00700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb0071f10 0x7faeb01100e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c830 tx=0x7fae9c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.708+0000 7faead600700 1 -- 172.21.15.57:0/2490573083 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae9c00a760 con 0x7faeb0071f10 2024-02-28T16:13:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.708+0000 7faead600700 1 -- 172.21.15.57:0/2490573083 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae9c00ad90 con 0x7faeb0071f10 2024-02-28T16:13:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.708+0000 7faeb8000700 1 -- 172.21.15.57:0/2490573083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb0111260 con 0x7faeb0071f10 2024-02-28T16:13:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.708+0000 7faead600700 1 -- 172.21.15.57:0/2490573083 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae9c0113a0 con 0x7faeb0071f10 2024-02-28T16:13:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.708+0000 7faeb8000700 1 -- 172.21.15.57:0/2490573083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb01117a0 con 0x7faeb0071f10 2024-02-28T16:13:25.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.709+0000 7faeb8000700 1 -- 172.21.15.57:0/2490573083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb004bed0 con 0x7faeb0071f10 2024-02-28T16:13:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.711+0000 7faead600700 1 -- 172.21.15.57:0/2490573083 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fae9c012400 con 0x7faeb0071f10 2024-02-28T16:13:25.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.712+0000 7faead600700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9806d7f0 0x7fae9806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:25.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.712+0000 7faead600700 1 -- 172.21.15.57:0/2490573083 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fae9c08d0e0 con 0x7faeb0071f10 2024-02-28T16:13:25.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.712+0000 7faeb5600700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9806d7f0 0x7fae9806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:25.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.713+0000 7faeb5600700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9806d7f0 0x7fae9806fca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faea4004f90 tx=0x7faea4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:25.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.720+0000 7faead600700 1 -- 172.21.15.57:0/2490573083 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fae9c05a2e0 con 0x7faeb0071f10 2024-02-28T16:13:25.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:25 smithi087 ceph-mon[82628]: pgmap v322: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:25.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.973+0000 7faeb8000700 1 -- 172.21.15.57:0/2490573083 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faeb01044f0 con 0x7fae9806d7f0 2024-02-28T16:13:25.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.975+0000 7faead600700 1 -- 172.21.15.57:0/2490573083 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7faeb01044f0 con 0x7fae9806d7f0 2024-02-28T16:13:25.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.978+0000 7faeb8000700 1 -- 172.21.15.57:0/2490573083 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9806d7f0 msgr2=0x7fae9806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.978+0000 7faeb8000700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9806d7f0 0x7fae9806fca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faea4004f90 tx=0x7faea4009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:25.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.978+0000 7faeb8000700 1 -- 172.21.15.57:0/2490573083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb0071f10 msgr2=0x7faeb01100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:25.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.978+0000 7faeb8000700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb0071f10 0x7faeb01100e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c830 tx=0x7fae9c004470 comp rx=0 tx=0).stop 2024-02-28T16:13:25.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.978+0000 7faeb8000700 1 -- 172.21.15.57:0/2490573083 shutdown_connections 2024-02-28T16:13:25.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.978+0000 7faeb8000700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fae9806d7f0 0x7fae9806fca0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.978+0000 7faeb8000700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb00708c0 0x7faeb010fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.978+0000 7faeb8000700 1 --2- 172.21.15.57:0/2490573083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faeb0071f10 0x7faeb01100e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:25.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.978+0000 7faeb8000700 1 -- 172.21.15.57:0/2490573083 >> 172.21.15.57:0/2490573083 conn(0x7faeb00f8620 msgr2=0x7faeb0102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:25.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.979+0000 7faeb8000700 1 -- 172.21.15.57:0/2490573083 shutdown_connections 2024-02-28T16:13:25.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:25.979+0000 7faeb8000700 1 -- 172.21.15.57:0/2490573083 wait complete. 2024-02-28T16:13:26.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.143+0000 7fc5e4800700 1 -- 172.21.15.57:0/3708244781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5dc0708c0 msgr2=0x7fc5dc070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.143+0000 7fc5e4800700 1 --2- 172.21.15.57:0/3708244781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5dc0708c0 0x7fc5dc070d10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc004940 tx=0x7fc5cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:26.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.143+0000 7fc5e4800700 1 -- 172.21.15.57:0/3708244781 shutdown_connections 2024-02-28T16:13:26.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.143+0000 7fc5e4800700 1 --2- 172.21.15.57:0/3708244781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5dc0708c0 0x7fc5dc070d10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.143+0000 7fc5e4800700 1 --2- 172.21.15.57:0/3708244781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc071f10 0x7fc5dc070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.143+0000 7fc5e4800700 1 -- 172.21.15.57:0/3708244781 >> 172.21.15.57:0/3708244781 conn(0x7fc5dc0f8620 msgr2=0x7fc5dc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:26.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.143+0000 7fc5e4800700 1 -- 172.21.15.57:0/3708244781 shutdown_connections 2024-02-28T16:13:26.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.143+0000 7fc5e4800700 1 -- 172.21.15.57:0/3708244781 wait complete. 2024-02-28T16:13:26.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.144+0000 7fc5e4800700 1 Processor -- start 2024-02-28T16:13:26.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.144+0000 7fc5e4800700 1 -- start start 2024-02-28T16:13:26.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.144+0000 7fc5e4800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc0708c0 0x7fc5dc10fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:26.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.144+0000 7fc5e4800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5dc071f10 0x7fc5dc1100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:26.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.144+0000 7fc5e4800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1106b0 con 0x7fc5dc071f10 2024-02-28T16:13:26.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.144+0000 7fc5e4800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc110f50 con 0x7fc5dc0708c0 2024-02-28T16:13:26.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.145+0000 7fc5e1400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5dc071f10 0x7fc5dc1100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:26.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.145+0000 7fc5e1400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5dc071f10 0x7fc5dc1100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33846/0 (socket says 172.21.15.57:33846) 2024-02-28T16:13:26.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.145+0000 7fc5e1400700 1 -- 172.21.15.57:0/3227955992 learned_addr learned my addr 172.21.15.57:0/3227955992 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:26.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.145+0000 7fc5e1e00700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc0708c0 0x7fc5dc10fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:26.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.145+0000 7fc5e1400700 1 -- 172.21.15.57:0/3227955992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc0708c0 msgr2=0x7fc5dc10fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.145+0000 7fc5e1400700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc0708c0 0x7fc5dc10fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.145+0000 7fc5e1400700 1 -- 172.21.15.57:0/3227955992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc005040 con 0x7fc5dc071f10 2024-02-28T16:13:26.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.146+0000 7fc5e1400700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5dc071f10 0x7fc5dc1100b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009fd0 tx=0x7fc5cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:26.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.146+0000 7fc5d6000700 1 -- 172.21.15.57:0/3227955992 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc00e040 con 0x7fc5dc071f10 2024-02-28T16:13:26.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.146+0000 7fc5d6000700 1 -- 172.21.15.57:0/3227955992 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5cc004290 con 0x7fc5dc071f10 2024-02-28T16:13:26.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.146+0000 7fc5e4800700 1 -- 172.21.15.57:0/3227955992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc1111d0 con 0x7fc5dc071f10 2024-02-28T16:13:26.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.146+0000 7fc5d6000700 1 -- 172.21.15.57:0/3227955992 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc01c630 con 0x7fc5dc071f10 2024-02-28T16:13:26.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.146+0000 7fc5e4800700 1 -- 172.21.15.57:0/3227955992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc111710 con 0x7fc5dc071f10 2024-02-28T16:13:26.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.148+0000 7fc5e4800700 1 -- 172.21.15.57:0/3227955992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc04bed0 con 0x7fc5dc071f10 2024-02-28T16:13:26.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.148+0000 7fc5d6000700 1 -- 172.21.15.57:0/3227955992 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc5cc01c8a0 con 0x7fc5dc071f10 2024-02-28T16:13:26.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.149+0000 7fc5d6000700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc5c406d7f0 0x7fc5c406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:26.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.149+0000 7fc5d6000700 1 -- 172.21.15.57:0/3227955992 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fc5cc08e1f0 con 0x7fc5dc071f10 2024-02-28T16:13:26.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.150+0000 7fc5e1e00700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc5c406d7f0 0x7fc5c406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:26.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.150+0000 7fc5e1e00700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc5c406d7f0 0x7fc5c406fca0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0004990 tx=0x7fc5d0009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:26.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.154+0000 7fc5d6000700 1 -- 172.21.15.57:0/3227955992 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc5cc05b410 con 0x7fc5dc071f10 2024-02-28T16:13:26.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.401+0000 7fc5e4800700 1 -- 172.21.15.57:0/3227955992 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5dc111b20 con 0x7fc5c406d7f0 2024-02-28T16:13:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.414+0000 7fc5d6000700 1 -- 172.21.15.57:0/3227955992 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc5dc111b20 con 0x7fc5c406d7f0 2024-02-28T16:13:26.404 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (11m) 3s ago 22m 15.0M - 0.25.0 c8568f914cd2 23100adcb2ac 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (7m) 3s ago 22m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (7m) 30s ago 21m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (11m) 3s ago 22m 74.8M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (2m) 3s ago 15m 66.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b df14dcf6973e 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (113s) 3s ago 15m 14.6M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 977aa1867016 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (87s) 30s ago 15m 65.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1ee4a125f5b 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (63s) 30s ago 15m 12.5M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b0b892c8725f 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (10m) 3s ago 24m 513M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (9m) 30s ago 21m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (9m) 3s ago 24m 59.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (8m) 30s ago 20m 45.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (42s) 3s ago 22m 7155k - 1.5.0 0da6a335fe13 6e10666d4d1f 2024-02-28T16:13:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (35s) 30s ago 21m 3011k - 1.5.0 0da6a335fe13 285db7ba57fc 2024-02-28T16:13:26.406 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (6m) 3s ago 20m 134M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:13:26.406 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (6m) 3s ago 19m 106M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:13:26.406 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (5m) 3s ago 18m 99.8M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:13:26.406 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (4m) 30s ago 18m 107M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:13:26.406 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (4m) 30s ago 17m 94.0M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:13:26.406 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (3m) 30s ago 17m 93.9M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b cbdb6df47634 2024-02-28T16:13:26.406 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (9s) 3s ago 21m 38.3M - 2.43.0 a07b618ecd1d 33bac790aba5 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 -- 172.21.15.57:0/3227955992 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc5c406d7f0 msgr2=0x7fc5c406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc5c406d7f0 0x7fc5c406fca0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0004990 tx=0x7fc5d0009ee0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 -- 172.21.15.57:0/3227955992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5dc071f10 msgr2=0x7fc5dc1100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5dc071f10 0x7fc5dc1100b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009fd0 tx=0x7fc5cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 -- 172.21.15.57:0/3227955992 shutdown_connections 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc5c406d7f0 0x7fc5c406fca0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc0708c0 0x7fc5dc10fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 --2- 172.21.15.57:0/3227955992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5dc071f10 0x7fc5dc1100b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 -- 172.21.15.57:0/3227955992 >> 172.21.15.57:0/3227955992 conn(0x7fc5dc0f8620 msgr2=0x7fc5dc102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 -- 172.21.15.57:0/3227955992 shutdown_connections 2024-02-28T16:13:26.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.417+0000 7fc5e4800700 1 -- 172.21.15.57:0/3227955992 wait complete. 2024-02-28T16:13:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.573+0000 7f6deda00700 1 -- 172.21.15.57:0/3049836800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de80fe0e0 msgr2=0x7f6de80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.573+0000 7f6deda00700 1 --2- 172.21.15.57:0/3049836800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de80fe0e0 0x7f6de80fe550 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4004940 tx=0x7f6dd4009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.573+0000 7f6deda00700 1 -- 172.21.15.57:0/3049836800 shutdown_connections 2024-02-28T16:13:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.573+0000 7f6deda00700 1 --2- 172.21.15.57:0/3049836800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de80fe0e0 0x7f6de80fe550 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.573+0000 7f6deda00700 1 --2- 172.21.15.57:0/3049836800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6de80fcef0 0x7f6de80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.573+0000 7f6deda00700 1 -- 172.21.15.57:0/3049836800 >> 172.21.15.57:0/3049836800 conn(0x7f6de80f8620 msgr2=0x7f6de80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.573+0000 7f6deda00700 1 -- 172.21.15.57:0/3049836800 shutdown_connections 2024-02-28T16:13:26.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.573+0000 7f6deda00700 1 -- 172.21.15.57:0/3049836800 wait complete. 2024-02-28T16:13:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.574+0000 7f6deda00700 1 Processor -- start 2024-02-28T16:13:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.574+0000 7f6deda00700 1 -- start start 2024-02-28T16:13:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.574+0000 7f6deda00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6de80fcef0 0x7f6de810fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.574+0000 7f6deda00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de80fe0e0 0x7f6de8110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.574+0000 7f6deda00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8110600 con 0x7f6de80fe0e0 2024-02-28T16:13:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.574+0000 7f6deda00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8110ea0 con 0x7f6de80fcef0 2024-02-28T16:13:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.575+0000 7f6de6000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de80fe0e0 0x7f6de8110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.575+0000 7f6de6000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de80fe0e0 0x7f6de8110000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33852/0 (socket says 172.21.15.57:33852) 2024-02-28T16:13:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.575+0000 7f6de6000700 1 -- 172.21.15.57:0/4045532401 learned_addr learned my addr 172.21.15.57:0/4045532401 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.575+0000 7f6de6a00700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6de80fcef0 0x7f6de810fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:26.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.575+0000 7f6de6000700 1 -- 172.21.15.57:0/4045532401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6de80fcef0 msgr2=0x7f6de810fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.575+0000 7f6de6000700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6de80fcef0 0x7f6de810fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.575+0000 7f6de6000700 1 -- 172.21.15.57:0/4045532401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4005040 con 0x7f6de80fe0e0 2024-02-28T16:13:26.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.575+0000 7f6de6000700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de80fe0e0 0x7f6de8110000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4009fd0 tx=0x7f6dd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:26.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.576+0000 7f6ddea00700 1 -- 172.21.15.57:0/4045532401 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd400e070 con 0x7f6de80fe0e0 2024-02-28T16:13:26.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.576+0000 7f6ddea00700 1 -- 172.21.15.57:0/4045532401 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6dd401c400 con 0x7f6de80fe0e0 2024-02-28T16:13:26.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.576+0000 7f6ddea00700 1 -- 172.21.15.57:0/4045532401 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd400b650 con 0x7f6de80fe0e0 2024-02-28T16:13:26.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.576+0000 7f6deda00700 1 -- 172.21.15.57:0/4045532401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de8111120 con 0x7f6de80fe0e0 2024-02-28T16:13:26.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.576+0000 7f6deda00700 1 -- 172.21.15.57:0/4045532401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de8111600 con 0x7f6de80fe0e0 2024-02-28T16:13:26.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.577+0000 7f6deda00700 1 -- 172.21.15.57:0/4045532401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de8102210 con 0x7f6de80fe0e0 2024-02-28T16:13:26.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.578+0000 7f6ddea00700 1 -- 172.21.15.57:0/4045532401 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6dd401c570 con 0x7f6de80fe0e0 2024-02-28T16:13:26.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.579+0000 7f6ddea00700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6dcc06d7f0 0x7f6dcc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:26.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.579+0000 7f6ddea00700 1 -- 172.21.15.57:0/4045532401 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f6dd408e7a0 con 0x7f6de80fe0e0 2024-02-28T16:13:26.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.579+0000 7f6de6a00700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6dcc06d7f0 0x7f6dcc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:26.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.580+0000 7f6de6a00700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6dcc06d7f0 0x7f6dcc06fca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6de80fcc30 tx=0x7f6dd800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:26.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.585+0000 7f6ddea00700 1 -- 172.21.15.57:0/4045532401 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6dd405ba20 con 0x7f6de80fe0e0 2024-02-28T16:13:26.665 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:26 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:26.665 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:26 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:26.666 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:26 smithi057 ceph-mon[93219]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:26.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.913+0000 7f6deda00700 1 -- 172.21.15.57:0/4045532401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6de8105a30 con 0x7f6de80fe0e0 2024-02-28T16:13:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.914+0000 7f6ddea00700 1 -- 172.21.15.57:0/4045532401 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f6dd405b5b0 con 0x7f6de80fe0e0 2024-02-28T16:13:26.905 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:13:26.905 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:13:26.905 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:13:26.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:13:26.906 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:13:26.906 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:13:26.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:13:26.906 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:13:26.906 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:13:26.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:13:26.907 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:13:26.907 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:13:26.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:13:26.907 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:13:26.907 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:13:26.908 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:13:26.908 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:13:26.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 -- 172.21.15.57:0/4045532401 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6dcc06d7f0 msgr2=0x7f6dcc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6dcc06d7f0 0x7f6dcc06fca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6de80fcc30 tx=0x7f6dd800b040 comp rx=0 tx=0).stop 2024-02-28T16:13:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 -- 172.21.15.57:0/4045532401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de80fe0e0 msgr2=0x7f6de8110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de80fe0e0 0x7f6de8110000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4009fd0 tx=0x7f6dd4009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 -- 172.21.15.57:0/4045532401 shutdown_connections 2024-02-28T16:13:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f6dcc06d7f0 0x7f6dcc06fca0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6de80fcef0 0x7f6de810fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 --2- 172.21.15.57:0/4045532401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de80fe0e0 0x7f6de8110000 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 -- 172.21.15.57:0/4045532401 >> 172.21.15.57:0/4045532401 conn(0x7f6de80f8620 msgr2=0x7f6de80ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:26.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 -- 172.21.15.57:0/4045532401 shutdown_connections 2024-02-28T16:13:26.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:26.917+0000 7f6deda00700 1 -- 172.21.15.57:0/4045532401 wait complete. 2024-02-28T16:13:26.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:26 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:26.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:26 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:26.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:26 smithi087 ceph-mon[82628]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.073+0000 7fe862000700 1 -- 172.21.15.57:0/3168196375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe85c104750 msgr2=0x7fe85c104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.073+0000 7fe862000700 1 --2- 172.21.15.57:0/3168196375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe85c104750 0x7fe85c104ba0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe848004940 tx=0x7fe848009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.073+0000 7fe862000700 1 -- 172.21.15.57:0/3168196375 shutdown_connections 2024-02-28T16:13:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.073+0000 7fe862000700 1 --2- 172.21.15.57:0/3168196375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe85c104750 0x7fe85c104ba0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.073+0000 7fe862000700 1 --2- 172.21.15.57:0/3168196375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe85c103540 0x7fe85c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.073+0000 7fe862000700 1 -- 172.21.15.57:0/3168196375 >> 172.21.15.57:0/3168196375 conn(0x7fe85c0727d0 msgr2=0x7fe85c074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:27.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.073+0000 7fe862000700 1 -- 172.21.15.57:0/3168196375 shutdown_connections 2024-02-28T16:13:27.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.073+0000 7fe862000700 1 -- 172.21.15.57:0/3168196375 wait complete. 2024-02-28T16:13:27.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.074+0000 7fe862000700 1 Processor -- start 2024-02-28T16:13:27.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.074+0000 7fe862000700 1 -- start start 2024-02-28T16:13:27.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe862000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe85c103540 0x7fe85c113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe862000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe85c104750 0x7fe85c1144c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe862000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c114ac0 con 0x7fe85c104750 2024-02-28T16:13:27.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe862000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c115360 con 0x7fe85c103540 2024-02-28T16:13:27.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe85aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe85c104750 0x7fe85c1144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe85aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe85c104750 0x7fe85c1144c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33874/0 (socket says 172.21.15.57:33874) 2024-02-28T16:13:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe85aa00700 1 -- 172.21.15.57:0/376624354 learned_addr learned my addr 172.21.15.57:0/376624354 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe85b400700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe85c103540 0x7fe85c113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe85aa00700 1 -- 172.21.15.57:0/376624354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe85c103540 msgr2=0x7fe85c113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe85aa00700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe85c103540 0x7fe85c113f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe85aa00700 1 -- 172.21.15.57:0/376624354 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848005040 con 0x7fe85c104750 2024-02-28T16:13:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.075+0000 7fe85b400700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe85c103540 0x7fe85c113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:13:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.076+0000 7fe85aa00700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe85c104750 0x7fe85c1144c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe84800b3b0 tx=0x7fe848009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:27.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.076+0000 7fe853400700 1 -- 172.21.15.57:0/376624354 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe84800e040 con 0x7fe85c104750 2024-02-28T16:13:27.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.076+0000 7fe862000700 1 -- 172.21.15.57:0/376624354 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85c1155e0 con 0x7fe85c104750 2024-02-28T16:13:27.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.076+0000 7fe853400700 1 -- 172.21.15.57:0/376624354 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe84800bd90 con 0x7fe85c104750 2024-02-28T16:13:27.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.076+0000 7fe853400700 1 -- 172.21.15.57:0/376624354 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe84801c630 con 0x7fe85c104750 2024-02-28T16:13:27.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.076+0000 7fe862000700 1 -- 172.21.15.57:0/376624354 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c115b20 con 0x7fe85c104750 2024-02-28T16:13:27.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.077+0000 7fe862000700 1 -- 172.21.15.57:0/376624354 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85c04bed0 con 0x7fe85c104750 2024-02-28T16:13:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.078+0000 7fe853400700 1 -- 172.21.15.57:0/376624354 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe8480139f0 con 0x7fe85c104750 2024-02-28T16:13:27.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.079+0000 7fe853400700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe84006d7f0 0x7fe84006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.079+0000 7fe853400700 1 -- 172.21.15.57:0/376624354 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fe84808e5e0 con 0x7fe85c104750 2024-02-28T16:13:27.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.079+0000 7fe85b400700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe84006d7f0 0x7fe84006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.080+0000 7fe85b400700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe84006d7f0 0x7fe84006fca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe84c0041d0 tx=0x7fe84c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:27.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.084+0000 7fe853400700 1 -- 172.21.15.57:0/376624354 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe84805b7e0 con 0x7fe85c104750 2024-02-28T16:13:27.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.360+0000 7fe862000700 1 -- 172.21.15.57:0/376624354 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe85c10c040 con 0x7fe85c104750 2024-02-28T16:13:27.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.361+0000 7fe853400700 1 -- 172.21.15.57:0/376624354 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1889 (secure 0 0 0) 0x7fe84805b370 con 0x7fe85c104750 2024-02-28T16:13:27.352 INFO:teuthology.orchestra.run.smithi057.stdout:e41 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 41 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:12:37.537945+0000 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:13:27.353 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 101 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=34490,1=34522} 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:13:27.354 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:13:27.355 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:13:27.355 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:13:27.355 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:13:27.355 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:13:27.355 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:34490} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:13:27.355 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{0:44391} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6824/571403132,v1:172.21.15.87:6825/571403132] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:13:27.355 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{1:34522} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.57:6828/2553742021,v1:172.21.15.57:6829/2553742021] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:13:27.355 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:44405} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/2114762616,v1:172.21.15.87:6827/2114762616] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:13:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:13:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:13:27.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.364+0000 7fe862000700 1 -- 172.21.15.57:0/376624354 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe84006d7f0 msgr2=0x7fe84006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.364+0000 7fe862000700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe84006d7f0 0x7fe84006fca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe84c0041d0 tx=0x7fe84c009040 comp rx=0 tx=0).stop 2024-02-28T16:13:27.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.364+0000 7fe862000700 1 -- 172.21.15.57:0/376624354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe85c104750 msgr2=0x7fe85c1144c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.364+0000 7fe862000700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe85c104750 0x7fe85c1144c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe84800b3b0 tx=0x7fe848009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:27.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.364+0000 7fe862000700 1 -- 172.21.15.57:0/376624354 shutdown_connections 2024-02-28T16:13:27.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.364+0000 7fe862000700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe84006d7f0 0x7fe84006fca0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.364+0000 7fe862000700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe85c103540 0x7fe85c113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.364+0000 7fe862000700 1 --2- 172.21.15.57:0/376624354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe85c104750 0x7fe85c1144c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.364+0000 7fe862000700 1 -- 172.21.15.57:0/376624354 >> 172.21.15.57:0/376624354 conn(0x7fe85c0727d0 msgr2=0x7fe85c107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:27.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.365+0000 7fe862000700 1 -- 172.21.15.57:0/376624354 shutdown_connections 2024-02-28T16:13:27.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.365+0000 7fe862000700 1 -- 172.21.15.57:0/376624354 wait complete. 2024-02-28T16:13:27.357 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2024-02-28T16:13:27.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.516+0000 7f09a5000700 1 -- 172.21.15.57:0/1708292896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a0072890 msgr2=0x7f09a0072ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.516+0000 7f09a5000700 1 --2- 172.21.15.57:0/1708292896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a0072890 0x7f09a0072ca0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0990004940 tx=0x7f0990009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.516+0000 7f09a5000700 1 -- 172.21.15.57:0/1708292896 shutdown_connections 2024-02-28T16:13:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.516+0000 7f09a5000700 1 --2- 172.21.15.57:0/1708292896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a0073af0 0x7f09a0073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.516+0000 7f09a5000700 1 --2- 172.21.15.57:0/1708292896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a0072890 0x7f09a0072ca0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.516+0000 7f09a5000700 1 -- 172.21.15.57:0/1708292896 >> 172.21.15.57:0/1708292896 conn(0x7f09a00fa920 msgr2=0x7f09a00fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.517+0000 7f09a5000700 1 -- 172.21.15.57:0/1708292896 shutdown_connections 2024-02-28T16:13:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.517+0000 7f09a5000700 1 -- 172.21.15.57:0/1708292896 wait complete. 2024-02-28T16:13:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.517+0000 7f09a5000700 1 Processor -- start 2024-02-28T16:13:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.518+0000 7f09a5000700 1 -- start start 2024-02-28T16:13:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.518+0000 7f09a5000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a0072890 0x7f09a0113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.518+0000 7f09a5000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a0073af0 0x7f09a01144e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.518+0000 7f09a5000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0114ae0 con 0x7f09a0072890 2024-02-28T16:13:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.518+0000 7f09a5000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0115380 con 0x7f09a0073af0 2024-02-28T16:13:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.518+0000 7f099de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a0072890 0x7f09a0113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.518+0000 7f099de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a0072890 0x7f09a0113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33890/0 (socket says 172.21.15.57:33890) 2024-02-28T16:13:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.518+0000 7f099de00700 1 -- 172.21.15.57:0/69394857 learned_addr learned my addr 172.21.15.57:0/69394857 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.518+0000 7f0997e00700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a0073af0 0x7f09a01144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.519+0000 7f099de00700 1 -- 172.21.15.57:0/69394857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a0073af0 msgr2=0x7f09a01144e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.519+0000 7f099de00700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a0073af0 0x7f09a01144e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.519+0000 7f099de00700 1 -- 172.21.15.57:0/69394857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990005040 con 0x7f09a0072890 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.519+0000 7f0997e00700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a0073af0 0x7f09a01144e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.519+0000 7f099de00700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a0072890 0x7f09a0113fa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f099000b3b0 tx=0x7f0990009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.519+0000 7f0996000700 1 -- 172.21.15.57:0/69394857 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099000e040 con 0x7f09a0072890 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.519+0000 7f0996000700 1 -- 172.21.15.57:0/69394857 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f099000bd90 con 0x7f09a0072890 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.519+0000 7f0996000700 1 -- 172.21.15.57:0/69394857 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099001c630 con 0x7f09a0072890 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.519+0000 7f09a5000700 1 -- 172.21.15.57:0/69394857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a0115600 con 0x7f09a0072890 2024-02-28T16:13:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.519+0000 7f09a5000700 1 -- 172.21.15.57:0/69394857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a0115b40 con 0x7f09a0072890 2024-02-28T16:13:27.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.520+0000 7f09a5000700 1 -- 172.21.15.57:0/69394857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a004bed0 con 0x7f09a0072890 2024-02-28T16:13:27.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.521+0000 7f0996000700 1 -- 172.21.15.57:0/69394857 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f09900139f0 con 0x7f09a0072890 2024-02-28T16:13:27.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.522+0000 7f0996000700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f098406d7f0 0x7f098406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.522+0000 7f0996000700 1 -- 172.21.15.57:0/69394857 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f099008e450 con 0x7f09a0072890 2024-02-28T16:13:27.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.522+0000 7f0997e00700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f098406d7f0 0x7f098406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.523+0000 7f0997e00700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f098406d7f0 0x7f098406fca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0988009fd0 tx=0x7f098800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:27.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.527+0000 7f0996000700 1 -- 172.21.15.57:0/69394857 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f099005b790 con 0x7f09a0072890 2024-02-28T16:13:27.646 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:27 smithi057 ceph-mon[93219]: pgmap v323: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:13:27.647 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:27 smithi057 ceph-mon[93219]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:27.647 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:27 smithi057 ceph-mon[93219]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:27.647 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:27 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/4045532401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:27.647 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:27 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/376624354' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:13:27.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.777+0000 7f09a5000700 1 -- 172.21.15.57:0/69394857 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09a0115790 con 0x7f098406d7f0 2024-02-28T16:13:27.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.780+0000 7f0996000700 1 -- 172.21.15.57:0/69394857 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f09a0115790 con 0x7f098406d7f0 2024-02-28T16:13:27.771 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:13:27.771 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "osd", 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "mds", 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "16/21 daemons upgraded", 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading prometheus daemons", 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:13:27.772 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:13:27.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 -- 172.21.15.57:0/69394857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f098406d7f0 msgr2=0x7f098406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f098406d7f0 0x7f098406fca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0988009fd0 tx=0x7f098800b040 comp rx=0 tx=0).stop 2024-02-28T16:13:27.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 -- 172.21.15.57:0/69394857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a0072890 msgr2=0x7f09a0113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a0072890 0x7f09a0113fa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f099000b3b0 tx=0x7f0990009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:27.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 -- 172.21.15.57:0/69394857 shutdown_connections 2024-02-28T16:13:27.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f098406d7f0 0x7f098406fca0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a0072890 0x7f09a0113fa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 --2- 172.21.15.57:0/69394857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a0073af0 0x7f09a01144e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 -- 172.21.15.57:0/69394857 >> 172.21.15.57:0/69394857 conn(0x7f09a00fa920 msgr2=0x7f09a0109480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:27.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 -- 172.21.15.57:0/69394857 shutdown_connections 2024-02-28T16:13:27.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.783+0000 7f09a5000700 1 -- 172.21.15.57:0/69394857 wait complete. 2024-02-28T16:13:27.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.931+0000 7f0022800700 1 -- 172.21.15.57:0/794046329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c103540 msgr2=0x7f001c103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.931+0000 7f0022800700 1 --2- 172.21.15.57:0/794046329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c103540 0x7f001c103950 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f000c004940 tx=0x7f000c009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:27.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.931+0000 7f0022800700 1 -- 172.21.15.57:0/794046329 shutdown_connections 2024-02-28T16:13:27.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.931+0000 7f0022800700 1 --2- 172.21.15.57:0/794046329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c104750 0x7f001c104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.931+0000 7f0022800700 1 --2- 172.21.15.57:0/794046329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c103540 0x7f001c103950 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.931+0000 7f0022800700 1 -- 172.21.15.57:0/794046329 >> 172.21.15.57:0/794046329 conn(0x7f001c0727d0 msgr2=0x7f001c074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:27.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.931+0000 7f0022800700 1 -- 172.21.15.57:0/794046329 shutdown_connections 2024-02-28T16:13:27.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.931+0000 7f0022800700 1 -- 172.21.15.57:0/794046329 wait complete. 2024-02-28T16:13:27.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.932+0000 7f0022800700 1 Processor -- start 2024-02-28T16:13:27.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.932+0000 7f0022800700 1 -- start start 2024-02-28T16:13:27.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.932+0000 7f0022800700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c103540 0x7f001c113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.932+0000 7f0022800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c104750 0x7f001c1144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.932+0000 7f0022800700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c114aa0 con 0x7f001c103540 2024-02-28T16:13:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.932+0000 7f0022800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c115340 con 0x7f001c104750 2024-02-28T16:13:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.933+0000 7f001b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c103540 0x7f001c113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.933+0000 7f001b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c103540 0x7f001c113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33902/0 (socket says 172.21.15.57:33902) 2024-02-28T16:13:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.933+0000 7f001b400700 1 -- 172.21.15.57:0/3038191668 learned_addr learned my addr 172.21.15.57:0/3038191668 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.933+0000 7f001aa00700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c104750 0x7f001c1144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.933+0000 7f001b400700 1 -- 172.21.15.57:0/3038191668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c104750 msgr2=0x7f001c1144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.933+0000 7f001b400700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c104750 0x7f001c1144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.933+0000 7f001b400700 1 -- 172.21.15.57:0/3038191668 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c005040 con 0x7f001c103540 2024-02-28T16:13:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.934+0000 7f001b400700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c103540 0x7f001c113f60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f000c000c00 tx=0x7f000c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.934+0000 7f0013400700 1 -- 172.21.15.57:0/3038191668 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f000c00e040 con 0x7f001c103540 2024-02-28T16:13:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.934+0000 7f0013400700 1 -- 172.21.15.57:0/3038191668 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f000c00bcc0 con 0x7f001c103540 2024-02-28T16:13:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.934+0000 7f0022800700 1 -- 172.21.15.57:0/3038191668 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c1155c0 con 0x7f001c103540 2024-02-28T16:13:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.934+0000 7f0013400700 1 -- 172.21.15.57:0/3038191668 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f000c013ea0 con 0x7f001c103540 2024-02-28T16:13:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.934+0000 7f0022800700 1 -- 172.21.15.57:0/3038191668 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c115b00 con 0x7f001c103540 2024-02-28T16:13:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.935+0000 7f0022800700 1 -- 172.21.15.57:0/3038191668 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c04bed0 con 0x7f001c103540 2024-02-28T16:13:27.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.936+0000 7f0013400700 1 -- 172.21.15.57:0/3038191668 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f000c013420 con 0x7f001c103540 2024-02-28T16:13:27.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.937+0000 7f0013400700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7f0 0x7f000006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.937+0000 7f0013400700 1 -- 172.21.15.57:0/3038191668 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f000c08e420 con 0x7f001c103540 2024-02-28T16:13:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.937+0000 7f001aa00700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7f0 0x7f000006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.938+0000 7f001aa00700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7f0 0x7f000006fca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0008004990 tx=0x7f0008009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:27.942+0000 7f0013400700 1 -- 172.21.15.57:0/3038191668 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f000c05b5a0 con 0x7f001c103540 2024-02-28T16:13:27.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:27 smithi087 ceph-mon[82628]: pgmap v323: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:13:27.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:27 smithi087 ceph-mon[82628]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:27.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:27 smithi087 ceph-mon[82628]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:27.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:27 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/4045532401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:27.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:27 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/376624354' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:13:28.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.264+0000 7f0022800700 1 -- 172.21.15.57:0/3038191668 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f001c10c020 con 0x7f001c103540 2024-02-28T16:13:28.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.265+0000 7f0013400700 1 -- 172.21.15.57:0/3038191668 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f000c05b130 con 0x7f001c103540 2024-02-28T16:13:28.257 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.268+0000 7f0022800700 1 -- 172.21.15.57:0/3038191668 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7f0 msgr2=0x7f000006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.268+0000 7f0022800700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7f0 0x7f000006fca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0008004990 tx=0x7f0008009ee0 comp rx=0 tx=0).stop 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.269+0000 7f0022800700 1 -- 172.21.15.57:0/3038191668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c103540 msgr2=0x7f001c113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.269+0000 7f0022800700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c103540 0x7f001c113f60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f000c000c00 tx=0x7f000c009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.269+0000 7f0022800700 1 -- 172.21.15.57:0/3038191668 shutdown_connections 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.269+0000 7f0022800700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f000006d7f0 0x7f000006fca0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.269+0000 7f0022800700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f001c103540 0x7f001c113f60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.269+0000 7f0022800700 1 --2- 172.21.15.57:0/3038191668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c104750 0x7f001c1144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.269+0000 7f0022800700 1 -- 172.21.15.57:0/3038191668 >> 172.21.15.57:0/3038191668 conn(0x7f001c0727d0 msgr2=0x7f001c107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.269+0000 7f0022800700 1 -- 172.21.15.57:0/3038191668 shutdown_connections 2024-02-28T16:13:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:28.269+0000 7f0022800700 1 -- 172.21.15.57:0/3038191668 wait complete. 2024-02-28T16:13:28.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:28 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3038191668' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:13:28.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:28 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3038191668' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:13:29.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:29 smithi057 ceph-mon[93219]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:29.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:29 smithi057 ceph-mon[93219]: pgmap v324: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:29.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:29 smithi087 ceph-mon[82628]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:29.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:29 smithi087 ceph-mon[82628]: pgmap v324: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: pgmap v325: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:13:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:13:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:13:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.929 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: pgmap v325: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:13:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:13:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:13:31.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:31.967 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:32.643 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:32 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:13:32.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:32 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:13:33.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:33 smithi057 ceph-mon[93219]: pgmap v326: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:33.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:33 smithi087 ceph-mon[82628]: pgmap v326: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:34.911 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:34 smithi057 ceph-mon[93219]: Upgrade: Updating alertmanager.smithi057 2024-02-28T16:13:34.912 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:34 smithi057 ceph-mon[93219]: Deploying daemon alertmanager.smithi057 on smithi057 2024-02-28T16:13:34.912 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:13:34.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:34 smithi087 ceph-mon[82628]: Upgrade: Updating alertmanager.smithi057 2024-02-28T16:13:34.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:34 smithi087 ceph-mon[82628]: Deploying daemon alertmanager.smithi057 on smithi057 2024-02-28T16:13:34.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:13:35.827 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:35 smithi057 ceph-mon[93219]: pgmap v327: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:35.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:35 smithi087 ceph-mon[82628]: pgmap v327: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:37.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:37 smithi057 ceph-mon[93219]: pgmap v328: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:13:37.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:37 smithi087 ceph-mon[82628]: pgmap v328: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:13:39.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:39 smithi057 ceph-mon[93219]: pgmap v329: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:13:39.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:39 smithi087 ceph-mon[82628]: pgmap v329: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:13:41.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:41 smithi057 ceph-mon[93219]: pgmap v330: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-28T16:13:41.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:41.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:41.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:41 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:41.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:41 smithi087 ceph-mon[82628]: pgmap v330: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-28T16:13:41.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:41.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:41.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:41 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:43.921 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:43 smithi057 ceph-mon[93219]: pgmap v331: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-28T16:13:43.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:43 smithi087 ceph-mon[82628]: pgmap v331: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-28T16:13:45.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:45 smithi057 ceph-mon[93219]: pgmap v332: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:13:45.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:45 smithi087 ceph-mon[82628]: pgmap v332: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:13:47.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:47 smithi057 ceph-mon[93219]: pgmap v333: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:13:47.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:47.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:47 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:47.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:47 smithi087 ceph-mon[82628]: pgmap v333: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:13:47.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:47.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:47 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:49.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:49 smithi057 ceph-mon[93219]: pgmap v334: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:49.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:13:49.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:49.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:49.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:49 smithi087 ceph-mon[82628]: pgmap v334: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:49.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:13:49.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:49.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:51.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:51 smithi057 ceph-mon[93219]: pgmap v335: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:51.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:51 smithi087 ceph-mon[82628]: pgmap v335: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:13:53.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:53 smithi057 ceph-mon[93219]: pgmap v336: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:13:53.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:53 smithi087 ceph-mon[82628]: pgmap v336: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:13:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: pgmap v337: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:13:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:13:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:13:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.927 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:55 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: pgmap v337: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:55.966 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:55 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:13:56.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:56 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:13:56.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:56 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:13:57.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:57 smithi057 ceph-mon[93219]: pgmap v338: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:13:57.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:57 smithi087 ceph-mon[82628]: pgmap v338: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:13:58.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.438+0000 7fda88400700 1 -- 172.21.15.57:0/1360747244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda800fe0e0 msgr2=0x7fda800fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:58.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.438+0000 7fda88400700 1 --2- 172.21.15.57:0/1360747244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda800fe0e0 0x7fda800fe550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fda6c004940 tx=0x7fda6c009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:58.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.439+0000 7fda88400700 1 -- 172.21.15.57:0/1360747244 shutdown_connections 2024-02-28T16:13:58.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.439+0000 7fda88400700 1 --2- 172.21.15.57:0/1360747244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda800fe0e0 0x7fda800fe550 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.439+0000 7fda88400700 1 --2- 172.21.15.57:0/1360747244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800fcef0 0x7fda800fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.439+0000 7fda88400700 1 -- 172.21.15.57:0/1360747244 >> 172.21.15.57:0/1360747244 conn(0x7fda800f8620 msgr2=0x7fda800faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:58.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.439+0000 7fda88400700 1 -- 172.21.15.57:0/1360747244 shutdown_connections 2024-02-28T16:13:58.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.439+0000 7fda88400700 1 -- 172.21.15.57:0/1360747244 wait complete. 2024-02-28T16:13:58.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.440+0000 7fda88400700 1 Processor -- start 2024-02-28T16:13:58.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.440+0000 7fda88400700 1 -- start start 2024-02-28T16:13:58.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.441+0000 7fda88400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda800fcef0 0x7fda8010fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:58.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.441+0000 7fda88400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800fe0e0 0x7fda80110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:58.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.441+0000 7fda88400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda80110600 con 0x7fda800fcef0 2024-02-28T16:13:58.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.441+0000 7fda88400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda80110ea0 con 0x7fda800fe0e0 2024-02-28T16:13:58.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.441+0000 7fda85a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda800fcef0 0x7fda8010fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:58.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.441+0000 7fda85a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda800fcef0 0x7fda8010fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52668/0 (socket says 172.21.15.57:52668) 2024-02-28T16:13:58.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.441+0000 7fda85a00700 1 -- 172.21.15.57:0/1642418002 learned_addr learned my addr 172.21.15.57:0/1642418002 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:58.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.442+0000 7fda85000700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800fe0e0 0x7fda80110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:58.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.442+0000 7fda85a00700 1 -- 172.21.15.57:0/1642418002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800fe0e0 msgr2=0x7fda80110000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:58.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.442+0000 7fda85a00700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800fe0e0 0x7fda80110000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.442+0000 7fda85a00700 1 -- 172.21.15.57:0/1642418002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c005040 con 0x7fda800fcef0 2024-02-28T16:13:58.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.442+0000 7fda85a00700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda800fcef0 0x7fda8010fac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fda7400eb70 tx=0x7fda7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:58.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.442+0000 7fda7d600700 1 -- 172.21.15.57:0/1642418002 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda74007cc0 con 0x7fda800fcef0 2024-02-28T16:13:58.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.442+0000 7fda7d600700 1 -- 172.21.15.57:0/1642418002 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda7400f040 con 0x7fda800fcef0 2024-02-28T16:13:58.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.442+0000 7fda88400700 1 -- 172.21.15.57:0/1642418002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda80111120 con 0x7fda800fcef0 2024-02-28T16:13:58.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.443+0000 7fda7d600700 1 -- 172.21.15.57:0/1642418002 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7400cbd0 con 0x7fda800fcef0 2024-02-28T16:13:58.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.443+0000 7fda88400700 1 -- 172.21.15.57:0/1642418002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda80111660 con 0x7fda800fcef0 2024-02-28T16:13:58.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.444+0000 7fda88400700 1 -- 172.21.15.57:0/1642418002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda80102210 con 0x7fda800fcef0 2024-02-28T16:13:58.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.445+0000 7fda7d600700 1 -- 172.21.15.57:0/1642418002 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fda7400cd30 con 0x7fda800fcef0 2024-02-28T16:13:58.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.446+0000 7fda7d600700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fda6806d7f0 0x7fda6806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:58.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.446+0000 7fda7d600700 1 -- 172.21.15.57:0/1642418002 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fda7408cab0 con 0x7fda800fcef0 2024-02-28T16:13:58.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.446+0000 7fda85000700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fda6806d7f0 0x7fda6806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:58.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.447+0000 7fda85000700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fda6806d7f0 0x7fda6806fca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda6c004560 tx=0x7fda6c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:58.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.451+0000 7fda7d600700 1 -- 172.21.15.57:0/1642418002 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fda7408ee60 con 0x7fda800fcef0 2024-02-28T16:13:58.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.707+0000 7fda88400700 1 -- 172.21.15.57:0/1642418002 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda80111aa0 con 0x7fda6806d7f0 2024-02-28T16:13:58.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.709+0000 7fda7d600700 1 -- 172.21.15.57:0/1642418002 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fda80111aa0 con 0x7fda6806d7f0 2024-02-28T16:13:58.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.712+0000 7fda88400700 1 -- 172.21.15.57:0/1642418002 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fda6806d7f0 msgr2=0x7fda6806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:58.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.712+0000 7fda88400700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fda6806d7f0 0x7fda6806fca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda6c004560 tx=0x7fda6c009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:58.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.712+0000 7fda88400700 1 -- 172.21.15.57:0/1642418002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda800fcef0 msgr2=0x7fda8010fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:58.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.712+0000 7fda88400700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda800fcef0 0x7fda8010fac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fda7400eb70 tx=0x7fda7400b040 comp rx=0 tx=0).stop 2024-02-28T16:13:58.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.713+0000 7fda88400700 1 -- 172.21.15.57:0/1642418002 shutdown_connections 2024-02-28T16:13:58.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.713+0000 7fda88400700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fda6806d7f0 0x7fda6806fca0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.713+0000 7fda88400700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda800fcef0 0x7fda8010fac0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.713+0000 7fda88400700 1 --2- 172.21.15.57:0/1642418002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800fe0e0 0x7fda80110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.713+0000 7fda88400700 1 -- 172.21.15.57:0/1642418002 >> 172.21.15.57:0/1642418002 conn(0x7fda800f8620 msgr2=0x7fda800ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:58.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.713+0000 7fda88400700 1 -- 172.21.15.57:0/1642418002 shutdown_connections 2024-02-28T16:13:58.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.713+0000 7fda88400700 1 -- 172.21.15.57:0/1642418002 wait complete. 2024-02-28T16:13:58.722 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:13:58.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.870+0000 7f60ea000700 1 -- 172.21.15.57:0/3039720366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e40fe0e0 msgr2=0x7f60e40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:58.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.870+0000 7f60ea000700 1 --2- 172.21.15.57:0/3039720366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e40fe0e0 0x7f60e40fe550 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f60cc004940 tx=0x7f60cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:58.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.870+0000 7f60ea000700 1 -- 172.21.15.57:0/3039720366 shutdown_connections 2024-02-28T16:13:58.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.870+0000 7f60ea000700 1 --2- 172.21.15.57:0/3039720366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e40fe0e0 0x7f60e40fe550 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.870+0000 7f60ea000700 1 --2- 172.21.15.57:0/3039720366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e40fcef0 0x7f60e40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.870+0000 7f60ea000700 1 -- 172.21.15.57:0/3039720366 >> 172.21.15.57:0/3039720366 conn(0x7f60e40f8620 msgr2=0x7f60e40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:58.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.870+0000 7f60ea000700 1 -- 172.21.15.57:0/3039720366 shutdown_connections 2024-02-28T16:13:58.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.870+0000 7f60ea000700 1 -- 172.21.15.57:0/3039720366 wait complete. 2024-02-28T16:13:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.871+0000 7f60ea000700 1 Processor -- start 2024-02-28T16:13:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.871+0000 7f60ea000700 1 -- start start 2024-02-28T16:13:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.872+0000 7f60ea000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e40fcef0 0x7f60e410db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.872+0000 7f60ea000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e410e060 0x7f60e410ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.872+0000 7f60ea000700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e410e520 con 0x7f60e40fcef0 2024-02-28T16:13:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.872+0000 7f60ea000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e410e660 con 0x7f60e410e060 2024-02-28T16:13:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.872+0000 7f60e3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e40fcef0 0x7f60e410db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.872+0000 7f60e3400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e40fcef0 0x7f60e410db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52680/0 (socket says 172.21.15.57:52680) 2024-02-28T16:13:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.872+0000 7f60e3400700 1 -- 172.21.15.57:0/4248111580 learned_addr learned my addr 172.21.15.57:0/4248111580 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.872+0000 7f60dbe00700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e410e060 0x7f60e410ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.873+0000 7f60e3400700 1 -- 172.21.15.57:0/4248111580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e410e060 msgr2=0x7f60e410ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.873+0000 7f60e3400700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e410e060 0x7f60e410ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.873+0000 7f60e3400700 1 -- 172.21.15.57:0/4248111580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc005040 con 0x7f60e40fcef0 2024-02-28T16:13:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.873+0000 7f60dbe00700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e410e060 0x7f60e410ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:13:58.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.873+0000 7f60e3400700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e40fcef0 0x7f60e410db20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f60d4001ce0 tx=0x7f60d4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:58.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.873+0000 7f60db400700 1 -- 172.21.15.57:0/4248111580 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d400db60 con 0x7f60e40fcef0 2024-02-28T16:13:58.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.873+0000 7f60db400700 1 -- 172.21.15.57:0/4248111580 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60d400f040 con 0x7f60e40fcef0 2024-02-28T16:13:58.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.873+0000 7f60ea000700 1 -- 172.21.15.57:0/4248111580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e410f560 con 0x7f60e40fcef0 2024-02-28T16:13:58.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.873+0000 7f60db400700 1 -- 172.21.15.57:0/4248111580 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d4009790 con 0x7f60e40fcef0 2024-02-28T16:13:58.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.873+0000 7f60ea000700 1 -- 172.21.15.57:0/4248111580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e410fa70 con 0x7f60e40fcef0 2024-02-28T16:13:58.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.875+0000 7f60ea000700 1 -- 172.21.15.57:0/4248111580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e4107a70 con 0x7f60e40fcef0 2024-02-28T16:13:58.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.876+0000 7f60db400700 1 -- 172.21.15.57:0/4248111580 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f60d4007920 con 0x7f60e40fcef0 2024-02-28T16:13:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.877+0000 7f60db400700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f60c806d7f0 0x7f60c806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.877+0000 7f60db400700 1 -- 172.21.15.57:0/4248111580 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f60d408cba0 con 0x7f60e40fcef0 2024-02-28T16:13:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.877+0000 7f60dbe00700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f60c806d7f0 0x7f60c806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.878+0000 7f60dbe00700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f60c806d7f0 0x7f60c806fca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009040 tx=0x7f60cc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:58.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:58.881+0000 7f60db400700 1 -- 172.21.15.57:0/4248111580 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f60d4059dd0 con 0x7f60e40fcef0 2024-02-28T16:13:59.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.137+0000 7f60ea000700 1 -- 172.21.15.57:0/4248111580 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60e405e3d0 con 0x7f60c806d7f0 2024-02-28T16:13:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.139+0000 7f60db400700 1 -- 172.21.15.57:0/4248111580 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f60e405e3d0 con 0x7f60c806d7f0 2024-02-28T16:13:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 -- 172.21.15.57:0/4248111580 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f60c806d7f0 msgr2=0x7f60c806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f60c806d7f0 0x7f60c806fca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009040 tx=0x7f60cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 -- 172.21.15.57:0/4248111580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e40fcef0 msgr2=0x7f60e410db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e40fcef0 0x7f60e410db20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f60d4001ce0 tx=0x7f60d4009e60 comp rx=0 tx=0).stop 2024-02-28T16:13:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 -- 172.21.15.57:0/4248111580 shutdown_connections 2024-02-28T16:13:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f60c806d7f0 0x7f60c806fca0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e40fcef0 0x7f60e410db20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 --2- 172.21.15.57:0/4248111580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e410e060 0x7f60e410ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 -- 172.21.15.57:0/4248111580 >> 172.21.15.57:0/4248111580 conn(0x7f60e40f8620 msgr2=0x7f60e40fa910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:59.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 -- 172.21.15.57:0/4248111580 shutdown_connections 2024-02-28T16:13:59.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.142+0000 7f60ea000700 1 -- 172.21.15.57:0/4248111580 wait complete. 2024-02-28T16:13:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.296+0000 7f75b8c00700 1 -- 172.21.15.57:0/431654713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75b4071eb0 msgr2=0x7f75b4070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.296+0000 7f75b8c00700 1 --2- 172.21.15.57:0/431654713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75b4071eb0 0x7f75b4070320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f75a4004940 tx=0x7f75a4009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.296+0000 7f75b8c00700 1 -- 172.21.15.57:0/431654713 shutdown_connections 2024-02-28T16:13:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.296+0000 7f75b8c00700 1 --2- 172.21.15.57:0/431654713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b4070860 0x7f75b4070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.296+0000 7f75b8c00700 1 --2- 172.21.15.57:0/431654713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75b4071eb0 0x7f75b4070320 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.296+0000 7f75b8c00700 1 -- 172.21.15.57:0/431654713 >> 172.21.15.57:0/431654713 conn(0x7f75b40f8620 msgr2=0x7f75b40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.297+0000 7f75b8c00700 1 -- 172.21.15.57:0/431654713 shutdown_connections 2024-02-28T16:13:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.297+0000 7f75b8c00700 1 -- 172.21.15.57:0/431654713 wait complete. 2024-02-28T16:13:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.298+0000 7f75b8c00700 1 Processor -- start 2024-02-28T16:13:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.298+0000 7f75b8c00700 1 -- start start 2024-02-28T16:13:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.298+0000 7f75b8c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75b4070860 0x7f75b410fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.298+0000 7f75b8c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b4071eb0 0x7f75b4110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.298+0000 7f75b8c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b4110610 con 0x7f75b4070860 2024-02-28T16:13:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.298+0000 7f75b8c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b4110eb0 con 0x7f75b4071eb0 2024-02-28T16:13:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.298+0000 7f75b1e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75b4070860 0x7f75b410fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.298+0000 7f75b1e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75b4070860 0x7f75b410fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52696/0 (socket says 172.21.15.57:52696) 2024-02-28T16:13:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.298+0000 7f75b1e00700 1 -- 172.21.15.57:0/3788911370 learned_addr learned my addr 172.21.15.57:0/3788911370 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:59.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.299+0000 7f75abe00700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b4071eb0 0x7f75b4110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:59.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.299+0000 7f75b1e00700 1 -- 172.21.15.57:0/3788911370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b4071eb0 msgr2=0x7f75b4110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.299+0000 7f75b1e00700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b4071eb0 0x7f75b4110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.299+0000 7f75b1e00700 1 -- 172.21.15.57:0/3788911370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4005040 con 0x7f75b4070860 2024-02-28T16:13:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.299+0000 7f75b1e00700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75b4070860 0x7f75b410fad0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f75a40093b0 tx=0x7f75a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.300+0000 7f75aa000700 1 -- 172.21.15.57:0/3788911370 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a400e040 con 0x7f75b4070860 2024-02-28T16:13:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.300+0000 7f75aa000700 1 -- 172.21.15.57:0/3788911370 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75a400bcc0 con 0x7f75b4070860 2024-02-28T16:13:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.300+0000 7f75b8c00700 1 -- 172.21.15.57:0/3788911370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b4111130 con 0x7f75b4070860 2024-02-28T16:13:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.300+0000 7f75aa000700 1 -- 172.21.15.57:0/3788911370 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a401c630 con 0x7f75b4070860 2024-02-28T16:13:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.300+0000 7f75b8c00700 1 -- 172.21.15.57:0/3788911370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b4111670 con 0x7f75b4070860 2024-02-28T16:13:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.301+0000 7f75b8c00700 1 -- 172.21.15.57:0/3788911370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b404bed0 con 0x7f75b4070860 2024-02-28T16:13:59.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.302+0000 7f75aa000700 1 -- 172.21.15.57:0/3788911370 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f75a40139f0 con 0x7f75b4070860 2024-02-28T16:13:59.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.303+0000 7f75aa000700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f759806d7e0 0x7f759806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:59.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.303+0000 7f75aa000700 1 -- 172.21.15.57:0/3788911370 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f75a408e470 con 0x7f75b4070860 2024-02-28T16:13:59.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.303+0000 7f75abe00700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f759806d7e0 0x7f759806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:59.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.304+0000 7f75abe00700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f759806d7e0 0x7f759806fc90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f759c004990 tx=0x7f759c009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:59.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.308+0000 7f75aa000700 1 -- 172.21.15.57:0/3788911370 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f75a405b6f0 con 0x7f75b4070860 2024-02-28T16:13:59.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.549+0000 7f75b8c00700 1 -- 172.21.15.57:0/3788911370 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75b4104550 con 0x7f759806d7e0 2024-02-28T16:13:59.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.567+0000 7f75aa000700 1 -- 172.21.15.57:0/3788911370 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f75b4104550 con 0x7f759806d7e0 2024-02-28T16:13:59.559 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (19s) 12s ago 23m 14.6M - 0.25.0 c8568f914cd2 abec484faa15 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (8m) 12s ago 23m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (7m) 63s ago 21m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (11m) 12s ago 22m 75.0M - 9.4.7 954c08fa6188 5aefc98d15b6 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (3m) 12s ago 15m 66.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b df14dcf6973e 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (2m) 12s ago 15m 15.4M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 977aa1867016 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (2m) 63s ago 15m 65.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1ee4a125f5b 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (96s) 63s ago 15m 12.5M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b0b892c8725f 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (11m) 12s ago 24m 514M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (10m) 63s ago 21m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (9m) 12s ago 24m 60.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (9m) 63s ago 21m 45.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (76s) 12s ago 23m 7436k - 1.5.0 0da6a335fe13 6e10666d4d1f 2024-02-28T16:13:59.560 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (68s) 63s ago 21m 3011k - 1.5.0 0da6a335fe13 285db7ba57fc 2024-02-28T16:13:59.561 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (7m) 12s ago 20m 134M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:13:59.561 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (6m) 12s ago 20m 106M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:13:59.561 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (5m) 12s ago 19m 99.9M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:13:59.561 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (5m) 63s ago 18m 107M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:13:59.561 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (4m) 63s ago 18m 94.0M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:13:59.561 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (4m) 63s ago 17m 93.9M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b cbdb6df47634 2024-02-28T16:13:59.561 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (43s) 12s ago 22m 47.1M - 2.43.0 a07b618ecd1d 33bac790aba5 2024-02-28T16:13:59.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.570+0000 7f75b8c00700 1 -- 172.21.15.57:0/3788911370 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f759806d7e0 msgr2=0x7f759806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.570+0000 7f75b8c00700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f759806d7e0 0x7f759806fc90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f759c004990 tx=0x7f759c009ee0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.570+0000 7f75b8c00700 1 -- 172.21.15.57:0/3788911370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75b4070860 msgr2=0x7f75b410fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.570+0000 7f75b8c00700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75b4070860 0x7f75b410fad0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f75a40093b0 tx=0x7f75a4009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:59.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.571+0000 7f75b8c00700 1 -- 172.21.15.57:0/3788911370 shutdown_connections 2024-02-28T16:13:59.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.571+0000 7f75b8c00700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f759806d7e0 0x7f759806fc90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.571+0000 7f75b8c00700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75b4070860 0x7f75b410fad0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.571+0000 7f75b8c00700 1 --2- 172.21.15.57:0/3788911370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b4071eb0 0x7f75b4110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.571+0000 7f75b8c00700 1 -- 172.21.15.57:0/3788911370 >> 172.21.15.57:0/3788911370 conn(0x7f75b40f8620 msgr2=0x7f75b4102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:59.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.571+0000 7f75b8c00700 1 -- 172.21.15.57:0/3788911370 shutdown_connections 2024-02-28T16:13:59.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.571+0000 7f75b8c00700 1 -- 172.21.15.57:0/3788911370 wait complete. 2024-02-28T16:13:59.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.719+0000 7f5507400700 1 -- 172.21.15.57:0/2364257714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55000fe0e0 msgr2=0x7f55000fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.719+0000 7f5507400700 1 --2- 172.21.15.57:0/2364257714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55000fe0e0 0x7f55000fe550 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f54ec004940 tx=0x7f54ec009e30 comp rx=0 tx=0).stop 2024-02-28T16:13:59.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.719+0000 7f5507400700 1 -- 172.21.15.57:0/2364257714 shutdown_connections 2024-02-28T16:13:59.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.719+0000 7f5507400700 1 --2- 172.21.15.57:0/2364257714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55000fe0e0 0x7f55000fe550 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.719+0000 7f5507400700 1 --2- 172.21.15.57:0/2364257714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55000fcef0 0x7f55000fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.719+0000 7f5507400700 1 -- 172.21.15.57:0/2364257714 >> 172.21.15.57:0/2364257714 conn(0x7f55000f8620 msgr2=0x7f55000faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:59.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.720+0000 7f5507400700 1 -- 172.21.15.57:0/2364257714 shutdown_connections 2024-02-28T16:13:59.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.720+0000 7f5507400700 1 -- 172.21.15.57:0/2364257714 wait complete. 2024-02-28T16:13:59.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.720+0000 7f5507400700 1 Processor -- start 2024-02-28T16:13:59.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.720+0000 7f5507400700 1 -- start start 2024-02-28T16:13:59.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.721+0000 7f5507400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55000fcef0 0x7f5500071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:59.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.721+0000 7f5507400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55000fe0e0 0x7f55000702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:59.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.721+0000 7f5507400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5500070970 con 0x7f55000fe0e0 2024-02-28T16:13:59.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.721+0000 7f5507400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5500070ae0 con 0x7f55000fcef0 2024-02-28T16:13:59.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.721+0000 7f54ffe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55000fe0e0 0x7f55000702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:59.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.721+0000 7f54ffe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55000fe0e0 0x7f55000702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52708/0 (socket says 172.21.15.57:52708) 2024-02-28T16:13:59.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.721+0000 7f54ffe00700 1 -- 172.21.15.57:0/2588642905 learned_addr learned my addr 172.21.15.57:0/2588642905 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:13:59.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.721+0000 7f5504a00700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55000fcef0 0x7f5500071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:59.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.721+0000 7f54ffe00700 1 -- 172.21.15.57:0/2588642905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55000fcef0 msgr2=0x7f5500071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.722+0000 7f54ffe00700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55000fcef0 0x7f5500071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.722+0000 7f54ffe00700 1 -- 172.21.15.57:0/2588642905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec005040 con 0x7f55000fe0e0 2024-02-28T16:13:59.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.722+0000 7f5504a00700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55000fcef0 0x7f5500071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:13:59.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.722+0000 7f54ffe00700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55000fe0e0 0x7f55000702e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00b3b0 tx=0x7f54ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:59.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.722+0000 7f54fcc00700 1 -- 172.21.15.57:0/2588642905 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54ec00e040 con 0x7f55000fe0e0 2024-02-28T16:13:59.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.722+0000 7f54fcc00700 1 -- 172.21.15.57:0/2588642905 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54ec00bd90 con 0x7f55000fe0e0 2024-02-28T16:13:59.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.722+0000 7f5507400700 1 -- 172.21.15.57:0/2588642905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5500070d60 con 0x7f55000fe0e0 2024-02-28T16:13:59.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.722+0000 7f54fcc00700 1 -- 172.21.15.57:0/2588642905 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54ec01c630 con 0x7f55000fe0e0 2024-02-28T16:13:59.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.722+0000 7f5507400700 1 -- 172.21.15.57:0/2588642905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55001159a0 con 0x7f55000fe0e0 2024-02-28T16:13:59.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.723+0000 7f5507400700 1 -- 172.21.15.57:0/2588642905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550004bed0 con 0x7f55000fe0e0 2024-02-28T16:13:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.724+0000 7f54fcc00700 1 -- 172.21.15.57:0/2588642905 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f54ec0139f0 con 0x7f55000fe0e0 2024-02-28T16:13:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.725+0000 7f54fcc00700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f54e806d7f0 0x7f54e806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.725+0000 7f54fcc00700 1 -- 172.21.15.57:0/2588642905 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f54ec08e510 con 0x7f55000fe0e0 2024-02-28T16:13:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.726+0000 7f5504a00700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f54e806d7f0 0x7f54e806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.726+0000 7f5504a00700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f54e806d7f0 0x7f54e806fca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5500071bf0 tx=0x7f54f4007510 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:13:59.730+0000 7f54fcc00700 1 -- 172.21.15.57:0/2588642905 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f54ec05b790 con 0x7f55000fe0e0 2024-02-28T16:13:59.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:59 smithi057 ceph-mon[93219]: Upgrade: Updating grafana.smithi057 2024-02-28T16:13:59.839 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:59 smithi057 ceph-mon[93219]: Deploying daemon grafana.smithi057 on smithi057 2024-02-28T16:13:59.840 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:13:59 smithi057 ceph-mon[93219]: pgmap v339: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:13:59.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:59 smithi087 ceph-mon[82628]: Upgrade: Updating grafana.smithi057 2024-02-28T16:13:59.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:59 smithi087 ceph-mon[82628]: Deploying daemon grafana.smithi057 on smithi057 2024-02-28T16:13:59.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:13:59 smithi087 ceph-mon[82628]: pgmap v339: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.037+0000 7f5507400700 1 -- 172.21.15.57:0/2588642905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5500105ad0 con 0x7f55000fe0e0 2024-02-28T16:14:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.038+0000 7f54fcc00700 1 -- 172.21.15.57:0/2588642905 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f54ec05b320 con 0x7f55000fe0e0 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:14:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:14:00.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:14:00.031 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:14:00.031 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:14:00.031 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:14:00.031 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:14:00.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.040+0000 7f5507400700 1 -- 172.21.15.57:0/2588642905 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f54e806d7f0 msgr2=0x7f54e806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:00.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.040+0000 7f5507400700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f54e806d7f0 0x7f54e806fca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5500071bf0 tx=0x7f54f4007510 comp rx=0 tx=0).stop 2024-02-28T16:14:00.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.040+0000 7f5507400700 1 -- 172.21.15.57:0/2588642905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55000fe0e0 msgr2=0x7f55000702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:00.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.040+0000 7f5507400700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55000fe0e0 0x7f55000702e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00b3b0 tx=0x7f54ec009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:00.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.041+0000 7f5507400700 1 -- 172.21.15.57:0/2588642905 shutdown_connections 2024-02-28T16:14:00.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.041+0000 7f5507400700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f54e806d7f0 0x7f54e806fca0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.041+0000 7f5507400700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55000fcef0 0x7f5500071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.041+0000 7f5507400700 1 --2- 172.21.15.57:0/2588642905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55000fe0e0 0x7f55000702e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.041+0000 7f5507400700 1 -- 172.21.15.57:0/2588642905 >> 172.21.15.57:0/2588642905 conn(0x7f55000f8620 msgr2=0x7f55001013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:00.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.041+0000 7f5507400700 1 -- 172.21.15.57:0/2588642905 shutdown_connections 2024-02-28T16:14:00.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.041+0000 7f5507400700 1 -- 172.21.15.57:0/2588642905 wait complete. 2024-02-28T16:14:00.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.181+0000 7f92a4400700 1 -- 172.21.15.57:0/2729996814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f929c0fe2b0 msgr2=0x7f929c0fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:00.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.181+0000 7f92a4400700 1 --2- 172.21.15.57:0/2729996814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f929c0fe2b0 0x7f929c0fe700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9288004940 tx=0x7f9288009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:00.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.182+0000 7f92a4400700 1 -- 172.21.15.57:0/2729996814 shutdown_connections 2024-02-28T16:14:00.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.182+0000 7f92a4400700 1 --2- 172.21.15.57:0/2729996814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f929c0fe2b0 0x7f929c0fe700 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.182+0000 7f92a4400700 1 --2- 172.21.15.57:0/2729996814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f929c0fb220 0x7f929c0fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.182+0000 7f92a4400700 1 -- 172.21.15.57:0/2729996814 >> 172.21.15.57:0/2729996814 conn(0x7f929c0f6ca0 msgr2=0x7f929c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:00.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.182+0000 7f92a4400700 1 -- 172.21.15.57:0/2729996814 shutdown_connections 2024-02-28T16:14:00.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.182+0000 7f92a4400700 1 -- 172.21.15.57:0/2729996814 wait complete. 2024-02-28T16:14:00.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.182+0000 7f92a4400700 1 Processor -- start 2024-02-28T16:14:00.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.183+0000 7f92a4400700 1 -- start start 2024-02-28T16:14:00.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.183+0000 7f92a4400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f929c0fb220 0x7f929c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:00.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.183+0000 7f92a4400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f929c0fe2b0 0x7f929c10df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:00.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.183+0000 7f92a4400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c10e550 con 0x7f929c0fe2b0 2024-02-28T16:14:00.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.183+0000 7f92a4400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c10edf0 con 0x7f929c0fb220 2024-02-28T16:14:00.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.183+0000 7f92a1000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f929c0fe2b0 0x7f929c10df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:00.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.183+0000 7f92a1000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f929c0fe2b0 0x7f929c10df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52726/0 (socket says 172.21.15.57:52726) 2024-02-28T16:14:00.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.183+0000 7f92a1000700 1 -- 172.21.15.57:0/20257044 learned_addr learned my addr 172.21.15.57:0/20257044 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:14:00.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.184+0000 7f92a1a00700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f929c0fb220 0x7f929c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:00.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.184+0000 7f92a1000700 1 -- 172.21.15.57:0/20257044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f929c0fb220 msgr2=0x7f929c10da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:00.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.184+0000 7f92a1000700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f929c0fb220 0x7f929c10da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.184+0000 7f92a1000700 1 -- 172.21.15.57:0/20257044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9288005040 con 0x7f929c0fe2b0 2024-02-28T16:14:00.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.184+0000 7f92a1a00700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f929c0fb220 0x7f929c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:14:00.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.184+0000 7f92a1000700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f929c0fe2b0 0x7f929c10df50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f928800b3b0 tx=0x7f9288009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:00.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.184+0000 7f9299600700 1 -- 172.21.15.57:0/20257044 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928800e040 con 0x7f929c0fe2b0 2024-02-28T16:14:00.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.184+0000 7f9299600700 1 -- 172.21.15.57:0/20257044 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f928800bbf0 con 0x7f929c0fe2b0 2024-02-28T16:14:00.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.184+0000 7f9299600700 1 -- 172.21.15.57:0/20257044 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928801c410 con 0x7f929c0fe2b0 2024-02-28T16:14:00.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.185+0000 7f92a4400700 1 -- 172.21.15.57:0/20257044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c10f070 con 0x7f929c0fe2b0 2024-02-28T16:14:00.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.185+0000 7f92a4400700 1 -- 172.21.15.57:0/20257044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c10f5b0 con 0x7f929c0fe2b0 2024-02-28T16:14:00.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.186+0000 7f92a4400700 1 -- 172.21.15.57:0/20257044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c107a80 con 0x7f929c0fe2b0 2024-02-28T16:14:00.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.187+0000 7f9299600700 1 -- 172.21.15.57:0/20257044 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f928800bd60 con 0x7f929c0fe2b0 2024-02-28T16:14:00.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.188+0000 7f9299600700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f928406d7e0 0x7f928406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:00.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.188+0000 7f9299600700 1 -- 172.21.15.57:0/20257044 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f928808e390 con 0x7f929c0fe2b0 2024-02-28T16:14:00.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.189+0000 7f92a1a00700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f928406d7e0 0x7f928406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:00.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.189+0000 7f92a1a00700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f928406d7e0 0x7f928406fc90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9290009fd0 tx=0x7f929000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:00.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.193+0000 7f9299600700 1 -- 172.21.15.57:0/20257044 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f928805b630 con 0x7f929c0fe2b0 2024-02-28T16:14:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.473+0000 7f92a4400700 1 -- 172.21.15.57:0/20257044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f929c105a40 con 0x7f929c0fe2b0 2024-02-28T16:14:00.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.473+0000 7f9299600700 1 -- 172.21.15.57:0/20257044 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1889 (secure 0 0 0) 0x7f928805b1c0 con 0x7f929c0fe2b0 2024-02-28T16:14:00.465 INFO:teuthology.orchestra.run.smithi057.stdout:e41 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 41 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:12:37.537945+0000 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:14:00.466 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 101 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=34490,1=34522} 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:14:00.467 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:14:00.468 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:14:00.468 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:14:00.468 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:14:00.468 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:14:00.468 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:34490} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:14:00.468 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{0:44391} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6824/571403132,v1:172.21.15.87:6825/571403132] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:14:00.468 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{1:34522} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.57:6828/2553742021,v1:172.21.15.57:6829/2553742021] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:14:00.468 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:44405} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/2114762616,v1:172.21.15.87:6827/2114762616] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:14:00.468 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:14:00.468 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:14:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 -- 172.21.15.57:0/20257044 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f928406d7e0 msgr2=0x7f928406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f928406d7e0 0x7f928406fc90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9290009fd0 tx=0x7f929000b040 comp rx=0 tx=0).stop 2024-02-28T16:14:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 -- 172.21.15.57:0/20257044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f929c0fe2b0 msgr2=0x7f929c10df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f929c0fe2b0 0x7f929c10df50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f928800b3b0 tx=0x7f9288009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 -- 172.21.15.57:0/20257044 shutdown_connections 2024-02-28T16:14:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f928406d7e0 0x7f928406fc90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f929c0fb220 0x7f929c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 --2- 172.21.15.57:0/20257044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f929c0fe2b0 0x7f929c10df50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 -- 172.21.15.57:0/20257044 >> 172.21.15.57:0/20257044 conn(0x7f929c0f6ca0 msgr2=0x7f929c0f8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:00.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 -- 172.21.15.57:0/20257044 shutdown_connections 2024-02-28T16:14:00.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.477+0000 7f92a4400700 1 -- 172.21.15.57:0/20257044 wait complete. 2024-02-28T16:14:00.470 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2024-02-28T16:14:00.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.633+0000 7ffae1200700 1 -- 172.21.15.57:0/82300388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffadc0ff170 msgr2=0x7ffadc0ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:00.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.633+0000 7ffae1200700 1 --2- 172.21.15.57:0/82300388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffadc0ff170 0x7ffadc0ff580 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffacc004940 tx=0x7ffacc009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:00.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.633+0000 7ffae1200700 1 -- 172.21.15.57:0/82300388 shutdown_connections 2024-02-28T16:14:00.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.633+0000 7ffae1200700 1 --2- 172.21.15.57:0/82300388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffadc100380 0x7ffadc1007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.633+0000 7ffae1200700 1 --2- 172.21.15.57:0/82300388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffadc0ff170 0x7ffadc0ff580 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.633+0000 7ffae1200700 1 -- 172.21.15.57:0/82300388 >> 172.21.15.57:0/82300388 conn(0x7ffadc0fa920 msgr2=0x7ffadc0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:00.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.633+0000 7ffae1200700 1 -- 172.21.15.57:0/82300388 shutdown_connections 2024-02-28T16:14:00.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.633+0000 7ffae1200700 1 -- 172.21.15.57:0/82300388 wait complete. 2024-02-28T16:14:00.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.634+0000 7ffae1200700 1 Processor -- start 2024-02-28T16:14:00.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.634+0000 7ffae1200700 1 -- start start 2024-02-28T16:14:00.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.635+0000 7ffae1200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffadc0ff170 0x7ffadc10fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:00.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.635+0000 7ffae1200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffadc100380 0x7ffadc110230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:00.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.635+0000 7ffae1200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc110830 con 0x7ffadc100380 2024-02-28T16:14:00.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.635+0000 7ffae1200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc110fc0 con 0x7ffadc0ff170 2024-02-28T16:14:00.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.635+0000 7ffad9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffadc100380 0x7ffadc110230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:00.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.635+0000 7ffad9400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffadc100380 0x7ffadc110230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52744/0 (socket says 172.21.15.57:52744) 2024-02-28T16:14:00.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.635+0000 7ffad9400700 1 -- 172.21.15.57:0/791663530 learned_addr learned my addr 172.21.15.57:0/791663530 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:14:00.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.635+0000 7ffad9e00700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffadc0ff170 0x7ffadc10fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:00.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.636+0000 7ffad9400700 1 -- 172.21.15.57:0/791663530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffadc0ff170 msgr2=0x7ffadc10fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:00.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.636+0000 7ffad9400700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffadc0ff170 0x7ffadc10fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.636+0000 7ffad9400700 1 -- 172.21.15.57:0/791663530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc005040 con 0x7ffadc100380 2024-02-28T16:14:00.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.636+0000 7ffad9400700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffadc100380 0x7ffadc110230 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ffac8002a50 tx=0x7ffac80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:00.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.636+0000 7ffad2000700 1 -- 172.21.15.57:0/791663530 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac8007cc0 con 0x7ffadc100380 2024-02-28T16:14:00.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.636+0000 7ffad2000700 1 -- 172.21.15.57:0/791663530 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffac800f040 con 0x7ffadc100380 2024-02-28T16:14:00.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.636+0000 7ffae1200700 1 -- 172.21.15.57:0/791663530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffadc1112a0 con 0x7ffadc100380 2024-02-28T16:14:00.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.636+0000 7ffad2000700 1 -- 172.21.15.57:0/791663530 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac8009640 con 0x7ffadc100380 2024-02-28T16:14:00.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.637+0000 7ffae1200700 1 -- 172.21.15.57:0/791663530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc1117e0 con 0x7ffadc100380 2024-02-28T16:14:00.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.638+0000 7ffae1200700 1 -- 172.21.15.57:0/791663530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffadc04bed0 con 0x7ffadc100380 2024-02-28T16:14:00.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.639+0000 7ffad2000700 1 -- 172.21.15.57:0/791663530 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ffac80097a0 con 0x7ffadc100380 2024-02-28T16:14:00.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.639+0000 7ffad2000700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffac006d7f0 0x7ffac006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:00.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.640+0000 7ffad2000700 1 -- 172.21.15.57:0/791663530 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ffac808cdc0 con 0x7ffadc100380 2024-02-28T16:14:00.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.640+0000 7ffad9e00700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffac006d7f0 0x7ffac006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:00.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.640+0000 7ffad9e00700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffac006d7f0 0x7ffac006fca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00b3b0 tx=0x7ffacc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:00.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.644+0000 7ffad2000700 1 -- 172.21.15.57:0/791663530 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffac8090030 con 0x7ffadc100380 2024-02-28T16:14:00.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.896+0000 7ffae1200700 1 -- 172.21.15.57:0/791663530 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffadc111cf0 con 0x7ffac006d7f0 2024-02-28T16:14:00.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.898+0000 7ffad2000700 1 -- 172.21.15.57:0/791663530 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7ffadc111cf0 con 0x7ffac006d7f0 2024-02-28T16:14:00.890 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:14:00.890 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:14:00.890 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": true, 2024-02-28T16:14:00.890 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:14:00.890 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [ 2024-02-28T16:14:00.890 INFO:teuthology.orchestra.run.smithi057.stdout: "mon", 2024-02-28T16:14:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr", 2024-02-28T16:14:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "osd", 2024-02-28T16:14:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "mds", 2024-02-28T16:14:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "crash" 2024-02-28T16:14:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-02-28T16:14:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": "16/21 daemons upgraded", 2024-02-28T16:14:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "Currently upgrading grafana daemons", 2024-02-28T16:14:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:14:00.891 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 -- 172.21.15.57:0/791663530 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffac006d7f0 msgr2=0x7ffac006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffac006d7f0 0x7ffac006fca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00b3b0 tx=0x7ffacc009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 -- 172.21.15.57:0/791663530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffadc100380 msgr2=0x7ffadc110230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffadc100380 0x7ffadc110230 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ffac8002a50 tx=0x7ffac80046b0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 -- 172.21.15.57:0/791663530 shutdown_connections 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffac006d7f0 0x7ffac006fca0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffadc0ff170 0x7ffadc10fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 --2- 172.21.15.57:0/791663530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffadc100380 0x7ffadc110230 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 -- 172.21.15.57:0/791663530 >> 172.21.15.57:0/791663530 conn(0x7ffadc0fa920 msgr2=0x7ffadc1035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 -- 172.21.15.57:0/791663530 shutdown_connections 2024-02-28T16:14:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:00.901+0000 7ffae1200700 1 -- 172.21.15.57:0/791663530 wait complete. 2024-02-28T16:14:00.940 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:00 smithi057 ceph-mon[93219]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:00.941 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:00 smithi057 ceph-mon[93219]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:00.941 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:00 smithi057 ceph-mon[93219]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:00.941 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:00 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2588642905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:00.941 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:00 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/20257044' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:14:00.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:00 smithi087 ceph-mon[82628]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:00.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:00 smithi087 ceph-mon[82628]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:00.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:00 smithi087 ceph-mon[82628]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:00.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:00 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2588642905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:00.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:00 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/20257044' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:14:01.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.053+0000 7fe955c00700 1 -- 172.21.15.57:0/2686929301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe950100170 msgr2=0x7fe9501005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:01.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.053+0000 7fe955c00700 1 --2- 172.21.15.57:0/2686929301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe950100170 0x7fe9501005c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe93c004940 tx=0x7fe93c009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:01.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.053+0000 7fe955c00700 1 -- 172.21.15.57:0/2686929301 shutdown_connections 2024-02-28T16:14:01.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.053+0000 7fe955c00700 1 --2- 172.21.15.57:0/2686929301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe950100170 0x7fe9501005c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:01.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.053+0000 7fe955c00700 1 --2- 172.21.15.57:0/2686929301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9500fef60 0x7fe9500ff370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:01.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.053+0000 7fe955c00700 1 -- 172.21.15.57:0/2686929301 >> 172.21.15.57:0/2686929301 conn(0x7fe9500fa760 msgr2=0x7fe9500fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:01.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.054+0000 7fe955c00700 1 -- 172.21.15.57:0/2686929301 shutdown_connections 2024-02-28T16:14:01.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.054+0000 7fe955c00700 1 -- 172.21.15.57:0/2686929301 wait complete. 2024-02-28T16:14:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.054+0000 7fe955c00700 1 Processor -- start 2024-02-28T16:14:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.054+0000 7fe955c00700 1 -- start start 2024-02-28T16:14:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.055+0000 7fe955c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9500fef60 0x7fe95010f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.055+0000 7fe955c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe950100170 0x7fe95010fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.055+0000 7fe955c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe950110530 con 0x7fe950100170 2024-02-28T16:14:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.055+0000 7fe955c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe950110d70 con 0x7fe9500fef60 2024-02-28T16:14:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.055+0000 7fe94f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe950100170 0x7fe95010fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.055+0000 7fe94f400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe950100170 0x7fe95010fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52758/0 (socket says 172.21.15.57:52758) 2024-02-28T16:14:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.055+0000 7fe94f400700 1 -- 172.21.15.57:0/2523205515 learned_addr learned my addr 172.21.15.57:0/2523205515 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.055+0000 7fe94fe00700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9500fef60 0x7fe95010f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.055+0000 7fe94f400700 1 -- 172.21.15.57:0/2523205515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9500fef60 msgr2=0x7fe95010f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.056+0000 7fe94f400700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9500fef60 0x7fe95010f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.056+0000 7fe94f400700 1 -- 172.21.15.57:0/2523205515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c005040 con 0x7fe950100170 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.056+0000 7fe94fe00700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9500fef60 0x7fe95010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.056+0000 7fe94f400700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe950100170 0x7fe95010fea0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0093b0 tx=0x7fe93c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.056+0000 7fe947e00700 1 -- 172.21.15.57:0/2523205515 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe93c00e040 con 0x7fe950100170 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.056+0000 7fe947e00700 1 -- 172.21.15.57:0/2523205515 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe93c00bcc0 con 0x7fe950100170 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.056+0000 7fe947e00700 1 -- 172.21.15.57:0/2523205515 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe93c01c630 con 0x7fe950100170 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.056+0000 7fe955c00700 1 -- 172.21.15.57:0/2523205515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe950110ff0 con 0x7fe950100170 2024-02-28T16:14:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.056+0000 7fe955c00700 1 -- 172.21.15.57:0/2523205515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9501115b0 con 0x7fe950100170 2024-02-28T16:14:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.057+0000 7fe955c00700 1 -- 172.21.15.57:0/2523205515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95004bed0 con 0x7fe950100170 2024-02-28T16:14:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.059+0000 7fe947e00700 1 -- 172.21.15.57:0/2523205515 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fe93c0139f0 con 0x7fe950100170 2024-02-28T16:14:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.059+0000 7fe947e00700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe93406d7e0 0x7fe93406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.060+0000 7fe947e00700 1 -- 172.21.15.57:0/2523205515 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fe93c08e360 con 0x7fe950100170 2024-02-28T16:14:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.060+0000 7fe94fe00700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe93406d7e0 0x7fe93406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:01.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.060+0000 7fe94fe00700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe93406d7e0 0x7fe93406fc90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe940006fd0 tx=0x7fe940008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:01.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.064+0000 7fe947e00700 1 -- 172.21.15.57:0/2523205515 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe93c05b6a0 con 0x7fe950100170 2024-02-28T16:14:01.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.363+0000 7fe955c00700 1 -- 172.21.15.57:0/2523205515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe950107ae0 con 0x7fe950100170 2024-02-28T16:14:01.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.364+0000 7fe947e00700 1 -- 172.21.15.57:0/2523205515 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe93c05b230 con 0x7fe950100170 2024-02-28T16:14:01.356 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:14:01.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.368+0000 7fe955c00700 1 -- 172.21.15.57:0/2523205515 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe93406d7e0 msgr2=0x7fe93406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.368+0000 7fe955c00700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe93406d7e0 0x7fe93406fc90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe940006fd0 tx=0x7fe940008040 comp rx=0 tx=0).stop 2024-02-28T16:14:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.368+0000 7fe955c00700 1 -- 172.21.15.57:0/2523205515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe950100170 msgr2=0x7fe95010fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.368+0000 7fe955c00700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe950100170 0x7fe95010fea0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0093b0 tx=0x7fe93c009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.368+0000 7fe955c00700 1 -- 172.21.15.57:0/2523205515 shutdown_connections 2024-02-28T16:14:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.368+0000 7fe955c00700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fe93406d7e0 0x7fe93406fc90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.368+0000 7fe955c00700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9500fef60 0x7fe95010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.368+0000 7fe955c00700 1 --2- 172.21.15.57:0/2523205515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe950100170 0x7fe95010fea0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:01.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.368+0000 7fe955c00700 1 -- 172.21.15.57:0/2523205515 >> 172.21.15.57:0/2523205515 conn(0x7fe9500fa760 msgr2=0x7fe9501033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:01.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.369+0000 7fe955c00700 1 -- 172.21.15.57:0/2523205515 shutdown_connections 2024-02-28T16:14:01.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:01.369+0000 7fe955c00700 1 -- 172.21.15.57:0/2523205515 wait complete. 2024-02-28T16:14:01.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:01 smithi087 ceph-mon[82628]: pgmap v340: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:01.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:01 smithi087 ceph-mon[82628]: from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:01.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:01 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2523205515' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:14:02.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:01 smithi057 ceph-mon[93219]: pgmap v340: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:02.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:01 smithi057 ceph-mon[93219]: from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:02.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:01 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2523205515' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:14:02.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:02 smithi057 ceph-mon[93219]: pgmap v341: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:02.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:02 smithi087 ceph-mon[82628]: pgmap v341: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:04.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:03 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:04.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:03 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:05.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:05 smithi087 ceph-mon[82628]: pgmap v342: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:05.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:05 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:05.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:05 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:05.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:05 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:14:05.994 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:05 smithi057 ceph-mon[93219]: pgmap v342: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:05.994 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:05 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:05.994 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:05 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:05.995 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:05 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:14:06.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:06 smithi087 ceph-mon[82628]: pgmap v343: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:07.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:06 smithi057 ceph-mon[93219]: pgmap v343: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:09.253 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:08 smithi057 ceph-mon[93219]: pgmap v344: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:09.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:08 smithi087 ceph-mon[82628]: pgmap v344: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:11.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:10 smithi057 ceph-mon[93219]: pgmap v345: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:11.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:10 smithi087 ceph-mon[82628]: pgmap v345: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:12.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:12.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:12 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:12.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:12.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:12 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:13.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:13 smithi057 ceph-mon[93219]: pgmap v346: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:13.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:13 smithi087 ceph-mon[82628]: pgmap v346: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:14.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:14 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:14.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:14 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:14.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:14 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:14.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:14 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:15.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:15 smithi057 ceph-mon[93219]: pgmap v347: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:15.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:15 smithi087 ceph-mon[82628]: pgmap v347: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:17.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:17 smithi057 ceph-mon[93219]: pgmap v348: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:17.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:17 smithi087 ceph-mon[82628]: pgmap v348: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:19 smithi057 ceph-mon[93219]: pgmap v349: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:19.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:19.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:14:19.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:19.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:19 smithi087 ceph-mon[82628]: pgmap v349: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:19.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:14:19.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: Upgrade: Finalizing container_image settings 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T16:14:20.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T16:14:20.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T16:14:20.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-28T16:14:20.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T16:14:20.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-28T16:14:20.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T16:14:20.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-28T16:14:20.429 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.430 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:14:20.431 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:20 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:20.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.465 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: Upgrade: Finalizing container_image settings 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T16:14:20.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T16:14:20.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T16:14:20.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-28T16:14:20.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T16:14:20.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-28T16:14:20.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T16:14:20.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-28T16:14:20.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T16:14:20.467 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T16:14:20.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T16:14:20.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T16:14:20.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T16:14:20.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-28T16:14:20.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T16:14:20.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T16:14:20.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T16:14:20.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T16:14:20.468 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:20.469 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:14:20.470 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:20 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:21.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:21 smithi057 ceph-mon[93219]: Upgrade: Complete! 2024-02-28T16:14:21.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:21 smithi057 ceph-mon[93219]: pgmap v350: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:21.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:21 smithi087 ceph-mon[82628]: Upgrade: Complete! 2024-02-28T16:14:21.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:21 smithi087 ceph-mon[82628]: pgmap v350: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:23.427 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:23 smithi057 ceph-mon[93219]: pgmap v351: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:23.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:23 smithi087 ceph-mon[82628]: pgmap v351: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:25.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:25 smithi087 ceph-mon[82628]: pgmap v352: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:25.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:25.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:25 smithi057 ceph-mon[93219]: pgmap v352: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:25.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:14:27.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:27 smithi087 ceph-mon[82628]: pgmap v353: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:27.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:27 smithi057 ceph-mon[93219]: pgmap v353: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:29.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:29 smithi057 ceph-mon[93219]: pgmap v354: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:29.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:29 smithi087 ceph-mon[82628]: pgmap v354: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:31.531 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:31 smithi057 ceph-mon[93219]: pgmap v355: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.540+0000 7f61eee00700 1 -- 172.21.15.57:0/3662593778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61e8100360 msgr2=0x7f61e81007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.540+0000 7f61eee00700 1 --2- 172.21.15.57:0/3662593778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61e8100360 0x7f61e81007b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f61d4004940 tx=0x7f61d4009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.540+0000 7f61eee00700 1 -- 172.21.15.57:0/3662593778 shutdown_connections 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.540+0000 7f61eee00700 1 --2- 172.21.15.57:0/3662593778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61e8100360 0x7f61e81007b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.540+0000 7f61eee00700 1 --2- 172.21.15.57:0/3662593778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e80ff150 0x7f61e80ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.540+0000 7f61eee00700 1 -- 172.21.15.57:0/3662593778 >> 172.21.15.57:0/3662593778 conn(0x7f61e80fa920 msgr2=0x7f61e80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.541+0000 7f61eee00700 1 -- 172.21.15.57:0/3662593778 shutdown_connections 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.541+0000 7f61eee00700 1 -- 172.21.15.57:0/3662593778 wait complete. 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.541+0000 7f61eee00700 1 Processor -- start 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.542+0000 7f61eee00700 1 -- start start 2024-02-28T16:14:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.542+0000 7f61eee00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61e80ff150 0x7f61e810fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.542+0000 7f61eee00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e8100360 0x7f61e81100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.542+0000 7f61eee00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e81106b0 con 0x7f61e80ff150 2024-02-28T16:14:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.542+0000 7f61eee00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e8110f50 con 0x7f61e8100360 2024-02-28T16:14:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.542+0000 7f61e7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61e80ff150 0x7f61e810fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.542+0000 7f61e7e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61e80ff150 0x7f61e810fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38720/0 (socket says 172.21.15.57:38720) 2024-02-28T16:14:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.542+0000 7f61e7e00700 1 -- 172.21.15.57:0/2971162729 learned_addr learned my addr 172.21.15.57:0/2971162729 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:14:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.543+0000 7f61e7400700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e8100360 0x7f61e81100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.543+0000 7f61e7e00700 1 -- 172.21.15.57:0/2971162729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e8100360 msgr2=0x7f61e81100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.543+0000 7f61e7e00700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e8100360 0x7f61e81100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.543+0000 7f61e7e00700 1 -- 172.21.15.57:0/2971162729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4005040 con 0x7f61e80ff150 2024-02-28T16:14:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.543+0000 7f61e7e00700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61e80ff150 0x7f61e810fb70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f61d8002a80 tx=0x7f61d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.543+0000 7f61dfe00700 1 -- 172.21.15.57:0/2971162729 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61d8007cc0 con 0x7f61e80ff150 2024-02-28T16:14:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.543+0000 7f61dfe00700 1 -- 172.21.15.57:0/2971162729 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61d800f040 con 0x7f61e80ff150 2024-02-28T16:14:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.543+0000 7f61dfe00700 1 -- 172.21.15.57:0/2971162729 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61d800dad0 con 0x7f61e80ff150 2024-02-28T16:14:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.543+0000 7f61eee00700 1 -- 172.21.15.57:0/2971162729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e8111230 con 0x7f61e80ff150 2024-02-28T16:14:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.544+0000 7f61eee00700 1 -- 172.21.15.57:0/2971162729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e8111770 con 0x7f61e80ff150 2024-02-28T16:14:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.545+0000 7f61eee00700 1 -- 172.21.15.57:0/2971162729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e804bed0 con 0x7f61e80ff150 2024-02-28T16:14:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.546+0000 7f61dfe00700 1 -- 172.21.15.57:0/2971162729 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f61d800dc30 con 0x7f61e80ff150 2024-02-28T16:14:31.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.547+0000 7f61dfe00700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f61cc06d7e0 0x7f61cc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:31.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.547+0000 7f61dfe00700 1 -- 172.21.15.57:0/2971162729 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f61d808cd60 con 0x7f61e80ff150 2024-02-28T16:14:31.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.547+0000 7f61e7400700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f61cc06d7e0 0x7f61cc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:31.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.548+0000 7f61e7400700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f61cc06d7e0 0x7f61cc06fc90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f61d4004f90 tx=0x7f61d4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:31.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.552+0000 7f61dfe00700 1 -- 172.21.15.57:0/2971162729 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f61d8091070 con 0x7f61e80ff150 2024-02-28T16:14:31.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:31 smithi087 ceph-mon[82628]: pgmap v355: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:31.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.801+0000 7f61eee00700 1 -- 172.21.15.57:0/2971162729 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f61e8111c30 con 0x7f61cc06d7e0 2024-02-28T16:14:31.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.803+0000 7f61dfe00700 1 -- 172.21.15.57:0/2971162729 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f61e8111c30 con 0x7f61cc06d7e0 2024-02-28T16:14:31.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.807+0000 7f61eee00700 1 -- 172.21.15.57:0/2971162729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f61cc06d7e0 msgr2=0x7f61cc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:31.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.807+0000 7f61eee00700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f61cc06d7e0 0x7f61cc06fc90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f61d4004f90 tx=0x7f61d4009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:31.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.807+0000 7f61eee00700 1 -- 172.21.15.57:0/2971162729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61e80ff150 msgr2=0x7f61e810fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:31.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.807+0000 7f61eee00700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61e80ff150 0x7f61e810fb70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f61d8002a80 tx=0x7f61d8004600 comp rx=0 tx=0).stop 2024-02-28T16:14:31.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.807+0000 7f61eee00700 1 -- 172.21.15.57:0/2971162729 shutdown_connections 2024-02-28T16:14:31.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.807+0000 7f61eee00700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f61cc06d7e0 0x7f61cc06fc90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:31.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.807+0000 7f61eee00700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61e80ff150 0x7f61e810fb70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:31.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.807+0000 7f61eee00700 1 --2- 172.21.15.57:0/2971162729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e8100360 0x7f61e81100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:31.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.807+0000 7f61eee00700 1 -- 172.21.15.57:0/2971162729 >> 172.21.15.57:0/2971162729 conn(0x7f61e80fa920 msgr2=0x7f61e8103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:31.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.807+0000 7f61eee00700 1 -- 172.21.15.57:0/2971162729 shutdown_connections 2024-02-28T16:14:31.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:31.808+0000 7f61eee00700 1 -- 172.21.15.57:0/2971162729 wait complete. 2024-02-28T16:14:32.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-02-28T16:14:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:14:33.487 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:33 smithi057 ceph-mon[93219]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:33.487 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:33 smithi057 ceph-mon[93219]: pgmap v356: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:33.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:33 smithi087 ceph-mon[82628]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:33.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:33 smithi087 ceph-mon[82628]: pgmap v356: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:34.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:34.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:35.298 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:35 smithi057 ceph-mon[93219]: pgmap v357: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:35.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.307+0000 7fd111e00700 1 -- 172.21.15.57:0/3780270510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10c1038f0 msgr2=0x7fd10c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:35.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.307+0000 7fd111e00700 1 --2- 172.21.15.57:0/3780270510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10c1038f0 0x7fd10c0fcf60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4004940 tx=0x7fd0f4009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:35.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.307+0000 7fd111e00700 1 -- 172.21.15.57:0/3780270510 shutdown_connections 2024-02-28T16:14:35.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.307+0000 7fd111e00700 1 --2- 172.21.15.57:0/3780270510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10c1038f0 0x7fd10c0fcf60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:35.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.307+0000 7fd111e00700 1 --2- 172.21.15.57:0/3780270510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd10c102f50 0x7fd10c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:35.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.307+0000 7fd111e00700 1 -- 172.21.15.57:0/3780270510 >> 172.21.15.57:0/3780270510 conn(0x7fd10c0f8ae0 msgr2=0x7fd10c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:35.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.307+0000 7fd111e00700 1 -- 172.21.15.57:0/3780270510 shutdown_connections 2024-02-28T16:14:35.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.307+0000 7fd111e00700 1 -- 172.21.15.57:0/3780270510 wait complete. 2024-02-28T16:14:35.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.308+0000 7fd111e00700 1 Processor -- start 2024-02-28T16:14:35.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.308+0000 7fd111e00700 1 -- start start 2024-02-28T16:14:35.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.308+0000 7fd111e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10c102f50 0x7fd10c115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:35.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.308+0000 7fd111e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd10c1038f0 0x7fd10c1161e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:35.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.309+0000 7fd111e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c116830 con 0x7fd10c102f50 2024-02-28T16:14:35.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.309+0000 7fd111e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c10fb40 con 0x7fd10c1038f0 2024-02-28T16:14:35.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.309+0000 7fd10aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10c102f50 0x7fd10c115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:35.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.309+0000 7fd10aa00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10c102f50 0x7fd10c115ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35884/0 (socket says 172.21.15.57:35884) 2024-02-28T16:14:35.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.309+0000 7fd10aa00700 1 -- 172.21.15.57:0/770630402 learned_addr learned my addr 172.21.15.57:0/770630402 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:14:35.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.309+0000 7fd102000700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd10c1038f0 0x7fd10c1161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:35.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.309+0000 7fd10aa00700 1 -- 172.21.15.57:0/770630402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd10c1038f0 msgr2=0x7fd10c1161e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:35.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.309+0000 7fd10aa00700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd10c1038f0 0x7fd10c1161e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:35.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.309+0000 7fd10aa00700 1 -- 172.21.15.57:0/770630402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4005040 con 0x7fd10c102f50 2024-02-28T16:14:35.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.310+0000 7fd10aa00700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10c102f50 0x7fd10c115ca0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc002a50 tx=0x7fd0fc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:35.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.310+0000 7fd103400700 1 -- 172.21.15.57:0/770630402 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0fc007cc0 con 0x7fd10c102f50 2024-02-28T16:14:35.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.310+0000 7fd103400700 1 -- 172.21.15.57:0/770630402 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0fc00f040 con 0x7fd10c102f50 2024-02-28T16:14:35.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.310+0000 7fd111e00700 1 -- 172.21.15.57:0/770630402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c10fe20 con 0x7fd10c102f50 2024-02-28T16:14:35.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.310+0000 7fd103400700 1 -- 172.21.15.57:0/770630402 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0fc00db70 con 0x7fd10c102f50 2024-02-28T16:14:35.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.310+0000 7fd111e00700 1 -- 172.21.15.57:0/770630402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c110360 con 0x7fd10c102f50 2024-02-28T16:14:35.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.311+0000 7fd111e00700 1 -- 172.21.15.57:0/770630402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c0fc6e0 con 0x7fd10c102f50 2024-02-28T16:14:35.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.312+0000 7fd103400700 1 -- 172.21.15.57:0/770630402 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd0fc00dd10 con 0x7fd10c102f50 2024-02-28T16:14:35.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.313+0000 7fd103400700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0f006d7f0 0x7fd0f006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:35.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.313+0000 7fd103400700 1 -- 172.21.15.57:0/770630402 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fd0fc08c7d0 con 0x7fd10c102f50 2024-02-28T16:14:35.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.314+0000 7fd102000700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0f006d7f0 0x7fd0f006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:35.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.314+0000 7fd102000700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0f006d7f0 0x7fd0f006fca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400b020 tx=0x7fd0f4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:35.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.319+0000 7fd103400700 1 -- 172.21.15.57:0/770630402 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd0fc059950 con 0x7fd10c102f50 2024-02-28T16:14:35.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.554+0000 7fd111e00700 1 -- 172.21.15.57:0/770630402 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd10c1112f0 con 0x7fd0f006d7f0 2024-02-28T16:14:35.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.582+0000 7fd103400700 1 -- 172.21.15.57:0/770630402 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd10c1112f0 con 0x7fd0f006d7f0 2024-02-28T16:14:35.574 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:14:35.574 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (55s) 24s ago 23m 14.7M - 0.25.0 c8568f914cd2 abec484faa15 2024-02-28T16:14:35.574 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (8m) 24s ago 23m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:14:35.574 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (8m) 99s ago 22m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:14:35.574 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (31s) 24s ago 23m 51.6M - 9.4.12 a0ea5e3c46d9 2c9fab9e584c 2024-02-28T16:14:35.574 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (3m) 24s ago 16m 67.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b df14dcf6973e 2024-02-28T16:14:35.574 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (3m) 24s ago 16m 16.1M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 977aa1867016 2024-02-28T16:14:35.574 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (2m) 99s ago 16m 65.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1ee4a125f5b 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (2m) 99s ago 16m 12.5M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b0b892c8725f 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (11m) 24s ago 25m 514M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (10m) 99s ago 22m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (10m) 24s ago 25m 60.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (9m) 99s ago 22m 45.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (112s) 24s ago 23m 7268k - 1.5.0 0da6a335fe13 6e10666d4d1f 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (104s) 99s ago 22m 3011k - 1.5.0 0da6a335fe13 285db7ba57fc 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (7m) 24s ago 21m 134M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (7m) 24s ago 20m 106M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (6m) 24s ago 19m 100M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (5m) 99s ago 19m 107M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (5m) 99s ago 18m 94.0M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (4m) 99s ago 18m 93.9M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b cbdb6df47634 2024-02-28T16:14:35.575 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (79s) 24s ago 22m 48.1M - 2.43.0 a07b618ecd1d 33bac790aba5 2024-02-28T16:14:35.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.585+0000 7fd111e00700 1 -- 172.21.15.57:0/770630402 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0f006d7f0 msgr2=0x7fd0f006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:35.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.585+0000 7fd111e00700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0f006d7f0 0x7fd0f006fca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400b020 tx=0x7fd0f4009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:35.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.585+0000 7fd111e00700 1 -- 172.21.15.57:0/770630402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10c102f50 msgr2=0x7fd10c115ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:35.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.585+0000 7fd111e00700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10c102f50 0x7fd10c115ca0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc002a50 tx=0x7fd0fc0046b0 comp rx=0 tx=0).stop 2024-02-28T16:14:35.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.586+0000 7fd111e00700 1 -- 172.21.15.57:0/770630402 shutdown_connections 2024-02-28T16:14:35.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.586+0000 7fd111e00700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd0f006d7f0 0x7fd0f006fca0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:35.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.586+0000 7fd111e00700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10c102f50 0x7fd10c115ca0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:35.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.586+0000 7fd111e00700 1 --2- 172.21.15.57:0/770630402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd10c1038f0 0x7fd10c1161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:35.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.586+0000 7fd111e00700 1 -- 172.21.15.57:0/770630402 >> 172.21.15.57:0/770630402 conn(0x7fd10c0f8ae0 msgr2=0x7fd10c0fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:35.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.586+0000 7fd111e00700 1 -- 172.21.15.57:0/770630402 shutdown_connections 2024-02-28T16:14:35.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:35.586+0000 7fd111e00700 1 -- 172.21.15.57:0/770630402 wait complete. 2024-02-28T16:14:35.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:35 smithi087 ceph-mon[82628]: pgmap v357: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:36.353 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade status' 2024-02-28T16:14:36.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:36 smithi057 ceph-mon[93219]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:36.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:36 smithi087 ceph-mon[82628]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:36.876 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:14:37.361 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:37 smithi057 ceph-mon[93219]: pgmap v358: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:37.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:37 smithi087 ceph-mon[82628]: pgmap v358: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:39.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.012+0000 7f0762400700 1 -- 172.21.15.57:0/2993487712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f075c103dc0 msgr2=0x7f075c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:39.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.012+0000 7f0762400700 1 --2- 172.21.15.57:0/2993487712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f075c103dc0 0x7f075c104210 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0748004940 tx=0x7f0748009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:39.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.012+0000 7f0762400700 1 -- 172.21.15.57:0/2993487712 shutdown_connections 2024-02-28T16:14:39.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.012+0000 7f0762400700 1 --2- 172.21.15.57:0/2993487712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f075c103dc0 0x7f075c104210 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:39.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.012+0000 7f0762400700 1 --2- 172.21.15.57:0/2993487712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f075c1095f0 0x7f075c1099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:39.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.012+0000 7f0762400700 1 -- 172.21.15.57:0/2993487712 >> 172.21.15.57:0/2993487712 conn(0x7f075c072d50 msgr2=0x7f075c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:39.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.012+0000 7f0762400700 1 -- 172.21.15.57:0/2993487712 shutdown_connections 2024-02-28T16:14:39.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.012+0000 7f0762400700 1 -- 172.21.15.57:0/2993487712 wait complete. 2024-02-28T16:14:39.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.013+0000 7f0762400700 1 Processor -- start 2024-02-28T16:14:39.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.013+0000 7f0762400700 1 -- start start 2024-02-28T16:14:39.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f0762400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f075c103dc0 0x7f075c11a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:39.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f0762400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f075c1095f0 0x7f075c11a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:39.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f0762400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c11abd0 con 0x7f075c103dc0 2024-02-28T16:14:39.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f0762400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c113ee0 con 0x7f075c1095f0 2024-02-28T16:14:39.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f075b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f075c103dc0 0x7f075c11a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:39.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f075b400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f075c103dc0 0x7f075c11a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35900/0 (socket says 172.21.15.57:35900) 2024-02-28T16:14:39.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f075b400700 1 -- 172.21.15.57:0/3915712196 learned_addr learned my addr 172.21.15.57:0/3915712196 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:14:39.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f075aa00700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f075c1095f0 0x7f075c11a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:39.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f075b400700 1 -- 172.21.15.57:0/3915712196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f075c1095f0 msgr2=0x7f075c11a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:39.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f075b400700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f075c1095f0 0x7f075c11a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:39.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.014+0000 7f075b400700 1 -- 172.21.15.57:0/3915712196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748005040 con 0x7f075c103dc0 2024-02-28T16:14:39.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.015+0000 7f075b400700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f075c103dc0 0x7f075c11a040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f074c002a50 tx=0x7f074c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:39.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.015+0000 7f0753400700 1 -- 172.21.15.57:0/3915712196 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f074c007cc0 con 0x7f075c103dc0 2024-02-28T16:14:39.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.015+0000 7f0753400700 1 -- 172.21.15.57:0/3915712196 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f074c00f040 con 0x7f075c103dc0 2024-02-28T16:14:39.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.015+0000 7f0753400700 1 -- 172.21.15.57:0/3915712196 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f074c009640 con 0x7f075c103dc0 2024-02-28T16:14:39.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.015+0000 7f0762400700 1 -- 172.21.15.57:0/3915712196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c1141c0 con 0x7f075c103dc0 2024-02-28T16:14:39.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.015+0000 7f0762400700 1 -- 172.21.15.57:0/3915712196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c114700 con 0x7f075c103dc0 2024-02-28T16:14:39.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.016+0000 7f0762400700 1 -- 172.21.15.57:0/3915712196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c10b9c0 con 0x7f075c103dc0 2024-02-28T16:14:39.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.017+0000 7f0753400700 1 -- 172.21.15.57:0/3915712196 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f074c0097a0 con 0x7f075c103dc0 2024-02-28T16:14:39.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.018+0000 7f0753400700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f074006d7f0 0x7f074006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:39.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.018+0000 7f0753400700 1 -- 172.21.15.57:0/3915712196 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f074c08cde0 con 0x7f075c103dc0 2024-02-28T16:14:39.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.019+0000 7f075aa00700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f074006d7f0 0x7f074006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:39.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.019+0000 7f075aa00700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f074006d7f0 0x7f074006fca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f074800b3b0 tx=0x7f0748009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:39.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.024+0000 7f0753400700 1 -- 172.21.15.57:0/3915712196 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f074c05a000 con 0x7f075c103dc0 2024-02-28T16:14:39.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.271+0000 7f0762400700 1 -- 172.21.15.57:0/3915712196 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f075c115620 con 0x7f074006d7f0 2024-02-28T16:14:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.273+0000 7f0753400700 1 -- 172.21.15.57:0/3915712196 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f075c115620 con 0x7f074006d7f0 2024-02-28T16:14:39.264 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:14:39.264 INFO:teuthology.orchestra.run.smithi057.stdout: "target_image": null, 2024-02-28T16:14:39.264 INFO:teuthology.orchestra.run.smithi057.stdout: "in_progress": false, 2024-02-28T16:14:39.265 INFO:teuthology.orchestra.run.smithi057.stdout: "which": "", 2024-02-28T16:14:39.265 INFO:teuthology.orchestra.run.smithi057.stdout: "services_complete": [], 2024-02-28T16:14:39.265 INFO:teuthology.orchestra.run.smithi057.stdout: "progress": null, 2024-02-28T16:14:39.265 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "", 2024-02-28T16:14:39.265 INFO:teuthology.orchestra.run.smithi057.stdout: "is_paused": false 2024-02-28T16:14:39.265 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:14:39.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.276+0000 7f0762400700 1 -- 172.21.15.57:0/3915712196 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f074006d7f0 msgr2=0x7f074006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:39.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.276+0000 7f0762400700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f074006d7f0 0x7f074006fca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f074800b3b0 tx=0x7f0748009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:39.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.276+0000 7f0762400700 1 -- 172.21.15.57:0/3915712196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f075c103dc0 msgr2=0x7f075c11a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:39.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.276+0000 7f0762400700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f075c103dc0 0x7f075c11a040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f074c002a50 tx=0x7f074c0046b0 comp rx=0 tx=0).stop 2024-02-28T16:14:39.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.276+0000 7f0762400700 1 -- 172.21.15.57:0/3915712196 shutdown_connections 2024-02-28T16:14:39.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.276+0000 7f0762400700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f074006d7f0 0x7f074006fca0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:39.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.276+0000 7f0762400700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f075c103dc0 0x7f075c11a040 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:39.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.276+0000 7f0762400700 1 --2- 172.21.15.57:0/3915712196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f075c1095f0 0x7f075c11a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:39.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.276+0000 7f0762400700 1 -- 172.21.15.57:0/3915712196 >> 172.21.15.57:0/3915712196 conn(0x7f075c072d50 msgr2=0x7f075c074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:39.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.277+0000 7f0762400700 1 -- 172.21.15.57:0/3915712196 shutdown_connections 2024-02-28T16:14:39.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:39.277+0000 7f0762400700 1 -- 172.21.15.57:0/3915712196 wait complete. 2024-02-28T16:14:39.591 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:39 smithi057 ceph-mon[93219]: pgmap v359: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:39.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:39 smithi087 ceph-mon[82628]: pgmap v359: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:40.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph health detail' 2024-02-28T16:14:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:14:40.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:40 smithi057 ceph-mon[93219]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:40.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:40 smithi087 ceph-mon[82628]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:41.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:41 smithi057 ceph-mon[93219]: pgmap v360: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:41.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:41 smithi087 ceph-mon[82628]: pgmap v360: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:42.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.634+0000 7fc27e400700 1 -- 172.21.15.57:0/1517894492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc278071f60 msgr2=0x7fc278070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.634+0000 7fc27e400700 1 --2- 172.21.15.57:0/1517894492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc278071f60 0x7fc278070330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009d10 tx=0x7fc26c004d10 comp rx=0 tx=0).stop 2024-02-28T16:14:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.634+0000 7fc27e400700 1 -- 172.21.15.57:0/1517894492 shutdown_connections 2024-02-28T16:14:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.634+0000 7fc27e400700 1 --2- 172.21.15.57:0/1517894492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc278070870 0x7fc278070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.634+0000 7fc27e400700 1 --2- 172.21.15.57:0/1517894492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc278071f60 0x7fc278070330 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.634+0000 7fc27e400700 1 -- 172.21.15.57:0/1517894492 >> 172.21.15.57:0/1517894492 conn(0x7fc2780f8940 msgr2=0x7fc2780fad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.634+0000 7fc27e400700 1 -- 172.21.15.57:0/1517894492 shutdown_connections 2024-02-28T16:14:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.634+0000 7fc27e400700 1 -- 172.21.15.57:0/1517894492 wait complete. 2024-02-28T16:14:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.635+0000 7fc27e400700 1 Processor -- start 2024-02-28T16:14:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.635+0000 7fc27e400700 1 -- start start 2024-02-28T16:14:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.636+0000 7fc27e400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc278070870 0x7fc27811a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.636+0000 7fc27e400700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc278071f60 0x7fc27811a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.636+0000 7fc27e400700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27811ac10 con 0x7fc278071f60 2024-02-28T16:14:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.636+0000 7fc27e400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc278113f20 con 0x7fc278070870 2024-02-28T16:14:42.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.636+0000 7fc277e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc278071f60 0x7fc27811a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:42.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.636+0000 7fc277e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc278071f60 0x7fc27811a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47988/0 (socket says 172.21.15.57:47988) 2024-02-28T16:14:42.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.636+0000 7fc277e00700 1 -- 172.21.15.57:0/326620144 learned_addr learned my addr 172.21.15.57:0/326620144 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:14:42.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.637+0000 7fc27d000700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc278070870 0x7fc27811a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.637+0000 7fc277e00700 1 -- 172.21.15.57:0/326620144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc278070870 msgr2=0x7fc27811a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.637+0000 7fc277e00700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc278070870 0x7fc27811a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.637+0000 7fc277e00700 1 -- 172.21.15.57:0/326620144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c009940 con 0x7fc278071f60 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.637+0000 7fc277e00700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc278071f60 0x7fc27811a5c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc264002a50 tx=0x7fc2640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.637+0000 7fc274c00700 1 -- 172.21.15.57:0/326620144 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc264007cc0 con 0x7fc278071f60 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.638+0000 7fc274c00700 1 -- 172.21.15.57:0/326620144 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc26400f040 con 0x7fc278071f60 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.638+0000 7fc27e400700 1 -- 172.21.15.57:0/326620144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc278114200 con 0x7fc278071f60 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.638+0000 7fc274c00700 1 -- 172.21.15.57:0/326620144 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc264009640 con 0x7fc278071f60 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.638+0000 7fc27e400700 1 -- 172.21.15.57:0/326620144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc278114740 con 0x7fc278071f60 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.639+0000 7fc27e400700 1 -- 172.21.15.57:0/326620144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2780fe260 con 0x7fc278071f60 2024-02-28T16:14:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.640+0000 7fc274c00700 1 -- 172.21.15.57:0/326620144 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fc2640097a0 con 0x7fc278071f60 2024-02-28T16:14:42.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.641+0000 7fc274c00700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc26006d7f0 0x7fc26006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:42.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.641+0000 7fc274c00700 1 -- 172.21.15.57:0/326620144 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fc26408cde0 con 0x7fc278071f60 2024-02-28T16:14:42.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.641+0000 7fc27d000700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc26006d7f0 0x7fc26006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:42.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.642+0000 7fc27d000700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc26006d7f0 0x7fc26006fca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc26c015040 tx=0x7fc26c004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:42.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.646+0000 7fc274c00700 1 -- 172.21.15.57:0/326620144 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc26405a000 con 0x7fc278071f60 2024-02-28T16:14:42.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.965+0000 7fc27e400700 1 -- 172.21.15.57:0/326620144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc27804bed0 con 0x7fc278071f60 2024-02-28T16:14:42.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.966+0000 7fc274c00700 1 -- 172.21.15.57:0/326620144 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc264059b90 con 0x7fc278071f60 2024-02-28T16:14:42.956 INFO:teuthology.orchestra.run.smithi057.stdout:HEALTH_OK 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 -- 172.21.15.57:0/326620144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc26006d7f0 msgr2=0x7fc26006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc26006d7f0 0x7fc26006fca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc26c015040 tx=0x7fc26c004d10 comp rx=0 tx=0).stop 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 -- 172.21.15.57:0/326620144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc278071f60 msgr2=0x7fc27811a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc278071f60 0x7fc27811a5c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc264002a50 tx=0x7fc2640046b0 comp rx=0 tx=0).stop 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 -- 172.21.15.57:0/326620144 shutdown_connections 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fc26006d7f0 0x7fc26006fca0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc278070870 0x7fc27811a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 --2- 172.21.15.57:0/326620144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc278071f60 0x7fc27811a5c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 -- 172.21.15.57:0/326620144 >> 172.21.15.57:0/326620144 conn(0x7fc2780f8940 msgr2=0x7fc2780fa730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 -- 172.21.15.57:0/326620144 shutdown_connections 2024-02-28T16:14:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:42.969+0000 7fc27e400700 1 -- 172.21.15.57:0/326620144 wait complete. 2024-02-28T16:14:43.632 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:43 smithi057 ceph-mon[93219]: pgmap v361: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:43.632 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:43 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/326620144' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:14:43.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:43 smithi087 ceph-mon[82628]: pgmap v361: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:43.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:43 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/326620144' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:14:43.715 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions' 2024-02-28T16:14:44.241 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:14:45.444 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:45 smithi057 ceph-mon[93219]: pgmap v362: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:45.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:45 smithi087 ceph-mon[82628]: pgmap v362: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:46.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.429+0000 7fb186c00700 1 -- 172.21.15.57:0/3272290250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180102f50 msgr2=0x7fb180103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:46.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.429+0000 7fb186c00700 1 --2- 172.21.15.57:0/3272290250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180102f50 0x7fb180103320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb170009ce0 tx=0x7fb170004d10 comp rx=0 tx=0).stop 2024-02-28T16:14:46.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.429+0000 7fb186c00700 1 -- 172.21.15.57:0/3272290250 shutdown_connections 2024-02-28T16:14:46.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.429+0000 7fb186c00700 1 --2- 172.21.15.57:0/3272290250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1801038f0 0x7fb1800fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:46.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.429+0000 7fb186c00700 1 --2- 172.21.15.57:0/3272290250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180102f50 0x7fb180103320 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:46.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.429+0000 7fb186c00700 1 -- 172.21.15.57:0/3272290250 >> 172.21.15.57:0/3272290250 conn(0x7fb1800f8ae0 msgr2=0x7fb1800faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:46.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.429+0000 7fb186c00700 1 -- 172.21.15.57:0/3272290250 shutdown_connections 2024-02-28T16:14:46.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.429+0000 7fb186c00700 1 -- 172.21.15.57:0/3272290250 wait complete. 2024-02-28T16:14:46.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.430+0000 7fb186c00700 1 Processor -- start 2024-02-28T16:14:46.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.430+0000 7fb186c00700 1 -- start start 2024-02-28T16:14:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb186c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180102f50 0x7fb180070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb186c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1801038f0 0x7fb1800707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb186c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb180070e60 con 0x7fb180102f50 2024-02-28T16:14:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb186c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb180070fd0 con 0x7fb1801038f0 2024-02-28T16:14:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb17fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180102f50 0x7fb180070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb17fe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180102f50 0x7fb180070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48010/0 (socket says 172.21.15.57:48010) 2024-02-28T16:14:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb17fe00700 1 -- 172.21.15.57:0/2910392857 learned_addr learned my addr 172.21.15.57:0/2910392857 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:14:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb17fe00700 1 -- 172.21.15.57:0/2910392857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1801038f0 msgr2=0x7fb1800707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb177400700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1801038f0 0x7fb1800707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb17fe00700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1801038f0 0x7fb1800707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb17fe00700 1 -- 172.21.15.57:0/2910392857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170009940 con 0x7fb180102f50 2024-02-28T16:14:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.431+0000 7fb177400700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1801038f0 0x7fb1800707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:14:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.432+0000 7fb17fe00700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180102f50 0x7fb180070290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb170004b70 tx=0x7fb170004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.432+0000 7fb17cc00700 1 -- 172.21.15.57:0/2910392857 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb17000e040 con 0x7fb180102f50 2024-02-28T16:14:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.432+0000 7fb17cc00700 1 -- 172.21.15.57:0/2910392857 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb170004610 con 0x7fb180102f50 2024-02-28T16:14:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.432+0000 7fb186c00700 1 -- 172.21.15.57:0/2910392857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb180119e60 con 0x7fb180102f50 2024-02-28T16:14:46.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.432+0000 7fb17cc00700 1 -- 172.21.15.57:0/2910392857 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb17001c810 con 0x7fb180102f50 2024-02-28T16:14:46.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.432+0000 7fb186c00700 1 -- 172.21.15.57:0/2910392857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18011a320 con 0x7fb180102f50 2024-02-28T16:14:46.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.433+0000 7fb186c00700 1 -- 172.21.15.57:0/2910392857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1800fc6e0 con 0x7fb180102f50 2024-02-28T16:14:46.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.435+0000 7fb17cc00700 1 -- 172.21.15.57:0/2910392857 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb170012c00 con 0x7fb180102f50 2024-02-28T16:14:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.435+0000 7fb17cc00700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb16406d7f0 0x7fb16406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.436+0000 7fb17cc00700 1 -- 172.21.15.57:0/2910392857 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fb17008eb80 con 0x7fb180102f50 2024-02-28T16:14:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.436+0000 7fb177400700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb16406d7f0 0x7fb16406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.436+0000 7fb177400700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb16406d7f0 0x7fb16406fca0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb168006fd0 tx=0x7fb168008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.441+0000 7fb17cc00700 1 -- 172.21.15.57:0/2910392857 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb1700582f0 con 0x7fb180102f50 2024-02-28T16:14:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.757+0000 7fb186c00700 1 -- 172.21.15.57:0/2910392857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb18010a0c0 con 0x7fb180102f50 2024-02-28T16:14:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.757+0000 7fb17cc00700 1 -- 172.21.15.57:0/2910392857 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fb17005b9b0 con 0x7fb180102f50 2024-02-28T16:14:46.751 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:14:46.751 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:14:46.752 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:14:46.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:14:46.752 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:14:46.752 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:14:46.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:14:46.752 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:14:46.752 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:14:46.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:14:46.752 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:14:46.752 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:14:46.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:14:46.753 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:14:46.753 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:14:46.753 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:14:46.753 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:14:46.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 -- 172.21.15.57:0/2910392857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb16406d7f0 msgr2=0x7fb16406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:46.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb16406d7f0 0x7fb16406fca0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb168006fd0 tx=0x7fb168008040 comp rx=0 tx=0).stop 2024-02-28T16:14:46.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 -- 172.21.15.57:0/2910392857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180102f50 msgr2=0x7fb180070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180102f50 0x7fb180070290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb170004b70 tx=0x7fb170004d10 comp rx=0 tx=0).stop 2024-02-28T16:14:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 -- 172.21.15.57:0/2910392857 shutdown_connections 2024-02-28T16:14:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb16406d7f0 0x7fb16406fca0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180102f50 0x7fb180070290 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 --2- 172.21.15.57:0/2910392857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1801038f0 0x7fb1800707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 -- 172.21.15.57:0/2910392857 >> 172.21.15.57:0/2910392857 conn(0x7fb1800f8ae0 msgr2=0x7fb1800fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 -- 172.21.15.57:0/2910392857 shutdown_connections 2024-02-28T16:14:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:14:46.761+0000 7fb186c00700 1 -- 172.21.15.57:0/2910392857 wait complete. 2024-02-28T16:14:47.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:47 smithi057 ceph-mon[93219]: pgmap v363: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:47.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:47 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2910392857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:47.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-28T16:14:47.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:47 smithi087 ceph-mon[82628]: pgmap v363: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:47.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:47 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2910392857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:14:48.107 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:14:49.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:49 smithi057 ceph-mon[93219]: pgmap v364: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:49.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:49.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:49 smithi087 ceph-mon[82628]: pgmap v364: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:49.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:14:50.247 INFO:teuthology.orchestra.run.smithi057.stdout:wait for servicemap items w/ changing names to refresh 2024-02-28T16:14:50.902 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'sleep 60' 2024-02-28T16:14:51.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:51 smithi057 ceph-mon[93219]: pgmap v365: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:51.463 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:14:51.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:51 smithi087 ceph-mon[82628]: pgmap v365: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:14:53.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:53 smithi057 ceph-mon[93219]: pgmap v366: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:53.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:53 smithi087 ceph-mon[82628]: pgmap v366: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:14:55.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:55 smithi057 ceph-mon[93219]: pgmap v367: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:55.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:55 smithi087 ceph-mon[82628]: pgmap v367: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:57.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:57 smithi057 ceph-mon[93219]: pgmap v368: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:57.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:57 smithi087 ceph-mon[82628]: pgmap v368: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:14:59.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:14:59 smithi057 ceph-mon[93219]: pgmap v369: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:14:59.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:14:59 smithi087 ceph-mon[82628]: pgmap v369: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:01.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:01 smithi057 ceph-mon[93219]: pgmap v370: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:01.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:01 smithi087 ceph-mon[82628]: pgmap v370: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:03.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:03 smithi057 ceph-mon[93219]: pgmap v371: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:03.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:03 smithi087 ceph-mon[82628]: pgmap v371: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:04.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:04.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:05.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:05 smithi057 ceph-mon[93219]: pgmap v372: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:05.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:05 smithi087 ceph-mon[82628]: pgmap v372: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:07.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:07 smithi057 ceph-mon[93219]: pgmap v373: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:07.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:07 smithi087 ceph-mon[82628]: pgmap v373: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:09.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:09 smithi057 ceph-mon[93219]: pgmap v374: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:09.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:09 smithi087 ceph-mon[82628]: pgmap v374: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:11.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:11 smithi057 ceph-mon[93219]: pgmap v375: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:11.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:11 smithi087 ceph-mon[82628]: pgmap v375: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:13.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:13 smithi057 ceph-mon[93219]: pgmap v376: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:13.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:13 smithi087 ceph-mon[82628]: pgmap v376: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:15.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:15 smithi087 ceph-mon[82628]: pgmap v377: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:15.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:15 smithi057 ceph-mon[93219]: pgmap v377: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:17.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:17 smithi087 ceph-mon[82628]: pgmap v378: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:17.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:17 smithi057 ceph-mon[93219]: pgmap v378: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:19.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:19 smithi087 ceph-mon[82628]: pgmap v379: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:19.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:19.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:19 smithi057 ceph-mon[93219]: pgmap v379: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:19.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:21.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:21 smithi087 ceph-mon[82628]: pgmap v380: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:21.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:21 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:15:21.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:21 smithi057 ceph-mon[93219]: pgmap v380: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:21.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:21 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:15:22.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:22.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:15:22.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:15:22.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:22.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:15:22.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:15:23.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:23 smithi057 ceph-mon[93219]: pgmap v381: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:23.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:23 smithi087 ceph-mon[82628]: pgmap v381: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:25.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:25 smithi057 ceph-mon[93219]: pgmap v382: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:25.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:25 smithi087 ceph-mon[82628]: pgmap v382: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:27.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:27 smithi057 ceph-mon[93219]: pgmap v383: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:27.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:27 smithi087 ceph-mon[82628]: pgmap v383: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:29.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:29 smithi057 ceph-mon[93219]: pgmap v384: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:29.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:29 smithi087 ceph-mon[82628]: pgmap v384: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:31.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:31 smithi057 ceph-mon[93219]: pgmap v385: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:31.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:31 smithi087 ceph-mon[82628]: pgmap v385: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:33.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:33 smithi057 ceph-mon[93219]: pgmap v386: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:33.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:33 smithi087 ceph-mon[82628]: pgmap v386: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:34.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:34.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:35.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:35 smithi057 ceph-mon[93219]: pgmap v387: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:35.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:35 smithi087 ceph-mon[82628]: pgmap v387: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:37.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:37 smithi057 ceph-mon[93219]: pgmap v388: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:37.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:37 smithi087 ceph-mon[82628]: pgmap v388: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:39.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:39 smithi057 ceph-mon[93219]: pgmap v389: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:39.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:39 smithi087 ceph-mon[82628]: pgmap v389: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:41.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:41 smithi057 ceph-mon[93219]: pgmap v390: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:41.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:41 smithi087 ceph-mon[82628]: pgmap v390: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:43.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:43 smithi057 ceph-mon[93219]: pgmap v391: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:43.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:43 smithi087 ceph-mon[82628]: pgmap v391: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:45.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:45 smithi087 ceph-mon[82628]: pgmap v392: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:45.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:45 smithi057 ceph-mon[93219]: pgmap v392: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:47.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:47 smithi057 ceph-mon[93219]: pgmap v393: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:47.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:47 smithi087 ceph-mon[82628]: pgmap v393: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:49.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:49 smithi057 ceph-mon[93219]: pgmap v394: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:49.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:49.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:49 smithi087 ceph-mon[82628]: pgmap v394: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:49.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:51.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:51 smithi057 ceph-mon[93219]: pgmap v395: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:51.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:51 smithi087 ceph-mon[82628]: pgmap v395: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:15:53.676 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:53 smithi057 ceph-mon[93219]: pgmap v396: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:53.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:53 smithi087 ceph-mon[82628]: pgmap v396: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:15:54.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-02-28T16:15:54.872 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:15:55.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:55 smithi057 ceph-mon[93219]: pgmap v397: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:55.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:55 smithi087 ceph-mon[82628]: pgmap v397: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.042+0000 7ff206c00700 1 -- 172.21.15.57:0/1846671704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2001095f0 msgr2=0x7ff2001099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.042+0000 7ff206c00700 1 --2- 172.21.15.57:0/1846671704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2001095f0 0x7ff2001099c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0004940 tx=0x7ff1f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.042+0000 7ff206c00700 1 -- 172.21.15.57:0/1846671704 shutdown_connections 2024-02-28T16:15:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.042+0000 7ff206c00700 1 --2- 172.21.15.57:0/1846671704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff200103dc0 0x7ff200104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.042+0000 7ff206c00700 1 --2- 172.21.15.57:0/1846671704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2001095f0 0x7ff2001099c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.042+0000 7ff206c00700 1 -- 172.21.15.57:0/1846671704 >> 172.21.15.57:0/1846671704 conn(0x7ff200072d50 msgr2=0x7ff200075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.042+0000 7ff206c00700 1 -- 172.21.15.57:0/1846671704 shutdown_connections 2024-02-28T16:15:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.042+0000 7ff206c00700 1 -- 172.21.15.57:0/1846671704 wait complete. 2024-02-28T16:15:57.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.043+0000 7ff206c00700 1 Processor -- start 2024-02-28T16:15:57.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.043+0000 7ff206c00700 1 -- start start 2024-02-28T16:15:57.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.044+0000 7ff206c00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff200103dc0 0x7ff20011a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:57.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.044+0000 7ff206c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2001095f0 0x7ff20011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:57.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.044+0000 7ff206c00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20011ac70 con 0x7ff200103dc0 2024-02-28T16:15:57.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.044+0000 7ff206c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff200113f80 con 0x7ff2001095f0 2024-02-28T16:15:57.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.044+0000 7ff1ffe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff200103dc0 0x7ff20011a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:57.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.044+0000 7ff1ffe00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff200103dc0 0x7ff20011a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60956/0 (socket says 172.21.15.57:60956) 2024-02-28T16:15:57.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.044+0000 7ff1ffe00700 1 -- 172.21.15.57:0/3436261117 learned_addr learned my addr 172.21.15.57:0/3436261117 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:15:57.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.044+0000 7ff1ff400700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2001095f0 0x7ff20011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:57.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.045+0000 7ff1ffe00700 1 -- 172.21.15.57:0/3436261117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2001095f0 msgr2=0x7ff20011a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:57.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.045+0000 7ff1ffe00700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2001095f0 0x7ff20011a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:57.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.045+0000 7ff1ffe00700 1 -- 172.21.15.57:0/3436261117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0005040 con 0x7ff200103dc0 2024-02-28T16:15:57.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.045+0000 7ff1ffe00700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff200103dc0 0x7ff20011a0e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009150 tx=0x7ff1f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:57.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.045+0000 7ff1f7e00700 1 -- 172.21.15.57:0/3436261117 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1f000e040 con 0x7ff200103dc0 2024-02-28T16:15:57.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.045+0000 7ff1f7e00700 1 -- 172.21.15.57:0/3436261117 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1f000bbf0 con 0x7ff200103dc0 2024-02-28T16:15:57.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.045+0000 7ff206c00700 1 -- 172.21.15.57:0/3436261117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff200114200 con 0x7ff200103dc0 2024-02-28T16:15:57.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.045+0000 7ff1f7e00700 1 -- 172.21.15.57:0/3436261117 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1f001c630 con 0x7ff200103dc0 2024-02-28T16:15:57.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.045+0000 7ff206c00700 1 -- 172.21.15.57:0/3436261117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff200114740 con 0x7ff200103dc0 2024-02-28T16:15:57.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.047+0000 7ff206c00700 1 -- 172.21.15.57:0/3436261117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff200106850 con 0x7ff200103dc0 2024-02-28T16:15:57.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.048+0000 7ff1f7e00700 1 -- 172.21.15.57:0/3436261117 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff1f000bd60 con 0x7ff200103dc0 2024-02-28T16:15:57.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.049+0000 7ff1f7e00700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff1e406d7f0 0x7ff1e406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:57.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.049+0000 7ff1f7e00700 1 -- 172.21.15.57:0/3436261117 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ff1f008e4c0 con 0x7ff200103dc0 2024-02-28T16:15:57.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.049+0000 7ff1ff400700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff1e406d7f0 0x7ff1e406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:57.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.050+0000 7ff1ff400700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff1e406d7f0 0x7ff1e406fca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff200115980 tx=0x7ff1ec009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:57.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.054+0000 7ff1f7e00700 1 -- 172.21.15.57:0/3436261117 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff1f005b6c0 con 0x7ff200103dc0 2024-02-28T16:15:57.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.293+0000 7ff206c00700 1 -- 172.21.15.57:0/3436261117 --> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff20004bed0 con 0x7ff1e406d7f0 2024-02-28T16:15:57.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.305+0000 7ff1f7e00700 1 -- 172.21.15.57:0/3436261117 <== mgr.34102 v2:172.21.15.57:6800/2269634640 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff20004bed0 con 0x7ff1e406d7f0 2024-02-28T16:15:57.296 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:15:57.296 INFO:teuthology.orchestra.run.smithi057.stdout:alertmanager.smithi057 smithi057 *:9093,9094 running (2m) 106s ago 24m 14.7M - 0.25.0 c8568f914cd2 abec484faa15 2024-02-28T16:15:57.296 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi057 smithi057 running (9m) 106s ago 25m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 10ef2750b014 2024-02-28T16:15:57.296 INFO:teuthology.orchestra.run.smithi057.stdout:crash.smithi087 smithi087 running (9m) 3m ago 23m 6665k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 3f9af0e22644 2024-02-28T16:15:57.296 INFO:teuthology.orchestra.run.smithi057.stdout:grafana.smithi057 smithi057 *:3000 running (113s) 106s ago 24m 51.6M - 9.4.12 a0ea5e3c46d9 2c9fab9e584c 2024-02-28T16:15:57.296 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.eztwsd smithi057 running (5m) 106s ago 17m 67.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b df14dcf6973e 2024-02-28T16:15:57.296 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi057.qwatmu smithi057 running (4m) 106s ago 17m 16.1M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 977aa1867016 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.fzjgef smithi087 running (3m) 3m ago 17m 65.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b a1ee4a125f5b 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:mds.cephfs.smithi087.whebmo smithi087 running (3m) 3m ago 17m 12.5M - 19.0.0-1670-g1fb5d106 2272b2c42f9b b0b892c8725f 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi057.upqerc smithi057 *:8443,9283,8765 running (13m) 106s ago 26m 514M - 19.0.0-1670-g1fb5d106 2272b2c42f9b fac60984b671 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.smithi087.ewrszc smithi087 *:8443,9283,8765 running (12m) 3m ago 23m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b c9b62b938b28 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi057 smithi057 running (11m) 106s ago 26m 60.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 90fe3fb47dc2 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:mon.smithi087 smithi087 running (10m) 3m ago 23m 45.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d7f0d6f21c99 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi057 smithi057 *:9100 running (3m) 106s ago 25m 7268k - 1.5.0 0da6a335fe13 6e10666d4d1f 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:node-exporter.smithi087 smithi087 *:9100 running (3m) 3m ago 23m 3011k - 1.5.0 0da6a335fe13 285db7ba57fc 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (9m) 106s ago 22m 134M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 5a9d77191a10 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi057 running (8m) 106s ago 21m 106M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b 676452ac2f89 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi057 running (7m) 106s ago 21m 100M 1559M 19.0.0-1670-g1fb5d106 2272b2c42f9b bb9a6a24a249 2024-02-28T16:15:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi087 running (7m) 3m ago 20m 107M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 8d59e4ee9f7d 2024-02-28T16:15:57.298 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi087 running (6m) 3m ago 20m 94.0M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b a98b26059f0a 2024-02-28T16:15:57.298 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi087 running (6m) 3m ago 19m 93.9M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b cbdb6df47634 2024-02-28T16:15:57.298 INFO:teuthology.orchestra.run.smithi057.stdout:prometheus.smithi057 smithi057 *:9095 running (2m) 106s ago 24m 48.1M - 2.43.0 a07b618ecd1d 33bac790aba5 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.307+0000 7ff206c00700 1 -- 172.21.15.57:0/3436261117 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff1e406d7f0 msgr2=0x7ff1e406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.307+0000 7ff206c00700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff1e406d7f0 0x7ff1e406fca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff200115980 tx=0x7ff1ec009ee0 comp rx=0 tx=0).stop 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.307+0000 7ff206c00700 1 -- 172.21.15.57:0/3436261117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff200103dc0 msgr2=0x7ff20011a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.307+0000 7ff206c00700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff200103dc0 0x7ff20011a0e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009150 tx=0x7ff1f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.307+0000 7ff206c00700 1 -- 172.21.15.57:0/3436261117 shutdown_connections 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.307+0000 7ff206c00700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff1e406d7f0 0x7ff1e406fca0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.307+0000 7ff206c00700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff200103dc0 0x7ff20011a0e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.307+0000 7ff206c00700 1 --2- 172.21.15.57:0/3436261117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2001095f0 0x7ff20011a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.308+0000 7ff206c00700 1 -- 172.21.15.57:0/3436261117 >> 172.21.15.57:0/3436261117 conn(0x7ff200072d50 msgr2=0x7ff200074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.308+0000 7ff206c00700 1 -- 172.21.15.57:0/3436261117 shutdown_connections 2024-02-28T16:15:57.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:15:57.308+0000 7ff206c00700 1 -- 172.21.15.57:0/3436261117 wait complete. 2024-02-28T16:15:57.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:57 smithi057 ceph-mon[93219]: pgmap v398: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:57.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:57 smithi087 ceph-mon[82628]: pgmap v398: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:15:58.179 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions' 2024-02-28T16:15:58.688 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:15:58.896 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:58 smithi057 ceph-mon[93219]: from='client.34686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:15:58.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:58 smithi087 ceph-mon[82628]: from='client.34686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:15:59.909 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:15:59 smithi057 ceph-mon[93219]: pgmap v399: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:15:59.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:15:59 smithi087 ceph-mon[82628]: pgmap v399: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.121+0000 7f9ea5200700 1 -- 172.21.15.57:0/1045052758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea00fdfe0 msgr2=0x7f9ea00fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.121+0000 7f9ea5200700 1 --2- 172.21.15.57:0/1045052758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea00fdfe0 0x7f9ea00fe3b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e90004970 tx=0x7f9e90009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.121+0000 7f9ea5200700 1 -- 172.21.15.57:0/1045052758 shutdown_connections 2024-02-28T16:16:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.121+0000 7f9ea5200700 1 --2- 172.21.15.57:0/1045052758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ea00fe8f0 0x7f9ea0107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.121+0000 7f9ea5200700 1 --2- 172.21.15.57:0/1045052758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea00fdfe0 0x7f9ea00fe3b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.121+0000 7f9ea5200700 1 -- 172.21.15.57:0/1045052758 >> 172.21.15.57:0/1045052758 conn(0x7f9ea0071d90 msgr2=0x7f9ea0072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.121+0000 7f9ea5200700 1 -- 172.21.15.57:0/1045052758 shutdown_connections 2024-02-28T16:16:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.121+0000 7f9ea5200700 1 -- 172.21.15.57:0/1045052758 wait complete. 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.122+0000 7f9ea5200700 1 Processor -- start 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.122+0000 7f9ea5200700 1 -- start start 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9ea5200700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea00fdfe0 0x7f9ea00fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9ea5200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ea00fe8f0 0x7f9ea00fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9ea5200700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00fc9e0 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9ea5200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00fcb50 con 0x7f9ea00fe8f0 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9e9de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea00fdfe0 0x7f9ea00fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9e9de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea00fdfe0 0x7f9ea00fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60968/0 (socket says 172.21.15.57:60968) 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9e9de00700 1 -- 172.21.15.57:0/973999984 learned_addr learned my addr 172.21.15.57:0/973999984 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9e9d400700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ea00fe8f0 0x7f9ea00fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9e9de00700 1 -- 172.21.15.57:0/973999984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ea00fe8f0 msgr2=0x7f9ea00fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:01.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9e9de00700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ea00fe8f0 0x7f9ea00fc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:01.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.123+0000 7f9e9de00700 1 -- 172.21.15.57:0/973999984 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90005040 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.124+0000 7f9e9de00700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea00fdfe0 0x7f9ea00fbea0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e90004f50 tx=0x7f9e90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:01.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.124+0000 7f9e96000700 1 -- 172.21.15.57:0/973999984 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e9000e040 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.124+0000 7f9e96000700 1 -- 172.21.15.57:0/973999984 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e90004290 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.124+0000 7f9e96000700 1 -- 172.21.15.57:0/973999984 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e9001c630 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.124+0000 7f9ea5200700 1 -- 172.21.15.57:0/973999984 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea0119c90 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.124+0000 7f9ea5200700 1 -- 172.21.15.57:0/973999984 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea011a0f0 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.126+0000 7f9ea5200700 1 -- 172.21.15.57:0/973999984 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea01046c0 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.127+0000 7f9e96000700 1 -- 172.21.15.57:0/973999984 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f9e9000bc10 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.127+0000 7f9e96000700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9e8406d7f0 0x7f9e8406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:01.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.128+0000 7f9e96000700 1 -- 172.21.15.57:0/973999984 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f9e9008e490 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.128+0000 7f9e9d400700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9e8406d7f0 0x7f9e8406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:01.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.129+0000 7f9e9d400700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9e8406d7f0 0x7f9e8406fca0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00fd8a0 tx=0x7f9e8c009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.135+0000 7f9e96000700 1 -- 172.21.15.57:0/973999984 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9e90057b60 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.448+0000 7f9ea5200700 1 -- 172.21.15.57:0/973999984 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ea004bed0 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.450+0000 7f9e96000700 1 -- 172.21.15.57:0/973999984 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f9e90013e60 con 0x7f9ea00fdfe0 2024-02-28T16:16:01.441 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-02-28T16:16:01.441 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-02-28T16:16:01.441 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:16:01.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-02-28T16:16:01.442 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 -- 172.21.15.57:0/973999984 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9e8406d7f0 msgr2=0x7f9e8406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9e8406d7f0 0x7f9e8406fca0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00fd8a0 tx=0x7f9e8c009ee0 comp rx=0 tx=0).stop 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 -- 172.21.15.57:0/973999984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea00fdfe0 msgr2=0x7f9ea00fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea00fdfe0 0x7f9ea00fbea0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e90004f50 tx=0x7f9e90009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 -- 172.21.15.57:0/973999984 shutdown_connections 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9e8406d7f0 0x7f9e8406fca0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea00fdfe0 0x7f9ea00fbea0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 --2- 172.21.15.57:0/973999984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ea00fe8f0 0x7f9ea00fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 -- 172.21.15.57:0/973999984 >> 172.21.15.57:0/973999984 conn(0x7f9ea0071d90 msgr2=0x7f9ea0101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 -- 172.21.15.57:0/973999984 shutdown_connections 2024-02-28T16:16:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:01.453+0000 7f9ea5200700 1 -- 172.21.15.57:0/973999984 wait complete. 2024-02-28T16:16:01.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:01 smithi057 ceph-mon[93219]: pgmap v400: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:01.837 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:01 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/973999984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:16:01.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:01 smithi087 ceph-mon[82628]: pgmap v400: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:01.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:01 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/973999984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:16:02.324 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-28T16:16:02.842 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:16:03.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:03 smithi057 ceph-mon[93219]: pgmap v401: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:03.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:03 smithi087 ceph-mon[82628]: pgmap v401: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:04.879 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:04.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.181+0000 7f649de00700 1 -- 172.21.15.57:0/80970680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6498102f50 msgr2=0x7f6498103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.181+0000 7f649de00700 1 --2- 172.21.15.57:0/80970680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6498102f50 0x7f6498103320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6488004940 tx=0x7f6488009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.181+0000 7f649de00700 1 -- 172.21.15.57:0/80970680 shutdown_connections 2024-02-28T16:16:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.181+0000 7f649de00700 1 --2- 172.21.15.57:0/80970680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64981038f0 0x7f64980fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.181+0000 7f649de00700 1 --2- 172.21.15.57:0/80970680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6498102f50 0x7f6498103320 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.181+0000 7f649de00700 1 -- 172.21.15.57:0/80970680 >> 172.21.15.57:0/80970680 conn(0x7f64980f8ae0 msgr2=0x7f64980faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.181+0000 7f649de00700 1 -- 172.21.15.57:0/80970680 shutdown_connections 2024-02-28T16:16:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.181+0000 7f649de00700 1 -- 172.21.15.57:0/80970680 wait complete. 2024-02-28T16:16:05.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.182+0000 7f649de00700 1 Processor -- start 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.182+0000 7f649de00700 1 -- start start 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.182+0000 7f649de00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6498102f50 0x7f6498113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.182+0000 7f649de00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64981038f0 0x7f6498113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.182+0000 7f649de00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64981145e0 con 0x7f64981038f0 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.182+0000 7f649de00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649810d910 con 0x7f6498102f50 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.183+0000 7f648e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64981038f0 0x7f6498113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.183+0000 7f648e000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64981038f0 0x7f6498113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34226/0 (socket says 172.21.15.57:34226) 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.183+0000 7f648e000700 1 -- 172.21.15.57:0/4186096395 learned_addr learned my addr 172.21.15.57:0/4186096395 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.183+0000 7f6496a00700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6498102f50 0x7f6498113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.183+0000 7f648e000700 1 -- 172.21.15.57:0/4186096395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6498102f50 msgr2=0x7f6498113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.183+0000 7f648e000700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6498102f50 0x7f6498113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.183+0000 7f648e000700 1 -- 172.21.15.57:0/4186096395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6488005040 con 0x7f64981038f0 2024-02-28T16:16:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.184+0000 7f648e000700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64981038f0 0x7f6498113f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6480002a50 tx=0x7f6480004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.184+0000 7f648f400700 1 -- 172.21.15.57:0/4186096395 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6480007cc0 con 0x7f64981038f0 2024-02-28T16:16:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.184+0000 7f648f400700 1 -- 172.21.15.57:0/4186096395 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f648000f040 con 0x7f64981038f0 2024-02-28T16:16:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.184+0000 7f649de00700 1 -- 172.21.15.57:0/4186096395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649810dbf0 con 0x7f64981038f0 2024-02-28T16:16:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.184+0000 7f648f400700 1 -- 172.21.15.57:0/4186096395 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f648000daf0 con 0x7f64981038f0 2024-02-28T16:16:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.184+0000 7f649de00700 1 -- 172.21.15.57:0/4186096395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649810e130 con 0x7f64981038f0 2024-02-28T16:16:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.185+0000 7f649de00700 1 -- 172.21.15.57:0/4186096395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64980fc6e0 con 0x7f64981038f0 2024-02-28T16:16:05.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.186+0000 7f648f400700 1 -- 172.21.15.57:0/4186096395 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f6480009810 con 0x7f64981038f0 2024-02-28T16:16:05.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.187+0000 7f648f400700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f647c06d7f0 0x7f647c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:05.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.187+0000 7f648f400700 1 -- 172.21.15.57:0/4186096395 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f648008cd80 con 0x7f64981038f0 2024-02-28T16:16:05.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.188+0000 7f6496a00700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f647c06d7f0 0x7f647c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:05.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.188+0000 7f6496a00700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f647c06d7f0 0x7f647c06fca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f648800b020 tx=0x7f6488009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.193+0000 7f648f400700 1 -- 172.21.15.57:0/4186096395 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6480059f80 con 0x7f64981038f0 2024-02-28T16:16:05.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.508+0000 7f649de00700 1 -- 172.21.15.57:0/4186096395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f649810e3a0 con 0x7f64981038f0 2024-02-28T16:16:05.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.509+0000 7f648f400700 1 -- 172.21.15.57:0/4186096395 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f6480059b10 con 0x7f64981038f0 2024-02-28T16:16:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.512+0000 7f649de00700 1 -- 172.21.15.57:0/4186096395 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f647c06d7f0 msgr2=0x7f647c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.512+0000 7f649de00700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f647c06d7f0 0x7f647c06fca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f648800b020 tx=0x7f6488009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.512+0000 7f649de00700 1 -- 172.21.15.57:0/4186096395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64981038f0 msgr2=0x7f6498113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.512+0000 7f649de00700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64981038f0 0x7f6498113f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6480002a50 tx=0x7f6480004600 comp rx=0 tx=0).stop 2024-02-28T16:16:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.512+0000 7f649de00700 1 -- 172.21.15.57:0/4186096395 shutdown_connections 2024-02-28T16:16:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.512+0000 7f649de00700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f647c06d7f0 0x7f647c06fca0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.512+0000 7f649de00700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6498102f50 0x7f6498113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.512+0000 7f649de00700 1 --2- 172.21.15.57:0/4186096395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64981038f0 0x7f6498113f90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.513+0000 7f649de00700 1 -- 172.21.15.57:0/4186096395 >> 172.21.15.57:0/4186096395 conn(0x7f64980f8ae0 msgr2=0x7f64980fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.513+0000 7f649de00700 1 -- 172.21.15.57:0/4186096395 shutdown_connections 2024-02-28T16:16:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:05.513+0000 7f649de00700 1 -- 172.21.15.57:0/4186096395 wait complete. 2024-02-28T16:16:05.520 INFO:teuthology.orchestra.run.smithi057.stdout:true 2024-02-28T16:16:05.917 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:05 smithi057 ceph-mon[93219]: pgmap v402: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:05.917 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:05 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/4186096395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:16:05.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:05 smithi087 ceph-mon[82628]: pgmap v402: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:05.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:05 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/4186096395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:16:06.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-28T16:16:06.862 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:16:07.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:07 smithi057 ceph-mon[93219]: pgmap v403: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:07.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:07 smithi087 ceph-mon[82628]: pgmap v403: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.121+0000 7f7dddc00700 1 -- 172.21.15.57:0/4209330845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd8070330 msgr2=0x7f7dd8070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.121+0000 7f7dddc00700 1 --2- 172.21.15.57:0/4209330845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd8070330 0x7f7dd8070700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8004970 tx=0x7f7dc8009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.121+0000 7f7dddc00700 1 -- 172.21.15.57:0/4209330845 shutdown_connections 2024-02-28T16:16:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.121+0000 7f7dddc00700 1 --2- 172.21.15.57:0/4209330845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd8070c40 0x7f7dd8109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.121+0000 7f7dddc00700 1 --2- 172.21.15.57:0/4209330845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd8070330 0x7f7dd8070700 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.121+0000 7f7dddc00700 1 -- 172.21.15.57:0/4209330845 >> 172.21.15.57:0/4209330845 conn(0x7f7dd80f8ae0 msgr2=0x7f7dd80faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.122+0000 7f7dddc00700 1 -- 172.21.15.57:0/4209330845 shutdown_connections 2024-02-28T16:16:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.122+0000 7f7dddc00700 1 -- 172.21.15.57:0/4209330845 wait complete. 2024-02-28T16:16:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.122+0000 7f7dddc00700 1 Processor -- start 2024-02-28T16:16:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.123+0000 7f7dddc00700 1 -- start start 2024-02-28T16:16:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.123+0000 7f7dddc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd8070330 0x7f7dd8115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.123+0000 7f7dddc00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd8070c40 0x7f7dd8116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.123+0000 7f7dddc00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd81167b0 con 0x7f7dd8070c40 2024-02-28T16:16:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.123+0000 7f7dddc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd810fae0 con 0x7f7dd8070330 2024-02-28T16:16:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.123+0000 7f7dd6000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd8070c40 0x7f7dd8116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.123+0000 7f7dd6000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd8070c40 0x7f7dd8116160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34256/0 (socket says 172.21.15.57:34256) 2024-02-28T16:16:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.123+0000 7f7dd6000700 1 -- 172.21.15.57:0/203797286 learned_addr learned my addr 172.21.15.57:0/203797286 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.124+0000 7f7dd6a00700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd8070330 0x7f7dd8115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.124+0000 7f7dd6000700 1 -- 172.21.15.57:0/203797286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd8070330 msgr2=0x7f7dd8115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.124+0000 7f7dd6000700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd8070330 0x7f7dd8115c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.124+0000 7f7dd6000700 1 -- 172.21.15.57:0/203797286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8005040 con 0x7f7dd8070c40 2024-02-28T16:16:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.124+0000 7f7dd6a00700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd8070330 0x7f7dd8115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:16:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.124+0000 7f7dd6000700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd8070c40 0x7f7dd8116160 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400c8c0 tx=0x7f7dc40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.125+0000 7f7dcea00700 1 -- 172.21.15.57:0/203797286 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dc400a980 con 0x7f7dd8070c40 2024-02-28T16:16:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.125+0000 7f7dcea00700 1 -- 172.21.15.57:0/203797286 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7dc400ce60 con 0x7f7dd8070c40 2024-02-28T16:16:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.125+0000 7f7dddc00700 1 -- 172.21.15.57:0/203797286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd810fdc0 con 0x7f7dd8070c40 2024-02-28T16:16:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.125+0000 7f7dcea00700 1 -- 172.21.15.57:0/203797286 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dc40115e0 con 0x7f7dd8070c40 2024-02-28T16:16:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.125+0000 7f7dddc00700 1 -- 172.21.15.57:0/203797286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd8110300 con 0x7f7dd8070c40 2024-02-28T16:16:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.126+0000 7f7dddc00700 1 -- 172.21.15.57:0/203797286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd8106920 con 0x7f7dd8070c40 2024-02-28T16:16:09.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.127+0000 7f7dcea00700 1 -- 172.21.15.57:0/203797286 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f7dc4012400 con 0x7f7dd8070c40 2024-02-28T16:16:09.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.128+0000 7f7dcea00700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dbc06d7f0 0x7f7dbc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:09.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.128+0000 7f7dcea00700 1 -- 172.21.15.57:0/203797286 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f7dc408d0d0 con 0x7f7dd8070c40 2024-02-28T16:16:09.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.128+0000 7f7dd6a00700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dbc06d7f0 0x7f7dbc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:09.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.129+0000 7f7dd6a00700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dbc06d7f0 0x7f7dbc06fca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8000c00 tx=0x7f7dc8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:09.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.133+0000 7f7dcea00700 1 -- 172.21.15.57:0/203797286 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7dc405a350 con 0x7f7dd8070c40 2024-02-28T16:16:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.447+0000 7f7dddc00700 1 -- 172.21.15.57:0/203797286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7dd810c240 con 0x7f7dd8070c40 2024-02-28T16:16:09.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.448+0000 7f7dcea00700 1 -- 172.21.15.57:0/203797286 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f7dc40126b0 con 0x7f7dd8070c40 2024-02-28T16:16:09.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.451+0000 7f7dddc00700 1 -- 172.21.15.57:0/203797286 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dbc06d7f0 msgr2=0x7f7dbc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:09.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.451+0000 7f7dddc00700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dbc06d7f0 0x7f7dbc06fca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8000c00 tx=0x7f7dc8009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.451+0000 7f7dddc00700 1 -- 172.21.15.57:0/203797286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd8070c40 msgr2=0x7f7dd8116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.451+0000 7f7dddc00700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd8070c40 0x7f7dd8116160 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400c8c0 tx=0x7f7dc40044c0 comp rx=0 tx=0).stop 2024-02-28T16:16:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.451+0000 7f7dddc00700 1 -- 172.21.15.57:0/203797286 shutdown_connections 2024-02-28T16:16:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.451+0000 7f7dddc00700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7dbc06d7f0 0x7f7dbc06fca0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.451+0000 7f7dddc00700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd8070330 0x7f7dd8115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.451+0000 7f7dddc00700 1 --2- 172.21.15.57:0/203797286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd8070c40 0x7f7dd8116160 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.451+0000 7f7dddc00700 1 -- 172.21.15.57:0/203797286 >> 172.21.15.57:0/203797286 conn(0x7f7dd80f8ae0 msgr2=0x7f7dd8103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.451+0000 7f7dddc00700 1 -- 172.21.15.57:0/203797286 shutdown_connections 2024-02-28T16:16:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:09.452+0000 7f7dddc00700 1 -- 172.21.15.57:0/203797286 wait complete. 2024-02-28T16:16:09.459 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)" 2024-02-28T16:16:09.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:09 smithi057 ceph-mon[93219]: pgmap v404: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:09.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:09 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/203797286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:16:09.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:09 smithi087 ceph-mon[82628]: pgmap v404: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:09.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:09 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/203797286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:16:10.380 DEBUG:teuthology.parallel:result is None 2024-02-28T16:16:10.380 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:16:10.393 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T16:16:10.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf04dacc-d650-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T16:16:10.915 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/mon.smithi057/config 2024-02-28T16:16:11.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:11 smithi057 ceph-mon[93219]: pgmap v405: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:11.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:11 smithi087 ceph-mon[82628]: pgmap v405: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:12.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.915+0000 7f2f5ac00700 1 -- 172.21.15.57:0/4011881254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f54101e40 msgr2=0x7f2f54102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:12.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.915+0000 7f2f5ac00700 1 --2- 172.21.15.57:0/4011881254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f54101e40 0x7f2f54102210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2f44004940 tx=0x7f2f44009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:12.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.915+0000 7f2f5ac00700 1 -- 172.21.15.57:0/4011881254 shutdown_connections 2024-02-28T16:16:12.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.915+0000 7f2f5ac00700 1 --2- 172.21.15.57:0/4011881254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f541027e0 0x7f2f540fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:12.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.915+0000 7f2f5ac00700 1 --2- 172.21.15.57:0/4011881254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f54101e40 0x7f2f54102210 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:12.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.915+0000 7f2f5ac00700 1 -- 172.21.15.57:0/4011881254 >> 172.21.15.57:0/4011881254 conn(0x7f2f54071d90 msgr2=0x7f2f54072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:12.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.915+0000 7f2f5ac00700 1 -- 172.21.15.57:0/4011881254 shutdown_connections 2024-02-28T16:16:12.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.915+0000 7f2f5ac00700 1 -- 172.21.15.57:0/4011881254 wait complete. 2024-02-28T16:16:12.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.916+0000 7f2f5ac00700 1 Processor -- start 2024-02-28T16:16:12.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.917+0000 7f2f5ac00700 1 -- start start 2024-02-28T16:16:12.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.917+0000 7f2f5ac00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f54101e40 0x7f2f54113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:12.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.917+0000 7f2f5ac00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f541027e0 0x7f2f54113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.917+0000 7f2f5ac00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f541145e0 con 0x7f2f54101e40 2024-02-28T16:16:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.917+0000 7f2f5ac00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5410d910 con 0x7f2f541027e0 2024-02-28T16:16:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.917+0000 7f2f53e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f54101e40 0x7f2f54113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.917+0000 7f2f53e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f54101e40 0x7f2f54113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39802/0 (socket says 172.21.15.57:39802) 2024-02-28T16:16:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.917+0000 7f2f53e00700 1 -- 172.21.15.57:0/1104800128 learned_addr learned my addr 172.21.15.57:0/1104800128 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.918+0000 7f2f53e00700 1 -- 172.21.15.57:0/1104800128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f541027e0 msgr2=0x7f2f54113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.918+0000 7f2f53e00700 1 --2- 172.21.15.57:0/1104800128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f541027e0 0x7f2f54113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.918+0000 7f2f53e00700 1 -- 172.21.15.57:0/1104800128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44005040 con 0x7f2f54101e40 2024-02-28T16:16:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.918+0000 7f2f53e00700 1 --2- 172.21.15.57:0/1104800128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f54101e40 0x7f2f54113a50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009150 tx=0x7f2f44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.918+0000 7f2f4be00700 1 -- 172.21.15.57:0/1104800128 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f4400e040 con 0x7f2f54101e40 2024-02-28T16:16:12.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.918+0000 7f2f5ac00700 1 -- 172.21.15.57:0/1104800128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5410db90 con 0x7f2f54101e40 2024-02-28T16:16:12.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.918+0000 7f2f4be00700 1 -- 172.21.15.57:0/1104800128 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f4400bbf0 con 0x7f2f54101e40 2024-02-28T16:16:12.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.919+0000 7f2f5ac00700 1 -- 172.21.15.57:0/1104800128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5410e0d0 con 0x7f2f54101e40 2024-02-28T16:16:12.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.919+0000 7f2f4be00700 1 -- 172.21.15.57:0/1104800128 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f4401c630 con 0x7f2f54101e40 2024-02-28T16:16:12.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.920+0000 7f2f5ac00700 1 -- 172.21.15.57:0/1104800128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f540738b0 con 0x7f2f54101e40 2024-02-28T16:16:12.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.921+0000 7f2f4be00700 1 -- 172.21.15.57:0/1104800128 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2f4400bd60 con 0x7f2f54101e40 2024-02-28T16:16:12.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.922+0000 7f2f4be00700 1 --2- 172.21.15.57:0/1104800128 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2f3806d7f0 0x7f2f3806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:12.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.922+0000 7f2f4be00700 1 -- 172.21.15.57:0/1104800128 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f2f4408e4e0 con 0x7f2f54101e40 2024-02-28T16:16:12.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.922+0000 7f2f53400700 1 --2- 172.21.15.57:0/1104800128 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2f3806d7f0 0x7f2f3806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:12.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.923+0000 7f2f53400700 1 --2- 172.21.15.57:0/1104800128 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2f3806d7f0 0x7f2f3806fca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2f5410f280 tx=0x7f2f40007cc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:12.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:12.927+0000 7f2f4be00700 1 -- 172.21.15.57:0/1104800128 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2f4405b6e0 con 0x7f2f54101e40 2024-02-28T16:16:13.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.200+0000 7f2f5ac00700 1 -- 172.21.15.57:0/1104800128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2f5404bed0 con 0x7f2f54101e40 2024-02-28T16:16:13.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.201+0000 7f2f4be00700 1 -- 172.21.15.57:0/1104800128 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1889 (secure 0 0 0) 0x7f2f4405b270 con 0x7f2f54101e40 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:e41 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 41 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-02-28T15:58:03.684519+0000 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-02-28T16:12:37.537945+0000 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2024-02-28T16:16:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 60 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 101 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 2 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=34490,1=34522} 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2024-02-28T16:16:13.194 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 1 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.eztwsd{0:34490} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.57:6826/995880144,v1:172.21.15.57:6827/995880144] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.fzjgef{0:44391} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6824/571403132,v1:172.21.15.87:6825/571403132] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi057.qwatmu{1:34522} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.57:6828/2553742021,v1:172.21.15.57:6829/2553742021] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.cephfs.smithi087.whebmo{1:44405} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/2114762616,v1:172.21.15.87:6827/2114762616] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:13.195 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.203+0000 7f2f5ac00700 1 -- 172.21.15.57:0/1104800128 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2f3806d7f0 msgr2=0x7f2f3806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.203+0000 7f2f5ac00700 1 --2- 172.21.15.57:0/1104800128 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2f3806d7f0 0x7f2f3806fca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2f5410f280 tx=0x7f2f40007cc0 comp rx=0 tx=0).stop 2024-02-28T16:16:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.203+0000 7f2f5ac00700 1 -- 172.21.15.57:0/1104800128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f54101e40 msgr2=0x7f2f54113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.203+0000 7f2f5ac00700 1 --2- 172.21.15.57:0/1104800128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f54101e40 0x7f2f54113a50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009150 tx=0x7f2f44009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.204+0000 7f2f5ac00700 1 -- 172.21.15.57:0/1104800128 shutdown_connections 2024-02-28T16:16:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.204+0000 7f2f5ac00700 1 --2- 172.21.15.57:0/1104800128 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2f3806d7f0 0x7f2f3806fca0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.204+0000 7f2f5ac00700 1 --2- 172.21.15.57:0/1104800128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f54101e40 0x7f2f54113a50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.204+0000 7f2f5ac00700 1 --2- 172.21.15.57:0/1104800128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f541027e0 0x7f2f54113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:13.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.204+0000 7f2f5ac00700 1 -- 172.21.15.57:0/1104800128 >> 172.21.15.57:0/1104800128 conn(0x7f2f54071d90 msgr2=0x7f2f54065700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:13.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.204+0000 7f2f5ac00700 1 -- 172.21.15.57:0/1104800128 shutdown_connections 2024-02-28T16:16:13.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:13.204+0000 7f2f5ac00700 1 -- 172.21.15.57:0/1104800128 wait complete. 2024-02-28T16:16:13.197 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2024-02-28T16:16:13.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:13 smithi057 ceph-mon[93219]: pgmap v406: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:13.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:13 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1104800128' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:16:13.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:13 smithi087 ceph-mon[82628]: pgmap v406: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:13.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:13 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1104800128' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:16:14.025 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-28T16:16:14.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:16:14.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.274+0000 7f73e4000640 1 -- 172.21.15.57:0/1880320014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73dc0fe4f0 msgr2=0x7f73dc0fe960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:14.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.274+0000 7f73e4000640 1 --2- 172.21.15.57:0/1880320014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73dc0fe4f0 0x7f73dc0fe960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f73c80048d0 tx=0x7f73c8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.275+0000 7f73e4000640 1 -- 172.21.15.57:0/1880320014 shutdown_connections 2024-02-28T16:16:14.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.275+0000 7f73e4000640 1 --2- 172.21.15.57:0/1880320014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73dc0fe4f0 0x7f73dc0fe960 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.275+0000 7f73e4000640 1 --2- 172.21.15.57:0/1880320014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73dc104530 0x7f73dc104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.275+0000 7f73e4000640 1 -- 172.21.15.57:0/1880320014 >> 172.21.15.57:0/1880320014 conn(0x7f73dc0fa090 msgr2=0x7f73dc0fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:14.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.275+0000 7f73e4000640 1 -- 172.21.15.57:0/1880320014 shutdown_connections 2024-02-28T16:16:14.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.275+0000 7f73e4000640 1 -- 172.21.15.57:0/1880320014 wait complete. 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.275+0000 7f73e4000640 1 Processor -- start 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.276+0000 7f73e4000640 1 -- start start 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.276+0000 7f73e4000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73dc0fe4f0 0x7f73dc114d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.276+0000 7f73e4000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73dc104530 0x7f73dc115250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.276+0000 7f73e4000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc115850 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.276+0000 7f73e4000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc10ede0 con 0x7f73dc104530 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.276+0000 7f73e1600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73dc0fe4f0 0x7f73dc114d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.276+0000 7f73e1600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73dc0fe4f0 0x7f73dc114d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39826/0 (socket says 172.21.15.57:39826) 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.276+0000 7f73e1600640 1 -- 172.21.15.57:0/2593712474 learned_addr learned my addr 172.21.15.57:0/2593712474 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.277+0000 7f73e1600640 1 -- 172.21.15.57:0/2593712474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73dc104530 msgr2=0x7f73dc115250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.277+0000 7f73e1600640 1 --2- 172.21.15.57:0/2593712474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73dc104530 0x7f73dc115250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.277+0000 7f73e1600640 1 -- 172.21.15.57:0/2593712474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8005040 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.277+0000 7f73e1600640 1 --2- 172.21.15.57:0/2593712474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73dc0fe4f0 0x7f73dc114d10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f73d000db00 tx=0x7f73d0004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.277+0000 7f73d9600640 1 -- 172.21.15.57:0/2593712474 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73d0017070 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.277+0000 7f73d9600640 1 -- 172.21.15.57:0/2593712474 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73d000f040 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.277+0000 7f73e4000640 1 -- 172.21.15.57:0/2593712474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc10f0c0 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.277+0000 7f73d9600640 1 -- 172.21.15.57:0/2593712474 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73d0003ae0 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.277+0000 7f73e4000640 1 -- 172.21.15.57:0/2593712474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc10f5e0 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.278+0000 7f73e4000640 1 -- 172.21.15.57:0/2593712474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc064030 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.279+0000 7f73d9600640 1 -- 172.21.15.57:0/2593712474 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f73d0003c40 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.280+0000 7f73d9600640 1 --2- 172.21.15.57:0/2593712474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f73c406d760 0x7f73c406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:14.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.280+0000 7f73d9600640 1 -- 172.21.15.57:0/2593712474 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f73d008d240 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.281+0000 7f73e0c00640 1 --2- 172.21.15.57:0/2593712474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f73c406d760 0x7f73c406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:14.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.281+0000 7f73e0c00640 1 --2- 172.21.15.57:0/2593712474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f73c406d760 0x7f73c406fc10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f73c80048a0 tx=0x7f73c8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:14.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.285+0000 7f73d9600640 1 -- 172.21.15.57:0/2593712474 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f73d0056890 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.488+0000 7f73e4000640 1 -- 172.21.15.57:0/2593712474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73dc10f800 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.489+0000 7f73d9600640 1 -- 172.21.15.57:0/2593712474 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+17102 (secure 0 0 0) 0x7f73d0059f50 con 0x7f73dc0fe4f0 2024-02-28T16:16:14.481 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:14.481 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":103,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","created":"2024-02-28T15:49:03.036724+0000","modified":"2024-02-28T16:12:17.859460+0000","last_up_change":"2024-02-28T16:10:01.305153+0000","last_in_change":"2024-02-28T15:56:03.811536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T15:54:45.908218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T15:58:02.602649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T15:58:03.211266+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a78e2ba-3bfe-4677-b633-f2095c44065f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":60,"up_thru":96,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6803","nonce":1715766120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6805","nonce":1715766120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6809","nonce":1715766120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6807","nonce":1715766120}]},"public_addr":"172.21.15.57:6803/1715766120","cluster_addr":"172.21.15.57:6805/1715766120","heartbeat_back_addr":"172.21.15.57:6809/1715766120","heartbeat_front_addr":"172.21.15.57:6807/1715766120","state":["exists","up"]},{"osd":1,"uuid":"fccab799-0840-4050-9ead-4ad9e7e69fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":72,"up_from":76,"up_thru":96,"down_at":73,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6811","nonce":1999906736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6813","nonce":1999906736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6817","nonce":1999906736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6815","nonce":1999906736}]},"public_addr":"172.21.15.57:6811/1999906736","cluster_addr":"172.21.15.57:6813/1999906736","heartbeat_back_addr":"172.21.15.57:6817/1999906736","heartbeat_front_addr":"172.21.15.57:6815/1999906736","state":["exists","up"]},{"osd":2,"uuid":"4b0a7b1d-f096-4698-b27a-6b5aa2239eb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":77,"up_from":81,"up_thru":96,"down_at":78,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6819","nonce":3549211468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6821","nonce":3549211468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6825","nonce":3549211468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6823","nonce":3549211468}]},"public_addr":"172.21.15.57:6819/3549211468","cluster_addr":"172.21.15.57:6821/3549211468","heartbeat_back_addr":"172.21.15.57:6825/3549211468","heartbeat_front_addr":"172.21.15.57:6823/3549211468","state":["exists","up"]},{"osd":3,"uuid":"1c67654a-1d10-422e-9540-a348cff2d828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":82,"up_from":86,"up_thru":96,"down_at":83,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6801","nonce":2608240291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6803","nonce":2608240291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6807","nonce":2608240291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6805","nonce":2608240291}]},"public_addr":"172.21.15.87:6801/2608240291","cluster_addr":"172.21.15.87:6803/2608240291","heartbeat_back_addr":"172.21.15.87:6807/2608240291","heartbeat_front_addr":"172.21.15.87:6805/2608240291","state":["exists","up"]},{"osd":4,"uuid":"7f988788-349d-4afd-adca-af474c7bb8ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":87,"up_from":91,"up_thru":96,"down_at":88,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6809","nonce":3757515598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6811","nonce":3757515598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6815","nonce":3757515598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6813","nonce":3757515598}]},"public_addr":"172.21.15.87:6809/3757515598","cluster_addr":"172.21.15.87:6811/3757515598","heartbeat_back_addr":"172.21.15.87:6815/3757515598","heartbeat_front_addr":"172.21.15.87:6813/3757515598","state":["exists","up"]},{"osd":5,"uuid":"83e02849-bd1f-4fa8-893e-1bfd8b2cfe42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":92,"up_from":96,"up_thru":96,"down_at":93,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6817","nonce":2897063090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6819","nonce":2897063090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6823","nonce":2897063090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6821","nonce":2897063090}]},"public_addr":"172.21.15.87:6817/2897063090","cluster_addr":"172.21.15.87:6819/2897063090","heartbeat_back_addr":"172.21.15.87:6823/2897063090","heartbeat_front_addr":"172.21.15.87:6821/2897063090","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:53:27.750469+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:03.782911+0000","dead_epoch":72},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:41.785278+0000","dead_epoch":77},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:15.986058+0000","dead_epoch":82},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:50.819979+0000","dead_epoch":87},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:56:26.433957+0000","dead_epoch":92}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.a","mappings":[{"from":3,"to":0}]},{"pgid":"2.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.0","mappings":[{"from":1,"to":0}]},{"pgid":"3.2","mappings":[{"from":1,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":0}]},{"pgid":"3.11","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":3,"to":0}]},{"pgid":"3.1a","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6828/3861545073":"2024-02-29T16:11:21.561856+0000","172.21.15.57:6827/1436733447":"2024-02-29T16:10:49.544938+0000","172.21.15.57:6801/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/1871958144":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3728594338":"2024-02-29T16:01:00.964498+0000","172.21.15.87:0/4142702720":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/3926246244":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/810130858":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/3171524924":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/794302018":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6800/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.87:0/1921033756":"2024-02-29T16:03:12.188113+0000","172.21.15.87:6829/3858637717":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/1819633079":"2024-02-29T16:01:00.964498+0000","172.21.15.57:0/2510955053":"2024-02-29T16:04:33.669357+0000","172.21.15.57:6829/3861545073":"2024-02-29T16:11:21.561856+0000","172.21.15.57:0/2729792809":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/509992026":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6801/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/4184139864":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3955176243":"2024-02-29T15:51:51.209781+0000","172.21.15.87:0/3563981670":"2024-02-29T16:03:12.188113+0000","172.21.15.87:6828/3858637717":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/4078846536":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6800/2828490283":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6801/2828490283":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6800/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:6800/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/961475533":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6801/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.87:0/3414157439":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/429066936":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/2044423401":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/1211502049":"2024-02-29T16:04:33.669357+0000","172.21.15.57:6826/1436733447":"2024-02-29T16:10:49.544938+0000","172.21.15.57:6800/3297260515":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/4173475219":"2024-02-29T16:04:33.669357+0000","172.21.15.57:6801/3297260515":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/2332815594":"2024-02-29T16:04:33.669357+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:16:14.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.492+0000 7f73e4000640 1 -- 172.21.15.57:0/2593712474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f73c406d760 msgr2=0x7f73c406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:14.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.492+0000 7f73e4000640 1 --2- 172.21.15.57:0/2593712474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f73c406d760 0x7f73c406fc10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f73c80048a0 tx=0x7f73c8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.492+0000 7f73e4000640 1 -- 172.21.15.57:0/2593712474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73dc0fe4f0 msgr2=0x7f73dc114d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:14.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.492+0000 7f73e4000640 1 --2- 172.21.15.57:0/2593712474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73dc0fe4f0 0x7f73dc114d10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f73d000db00 tx=0x7f73d0004e60 comp rx=0 tx=0).stop 2024-02-28T16:16:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.493+0000 7f73e4000640 1 -- 172.21.15.57:0/2593712474 shutdown_connections 2024-02-28T16:16:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.493+0000 7f73e4000640 1 --2- 172.21.15.57:0/2593712474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f73c406d760 0x7f73c406fc10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.493+0000 7f73e4000640 1 --2- 172.21.15.57:0/2593712474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73dc104530 0x7f73dc115250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.493+0000 7f73e4000640 1 --2- 172.21.15.57:0/2593712474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73dc0fe4f0 0x7f73dc114d10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.493+0000 7f73e4000640 1 -- 172.21.15.57:0/2593712474 >> 172.21.15.57:0/2593712474 conn(0x7f73dc0fa090 msgr2=0x7f73dc0fa910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.493+0000 7f73e4000640 1 -- 172.21.15.57:0/2593712474 shutdown_connections 2024-02-28T16:16:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.493+0000 7f73e4000640 1 -- 172.21.15.57:0/2593712474 wait complete. 2024-02-28T16:16:14.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T15:54:45.908218+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T15:58:02.602649+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T15:58:03.211266+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:16:14.503 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:16:14.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.738+0000 7f8a3be00640 1 -- 172.21.15.57:0/3956012468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a341012d0 msgr2=0x7f8a341016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:14.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.738+0000 7f8a3be00640 1 --2- 172.21.15.57:0/3956012468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a341012d0 0x7f8a341016a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8a240048d0 tx=0x7f8a24009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.738+0000 7f8a3be00640 1 -- 172.21.15.57:0/3956012468 shutdown_connections 2024-02-28T16:16:14.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.738+0000 7f8a3be00640 1 --2- 172.21.15.57:0/3956012468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a340fb2b0 0x7f8a340fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.738+0000 7f8a3be00640 1 --2- 172.21.15.57:0/3956012468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a341012d0 0x7f8a341016a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.738+0000 7f8a3be00640 1 -- 172.21.15.57:0/3956012468 >> 172.21.15.57:0/3956012468 conn(0x7f8a34071230 msgr2=0x7f8a34071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:14.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.738+0000 7f8a3be00640 1 -- 172.21.15.57:0/3956012468 shutdown_connections 2024-02-28T16:16:14.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.738+0000 7f8a3be00640 1 -- 172.21.15.57:0/3956012468 wait complete. 2024-02-28T16:16:14.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.739+0000 7f8a3be00640 1 Processor -- start 2024-02-28T16:16:14.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.739+0000 7f8a3be00640 1 -- start start 2024-02-28T16:16:14.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a3be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a340fb2b0 0x7f8a34114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:14.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a3be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a341012d0 0x7f8a34115310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:14.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a3be00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34115910 con 0x7f8a340fb2b0 2024-02-28T16:16:14.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a3be00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3410eea0 con 0x7f8a341012d0 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a39400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a340fb2b0 0x7f8a34114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a39400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a340fb2b0 0x7f8a34114dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39852/0 (socket says 172.21.15.57:39852) 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a39400640 1 -- 172.21.15.57:0/3056824244 learned_addr learned my addr 172.21.15.57:0/3056824244 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a39400640 1 -- 172.21.15.57:0/3056824244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a341012d0 msgr2=0x7f8a34115310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a39400640 1 --2- 172.21.15.57:0/3056824244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a341012d0 0x7f8a34115310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a39400640 1 -- 172.21.15.57:0/3056824244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24005040 con 0x7f8a340fb2b0 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.740+0000 7f8a39400640 1 --2- 172.21.15.57:0/3056824244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a340fb2b0 0x7f8a34114dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8a24031720 tx=0x7f8a24009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.741+0000 7f8a31600640 1 -- 172.21.15.57:0/3056824244 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a240094c0 con 0x7f8a340fb2b0 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.741+0000 7f8a3be00640 1 -- 172.21.15.57:0/3056824244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3410f120 con 0x7f8a340fb2b0 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.741+0000 7f8a31600640 1 -- 172.21.15.57:0/3056824244 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a24009620 con 0x7f8a340fb2b0 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.741+0000 7f8a31600640 1 -- 172.21.15.57:0/3056824244 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a2403b640 con 0x7f8a340fb2b0 2024-02-28T16:16:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.741+0000 7f8a3be00640 1 -- 172.21.15.57:0/3056824244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3410f640 con 0x7f8a340fb2b0 2024-02-28T16:16:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.742+0000 7f8a3be00640 1 -- 172.21.15.57:0/3056824244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a34064030 con 0x7f8a340fb2b0 2024-02-28T16:16:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.743+0000 7f8a31600640 1 -- 172.21.15.57:0/3056824244 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f8a2402f070 con 0x7f8a340fb2b0 2024-02-28T16:16:14.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.744+0000 7f8a31600640 1 --2- 172.21.15.57:0/3056824244 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8a1806d750 0x7f8a1806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:14.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.745+0000 7f8a31600640 1 -- 172.21.15.57:0/3056824244 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f8a240af5c0 con 0x7f8a340fb2b0 2024-02-28T16:16:14.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.745+0000 7f8a38a00640 1 --2- 172.21.15.57:0/3056824244 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8a1806d750 0x7f8a1806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:14.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.745+0000 7f8a38a00640 1 --2- 172.21.15.57:0/3056824244 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8a1806d750 0x7f8a1806fc00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a34110690 tx=0x7f8a20009c50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:14.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.749+0000 7f8a31600640 1 -- 172.21.15.57:0/3056824244 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8a24078cb0 con 0x7f8a340fb2b0 2024-02-28T16:16:14.928 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:14 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2593712474' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:16:14.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.953+0000 7f8a3be00640 1 -- 172.21.15.57:0/3056824244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a3410f7d0 con 0x7f8a340fb2b0 2024-02-28T16:16:14.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.954+0000 7f8a31600640 1 -- 172.21.15.57:0/3056824244 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a2407c370 con 0x7f8a340fb2b0 2024-02-28T16:16:14.946 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-02-28T16:16:14.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 -- 172.21.15.57:0/3056824244 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8a1806d750 msgr2=0x7f8a1806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:14.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 --2- 172.21.15.57:0/3056824244 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8a1806d750 0x7f8a1806fc00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a34110690 tx=0x7f8a20009c50 comp rx=0 tx=0).stop 2024-02-28T16:16:14.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 -- 172.21.15.57:0/3056824244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a340fb2b0 msgr2=0x7f8a34114dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:14.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 --2- 172.21.15.57:0/3056824244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a340fb2b0 0x7f8a34114dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8a24031720 tx=0x7f8a24009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 -- 172.21.15.57:0/3056824244 shutdown_connections 2024-02-28T16:16:14.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 --2- 172.21.15.57:0/3056824244 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8a1806d750 0x7f8a1806fc00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 --2- 172.21.15.57:0/3056824244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a341012d0 0x7f8a34115310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 --2- 172.21.15.57:0/3056824244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a340fb2b0 0x7f8a34114dd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 -- 172.21.15.57:0/3056824244 >> 172.21.15.57:0/3056824244 conn(0x7f8a34071230 msgr2=0x7f8a34064480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:14.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 -- 172.21.15.57:0/3056824244 shutdown_connections 2024-02-28T16:16:14.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:14.957+0000 7f8a3be00640 1 -- 172.21.15.57:0/3056824244 wait complete. 2024-02-28T16:16:14.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:14 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2593712474' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:16:14.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:16:15.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.191+0000 7ffa69200640 1 -- 172.21.15.57:0/321555994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa64102ac0 msgr2=0x7ffa640fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:15.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.191+0000 7ffa69200640 1 --2- 172.21.15.57:0/321555994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa64102ac0 0x7ffa640fc150 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffa500048d0 tx=0x7ffa50009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.191+0000 7ffa69200640 1 -- 172.21.15.57:0/321555994 shutdown_connections 2024-02-28T16:16:15.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.191+0000 7ffa69200640 1 --2- 172.21.15.57:0/321555994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa64102ac0 0x7ffa640fc150 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.191+0000 7ffa69200640 1 --2- 172.21.15.57:0/321555994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa64102120 0x7ffa641024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.191+0000 7ffa69200640 1 -- 172.21.15.57:0/321555994 >> 172.21.15.57:0/321555994 conn(0x7ffa640f7cf0 msgr2=0x7ffa640fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:15.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.191+0000 7ffa69200640 1 -- 172.21.15.57:0/321555994 shutdown_connections 2024-02-28T16:16:15.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.191+0000 7ffa69200640 1 -- 172.21.15.57:0/321555994 wait complete. 2024-02-28T16:16:15.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.192+0000 7ffa69200640 1 Processor -- start 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.192+0000 7ffa69200640 1 -- start start 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa69200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa64102120 0x7ffa64114c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa69200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa64102ac0 0x7ffa641151c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa69200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa641157c0 con 0x7ffa64102ac0 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa69200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6410ed50 con 0x7ffa64102120 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa62a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa64102ac0 0x7ffa641151c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa62a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa64102ac0 0x7ffa641151c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39874/0 (socket says 172.21.15.57:39874) 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa62a00640 1 -- 172.21.15.57:0/1919981279 learned_addr learned my addr 172.21.15.57:0/1919981279 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa63400640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa64102120 0x7ffa64114c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa62a00640 1 -- 172.21.15.57:0/1919981279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa64102120 msgr2=0x7ffa64114c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa62a00640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa64102120 0x7ffa64114c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa62a00640 1 -- 172.21.15.57:0/1919981279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa50005040 con 0x7ffa64102ac0 2024-02-28T16:16:15.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.193+0000 7ffa63400640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa64102120 0x7ffa64114c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:16:15.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.194+0000 7ffa62a00640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa64102ac0 0x7ffa641151c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffa50031720 tx=0x7ffa50009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:15.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.194+0000 7ffa5b400640 1 -- 172.21.15.57:0/1919981279 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa500094c0 con 0x7ffa64102ac0 2024-02-28T16:16:15.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.194+0000 7ffa69200640 1 -- 172.21.15.57:0/1919981279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6410efd0 con 0x7ffa64102ac0 2024-02-28T16:16:15.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.194+0000 7ffa5b400640 1 -- 172.21.15.57:0/1919981279 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa50009620 con 0x7ffa64102ac0 2024-02-28T16:16:15.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.194+0000 7ffa69200640 1 -- 172.21.15.57:0/1919981279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6410f4f0 con 0x7ffa64102ac0 2024-02-28T16:16:15.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.194+0000 7ffa5b400640 1 -- 172.21.15.57:0/1919981279 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa500465e0 con 0x7ffa64102ac0 2024-02-28T16:16:15.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.195+0000 7ffa69200640 1 -- 172.21.15.57:0/1919981279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6404bcc0 con 0x7ffa64102ac0 2024-02-28T16:16:15.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.196+0000 7ffa5b400640 1 -- 172.21.15.57:0/1919981279 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ffa5002f070 con 0x7ffa64102ac0 2024-02-28T16:16:15.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.198+0000 7ffa5b400640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffa4806d750 0x7ffa4806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:15.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.198+0000 7ffa5b400640 1 -- 172.21.15.57:0/1919981279 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ffa500af610 con 0x7ffa64102ac0 2024-02-28T16:16:15.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.198+0000 7ffa63400640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffa4806d750 0x7ffa4806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:15.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.199+0000 7ffa63400640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffa4806d750 0x7ffa4806fc00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffa54004c80 tx=0x7ffa54009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:15.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.203+0000 7ffa5b400640 1 -- 172.21.15.57:0/1919981279 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffa50078c60 con 0x7ffa64102ac0 2024-02-28T16:16:15.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.401+0000 7ffa69200640 1 -- 172.21.15.57:0/1919981279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7ffa6410f6d0 con 0x7ffa64102ac0 2024-02-28T16:16:15.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.402+0000 7ffa5b400640 1 -- 172.21.15.57:0/1919981279 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v103) v1 ==== 107+0+11 (secure 0 0 0) 0x7ffa5007c320 con 0x7ffa64102ac0 2024-02-28T16:16:15.394 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.405+0000 7ffa69200640 1 -- 172.21.15.57:0/1919981279 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffa4806d750 msgr2=0x7ffa4806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.405+0000 7ffa69200640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffa4806d750 0x7ffa4806fc00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffa54004c80 tx=0x7ffa54009040 comp rx=0 tx=0).stop 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.405+0000 7ffa69200640 1 -- 172.21.15.57:0/1919981279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa64102ac0 msgr2=0x7ffa641151c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.405+0000 7ffa69200640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa64102ac0 0x7ffa641151c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffa50031720 tx=0x7ffa50009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.405+0000 7ffa69200640 1 -- 172.21.15.57:0/1919981279 shutdown_connections 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.405+0000 7ffa69200640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffa4806d750 0x7ffa4806fc00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.405+0000 7ffa69200640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa64102ac0 0x7ffa641151c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.405+0000 7ffa69200640 1 --2- 172.21.15.57:0/1919981279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa64102120 0x7ffa64114c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.405+0000 7ffa69200640 1 -- 172.21.15.57:0/1919981279 >> 172.21.15.57:0/1919981279 conn(0x7ffa640f7cf0 msgr2=0x7ffa6406fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.406+0000 7ffa69200640 1 -- 172.21.15.57:0/1919981279 shutdown_connections 2024-02-28T16:16:15.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.406+0000 7ffa69200640 1 -- 172.21.15.57:0/1919981279 wait complete. 2024-02-28T16:16:15.413 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:16:15.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.628+0000 7fcbec800640 1 -- 172.21.15.57:0/2055409445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe4104ee0 msgr2=0x7fcbe40fe5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:15.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.628+0000 7fcbec800640 1 --2- 172.21.15.57:0/2055409445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe4104ee0 0x7fcbe40fe5a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40048d0 tx=0x7fcbd4009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.629+0000 7fcbec800640 1 -- 172.21.15.57:0/2055409445 shutdown_connections 2024-02-28T16:16:15.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.629+0000 7fcbec800640 1 --2- 172.21.15.57:0/2055409445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe4104ee0 0x7fcbe40fe5a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.629+0000 7fcbec800640 1 --2- 172.21.15.57:0/2055409445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe4104540 0x7fcbe4104910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.629+0000 7fcbec800640 1 -- 172.21.15.57:0/2055409445 >> 172.21.15.57:0/2055409445 conn(0x7fcbe40fa120 msgr2=0x7fcbe40fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:15.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.629+0000 7fcbec800640 1 -- 172.21.15.57:0/2055409445 shutdown_connections 2024-02-28T16:16:15.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.629+0000 7fcbec800640 1 -- 172.21.15.57:0/2055409445 wait complete. 2024-02-28T16:16:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.629+0000 7fcbec800640 1 Processor -- start 2024-02-28T16:16:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.630+0000 7fcbec800640 1 -- start start 2024-02-28T16:16:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.630+0000 7fcbec800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe4104540 0x7fcbe4114df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.630+0000 7fcbec800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe4104ee0 0x7fcbe4115330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.630+0000 7fcbec800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe4115930 con 0x7fcbe4104ee0 2024-02-28T16:16:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.630+0000 7fcbec800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe410eec0 con 0x7fcbe4104540 2024-02-28T16:16:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.630+0000 7fcbe9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe4104ee0 0x7fcbe4115330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.630+0000 7fcbe9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe4104ee0 0x7fcbe4115330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39888/0 (socket says 172.21.15.57:39888) 2024-02-28T16:16:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.631+0000 7fcbe9400640 1 -- 172.21.15.57:0/3527676061 learned_addr learned my addr 172.21.15.57:0/3527676061 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:15.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.631+0000 7fcbe9e00640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe4104540 0x7fcbe4114df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:15.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.631+0000 7fcbe9400640 1 -- 172.21.15.57:0/3527676061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe4104540 msgr2=0x7fcbe4114df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:15.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.631+0000 7fcbe9400640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe4104540 0x7fcbe4114df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.631+0000 7fcbe9400640 1 -- 172.21.15.57:0/3527676061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4005040 con 0x7fcbe4104ee0 2024-02-28T16:16:15.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.632+0000 7fcbe9400640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe4104ee0 0x7fcbe4115330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4034040 tx=0x7fcbd4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:15.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.632+0000 7fcbde000640 1 -- 172.21.15.57:0/3527676061 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbd40094c0 con 0x7fcbe4104ee0 2024-02-28T16:16:15.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.632+0000 7fcbec800640 1 -- 172.21.15.57:0/3527676061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe410f140 con 0x7fcbe4104ee0 2024-02-28T16:16:15.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.632+0000 7fcbde000640 1 -- 172.21.15.57:0/3527676061 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbd4032e70 con 0x7fcbe4104ee0 2024-02-28T16:16:15.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.632+0000 7fcbde000640 1 -- 172.21.15.57:0/3527676061 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbd40433b0 con 0x7fcbe4104ee0 2024-02-28T16:16:15.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.632+0000 7fcbec800640 1 -- 172.21.15.57:0/3527676061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe410f600 con 0x7fcbe4104ee0 2024-02-28T16:16:15.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.633+0000 7fcbec800640 1 -- 172.21.15.57:0/3527676061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe4064480 con 0x7fcbe4104ee0 2024-02-28T16:16:15.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.635+0000 7fcbde000640 1 -- 172.21.15.57:0/3527676061 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fcbd402f070 con 0x7fcbe4104ee0 2024-02-28T16:16:15.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.635+0000 7fcbde000640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcbcc06d760 0x7fcbcc06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:15.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.636+0000 7fcbde000640 1 -- 172.21.15.57:0/3527676061 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fcbd40aefa0 con 0x7fcbe4104ee0 2024-02-28T16:16:15.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.636+0000 7fcbe9e00640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcbcc06d760 0x7fcbcc06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:15.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.637+0000 7fcbe9e00640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcbcc06d760 0x7fcbcc06fc10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8007fd0 tx=0x7fcbd8009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:15.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.641+0000 7fcbde000640 1 -- 172.21.15.57:0/3527676061 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcbd40785f0 con 0x7fcbe4104ee0 2024-02-28T16:16:15.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.842+0000 7fcbec800640 1 -- 172.21.15.57:0/3527676061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fcbe410f870 con 0x7fcbe4104ee0 2024-02-28T16:16:15.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.843+0000 7fcbde000640 1 -- 172.21.15.57:0/3527676061 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v103) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcbd4009620 con 0x7fcbe4104ee0 2024-02-28T16:16:15.834 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-02-28T16:16:15.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.846+0000 7fcbec800640 1 -- 172.21.15.57:0/3527676061 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcbcc06d760 msgr2=0x7fcbcc06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:15.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.846+0000 7fcbec800640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcbcc06d760 0x7fcbcc06fc10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8007fd0 tx=0x7fcbd8009e90 comp rx=0 tx=0).stop 2024-02-28T16:16:15.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.846+0000 7fcbec800640 1 -- 172.21.15.57:0/3527676061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe4104ee0 msgr2=0x7fcbe4115330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:15.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.846+0000 7fcbec800640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe4104ee0 0x7fcbe4115330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4034040 tx=0x7fcbd4009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.846+0000 7fcbec800640 1 -- 172.21.15.57:0/3527676061 shutdown_connections 2024-02-28T16:16:15.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.846+0000 7fcbec800640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcbcc06d760 0x7fcbcc06fc10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.846+0000 7fcbec800640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe4104ee0 0x7fcbe4115330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.846+0000 7fcbec800640 1 --2- 172.21.15.57:0/3527676061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe4104540 0x7fcbe4114df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:15.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.846+0000 7fcbec800640 1 -- 172.21.15.57:0/3527676061 >> 172.21.15.57:0/3527676061 conn(0x7fcbe40fa120 msgr2=0x7fcbe40fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:15.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.847+0000 7fcbec800640 1 -- 172.21.15.57:0/3527676061 shutdown_connections 2024-02-28T16:16:15.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:15.847+0000 7fcbec800640 1 -- 172.21.15.57:0/3527676061 wait complete. 2024-02-28T16:16:15.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-28T16:16:15.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:15 smithi087 ceph-mon[82628]: pgmap v407: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:15.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:15 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3056824244' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:16:15.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:15 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1919981279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:16:16.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.077+0000 7f0ca5e00640 1 -- 172.21.15.57:0/1760881961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ca0070110 msgr2=0x7f0ca0108530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:16.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.077+0000 7f0ca5e00640 1 --2- 172.21.15.57:0/1760881961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ca0070110 0x7f0ca0108530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c90004900 tx=0x7f0c90009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.078+0000 7f0ca5e00640 1 -- 172.21.15.57:0/1760881961 shutdown_connections 2024-02-28T16:16:16.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.078+0000 7f0ca5e00640 1 --2- 172.21.15.57:0/1760881961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ca0070110 0x7f0ca0108530 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.078+0000 7f0ca5e00640 1 --2- 172.21.15.57:0/1760881961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ca006f800 0x7f0ca006fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.078+0000 7f0ca5e00640 1 -- 172.21.15.57:0/1760881961 >> 172.21.15.57:0/1760881961 conn(0x7f0ca00f7d90 msgr2=0x7f0ca00fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:16.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.078+0000 7f0ca5e00640 1 -- 172.21.15.57:0/1760881961 shutdown_connections 2024-02-28T16:16:16.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.078+0000 7f0ca5e00640 1 -- 172.21.15.57:0/1760881961 wait complete. 2024-02-28T16:16:16.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.078+0000 7f0ca5e00640 1 Processor -- start 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.079+0000 7f0ca5e00640 1 -- start start 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.079+0000 7f0ca5e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ca006f800 0x7f0ca0114cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.079+0000 7f0ca5e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ca0070110 0x7f0ca01151f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.079+0000 7f0ca5e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01157f0 con 0x7f0ca0070110 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.079+0000 7f0ca5e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca010ed80 con 0x7f0ca006f800 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.079+0000 7f0c9fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ca0070110 0x7f0ca01151f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.079+0000 7f0c9fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ca0070110 0x7f0ca01151f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39914/0 (socket says 172.21.15.57:39914) 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.079+0000 7f0c9fe00640 1 -- 172.21.15.57:0/332316873 learned_addr learned my addr 172.21.15.57:0/332316873 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.080+0000 7f0ca4a00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ca006f800 0x7f0ca0114cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.080+0000 7f0c9fe00640 1 -- 172.21.15.57:0/332316873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ca006f800 msgr2=0x7f0ca0114cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.080+0000 7f0c9fe00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ca006f800 0x7f0ca0114cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.080+0000 7f0c9fe00640 1 -- 172.21.15.57:0/332316873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90005040 con 0x7f0ca0070110 2024-02-28T16:16:16.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.080+0000 7f0ca4a00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ca006f800 0x7f0ca0114cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:16:16.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.080+0000 7f0c9fe00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ca0070110 0x7f0ca01151f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0c900047f0 tx=0x7f0c90009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:16.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.080+0000 7f0c9cc00640 1 -- 172.21.15.57:0/332316873 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c900094c0 con 0x7f0ca0070110 2024-02-28T16:16:16.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.080+0000 7f0c9cc00640 1 -- 172.21.15.57:0/332316873 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c9003d920 con 0x7f0ca0070110 2024-02-28T16:16:16.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.080+0000 7f0ca5e00640 1 -- 172.21.15.57:0/332316873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca010f000 con 0x7f0ca0070110 2024-02-28T16:16:16.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.081+0000 7f0c9cc00640 1 -- 172.21.15.57:0/332316873 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c9003b8f0 con 0x7f0ca0070110 2024-02-28T16:16:16.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.081+0000 7f0ca5e00640 1 -- 172.21.15.57:0/332316873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca010f520 con 0x7f0ca0070110 2024-02-28T16:16:16.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.082+0000 7f0ca5e00640 1 -- 172.21.15.57:0/332316873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca004bcc0 con 0x7f0ca0070110 2024-02-28T16:16:16.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.083+0000 7f0c9cc00640 1 -- 172.21.15.57:0/332316873 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f0c9003da90 con 0x7f0ca0070110 2024-02-28T16:16:16.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.084+0000 7f0c9cc00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0c8806d760 0x7f0c8806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:16.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.084+0000 7f0c9cc00640 1 -- 172.21.15.57:0/332316873 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f0c900afdd0 con 0x7f0ca0070110 2024-02-28T16:16:16.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.084+0000 7f0ca4a00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0c8806d760 0x7f0c8806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:16.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.085+0000 7f0ca4a00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0c8806d760 0x7f0c8806fc10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c94004d80 tx=0x7f0c9400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:16.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.089+0000 7f0c9cc00640 1 -- 172.21.15.57:0/332316873 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0c90079420 con 0x7f0ca0070110 2024-02-28T16:16:16.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:15 smithi057 ceph-mon[93219]: pgmap v407: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:16.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:15 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3056824244' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:16:16.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:15 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1919981279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:16:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.330+0000 7f0ca5e00640 1 -- 172.21.15.57:0/332316873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ca01102b0 con 0x7f0ca0070110 2024-02-28T16:16:16.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.331+0000 7f0c9cc00640 1 -- 172.21.15.57:0/332316873 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+5024 (secure 0 0 0) 0x7f0c9007cae0 con 0x7f0ca0070110 2024-02-28T16:16:16.323 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:16.323 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:12:37.537945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34490,"mds_1":34522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34522":{"gid":34522,"name":"cephfs.smithi057.qwatmu","rank":1,"incarnation":39,"state":"up:active","state_seq":17,"addr":"172.21.15.57:6829/2553742021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2553742021},{"type":"v1","addr":"172.21.15.57:6829","nonce":2553742021}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_44391":{"gid":44391,"name":"cephfs.smithi087.fzjgef","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6825/571403132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":571403132},{"type":"v1","addr":"172.21.15.87:6825","nonce":571403132}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_44405":{"gid":44405,"name":"cephfs.smithi087.whebmo","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6827/2114762616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2114762616},{"type":"v1","addr":"172.21.15.87:6827","nonce":2114762616}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:16.323 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.334+0000 7f0ca5e00640 1 -- 172.21.15.57:0/332316873 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0c8806d760 msgr2=0x7f0c8806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.334+0000 7f0ca5e00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0c8806d760 0x7f0c8806fc10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c94004d80 tx=0x7f0c9400b040 comp rx=0 tx=0).stop 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.334+0000 7f0ca5e00640 1 -- 172.21.15.57:0/332316873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ca0070110 msgr2=0x7f0ca01151f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.334+0000 7f0ca5e00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ca0070110 0x7f0ca01151f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0c900047f0 tx=0x7f0c90009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.334+0000 7f0ca5e00640 1 -- 172.21.15.57:0/332316873 shutdown_connections 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.334+0000 7f0ca5e00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0c8806d760 0x7f0c8806fc10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.334+0000 7f0ca5e00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ca0070110 0x7f0ca01151f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.334+0000 7f0ca5e00640 1 --2- 172.21.15.57:0/332316873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ca006f800 0x7f0ca0114cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.334+0000 7f0ca5e00640 1 -- 172.21.15.57:0/332316873 >> 172.21.15.57:0/332316873 conn(0x7f0ca00f7d90 msgr2=0x7f0ca0102d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.335+0000 7f0ca5e00640 1 -- 172.21.15.57:0/332316873 shutdown_connections 2024-02-28T16:16:16.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.335+0000 7f0ca5e00640 1 -- 172.21.15.57:0/332316873 wait complete. 2024-02-28T16:16:16.344 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 2, 'flags': 50} 2024-02-28T16:16:16.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-02-28T16:16:16.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.567+0000 7fcd58200640 1 -- 172.21.15.57:0/3387482657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd500fb2b0 msgr2=0x7fcd500fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:16.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.567+0000 7fcd58200640 1 --2- 172.21.15.57:0/3387482657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd500fb2b0 0x7fcd500fb700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0048d0 tx=0x7fcd3c009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.567+0000 7fcd58200640 1 -- 172.21.15.57:0/3387482657 shutdown_connections 2024-02-28T16:16:16.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.567+0000 7fcd58200640 1 --2- 172.21.15.57:0/3387482657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd500fb2b0 0x7fcd500fb700 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.567+0000 7fcd58200640 1 --2- 172.21.15.57:0/3387482657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd501012d0 0x7fcd501016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.567+0000 7fcd58200640 1 -- 172.21.15.57:0/3387482657 >> 172.21.15.57:0/3387482657 conn(0x7fcd50071230 msgr2=0x7fcd50071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:16.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.568+0000 7fcd58200640 1 -- 172.21.15.57:0/3387482657 shutdown_connections 2024-02-28T16:16:16.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.568+0000 7fcd58200640 1 -- 172.21.15.57:0/3387482657 wait complete. 2024-02-28T16:16:16.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.568+0000 7fcd58200640 1 Processor -- start 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.568+0000 7fcd58200640 1 -- start start 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.569+0000 7fcd58200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd500fb2b0 0x7fcd50114e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.569+0000 7fcd58200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd501012d0 0x7fcd501153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.569+0000 7fcd58200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd501159d0 con 0x7fcd501012d0 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.569+0000 7fcd58200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5010ef60 con 0x7fcd500fb2b0 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.569+0000 7fcd54e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd501012d0 0x7fcd501153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.569+0000 7fcd54e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd501012d0 0x7fcd501153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39944/0 (socket says 172.21.15.57:39944) 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.569+0000 7fcd54e00640 1 -- 172.21.15.57:0/3114175440 learned_addr learned my addr 172.21.15.57:0/3114175440 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.569+0000 7fcd55800640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd500fb2b0 0x7fcd50114e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.569+0000 7fcd54e00640 1 -- 172.21.15.57:0/3114175440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd500fb2b0 msgr2=0x7fcd50114e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.570+0000 7fcd54e00640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd500fb2b0 0x7fcd50114e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.570+0000 7fcd54e00640 1 -- 172.21.15.57:0/3114175440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c005040 con 0x7fcd501012d0 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.570+0000 7fcd54e00640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd501012d0 0x7fcd501153d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c031720 tx=0x7fcd3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:16.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.570+0000 7fcd4d600640 1 -- 172.21.15.57:0/3114175440 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd3c0094c0 con 0x7fcd501012d0 2024-02-28T16:16:16.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.570+0000 7fcd4d600640 1 -- 172.21.15.57:0/3114175440 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd3c009620 con 0x7fcd501012d0 2024-02-28T16:16:16.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.570+0000 7fcd4d600640 1 -- 172.21.15.57:0/3114175440 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd3c03b640 con 0x7fcd501012d0 2024-02-28T16:16:16.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.570+0000 7fcd58200640 1 -- 172.21.15.57:0/3114175440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5010f1e0 con 0x7fcd501012d0 2024-02-28T16:16:16.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.570+0000 7fcd58200640 1 -- 172.21.15.57:0/3114175440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5010f700 con 0x7fcd501012d0 2024-02-28T16:16:16.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.572+0000 7fcd58200640 1 -- 172.21.15.57:0/3114175440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd50064030 con 0x7fcd501012d0 2024-02-28T16:16:16.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.573+0000 7fcd4d600640 1 -- 172.21.15.57:0/3114175440 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fcd3c02f070 con 0x7fcd501012d0 2024-02-28T16:16:16.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.575+0000 7fcd4d600640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcd3806d750 0x7fcd3806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:16.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.575+0000 7fcd4d600640 1 -- 172.21.15.57:0/3114175440 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fcd3c0af4c0 con 0x7fcd501012d0 2024-02-28T16:16:16.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.576+0000 7fcd55800640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcd3806d750 0x7fcd3806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:16.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.576+0000 7fcd55800640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcd3806d750 0x7fcd3806fc00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd44007e60 tx=0x7fcd44004bb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:16.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.580+0000 7fcd4d600640 1 -- 172.21.15.57:0/3114175440 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcd3c078b90 con 0x7fcd501012d0 2024-02-28T16:16:16.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.824+0000 7fcd58200640 1 -- 172.21.15.57:0/3114175440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7fcd5010f8e0 con 0x7fcd501012d0 2024-02-28T16:16:16.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.825+0000 7fcd4d600640 1 -- 172.21.15.57:0/3114175440 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v41) v1 ==== 107+0+4849 (secure 0 0 0) 0x7fcd3c07c250 con 0x7fcd501012d0 2024-02-28T16:16:16.817 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:16.817 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:00:39.195831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14452,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6827/1436733447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1436733447},{"type":"v1","addr":"172.21.15.57:6827","nonce":1436733447}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14464":{"gid":14464,"name":"cephfs.smithi057.qwatmu","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.57:6829/3864009326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3864009326},{"type":"v1","addr":"172.21.15.57:6829","nonce":3864009326}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi087.fzjgef","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6825/82197361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":82197361},{"type":"v1","addr":"172.21.15.87:6825","nonce":82197361}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24293":{"gid":24293,"name":"cephfs.smithi087.whebmo","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.87:6827/2094154189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2094154189},{"type":"v1","addr":"172.21.15.87:6827","nonce":2094154189}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:16.817 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 15 2024-02-28T16:16:16.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.828+0000 7fcd58200640 1 -- 172.21.15.57:0/3114175440 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcd3806d750 msgr2=0x7fcd3806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:16.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.828+0000 7fcd58200640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcd3806d750 0x7fcd3806fc00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd44007e60 tx=0x7fcd44004bb0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.828+0000 7fcd58200640 1 -- 172.21.15.57:0/3114175440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd501012d0 msgr2=0x7fcd501153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:16.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.828+0000 7fcd58200640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd501012d0 0x7fcd501153d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c031720 tx=0x7fcd3c009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.829+0000 7fcd58200640 1 -- 172.21.15.57:0/3114175440 shutdown_connections 2024-02-28T16:16:16.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.829+0000 7fcd58200640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fcd3806d750 0x7fcd3806fc00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.829+0000 7fcd58200640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd501012d0 0x7fcd501153d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.829+0000 7fcd58200640 1 --2- 172.21.15.57:0/3114175440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd500fb2b0 0x7fcd50114e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:16.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.829+0000 7fcd58200640 1 -- 172.21.15.57:0/3114175440 >> 172.21.15.57:0/3114175440 conn(0x7fcd50071230 msgr2=0x7fcd50064560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:16.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.829+0000 7fcd58200640 1 -- 172.21.15.57:0/3114175440 shutdown_connections 2024-02-28T16:16:16.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:16.829+0000 7fcd58200640 1 -- 172.21.15.57:0/3114175440 wait complete. 2024-02-28T16:16:16.839 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-02-28T16:16:16.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:16 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3527676061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:16:16.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:16 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/332316873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:16:17.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.065+0000 7f0b34c00640 1 -- 172.21.15.57:0/1797296247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b30102740 msgr2=0x7f0b30102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:17.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.065+0000 7f0b34c00640 1 --2- 172.21.15.57:0/1797296247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b30102740 0x7f0b30102bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0b180048d0 tx=0x7f0b18009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.065+0000 7f0b34c00640 1 -- 172.21.15.57:0/1797296247 shutdown_connections 2024-02-28T16:16:17.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.065+0000 7f0b34c00640 1 --2- 172.21.15.57:0/1797296247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b30102740 0x7f0b30102bb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.065+0000 7f0b34c00640 1 --2- 172.21.15.57:0/1797296247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30108760 0x7f0b30108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.065+0000 7f0b34c00640 1 -- 172.21.15.57:0/1797296247 >> 172.21.15.57:0/1797296247 conn(0x7f0b30071fc0 msgr2=0x7f0b300743d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:17.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.066+0000 7f0b34c00640 1 -- 172.21.15.57:0/1797296247 shutdown_connections 2024-02-28T16:16:17.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.066+0000 7f0b34c00640 1 -- 172.21.15.57:0/1797296247 wait complete. 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.066+0000 7f0b34c00640 1 Processor -- start 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.067+0000 7f0b34c00640 1 -- start start 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.067+0000 7f0b34c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30102740 0x7f0b301190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.067+0000 7f0b34c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b30108760 0x7f0b301195f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.067+0000 7f0b34c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b30119bf0 con 0x7f0b30108760 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.067+0000 7f0b34c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b30113180 con 0x7f0b30102740 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.067+0000 7f0b27e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b30108760 0x7f0b301195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.067+0000 7f0b27e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b30108760 0x7f0b301195f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39956/0 (socket says 172.21.15.57:39956) 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.067+0000 7f0b27e00640 1 -- 172.21.15.57:0/1084740738 learned_addr learned my addr 172.21.15.57:0/1084740738 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.068+0000 7f0b2f400640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30102740 0x7f0b301190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.068+0000 7f0b27e00640 1 -- 172.21.15.57:0/1084740738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30102740 msgr2=0x7f0b301190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:17.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.068+0000 7f0b27e00640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30102740 0x7f0b301190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.068+0000 7f0b27e00640 1 -- 172.21.15.57:0/1084740738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b18005040 con 0x7f0b30108760 2024-02-28T16:16:17.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.068+0000 7f0b2f400640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30102740 0x7f0b301190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:16:17.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.068+0000 7f0b27e00640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b30108760 0x7f0b301195f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0b18031720 tx=0x7f0b18009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:17.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.068+0000 7f0b27400640 1 -- 172.21.15.57:0/1084740738 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b180094c0 con 0x7f0b30108760 2024-02-28T16:16:17.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.068+0000 7f0b27400640 1 -- 172.21.15.57:0/1084740738 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b18009620 con 0x7f0b30108760 2024-02-28T16:16:17.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.068+0000 7f0b34c00640 1 -- 172.21.15.57:0/1084740738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b30113400 con 0x7f0b30108760 2024-02-28T16:16:17.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.068+0000 7f0b27400640 1 -- 172.21.15.57:0/1084740738 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b1803b640 con 0x7f0b30108760 2024-02-28T16:16:17.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.069+0000 7f0b34c00640 1 -- 172.21.15.57:0/1084740738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b30113920 con 0x7f0b30108760 2024-02-28T16:16:17.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.070+0000 7f0b34c00640 1 -- 172.21.15.57:0/1084740738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3004bcc0 con 0x7f0b30108760 2024-02-28T16:16:17.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.071+0000 7f0b27400640 1 -- 172.21.15.57:0/1084740738 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f0b1802f070 con 0x7f0b30108760 2024-02-28T16:16:17.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.071+0000 7f0b27400640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0b1406d750 0x7f0b1406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:17.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.072+0000 7f0b27400640 1 -- 172.21.15.57:0/1084740738 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f0b180af6c0 con 0x7f0b30108760 2024-02-28T16:16:17.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.072+0000 7f0b2f400640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0b1406d750 0x7f0b1406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:17.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.073+0000 7f0b2f400640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0b1406d750 0x7f0b1406fc00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b20004c80 tx=0x7f0b20009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:17.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.077+0000 7f0b27400640 1 -- 172.21.15.57:0/1084740738 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0b18078d10 con 0x7f0b30108760 2024-02-28T16:16:17.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:16 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3527676061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:16:17.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:16 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/332316873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:16:17.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.317+0000 7f0b34c00640 1 -- 172.21.15.57:0/1084740738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f0b30105980 con 0x7f0b30108760 2024-02-28T16:16:17.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.318+0000 7f0b27400640 1 -- 172.21.15.57:0/1084740738 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v41) v1 ==== 107+0+4850 (secure 0 0 0) 0x7f0b1807c3d0 con 0x7f0b30108760 2024-02-28T16:16:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:17.310 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:02:07.353165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14452,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6827/1436733447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1436733447},{"type":"v1","addr":"172.21.15.57:6827","nonce":1436733447}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14464":{"gid":14464,"name":"cephfs.smithi057.qwatmu","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.57:6829/3864009326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3864009326},{"type":"v1","addr":"172.21.15.57:6829","nonce":3864009326}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi087.fzjgef","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6825/82197361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":82197361},{"type":"v1","addr":"172.21.15.87:6825","nonce":82197361}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24293":{"gid":24293,"name":"cephfs.smithi087.whebmo","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.87:6827/2094154189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2094154189},{"type":"v1","addr":"172.21.15.87:6827","nonce":2094154189}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:17.310 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2024-02-28T16:16:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 -- 172.21.15.57:0/1084740738 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0b1406d750 msgr2=0x7f0b1406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0b1406d750 0x7f0b1406fc00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b20004c80 tx=0x7f0b20009040 comp rx=0 tx=0).stop 2024-02-28T16:16:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 -- 172.21.15.57:0/1084740738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b30108760 msgr2=0x7f0b301195f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b30108760 0x7f0b301195f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0b18031720 tx=0x7f0b18009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 -- 172.21.15.57:0/1084740738 shutdown_connections 2024-02-28T16:16:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f0b1406d750 0x7f0b1406fc00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b30108760 0x7f0b301195f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 --2- 172.21.15.57:0/1084740738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30102740 0x7f0b301190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 -- 172.21.15.57:0/1084740738 >> 172.21.15.57:0/1084740738 conn(0x7f0b30071fc0 msgr2=0x7f0b30074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 -- 172.21.15.57:0/1084740738 shutdown_connections 2024-02-28T16:16:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.321+0000 7f0b34c00640 1 -- 172.21.15.57:0/1084740738 wait complete. 2024-02-28T16:16:17.329 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-02-28T16:16:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.550+0000 7fda10200640 1 -- 172.21.15.57:0/1682407449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda08104e90 msgr2=0x7fda080fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.550+0000 7fda10200640 1 --2- 172.21.15.57:0/1682407449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda08104e90 0x7fda080fe5e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd9f40048d0 tx=0x7fd9f4009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.551+0000 7fda10200640 1 -- 172.21.15.57:0/1682407449 shutdown_connections 2024-02-28T16:16:17.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.551+0000 7fda10200640 1 --2- 172.21.15.57:0/1682407449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda08104e90 0x7fda080fe5e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.551+0000 7fda10200640 1 --2- 172.21.15.57:0/1682407449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda08104580 0x7fda08104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.551+0000 7fda10200640 1 -- 172.21.15.57:0/1682407449 >> 172.21.15.57:0/1682407449 conn(0x7fda080fa160 msgr2=0x7fda080fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.551+0000 7fda10200640 1 -- 172.21.15.57:0/1682407449 shutdown_connections 2024-02-28T16:16:17.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.551+0000 7fda10200640 1 -- 172.21.15.57:0/1682407449 wait complete. 2024-02-28T16:16:17.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.552+0000 7fda10200640 1 Processor -- start 2024-02-28T16:16:17.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.552+0000 7fda10200640 1 -- start start 2024-02-28T16:16:17.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.552+0000 7fda10200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda08104580 0x7fda08114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:17.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.552+0000 7fda10200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda08104e90 0x7fda08115310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.552+0000 7fda10200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda08115910 con 0x7fda08104e90 2024-02-28T16:16:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.552+0000 7fda10200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0810eea0 con 0x7fda08104580 2024-02-28T16:16:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.552+0000 7fda0ce00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda08104e90 0x7fda08115310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.552+0000 7fda0ce00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda08104e90 0x7fda08115310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39976/0 (socket says 172.21.15.57:39976) 2024-02-28T16:16:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.552+0000 7fda0ce00640 1 -- 172.21.15.57:0/2118480640 learned_addr learned my addr 172.21.15.57:0/2118480640 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.553+0000 7fda0d800640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda08104580 0x7fda08114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.553+0000 7fda0ce00640 1 -- 172.21.15.57:0/2118480640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda08104580 msgr2=0x7fda08114dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.553+0000 7fda0ce00640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda08104580 0x7fda08114dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.553+0000 7fda0ce00640 1 -- 172.21.15.57:0/2118480640 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4005040 con 0x7fda08104e90 2024-02-28T16:16:17.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.553+0000 7fda0ce00640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda08104e90 0x7fda08115310 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4034040 tx=0x7fd9f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:17.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.554+0000 7fda05600640 1 -- 172.21.15.57:0/2118480640 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9f40094c0 con 0x7fda08104e90 2024-02-28T16:16:17.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.554+0000 7fda05600640 1 -- 172.21.15.57:0/2118480640 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9f4009a80 con 0x7fda08104e90 2024-02-28T16:16:17.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.554+0000 7fda05600640 1 -- 172.21.15.57:0/2118480640 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9f403b400 con 0x7fda08104e90 2024-02-28T16:16:17.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.554+0000 7fda10200640 1 -- 172.21.15.57:0/2118480640 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0810f120 con 0x7fda08104e90 2024-02-28T16:16:17.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.554+0000 7fda10200640 1 -- 172.21.15.57:0/2118480640 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0810f640 con 0x7fda08104e90 2024-02-28T16:16:17.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.555+0000 7fda10200640 1 -- 172.21.15.57:0/2118480640 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda08064480 con 0x7fda08104e90 2024-02-28T16:16:17.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.556+0000 7fda05600640 1 -- 172.21.15.57:0/2118480640 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd9f402f070 con 0x7fda08104e90 2024-02-28T16:16:17.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.557+0000 7fda05600640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd9f006d750 0x7fd9f006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:17.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.557+0000 7fda05600640 1 -- 172.21.15.57:0/2118480640 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fd9f40af580 con 0x7fda08104e90 2024-02-28T16:16:17.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.557+0000 7fda0d800640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd9f006d750 0x7fd9f006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:17.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.558+0000 7fda0d800640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd9f006d750 0x7fd9f006fc00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009fd0 tx=0x7fd9fc009e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:17.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.562+0000 7fda05600640 1 -- 172.21.15.57:0/2118480640 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd9f4078bd0 con 0x7fda08104e90 2024-02-28T16:16:17.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.802+0000 7fda10200640 1 -- 172.21.15.57:0/2118480640 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fda08110460 con 0x7fda08104e90 2024-02-28T16:16:17.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.804+0000 7fda05600640 1 -- 172.21.15.57:0/2118480640 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v41) v1 ==== 107+0+4849 (secure 0 0 0) 0x7fd9f407c290 con 0x7fda08104e90 2024-02-28T16:16:17.796 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:17.796 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:06:27.266154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14452,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6827/1436733447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1436733447},{"type":"v1","addr":"172.21.15.57:6827","nonce":1436733447}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14464":{"gid":14464,"name":"cephfs.smithi057.qwatmu","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.57:6829/3864009326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3864009326},{"type":"v1","addr":"172.21.15.57:6829","nonce":3864009326}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi087.fzjgef","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6825/82197361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":82197361},{"type":"v1","addr":"172.21.15.87:6825","nonce":82197361}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24293":{"gid":24293,"name":"cephfs.smithi087.whebmo","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.87:6827/2094154189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2094154189},{"type":"v1","addr":"172.21.15.87:6827","nonce":2094154189}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:17.796 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 17 2024-02-28T16:16:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.807+0000 7fda10200640 1 -- 172.21.15.57:0/2118480640 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd9f006d750 msgr2=0x7fd9f006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.807+0000 7fda10200640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd9f006d750 0x7fd9f006fc00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009fd0 tx=0x7fd9fc009e50 comp rx=0 tx=0).stop 2024-02-28T16:16:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.807+0000 7fda10200640 1 -- 172.21.15.57:0/2118480640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda08104e90 msgr2=0x7fda08115310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.807+0000 7fda10200640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda08104e90 0x7fda08115310 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4034040 tx=0x7fd9f4009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.808+0000 7fda10200640 1 -- 172.21.15.57:0/2118480640 shutdown_connections 2024-02-28T16:16:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.808+0000 7fda10200640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd9f006d750 0x7fd9f006fc00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.808+0000 7fda10200640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda08104e90 0x7fda08115310 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.808+0000 7fda10200640 1 --2- 172.21.15.57:0/2118480640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda08104580 0x7fda08114dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:17.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.808+0000 7fda10200640 1 -- 172.21.15.57:0/2118480640 >> 172.21.15.57:0/2118480640 conn(0x7fda080fa160 msgr2=0x7fda080fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:17.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.808+0000 7fda10200640 1 -- 172.21.15.57:0/2118480640 shutdown_connections 2024-02-28T16:16:17.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:17.808+0000 7fda10200640 1 -- 172.21.15.57:0/2118480640 wait complete. 2024-02-28T16:16:17.818 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-02-28T16:16:18.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.046+0000 7ff2fca00640 1 -- 172.21.15.57:0/3846411352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2f8108760 msgr2=0x7ff2f8108b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.046+0000 7ff2fca00640 1 --2- 172.21.15.57:0/3846411352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2f8108760 0x7ff2f8108b30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80048d0 tx=0x7ff2e8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.046+0000 7ff2fca00640 1 -- 172.21.15.57:0/3846411352 shutdown_connections 2024-02-28T16:16:18.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.046+0000 7ff2fca00640 1 --2- 172.21.15.57:0/3846411352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f8102740 0x7ff2f8102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.046+0000 7ff2fca00640 1 --2- 172.21.15.57:0/3846411352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2f8108760 0x7ff2f8108b30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.046+0000 7ff2fca00640 1 -- 172.21.15.57:0/3846411352 >> 172.21.15.57:0/3846411352 conn(0x7ff2f8071fc0 msgr2=0x7ff2f80743d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:18.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.046+0000 7ff2fca00640 1 -- 172.21.15.57:0/3846411352 shutdown_connections 2024-02-28T16:16:18.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.046+0000 7ff2fca00640 1 -- 172.21.15.57:0/3846411352 wait complete. 2024-02-28T16:16:18.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.046+0000 7ff2fca00640 1 Processor -- start 2024-02-28T16:16:18.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.047+0000 7ff2fca00640 1 -- start start 2024-02-28T16:16:18.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.047+0000 7ff2fca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f8102740 0x7ff2f8119160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.047+0000 7ff2fca00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2f8108760 0x7ff2f81196a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.047+0000 7ff2fca00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8119ca0 con 0x7ff2f8108760 2024-02-28T16:16:18.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.047+0000 7ff2fca00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8113230 con 0x7ff2f8102740 2024-02-28T16:16:18.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.047+0000 7ff2f6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2f8108760 0x7ff2f81196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.047+0000 7ff2f6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2f8108760 0x7ff2f81196a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40000/0 (socket says 172.21.15.57:40000) 2024-02-28T16:16:18.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.047+0000 7ff2f6a00640 1 -- 172.21.15.57:0/1933104816 learned_addr learned my addr 172.21.15.57:0/1933104816 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:18.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.048+0000 7ff2f7400640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f8102740 0x7ff2f8119160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.048+0000 7ff2f6a00640 1 -- 172.21.15.57:0/1933104816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f8102740 msgr2=0x7ff2f8119160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.048+0000 7ff2f6a00640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f8102740 0x7ff2f8119160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.048+0000 7ff2f6a00640 1 -- 172.21.15.57:0/1933104816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e8005040 con 0x7ff2f8108760 2024-02-28T16:16:18.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.048+0000 7ff2f6a00640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2f8108760 0x7ff2f81196a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400db00 tx=0x7ff2e4004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:18.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.048+0000 7ff2ef400640 1 -- 172.21.15.57:0/1933104816 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e4017070 con 0x7ff2f8108760 2024-02-28T16:16:18.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.048+0000 7ff2ef400640 1 -- 172.21.15.57:0/1933104816 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2e400f040 con 0x7ff2f8108760 2024-02-28T16:16:18.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.048+0000 7ff2ef400640 1 -- 172.21.15.57:0/1933104816 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e4003ae0 con 0x7ff2f8108760 2024-02-28T16:16:18.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.048+0000 7ff2fca00640 1 -- 172.21.15.57:0/1933104816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f8113510 con 0x7ff2f8108760 2024-02-28T16:16:18.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.048+0000 7ff2fca00640 1 -- 172.21.15.57:0/1933104816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f81139e0 con 0x7ff2f8108760 2024-02-28T16:16:18.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.050+0000 7ff2fca00640 1 -- 172.21.15.57:0/1933104816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f804bcc0 con 0x7ff2f8108760 2024-02-28T16:16:18.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.051+0000 7ff2ef400640 1 -- 172.21.15.57:0/1933104816 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff2e4003c40 con 0x7ff2f8108760 2024-02-28T16:16:18.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.051+0000 7ff2ef400640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2dc06d760 0x7ff2dc06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.051+0000 7ff2ef400640 1 -- 172.21.15.57:0/1933104816 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ff2e408d200 con 0x7ff2f8108760 2024-02-28T16:16:18.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.052+0000 7ff2f7400640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2dc06d760 0x7ff2dc06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.052+0000 7ff2f7400640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2dc06d760 0x7ff2dc06fc10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8034040 tx=0x7ff2e8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:18.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.056+0000 7ff2ef400640 1 -- 172.21.15.57:0/1933104816 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff2e4056890 con 0x7ff2f8108760 2024-02-28T16:16:18.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:17 smithi057 ceph-mon[93219]: pgmap v408: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:18.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:17 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3114175440' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-02-28T16:16:18.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:17 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1084740738' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-28T16:16:18.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:17 smithi087 ceph-mon[82628]: pgmap v408: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:18.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:17 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3114175440' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-02-28T16:16:18.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:17 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1084740738' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-28T16:16:18.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.285+0000 7ff2fca00640 1 -- 172.21.15.57:0/1933104816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7ff2f81079e0 con 0x7ff2f8108760 2024-02-28T16:16:18.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.286+0000 7ff2ef400640 1 -- 172.21.15.57:0/1933104816 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v41) v1 ==== 107+0+4848 (secure 0 0 0) 0x7ff2e4059f50 con 0x7ff2f8108760 2024-02-28T16:16:18.278 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:18.278 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:06:28.521002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14452,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6827/1436733447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1436733447},{"type":"v1","addr":"172.21.15.57:6827","nonce":1436733447}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14464":{"gid":14464,"name":"cephfs.smithi057.qwatmu","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.57:6829/3864009326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3864009326},{"type":"v1","addr":"172.21.15.57:6829","nonce":3864009326}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi087.fzjgef","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6825/82197361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":82197361},{"type":"v1","addr":"172.21.15.87:6825","nonce":82197361}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24293":{"gid":24293,"name":"cephfs.smithi087.whebmo","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.87:6827/2094154189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2094154189},{"type":"v1","addr":"172.21.15.87:6827","nonce":2094154189}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:18.278 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-02-28T16:16:18.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 -- 172.21.15.57:0/1933104816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2dc06d760 msgr2=0x7ff2dc06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2dc06d760 0x7ff2dc06fc10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8034040 tx=0x7ff2e8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 -- 172.21.15.57:0/1933104816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2f8108760 msgr2=0x7ff2f81196a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2f8108760 0x7ff2f81196a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400db00 tx=0x7ff2e4004e60 comp rx=0 tx=0).stop 2024-02-28T16:16:18.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 -- 172.21.15.57:0/1933104816 shutdown_connections 2024-02-28T16:16:18.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2dc06d760 0x7ff2dc06fc10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2f8108760 0x7ff2f81196a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 --2- 172.21.15.57:0/1933104816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f8102740 0x7ff2f8119160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 -- 172.21.15.57:0/1933104816 >> 172.21.15.57:0/1933104816 conn(0x7ff2f8071fc0 msgr2=0x7ff2f8104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:18.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 -- 172.21.15.57:0/1933104816 shutdown_connections 2024-02-28T16:16:18.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.289+0000 7ff2fca00640 1 -- 172.21.15.57:0/1933104816 wait complete. 2024-02-28T16:16:18.300 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-28T16:16:18.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.524+0000 7f8f86400640 1 -- 172.21.15.57:0/2599036563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f80104cc0 msgr2=0x7f8f800fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.524+0000 7f8f86400640 1 --2- 172.21.15.57:0/2599036563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f80104cc0 0x7f8f800fe350 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8f700048d0 tx=0x7f8f70009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.525+0000 7f8f86400640 1 -- 172.21.15.57:0/2599036563 shutdown_connections 2024-02-28T16:16:18.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.525+0000 7f8f86400640 1 --2- 172.21.15.57:0/2599036563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f80104cc0 0x7f8f800fe350 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.525+0000 7f8f86400640 1 --2- 172.21.15.57:0/2599036563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f80104320 0x7f8f801046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.525+0000 7f8f86400640 1 -- 172.21.15.57:0/2599036563 >> 172.21.15.57:0/2599036563 conn(0x7f8f800f9f90 msgr2=0x7f8f800fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:18.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.525+0000 7f8f86400640 1 -- 172.21.15.57:0/2599036563 shutdown_connections 2024-02-28T16:16:18.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.525+0000 7f8f86400640 1 -- 172.21.15.57:0/2599036563 wait complete. 2024-02-28T16:16:18.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.525+0000 7f8f86400640 1 Processor -- start 2024-02-28T16:16:18.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.526+0000 7f8f86400640 1 -- start start 2024-02-28T16:16:18.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.526+0000 7f8f86400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f80104320 0x7f8f80114ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.526+0000 7f8f86400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f80104cc0 0x7f8f801150e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.526+0000 7f8f86400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f801156e0 con 0x7f8f80104cc0 2024-02-28T16:16:18.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.526+0000 7f8f86400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8010ecc0 con 0x7f8f80104320 2024-02-28T16:16:18.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.526+0000 7f8f7fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f80104cc0 0x7f8f801150e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.526+0000 7f8f7fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f80104cc0 0x7f8f801150e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40016/0 (socket says 172.21.15.57:40016) 2024-02-28T16:16:18.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.526+0000 7f8f7fe00640 1 -- 172.21.15.57:0/2251969137 learned_addr learned my addr 172.21.15.57:0/2251969137 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:18.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.527+0000 7f8f85000640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f80104320 0x7f8f80114ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.527+0000 7f8f7fe00640 1 -- 172.21.15.57:0/2251969137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f80104320 msgr2=0x7f8f80114ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.527+0000 7f8f7fe00640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f80104320 0x7f8f80114ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.527+0000 7f8f7fe00640 1 -- 172.21.15.57:0/2251969137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f70005040 con 0x7f8f80104cc0 2024-02-28T16:16:18.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.527+0000 7f8f7fe00640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f80104cc0 0x7f8f801150e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8f7002bda0 tx=0x7f8f70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:18.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.527+0000 7f8f7cc00640 1 -- 172.21.15.57:0/2251969137 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f700094c0 con 0x7f8f80104cc0 2024-02-28T16:16:18.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.528+0000 7f8f7cc00640 1 -- 172.21.15.57:0/2251969137 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f70032e50 con 0x7f8f80104cc0 2024-02-28T16:16:18.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.528+0000 7f8f86400640 1 -- 172.21.15.57:0/2251969137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8010ef40 con 0x7f8f80104cc0 2024-02-28T16:16:18.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.528+0000 7f8f7cc00640 1 -- 172.21.15.57:0/2251969137 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f700435f0 con 0x7f8f80104cc0 2024-02-28T16:16:18.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.528+0000 7f8f86400640 1 -- 172.21.15.57:0/2251969137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8010f400 con 0x7f8f80104cc0 2024-02-28T16:16:18.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.529+0000 7f8f86400640 1 -- 172.21.15.57:0/2251969137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8004bcc0 con 0x7f8f80104cc0 2024-02-28T16:16:18.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.530+0000 7f8f7cc00640 1 -- 172.21.15.57:0/2251969137 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f8f7002f070 con 0x7f8f80104cc0 2024-02-28T16:16:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.531+0000 7f8f7cc00640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f6806d760 0x7f8f6806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.531+0000 7f8f7cc00640 1 -- 172.21.15.57:0/2251969137 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f8f700aefe0 con 0x7f8f80104cc0 2024-02-28T16:16:18.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.531+0000 7f8f85000640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f6806d760 0x7f8f6806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.532+0000 7f8f85000640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f6806d760 0x7f8f6806fc10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f74007fd0 tx=0x7f8f74009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:18.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.536+0000 7f8f7cc00640 1 -- 172.21.15.57:0/2251969137 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8f70078690 con 0x7f8f80104cc0 2024-02-28T16:16:18.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.780+0000 7f8f86400640 1 -- 172.21.15.57:0/2251969137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f8f801101a0 con 0x7f8f80104cc0 2024-02-28T16:16:18.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.781+0000 7f8f7cc00640 1 -- 172.21.15.57:0/2251969137 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v41) v1 ==== 107+0+3277 (secure 0 0 0) 0x7f8f7003fce0 con 0x7f8f80104cc0 2024-02-28T16:16:18.773 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:18.773 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:10:08.187138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14452,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6827/1436733447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1436733447},{"type":"v1","addr":"172.21.15.57:6827","nonce":1436733447}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi087.fzjgef","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6825/82197361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":82197361},{"type":"v1","addr":"172.21.15.87:6825","nonce":82197361}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:18.773 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 19 2024-02-28T16:16:18.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 -- 172.21.15.57:0/2251969137 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f6806d760 msgr2=0x7f8f6806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f6806d760 0x7f8f6806fc10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f74007fd0 tx=0x7f8f74009e90 comp rx=0 tx=0).stop 2024-02-28T16:16:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 -- 172.21.15.57:0/2251969137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f80104cc0 msgr2=0x7f8f801150e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f80104cc0 0x7f8f801150e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8f7002bda0 tx=0x7f8f70009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 -- 172.21.15.57:0/2251969137 shutdown_connections 2024-02-28T16:16:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8f6806d760 0x7f8f6806fc10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f80104cc0 0x7f8f801150e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 --2- 172.21.15.57:0/2251969137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f80104320 0x7f8f80114ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 -- 172.21.15.57:0/2251969137 >> 172.21.15.57:0/2251969137 conn(0x7f8f800f9f90 msgr2=0x7f8f800fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 -- 172.21.15.57:0/2251969137 shutdown_connections 2024-02-28T16:16:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:18.784+0000 7f8f86400640 1 -- 172.21.15.57:0/2251969137 wait complete. 2024-02-28T16:16:18.794 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-02-28T16:16:18.794 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-28T16:16:18.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.000+0000 7f1e42c00640 1 -- 172.21.15.57:0/541149901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e3c102d00 msgr2=0x7f1e3c0fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.000+0000 7f1e42c00640 1 --2- 172.21.15.57:0/541149901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e3c102d00 0x7f1e3c0fc390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009c50 tx=0x7f1e2c004d10 comp rx=0 tx=0).stop 2024-02-28T16:16:18.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.000+0000 7f1e42c00640 1 -- 172.21.15.57:0/541149901 shutdown_connections 2024-02-28T16:16:18.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.000+0000 7f1e42c00640 1 --2- 172.21.15.57:0/541149901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e3c102d00 0x7f1e3c0fc390 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.000+0000 7f1e42c00640 1 --2- 172.21.15.57:0/541149901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c102360 0x7f1e3c102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.001+0000 7f1e42c00640 1 -- 172.21.15.57:0/541149901 >> 172.21.15.57:0/541149901 conn(0x7f1e3c0f7ef0 msgr2=0x7f1e3c0fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:18.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.001+0000 7f1e42c00640 1 -- 172.21.15.57:0/541149901 shutdown_connections 2024-02-28T16:16:18.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.001+0000 7f1e42c00640 1 -- 172.21.15.57:0/541149901 wait complete. 2024-02-28T16:16:18.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.001+0000 7f1e42c00640 1 Processor -- start 2024-02-28T16:16:18.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.002+0000 7f1e42c00640 1 -- start start 2024-02-28T16:16:18.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.002+0000 7f1e42c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c102360 0x7f1e3c114d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.002+0000 7f1e42c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e3c102d00 0x7f1e3c1152d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.002+0000 7f1e42c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c1158d0 con 0x7f1e3c102d00 2024-02-28T16:16:18.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.002+0000 7f1e42c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c10ee60 con 0x7f1e3c102360 2024-02-28T16:16:18.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.002+0000 7f1e3b400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e3c102d00 0x7f1e3c1152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.002+0000 7f1e3b400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e3c102d00 0x7f1e3c1152d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40028/0 (socket says 172.21.15.57:40028) 2024-02-28T16:16:18.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.002+0000 7f1e3b400640 1 -- 172.21.15.57:0/974885627 learned_addr learned my addr 172.21.15.57:0/974885627 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:18.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.003+0000 7f1e3be00640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c102360 0x7f1e3c114d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.003+0000 7f1e3b400640 1 -- 172.21.15.57:0/974885627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c102360 msgr2=0x7f1e3c114d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.003+0000 7f1e3b400640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c102360 0x7f1e3c114d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.003+0000 7f1e3b400640 1 -- 172.21.15.57:0/974885627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c0098b0 con 0x7f1e3c102d00 2024-02-28T16:16:18.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.003+0000 7f1e3b400640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e3c102d00 0x7f1e3c1152d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c000f80 tx=0x7f1e2c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:18.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.004+0000 7f1e33e00640 1 -- 172.21.15.57:0/974885627 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e2c03a070 con 0x7f1e3c102d00 2024-02-28T16:16:18.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.004+0000 7f1e33e00640 1 -- 172.21.15.57:0/974885627 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e2c035b20 con 0x7f1e3c102d00 2024-02-28T16:16:18.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.004+0000 7f1e42c00640 1 -- 172.21.15.57:0/974885627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c10f0e0 con 0x7f1e3c102d00 2024-02-28T16:16:18.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.004+0000 7f1e33e00640 1 -- 172.21.15.57:0/974885627 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e2c03eb20 con 0x7f1e3c102d00 2024-02-28T16:16:18.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.004+0000 7f1e42c00640 1 -- 172.21.15.57:0/974885627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c10f680 con 0x7f1e3c102d00 2024-02-28T16:16:18.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.005+0000 7f1e42c00640 1 -- 172.21.15.57:0/974885627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c064480 con 0x7f1e3c102d00 2024-02-28T16:16:18.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.006+0000 7f1e33e00640 1 -- 172.21.15.57:0/974885627 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1e2c032070 con 0x7f1e3c102d00 2024-02-28T16:16:18.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.007+0000 7f1e33e00640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e2006d760 0x7f1e2006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.007+0000 7f1e33e00640 1 -- 172.21.15.57:0/974885627 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f1e2c0af370 con 0x7f1e3c102d00 2024-02-28T16:16:18.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.007+0000 7f1e3be00640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e2006d760 0x7f1e2006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.008+0000 7f1e3be00640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e2006d760 0x7f1e2006fc10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e240041d0 tx=0x7f1e24009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.012+0000 7f1e33e00640 1 -- 172.21.15.57:0/974885627 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1e2c078a60 con 0x7f1e3c102d00 2024-02-28T16:16:19.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:18 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2118480640' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-28T16:16:19.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:18 smithi057 ceph-mon[93219]: pgmap v409: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:19.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:18 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1933104816' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-28T16:16:19.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:18 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2118480640' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-28T16:16:19.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:18 smithi087 ceph-mon[82628]: pgmap v409: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:19.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:18 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1933104816' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-28T16:16:19.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.251+0000 7f1e42c00640 1 -- 172.21.15.57:0/974885627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f1e3c10f8a0 con 0x7f1e3c102d00 2024-02-28T16:16:19.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.253+0000 7f1e33e00640 1 -- 172.21.15.57:0/974885627 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v41) v1 ==== 107+0+4834 (secure 0 0 0) 0x7f1e2c035c90 con 0x7f1e3c102d00 2024-02-28T16:16:19.244 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:19.245 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34456,"name":"cephfs.smithi057.qwatmu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6829/3861545073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3861545073},{"type":"v1","addr":"172.21.15.57:6829","nonce":3861545073}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:10:09.504527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14452,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6827/1436733447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1436733447},{"type":"v1","addr":"172.21.15.57:6827","nonce":1436733447}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi087.fzjgef","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6825/82197361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":82197361},{"type":"v1","addr":"172.21.15.87:6825","nonce":82197361}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:19.245 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 20 2024-02-28T16:16:19.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.255+0000 7f1e42c00640 1 -- 172.21.15.57:0/974885627 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e2006d760 msgr2=0x7f1e2006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:19.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.256+0000 7f1e42c00640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e2006d760 0x7f1e2006fc10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e240041d0 tx=0x7f1e24009040 comp rx=0 tx=0).stop 2024-02-28T16:16:19.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.256+0000 7f1e42c00640 1 -- 172.21.15.57:0/974885627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e3c102d00 msgr2=0x7f1e3c1152d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:19.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.256+0000 7f1e42c00640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e3c102d00 0x7f1e3c1152d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c000f80 tx=0x7f1e2c004d10 comp rx=0 tx=0).stop 2024-02-28T16:16:19.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.256+0000 7f1e42c00640 1 -- 172.21.15.57:0/974885627 shutdown_connections 2024-02-28T16:16:19.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.256+0000 7f1e42c00640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1e2006d760 0x7f1e2006fc10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.256+0000 7f1e42c00640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e3c102d00 0x7f1e3c1152d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.256+0000 7f1e42c00640 1 --2- 172.21.15.57:0/974885627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c102360 0x7f1e3c114d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.256+0000 7f1e42c00640 1 -- 172.21.15.57:0/974885627 >> 172.21.15.57:0/974885627 conn(0x7f1e3c0f7ef0 msgr2=0x7f1e3c0f97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:19.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.256+0000 7f1e42c00640 1 -- 172.21.15.57:0/974885627 shutdown_connections 2024-02-28T16:16:19.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.256+0000 7f1e42c00640 1 -- 172.21.15.57:0/974885627 wait complete. 2024-02-28T16:16:19.266 DEBUG:tasks.fs:max_mds reduced in epoch 20 2024-02-28T16:16:19.266 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-02-28T16:16:19.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-28T16:16:19.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.492+0000 7ffb8b600640 1 -- 172.21.15.57:0/1368651242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb84102360 msgr2=0x7ffb84102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:19.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.492+0000 7ffb8b600640 1 --2- 172.21.15.57:0/1368651242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb84102360 0x7ffb84102730 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffb780048d0 tx=0x7ffb78009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.492+0000 7ffb8b600640 1 -- 172.21.15.57:0/1368651242 shutdown_connections 2024-02-28T16:16:19.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.492+0000 7ffb8b600640 1 --2- 172.21.15.57:0/1368651242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb84102d00 0x7ffb840fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.492+0000 7ffb8b600640 1 --2- 172.21.15.57:0/1368651242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb84102360 0x7ffb84102730 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.492+0000 7ffb8b600640 1 -- 172.21.15.57:0/1368651242 >> 172.21.15.57:0/1368651242 conn(0x7ffb840f7ef0 msgr2=0x7ffb840fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:19.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.492+0000 7ffb8b600640 1 -- 172.21.15.57:0/1368651242 shutdown_connections 2024-02-28T16:16:19.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.492+0000 7ffb8b600640 1 -- 172.21.15.57:0/1368651242 wait complete. 2024-02-28T16:16:19.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.493+0000 7ffb8b600640 1 Processor -- start 2024-02-28T16:16:19.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.493+0000 7ffb8b600640 1 -- start start 2024-02-28T16:16:19.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.493+0000 7ffb8b600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb84102360 0x7ffb84114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:19.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.493+0000 7ffb8b600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb84102d00 0x7ffb84115310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.493+0000 7ffb8b600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84115910 con 0x7ffb84102360 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.493+0000 7ffb8b600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8410ef40 con 0x7ffb84102d00 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.494+0000 7ffb88c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb84102360 0x7ffb84114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.494+0000 7ffb88c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb84102360 0x7ffb84114dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40036/0 (socket says 172.21.15.57:40036) 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.494+0000 7ffb88c00640 1 -- 172.21.15.57:0/323004004 learned_addr learned my addr 172.21.15.57:0/323004004 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.494+0000 7ffb83e00640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb84102d00 0x7ffb84115310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.494+0000 7ffb88c00640 1 -- 172.21.15.57:0/323004004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb84102d00 msgr2=0x7ffb84115310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.494+0000 7ffb88c00640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb84102d00 0x7ffb84115310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.494+0000 7ffb88c00640 1 -- 172.21.15.57:0/323004004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb78005040 con 0x7ffb84102360 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.494+0000 7ffb83e00640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb84102d00 0x7ffb84115310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.494+0000 7ffb88c00640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb84102360 0x7ffb84114dd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffb7802bda0 tx=0x7ffb78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.495+0000 7ffb80c00640 1 -- 172.21.15.57:0/323004004 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb780094c0 con 0x7ffb84102360 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.495+0000 7ffb80c00640 1 -- 172.21.15.57:0/323004004 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb78032e50 con 0x7ffb84102360 2024-02-28T16:16:19.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.495+0000 7ffb80c00640 1 -- 172.21.15.57:0/323004004 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb780435f0 con 0x7ffb84102360 2024-02-28T16:16:19.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.495+0000 7ffb8b600640 1 -- 172.21.15.57:0/323004004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8410f1c0 con 0x7ffb84102360 2024-02-28T16:16:19.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.495+0000 7ffb8b600640 1 -- 172.21.15.57:0/323004004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8410f680 con 0x7ffb84102360 2024-02-28T16:16:19.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.496+0000 7ffb8b600640 1 -- 172.21.15.57:0/323004004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb84064480 con 0x7ffb84102360 2024-02-28T16:16:19.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.497+0000 7ffb80c00640 1 -- 172.21.15.57:0/323004004 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ffb7802f070 con 0x7ffb84102360 2024-02-28T16:16:19.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.498+0000 7ffb80c00640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffb6c06d760 0x7ffb6c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:19.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.498+0000 7ffb80c00640 1 -- 172.21.15.57:0/323004004 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ffb780aef80 con 0x7ffb84102360 2024-02-28T16:16:19.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.498+0000 7ffb83e00640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffb6c06d760 0x7ffb6c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:19.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.499+0000 7ffb83e00640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffb6c06d760 0x7ffb6c06fc10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffb84110690 tx=0x7ffb7000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:19.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.503+0000 7ffb80c00640 1 -- 172.21.15.57:0/323004004 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffb780785d0 con 0x7ffb84102360 2024-02-28T16:16:19.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.746+0000 7ffb8b600640 1 -- 172.21.15.57:0/323004004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7ffb8410f8f0 con 0x7ffb84102360 2024-02-28T16:16:19.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.747+0000 7ffb80c00640 1 -- 172.21.15.57:0/323004004 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v41) v1 ==== 107+0+4836 (secure 0 0 0) 0x7ffb7807bc90 con 0x7ffb84102360 2024-02-28T16:16:19.739 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:19.739 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34456,"name":"cephfs.smithi057.qwatmu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6829/3861545073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3861545073},{"type":"v1","addr":"172.21.15.57:6829","nonce":3861545073}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:10:10.216763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14452,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6827/1436733447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1436733447},{"type":"v1","addr":"172.21.15.57:6827","nonce":1436733447}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi087.fzjgef","rank":1,"incarnation":7,"state":"up:stopping","state_seq":5,"addr":"172.21.15.87:6825/82197361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":82197361},{"type":"v1","addr":"172.21.15.87:6825","nonce":82197361}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:19.739 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 21 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.750+0000 7ffb8b600640 1 -- 172.21.15.57:0/323004004 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffb6c06d760 msgr2=0x7ffb6c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.750+0000 7ffb8b600640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffb6c06d760 0x7ffb6c06fc10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffb84110690 tx=0x7ffb7000b040 comp rx=0 tx=0).stop 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.750+0000 7ffb8b600640 1 -- 172.21.15.57:0/323004004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb84102360 msgr2=0x7ffb84114dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.750+0000 7ffb8b600640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb84102360 0x7ffb84114dd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffb7802bda0 tx=0x7ffb78009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.750+0000 7ffb8b600640 1 -- 172.21.15.57:0/323004004 shutdown_connections 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.750+0000 7ffb8b600640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffb6c06d760 0x7ffb6c06fc10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.750+0000 7ffb8b600640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb84102d00 0x7ffb84115310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.750+0000 7ffb8b600640 1 --2- 172.21.15.57:0/323004004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb84102360 0x7ffb84114dd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.750+0000 7ffb8b600640 1 -- 172.21.15.57:0/323004004 >> 172.21.15.57:0/323004004 conn(0x7ffb840f7ef0 msgr2=0x7ffb840f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.750+0000 7ffb8b600640 1 -- 172.21.15.57:0/323004004 shutdown_connections 2024-02-28T16:16:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.751+0000 7ffb8b600640 1 -- 172.21.15.57:0/323004004 wait complete. 2024-02-28T16:16:19.760 DEBUG:tasks.fs:max_mds reduced in epoch 21 2024-02-28T16:16:19.760 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-02-28T16:16:19.761 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-28T16:16:19.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.982+0000 7fce23200640 1 -- 172.21.15.57:0/2022812656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce240722e0 msgr2=0x7fce2410cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.982+0000 7fce23200640 1 --2- 172.21.15.57:0/2022812656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce240722e0 0x7fce2410cba0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fce100048d0 tx=0x7fce10009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.982+0000 7fce23200640 1 -- 172.21.15.57:0/2022812656 shutdown_connections 2024-02-28T16:16:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.982+0000 7fce23200640 1 --2- 172.21.15.57:0/2022812656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce240722e0 0x7fce2410cba0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.982+0000 7fce23200640 1 --2- 172.21.15.57:0/2022812656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce240719d0 0x7fce24071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.982+0000 7fce23200640 1 -- 172.21.15.57:0/2022812656 >> 172.21.15.57:0/2022812656 conn(0x7fce240fa020 msgr2=0x7fce240fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.982+0000 7fce23200640 1 -- 172.21.15.57:0/2022812656 shutdown_connections 2024-02-28T16:16:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.982+0000 7fce23200640 1 -- 172.21.15.57:0/2022812656 wait complete. 2024-02-28T16:16:19.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.983+0000 7fce23200640 1 Processor -- start 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.983+0000 7fce23200640 1 -- start start 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.983+0000 7fce23200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce240719d0 0x7fce24119090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.983+0000 7fce23200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce240722e0 0x7fce241195d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.983+0000 7fce23200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce24119bd0 con 0x7fce240722e0 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.983+0000 7fce23200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce24113160 con 0x7fce240719d0 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.984+0000 7fce21400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce240722e0 0x7fce241195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.984+0000 7fce21400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce240722e0 0x7fce241195d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40064/0 (socket says 172.21.15.57:40064) 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.984+0000 7fce21400640 1 -- 172.21.15.57:0/211734161 learned_addr learned my addr 172.21.15.57:0/211734161 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.984+0000 7fce21e00640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce240719d0 0x7fce24119090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.984+0000 7fce21400640 1 -- 172.21.15.57:0/211734161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce240719d0 msgr2=0x7fce24119090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.984+0000 7fce21400640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce240719d0 0x7fce24119090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.984+0000 7fce21400640 1 -- 172.21.15.57:0/211734161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce10005040 con 0x7fce240722e0 2024-02-28T16:16:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.985+0000 7fce21400640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce240722e0 0x7fce241195d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fce10003080 tx=0x7fce10009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:19.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.985+0000 7fce1a000640 1 -- 172.21.15.57:0/211734161 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce100092e0 con 0x7fce240722e0 2024-02-28T16:16:19.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.985+0000 7fce1a000640 1 -- 172.21.15.57:0/211734161 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce10009440 con 0x7fce240722e0 2024-02-28T16:16:19.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.985+0000 7fce23200640 1 -- 172.21.15.57:0/211734161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce241133e0 con 0x7fce240722e0 2024-02-28T16:16:19.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.985+0000 7fce1a000640 1 -- 172.21.15.57:0/211734161 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce1003a5f0 con 0x7fce240722e0 2024-02-28T16:16:19.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.985+0000 7fce23200640 1 -- 172.21.15.57:0/211734161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce24113900 con 0x7fce240722e0 2024-02-28T16:16:19.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.987+0000 7fce23200640 1 -- 172.21.15.57:0/211734161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2404bcc0 con 0x7fce240722e0 2024-02-28T16:16:19.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.987+0000 7fce1a000640 1 -- 172.21.15.57:0/211734161 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fce1003b420 con 0x7fce240722e0 2024-02-28T16:16:19.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.988+0000 7fce1a000640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fce0806d750 0x7fce0806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:19.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.988+0000 7fce1a000640 1 -- 172.21.15.57:0/211734161 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fce100aff20 con 0x7fce240722e0 2024-02-28T16:16:19.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.989+0000 7fce21e00640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fce0806d750 0x7fce0806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:19.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.989+0000 7fce21e00640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fce0806d750 0x7fce0806fc00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce14004c40 tx=0x7fce14009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:19.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:19.993+0000 7fce1a000640 1 -- 172.21.15.57:0/211734161 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fce100e3d20 con 0x7fce240722e0 2024-02-28T16:16:20.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:19 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2251969137' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-28T16:16:20.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:20.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:19 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/974885627' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-28T16:16:20.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:19 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2251969137' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-28T16:16:20.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:20.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:19 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/974885627' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-28T16:16:20.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.233+0000 7fce23200640 1 -- 172.21.15.57:0/211734161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fce2410a270 con 0x7fce240722e0 2024-02-28T16:16:20.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.235+0000 7fce1a000640 1 -- 172.21.15.57:0/211734161 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v41) v1 ==== 107+0+4047 (secure 0 0 0) 0x7fce10079690 con 0x7fce240722e0 2024-02-28T16:16:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:20.226 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34456,"name":"cephfs.smithi057.qwatmu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6829/3861545073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3861545073},{"type":"v1","addr":"172.21.15.57:6829","nonce":3861545073}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:10:32.273940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14452},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6827/1436733447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1436733447},{"type":"v1","addr":"172.21.15.57:6827","nonce":1436733447}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:20.226 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 22 2024-02-28T16:16:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.237+0000 7fce23200640 1 -- 172.21.15.57:0/211734161 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fce0806d750 msgr2=0x7fce0806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.237+0000 7fce23200640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fce0806d750 0x7fce0806fc00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce14004c40 tx=0x7fce14009040 comp rx=0 tx=0).stop 2024-02-28T16:16:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.237+0000 7fce23200640 1 -- 172.21.15.57:0/211734161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce240722e0 msgr2=0x7fce241195d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.237+0000 7fce23200640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce240722e0 0x7fce241195d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fce10003080 tx=0x7fce10009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.237+0000 7fce23200640 1 -- 172.21.15.57:0/211734161 shutdown_connections 2024-02-28T16:16:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.237+0000 7fce23200640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fce0806d750 0x7fce0806fc00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.237+0000 7fce23200640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce240722e0 0x7fce241195d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.238+0000 7fce23200640 1 --2- 172.21.15.57:0/211734161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce240719d0 0x7fce24119090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.238+0000 7fce23200640 1 -- 172.21.15.57:0/211734161 >> 172.21.15.57:0/211734161 conn(0x7fce240fa020 msgr2=0x7fce240fac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:20.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.238+0000 7fce23200640 1 -- 172.21.15.57:0/211734161 shutdown_connections 2024-02-28T16:16:20.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.238+0000 7fce23200640 1 -- 172.21.15.57:0/211734161 wait complete. 2024-02-28T16:16:20.247 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-02-28T16:16:20.247 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-02-28T16:16:20.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-28T16:16:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.480+0000 7f7214a00640 1 -- 172.21.15.57:0/3388484550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210104c80 msgr2=0x7f72100fe310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.480+0000 7f7214a00640 1 --2- 172.21.15.57:0/3388484550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210104c80 0x7f72100fe310 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f71f80048d0 tx=0x7f71f8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.480+0000 7f7214a00640 1 -- 172.21.15.57:0/3388484550 shutdown_connections 2024-02-28T16:16:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.480+0000 7f7214a00640 1 --2- 172.21.15.57:0/3388484550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210104c80 0x7f72100fe310 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.480+0000 7f7214a00640 1 --2- 172.21.15.57:0/3388484550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72101042e0 0x7f72101046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.480+0000 7f7214a00640 1 -- 172.21.15.57:0/3388484550 >> 172.21.15.57:0/3388484550 conn(0x7f72100f9f90 msgr2=0x7f72100fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.480+0000 7f7214a00640 1 -- 172.21.15.57:0/3388484550 shutdown_connections 2024-02-28T16:16:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.480+0000 7f7214a00640 1 -- 172.21.15.57:0/3388484550 wait complete. 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.481+0000 7f7214a00640 1 Processor -- start 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.481+0000 7f7214a00640 1 -- start start 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f7214a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72101042e0 0x7f7210114be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f7214a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210104c80 0x7f7210115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f7214a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7210115720 con 0x7f7210104c80 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f7214a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721010ecb0 con 0x7f72101042e0 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f7205e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210104c80 0x7f7210115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f7205e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210104c80 0x7f7210115120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40094/0 (socket says 172.21.15.57:40094) 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f7205e00640 1 -- 172.21.15.57:0/1908739759 learned_addr learned my addr 172.21.15.57:0/1908739759 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f720e800640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72101042e0 0x7f7210114be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f7205e00640 1 -- 172.21.15.57:0/1908739759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72101042e0 msgr2=0x7f7210114be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f7205e00640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72101042e0 0x7f7210114be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.482+0000 7f7205e00640 1 -- 172.21.15.57:0/1908739759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f8005040 con 0x7f7210104c80 2024-02-28T16:16:20.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.483+0000 7f7205e00640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210104c80 0x7f7210115120 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f71f802bda0 tx=0x7f71f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:20.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.483+0000 7f7207400640 1 -- 172.21.15.57:0/1908739759 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71f80094c0 con 0x7f7210104c80 2024-02-28T16:16:20.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.483+0000 7f7207400640 1 -- 172.21.15.57:0/1908739759 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71f8032e50 con 0x7f7210104c80 2024-02-28T16:16:20.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.483+0000 7f7207400640 1 -- 172.21.15.57:0/1908739759 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71f80435f0 con 0x7f7210104c80 2024-02-28T16:16:20.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.483+0000 7f7214a00640 1 -- 172.21.15.57:0/1908739759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721010ef30 con 0x7f7210104c80 2024-02-28T16:16:20.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.483+0000 7f7214a00640 1 -- 172.21.15.57:0/1908739759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721010f3f0 con 0x7f7210104c80 2024-02-28T16:16:20.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.485+0000 7f7214a00640 1 -- 172.21.15.57:0/1908739759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721004bcc0 con 0x7f7210104c80 2024-02-28T16:16:20.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.485+0000 7f7207400640 1 -- 172.21.15.57:0/1908739759 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f71f802f070 con 0x7f7210104c80 2024-02-28T16:16:20.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.486+0000 7f7207400640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f71f406d760 0x7f71f406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:20.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.486+0000 7f7207400640 1 -- 172.21.15.57:0/1908739759 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f71f80aef10 con 0x7f7210104c80 2024-02-28T16:16:20.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.487+0000 7f720e800640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f71f406d760 0x7f71f406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:20.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.487+0000 7f720e800640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f71f406d760 0x7f71f406fc10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7200007fd0 tx=0x7f7200009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:20.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.491+0000 7f7207400640 1 -- 172.21.15.57:0/1908739759 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f71f8078600 con 0x7f7210104c80 2024-02-28T16:16:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.734+0000 7f7214a00640 1 -- 172.21.15.57:0/1908739759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f72101101e0 con 0x7f7210104c80 2024-02-28T16:16:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.735+0000 7f7207400640 1 -- 172.21.15.57:0/1908739759 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v41) v1 ==== 107+0+4823 (secure 0 0 0) 0x7f71f807bcc0 con 0x7f7210104c80 2024-02-28T16:16:20.727 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:20.727 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34456,"name":"cephfs.smithi057.qwatmu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6829/3861545073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3861545073},{"type":"v1","addr":"172.21.15.57:6829","nonce":3861545073}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:10:32.273940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14452},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6827/1436733447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1436733447},{"type":"v1","addr":"172.21.15.57:6827","nonce":1436733447}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 23 2024-02-28T16:16:20.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.738+0000 7f7214a00640 1 -- 172.21.15.57:0/1908739759 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f71f406d760 msgr2=0x7f71f406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.738+0000 7f7214a00640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f71f406d760 0x7f71f406fc10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7200007fd0 tx=0x7f7200009e90 comp rx=0 tx=0).stop 2024-02-28T16:16:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.738+0000 7f7214a00640 1 -- 172.21.15.57:0/1908739759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210104c80 msgr2=0x7f7210115120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.738+0000 7f7214a00640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210104c80 0x7f7210115120 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f71f802bda0 tx=0x7f71f8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.739+0000 7f7214a00640 1 -- 172.21.15.57:0/1908739759 shutdown_connections 2024-02-28T16:16:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.739+0000 7f7214a00640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f71f406d760 0x7f71f406fc10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.739+0000 7f7214a00640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210104c80 0x7f7210115120 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.739+0000 7f7214a00640 1 --2- 172.21.15.57:0/1908739759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72101042e0 0x7f7210114be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.739+0000 7f7214a00640 1 -- 172.21.15.57:0/1908739759 >> 172.21.15.57:0/1908739759 conn(0x7f72100f9f90 msgr2=0x7f72100fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.739+0000 7f7214a00640 1 -- 172.21.15.57:0/1908739759 shutdown_connections 2024-02-28T16:16:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.739+0000 7f7214a00640 1 -- 172.21.15.57:0/1908739759 wait complete. 2024-02-28T16:16:20.749 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-02-28T16:16:20.749 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-02-28T16:16:20.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-28T16:16:20.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.973+0000 7ff8a3200640 1 -- 172.21.15.57:0/721711616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8a4104320 msgr2=0x7ff8a41046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:20.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.973+0000 7ff8a3200640 1 --2- 172.21.15.57:0/721711616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8a4104320 0x7ff8a41046f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff8940048d0 tx=0x7ff894009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.973+0000 7ff8a3200640 1 -- 172.21.15.57:0/721711616 shutdown_connections 2024-02-28T16:16:20.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.973+0000 7ff8a3200640 1 --2- 172.21.15.57:0/721711616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8a4104cc0 0x7ff8a40fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.973+0000 7ff8a3200640 1 --2- 172.21.15.57:0/721711616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8a4104320 0x7ff8a41046f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.973+0000 7ff8a3200640 1 -- 172.21.15.57:0/721711616 >> 172.21.15.57:0/721711616 conn(0x7ff8a40f9f90 msgr2=0x7ff8a40fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:20.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.973+0000 7ff8a3200640 1 -- 172.21.15.57:0/721711616 shutdown_connections 2024-02-28T16:16:20.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.973+0000 7ff8a3200640 1 -- 172.21.15.57:0/721711616 wait complete. 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.974+0000 7ff8a3200640 1 Processor -- start 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.974+0000 7ff8a3200640 1 -- start start 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.974+0000 7ff8a3200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8a4104320 0x7ff8a4114c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.974+0000 7ff8a3200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8a4104cc0 0x7ff8a4115160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.974+0000 7ff8a3200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4115760 con 0x7ff8a4104320 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.974+0000 7ff8a3200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a410ecf0 con 0x7ff8a4104cc0 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.974+0000 7ff8a1e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8a4104320 0x7ff8a4114c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.974+0000 7ff8a1e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8a4104320 0x7ff8a4114c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40108/0 (socket says 172.21.15.57:40108) 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.974+0000 7ff8a1e00640 1 -- 172.21.15.57:0/3581978854 learned_addr learned my addr 172.21.15.57:0/3581978854 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.975+0000 7ff8a1e00640 1 -- 172.21.15.57:0/3581978854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8a4104cc0 msgr2=0x7ff8a4115160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.975+0000 7ff8a1e00640 1 --2- 172.21.15.57:0/3581978854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8a4104cc0 0x7ff8a4115160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:20.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.975+0000 7ff8a1e00640 1 -- 172.21.15.57:0/3581978854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894005040 con 0x7ff8a4104320 2024-02-28T16:16:20.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.975+0000 7ff8a1e00640 1 --2- 172.21.15.57:0/3581978854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8a4104320 0x7ff8a4114c20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff894031720 tx=0x7ff894009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:20.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.975+0000 7ff89a000640 1 -- 172.21.15.57:0/3581978854 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8940094c0 con 0x7ff8a4104320 2024-02-28T16:16:20.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.975+0000 7ff89a000640 1 -- 172.21.15.57:0/3581978854 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff894009620 con 0x7ff8a4104320 2024-02-28T16:16:20.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.975+0000 7ff89a000640 1 -- 172.21.15.57:0/3581978854 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff89403b640 con 0x7ff8a4104320 2024-02-28T16:16:20.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.975+0000 7ff8a3200640 1 -- 172.21.15.57:0/3581978854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a410ef70 con 0x7ff8a4104320 2024-02-28T16:16:20.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.976+0000 7ff8a3200640 1 -- 172.21.15.57:0/3581978854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a410f490 con 0x7ff8a4104320 2024-02-28T16:16:20.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.977+0000 7ff8a3200640 1 -- 172.21.15.57:0/3581978854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a404bcc0 con 0x7ff8a4104320 2024-02-28T16:16:20.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.978+0000 7ff89a000640 1 -- 172.21.15.57:0/3581978854 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff89402f070 con 0x7ff8a4104320 2024-02-28T16:16:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.979+0000 7ff89a000640 1 --2- 172.21.15.57:0/3581978854 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff88806d750 0x7ff88806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:20.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.979+0000 7ff89a000640 1 -- 172.21.15.57:0/3581978854 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ff8940af4c0 con 0x7ff8a4104320 2024-02-28T16:16:20.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.979+0000 7ff8a1400640 1 --2- 172.21.15.57:0/3581978854 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff88806d750 0x7ff88806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:20.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.980+0000 7ff8a1400640 1 --2- 172.21.15.57:0/3581978854 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff88806d750 0x7ff88806fc00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff8a41104e0 tx=0x7ff88c009c50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:20.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:20.984+0000 7ff89a000640 1 -- 172.21.15.57:0/3581978854 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff894078b90 con 0x7ff8a4104320 2024-02-28T16:16:21.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:20 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/323004004' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-28T16:16:21.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:20 smithi057 ceph-mon[93219]: pgmap v410: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:21.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:20 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/211734161' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-28T16:16:21.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:20 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1908739759' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-28T16:16:21.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:20 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/323004004' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-28T16:16:21.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:20 smithi087 ceph-mon[82628]: pgmap v410: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:21.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:20 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/211734161' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-28T16:16:21.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:20 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1908739759' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-28T16:16:21.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.229+0000 7ff8a3200640 1 -- 172.21.15.57:0/3581978854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7ff8a410b460 con 0x7ff8a4104320 2024-02-28T16:16:21.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.231+0000 7ff89a000640 1 -- 172.21.15.57:0/3581978854 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v41) v1 ==== 107+0+4036 (secure 0 0 0) 0x7ff89407c250 con 0x7ff8a4104320 2024-02-28T16:16:21.222 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:21.222 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34456,"name":"cephfs.smithi057.qwatmu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6829/3861545073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3861545073},{"type":"v1","addr":"172.21.15.57:6829","nonce":3861545073}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:10:49.544958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:21.223 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 24 2024-02-28T16:16:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 -- 172.21.15.57:0/3581978854 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff88806d750 msgr2=0x7ff88806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 --2- 172.21.15.57:0/3581978854 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff88806d750 0x7ff88806fc00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff8a41104e0 tx=0x7ff88c009c50 comp rx=0 tx=0).stop 2024-02-28T16:16:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 -- 172.21.15.57:0/3581978854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8a4104320 msgr2=0x7ff8a4114c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 --2- 172.21.15.57:0/3581978854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8a4104320 0x7ff8a4114c20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff894031720 tx=0x7ff894009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 -- 172.21.15.57:0/3581978854 shutdown_connections 2024-02-28T16:16:21.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 --2- 172.21.15.57:0/3581978854 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff88806d750 0x7ff88806fc00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 --2- 172.21.15.57:0/3581978854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8a4104cc0 0x7ff8a4115160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 --2- 172.21.15.57:0/3581978854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8a4104320 0x7ff8a4114c20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 -- 172.21.15.57:0/3581978854 >> 172.21.15.57:0/3581978854 conn(0x7ff8a40f9f90 msgr2=0x7ff8a40fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 -- 172.21.15.57:0/3581978854 shutdown_connections 2024-02-28T16:16:21.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.234+0000 7ff8a3200640 1 -- 172.21.15.57:0/3581978854 wait complete. 2024-02-28T16:16:21.245 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-02-28T16:16:21.245 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-02-28T16:16:21.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-28T16:16:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.472+0000 7efeef000640 1 -- 172.21.15.57:0/20813043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efee8073e80 msgr2=0x7efee810cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.472+0000 7efeef000640 1 --2- 172.21.15.57:0/20813043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efee8073e80 0x7efee810cd40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efed00048d0 tx=0x7efed0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.473+0000 7efeef000640 1 -- 172.21.15.57:0/20813043 shutdown_connections 2024-02-28T16:16:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.473+0000 7efeef000640 1 --2- 172.21.15.57:0/20813043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efee8073e80 0x7efee810cd40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.473+0000 7efeef000640 1 --2- 172.21.15.57:0/20813043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efee8073570 0x7efee8073940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.473+0000 7efeef000640 1 -- 172.21.15.57:0/20813043 >> 172.21.15.57:0/20813043 conn(0x7efee80fa160 msgr2=0x7efee80fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.473+0000 7efeef000640 1 -- 172.21.15.57:0/20813043 shutdown_connections 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.473+0000 7efeef000640 1 -- 172.21.15.57:0/20813043 wait complete. 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.473+0000 7efeef000640 1 Processor -- start 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.474+0000 7efeef000640 1 -- start start 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.474+0000 7efeef000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efee8073570 0x7efee8119260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.474+0000 7efeef000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efee8073e80 0x7efee81197a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.474+0000 7efeef000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee8119da0 con 0x7efee8073e80 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.474+0000 7efeef000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee8113330 con 0x7efee8073570 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.474+0000 7efedfe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efee8073e80 0x7efee81197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.474+0000 7efedfe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efee8073e80 0x7efee81197a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40138/0 (socket says 172.21.15.57:40138) 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.474+0000 7efedfe00640 1 -- 172.21.15.57:0/1182540740 learned_addr learned my addr 172.21.15.57:0/1182540740 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.475+0000 7efedfe00640 1 -- 172.21.15.57:0/1182540740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efee8073570 msgr2=0x7efee8119260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.475+0000 7efee7e00640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efee8073570 0x7efee8119260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.475+0000 7efedfe00640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efee8073570 0x7efee8119260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.475+0000 7efedfe00640 1 -- 172.21.15.57:0/1182540740 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0005040 con 0x7efee8073e80 2024-02-28T16:16:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.475+0000 7efedfe00640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efee8073e80 0x7efee81197a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efed00047f0 tx=0x7efed0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.475+0000 7efee4c00640 1 -- 172.21.15.57:0/1182540740 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efed00094c0 con 0x7efee8073e80 2024-02-28T16:16:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.475+0000 7efee4c00640 1 -- 172.21.15.57:0/1182540740 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efed0009620 con 0x7efee8073e80 2024-02-28T16:16:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.475+0000 7efeef000640 1 -- 172.21.15.57:0/1182540740 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee81135b0 con 0x7efee8073e80 2024-02-28T16:16:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.475+0000 7efee4c00640 1 -- 172.21.15.57:0/1182540740 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efed00435f0 con 0x7efee8073e80 2024-02-28T16:16:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.475+0000 7efeef000640 1 -- 172.21.15.57:0/1182540740 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee8113a70 con 0x7efee8073e80 2024-02-28T16:16:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.477+0000 7efeef000640 1 -- 172.21.15.57:0/1182540740 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee8064030 con 0x7efee8073e80 2024-02-28T16:16:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.478+0000 7efee4c00640 1 -- 172.21.15.57:0/1182540740 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7efed002f070 con 0x7efee8073e80 2024-02-28T16:16:21.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.479+0000 7efee4c00640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efecc06d760 0x7efecc06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:21.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.479+0000 7efee4c00640 1 -- 172.21.15.57:0/1182540740 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7efed00aefb0 con 0x7efee8073e80 2024-02-28T16:16:21.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.479+0000 7efee7e00640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efecc06d760 0x7efecc06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:21.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.480+0000 7efee7e00640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efecc06d760 0x7efecc06fc10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efed8004bc0 tx=0x7efed8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:21.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.484+0000 7efee4c00640 1 -- 172.21.15.57:0/1182540740 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efed00786a0 con 0x7efee8073e80 2024-02-28T16:16:21.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.725+0000 7efeef000640 1 -- 172.21.15.57:0/1182540740 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7efee810a3e0 con 0x7efee8073e80 2024-02-28T16:16:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.727+0000 7efee4c00640 1 -- 172.21.15.57:0/1182540740 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v41) v1 ==== 107+0+4047 (secure 0 0 0) 0x7efed007bd60 con 0x7efee8073e80 2024-02-28T16:16:21.719 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:21.719 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:10:49.556192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34456},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34456":{"gid":34456,"name":"cephfs.smithi057.qwatmu","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.57:6829/3861545073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3861545073},{"type":"v1","addr":"172.21.15.57:6829","nonce":3861545073}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2024-02-28T16:16:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.729+0000 7efeef000640 1 -- 172.21.15.57:0/1182540740 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efecc06d760 msgr2=0x7efecc06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.729+0000 7efeef000640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efecc06d760 0x7efecc06fc10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efed8004bc0 tx=0x7efed8009040 comp rx=0 tx=0).stop 2024-02-28T16:16:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.729+0000 7efeef000640 1 -- 172.21.15.57:0/1182540740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efee8073e80 msgr2=0x7efee81197a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.729+0000 7efeef000640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efee8073e80 0x7efee81197a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efed00047f0 tx=0x7efed0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.730+0000 7efeef000640 1 -- 172.21.15.57:0/1182540740 shutdown_connections 2024-02-28T16:16:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.730+0000 7efeef000640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efecc06d760 0x7efecc06fc10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.730+0000 7efeef000640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efee8073e80 0x7efee81197a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.730+0000 7efeef000640 1 --2- 172.21.15.57:0/1182540740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efee8073570 0x7efee8119260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.730+0000 7efeef000640 1 -- 172.21.15.57:0/1182540740 >> 172.21.15.57:0/1182540740 conn(0x7efee80fa160 msgr2=0x7efee80fbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.730+0000 7efeef000640 1 -- 172.21.15.57:0/1182540740 shutdown_connections 2024-02-28T16:16:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.730+0000 7efeef000640 1 -- 172.21.15.57:0/1182540740 wait complete. 2024-02-28T16:16:21.740 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-02-28T16:16:21.741 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-02-28T16:16:21.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-28T16:16:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.965+0000 7f48f5e00640 1 -- 172.21.15.57:0/2287355065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f0104320 msgr2=0x7f48f01046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.965+0000 7f48f5e00640 1 --2- 172.21.15.57:0/2287355065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f0104320 0x7f48f01046f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f48e00048d0 tx=0x7f48e0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.965+0000 7f48f5e00640 1 -- 172.21.15.57:0/2287355065 shutdown_connections 2024-02-28T16:16:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.965+0000 7f48f5e00640 1 --2- 172.21.15.57:0/2287355065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48f0104cc0 0x7f48f00fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.965+0000 7f48f5e00640 1 --2- 172.21.15.57:0/2287355065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f0104320 0x7f48f01046f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.965+0000 7f48f5e00640 1 -- 172.21.15.57:0/2287355065 >> 172.21.15.57:0/2287355065 conn(0x7f48f00f9f90 msgr2=0x7f48f00fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.965+0000 7f48f5e00640 1 -- 172.21.15.57:0/2287355065 shutdown_connections 2024-02-28T16:16:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.965+0000 7f48f5e00640 1 -- 172.21.15.57:0/2287355065 wait complete. 2024-02-28T16:16:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.966+0000 7f48f5e00640 1 Processor -- start 2024-02-28T16:16:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.966+0000 7f48f5e00640 1 -- start start 2024-02-28T16:16:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48f5e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f0104320 0x7f48f0114c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48f5e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48f0104cc0 0x7f48f0115160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48f5e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0115760 con 0x7f48f0104320 2024-02-28T16:16:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48f5e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f010ecf0 con 0x7f48f0104cc0 2024-02-28T16:16:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48f4a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f0104320 0x7f48f0114c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48f4a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f0104320 0x7f48f0114c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34966/0 (socket says 172.21.15.57:34966) 2024-02-28T16:16:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48f4a00640 1 -- 172.21.15.57:0/1662326335 learned_addr learned my addr 172.21.15.57:0/1662326335 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48f4a00640 1 -- 172.21.15.57:0/1662326335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48f0104cc0 msgr2=0x7f48f0115160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:21.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48efe00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48f0104cc0 0x7f48f0115160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:21.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48f4a00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48f0104cc0 0x7f48f0115160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:21.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.967+0000 7f48f4a00640 1 -- 172.21.15.57:0/1662326335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0005040 con 0x7f48f0104320 2024-02-28T16:16:21.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.968+0000 7f48f4a00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f0104320 0x7f48f0114c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f48e0031720 tx=0x7f48e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:21.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.968+0000 7f48ecc00640 1 -- 172.21.15.57:0/1662326335 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e00094c0 con 0x7f48f0104320 2024-02-28T16:16:21.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.968+0000 7f48ecc00640 1 -- 172.21.15.57:0/1662326335 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48e0009620 con 0x7f48f0104320 2024-02-28T16:16:21.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.968+0000 7f48f5e00640 1 -- 172.21.15.57:0/1662326335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f010ef70 con 0x7f48f0104320 2024-02-28T16:16:21.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.968+0000 7f48ecc00640 1 -- 172.21.15.57:0/1662326335 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e003b640 con 0x7f48f0104320 2024-02-28T16:16:21.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.968+0000 7f48f5e00640 1 -- 172.21.15.57:0/1662326335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f010f490 con 0x7f48f0104320 2024-02-28T16:16:21.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.970+0000 7f48f5e00640 1 -- 172.21.15.57:0/1662326335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f004bcc0 con 0x7f48f0104320 2024-02-28T16:16:21.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.970+0000 7f48ecc00640 1 -- 172.21.15.57:0/1662326335 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f48e002f070 con 0x7f48f0104320 2024-02-28T16:16:21.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.972+0000 7f48ecc00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f48d406d750 0x7f48d406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:21.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.972+0000 7f48ecc00640 1 -- 172.21.15.57:0/1662326335 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f48e00af620 con 0x7f48f0104320 2024-02-28T16:16:21.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.972+0000 7f48efe00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f48d406d750 0x7f48d406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:21.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.973+0000 7f48efe00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f48d406d750 0x7f48d406fc00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48f01104e0 tx=0x7f48dc009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:21.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:21.977+0000 7f48ecc00640 1 -- 172.21.15.57:0/1662326335 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f48e0078cb0 con 0x7f48f0104320 2024-02-28T16:16:22.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:21 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3581978854' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-28T16:16:22.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:21 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1182540740' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-28T16:16:22.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.215+0000 7f48f5e00640 1 -- 172.21.15.57:0/1662326335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f48f010f620 con 0x7f48f0104320 2024-02-28T16:16:22.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.216+0000 7f48ecc00640 1 -- 172.21.15.57:0/1662326335 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v41) v1 ==== 107+0+4051 (secure 0 0 0) 0x7f48e007c370 con 0x7f48f0104320 2024-02-28T16:16:22.208 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:22.208 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:10:56.245622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34456},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34456":{"gid":34456,"name":"cephfs.smithi057.qwatmu","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.57:6829/3861545073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3861545073},{"type":"v1","addr":"172.21.15.57:6829","nonce":3861545073}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:22.208 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2024-02-28T16:16:22.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 -- 172.21.15.57:0/1662326335 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f48d406d750 msgr2=0x7f48d406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:22.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f48d406d750 0x7f48d406fc00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48f01104e0 tx=0x7f48dc009040 comp rx=0 tx=0).stop 2024-02-28T16:16:22.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 -- 172.21.15.57:0/1662326335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f0104320 msgr2=0x7f48f0114c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:22.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f0104320 0x7f48f0114c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f48e0031720 tx=0x7f48e0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 -- 172.21.15.57:0/1662326335 shutdown_connections 2024-02-28T16:16:22.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f48d406d750 0x7f48d406fc00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48f0104cc0 0x7f48f0115160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 --2- 172.21.15.57:0/1662326335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f0104320 0x7f48f0114c20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 -- 172.21.15.57:0/1662326335 >> 172.21.15.57:0/1662326335 conn(0x7f48f00f9f90 msgr2=0x7f48f00fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:22.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 -- 172.21.15.57:0/1662326335 shutdown_connections 2024-02-28T16:16:22.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.219+0000 7f48f5e00640 1 -- 172.21.15.57:0/1662326335 wait complete. 2024-02-28T16:16:22.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:21 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3581978854' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-28T16:16:22.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:21 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1182540740' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-28T16:16:22.230 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-02-28T16:16:22.230 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-02-28T16:16:22.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-28T16:16:22.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.441+0000 7fa7f4a00640 1 -- 172.21.15.57:0/2006565124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f0101b00 msgr2=0x7fa7f00fb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:22.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.441+0000 7fa7f4a00640 1 --2- 172.21.15.57:0/2006565124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f0101b00 0x7fa7f00fb190 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80048d0 tx=0x7fa7d8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.441+0000 7fa7f4a00640 1 -- 172.21.15.57:0/2006565124 shutdown_connections 2024-02-28T16:16:22.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.441+0000 7fa7f4a00640 1 --2- 172.21.15.57:0/2006565124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f0101b00 0x7fa7f00fb190 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.441+0000 7fa7f4a00640 1 --2- 172.21.15.57:0/2006565124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f0101160 0x7fa7f0101530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.441+0000 7fa7f4a00640 1 -- 172.21.15.57:0/2006565124 >> 172.21.15.57:0/2006565124 conn(0x7fa7f00f6d70 msgr2=0x7fa7f00f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:22.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.441+0000 7fa7f4a00640 1 -- 172.21.15.57:0/2006565124 shutdown_connections 2024-02-28T16:16:22.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.441+0000 7fa7f4a00640 1 -- 172.21.15.57:0/2006565124 wait complete. 2024-02-28T16:16:22.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.442+0000 7fa7f4a00640 1 Processor -- start 2024-02-28T16:16:22.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.442+0000 7fa7f4a00640 1 -- start start 2024-02-28T16:16:22.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.442+0000 7fa7f4a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f0101160 0x7fa7f0114f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.442+0000 7fa7f4a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f0101b00 0x7fa7f0115450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.442+0000 7fa7f4a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0115a50 con 0x7fa7f0101160 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.442+0000 7fa7f4a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f010efe0 con 0x7fa7f0101b00 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.443+0000 7fa7ede00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f0101160 0x7fa7f0114f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.443+0000 7fa7ede00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f0101160 0x7fa7f0114f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34996/0 (socket says 172.21.15.57:34996) 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.443+0000 7fa7ede00640 1 -- 172.21.15.57:0/3445601764 learned_addr learned my addr 172.21.15.57:0/3445601764 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.443+0000 7fa7e7e00640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f0101b00 0x7fa7f0115450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.443+0000 7fa7ede00640 1 -- 172.21.15.57:0/3445601764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f0101b00 msgr2=0x7fa7f0115450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.443+0000 7fa7ede00640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f0101b00 0x7fa7f0115450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.443+0000 7fa7ede00640 1 -- 172.21.15.57:0/3445601764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8005040 con 0x7fa7f0101160 2024-02-28T16:16:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.444+0000 7fa7ede00640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f0101160 0x7fa7f0114f10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000eb70 tx=0x7fa7e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.444+0000 7fa7e6000640 1 -- 172.21.15.57:0/3445601764 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e0007c30 con 0x7fa7f0101160 2024-02-28T16:16:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.444+0000 7fa7e6000640 1 -- 172.21.15.57:0/3445601764 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7e000f040 con 0x7fa7f0101160 2024-02-28T16:16:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.444+0000 7fa7f4a00640 1 -- 172.21.15.57:0/3445601764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f010f260 con 0x7fa7f0101160 2024-02-28T16:16:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.444+0000 7fa7e6000640 1 -- 172.21.15.57:0/3445601764 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e00095b0 con 0x7fa7f0101160 2024-02-28T16:16:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.444+0000 7fa7f4a00640 1 -- 172.21.15.57:0/3445601764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f010f750 con 0x7fa7f0101160 2024-02-28T16:16:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.445+0000 7fa7f4a00640 1 -- 172.21.15.57:0/3445601764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f004bcc0 con 0x7fa7f0101160 2024-02-28T16:16:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.446+0000 7fa7e6000640 1 -- 172.21.15.57:0/3445601764 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa7e0009730 con 0x7fa7f0101160 2024-02-28T16:16:22.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.447+0000 7fa7e6000640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa7d406d810 0x7fa7d406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:22.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.447+0000 7fa7e6000640 1 -- 172.21.15.57:0/3445601764 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fa7e008cda0 con 0x7fa7f0101160 2024-02-28T16:16:22.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.448+0000 7fa7e7e00640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa7d406d810 0x7fa7d406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:22.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.448+0000 7fa7e7e00640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa7d406d810 0x7fa7d406fcc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0110120 tx=0x7fa7d8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:22.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.459+0000 7fa7e6000640 1 -- 172.21.15.57:0/3445601764 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa7e00564a0 con 0x7fa7f0101160 2024-02-28T16:16:22.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.705+0000 7fa7f4a00640 1 -- 172.21.15.57:0/3445601764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fa7f0110570 con 0x7fa7f0101160 2024-02-28T16:16:22.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.706+0000 7fa7e6000640 1 -- 172.21.15.57:0/3445601764 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v41) v1 ==== 107+0+4858 (secure 0 0 0) 0x7fa7e0059b60 con 0x7fa7f0101160 2024-02-28T16:16:22.700 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:22.701 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:10:56.605939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34456},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34456":{"gid":34456,"name":"cephfs.smithi057.qwatmu","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":14,"addr":"172.21.15.57:6829/3861545073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3861545073},{"type":"v1","addr":"172.21.15.57:6829","nonce":3861545073}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:22.701 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 27 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 -- 172.21.15.57:0/3445601764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa7d406d810 msgr2=0x7fa7d406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa7d406d810 0x7fa7d406fcc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0110120 tx=0x7fa7d8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 -- 172.21.15.57:0/3445601764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f0101160 msgr2=0x7fa7f0114f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f0101160 0x7fa7f0114f10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000eb70 tx=0x7fa7e000b040 comp rx=0 tx=0).stop 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 -- 172.21.15.57:0/3445601764 shutdown_connections 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa7d406d810 0x7fa7d406fcc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f0101b00 0x7fa7f0115450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 --2- 172.21.15.57:0/3445601764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f0101160 0x7fa7f0114f10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 -- 172.21.15.57:0/3445601764 >> 172.21.15.57:0/3445601764 conn(0x7fa7f00f6d70 msgr2=0x7fa7f00f88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 -- 172.21.15.57:0/3445601764 shutdown_connections 2024-02-28T16:16:22.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.709+0000 7fa7f4a00640 1 -- 172.21.15.57:0/3445601764 wait complete. 2024-02-28T16:16:22.718 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-02-28T16:16:22.718 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-02-28T16:16:22.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-28T16:16:22.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.934+0000 7f9edd800640 1 -- 172.21.15.57:0/3125726534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed80fd340 msgr2=0x7f9ed80fd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.934+0000 7f9edd800640 1 --2- 172.21.15.57:0/3125726534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed80fd340 0x7f9ed80fd710 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8004900 tx=0x7f9ec8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.934+0000 7f9edd800640 1 -- 172.21.15.57:0/3125726534 shutdown_connections 2024-02-28T16:16:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.934+0000 7f9edd800640 1 --2- 172.21.15.57:0/3125726534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ed80fdce0 0x7f9ed81063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.934+0000 7f9edd800640 1 --2- 172.21.15.57:0/3125726534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed80fd340 0x7f9ed80fd710 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.934+0000 7f9edd800640 1 -- 172.21.15.57:0/3125726534 >> 172.21.15.57:0/3125726534 conn(0x7f9ed80f6dc0 msgr2=0x7f9ed80f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.934+0000 7f9edd800640 1 -- 172.21.15.57:0/3125726534 shutdown_connections 2024-02-28T16:16:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.934+0000 7f9edd800640 1 -- 172.21.15.57:0/3125726534 wait complete. 2024-02-28T16:16:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.935+0000 7f9edd800640 1 Processor -- start 2024-02-28T16:16:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.935+0000 7f9edd800640 1 -- start start 2024-02-28T16:16:22.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9edd800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed80fd340 0x7f9ed8114e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:22.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9edd800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ed80fdce0 0x7f9ed81153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:22.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9edd800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed81159c0 con 0x7f9ed80fd340 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9edd800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed810ef50 con 0x7f9ed80fdce0 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9ed6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed80fd340 0x7f9ed8114e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9ed6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed80fd340 0x7f9ed8114e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35016/0 (socket says 172.21.15.57:35016) 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9ed6a00640 1 -- 172.21.15.57:0/1084427569 learned_addr learned my addr 172.21.15.57:0/1084427569 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9ed6000640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ed80fdce0 0x7f9ed81153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9ed6a00640 1 -- 172.21.15.57:0/1084427569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ed80fdce0 msgr2=0x7f9ed81153c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9ed6a00640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ed80fdce0 0x7f9ed81153c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.936+0000 7f9ed6a00640 1 -- 172.21.15.57:0/1084427569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec8005040 con 0x7f9ed80fd340 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.937+0000 7f9ed6a00640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed80fd340 0x7f9ed8114e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80047f0 tx=0x7f9ec8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.937+0000 7f9ecea00640 1 -- 172.21.15.57:0/1084427569 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ec80094c0 con 0x7f9ed80fd340 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.937+0000 7f9ecea00640 1 -- 172.21.15.57:0/1084427569 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ec803d920 con 0x7f9ed80fd340 2024-02-28T16:16:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.937+0000 7f9ecea00640 1 -- 172.21.15.57:0/1084427569 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ec803b8f0 con 0x7f9ed80fd340 2024-02-28T16:16:22.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.937+0000 7f9edd800640 1 -- 172.21.15.57:0/1084427569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed810f1d0 con 0x7f9ed80fd340 2024-02-28T16:16:22.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.937+0000 7f9edd800640 1 -- 172.21.15.57:0/1084427569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed810f6f0 con 0x7f9ed80fd340 2024-02-28T16:16:22.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.939+0000 7f9edd800640 1 -- 172.21.15.57:0/1084427569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed8064480 con 0x7f9ed80fd340 2024-02-28T16:16:22.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.940+0000 7f9ecea00640 1 -- 172.21.15.57:0/1084427569 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f9ec803da90 con 0x7f9ed80fd340 2024-02-28T16:16:22.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.941+0000 7f9ecea00640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9ebc06d760 0x7f9ebc06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:22.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.941+0000 7f9ecea00640 1 -- 172.21.15.57:0/1084427569 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f9ec80afcc0 con 0x7f9ed80fd340 2024-02-28T16:16:22.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.941+0000 7f9ed6000640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9ebc06d760 0x7f9ebc06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:22.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.942+0000 7f9ed6000640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9ebc06d760 0x7f9ebc06fc10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8110740 tx=0x7f9ec400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:22.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:22.947+0000 7f9ecea00640 1 -- 172.21.15.57:0/1084427569 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ec80794f0 con 0x7f9ed80fd340 2024-02-28T16:16:23.065 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:22 smithi057 ceph-mon[93219]: pgmap v411: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:23.065 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:22 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1662326335' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-28T16:16:23.065 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:22 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:16:23.065 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:22 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3445601764' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-28T16:16:23.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.180+0000 7f9edd800640 1 -- 172.21.15.57:0/1084427569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f9ed8110480 con 0x7f9ed80fd340 2024-02-28T16:16:23.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.182+0000 7f9ecea00640 1 -- 172.21.15.57:0/1084427569 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v41) v1 ==== 107+0+4858 (secure 0 0 0) 0x7f9ec807cbb0 con 0x7f9ed80fd340 2024-02-28T16:16:23.173 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:23.173 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:10:57.644767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34456},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34456":{"gid":34456,"name":"cephfs.smithi057.qwatmu","rank":0,"incarnation":25,"state":"up:active","state_seq":15,"addr":"172.21.15.57:6829/3861545073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3861545073},{"type":"v1","addr":"172.21.15.57:6829","nonce":3861545073}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:23.174 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 28 2024-02-28T16:16:23.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.184+0000 7f9edd800640 1 -- 172.21.15.57:0/1084427569 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9ebc06d760 msgr2=0x7f9ebc06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.184+0000 7f9edd800640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9ebc06d760 0x7f9ebc06fc10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8110740 tx=0x7f9ec400b040 comp rx=0 tx=0).stop 2024-02-28T16:16:23.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.184+0000 7f9edd800640 1 -- 172.21.15.57:0/1084427569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed80fd340 msgr2=0x7f9ed8114e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.184+0000 7f9edd800640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed80fd340 0x7f9ed8114e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80047f0 tx=0x7f9ec8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.185+0000 7f9edd800640 1 -- 172.21.15.57:0/1084427569 shutdown_connections 2024-02-28T16:16:23.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.185+0000 7f9edd800640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f9ebc06d760 0x7f9ebc06fc10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.185+0000 7f9edd800640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ed80fdce0 0x7f9ed81153c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.185+0000 7f9edd800640 1 --2- 172.21.15.57:0/1084427569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed80fd340 0x7f9ed8114e80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.185+0000 7f9edd800640 1 -- 172.21.15.57:0/1084427569 >> 172.21.15.57:0/1084427569 conn(0x7f9ed80f6dc0 msgr2=0x7f9ed8102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:23.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.185+0000 7f9edd800640 1 -- 172.21.15.57:0/1084427569 shutdown_connections 2024-02-28T16:16:23.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.185+0000 7f9edd800640 1 -- 172.21.15.57:0/1084427569 wait complete. 2024-02-28T16:16:23.192 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-02-28T16:16:23.192 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-02-28T16:16:23.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-28T16:16:23.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:22 smithi087 ceph-mon[82628]: pgmap v411: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:23.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:22 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1662326335' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-28T16:16:23.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:22 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:16:23.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:22 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3445601764' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-28T16:16:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.388+0000 7ff2c0a00640 1 -- 172.21.15.57:0/4084618963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc0700f0 msgr2=0x7ff2bc1086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.388+0000 7ff2c0a00640 1 --2- 172.21.15.57:0/4084618963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc0700f0 0x7ff2bc1086f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80048d0 tx=0x7ff2a8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.388+0000 7ff2c0a00640 1 -- 172.21.15.57:0/4084618963 shutdown_connections 2024-02-28T16:16:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.388+0000 7ff2c0a00640 1 --2- 172.21.15.57:0/4084618963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc0700f0 0x7ff2bc1086f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.388+0000 7ff2c0a00640 1 --2- 172.21.15.57:0/4084618963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2bc06f7e0 0x7ff2bc06fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.388+0000 7ff2c0a00640 1 -- 172.21.15.57:0/4084618963 >> 172.21.15.57:0/4084618963 conn(0x7ff2bc0f7ef0 msgr2=0x7ff2bc0fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:23.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.388+0000 7ff2c0a00640 1 -- 172.21.15.57:0/4084618963 shutdown_connections 2024-02-28T16:16:23.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.388+0000 7ff2c0a00640 1 -- 172.21.15.57:0/4084618963 wait complete. 2024-02-28T16:16:23.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.389+0000 7ff2c0a00640 1 Processor -- start 2024-02-28T16:16:23.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.389+0000 7ff2c0a00640 1 -- start start 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.390+0000 7ff2c0a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc06f7e0 0x7ff2bc114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.390+0000 7ff2c0a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2bc0700f0 0x7ff2bc115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.390+0000 7ff2c0a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc115940 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.390+0000 7ff2c0a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc10eed0 con 0x7ff2bc0700f0 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.390+0000 7ff2b9e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc06f7e0 0x7ff2bc114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.390+0000 7ff2b9e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc06f7e0 0x7ff2bc114e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35026/0 (socket says 172.21.15.57:35026) 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.390+0000 7ff2b9e00640 1 -- 172.21.15.57:0/2823385959 learned_addr learned my addr 172.21.15.57:0/2823385959 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.390+0000 7ff2b9400640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2bc0700f0 0x7ff2bc115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.391+0000 7ff2b9e00640 1 -- 172.21.15.57:0/2823385959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2bc0700f0 msgr2=0x7ff2bc115340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.391+0000 7ff2b9e00640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2bc0700f0 0x7ff2bc115340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.391+0000 7ff2b9e00640 1 -- 172.21.15.57:0/2823385959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a8005040 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.391+0000 7ff2b9400640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2bc0700f0 0x7ff2bc115340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:16:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.391+0000 7ff2b9e00640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc06f7e0 0x7ff2bc114e00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac002a50 tx=0x7ff2ac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.391+0000 7ff2b2000640 1 -- 172.21.15.57:0/2823385959 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ac007c30 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.391+0000 7ff2b2000640 1 -- 172.21.15.57:0/2823385959 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2ac00f040 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.391+0000 7ff2c0a00640 1 -- 172.21.15.57:0/2823385959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc10f1b0 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.391+0000 7ff2b2000640 1 -- 172.21.15.57:0/2823385959 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ac00dbe0 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.391+0000 7ff2c0a00640 1 -- 172.21.15.57:0/2823385959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2bc10f6a0 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.393+0000 7ff2c0a00640 1 -- 172.21.15.57:0/2823385959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2bc064480 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.394+0000 7ff2b2000640 1 -- 172.21.15.57:0/2823385959 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ff2ac00dd40 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.394+0000 7ff2b2000640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2a006d750 0x7ff2a006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.395+0000 7ff2b2000640 1 -- 172.21.15.57:0/2823385959 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ff2ac08cf90 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.395+0000 7ff2b9400640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2a006d750 0x7ff2a006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.396+0000 7ff2b9400640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2a006d750 0x7ff2a006fc00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc110010 tx=0x7ff2a8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:23.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.400+0000 7ff2b2000640 1 -- 172.21.15.57:0/2823385959 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff2ac056660 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.648+0000 7ff2c0a00640 1 -- 172.21.15.57:0/2823385959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7ff2bc110400 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.649+0000 7ff2b2000640 1 -- 172.21.15.57:0/2823385959 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v41) v1 ==== 107+0+4067 (secure 0 0 0) 0x7ff2ac059d20 con 0x7ff2bc06f7e0 2024-02-28T16:16:23.640 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:23.640 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:11:21.561872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:23.640 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 29 2024-02-28T16:16:23.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 -- 172.21.15.57:0/2823385959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2a006d750 msgr2=0x7ff2a006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2a006d750 0x7ff2a006fc00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc110010 tx=0x7ff2a8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 -- 172.21.15.57:0/2823385959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc06f7e0 msgr2=0x7ff2bc114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc06f7e0 0x7ff2bc114e00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac002a50 tx=0x7ff2ac004600 comp rx=0 tx=0).stop 2024-02-28T16:16:23.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 -- 172.21.15.57:0/2823385959 shutdown_connections 2024-02-28T16:16:23.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ff2a006d750 0x7ff2a006fc00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2bc0700f0 0x7ff2bc115340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 --2- 172.21.15.57:0/2823385959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc06f7e0 0x7ff2bc114e00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 -- 172.21.15.57:0/2823385959 >> 172.21.15.57:0/2823385959 conn(0x7ff2bc0f7ef0 msgr2=0x7ff2bc102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:23.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 -- 172.21.15.57:0/2823385959 shutdown_connections 2024-02-28T16:16:23.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.651+0000 7ff2c0a00640 1 -- 172.21.15.57:0/2823385959 wait complete. 2024-02-28T16:16:23.660 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-02-28T16:16:23.660 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-02-28T16:16:23.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-28T16:16:23.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.871+0000 7efcd2a00640 1 -- 172.21.15.57:0/3596248782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efccc104410 msgr2=0x7efccc1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.871+0000 7efcd2a00640 1 --2- 172.21.15.57:0/3596248782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efccc104410 0x7efccc1047e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efcc00048d0 tx=0x7efcc0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.871+0000 7efcd2a00640 1 -- 172.21.15.57:0/3596248782 shutdown_connections 2024-02-28T16:16:23.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.871+0000 7efcd2a00640 1 --2- 172.21.15.57:0/3596248782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc104db0 0x7efccc0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.871+0000 7efcd2a00640 1 --2- 172.21.15.57:0/3596248782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efccc104410 0x7efccc1047e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.871+0000 7efcd2a00640 1 -- 172.21.15.57:0/3596248782 >> 172.21.15.57:0/3596248782 conn(0x7efccc0fa020 msgr2=0x7efccc0fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:23.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.871+0000 7efcd2a00640 1 -- 172.21.15.57:0/3596248782 shutdown_connections 2024-02-28T16:16:23.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.871+0000 7efcd2a00640 1 -- 172.21.15.57:0/3596248782 wait complete. 2024-02-28T16:16:23.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.871+0000 7efcd2a00640 1 Processor -- start 2024-02-28T16:16:23.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.872+0000 7efcd2a00640 1 -- start start 2024-02-28T16:16:23.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.872+0000 7efcd2a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc104410 0x7efccc114c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.872+0000 7efcd2a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efccc104db0 0x7efccc1151a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.872+0000 7efcd2a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc1157a0 con 0x7efccc104db0 2024-02-28T16:16:23.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.872+0000 7efcd2a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc10ed30 con 0x7efccc104410 2024-02-28T16:16:23.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.872+0000 7efcd0c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efccc104db0 0x7efccc1151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.872+0000 7efcd0c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efccc104db0 0x7efccc1151a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35040/0 (socket says 172.21.15.57:35040) 2024-02-28T16:16:23.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.872+0000 7efcd0c00640 1 -- 172.21.15.57:0/2325668696 learned_addr learned my addr 172.21.15.57:0/2325668696 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:23.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.873+0000 7efcd1600640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc104410 0x7efccc114c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.873+0000 7efcd0c00640 1 -- 172.21.15.57:0/2325668696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc104410 msgr2=0x7efccc114c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.873+0000 7efcd0c00640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc104410 0x7efccc114c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.873+0000 7efcd0c00640 1 -- 172.21.15.57:0/2325668696 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0005040 con 0x7efccc104db0 2024-02-28T16:16:23.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.873+0000 7efcd0c00640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efccc104db0 0x7efccc1151a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c760 tx=0x7efcb80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:23.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.873+0000 7efcc9600640 1 -- 172.21.15.57:0/2325668696 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcb800a790 con 0x7efccc104db0 2024-02-28T16:16:23.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.873+0000 7efcc9600640 1 -- 172.21.15.57:0/2325668696 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcb800adc0 con 0x7efccc104db0 2024-02-28T16:16:23.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.873+0000 7efcc9600640 1 -- 172.21.15.57:0/2325668696 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcb80115e0 con 0x7efccc104db0 2024-02-28T16:16:23.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.873+0000 7efcd2a00640 1 -- 172.21.15.57:0/2325668696 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc10f010 con 0x7efccc104db0 2024-02-28T16:16:23.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.873+0000 7efcd2a00640 1 -- 172.21.15.57:0/2325668696 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc10f530 con 0x7efccc104db0 2024-02-28T16:16:23.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.875+0000 7efcd2a00640 1 -- 172.21.15.57:0/2325668696 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc04bcc0 con 0x7efccc104db0 2024-02-28T16:16:23.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.876+0000 7efcc9600640 1 -- 172.21.15.57:0/2325668696 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7efcb8012400 con 0x7efccc104db0 2024-02-28T16:16:23.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.877+0000 7efcc9600640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcb406d760 0x7efcb406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.877+0000 7efcc9600640 1 -- 172.21.15.57:0/2325668696 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7efcb808d0e0 con 0x7efccc104db0 2024-02-28T16:16:23.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.877+0000 7efcd1600640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcb406d760 0x7efcb406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.878+0000 7efcd1600640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcb406d760 0x7efcb406fc10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efcc0034040 tx=0x7efcc0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:23.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:23.882+0000 7efcc9600640 1 -- 172.21.15.57:0/2325668696 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efcb80568f0 con 0x7efccc104db0 2024-02-28T16:16:23.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:23 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1084427569' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-28T16:16:23.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:23 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:23.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:23 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:16:23.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:23 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:16:23.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:23 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2823385959' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-28T16:16:24.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.115+0000 7efcd2a00640 1 -- 172.21.15.57:0/2325668696 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7efccc110260 con 0x7efccc104db0 2024-02-28T16:16:24.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.116+0000 7efcc9600640 1 -- 172.21.15.57:0/2325668696 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v41) v1 ==== 107+0+4112 (secure 0 0 0) 0x7efcb8059fb0 con 0x7efccc104db0 2024-02-28T16:16:24.107 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:24.107 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:11:21.573278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:24.107 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 30 2024-02-28T16:16:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.118+0000 7efcd2a00640 1 -- 172.21.15.57:0/2325668696 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcb406d760 msgr2=0x7efcb406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.118+0000 7efcd2a00640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcb406d760 0x7efcb406fc10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efcc0034040 tx=0x7efcc0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.118+0000 7efcd2a00640 1 -- 172.21.15.57:0/2325668696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efccc104db0 msgr2=0x7efccc1151a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.118+0000 7efcd2a00640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efccc104db0 0x7efccc1151a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c760 tx=0x7efcb80043c0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.118+0000 7efcd2a00640 1 -- 172.21.15.57:0/2325668696 shutdown_connections 2024-02-28T16:16:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.118+0000 7efcd2a00640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcb406d760 0x7efcb406fc10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.118+0000 7efcd2a00640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efccc104db0 0x7efccc1151a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.118+0000 7efcd2a00640 1 --2- 172.21.15.57:0/2325668696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc104410 0x7efccc114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.118+0000 7efcd2a00640 1 -- 172.21.15.57:0/2325668696 >> 172.21.15.57:0/2325668696 conn(0x7efccc0fa020 msgr2=0x7efccc0fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.119+0000 7efcd2a00640 1 -- 172.21.15.57:0/2325668696 shutdown_connections 2024-02-28T16:16:24.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.119+0000 7efcd2a00640 1 -- 172.21.15.57:0/2325668696 wait complete. 2024-02-28T16:16:24.128 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-02-28T16:16:24.128 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-02-28T16:16:24.128 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-28T16:16:24.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:23 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1084427569' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-28T16:16:24.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:23 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:24.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:23 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:16:24.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:23 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:16:24.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:23 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2823385959' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-28T16:16:24.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.352+0000 7fded6200640 1 -- 172.21.15.57:0/2913379234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fded006f840 msgr2=0x7fded006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:24.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.352+0000 7fded6200640 1 --2- 172.21.15.57:0/2913379234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fded006f840 0x7fded006fc10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdec40048d0 tx=0x7fdec4009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.352+0000 7fded6200640 1 -- 172.21.15.57:0/2913379234 shutdown_connections 2024-02-28T16:16:24.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.352+0000 7fded6200640 1 --2- 172.21.15.57:0/2913379234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0070150 0x7fded0108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.352+0000 7fded6200640 1 --2- 172.21.15.57:0/2913379234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fded006f840 0x7fded006fc10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.352+0000 7fded6200640 1 -- 172.21.15.57:0/2913379234 >> 172.21.15.57:0/2913379234 conn(0x7fded00f7cf0 msgr2=0x7fded00fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:24.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.352+0000 7fded6200640 1 -- 172.21.15.57:0/2913379234 shutdown_connections 2024-02-28T16:16:24.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.352+0000 7fded6200640 1 -- 172.21.15.57:0/2913379234 wait complete. 2024-02-28T16:16:24.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.353+0000 7fded6200640 1 Processor -- start 2024-02-28T16:16:24.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.353+0000 7fded6200640 1 -- start start 2024-02-28T16:16:24.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fded6200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fded006f840 0x7fded0114ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:24.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fded6200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0070150 0x7fded01151e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:24.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fded6200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded01157e0 con 0x7fded006f840 2024-02-28T16:16:24.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fded6200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded010ed70 con 0x7fded0070150 2024-02-28T16:16:24.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fded4e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fded006f840 0x7fded0114ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:24.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fded4e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fded006f840 0x7fded0114ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35068/0 (socket says 172.21.15.57:35068) 2024-02-28T16:16:24.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fded4e00640 1 -- 172.21.15.57:0/2730908694 learned_addr learned my addr 172.21.15.57:0/2730908694 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:24.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fdecfe00640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0070150 0x7fded01151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:24.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fded4e00640 1 -- 172.21.15.57:0/2730908694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0070150 msgr2=0x7fded01151e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:24.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fded4e00640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0070150 0x7fded01151e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.354+0000 7fded4e00640 1 -- 172.21.15.57:0/2730908694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4005040 con 0x7fded006f840 2024-02-28T16:16:24.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.355+0000 7fded4e00640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fded006f840 0x7fded0114ca0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdec40316b0 tx=0x7fdec4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:24.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.355+0000 7fdeccc00640 1 -- 172.21.15.57:0/2730908694 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec40094c0 con 0x7fded006f840 2024-02-28T16:16:24.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.355+0000 7fdeccc00640 1 -- 172.21.15.57:0/2730908694 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdec4009620 con 0x7fded006f840 2024-02-28T16:16:24.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.355+0000 7fded6200640 1 -- 172.21.15.57:0/2730908694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded010eff0 con 0x7fded006f840 2024-02-28T16:16:24.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.355+0000 7fdeccc00640 1 -- 172.21.15.57:0/2730908694 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec403b640 con 0x7fded006f840 2024-02-28T16:16:24.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.355+0000 7fded6200640 1 -- 172.21.15.57:0/2730908694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded010f510 con 0x7fded006f840 2024-02-28T16:16:24.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.356+0000 7fded6200640 1 -- 172.21.15.57:0/2730908694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded004bcc0 con 0x7fded006f840 2024-02-28T16:16:24.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.358+0000 7fdeccc00640 1 -- 172.21.15.57:0/2730908694 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fdec402f070 con 0x7fded006f840 2024-02-28T16:16:24.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.359+0000 7fdeccc00640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdeb806d750 0x7fdeb806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:24.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.359+0000 7fdeccc00640 1 -- 172.21.15.57:0/2730908694 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fdec40af540 con 0x7fded006f840 2024-02-28T16:16:24.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.359+0000 7fdecfe00640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdeb806d750 0x7fdeb806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:24.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.360+0000 7fdecfe00640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdeb806d750 0x7fdeb806fc00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdebc007fd0 tx=0x7fdebc009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:24.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.364+0000 7fdeccc00640 1 -- 172.21.15.57:0/2730908694 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdec4078b90 con 0x7fded006f840 2024-02-28T16:16:24.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.607+0000 7fded6200640 1 -- 172.21.15.57:0/2730908694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fded01102a0 con 0x7fded006f840 2024-02-28T16:16:24.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.608+0000 7fdeccc00640 1 -- 172.21.15.57:0/2730908694 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v41) v1 ==== 107+0+4115 (secure 0 0 0) 0x7fdec407c250 con 0x7fded006f840 2024-02-28T16:16:24.600 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:24.600 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:11:28.253207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":9,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:24.600 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 -- 172.21.15.57:0/2730908694 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdeb806d750 msgr2=0x7fdeb806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdeb806d750 0x7fdeb806fc00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdebc007fd0 tx=0x7fdebc009e90 comp rx=0 tx=0).stop 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 -- 172.21.15.57:0/2730908694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fded006f840 msgr2=0x7fded0114ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fded006f840 0x7fded0114ca0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdec40316b0 tx=0x7fdec4009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 -- 172.21.15.57:0/2730908694 shutdown_connections 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fdeb806d750 0x7fdeb806fc00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0070150 0x7fded01151e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 --2- 172.21.15.57:0/2730908694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fded006f840 0x7fded0114ca0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 -- 172.21.15.57:0/2730908694 >> 172.21.15.57:0/2730908694 conn(0x7fded00f7cf0 msgr2=0x7fded0102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 -- 172.21.15.57:0/2730908694 shutdown_connections 2024-02-28T16:16:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.611+0000 7fded6200640 1 -- 172.21.15.57:0/2730908694 wait complete. 2024-02-28T16:16:24.621 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-02-28T16:16:24.621 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-02-28T16:16:24.622 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-28T16:16:24.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.843+0000 7f8eb2600640 1 -- 172.21.15.57:0/750698816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eac102120 msgr2=0x7f8eac1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.843+0000 7f8eb2600640 1 --2- 172.21.15.57:0/750698816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eac102120 0x7f8eac1024f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00048d0 tx=0x7f8ea0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.843+0000 7f8eb2600640 1 -- 172.21.15.57:0/750698816 shutdown_connections 2024-02-28T16:16:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.843+0000 7f8eb2600640 1 --2- 172.21.15.57:0/750698816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac102ac0 0x7f8eac0fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.843+0000 7f8eb2600640 1 --2- 172.21.15.57:0/750698816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eac102120 0x7f8eac1024f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.843+0000 7f8eb2600640 1 -- 172.21.15.57:0/750698816 >> 172.21.15.57:0/750698816 conn(0x7f8eac0f7cf0 msgr2=0x7f8eac0fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.844+0000 7f8eb2600640 1 -- 172.21.15.57:0/750698816 shutdown_connections 2024-02-28T16:16:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.844+0000 7f8eb2600640 1 -- 172.21.15.57:0/750698816 wait complete. 2024-02-28T16:16:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.845+0000 7f8eb2600640 1 Processor -- start 2024-02-28T16:16:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.845+0000 7f8eb2600640 1 -- start start 2024-02-28T16:16:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.845+0000 7f8eb2600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eac102120 0x7f8eac114bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.845+0000 7f8eb2600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac102ac0 0x7f8eac1150f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.845+0000 7f8eb2600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac1156f0 con 0x7f8eac102120 2024-02-28T16:16:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.845+0000 7f8eb2600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac10ec80 con 0x7f8eac102ac0 2024-02-28T16:16:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.845+0000 7f8eb1200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eac102120 0x7f8eac114bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.845+0000 7f8eb1200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eac102120 0x7f8eac114bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35084/0 (socket says 172.21.15.57:35084) 2024-02-28T16:16:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.845+0000 7f8eb1200640 1 -- 172.21.15.57:0/2580154432 learned_addr learned my addr 172.21.15.57:0/2580154432 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.846+0000 7f8eabe00640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac102ac0 0x7f8eac1150f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.846+0000 7f8eb1200640 1 -- 172.21.15.57:0/2580154432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac102ac0 msgr2=0x7f8eac1150f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.846+0000 7f8eb1200640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac102ac0 0x7f8eac1150f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.846+0000 7f8eb1200640 1 -- 172.21.15.57:0/2580154432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0005040 con 0x7f8eac102120 2024-02-28T16:16:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.846+0000 7f8eb1200640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eac102120 0x7f8eac114bb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0031720 tx=0x7f8ea0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.847+0000 7f8ea8c00640 1 -- 172.21.15.57:0/2580154432 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea00094c0 con 0x7f8eac102120 2024-02-28T16:16:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.847+0000 7f8ea8c00640 1 -- 172.21.15.57:0/2580154432 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ea0009620 con 0x7f8eac102120 2024-02-28T16:16:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.847+0000 7f8ea8c00640 1 -- 172.21.15.57:0/2580154432 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea003b640 con 0x7f8eac102120 2024-02-28T16:16:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.847+0000 7f8eb2600640 1 -- 172.21.15.57:0/2580154432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac10ef00 con 0x7f8eac102120 2024-02-28T16:16:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.847+0000 7f8eb2600640 1 -- 172.21.15.57:0/2580154432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac10f420 con 0x7f8eac102120 2024-02-28T16:16:24.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.848+0000 7f8eb2600640 1 -- 172.21.15.57:0/2580154432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac04bcc0 con 0x7f8eac102120 2024-02-28T16:16:24.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.849+0000 7f8ea8c00640 1 -- 172.21.15.57:0/2580154432 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f8ea002f070 con 0x7f8eac102120 2024-02-28T16:16:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.850+0000 7f8ea8c00640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8e9406d750 0x7f8e9406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.850+0000 7f8ea8c00640 1 -- 172.21.15.57:0/2580154432 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f8ea00af6c0 con 0x7f8eac102120 2024-02-28T16:16:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.850+0000 7f8eabe00640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8e9406d750 0x7f8e9406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.851+0000 7f8eabe00640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8e9406d750 0x7f8e9406fc00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8eac110470 tx=0x7f8e9c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:24.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:24.855+0000 7f8ea8c00640 1 -- 172.21.15.57:0/2580154432 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8ea0078d10 con 0x7f8eac102120 2024-02-28T16:16:24.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:24 smithi057 ceph-mon[93219]: pgmap v412: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:24.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:24 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2325668696' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-28T16:16:24.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:24 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2730908694' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-28T16:16:25.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.094+0000 7f8eb2600640 1 -- 172.21.15.57:0/2580154432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f8eac10f5b0 con 0x7f8eac102120 2024-02-28T16:16:25.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.095+0000 7f8ea8c00640 1 -- 172.21.15.57:0/2580154432 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v41) v1 ==== 107+0+4113 (secure 0 0 0) 0x7f8ea007c3d0 con 0x7f8eac102120 2024-02-28T16:16:25.087 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:25.087 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:11:28.620705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:25.087 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 32 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.098+0000 7f8eb2600640 1 -- 172.21.15.57:0/2580154432 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8e9406d750 msgr2=0x7f8e9406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.098+0000 7f8eb2600640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8e9406d750 0x7f8e9406fc00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8eac110470 tx=0x7f8e9c009040 comp rx=0 tx=0).stop 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.098+0000 7f8eb2600640 1 -- 172.21.15.57:0/2580154432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eac102120 msgr2=0x7f8eac114bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.098+0000 7f8eb2600640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eac102120 0x7f8eac114bb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0031720 tx=0x7f8ea0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.098+0000 7f8eb2600640 1 -- 172.21.15.57:0/2580154432 shutdown_connections 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.098+0000 7f8eb2600640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f8e9406d750 0x7f8e9406fc00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.098+0000 7f8eb2600640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac102ac0 0x7f8eac1150f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.098+0000 7f8eb2600640 1 --2- 172.21.15.57:0/2580154432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eac102120 0x7f8eac114bb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.098+0000 7f8eb2600640 1 -- 172.21.15.57:0/2580154432 >> 172.21.15.57:0/2580154432 conn(0x7f8eac0f7cf0 msgr2=0x7f8eac0f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.098+0000 7f8eb2600640 1 -- 172.21.15.57:0/2580154432 shutdown_connections 2024-02-28T16:16:25.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.099+0000 7f8eb2600640 1 -- 172.21.15.57:0/2580154432 wait complete. 2024-02-28T16:16:25.110 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-02-28T16:16:25.110 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-02-28T16:16:25.110 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-28T16:16:25.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:24 smithi087 ceph-mon[82628]: pgmap v412: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:25.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:24 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2325668696' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-28T16:16:25.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:24 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2730908694' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-28T16:16:25.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.340+0000 7f8743200640 1 -- 172.21.15.57:0/2605134278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8744100c30 msgr2=0x7f87440fa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:25.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.340+0000 7f8743200640 1 --2- 172.21.15.57:0/2605134278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8744100c30 0x7f87440fa350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f872c0048d0 tx=0x7f872c009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.340+0000 7f8743200640 1 -- 172.21.15.57:0/2605134278 shutdown_connections 2024-02-28T16:16:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.340+0000 7f8743200640 1 --2- 172.21.15.57:0/2605134278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8744100c30 0x7f87440fa350 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.340+0000 7f8743200640 1 --2- 172.21.15.57:0/2605134278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8744100320 0x7f87441006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.340+0000 7f8743200640 1 -- 172.21.15.57:0/2605134278 >> 172.21.15.57:0/2605134278 conn(0x7f87440f5f70 msgr2=0x7f87440f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.340+0000 7f8743200640 1 -- 172.21.15.57:0/2605134278 shutdown_connections 2024-02-28T16:16:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.340+0000 7f8743200640 1 -- 172.21.15.57:0/2605134278 wait complete. 2024-02-28T16:16:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.341+0000 7f8743200640 1 Processor -- start 2024-02-28T16:16:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.341+0000 7f8743200640 1 -- start start 2024-02-28T16:16:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.341+0000 7f8743200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8744100320 0x7f8744114bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.341+0000 7f8743200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8744100c30 0x7f87441150f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.341+0000 7f8743200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87441156f0 con 0x7f8744100c30 2024-02-28T16:16:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.341+0000 7f8743200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874410ec80 con 0x7f8744100320 2024-02-28T16:16:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.342+0000 7f8741400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8744100c30 0x7f87441150f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.342+0000 7f8741400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8744100c30 0x7f87441150f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35108/0 (socket says 172.21.15.57:35108) 2024-02-28T16:16:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.342+0000 7f8741400640 1 -- 172.21.15.57:0/1973676474 learned_addr learned my addr 172.21.15.57:0/1973676474 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.342+0000 7f8741e00640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8744100320 0x7f8744114bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.342+0000 7f8741400640 1 -- 172.21.15.57:0/1973676474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8744100320 msgr2=0x7f8744114bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.342+0000 7f8741400640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8744100320 0x7f8744114bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.342+0000 7f8741400640 1 -- 172.21.15.57:0/1973676474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c005040 con 0x7f8744100c30 2024-02-28T16:16:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.343+0000 7f8741400640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8744100c30 0x7f87441150f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f872c031720 tx=0x7f872c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.343+0000 7f873a000640 1 -- 172.21.15.57:0/1973676474 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f872c0094c0 con 0x7f8744100c30 2024-02-28T16:16:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.343+0000 7f873a000640 1 -- 172.21.15.57:0/1973676474 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f872c009620 con 0x7f8744100c30 2024-02-28T16:16:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.343+0000 7f8743200640 1 -- 172.21.15.57:0/1973676474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874410ef00 con 0x7f8744100c30 2024-02-28T16:16:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.343+0000 7f873a000640 1 -- 172.21.15.57:0/1973676474 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f872c03b640 con 0x7f8744100c30 2024-02-28T16:16:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.343+0000 7f8743200640 1 -- 172.21.15.57:0/1973676474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874410f420 con 0x7f8744100c30 2024-02-28T16:16:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.344+0000 7f8743200640 1 -- 172.21.15.57:0/1973676474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874404bcc0 con 0x7f8744100c30 2024-02-28T16:16:25.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.345+0000 7f873a000640 1 -- 172.21.15.57:0/1973676474 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f872c02f070 con 0x7f8744100c30 2024-02-28T16:16:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.346+0000 7f873a000640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f872806d750 0x7f872806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.346+0000 7f873a000640 1 -- 172.21.15.57:0/1973676474 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f872c0af660 con 0x7f8744100c30 2024-02-28T16:16:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.346+0000 7f8741e00640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f872806d750 0x7f872806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:25.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.347+0000 7f8741e00640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f872806d750 0x7f872806fc00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8734007fd0 tx=0x7f8734009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.351+0000 7f873a000640 1 -- 172.21.15.57:0/1973676474 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f872c078cb0 con 0x7f8744100c30 2024-02-28T16:16:25.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.593+0000 7f8743200640 1 -- 172.21.15.57:0/1973676474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f874410f5b0 con 0x7f8744100c30 2024-02-28T16:16:25.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.594+0000 7f873a000640 1 -- 172.21.15.57:0/1973676474 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v41) v1 ==== 107+0+4113 (secure 0 0 0) 0x7f872c07c370 con 0x7f8744100c30 2024-02-28T16:16:25.585 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:25.585 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:11:29.712983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:25.586 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 33 2024-02-28T16:16:25.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 -- 172.21.15.57:0/1973676474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f872806d750 msgr2=0x7f872806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:25.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f872806d750 0x7f872806fc00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8734007fd0 tx=0x7f8734009e90 comp rx=0 tx=0).stop 2024-02-28T16:16:25.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 -- 172.21.15.57:0/1973676474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8744100c30 msgr2=0x7f87441150f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:25.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8744100c30 0x7f87441150f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f872c031720 tx=0x7f872c009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 -- 172.21.15.57:0/1973676474 shutdown_connections 2024-02-28T16:16:25.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f872806d750 0x7f872806fc00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8744100c30 0x7f87441150f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 --2- 172.21.15.57:0/1973676474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8744100320 0x7f8744114bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 -- 172.21.15.57:0/1973676474 >> 172.21.15.57:0/1973676474 conn(0x7f87440f5f70 msgr2=0x7f87441010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 -- 172.21.15.57:0/1973676474 shutdown_connections 2024-02-28T16:16:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.597+0000 7f8743200640 1 -- 172.21.15.57:0/1973676474 wait complete. 2024-02-28T16:16:25.606 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-02-28T16:16:25.606 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-02-28T16:16:25.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-28T16:16:25.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.835+0000 7f7ff3200640 1 -- 172.21.15.57:0/1646008399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff40722e0 msgr2=0x7f7ff410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:25.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.835+0000 7f7ff3200640 1 --2- 172.21.15.57:0/1646008399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff40722e0 0x7f7ff410cab0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00048d0 tx=0x7f7fe0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.835+0000 7f7ff3200640 1 -- 172.21.15.57:0/1646008399 shutdown_connections 2024-02-28T16:16:25.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.835+0000 7f7ff3200640 1 --2- 172.21.15.57:0/1646008399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff40722e0 0x7f7ff410cab0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.835+0000 7f7ff3200640 1 --2- 172.21.15.57:0/1646008399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff40719d0 0x7f7ff4071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.835+0000 7f7ff3200640 1 -- 172.21.15.57:0/1646008399 >> 172.21.15.57:0/1646008399 conn(0x7f7ff40f9f90 msgr2=0x7f7ff40fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:25.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.836+0000 7f7ff3200640 1 -- 172.21.15.57:0/1646008399 shutdown_connections 2024-02-28T16:16:25.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.836+0000 7f7ff3200640 1 -- 172.21.15.57:0/1646008399 wait complete. 2024-02-28T16:16:25.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.836+0000 7f7ff3200640 1 Processor -- start 2024-02-28T16:16:25.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.836+0000 7f7ff3200640 1 -- start start 2024-02-28T16:16:25.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.837+0000 7f7ff3200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff40719d0 0x7f7ff41190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:25.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.837+0000 7f7ff3200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff40722e0 0x7f7ff41195f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:25.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.837+0000 7f7ff3200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4119bf0 con 0x7f7ff40722e0 2024-02-28T16:16:25.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.837+0000 7f7ff3200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4113180 con 0x7f7ff40719d0 2024-02-28T16:16:25.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.837+0000 7f7ff1400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff40722e0 0x7f7ff41195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:25.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.837+0000 7f7ff1400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff40722e0 0x7f7ff41195f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35138/0 (socket says 172.21.15.57:35138) 2024-02-28T16:16:25.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.837+0000 7f7ff1400640 1 -- 172.21.15.57:0/848921426 learned_addr learned my addr 172.21.15.57:0/848921426 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:25.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.838+0000 7f7ff1e00640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff40719d0 0x7f7ff41190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:25.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.838+0000 7f7ff1400640 1 -- 172.21.15.57:0/848921426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff40719d0 msgr2=0x7f7ff41190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:25.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.838+0000 7f7ff1400640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff40719d0 0x7f7ff41190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:25.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.838+0000 7f7ff1400640 1 -- 172.21.15.57:0/848921426 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0005040 con 0x7f7ff40722e0 2024-02-28T16:16:25.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.838+0000 7f7ff1400640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff40722e0 0x7f7ff41195f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7fe002bda0 tx=0x7f7fe0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:25.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.838+0000 7f7fea000640 1 -- 172.21.15.57:0/848921426 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe0009590 con 0x7f7ff40722e0 2024-02-28T16:16:25.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.839+0000 7f7fea000640 1 -- 172.21.15.57:0/848921426 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fe00096f0 con 0x7f7ff40722e0 2024-02-28T16:16:25.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.839+0000 7f7ff3200640 1 -- 172.21.15.57:0/848921426 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff4113400 con 0x7f7ff40722e0 2024-02-28T16:16:25.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.839+0000 7f7fea000640 1 -- 172.21.15.57:0/848921426 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe00435f0 con 0x7f7ff40722e0 2024-02-28T16:16:25.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.839+0000 7f7ff3200640 1 -- 172.21.15.57:0/848921426 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff41138c0 con 0x7f7ff40722e0 2024-02-28T16:16:25.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.840+0000 7f7ff3200640 1 -- 172.21.15.57:0/848921426 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff404bcc0 con 0x7f7ff40722e0 2024-02-28T16:16:25.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.841+0000 7f7fea000640 1 -- 172.21.15.57:0/848921426 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f7fe002f070 con 0x7f7ff40722e0 2024-02-28T16:16:25.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.842+0000 7f7fea000640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fd806d760 0x7f7fd806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:25.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.842+0000 7f7fea000640 1 -- 172.21.15.57:0/848921426 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f7fe00aefb0 con 0x7f7ff40722e0 2024-02-28T16:16:25.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.842+0000 7f7ff1e00640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fd806d760 0x7f7fd806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:25.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.843+0000 7f7ff1e00640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fd806d760 0x7f7fd806fc10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4004e40 tx=0x7f7fe4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:25.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:25.847+0000 7f7fea000640 1 -- 172.21.15.57:0/848921426 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7fe00786a0 con 0x7f7ff40722e0 2024-02-28T16:16:25.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:25 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2580154432' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-28T16:16:25.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:25 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1973676474' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-28T16:16:26.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.090+0000 7f7ff3200640 1 -- 172.21.15.57:0/848921426 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f7ff410a150 con 0x7f7ff40722e0 2024-02-28T16:16:26.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.091+0000 7f7fea000640 1 -- 172.21.15.57:0/848921426 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v41) v1 ==== 107+0+4926 (secure 0 0 0) 0x7f7fe007bd60 con 0x7f7ff40722e0 2024-02-28T16:16:26.083 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:26.083 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34522,"name":"cephfs.smithi057.qwatmu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6829/2553742021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2553742021},{"type":"v1","addr":"172.21.15.57:6829","nonce":2553742021}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44327,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/456812589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":456812589},{"type":"v1","addr":"172.21.15.87:6825","nonce":456812589}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:11:29.712983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:26.083 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 34 2024-02-28T16:16:26.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.094+0000 7f7ff3200640 1 -- 172.21.15.57:0/848921426 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fd806d760 msgr2=0x7f7fd806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:26.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.094+0000 7f7ff3200640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fd806d760 0x7f7fd806fc10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4004e40 tx=0x7f7fe4009040 comp rx=0 tx=0).stop 2024-02-28T16:16:26.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.094+0000 7f7ff3200640 1 -- 172.21.15.57:0/848921426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff40722e0 msgr2=0x7f7ff41195f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:26.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.094+0000 7f7ff3200640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff40722e0 0x7f7ff41195f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7fe002bda0 tx=0x7f7fe0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.095+0000 7f7ff3200640 1 -- 172.21.15.57:0/848921426 shutdown_connections 2024-02-28T16:16:26.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.095+0000 7f7ff3200640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f7fd806d760 0x7f7fd806fc10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.095+0000 7f7ff3200640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff40722e0 0x7f7ff41195f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.095+0000 7f7ff3200640 1 --2- 172.21.15.57:0/848921426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff40719d0 0x7f7ff41190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.095+0000 7f7ff3200640 1 -- 172.21.15.57:0/848921426 >> 172.21.15.57:0/848921426 conn(0x7f7ff40f9f90 msgr2=0x7f7ff40fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:26.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.095+0000 7f7ff3200640 1 -- 172.21.15.57:0/848921426 shutdown_connections 2024-02-28T16:16:26.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.095+0000 7f7ff3200640 1 -- 172.21.15.57:0/848921426 wait complete. 2024-02-28T16:16:26.105 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-02-28T16:16:26.105 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-02-28T16:16:26.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-02-28T16:16:26.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:25 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2580154432' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-28T16:16:26.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:25 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1973676474' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-28T16:16:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.329+0000 7f1c5b200640 1 -- 172.21.15.57:0/3051413119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c5c102140 msgr2=0x7f1c5c102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.329+0000 7f1c5b200640 1 --2- 172.21.15.57:0/3051413119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c5c102140 0x7f1c5c102510 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1c440048d0 tx=0x7f1c44009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.329+0000 7f1c5b200640 1 -- 172.21.15.57:0/3051413119 shutdown_connections 2024-02-28T16:16:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.329+0000 7f1c5b200640 1 --2- 172.21.15.57:0/3051413119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c5c102ae0 0x7f1c5c0fc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.329+0000 7f1c5b200640 1 --2- 172.21.15.57:0/3051413119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c5c102140 0x7f1c5c102510 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.329+0000 7f1c5b200640 1 -- 172.21.15.57:0/3051413119 >> 172.21.15.57:0/3051413119 conn(0x7f1c5c0f7d90 msgr2=0x7f1c5c0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.329+0000 7f1c5b200640 1 -- 172.21.15.57:0/3051413119 shutdown_connections 2024-02-28T16:16:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.330+0000 7f1c5b200640 1 -- 172.21.15.57:0/3051413119 wait complete. 2024-02-28T16:16:26.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.330+0000 7f1c5b200640 1 Processor -- start 2024-02-28T16:16:26.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.331+0000 7f1c5b200640 1 -- start start 2024-02-28T16:16:26.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.331+0000 7f1c5b200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c5c102ae0 0x7f1c5c114d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:26.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.331+0000 7f1c5b200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c5c1152d0 0x7f1c5c10ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:26.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.331+0000 7f1c5b200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c115850 con 0x7f1c5c102ae0 2024-02-28T16:16:26.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.331+0000 7f1c5b200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c115990 con 0x7f1c5c1152d0 2024-02-28T16:16:26.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.331+0000 7f1c59e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c5c102ae0 0x7f1c5c114d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:26.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.331+0000 7f1c59e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c5c102ae0 0x7f1c5c114d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35156/0 (socket says 172.21.15.57:35156) 2024-02-28T16:16:26.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.331+0000 7f1c59e00640 1 -- 172.21.15.57:0/3322900869 learned_addr learned my addr 172.21.15.57:0/3322900869 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:26.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.332+0000 7f1c59400640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c5c1152d0 0x7f1c5c10ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:26.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.332+0000 7f1c59e00640 1 -- 172.21.15.57:0/3322900869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c5c1152d0 msgr2=0x7f1c5c10ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:26.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.332+0000 7f1c59e00640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c5c1152d0 0x7f1c5c10ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.332+0000 7f1c59e00640 1 -- 172.21.15.57:0/3322900869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44005040 con 0x7f1c5c102ae0 2024-02-28T16:16:26.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.332+0000 7f1c59e00640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c5c102ae0 0x7f1c5c114d90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009040 tx=0x7f1c44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:26.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.333+0000 7f1c52000640 1 -- 172.21.15.57:0/3322900869 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c440092b0 con 0x7f1c5c102ae0 2024-02-28T16:16:26.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.333+0000 7f1c52000640 1 -- 172.21.15.57:0/3322900869 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c44004290 con 0x7f1c5c102ae0 2024-02-28T16:16:26.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.333+0000 7f1c52000640 1 -- 172.21.15.57:0/3322900869 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4403b400 con 0x7f1c5c102ae0 2024-02-28T16:16:26.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.333+0000 7f1c5b200640 1 -- 172.21.15.57:0/3322900869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c10f400 con 0x7f1c5c102ae0 2024-02-28T16:16:26.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.333+0000 7f1c5b200640 1 -- 172.21.15.57:0/3322900869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c10f8f0 con 0x7f1c5c102ae0 2024-02-28T16:16:26.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.334+0000 7f1c5b200640 1 -- 172.21.15.57:0/3322900869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c04bcc0 con 0x7f1c5c102ae0 2024-02-28T16:16:26.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.335+0000 7f1c52000640 1 -- 172.21.15.57:0/3322900869 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f1c4402f070 con 0x7f1c5c102ae0 2024-02-28T16:16:26.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.337+0000 7f1c52000640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1c4006d760 0x7f1c4006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:26.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.337+0000 7f1c52000640 1 -- 172.21.15.57:0/3322900869 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f1c440af4a0 con 0x7f1c5c102ae0 2024-02-28T16:16:26.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.337+0000 7f1c59400640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1c4006d760 0x7f1c4006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:26.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.338+0000 7f1c59400640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1c4006d760 0x7f1c4006fc10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c004ec0 tx=0x7f1c4c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:26.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.343+0000 7f1c52000640 1 -- 172.21.15.57:0/3322900869 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1c44078b70 con 0x7f1c5c102ae0 2024-02-28T16:16:26.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.586+0000 7f1c5b200640 1 -- 172.21.15.57:0/3322900869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f1c5c1092a0 con 0x7f1c5c102ae0 2024-02-28T16:16:26.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.587+0000 7f1c52000640 1 -- 172.21.15.57:0/3322900869 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v41) v1 ==== 107+0+4150 (secure 0 0 0) 0x7f1c4407c230 con 0x7f1c5c102ae0 2024-02-28T16:16:26.578 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:26.579 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34522,"name":"cephfs.smithi057.qwatmu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6829/2553742021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2553742021},{"type":"v1","addr":"172.21.15.57:6829","nonce":2553742021}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:11:29.712983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:26.579 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 35 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.590+0000 7f1c5b200640 1 -- 172.21.15.57:0/3322900869 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1c4006d760 msgr2=0x7f1c4006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.590+0000 7f1c5b200640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1c4006d760 0x7f1c4006fc10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c004ec0 tx=0x7f1c4c00b040 comp rx=0 tx=0).stop 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.590+0000 7f1c5b200640 1 -- 172.21.15.57:0/3322900869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c5c102ae0 msgr2=0x7f1c5c114d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.590+0000 7f1c5b200640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c5c102ae0 0x7f1c5c114d90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009040 tx=0x7f1c44009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.590+0000 7f1c5b200640 1 -- 172.21.15.57:0/3322900869 shutdown_connections 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.590+0000 7f1c5b200640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f1c4006d760 0x7f1c4006fc10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.590+0000 7f1c5b200640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c5c1152d0 0x7f1c5c10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.590+0000 7f1c5b200640 1 --2- 172.21.15.57:0/3322900869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c5c102ae0 0x7f1c5c114d90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.590+0000 7f1c5b200640 1 -- 172.21.15.57:0/3322900869 >> 172.21.15.57:0/3322900869 conn(0x7f1c5c0f7d90 msgr2=0x7f1c5c06fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.590+0000 7f1c5b200640 1 -- 172.21.15.57:0/3322900869 shutdown_connections 2024-02-28T16:16:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.591+0000 7f1c5b200640 1 -- 172.21.15.57:0/3322900869 wait complete. 2024-02-28T16:16:26.601 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-02-28T16:16:26.601 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-02-28T16:16:26.601 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-02-28T16:16:26.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.823+0000 7fb44f200640 1 -- 172.21.15.57:0/3899662595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb448102100 msgr2=0x7fb4481024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.823+0000 7fb44f200640 1 --2- 172.21.15.57:0/3899662595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb448102100 0x7fb4481024d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0048d0 tx=0x7fb43c009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.823+0000 7fb44f200640 1 -- 172.21.15.57:0/3899662595 shutdown_connections 2024-02-28T16:16:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.823+0000 7fb44f200640 1 --2- 172.21.15.57:0/3899662595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb448102aa0 0x7fb4480fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.823+0000 7fb44f200640 1 --2- 172.21.15.57:0/3899662595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb448102100 0x7fb4481024d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.823+0000 7fb44f200640 1 -- 172.21.15.57:0/3899662595 >> 172.21.15.57:0/3899662595 conn(0x7fb4480f7cf0 msgr2=0x7fb4480fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.823+0000 7fb44f200640 1 -- 172.21.15.57:0/3899662595 shutdown_connections 2024-02-28T16:16:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.823+0000 7fb44f200640 1 -- 172.21.15.57:0/3899662595 wait complete. 2024-02-28T16:16:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.824+0000 7fb44f200640 1 Processor -- start 2024-02-28T16:16:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.824+0000 7fb44f200640 1 -- start start 2024-02-28T16:16:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.824+0000 7fb44f200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb448102100 0x7fb448114c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.824+0000 7fb44f200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb448102aa0 0x7fb448115190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.824+0000 7fb44f200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb448115820 con 0x7fb448102100 2024-02-28T16:16:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.824+0000 7fb44f200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44810ed20 con 0x7fb448102aa0 2024-02-28T16:16:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.825+0000 7fb44de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb448102100 0x7fb448114c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.825+0000 7fb44de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb448102100 0x7fb448114c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35178/0 (socket says 172.21.15.57:35178) 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.825+0000 7fb44de00640 1 -- 172.21.15.57:0/553314449 learned_addr learned my addr 172.21.15.57:0/553314449 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.825+0000 7fb44d400640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb448102aa0 0x7fb448115190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.825+0000 7fb44de00640 1 -- 172.21.15.57:0/553314449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb448102aa0 msgr2=0x7fb448115190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.825+0000 7fb44de00640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb448102aa0 0x7fb448115190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.825+0000 7fb44de00640 1 -- 172.21.15.57:0/553314449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c005040 con 0x7fb448102100 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.825+0000 7fb44de00640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb448102100 0x7fb448114c50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb43c02bda0 tx=0x7fb43c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.826+0000 7fb442000640 1 -- 172.21.15.57:0/553314449 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43c0094c0 con 0x7fb448102100 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.826+0000 7fb442000640 1 -- 172.21.15.57:0/553314449 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb43c009620 con 0x7fb448102100 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.826+0000 7fb442000640 1 -- 172.21.15.57:0/553314449 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43c0435f0 con 0x7fb448102100 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.826+0000 7fb44f200640 1 -- 172.21.15.57:0/553314449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44810efa0 con 0x7fb448102100 2024-02-28T16:16:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.826+0000 7fb44f200640 1 -- 172.21.15.57:0/553314449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44810f460 con 0x7fb448102100 2024-02-28T16:16:26.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.827+0000 7fb44f200640 1 -- 172.21.15.57:0/553314449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44804bcc0 con 0x7fb448102100 2024-02-28T16:16:26.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.828+0000 7fb442000640 1 -- 172.21.15.57:0/553314449 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb43c02f070 con 0x7fb448102100 2024-02-28T16:16:26.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.829+0000 7fb442000640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb43006d760 0x7fb43006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:26.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.829+0000 7fb442000640 1 -- 172.21.15.57:0/553314449 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fb43c0aeed0 con 0x7fb448102100 2024-02-28T16:16:26.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.829+0000 7fb44d400640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb43006d760 0x7fb43006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.830+0000 7fb44d400640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb43006d760 0x7fb43006fc10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb438006fd0 tx=0x7fb438008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:26.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:26.834+0000 7fb442000640 1 -- 172.21.15.57:0/553314449 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb43c0785c0 con 0x7fb448102100 2024-02-28T16:16:26.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:26 smithi057 ceph-mon[93219]: pgmap v413: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:26.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:26 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/848921426' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-28T16:16:26.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:26 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3322900869' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-28T16:16:27.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.076+0000 7fb44f200640 1 -- 172.21.15.57:0/553314449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7fb4481092c0 con 0x7fb448102100 2024-02-28T16:16:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.078+0000 7fb442000640 1 -- 172.21.15.57:0/553314449 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v41) v1 ==== 107+0+4960 (secure 0 0 0) 0x7fb43c07bc80 con 0x7fb448102100 2024-02-28T16:16:27.069 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:27.069 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34522,"name":"cephfs.smithi057.qwatmu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6829/2553742021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2553742021},{"type":"v1","addr":"172.21.15.57:6829","nonce":2553742021}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44319,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/3768145606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3768145606},{"type":"v1","addr":"172.21.15.87:6827","nonce":3768145606}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44391,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/571403132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":571403132},{"type":"v1","addr":"172.21.15.87:6825","nonce":571403132}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:11:29.712983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2024-02-28T16:16:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.080+0000 7fb44f200640 1 -- 172.21.15.57:0/553314449 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb43006d760 msgr2=0x7fb43006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.080+0000 7fb44f200640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb43006d760 0x7fb43006fc10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb438006fd0 tx=0x7fb438008040 comp rx=0 tx=0).stop 2024-02-28T16:16:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.080+0000 7fb44f200640 1 -- 172.21.15.57:0/553314449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb448102100 msgr2=0x7fb448114c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.080+0000 7fb44f200640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb448102100 0x7fb448114c50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb43c02bda0 tx=0x7fb43c009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.080+0000 7fb44f200640 1 -- 172.21.15.57:0/553314449 shutdown_connections 2024-02-28T16:16:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.080+0000 7fb44f200640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb43006d760 0x7fb43006fc10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.081+0000 7fb44f200640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb448102aa0 0x7fb448115190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.081+0000 7fb44f200640 1 --2- 172.21.15.57:0/553314449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb448102100 0x7fb448114c50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.081+0000 7fb44f200640 1 -- 172.21.15.57:0/553314449 >> 172.21.15.57:0/553314449 conn(0x7fb4480f7cf0 msgr2=0x7fb4480f96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.081+0000 7fb44f200640 1 -- 172.21.15.57:0/553314449 shutdown_connections 2024-02-28T16:16:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.081+0000 7fb44f200640 1 -- 172.21.15.57:0/553314449 wait complete. 2024-02-28T16:16:27.089 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-02-28T16:16:27.089 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-02-28T16:16:27.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-02-28T16:16:27.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:26 smithi087 ceph-mon[82628]: pgmap v413: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:27.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:26 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/848921426' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-28T16:16:27.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:26 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3322900869' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-28T16:16:27.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.314+0000 7f001b200640 1 -- 172.21.15.57:0/869448825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0014101240 msgr2=0x7f0014101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:27.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.314+0000 7f001b200640 1 --2- 172.21.15.57:0/869448825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0014101240 0x7f0014101610 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f00040048d0 tx=0x7f0004009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.314+0000 7f001b200640 1 -- 172.21.15.57:0/869448825 shutdown_connections 2024-02-28T16:16:27.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.314+0000 7f001b200640 1 --2- 172.21.15.57:0/869448825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0014101be0 0x7f00140fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.314+0000 7f001b200640 1 --2- 172.21.15.57:0/869448825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0014101240 0x7f0014101610 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.314+0000 7f001b200640 1 -- 172.21.15.57:0/869448825 >> 172.21.15.57:0/869448825 conn(0x7f00140f6e30 msgr2=0x7f00140f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:27.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.314+0000 7f001b200640 1 -- 172.21.15.57:0/869448825 shutdown_connections 2024-02-28T16:16:27.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.314+0000 7f001b200640 1 -- 172.21.15.57:0/869448825 wait complete. 2024-02-28T16:16:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.315+0000 7f001b200640 1 Processor -- start 2024-02-28T16:16:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.315+0000 7f001b200640 1 -- start start 2024-02-28T16:16:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.315+0000 7f001b200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0014101240 0x7f00141020c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.315+0000 7f001b200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0014101be0 0x7f0014102600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.315+0000 7f001b200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0014104060 con 0x7f0014101be0 2024-02-28T16:16:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.315+0000 7f001b200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0014102b40 con 0x7f0014101240 2024-02-28T16:16:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.316+0000 7f000be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0014101be0 0x7f0014102600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.316+0000 7f000be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0014101be0 0x7f0014102600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35196/0 (socket says 172.21.15.57:35196) 2024-02-28T16:16:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.316+0000 7f000be00640 1 -- 172.21.15.57:0/2747495081 learned_addr learned my addr 172.21.15.57:0/2747495081 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.316+0000 7f0013e00640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0014101240 0x7f00141020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.316+0000 7f000be00640 1 -- 172.21.15.57:0/2747495081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0014101240 msgr2=0x7f00141020c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.316+0000 7f000be00640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0014101240 0x7f00141020c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.316+0000 7f000be00640 1 -- 172.21.15.57:0/2747495081 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004005040 con 0x7f0014101be0 2024-02-28T16:16:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.317+0000 7f000be00640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0014101be0 0x7f0014102600 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efffc002a50 tx=0x7efffc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.317+0000 7f0010c00640 1 -- 172.21.15.57:0/2747495081 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efffc007c30 con 0x7f0014101be0 2024-02-28T16:16:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.317+0000 7f0010c00640 1 -- 172.21.15.57:0/2747495081 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efffc00f040 con 0x7f0014101be0 2024-02-28T16:16:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.317+0000 7f0010c00640 1 -- 172.21.15.57:0/2747495081 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efffc00db50 con 0x7f0014101be0 2024-02-28T16:16:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.317+0000 7f001b200640 1 -- 172.21.15.57:0/2747495081 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0014102df0 con 0x7f0014101be0 2024-02-28T16:16:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.317+0000 7f001b200640 1 -- 172.21.15.57:0/2747495081 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00141192a0 con 0x7f0014101be0 2024-02-28T16:16:27.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.318+0000 7f001b200640 1 -- 172.21.15.57:0/2747495081 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0014064480 con 0x7f0014101be0 2024-02-28T16:16:27.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.319+0000 7f0010c00640 1 -- 172.21.15.57:0/2747495081 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7efffc01c400 con 0x7f0014101be0 2024-02-28T16:16:27.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.320+0000 7f0010c00640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efff806d750 0x7efff806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:27.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.320+0000 7f0010c00640 1 -- 172.21.15.57:0/2747495081 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7efffc08c9a0 con 0x7f0014101be0 2024-02-28T16:16:27.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.320+0000 7f0013e00640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efff806d750 0x7efff806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.321+0000 7f0013e00640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efff806d750 0x7efff806fc00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0004004540 tx=0x7f0004009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.325+0000 7f0010c00640 1 -- 172.21.15.57:0/2747495081 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efffc055ff0 con 0x7f0014101be0 2024-02-28T16:16:27.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.566+0000 7f001b200640 1 -- 172.21.15.57:0/2747495081 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f00141194c0 con 0x7f0014101be0 2024-02-28T16:16:27.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.567+0000 7f0010c00640 1 -- 172.21.15.57:0/2747495081 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v41) v1 ==== 107+0+4181 (secure 0 0 0) 0x7efffc0596b0 con 0x7f0014101be0 2024-02-28T16:16:27.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:27.558 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34522,"name":"cephfs.smithi057.qwatmu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6829/2553742021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2553742021},{"type":"v1","addr":"172.21.15.57:6829","nonce":2553742021}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44391,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/571403132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":571403132},{"type":"v1","addr":"172.21.15.87:6825","nonce":571403132}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:11:29.712983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:27.558 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 37 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.569+0000 7f001b200640 1 -- 172.21.15.57:0/2747495081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efff806d750 msgr2=0x7efff806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.569+0000 7f001b200640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efff806d750 0x7efff806fc00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0004004540 tx=0x7f0004009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.569+0000 7f001b200640 1 -- 172.21.15.57:0/2747495081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0014101be0 msgr2=0x7f0014102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.569+0000 7f001b200640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0014101be0 0x7f0014102600 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efffc002a50 tx=0x7efffc004600 comp rx=0 tx=0).stop 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.570+0000 7f001b200640 1 -- 172.21.15.57:0/2747495081 shutdown_connections 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.570+0000 7f001b200640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efff806d750 0x7efff806fc00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.570+0000 7f001b200640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0014101be0 0x7f0014102600 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.570+0000 7f001b200640 1 --2- 172.21.15.57:0/2747495081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0014101240 0x7f00141020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.570+0000 7f001b200640 1 -- 172.21.15.57:0/2747495081 >> 172.21.15.57:0/2747495081 conn(0x7f00140f6e30 msgr2=0x7f0014065650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.570+0000 7f001b200640 1 -- 172.21.15.57:0/2747495081 shutdown_connections 2024-02-28T16:16:27.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.570+0000 7f001b200640 1 -- 172.21.15.57:0/2747495081 wait complete. 2024-02-28T16:16:27.579 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-02-28T16:16:27.579 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-02-28T16:16:27.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-02-28T16:16:27.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.798+0000 7f2cf1600640 1 -- 172.21.15.57:0/2699059452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec102120 msgr2=0x7f2cec1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:27.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.798+0000 7f2cf1600640 1 --2- 172.21.15.57:0/2699059452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec102120 0x7f2cec1024f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009c50 tx=0x7f2cdc004d10 comp rx=0 tx=0).stop 2024-02-28T16:16:27.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.798+0000 7f2cf1600640 1 -- 172.21.15.57:0/2699059452 shutdown_connections 2024-02-28T16:16:27.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.798+0000 7f2cf1600640 1 --2- 172.21.15.57:0/2699059452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cec102ac0 0x7f2cec0fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.798+0000 7f2cf1600640 1 --2- 172.21.15.57:0/2699059452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec102120 0x7f2cec1024f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.798+0000 7f2cf1600640 1 -- 172.21.15.57:0/2699059452 >> 172.21.15.57:0/2699059452 conn(0x7f2cec0f7cf0 msgr2=0x7f2cec0fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:27.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.798+0000 7f2cf1600640 1 -- 172.21.15.57:0/2699059452 shutdown_connections 2024-02-28T16:16:27.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.798+0000 7f2cf1600640 1 -- 172.21.15.57:0/2699059452 wait complete. 2024-02-28T16:16:27.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.799+0000 7f2cf1600640 1 Processor -- start 2024-02-28T16:16:27.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.799+0000 7f2cf1600640 1 -- start start 2024-02-28T16:16:27.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.799+0000 7f2cf1600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cec102120 0x7f2cec112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:27.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.799+0000 7f2cf1600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec102ac0 0x7f2cec112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:27.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.799+0000 7f2cf1600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1135d0 con 0x7f2cec102ac0 2024-02-28T16:16:27.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.799+0000 7f2cf1600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec10cb30 con 0x7f2cec102120 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.799+0000 7f2ceb400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec102ac0 0x7f2cec112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.800+0000 7f2ceb400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec102ac0 0x7f2cec112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35218/0 (socket says 172.21.15.57:35218) 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.800+0000 7f2ceb400640 1 -- 172.21.15.57:0/1781527809 learned_addr learned my addr 172.21.15.57:0/1781527809 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.800+0000 7f2cebe00640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cec102120 0x7f2cec112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.800+0000 7f2ceb400640 1 -- 172.21.15.57:0/1781527809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cec102120 msgr2=0x7f2cec112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.800+0000 7f2ceb400640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cec102120 0x7f2cec112a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.800+0000 7f2ceb400640 1 -- 172.21.15.57:0/1781527809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc0098b0 con 0x7f2cec102ac0 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.800+0000 7f2cebe00640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cec102120 0x7f2cec112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.800+0000 7f2ceb400640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec102ac0 0x7f2cec112f80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800c810 tx=0x7f2cd80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.800+0000 7f2ce3e00640 1 -- 172.21.15.57:0/1781527809 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd800a820 con 0x7f2cec102ac0 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.801+0000 7f2ce3e00640 1 -- 172.21.15.57:0/1781527809 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2cd800ae50 con 0x7f2cec102ac0 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.801+0000 7f2ce3e00640 1 -- 172.21.15.57:0/1781527809 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd80115c0 con 0x7f2cec102ac0 2024-02-28T16:16:27.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.801+0000 7f2cf1600640 1 -- 172.21.15.57:0/1781527809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec10ce10 con 0x7f2cec102ac0 2024-02-28T16:16:27.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.801+0000 7f2cf1600640 1 -- 172.21.15.57:0/1781527809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec10d330 con 0x7f2cec102ac0 2024-02-28T16:16:27.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.802+0000 7f2cf1600640 1 -- 172.21.15.57:0/1781527809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec04bcc0 con 0x7f2cec102ac0 2024-02-28T16:16:27.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.803+0000 7f2ce3e00640 1 -- 172.21.15.57:0/1781527809 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f2cd800a980 con 0x7f2cec102ac0 2024-02-28T16:16:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.804+0000 7f2ce3e00640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2cd006d750 0x7f2cd006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.804+0000 7f2ce3e00640 1 -- 172.21.15.57:0/1781527809 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f2cd808d590 con 0x7f2cec102ac0 2024-02-28T16:16:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.804+0000 7f2cebe00640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2cd006d750 0x7f2cd006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:27.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.805+0000 7f2cebe00640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2cd006d750 0x7f2cd006fc00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc02c110 tx=0x7f2cdc02e040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:27.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:27.811+0000 7f2ce3e00640 1 -- 172.21.15.57:0/1781527809 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2cd805a790 con 0x7f2cec102ac0 2024-02-28T16:16:27.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:27 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/553314449' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-28T16:16:27.926 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:27 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2747495081' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-28T16:16:28.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.045+0000 7f2cf1600640 1 -- 172.21.15.57:0/1781527809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f2cec10dfd0 con 0x7f2cec102ac0 2024-02-28T16:16:28.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.046+0000 7f2ce3e00640 1 -- 172.21.15.57:0/1781527809 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v41) v1 ==== 107+0+4994 (secure 0 0 0) 0x7f2cd805a320 con 0x7f2cec102ac0 2024-02-28T16:16:28.038 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:28.038 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34522,"name":"cephfs.smithi057.qwatmu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6829/2553742021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2553742021},{"type":"v1","addr":"172.21.15.57:6829","nonce":2553742021}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44391,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/571403132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":571403132},{"type":"v1","addr":"172.21.15.87:6825","nonce":571403132}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":44405,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/2114762616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2114762616},{"type":"v1","addr":"172.21.15.87:6827","nonce":2114762616}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:11:29.712983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:28.038 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2024-02-28T16:16:28.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 -- 172.21.15.57:0/1781527809 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2cd006d750 msgr2=0x7f2cd006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2cd006d750 0x7f2cd006fc00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc02c110 tx=0x7f2cdc02e040 comp rx=0 tx=0).stop 2024-02-28T16:16:28.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 -- 172.21.15.57:0/1781527809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec102ac0 msgr2=0x7f2cec112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec102ac0 0x7f2cec112f80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800c810 tx=0x7f2cd80043c0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 -- 172.21.15.57:0/1781527809 shutdown_connections 2024-02-28T16:16:28.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f2cd006d750 0x7f2cd006fc00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec102ac0 0x7f2cec112f80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 --2- 172.21.15.57:0/1781527809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cec102120 0x7f2cec112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 -- 172.21.15.57:0/1781527809 >> 172.21.15.57:0/1781527809 conn(0x7f2cec0f7cf0 msgr2=0x7f2cec0f9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:28.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 -- 172.21.15.57:0/1781527809 shutdown_connections 2024-02-28T16:16:28.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.049+0000 7f2cf1600640 1 -- 172.21.15.57:0/1781527809 wait complete. 2024-02-28T16:16:28.058 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-02-28T16:16:28.058 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-02-28T16:16:28.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-02-28T16:16:28.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:27 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/553314449' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-28T16:16:28.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:27 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2747495081' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-28T16:16:28.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.279+0000 7fa7abe00640 1 -- 172.21.15.57:0/3984172267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac06f7c0 msgr2=0x7fa7ac06fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.279+0000 7fa7abe00640 1 --2- 172.21.15.57:0/3984172267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac06f7c0 0x7fa7ac06fb90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0048d0 tx=0x7fa79c009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.279+0000 7fa7abe00640 1 -- 172.21.15.57:0/3984172267 shutdown_connections 2024-02-28T16:16:28.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.279+0000 7fa7abe00640 1 --2- 172.21.15.57:0/3984172267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac0700d0 0x7fa7ac1084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.279+0000 7fa7abe00640 1 --2- 172.21.15.57:0/3984172267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac06f7c0 0x7fa7ac06fb90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.279+0000 7fa7abe00640 1 -- 172.21.15.57:0/3984172267 >> 172.21.15.57:0/3984172267 conn(0x7fa7ac0f7cf0 msgr2=0x7fa7ac0fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:28.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.279+0000 7fa7abe00640 1 -- 172.21.15.57:0/3984172267 shutdown_connections 2024-02-28T16:16:28.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.279+0000 7fa7abe00640 1 -- 172.21.15.57:0/3984172267 wait complete. 2024-02-28T16:16:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.280+0000 7fa7abe00640 1 Processor -- start 2024-02-28T16:16:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.280+0000 7fa7abe00640 1 -- start start 2024-02-28T16:16:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.280+0000 7fa7abe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac06f7c0 0x7fa7ac114c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.280+0000 7fa7abe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0700d0 0x7fa7ac1151c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.280+0000 7fa7abe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac115850 con 0x7fa7ac0700d0 2024-02-28T16:16:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.280+0000 7fa7abe00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac10ed50 con 0x7fa7ac06f7c0 2024-02-28T16:16:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.281+0000 7fa7aa000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0700d0 0x7fa7ac1151c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.281+0000 7fa7aa000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0700d0 0x7fa7ac1151c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35228/0 (socket says 172.21.15.57:35228) 2024-02-28T16:16:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.281+0000 7fa7aa000640 1 -- 172.21.15.57:0/3145268259 learned_addr learned my addr 172.21.15.57:0/3145268259 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.281+0000 7fa7aaa00640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac06f7c0 0x7fa7ac114c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.281+0000 7fa7aa000640 1 -- 172.21.15.57:0/3145268259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac06f7c0 msgr2=0x7fa7ac114c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.281+0000 7fa7aa000640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac06f7c0 0x7fa7ac114c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.281+0000 7fa7aa000640 1 -- 172.21.15.57:0/3145268259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c005040 con 0x7fa7ac0700d0 2024-02-28T16:16:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.281+0000 7fa7aa000640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0700d0 0x7fa7ac1151c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa79800b790 tx=0x7fa7980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.281+0000 7fa7a2a00640 1 -- 172.21.15.57:0/3145268259 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa79800c700 con 0x7fa7ac0700d0 2024-02-28T16:16:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.282+0000 7fa7a2a00640 1 -- 172.21.15.57:0/3145268259 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa79800cd30 con 0x7fa7ac0700d0 2024-02-28T16:16:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.282+0000 7fa7abe00640 1 -- 172.21.15.57:0/3145268259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac10f030 con 0x7fa7ac0700d0 2024-02-28T16:16:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.282+0000 7fa7a2a00640 1 -- 172.21.15.57:0/3145268259 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa798013370 con 0x7fa7ac0700d0 2024-02-28T16:16:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.282+0000 7fa7abe00640 1 -- 172.21.15.57:0/3145268259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac10f550 con 0x7fa7ac0700d0 2024-02-28T16:16:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.283+0000 7fa7abe00640 1 -- 172.21.15.57:0/3145268259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac04bcc0 con 0x7fa7ac0700d0 2024-02-28T16:16:28.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.284+0000 7fa7a2a00640 1 -- 172.21.15.57:0/3145268259 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa798012070 con 0x7fa7ac0700d0 2024-02-28T16:16:28.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.285+0000 7fa7a2a00640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa79006d760 0x7fa79006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:28.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.286+0000 7fa7a2a00640 1 -- 172.21.15.57:0/3145268259 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fa79808caa0 con 0x7fa7ac0700d0 2024-02-28T16:16:28.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.286+0000 7fa7aaa00640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa79006d760 0x7fa79006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:28.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.287+0000 7fa7aaa00640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa79006d760 0x7fa79006fc10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa79c034040 tx=0x7fa79c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:28.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.290+0000 7fa7a2a00640 1 -- 172.21.15.57:0/3145268259 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa7980560f0 con 0x7fa7ac0700d0 2024-02-28T16:16:28.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.520+0000 7fa7abe00640 1 -- 172.21.15.57:0/3145268259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7fa7ac10b510 con 0x7fa7ac0700d0 2024-02-28T16:16:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.521+0000 7fa7a2a00640 1 -- 172.21.15.57:0/3145268259 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v41) v1 ==== 107+0+5011 (secure 0 0 0) 0x7fa7980597b0 con 0x7fa7ac0700d0 2024-02-28T16:16:28.513 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:28.513 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44391,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/571403132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":571403132},{"type":"v1","addr":"172.21.15.87:6825","nonce":571403132}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":44405,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/2114762616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2114762616},{"type":"v1","addr":"172.21.15.87:6827","nonce":2114762616}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:12:36.510496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34490,"mds_1":34522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34522":{"gid":34522,"name":"cephfs.smithi057.qwatmu","rank":1,"incarnation":39,"state":"up:starting","state_seq":1,"addr":"172.21.15.57:6829/2553742021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2553742021},{"type":"v1","addr":"172.21.15.57:6829","nonce":2553742021}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:28.513 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 39 2024-02-28T16:16:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.523+0000 7fa7abe00640 1 -- 172.21.15.57:0/3145268259 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa79006d760 msgr2=0x7fa79006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.524+0000 7fa7abe00640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa79006d760 0x7fa79006fc10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa79c034040 tx=0x7fa79c009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.524+0000 7fa7abe00640 1 -- 172.21.15.57:0/3145268259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0700d0 msgr2=0x7fa7ac1151c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.524+0000 7fa7abe00640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0700d0 0x7fa7ac1151c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa79800b790 tx=0x7fa7980091d0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.524+0000 7fa7abe00640 1 -- 172.21.15.57:0/3145268259 shutdown_connections 2024-02-28T16:16:28.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.524+0000 7fa7abe00640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa79006d760 0x7fa79006fc10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.524+0000 7fa7abe00640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0700d0 0x7fa7ac1151c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.524+0000 7fa7abe00640 1 --2- 172.21.15.57:0/3145268259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac06f7c0 0x7fa7ac114c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.524+0000 7fa7abe00640 1 -- 172.21.15.57:0/3145268259 >> 172.21.15.57:0/3145268259 conn(0x7fa7ac0f7cf0 msgr2=0x7fa7ac102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:28.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.524+0000 7fa7abe00640 1 -- 172.21.15.57:0/3145268259 shutdown_connections 2024-02-28T16:16:28.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.524+0000 7fa7abe00640 1 -- 172.21.15.57:0/3145268259 wait complete. 2024-02-28T16:16:28.533 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 39 2024-02-28T16:16:28.533 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-02-28T16:16:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.750+0000 7fb826600640 1 -- 172.21.15.57:0/737593641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb820102ae0 msgr2=0x7fb8200fc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.750+0000 7fb826600640 1 --2- 172.21.15.57:0/737593641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb820102ae0 0x7fb8200fc170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0048d0 tx=0x7fb80c009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.750+0000 7fb826600640 1 -- 172.21.15.57:0/737593641 shutdown_connections 2024-02-28T16:16:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.750+0000 7fb826600640 1 --2- 172.21.15.57:0/737593641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb820102ae0 0x7fb8200fc170 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.750+0000 7fb826600640 1 --2- 172.21.15.57:0/737593641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb820102140 0x7fb820102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.750+0000 7fb826600640 1 -- 172.21.15.57:0/737593641 >> 172.21.15.57:0/737593641 conn(0x7fb8200f7d90 msgr2=0x7fb8200fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.750+0000 7fb826600640 1 -- 172.21.15.57:0/737593641 shutdown_connections 2024-02-28T16:16:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.750+0000 7fb826600640 1 -- 172.21.15.57:0/737593641 wait complete. 2024-02-28T16:16:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.751+0000 7fb826600640 1 Processor -- start 2024-02-28T16:16:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.751+0000 7fb826600640 1 -- start start 2024-02-28T16:16:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.751+0000 7fb826600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb820102140 0x7fb82006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.751+0000 7fb826600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb820102ae0 0x7fb82006fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.751+0000 7fb826600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb820071740 con 0x7fb820102140 2024-02-28T16:16:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.751+0000 7fb826600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb820070220 con 0x7fb820102ae0 2024-02-28T16:16:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.751+0000 7fb825200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb820102140 0x7fb82006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.751+0000 7fb825200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb820102140 0x7fb82006f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35238/0 (socket says 172.21.15.57:35238) 2024-02-28T16:16:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.751+0000 7fb825200640 1 -- 172.21.15.57:0/431127638 learned_addr learned my addr 172.21.15.57:0/431127638 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.752+0000 7fb81fe00640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb820102ae0 0x7fb82006fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.752+0000 7fb825200640 1 -- 172.21.15.57:0/431127638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb820102ae0 msgr2=0x7fb82006fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.752+0000 7fb825200640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb820102ae0 0x7fb82006fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.752+0000 7fb825200640 1 -- 172.21.15.57:0/431127638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c005040 con 0x7fb820102140 2024-02-28T16:16:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.752+0000 7fb81fe00640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb820102ae0 0x7fb82006fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:16:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.752+0000 7fb825200640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb820102140 0x7fb82006f7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c810 tx=0x7fb8100043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.752+0000 7fb81cc00640 1 -- 172.21.15.57:0/431127638 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81000a820 con 0x7fb820102140 2024-02-28T16:16:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.752+0000 7fb81cc00640 1 -- 172.21.15.57:0/431127638 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb81000ae50 con 0x7fb820102140 2024-02-28T16:16:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.752+0000 7fb81cc00640 1 -- 172.21.15.57:0/431127638 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8100115c0 con 0x7fb820102140 2024-02-28T16:16:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.752+0000 7fb826600640 1 -- 172.21.15.57:0/431127638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8200704d0 con 0x7fb820102140 2024-02-28T16:16:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.753+0000 7fb826600640 1 -- 172.21.15.57:0/431127638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb820119030 con 0x7fb820102140 2024-02-28T16:16:28.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.754+0000 7fb826600640 1 -- 172.21.15.57:0/431127638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82004bcc0 con 0x7fb820102140 2024-02-28T16:16:28.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.755+0000 7fb81cc00640 1 -- 172.21.15.57:0/431127638 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb81000a980 con 0x7fb820102140 2024-02-28T16:16:28.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.756+0000 7fb81cc00640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb80406d760 0x7fb80406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:28.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.756+0000 7fb81cc00640 1 -- 172.21.15.57:0/431127638 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fb81008d5c0 con 0x7fb820102140 2024-02-28T16:16:28.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.756+0000 7fb81fe00640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb80406d760 0x7fb80406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:28.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.756+0000 7fb81fe00640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb80406d760 0x7fb80406fc10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb80c02bda0 tx=0x7fb80c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:28.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:28.761+0000 7fb81cc00640 1 -- 172.21.15.57:0/431127638 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb810056cb0 con 0x7fb820102140 2024-02-28T16:16:28.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.003+0000 7fb826600640 1 -- 172.21.15.57:0/431127638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7fb820109280 con 0x7fb820102140 2024-02-28T16:16:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.004+0000 7fb81cc00640 1 -- 172.21.15.57:0/431127638 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v41) v1 ==== 107+0+5009 (secure 0 0 0) 0x7fb81005a370 con 0x7fb820102140 2024-02-28T16:16:28.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:28.996 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44391,"name":"cephfs.smithi087.fzjgef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6825/571403132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":571403132},{"type":"v1","addr":"172.21.15.87:6825","nonce":571403132}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":44405,"name":"cephfs.smithi087.whebmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/2114762616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2114762616},{"type":"v1","addr":"172.21.15.87:6827","nonce":2114762616}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T15:58:03.684519+0000","modified":"2024-02-28T16:12:36.536632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34490,"mds_1":34522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34490":{"gid":34490,"name":"cephfs.smithi057.eztwsd","rank":0,"incarnation":30,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6827/995880144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":995880144},{"type":"v1","addr":"172.21.15.57:6827","nonce":995880144}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34522":{"gid":34522,"name":"cephfs.smithi057.qwatmu","rank":1,"incarnation":39,"state":"up:active","state_seq":17,"addr":"172.21.15.57:6829/2553742021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2553742021},{"type":"v1","addr":"172.21.15.57:6829","nonce":2553742021}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:16:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 40 2024-02-28T16:16:28.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 -- 172.21.15.57:0/431127638 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb80406d760 msgr2=0x7fb80406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb80406d760 0x7fb80406fc10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb80c02bda0 tx=0x7fb80c009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 -- 172.21.15.57:0/431127638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb820102140 msgr2=0x7fb82006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb820102140 0x7fb82006f7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c810 tx=0x7fb8100043c0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 -- 172.21.15.57:0/431127638 shutdown_connections 2024-02-28T16:16:28.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb80406d760 0x7fb80406fc10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb820102ae0 0x7fb82006fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 --2- 172.21.15.57:0/431127638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb820102140 0x7fb82006f7a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 -- 172.21.15.57:0/431127638 >> 172.21.15.57:0/431127638 conn(0x7fb8200f7d90 msgr2=0x7fb8200f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:28.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 -- 172.21.15.57:0/431127638 shutdown_connections 2024-02-28T16:16:28.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.007+0000 7fb826600640 1 -- 172.21.15.57:0/431127638 wait complete. 2024-02-28T16:16:29.018 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-28T16:16:29.029 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-28T16:16:29.030 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T16:16:29.030 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T16:16:29.085 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T16:16:29.085 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T16:16:29.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:16:29.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:28 smithi057 ceph-mon[93219]: pgmap v414: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:29.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:28 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1781527809' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-28T16:16:29.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:28 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3145268259' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-28T16:16:29.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:28 smithi087 ceph-mon[82628]: pgmap v414: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:29.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:28 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1781527809' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-28T16:16:29.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:28 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3145268259' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-28T16:16:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.368+0000 7ffb07200640 1 -- 172.21.15.57:0/2587029733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb08102850 msgr2=0x7ffb08102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.368+0000 7ffb07200640 1 --2- 172.21.15.57:0/2587029733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb08102850 0x7ffb08102ca0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40048d0 tx=0x7ffaf4009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.368+0000 7ffb07200640 1 -- 172.21.15.57:0/2587029733 shutdown_connections 2024-02-28T16:16:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.368+0000 7ffb07200640 1 --2- 172.21.15.57:0/2587029733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb08102850 0x7ffb08102ca0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.368+0000 7ffb07200640 1 --2- 172.21.15.57:0/2587029733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08108860 0x7ffb08108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.368+0000 7ffb07200640 1 -- 172.21.15.57:0/2587029733 >> 172.21.15.57:0/2587029733 conn(0x7ffb080720c0 msgr2=0x7ffb080744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.368+0000 7ffb07200640 1 -- 172.21.15.57:0/2587029733 shutdown_connections 2024-02-28T16:16:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.368+0000 7ffb07200640 1 -- 172.21.15.57:0/2587029733 wait complete. 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.369+0000 7ffb07200640 1 Processor -- start 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.369+0000 7ffb07200640 1 -- start start 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb07200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08102850 0x7ffb08119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb07200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb08108860 0x7ffb08119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb07200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08119b90 con 0x7ffb08108860 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb07200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08113120 con 0x7ffb08102850 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb05400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb08108860 0x7ffb08119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb05400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb08108860 0x7ffb08119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35262/0 (socket says 172.21.15.57:35262) 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb05400640 1 -- 172.21.15.57:0/758322165 learned_addr learned my addr 172.21.15.57:0/758322165 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb05e00640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08102850 0x7ffb08119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb05400640 1 -- 172.21.15.57:0/758322165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08102850 msgr2=0x7ffb08119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb05400640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08102850 0x7ffb08119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.370+0000 7ffb05400640 1 -- 172.21.15.57:0/758322165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf4005040 con 0x7ffb08108860 2024-02-28T16:16:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.371+0000 7ffb05400640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb08108860 0x7ffb08119590 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4031720 tx=0x7ffaf4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.371+0000 7ffafe000640 1 -- 172.21.15.57:0/758322165 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf40094c0 con 0x7ffb08108860 2024-02-28T16:16:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.371+0000 7ffafe000640 1 -- 172.21.15.57:0/758322165 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaf4009620 con 0x7ffb08108860 2024-02-28T16:16:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.371+0000 7ffafe000640 1 -- 172.21.15.57:0/758322165 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf403b640 con 0x7ffb08108860 2024-02-28T16:16:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.371+0000 7ffb07200640 1 -- 172.21.15.57:0/758322165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb081133a0 con 0x7ffb08108860 2024-02-28T16:16:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.372+0000 7ffb07200640 1 -- 172.21.15.57:0/758322165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb081138c0 con 0x7ffb08108860 2024-02-28T16:16:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.373+0000 7ffb07200640 1 -- 172.21.15.57:0/758322165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0804bcc0 con 0x7ffb08108860 2024-02-28T16:16:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.374+0000 7ffafe000640 1 -- 172.21.15.57:0/758322165 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7ffaf402f070 con 0x7ffb08108860 2024-02-28T16:16:29.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.375+0000 7ffafe000640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffaec06d750 0x7ffaec06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:29.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.375+0000 7ffafe000640 1 -- 172.21.15.57:0/758322165 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ffaf40af4c0 con 0x7ffb08108860 2024-02-28T16:16:29.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.375+0000 7ffb05e00640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffaec06d750 0x7ffaec06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:29.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.376+0000 7ffb05e00640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffaec06d750 0x7ffaec06fc00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8007fd0 tx=0x7ffaf8009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.379+0000 7ffafe000640 1 -- 172.21.15.57:0/758322165 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffaf4078b90 con 0x7ffb08108860 2024-02-28T16:16:29.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.581+0000 7ffb07200640 1 -- 172.21.15.57:0/758322165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb0810f960 con 0x7ffb08108860 2024-02-28T16:16:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.585+0000 7ffafe000640 1 -- 172.21.15.57:0/758322165 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+17102 (secure 0 0 0) 0x7ffaf407c250 con 0x7ffb08108860 2024-02-28T16:16:29.576 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:29.576 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":103,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","created":"2024-02-28T15:49:03.036724+0000","modified":"2024-02-28T16:12:17.859460+0000","last_up_change":"2024-02-28T16:10:01.305153+0000","last_in_change":"2024-02-28T15:56:03.811536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T15:54:45.908218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T15:58:02.602649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T15:58:03.211266+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a78e2ba-3bfe-4677-b633-f2095c44065f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":60,"up_thru":96,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6803","nonce":1715766120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6805","nonce":1715766120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6809","nonce":1715766120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6807","nonce":1715766120}]},"public_addr":"172.21.15.57:6803/1715766120","cluster_addr":"172.21.15.57:6805/1715766120","heartbeat_back_addr":"172.21.15.57:6809/1715766120","heartbeat_front_addr":"172.21.15.57:6807/1715766120","state":["exists","up"]},{"osd":1,"uuid":"fccab799-0840-4050-9ead-4ad9e7e69fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":72,"up_from":76,"up_thru":96,"down_at":73,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6811","nonce":1999906736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6813","nonce":1999906736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6817","nonce":1999906736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6815","nonce":1999906736}]},"public_addr":"172.21.15.57:6811/1999906736","cluster_addr":"172.21.15.57:6813/1999906736","heartbeat_back_addr":"172.21.15.57:6817/1999906736","heartbeat_front_addr":"172.21.15.57:6815/1999906736","state":["exists","up"]},{"osd":2,"uuid":"4b0a7b1d-f096-4698-b27a-6b5aa2239eb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":77,"up_from":81,"up_thru":96,"down_at":78,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6819","nonce":3549211468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6821","nonce":3549211468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6825","nonce":3549211468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6823","nonce":3549211468}]},"public_addr":"172.21.15.57:6819/3549211468","cluster_addr":"172.21.15.57:6821/3549211468","heartbeat_back_addr":"172.21.15.57:6825/3549211468","heartbeat_front_addr":"172.21.15.57:6823/3549211468","state":["exists","up"]},{"osd":3,"uuid":"1c67654a-1d10-422e-9540-a348cff2d828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":82,"up_from":86,"up_thru":96,"down_at":83,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6801","nonce":2608240291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6803","nonce":2608240291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6807","nonce":2608240291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6805","nonce":2608240291}]},"public_addr":"172.21.15.87:6801/2608240291","cluster_addr":"172.21.15.87:6803/2608240291","heartbeat_back_addr":"172.21.15.87:6807/2608240291","heartbeat_front_addr":"172.21.15.87:6805/2608240291","state":["exists","up"]},{"osd":4,"uuid":"7f988788-349d-4afd-adca-af474c7bb8ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":87,"up_from":91,"up_thru":96,"down_at":88,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6809","nonce":3757515598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6811","nonce":3757515598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6815","nonce":3757515598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6813","nonce":3757515598}]},"public_addr":"172.21.15.87:6809/3757515598","cluster_addr":"172.21.15.87:6811/3757515598","heartbeat_back_addr":"172.21.15.87:6815/3757515598","heartbeat_front_addr":"172.21.15.87:6813/3757515598","state":["exists","up"]},{"osd":5,"uuid":"83e02849-bd1f-4fa8-893e-1bfd8b2cfe42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":92,"up_from":96,"up_thru":96,"down_at":93,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6817","nonce":2897063090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6819","nonce":2897063090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6823","nonce":2897063090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6821","nonce":2897063090}]},"public_addr":"172.21.15.87:6817/2897063090","cluster_addr":"172.21.15.87:6819/2897063090","heartbeat_back_addr":"172.21.15.87:6823/2897063090","heartbeat_front_addr":"172.21.15.87:6821/2897063090","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:53:27.750469+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:03.782911+0000","dead_epoch":72},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:41.785278+0000","dead_epoch":77},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:15.986058+0000","dead_epoch":82},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:50.819979+0000","dead_epoch":87},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:56:26.433957+0000","dead_epoch":92}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.a","mappings":[{"from":3,"to":0}]},{"pgid":"2.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.0","mappings":[{"from":1,"to":0}]},{"pgid":"3.2","mappings":[{"from":1,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":0}]},{"pgid":"3.11","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":3,"to":0}]},{"pgid":"3.1a","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6828/3861545073":"2024-02-29T16:11:21.561856+0000","172.21.15.57:6827/1436733447":"2024-02-29T16:10:49.544938+0000","172.21.15.57:6801/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/1871958144":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3728594338":"2024-02-29T16:01:00.964498+0000","172.21.15.87:0/4142702720":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/3926246244":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/810130858":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/3171524924":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/794302018":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6800/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.87:0/1921033756":"2024-02-29T16:03:12.188113+0000","172.21.15.87:6829/3858637717":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/1819633079":"2024-02-29T16:01:00.964498+0000","172.21.15.57:0/2510955053":"2024-02-29T16:04:33.669357+0000","172.21.15.57:6829/3861545073":"2024-02-29T16:11:21.561856+0000","172.21.15.57:0/2729792809":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/509992026":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6801/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/4184139864":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3955176243":"2024-02-29T15:51:51.209781+0000","172.21.15.87:0/3563981670":"2024-02-29T16:03:12.188113+0000","172.21.15.87:6828/3858637717":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/4078846536":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6800/2828490283":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6801/2828490283":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6800/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:6800/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/961475533":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6801/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.87:0/3414157439":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/429066936":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/2044423401":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/1211502049":"2024-02-29T16:04:33.669357+0000","172.21.15.57:6826/1436733447":"2024-02-29T16:10:49.544938+0000","172.21.15.57:6800/3297260515":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/4173475219":"2024-02-29T16:04:33.669357+0000","172.21.15.57:6801/3297260515":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/2332815594":"2024-02-29T16:04:33.669357+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:16:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.587+0000 7ffb07200640 1 -- 172.21.15.57:0/758322165 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffaec06d750 msgr2=0x7ffaec06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.587+0000 7ffb07200640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffaec06d750 0x7ffaec06fc00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8007fd0 tx=0x7ffaf8009e90 comp rx=0 tx=0).stop 2024-02-28T16:16:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.587+0000 7ffb07200640 1 -- 172.21.15.57:0/758322165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb08108860 msgr2=0x7ffb08119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.587+0000 7ffb07200640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb08108860 0x7ffb08119590 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4031720 tx=0x7ffaf4009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.587+0000 7ffb07200640 1 -- 172.21.15.57:0/758322165 shutdown_connections 2024-02-28T16:16:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.587+0000 7ffb07200640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7ffaec06d750 0x7ffaec06fc00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.587+0000 7ffb07200640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb08108860 0x7ffb08119590 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.587+0000 7ffb07200640 1 --2- 172.21.15.57:0/758322165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08102850 0x7ffb08119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.587+0000 7ffb07200640 1 -- 172.21.15.57:0/758322165 >> 172.21.15.57:0/758322165 conn(0x7ffb080720c0 msgr2=0x7ffb08074b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.588+0000 7ffb07200640 1 -- 172.21.15.57:0/758322165 shutdown_connections 2024-02-28T16:16:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.588+0000 7ffb07200640 1 -- 172.21.15.57:0/758322165 wait complete. 2024-02-28T16:16:29.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T15:54:45.908218+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T15:58:02.602649+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T15:58:03.211266+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:16:29.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:16:29.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.871+0000 7fb07be00640 1 -- 172.21.15.57:0/1176353747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07c102aa0 msgr2=0x7fb07c064480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:29.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.871+0000 7fb07be00640 1 --2- 172.21.15.57:0/1176353747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07c102aa0 0x7fb07c064480 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb0680048d0 tx=0x7fb068009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.871+0000 7fb07be00640 1 -- 172.21.15.57:0/1176353747 shutdown_connections 2024-02-28T16:16:29.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.871+0000 7fb07be00640 1 --2- 172.21.15.57:0/1176353747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07c102aa0 0x7fb07c064480 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.871+0000 7fb07be00640 1 --2- 172.21.15.57:0/1176353747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb07c102100 0x7fb07c1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.871+0000 7fb07be00640 1 -- 172.21.15.57:0/1176353747 >> 172.21.15.57:0/1176353747 conn(0x7fb07c0710f0 msgr2=0x7fb07c0714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:29.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.871+0000 7fb07be00640 1 -- 172.21.15.57:0/1176353747 shutdown_connections 2024-02-28T16:16:29.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.872+0000 7fb07be00640 1 -- 172.21.15.57:0/1176353747 wait complete. 2024-02-28T16:16:29.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.872+0000 7fb07be00640 1 Processor -- start 2024-02-28T16:16:29.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.873+0000 7fb07be00640 1 -- start start 2024-02-28T16:16:29.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.873+0000 7fb07be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07c102100 0x7fb07c0fb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:29.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.873+0000 7fb07be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb07c102aa0 0x7fb07c0fb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:29.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.873+0000 7fb07be00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0fbbc0 con 0x7fb07c102100 2024-02-28T16:16:29.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.873+0000 7fb07be00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0fbd30 con 0x7fb07c102aa0 2024-02-28T16:16:29.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.874+0000 7fb07aa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07c102100 0x7fb07c0fb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:29.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.874+0000 7fb07aa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07c102100 0x7fb07c0fb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35274/0 (socket says 172.21.15.57:35274) 2024-02-28T16:16:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.874+0000 7fb07aa00640 1 -- 172.21.15.57:0/1462375111 learned_addr learned my addr 172.21.15.57:0/1462375111 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.874+0000 7fb07a000640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb07c102aa0 0x7fb07c0fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.874+0000 7fb07aa00640 1 -- 172.21.15.57:0/1462375111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb07c102aa0 msgr2=0x7fb07c0fb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.874+0000 7fb07aa00640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb07c102aa0 0x7fb07c0fb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.874+0000 7fb07aa00640 1 -- 172.21.15.57:0/1462375111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb068005040 con 0x7fb07c102100 2024-02-28T16:16:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.874+0000 7fb07aa00640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07c102100 0x7fb07c0fb140 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00b790 tx=0x7fb06c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.875+0000 7fb072a00640 1 -- 172.21.15.57:0/1462375111 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb06c00c700 con 0x7fb07c102100 2024-02-28T16:16:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.875+0000 7fb072a00640 1 -- 172.21.15.57:0/1462375111 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb06c00cd30 con 0x7fb07c102100 2024-02-28T16:16:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.875+0000 7fb07be00640 1 -- 172.21.15.57:0/1462375111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c118ee0 con 0x7fb07c102100 2024-02-28T16:16:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.875+0000 7fb072a00640 1 -- 172.21.15.57:0/1462375111 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb06c013370 con 0x7fb07c102100 2024-02-28T16:16:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.875+0000 7fb07be00640 1 -- 172.21.15.57:0/1462375111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c119210 con 0x7fb07c102100 2024-02-28T16:16:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.876+0000 7fb07be00640 1 -- 172.21.15.57:0/1462375111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c04bcc0 con 0x7fb07c102100 2024-02-28T16:16:29.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.877+0000 7fb072a00640 1 -- 172.21.15.57:0/1462375111 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fb06c012070 con 0x7fb07c102100 2024-02-28T16:16:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.878+0000 7fb072a00640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb06006d760 0x7fb06006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.879+0000 7fb072a00640 1 -- 172.21.15.57:0/1462375111 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fb06c08ca30 con 0x7fb07c102100 2024-02-28T16:16:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.879+0000 7fb07a000640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb06006d760 0x7fb06006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.880+0000 7fb07a000640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb06006d760 0x7fb06006fc10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb06802bda0 tx=0x7fb068009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:29.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:29.883+0000 7fb072a00640 1 -- 172.21.15.57:0/1462375111 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb06c056080 con 0x7fb07c102100 2024-02-28T16:16:29.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:29 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/431127638' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-02-28T16:16:29.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:29 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/758322165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:16:30.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.092+0000 7fb07be00640 1 -- 172.21.15.57:0/1462375111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb07c1092e0 con 0x7fb07c102100 2024-02-28T16:16:30.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.094+0000 7fb072a00640 1 -- 172.21.15.57:0/1462375111 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb06c059740 con 0x7fb07c102100 2024-02-28T16:16:30.085 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-02-28T16:16:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.096+0000 7fb07be00640 1 -- 172.21.15.57:0/1462375111 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb06006d760 msgr2=0x7fb06006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.096+0000 7fb07be00640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb06006d760 0x7fb06006fc10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb06802bda0 tx=0x7fb068009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.096+0000 7fb07be00640 1 -- 172.21.15.57:0/1462375111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07c102100 msgr2=0x7fb07c0fb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.096+0000 7fb07be00640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07c102100 0x7fb07c0fb140 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00b790 tx=0x7fb06c0091d0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.096+0000 7fb07be00640 1 -- 172.21.15.57:0/1462375111 shutdown_connections 2024-02-28T16:16:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.096+0000 7fb07be00640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fb06006d760 0x7fb06006fc10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.096+0000 7fb07be00640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb07c102aa0 0x7fb07c0fb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.096+0000 7fb07be00640 1 --2- 172.21.15.57:0/1462375111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07c102100 0x7fb07c0fb140 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.096+0000 7fb07be00640 1 -- 172.21.15.57:0/1462375111 >> 172.21.15.57:0/1462375111 conn(0x7fb07c0710f0 msgr2=0x7fb07c0fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:30.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.097+0000 7fb07be00640 1 -- 172.21.15.57:0/1462375111 shutdown_connections 2024-02-28T16:16:30.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.097+0000 7fb07be00640 1 -- 172.21.15.57:0/1462375111 wait complete. 2024-02-28T16:16:30.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:16:30.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:29 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/431127638' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-02-28T16:16:30.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:29 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/758322165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:16:30.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.334+0000 7fd91da00640 1 -- 172.21.15.57:0/68611605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd918102740 msgr2=0x7fd918102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:30.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.334+0000 7fd91da00640 1 --2- 172.21.15.57:0/68611605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd918102740 0x7fd918102bb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd9040048d0 tx=0x7fd904009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.334+0000 7fd91da00640 1 -- 172.21.15.57:0/68611605 shutdown_connections 2024-02-28T16:16:30.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.334+0000 7fd91da00640 1 --2- 172.21.15.57:0/68611605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd918102740 0x7fd918102bb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.334+0000 7fd91da00640 1 --2- 172.21.15.57:0/68611605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd918108760 0x7fd918108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.334+0000 7fd91da00640 1 -- 172.21.15.57:0/68611605 >> 172.21.15.57:0/68611605 conn(0x7fd918071fc0 msgr2=0x7fd9180743d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:30.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.334+0000 7fd91da00640 1 -- 172.21.15.57:0/68611605 shutdown_connections 2024-02-28T16:16:30.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.334+0000 7fd91da00640 1 -- 172.21.15.57:0/68611605 wait complete. 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.335+0000 7fd91da00640 1 Processor -- start 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.335+0000 7fd91da00640 1 -- start start 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.335+0000 7fd91da00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd918102740 0x7fd9181190d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.335+0000 7fd91da00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd918108760 0x7fd918119610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.335+0000 7fd91da00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd918119c10 con 0x7fd918108760 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.335+0000 7fd91da00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9181131a0 con 0x7fd918102740 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.335+0000 7fd917400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd918108760 0x7fd918119610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.336+0000 7fd917400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd918108760 0x7fd918119610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35294/0 (socket says 172.21.15.57:35294) 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.336+0000 7fd917400640 1 -- 172.21.15.57:0/2366302469 learned_addr learned my addr 172.21.15.57:0/2366302469 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.336+0000 7fd917e00640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd918102740 0x7fd9181190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.336+0000 7fd917400640 1 -- 172.21.15.57:0/2366302469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd918102740 msgr2=0x7fd9181190d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:30.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.336+0000 7fd917400640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd918102740 0x7fd9181190d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.336+0000 7fd917400640 1 -- 172.21.15.57:0/2366302469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd904005040 con 0x7fd918108760 2024-02-28T16:16:30.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.336+0000 7fd917e00640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd918102740 0x7fd9181190d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:16:30.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.336+0000 7fd917400640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd918108760 0x7fd918119610 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd90402bda0 tx=0x7fd904009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:30.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.337+0000 7fd90fe00640 1 -- 172.21.15.57:0/2366302469 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9040092e0 con 0x7fd918108760 2024-02-28T16:16:30.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.337+0000 7fd90fe00640 1 -- 172.21.15.57:0/2366302469 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd90403d450 con 0x7fd918108760 2024-02-28T16:16:30.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.337+0000 7fd91da00640 1 -- 172.21.15.57:0/2366302469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd918113420 con 0x7fd918108760 2024-02-28T16:16:30.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.337+0000 7fd90fe00640 1 -- 172.21.15.57:0/2366302469 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd90403b640 con 0x7fd918108760 2024-02-28T16:16:30.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.337+0000 7fd91da00640 1 -- 172.21.15.57:0/2366302469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd918113940 con 0x7fd918108760 2024-02-28T16:16:30.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.338+0000 7fd91da00640 1 -- 172.21.15.57:0/2366302469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91804bcc0 con 0x7fd918108760 2024-02-28T16:16:30.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.339+0000 7fd90fe00640 1 -- 172.21.15.57:0/2366302469 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd90402f070 con 0x7fd918108760 2024-02-28T16:16:30.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.340+0000 7fd90fe00640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd8fc06d750 0x7fd8fc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:30.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.340+0000 7fd90fe00640 1 -- 172.21.15.57:0/2366302469 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fd9040af440 con 0x7fd918108760 2024-02-28T16:16:30.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.341+0000 7fd917e00640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd8fc06d750 0x7fd8fc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:30.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.341+0000 7fd917e00640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd8fc06d750 0x7fd8fc06fc00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9080049d0 tx=0x7fd90800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:30.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.345+0000 7fd90fe00640 1 -- 172.21.15.57:0/2366302469 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd904078b10 con 0x7fd918108760 2024-02-28T16:16:30.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.548+0000 7fd91da00640 1 -- 172.21.15.57:0/2366302469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fd91810f860 con 0x7fd918108760 2024-02-28T16:16:30.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.549+0000 7fd90fe00640 1 -- 172.21.15.57:0/2366302469 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v103) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd90407c1d0 con 0x7fd918108760 2024-02-28T16:16:30.540 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.551+0000 7fd91da00640 1 -- 172.21.15.57:0/2366302469 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd8fc06d750 msgr2=0x7fd8fc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.551+0000 7fd91da00640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd8fc06d750 0x7fd8fc06fc00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9080049d0 tx=0x7fd90800b040 comp rx=0 tx=0).stop 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.551+0000 7fd91da00640 1 -- 172.21.15.57:0/2366302469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd918108760 msgr2=0x7fd918119610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.551+0000 7fd91da00640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd918108760 0x7fd918119610 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd90402bda0 tx=0x7fd904009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.551+0000 7fd91da00640 1 -- 172.21.15.57:0/2366302469 shutdown_connections 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.551+0000 7fd91da00640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd8fc06d750 0x7fd8fc06fc00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.552+0000 7fd91da00640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd918108760 0x7fd918119610 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.552+0000 7fd91da00640 1 --2- 172.21.15.57:0/2366302469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd918102740 0x7fd9181190d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.552+0000 7fd91da00640 1 -- 172.21.15.57:0/2366302469 >> 172.21.15.57:0/2366302469 conn(0x7fd918071fc0 msgr2=0x7fd918074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.552+0000 7fd91da00640 1 -- 172.21.15.57:0/2366302469 shutdown_connections 2024-02-28T16:16:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.552+0000 7fd91da00640 1 -- 172.21.15.57:0/2366302469 wait complete. 2024-02-28T16:16:30.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:16:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.789+0000 7f5cee400640 1 -- 172.21.15.57:0/863091337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce8073570 msgr2=0x7f5ce8073940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.789+0000 7f5cee400640 1 --2- 172.21.15.57:0/863091337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce8073570 0x7f5ce8073940 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80048d0 tx=0x7f5cd8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.789+0000 7f5cee400640 1 -- 172.21.15.57:0/863091337 shutdown_connections 2024-02-28T16:16:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.789+0000 7f5cee400640 1 --2- 172.21.15.57:0/863091337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ce8073e80 0x7f5ce810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.789+0000 7f5cee400640 1 --2- 172.21.15.57:0/863091337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce8073570 0x7f5ce8073940 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.789+0000 7f5cee400640 1 -- 172.21.15.57:0/863091337 >> 172.21.15.57:0/863091337 conn(0x7f5ce80fa160 msgr2=0x7f5ce80fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.790+0000 7f5cee400640 1 -- 172.21.15.57:0/863091337 shutdown_connections 2024-02-28T16:16:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.790+0000 7f5cee400640 1 -- 172.21.15.57:0/863091337 wait complete. 2024-02-28T16:16:30.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.790+0000 7f5cee400640 1 Processor -- start 2024-02-28T16:16:30.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.790+0000 7f5cee400640 1 -- start start 2024-02-28T16:16:30.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.791+0000 7f5cee400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ce8073570 0x7f5ce8119300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:30.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.791+0000 7f5cee400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce8073e80 0x7f5ce8119840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:30.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.791+0000 7f5cee400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce8119e40 con 0x7f5ce8073e80 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.791+0000 7f5cee400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce81133d0 con 0x7f5ce8073570 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.791+0000 7f5ce6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce8073e80 0x7f5ce8119840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.791+0000 7f5ce6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce8073e80 0x7f5ce8119840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35320/0 (socket says 172.21.15.57:35320) 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.791+0000 7f5ce6a00640 1 -- 172.21.15.57:0/3260942954 learned_addr learned my addr 172.21.15.57:0/3260942954 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.791+0000 7f5ce6a00640 1 -- 172.21.15.57:0/3260942954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ce8073570 msgr2=0x7f5ce8119300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.791+0000 7f5ce7400640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ce8073570 0x7f5ce8119300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.792+0000 7f5ce6a00640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ce8073570 0x7f5ce8119300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.792+0000 7f5ce6a00640 1 -- 172.21.15.57:0/3260942954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8005040 con 0x7f5ce8073e80 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.792+0000 7f5ce6a00640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce8073e80 0x7f5ce8119840 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4002a50 tx=0x7f5cd4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.792+0000 7f5cdf400640 1 -- 172.21.15.57:0/3260942954 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd4007c30 con 0x7f5ce8073e80 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.792+0000 7f5cdf400640 1 -- 172.21.15.57:0/3260942954 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cd400f040 con 0x7f5ce8073e80 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.792+0000 7f5cee400640 1 -- 172.21.15.57:0/3260942954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce81136b0 con 0x7f5ce8073e80 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.792+0000 7f5cdf400640 1 -- 172.21.15.57:0/3260942954 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd400db50 con 0x7f5ce8073e80 2024-02-28T16:16:30.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.792+0000 7f5cee400640 1 -- 172.21.15.57:0/3260942954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce8113bd0 con 0x7f5ce8073e80 2024-02-28T16:16:30.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.793+0000 7f5cee400640 1 -- 172.21.15.57:0/3260942954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce8064030 con 0x7f5ce8073e80 2024-02-28T16:16:30.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.795+0000 7f5cdf400640 1 -- 172.21.15.57:0/3260942954 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f5cd401c400 con 0x7f5ce8073e80 2024-02-28T16:16:30.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.796+0000 7f5cdf400640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5ccc06d760 0x7f5ccc06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:30.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.796+0000 7f5cdf400640 1 -- 172.21.15.57:0/3260942954 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f5cd408c9a0 con 0x7f5ce8073e80 2024-02-28T16:16:30.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.796+0000 7f5ce7400640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5ccc06d760 0x7f5ccc06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:30.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.797+0000 7f5ce7400640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5ccc06d760 0x7f5ccc06fc10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8004540 tx=0x7f5cd8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:30.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:30.801+0000 7f5cdf400640 1 -- 172.21.15.57:0/3260942954 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5cd4055ff0 con 0x7f5ce8073e80 2024-02-28T16:16:30.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.005+0000 7f5cee400640 1 -- 172.21.15.57:0/3260942954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f5ce8114900 con 0x7f5ce8073e80 2024-02-28T16:16:30.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.006+0000 7f5cdf400640 1 -- 172.21.15.57:0/3260942954 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v103) v1 ==== 107+0+11 (secure 0 0 0) 0x7f5cd40596b0 con 0x7f5ce8073e80 2024-02-28T16:16:30.998 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-02-28T16:16:31.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 -- 172.21.15.57:0/3260942954 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5ccc06d760 msgr2=0x7f5ccc06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5ccc06d760 0x7f5ccc06fc10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8004540 tx=0x7f5cd8009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 -- 172.21.15.57:0/3260942954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce8073e80 msgr2=0x7f5ce8119840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce8073e80 0x7f5ce8119840 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4002a50 tx=0x7f5cd4004600 comp rx=0 tx=0).stop 2024-02-28T16:16:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 -- 172.21.15.57:0/3260942954 shutdown_connections 2024-02-28T16:16:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f5ccc06d760 0x7f5ccc06fc10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce8073e80 0x7f5ce8119840 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 --2- 172.21.15.57:0/3260942954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ce8073570 0x7f5ce8119300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 -- 172.21.15.57:0/3260942954 >> 172.21.15.57:0/3260942954 conn(0x7f5ce80fa160 msgr2=0x7f5ce80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 -- 172.21.15.57:0/3260942954 shutdown_connections 2024-02-28T16:16:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.009+0000 7f5cee400640 1 -- 172.21.15.57:0/3260942954 wait complete. 2024-02-28T16:16:31.019 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-28T16:16:31.102 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:30 smithi057 ceph-mon[93219]: pgmap v415: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:31.102 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:30 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/1462375111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:16:31.102 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:30 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2366302469' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:16:31.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:30 smithi087 ceph-mon[82628]: pgmap v415: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:31.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:30 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/1462375111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:16:31.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:30 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2366302469' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:16:31.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.246+0000 7f16e1e00640 1 -- 172.21.15.57:0/4000727023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16dc0fe9c0 msgr2=0x7f16dc0fed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:31.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.246+0000 7f16e1e00640 1 --2- 172.21.15.57:0/4000727023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16dc0fe9c0 0x7f16dc0fed90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0048d0 tx=0x7f16cc009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.246+0000 7f16e1e00640 1 -- 172.21.15.57:0/4000727023 shutdown_connections 2024-02-28T16:16:31.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.246+0000 7f16e1e00640 1 --2- 172.21.15.57:0/4000727023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc100110 0x7f16dc100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.246+0000 7f16e1e00640 1 --2- 172.21.15.57:0/4000727023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16dc0fe9c0 0x7f16dc0fed90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.246+0000 7f16e1e00640 1 -- 172.21.15.57:0/4000727023 >> 172.21.15.57:0/4000727023 conn(0x7f16dc0fa160 msgr2=0x7f16dc0fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:31.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.246+0000 7f16e1e00640 1 -- 172.21.15.57:0/4000727023 shutdown_connections 2024-02-28T16:16:31.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.247+0000 7f16e1e00640 1 -- 172.21.15.57:0/4000727023 wait complete. 2024-02-28T16:16:31.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.247+0000 7f16e1e00640 1 Processor -- start 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.247+0000 7f16e1e00640 1 -- start start 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.248+0000 7f16e1e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16dc0fe9c0 0x7f16dc114dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.248+0000 7f16e1e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc100110 0x7f16dc115300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.248+0000 7f16e1e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc115900 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.248+0000 7f16e1e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc10ee90 con 0x7f16dc100110 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.248+0000 7f16daa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16dc0fe9c0 0x7f16dc114dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.248+0000 7f16daa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16dc0fe9c0 0x7f16dc114dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35338/0 (socket says 172.21.15.57:35338) 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.248+0000 7f16daa00640 1 -- 172.21.15.57:0/4212235794 learned_addr learned my addr 172.21.15.57:0/4212235794 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.248+0000 7f16da000640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc100110 0x7f16dc115300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.249+0000 7f16daa00640 1 -- 172.21.15.57:0/4212235794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc100110 msgr2=0x7f16dc115300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:31.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.249+0000 7f16daa00640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc100110 0x7f16dc115300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.249+0000 7f16daa00640 1 -- 172.21.15.57:0/4212235794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc005040 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.249+0000 7f16da000640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc100110 0x7f16dc115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:16:31.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.249+0000 7f16daa00640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16dc0fe9c0 0x7f16dc114dc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f16cc02bda0 tx=0x7f16cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:31.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.249+0000 7f16d2a00640 1 -- 172.21.15.57:0/4212235794 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16cc0094c0 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.249+0000 7f16d2a00640 1 -- 172.21.15.57:0/4212235794 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16cc009620 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.249+0000 7f16d2a00640 1 -- 172.21.15.57:0/4212235794 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16cc0435f0 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.249+0000 7f16e1e00640 1 -- 172.21.15.57:0/4212235794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc10f110 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.249+0000 7f16e1e00640 1 -- 172.21.15.57:0/4212235794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc10f5d0 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.251+0000 7f16e1e00640 1 -- 172.21.15.57:0/4212235794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc064030 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.251+0000 7f16d2a00640 1 -- 172.21.15.57:0/4212235794 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7f16cc02f070 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.252+0000 7f16d2a00640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f16c006d760 0x7f16c006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:31.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.253+0000 7f16d2a00640 1 -- 172.21.15.57:0/4212235794 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f16cc0aeff0 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.253+0000 7f16da000640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f16c006d760 0x7f16c006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:31.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.253+0000 7f16da000640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f16c006d760 0x7f16c006fc10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16dc110680 tx=0x7f16c8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:31.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.257+0000 7f16d2a00640 1 -- 172.21.15.57:0/4212235794 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f16cc0e2d20 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.472+0000 7f16e1e00640 1 -- 172.21.15.57:0/4212235794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f16dc1027f0 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.473+0000 7f16d2a00640 1 -- 172.21.15.57:0/4212235794 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v103) v1 ==== 81+0+2305 (secure 0 0 0) 0x7f16cc078640 con 0x7f16dc0fe9c0 2024-02-28T16:16:31.465 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6828/3861545073 2024-02-29T16:11:21.561856+0000 2024-02-28T16:16:31.465 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6827/1436733447 2024-02-29T16:10:49.544938+0000 2024-02-28T16:16:31.465 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6801/3389594762 2024-02-29T15:50:16.193611+0000 2024-02-28T16:16:31.465 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/1871958144 2024-02-29T15:49:35.637547+0000 2024-02-28T16:16:31.465 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/3728594338 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:31.465 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:0/4142702720 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:31.465 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/3926246244 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:31.465 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/810130858 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:31.465 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/3171524924 2024-02-29T15:49:35.637547+0000 2024-02-28T16:16:31.465 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/794302018 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6800/3389594762 2024-02-29T15:50:16.193611+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:0/1921033756 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:6829/3858637717 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/1819633079 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2510955053 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6829/3861545073 2024-02-29T16:11:21.561856+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2729792809 2024-02-29T15:50:16.193611+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/509992026 2024-02-29T15:50:16.193611+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6801/1609955238 2024-02-29T15:49:35.637547+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/4184139864 2024-02-29T15:49:35.637547+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/3955176243 2024-02-29T15:51:51.209781+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:0/3563981670 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:31.466 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:6828/3858637717 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/4078846536 2024-02-29T15:50:16.193611+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6800/2828490283 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6801/2828490283 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6800/1609955238 2024-02-29T15:49:35.637547+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6800/4162336432 2024-02-29T15:51:51.209781+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/961475533 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6801/4162336432 2024-02-29T15:51:51.209781+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:0/3414157439 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/429066936 2024-02-29T15:51:51.209781+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2044423401 2024-02-29T15:51:51.209781+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/1211502049 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6826/1436733447 2024-02-29T16:10:49.544938+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6800/3297260515 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:31.467 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/4173475219 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:31.468 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6801/3297260515 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:31.468 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2332815594 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:31.468 INFO:teuthology.orchestra.run.smithi057.stderr:listed 39 entries 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 -- 172.21.15.57:0/4212235794 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f16c006d760 msgr2=0x7f16c006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f16c006d760 0x7f16c006fc10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16dc110680 tx=0x7f16c8009040 comp rx=0 tx=0).stop 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 -- 172.21.15.57:0/4212235794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16dc0fe9c0 msgr2=0x7f16dc114dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16dc0fe9c0 0x7f16dc114dc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f16cc02bda0 tx=0x7f16cc009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 -- 172.21.15.57:0/4212235794 shutdown_connections 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7f16c006d760 0x7f16c006fc10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc100110 0x7f16dc115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 --2- 172.21.15.57:0/4212235794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16dc0fe9c0 0x7f16dc114dc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 -- 172.21.15.57:0/4212235794 >> 172.21.15.57:0/4212235794 conn(0x7f16dc0fa160 msgr2=0x7f16dc0fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 -- 172.21.15.57:0/4212235794 shutdown_connections 2024-02-28T16:16:31.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.476+0000 7f16e1e00640 1 -- 172.21.15.57:0/4212235794 wait complete. 2024-02-28T16:16:31.487 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-02-28T16:16:31.487 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T16:16:31.539 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:16:31.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.771+0000 7fcaa9a00640 1 -- 172.21.15.57:0/618815010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaa41044c0 msgr2=0x7fcaa4104890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:31.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.771+0000 7fcaa9a00640 1 --2- 172.21.15.57:0/618815010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaa41044c0 0x7fcaa4104890 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fca94009c50 tx=0x7fca94004d10 comp rx=0 tx=0).stop 2024-02-28T16:16:31.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.771+0000 7fcaa9a00640 1 -- 172.21.15.57:0/618815010 shutdown_connections 2024-02-28T16:16:31.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.771+0000 7fcaa9a00640 1 --2- 172.21.15.57:0/618815010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4104e60 0x7fcaa40fe520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.771+0000 7fcaa9a00640 1 --2- 172.21.15.57:0/618815010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaa41044c0 0x7fcaa4104890 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.771+0000 7fcaa9a00640 1 -- 172.21.15.57:0/618815010 >> 172.21.15.57:0/618815010 conn(0x7fcaa40fa0c0 msgr2=0x7fcaa40fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:31.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.771+0000 7fcaa9a00640 1 -- 172.21.15.57:0/618815010 shutdown_connections 2024-02-28T16:16:31.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.771+0000 7fcaa9a00640 1 -- 172.21.15.57:0/618815010 wait complete. 2024-02-28T16:16:31.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.772+0000 7fcaa9a00640 1 Processor -- start 2024-02-28T16:16:31.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.772+0000 7fcaa9a00640 1 -- start start 2024-02-28T16:16:31.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.772+0000 7fcaa9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaa41044c0 0x7fcaa4114d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:31.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.772+0000 7fcaa9a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4104e60 0x7fcaa4115270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:31.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.772+0000 7fcaa9a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa4115870 con 0x7fcaa41044c0 2024-02-28T16:16:31.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.772+0000 7fcaa9a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa410ee00 con 0x7fcaa4104e60 2024-02-28T16:16:31.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.773+0000 7fcaa2a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaa41044c0 0x7fcaa4114d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:31.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.773+0000 7fcaa2a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaa41044c0 0x7fcaa4114d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35354/0 (socket says 172.21.15.57:35354) 2024-02-28T16:16:31.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.773+0000 7fcaa2a00640 1 -- 172.21.15.57:0/927064826 learned_addr learned my addr 172.21.15.57:0/927064826 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:31.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.773+0000 7fcaa2a00640 1 -- 172.21.15.57:0/927064826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4104e60 msgr2=0x7fcaa4115270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.773+0000 7fcaa2a00640 1 --2- 172.21.15.57:0/927064826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4104e60 0x7fcaa4115270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.773+0000 7fcaa2a00640 1 -- 172.21.15.57:0/927064826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca940098b0 con 0x7fcaa41044c0 2024-02-28T16:16:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.773+0000 7fcaa2a00640 1 --2- 172.21.15.57:0/927064826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaa41044c0 0x7fcaa4114d30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fca94004750 tx=0x7fca94004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.774+0000 7fca9b400640 1 -- 172.21.15.57:0/927064826 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9403a070 con 0x7fcaa41044c0 2024-02-28T16:16:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.774+0000 7fca9b400640 1 -- 172.21.15.57:0/927064826 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca94035b20 con 0x7fcaa41044c0 2024-02-28T16:16:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.774+0000 7fcaa9a00640 1 -- 172.21.15.57:0/927064826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa410f080 con 0x7fcaa41044c0 2024-02-28T16:16:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.774+0000 7fca9b400640 1 -- 172.21.15.57:0/927064826 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9403ea80 con 0x7fcaa41044c0 2024-02-28T16:16:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.774+0000 7fcaa9a00640 1 -- 172.21.15.57:0/927064826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa410f620 con 0x7fcaa41044c0 2024-02-28T16:16:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.775+0000 7fcaa9a00640 1 -- 172.21.15.57:0/927064826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa4064480 con 0x7fcaa41044c0 2024-02-28T16:16:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.776+0000 7fca9b400640 1 -- 172.21.15.57:0/927064826 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fca94032070 con 0x7fcaa41044c0 2024-02-28T16:16:31.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.777+0000 7fca9b400640 1 --2- 172.21.15.57:0/927064826 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fca8806d750 0x7fca8806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:31.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.777+0000 7fca9b400640 1 -- 172.21.15.57:0/927064826 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fca940af460 con 0x7fcaa41044c0 2024-02-28T16:16:31.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.777+0000 7fca9a000640 1 --2- 172.21.15.57:0/927064826 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fca8806d750 0x7fca8806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:31.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.778+0000 7fca9a000640 1 --2- 172.21.15.57:0/927064826 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fca8806d750 0x7fca8806fc00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcaa41105f0 tx=0x7fca8c009c50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:31.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.784+0000 7fca9b400640 1 -- 172.21.15.57:0/927064826 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fca94078ab0 con 0x7fcaa41044c0 2024-02-28T16:16:31.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.986+0000 7fcaa9a00640 1 -- 172.21.15.57:0/927064826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaa410f840 con 0x7fcaa41044c0 2024-02-28T16:16:31.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.989+0000 7fca9b400640 1 -- 172.21.15.57:0/927064826 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+17102 (secure 0 0 0) 0x7fca9407c170 con 0x7fcaa41044c0 2024-02-28T16:16:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-02-28T16:16:31.981 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":103,"fsid":"bf04dacc-d650-11ee-95c3-87774f69a715","created":"2024-02-28T15:49:03.036724+0000","modified":"2024-02-28T16:12:17.859460+0000","last_up_change":"2024-02-28T16:10:01.305153+0000","last_in_change":"2024-02-28T15:56:03.811536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T15:54:45.908218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T15:58:02.602649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T15:58:03.211266+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a78e2ba-3bfe-4677-b633-f2095c44065f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":60,"up_thru":96,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6803","nonce":1715766120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6805","nonce":1715766120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6809","nonce":1715766120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1715766120},{"type":"v1","addr":"172.21.15.57:6807","nonce":1715766120}]},"public_addr":"172.21.15.57:6803/1715766120","cluster_addr":"172.21.15.57:6805/1715766120","heartbeat_back_addr":"172.21.15.57:6809/1715766120","heartbeat_front_addr":"172.21.15.57:6807/1715766120","state":["exists","up"]},{"osd":1,"uuid":"fccab799-0840-4050-9ead-4ad9e7e69fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":72,"up_from":76,"up_thru":96,"down_at":73,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6811","nonce":1999906736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6813","nonce":1999906736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6817","nonce":1999906736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1999906736},{"type":"v1","addr":"172.21.15.57:6815","nonce":1999906736}]},"public_addr":"172.21.15.57:6811/1999906736","cluster_addr":"172.21.15.57:6813/1999906736","heartbeat_back_addr":"172.21.15.57:6817/1999906736","heartbeat_front_addr":"172.21.15.57:6815/1999906736","state":["exists","up"]},{"osd":2,"uuid":"4b0a7b1d-f096-4698-b27a-6b5aa2239eb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":77,"up_from":81,"up_thru":96,"down_at":78,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6819","nonce":3549211468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6821","nonce":3549211468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6825","nonce":3549211468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3549211468},{"type":"v1","addr":"172.21.15.57:6823","nonce":3549211468}]},"public_addr":"172.21.15.57:6819/3549211468","cluster_addr":"172.21.15.57:6821/3549211468","heartbeat_back_addr":"172.21.15.57:6825/3549211468","heartbeat_front_addr":"172.21.15.57:6823/3549211468","state":["exists","up"]},{"osd":3,"uuid":"1c67654a-1d10-422e-9540-a348cff2d828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":82,"up_from":86,"up_thru":96,"down_at":83,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6801","nonce":2608240291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6803","nonce":2608240291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6807","nonce":2608240291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2608240291},{"type":"v1","addr":"172.21.15.87:6805","nonce":2608240291}]},"public_addr":"172.21.15.87:6801/2608240291","cluster_addr":"172.21.15.87:6803/2608240291","heartbeat_back_addr":"172.21.15.87:6807/2608240291","heartbeat_front_addr":"172.21.15.87:6805/2608240291","state":["exists","up"]},{"osd":4,"uuid":"7f988788-349d-4afd-adca-af474c7bb8ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":87,"up_from":91,"up_thru":96,"down_at":88,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6809","nonce":3757515598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6811","nonce":3757515598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6815","nonce":3757515598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3757515598},{"type":"v1","addr":"172.21.15.87:6813","nonce":3757515598}]},"public_addr":"172.21.15.87:6809/3757515598","cluster_addr":"172.21.15.87:6811/3757515598","heartbeat_back_addr":"172.21.15.87:6815/3757515598","heartbeat_front_addr":"172.21.15.87:6813/3757515598","state":["exists","up"]},{"osd":5,"uuid":"83e02849-bd1f-4fa8-893e-1bfd8b2cfe42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":92,"up_from":96,"up_thru":96,"down_at":93,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6817","nonce":2897063090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6819","nonce":2897063090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6823","nonce":2897063090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2897063090},{"type":"v1","addr":"172.21.15.87:6821","nonce":2897063090}]},"public_addr":"172.21.15.87:6817/2897063090","cluster_addr":"172.21.15.87:6819/2897063090","heartbeat_back_addr":"172.21.15.87:6823/2897063090","heartbeat_front_addr":"172.21.15.87:6821/2897063090","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:53:27.750469+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:03.782911+0000","dead_epoch":72},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:54:41.785278+0000","dead_epoch":77},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:15.986058+0000","dead_epoch":82},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:55:50.819979+0000","dead_epoch":87},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T15:56:26.433957+0000","dead_epoch":92}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.a","mappings":[{"from":3,"to":0}]},{"pgid":"2.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.0","mappings":[{"from":1,"to":0}]},{"pgid":"3.2","mappings":[{"from":1,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":0}]},{"pgid":"3.11","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":3,"to":0}]},{"pgid":"3.1a","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6828/3861545073":"2024-02-29T16:11:21.561856+0000","172.21.15.57:6827/1436733447":"2024-02-29T16:10:49.544938+0000","172.21.15.57:6801/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/1871958144":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3728594338":"2024-02-29T16:01:00.964498+0000","172.21.15.87:0/4142702720":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/3926246244":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/810130858":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/3171524924":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/794302018":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6800/3389594762":"2024-02-29T15:50:16.193611+0000","172.21.15.87:0/1921033756":"2024-02-29T16:03:12.188113+0000","172.21.15.87:6829/3858637717":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/1819633079":"2024-02-29T16:01:00.964498+0000","172.21.15.57:0/2510955053":"2024-02-29T16:04:33.669357+0000","172.21.15.57:6829/3861545073":"2024-02-29T16:11:21.561856+0000","172.21.15.57:0/2729792809":"2024-02-29T15:50:16.193611+0000","172.21.15.57:0/509992026":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6801/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/4184139864":"2024-02-29T15:49:35.637547+0000","172.21.15.57:0/3955176243":"2024-02-29T15:51:51.209781+0000","172.21.15.87:0/3563981670":"2024-02-29T16:03:12.188113+0000","172.21.15.87:6828/3858637717":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/4078846536":"2024-02-29T15:50:16.193611+0000","172.21.15.57:6800/2828490283":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6801/2828490283":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6800/1609955238":"2024-02-29T15:49:35.637547+0000","172.21.15.57:6800/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/961475533":"2024-02-29T16:01:00.964498+0000","172.21.15.57:6801/4162336432":"2024-02-29T15:51:51.209781+0000","172.21.15.87:0/3414157439":"2024-02-29T16:03:12.188113+0000","172.21.15.57:0/429066936":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/2044423401":"2024-02-29T15:51:51.209781+0000","172.21.15.57:0/1211502049":"2024-02-29T16:04:33.669357+0000","172.21.15.57:6826/1436733447":"2024-02-29T16:10:49.544938+0000","172.21.15.57:6800/3297260515":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/4173475219":"2024-02-29T16:04:33.669357+0000","172.21.15.57:6801/3297260515":"2024-02-29T16:04:33.669357+0000","172.21.15.57:0/2332815594":"2024-02-29T16:04:33.669357+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.992+0000 7fcaa9a00640 1 -- 172.21.15.57:0/927064826 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fca8806d750 msgr2=0x7fca8806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.992+0000 7fcaa9a00640 1 --2- 172.21.15.57:0/927064826 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fca8806d750 0x7fca8806fc00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcaa41105f0 tx=0x7fca8c009c50 comp rx=0 tx=0).stop 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.992+0000 7fcaa9a00640 1 -- 172.21.15.57:0/927064826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaa41044c0 msgr2=0x7fcaa4114d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.992+0000 7fcaa9a00640 1 --2- 172.21.15.57:0/927064826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaa41044c0 0x7fcaa4114d30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fca94004750 tx=0x7fca94004d10 comp rx=0 tx=0).stop 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.992+0000 7fcaa9a00640 1 -- 172.21.15.57:0/927064826 shutdown_connections 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.992+0000 7fcaa9a00640 1 --2- 172.21.15.57:0/927064826 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fca8806d750 0x7fca8806fc00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.992+0000 7fcaa9a00640 1 --2- 172.21.15.57:0/927064826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4104e60 0x7fcaa4115270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.992+0000 7fcaa9a00640 1 --2- 172.21.15.57:0/927064826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaa41044c0 0x7fcaa4114d30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.992+0000 7fcaa9a00640 1 -- 172.21.15.57:0/927064826 >> 172.21.15.57:0/927064826 conn(0x7fcaa40fa0c0 msgr2=0x7fcaa40fb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.993+0000 7fcaa9a00640 1 -- 172.21.15.57:0/927064826 shutdown_connections 2024-02-28T16:16:31.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:31.993+0000 7fcaa9a00640 1 -- 172.21.15.57:0/927064826 wait complete. 2024-02-28T16:16:32.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T15:54:45.908218+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T15:58:02.602649+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T15:58:03.211266+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:16:32.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:16:32.087 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:31 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/3260942954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:16:32.087 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:31 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/4212235794' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:16:32.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:31 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/3260942954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:16:32.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:31 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/4212235794' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:16:32.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.235+0000 7fa3c5c00640 1 -- 172.21.15.57:0/938524887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3c0104320 msgr2=0x7fa3c01046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:32.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.235+0000 7fa3c5c00640 1 --2- 172.21.15.57:0/938524887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3c0104320 0x7fa3c01046f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00048d0 tx=0x7fa3b0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.235+0000 7fa3c5c00640 1 -- 172.21.15.57:0/938524887 shutdown_connections 2024-02-28T16:16:32.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.235+0000 7fa3c5c00640 1 --2- 172.21.15.57:0/938524887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c0104cc0 0x7fa3c00fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.235+0000 7fa3c5c00640 1 --2- 172.21.15.57:0/938524887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3c0104320 0x7fa3c01046f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.235+0000 7fa3c5c00640 1 -- 172.21.15.57:0/938524887 >> 172.21.15.57:0/938524887 conn(0x7fa3c00f9f90 msgr2=0x7fa3c00fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:32.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.235+0000 7fa3c5c00640 1 -- 172.21.15.57:0/938524887 shutdown_connections 2024-02-28T16:16:32.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.236+0000 7fa3c5c00640 1 -- 172.21.15.57:0/938524887 wait complete. 2024-02-28T16:16:32.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.236+0000 7fa3c5c00640 1 Processor -- start 2024-02-28T16:16:32.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.236+0000 7fa3c5c00640 1 -- start start 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.237+0000 7fa3c5c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c0104320 0x7fa3c0114c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.237+0000 7fa3c5c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3c0104cc0 0x7fa3c0115160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.237+0000 7fa3c5c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01157f0 con 0x7fa3c0104cc0 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.237+0000 7fa3c5c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c010ecf0 con 0x7fa3c0104320 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.237+0000 7fa3bf400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3c0104cc0 0x7fa3c0115160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.237+0000 7fa3bf400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3c0104cc0 0x7fa3c0115160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57148/0 (socket says 172.21.15.57:57148) 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.237+0000 7fa3bf400640 1 -- 172.21.15.57:0/2926754336 learned_addr learned my addr 172.21.15.57:0/2926754336 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.237+0000 7fa3bfe00640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c0104320 0x7fa3c0114c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.238+0000 7fa3bf400640 1 -- 172.21.15.57:0/2926754336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c0104320 msgr2=0x7fa3c0114c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.238+0000 7fa3bf400640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c0104320 0x7fa3c0114c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.238+0000 7fa3bf400640 1 -- 172.21.15.57:0/2926754336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0005040 con 0x7fa3c0104cc0 2024-02-28T16:16:32.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.238+0000 7fa3bf400640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3c0104cc0 0x7fa3c0115160 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00b790 tx=0x7fa3ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:32.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.238+0000 7fa3b7e00640 1 -- 172.21.15.57:0/2926754336 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3ac00c700 con 0x7fa3c0104cc0 2024-02-28T16:16:32.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.238+0000 7fa3b7e00640 1 -- 172.21.15.57:0/2926754336 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3ac00cd30 con 0x7fa3c0104cc0 2024-02-28T16:16:32.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.238+0000 7fa3c5c00640 1 -- 172.21.15.57:0/2926754336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c010efd0 con 0x7fa3c0104cc0 2024-02-28T16:16:32.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.238+0000 7fa3b7e00640 1 -- 172.21.15.57:0/2926754336 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3ac013370 con 0x7fa3c0104cc0 2024-02-28T16:16:32.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.238+0000 7fa3c5c00640 1 -- 172.21.15.57:0/2926754336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c010f4f0 con 0x7fa3c0104cc0 2024-02-28T16:16:32.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.240+0000 7fa3c5c00640 1 -- 172.21.15.57:0/2926754336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c004bcc0 con 0x7fa3c0104cc0 2024-02-28T16:16:32.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.240+0000 7fa3b7e00640 1 -- 172.21.15.57:0/2926754336 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fa3ac012070 con 0x7fa3c0104cc0 2024-02-28T16:16:32.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.241+0000 7fa3b7e00640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa3a406d750 0x7fa3a406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:32.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.241+0000 7fa3b7e00640 1 -- 172.21.15.57:0/2926754336 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fa3ac08cd10 con 0x7fa3c0104cc0 2024-02-28T16:16:32.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.242+0000 7fa3bfe00640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa3a406d750 0x7fa3a406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:32.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.242+0000 7fa3bfe00640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa3a406d750 0x7fa3a406fc00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0000c00 tx=0x7fa3b0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:32.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.246+0000 7fa3b7e00640 1 -- 172.21.15.57:0/2926754336 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa3ac056360 con 0x7fa3c0104cc0 2024-02-28T16:16:32.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.449+0000 7fa3c5c00640 1 -- 172.21.15.57:0/2926754336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3c010f770 con 0x7fa3c0104cc0 2024-02-28T16:16:32.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.449+0000 7fa3b7e00640 1 -- 172.21.15.57:0/2926754336 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3ac059a20 con 0x7fa3c0104cc0 2024-02-28T16:16:32.441 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-02-28T16:16:32.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.452+0000 7fa3c5c00640 1 -- 172.21.15.57:0/2926754336 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa3a406d750 msgr2=0x7fa3a406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:32.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.452+0000 7fa3c5c00640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa3a406d750 0x7fa3a406fc00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0000c00 tx=0x7fa3b0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.452+0000 7fa3c5c00640 1 -- 172.21.15.57:0/2926754336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3c0104cc0 msgr2=0x7fa3c0115160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.452+0000 7fa3c5c00640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3c0104cc0 0x7fa3c0115160 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00b790 tx=0x7fa3ac0091d0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.452+0000 7fa3c5c00640 1 -- 172.21.15.57:0/2926754336 shutdown_connections 2024-02-28T16:16:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.452+0000 7fa3c5c00640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fa3a406d750 0x7fa3a406fc00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.452+0000 7fa3c5c00640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3c0104cc0 0x7fa3c0115160 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.452+0000 7fa3c5c00640 1 --2- 172.21.15.57:0/2926754336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c0104320 0x7fa3c0114c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.452+0000 7fa3c5c00640 1 -- 172.21.15.57:0/2926754336 >> 172.21.15.57:0/2926754336 conn(0x7fa3c00f9f90 msgr2=0x7fa3c00fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.452+0000 7fa3c5c00640 1 -- 172.21.15.57:0/2926754336 shutdown_connections 2024-02-28T16:16:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.453+0000 7fa3c5c00640 1 -- 172.21.15.57:0/2926754336 wait complete. 2024-02-28T16:16:32.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:16:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.694+0000 7fd5eda00640 1 -- 172.21.15.57:0/4223901552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e8102740 msgr2=0x7fd5e8102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.694+0000 7fd5eda00640 1 --2- 172.21.15.57:0/4223901552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e8102740 0x7fd5e8102bb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00048d0 tx=0x7fd5d0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.694+0000 7fd5eda00640 1 -- 172.21.15.57:0/4223901552 shutdown_connections 2024-02-28T16:16:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.694+0000 7fd5eda00640 1 --2- 172.21.15.57:0/4223901552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e8102740 0x7fd5e8102bb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.694+0000 7fd5eda00640 1 --2- 172.21.15.57:0/4223901552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e8108760 0x7fd5e8108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.694+0000 7fd5eda00640 1 -- 172.21.15.57:0/4223901552 >> 172.21.15.57:0/4223901552 conn(0x7fd5e8071fc0 msgr2=0x7fd5e80743d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.695+0000 7fd5eda00640 1 -- 172.21.15.57:0/4223901552 shutdown_connections 2024-02-28T16:16:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.695+0000 7fd5eda00640 1 -- 172.21.15.57:0/4223901552 wait complete. 2024-02-28T16:16:32.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.695+0000 7fd5eda00640 1 Processor -- start 2024-02-28T16:16:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.696+0000 7fd5eda00640 1 -- start start 2024-02-28T16:16:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.696+0000 7fd5eda00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e8102740 0x7fd5e81190d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.696+0000 7fd5eda00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e8108760 0x7fd5e8119610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.696+0000 7fd5eda00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e8119c10 con 0x7fd5e8102740 2024-02-28T16:16:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.696+0000 7fd5eda00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e81131a0 con 0x7fd5e8108760 2024-02-28T16:16:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.696+0000 7fd5e7e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e8102740 0x7fd5e81190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.696+0000 7fd5e7e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e8102740 0x7fd5e81190d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57172/0 (socket says 172.21.15.57:57172) 2024-02-28T16:16:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.696+0000 7fd5e7e00640 1 -- 172.21.15.57:0/2306866281 learned_addr learned my addr 172.21.15.57:0/2306866281 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:32.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.697+0000 7fd5e7e00640 1 -- 172.21.15.57:0/2306866281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e8108760 msgr2=0x7fd5e8119610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:32.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.697+0000 7fd5dfe00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e8108760 0x7fd5e8119610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:32.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.697+0000 7fd5e7e00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e8108760 0x7fd5e8119610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.697+0000 7fd5e7e00640 1 -- 172.21.15.57:0/2306866281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0005040 con 0x7fd5e8102740 2024-02-28T16:16:32.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.697+0000 7fd5e7e00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e8102740 0x7fd5e81190d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8002a50 tx=0x7fd5d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:32.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.697+0000 7fd5e4c00640 1 -- 172.21.15.57:0/2306866281 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5d8007c30 con 0x7fd5e8102740 2024-02-28T16:16:32.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.698+0000 7fd5eda00640 1 -- 172.21.15.57:0/2306866281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e8113480 con 0x7fd5e8102740 2024-02-28T16:16:32.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.698+0000 7fd5e4c00640 1 -- 172.21.15.57:0/2306866281 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5d800f040 con 0x7fd5e8102740 2024-02-28T16:16:32.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.698+0000 7fd5e4c00640 1 -- 172.21.15.57:0/2306866281 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5d800db50 con 0x7fd5e8102740 2024-02-28T16:16:32.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.698+0000 7fd5eda00640 1 -- 172.21.15.57:0/2306866281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e81139a0 con 0x7fd5e8102740 2024-02-28T16:16:32.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.699+0000 7fd5eda00640 1 -- 172.21.15.57:0/2306866281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e804bcc0 con 0x7fd5e8102740 2024-02-28T16:16:32.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.700+0000 7fd5e4c00640 1 -- 172.21.15.57:0/2306866281 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fd5d801c400 con 0x7fd5e8102740 2024-02-28T16:16:32.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.701+0000 7fd5e4c00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd5cc06d750 0x7fd5cc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:32.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.701+0000 7fd5e4c00640 1 -- 172.21.15.57:0/2306866281 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fd5d808c9a0 con 0x7fd5e8102740 2024-02-28T16:16:32.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.701+0000 7fd5dfe00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd5cc06d750 0x7fd5cc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:32.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.702+0000 7fd5dfe00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd5cc06d750 0x7fd5cc06fc00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd5d002bda0 tx=0x7fd5d0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:32.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.706+0000 7fd5e4c00640 1 -- 172.21.15.57:0/2306866281 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd5d8055ff0 con 0x7fd5e8102740 2024-02-28T16:16:32.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.909+0000 7fd5eda00640 1 -- 172.21.15.57:0/2306866281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fd5e8105a20 con 0x7fd5e8102740 2024-02-28T16:16:32.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.910+0000 7fd5e4c00640 1 -- 172.21.15.57:0/2306866281 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v103) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd5e8105a20 con 0x7fd5e8102740 2024-02-28T16:16:32.901 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-02-28T16:16:32.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 -- 172.21.15.57:0/2306866281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd5cc06d750 msgr2=0x7fd5cc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:32.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd5cc06d750 0x7fd5cc06fc00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd5d002bda0 tx=0x7fd5d0009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 -- 172.21.15.57:0/2306866281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e8102740 msgr2=0x7fd5e81190d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:32.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e8102740 0x7fd5e81190d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8002a50 tx=0x7fd5d8004600 comp rx=0 tx=0).stop 2024-02-28T16:16:32.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 -- 172.21.15.57:0/2306866281 shutdown_connections 2024-02-28T16:16:32.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fd5cc06d750 0x7fd5cc06fc00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e8108760 0x7fd5e8119610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 --2- 172.21.15.57:0/2306866281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e8102740 0x7fd5e81190d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:32.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 -- 172.21.15.57:0/2306866281 >> 172.21.15.57:0/2306866281 conn(0x7fd5e8071fc0 msgr2=0x7fd5e8074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:32.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 -- 172.21.15.57:0/2306866281 shutdown_connections 2024-02-28T16:16:32.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:32.913+0000 7fd5eda00640 1 -- 172.21.15.57:0/2306866281 wait complete. 2024-02-28T16:16:32.925 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:16:33.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.155+0000 7efd13200640 1 -- 172.21.15.57:0/4083079225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd0c104320 msgr2=0x7efd0c1046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:33.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.155+0000 7efd13200640 1 --2- 172.21.15.57:0/4083079225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd0c104320 0x7efd0c1046f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efd000048d0 tx=0x7efd00009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.155+0000 7efd13200640 1 -- 172.21.15.57:0/4083079225 shutdown_connections 2024-02-28T16:16:33.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.155+0000 7efd13200640 1 --2- 172.21.15.57:0/4083079225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd0c104cc0 0x7efd0c0fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.155+0000 7efd13200640 1 --2- 172.21.15.57:0/4083079225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd0c104320 0x7efd0c1046f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.155+0000 7efd13200640 1 -- 172.21.15.57:0/4083079225 >> 172.21.15.57:0/4083079225 conn(0x7efd0c0f9f90 msgr2=0x7efd0c0fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:33.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.155+0000 7efd13200640 1 -- 172.21.15.57:0/4083079225 shutdown_connections 2024-02-28T16:16:33.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.155+0000 7efd13200640 1 -- 172.21.15.57:0/4083079225 wait complete. 2024-02-28T16:16:33.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.156+0000 7efd13200640 1 Processor -- start 2024-02-28T16:16:33.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.156+0000 7efd13200640 1 -- start start 2024-02-28T16:16:33.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.157+0000 7efd13200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd0c104320 0x7efd0c114c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:33.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.157+0000 7efd13200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd0c104cc0 0x7efd0c1151a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:33.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.157+0000 7efd13200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c1157a0 con 0x7efd0c104cc0 2024-02-28T16:16:33.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.157+0000 7efd13200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c10ed30 con 0x7efd0c104320 2024-02-28T16:16:33.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.157+0000 7efd11400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd0c104cc0 0x7efd0c1151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:33.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.157+0000 7efd11400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd0c104cc0 0x7efd0c1151a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57190/0 (socket says 172.21.15.57:57190) 2024-02-28T16:16:33.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.157+0000 7efd11400640 1 -- 172.21.15.57:0/615700115 learned_addr learned my addr 172.21.15.57:0/615700115 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:33.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.158+0000 7efd11e00640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd0c104320 0x7efd0c114c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:33.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.158+0000 7efd11400640 1 -- 172.21.15.57:0/615700115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd0c104320 msgr2=0x7efd0c114c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:33.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.158+0000 7efd11400640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd0c104320 0x7efd0c114c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.158+0000 7efd11400640 1 -- 172.21.15.57:0/615700115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd00005040 con 0x7efd0c104cc0 2024-02-28T16:16:33.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.158+0000 7efd11400640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd0c104cc0 0x7efd0c1151a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7efcf8002a50 tx=0x7efcf8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:33.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.158+0000 7efd06000640 1 -- 172.21.15.57:0/615700115 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf8007c30 con 0x7efd0c104cc0 2024-02-28T16:16:33.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.158+0000 7efd06000640 1 -- 172.21.15.57:0/615700115 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcf800f040 con 0x7efd0c104cc0 2024-02-28T16:16:33.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.158+0000 7efd06000640 1 -- 172.21.15.57:0/615700115 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf800db50 con 0x7efd0c104cc0 2024-02-28T16:16:33.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.158+0000 7efd13200640 1 -- 172.21.15.57:0/615700115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c10f010 con 0x7efd0c104cc0 2024-02-28T16:16:33.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.159+0000 7efd13200640 1 -- 172.21.15.57:0/615700115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c10f530 con 0x7efd0c104cc0 2024-02-28T16:16:33.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.160+0000 7efd13200640 1 -- 172.21.15.57:0/615700115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c04bcc0 con 0x7efd0c104cc0 2024-02-28T16:16:33.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.161+0000 7efd06000640 1 -- 172.21.15.57:0/615700115 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7efcf800dcf0 con 0x7efd0c104cc0 2024-02-28T16:16:33.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.161+0000 7efd06000640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcf406d750 0x7efcf406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:33.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.162+0000 7efd06000640 1 -- 172.21.15.57:0/615700115 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7efcf808c920 con 0x7efd0c104cc0 2024-02-28T16:16:33.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.162+0000 7efd11e00640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcf406d750 0x7efcf406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:33.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.163+0000 7efd11e00640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcf406d750 0x7efcf406fc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efd0002bda0 tx=0x7efd00009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:33.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.166+0000 7efd06000640 1 -- 172.21.15.57:0/615700115 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efcf8055ff0 con 0x7efd0c104cc0 2024-02-28T16:16:33.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:32 smithi057 ceph-mon[93219]: pgmap v416: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:33.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:32 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/927064826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:16:33.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:32 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2926754336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:16:33.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:32 smithi087 ceph-mon[82628]: pgmap v416: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:33.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:32 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/927064826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:16:33.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:32 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2926754336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:16:33.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.368+0000 7efd13200640 1 -- 172.21.15.57:0/615700115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7efd0c1015c0 con 0x7efd0c104cc0 2024-02-28T16:16:33.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.369+0000 7efd06000640 1 -- 172.21.15.57:0/615700115 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v103) v1 ==== 107+0+11 (secure 0 0 0) 0x7efcf80596b0 con 0x7efd0c104cc0 2024-02-28T16:16:33.360 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-02-28T16:16:33.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 -- 172.21.15.57:0/615700115 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcf406d750 msgr2=0x7efcf406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:33.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcf406d750 0x7efcf406fc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efd0002bda0 tx=0x7efd00009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 -- 172.21.15.57:0/615700115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd0c104cc0 msgr2=0x7efd0c1151a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:33.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd0c104cc0 0x7efd0c1151a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7efcf8002a50 tx=0x7efcf8004600 comp rx=0 tx=0).stop 2024-02-28T16:16:33.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 -- 172.21.15.57:0/615700115 shutdown_connections 2024-02-28T16:16:33.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7efcf406d750 0x7efcf406fc00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd0c104cc0 0x7efd0c1151a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 --2- 172.21.15.57:0/615700115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd0c104320 0x7efd0c114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 -- 172.21.15.57:0/615700115 >> 172.21.15.57:0/615700115 conn(0x7efd0c0f9f90 msgr2=0x7efd0c0fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:33.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 -- 172.21.15.57:0/615700115 shutdown_connections 2024-02-28T16:16:33.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.372+0000 7efd13200640 1 -- 172.21.15.57:0/615700115 wait complete. 2024-02-28T16:16:33.382 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-28T16:16:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.599+0000 7fdde0a00640 1 -- 172.21.15.57:0/2660972666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdddc109330 msgr2=0x7fdddc1032d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.599+0000 7fdde0a00640 1 --2- 172.21.15.57:0/2660972666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdddc109330 0x7fdddc1032d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fddc40048d0 tx=0x7fddc4009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.599+0000 7fdde0a00640 1 -- 172.21.15.57:0/2660972666 shutdown_connections 2024-02-28T16:16:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.599+0000 7fdde0a00640 1 --2- 172.21.15.57:0/2660972666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdddc109330 0x7fdddc1032d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.599+0000 7fdde0a00640 1 --2- 172.21.15.57:0/2660972666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdddc108990 0x7fdddc108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.599+0000 7fdde0a00640 1 -- 172.21.15.57:0/2660972666 >> 172.21.15.57:0/2660972666 conn(0x7fdddc072210 msgr2=0x7fdddc074620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.599+0000 7fdde0a00640 1 -- 172.21.15.57:0/2660972666 shutdown_connections 2024-02-28T16:16:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.600+0000 7fdde0a00640 1 -- 172.21.15.57:0/2660972666 wait complete. 2024-02-28T16:16:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.600+0000 7fdde0a00640 1 Processor -- start 2024-02-28T16:16:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.600+0000 7fdde0a00640 1 -- start start 2024-02-28T16:16:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.601+0000 7fdde0a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdddc108990 0x7fdddc119220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.601+0000 7fdde0a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdddc109330 0x7fdddc119760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.601+0000 7fdde0a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc119d60 con 0x7fdddc108990 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.601+0000 7fdde0a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc1132f0 con 0x7fdddc109330 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.601+0000 7fddd9e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdddc108990 0x7fdddc119220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.601+0000 7fddd9e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdddc108990 0x7fdddc119220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57200/0 (socket says 172.21.15.57:57200) 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.601+0000 7fddd9e00640 1 -- 172.21.15.57:0/2435022901 learned_addr learned my addr 172.21.15.57:0/2435022901 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.601+0000 7fddd3e00640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdddc109330 0x7fdddc119760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.601+0000 7fddd9e00640 1 -- 172.21.15.57:0/2435022901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdddc109330 msgr2=0x7fdddc119760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.601+0000 7fddd9e00640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdddc109330 0x7fdddc119760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.602+0000 7fddd9e00640 1 -- 172.21.15.57:0/2435022901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4005040 con 0x7fdddc108990 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.602+0000 7fddd9e00640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdddc108990 0x7fdddc119220 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fddcc002a50 tx=0x7fddcc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.602+0000 7fddd2000640 1 -- 172.21.15.57:0/2435022901 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddcc007c30 con 0x7fdddc108990 2024-02-28T16:16:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.602+0000 7fddd2000640 1 -- 172.21.15.57:0/2435022901 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fddcc00f040 con 0x7fdddc108990 2024-02-28T16:16:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.602+0000 7fddd2000640 1 -- 172.21.15.57:0/2435022901 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddcc00dbe0 con 0x7fdddc108990 2024-02-28T16:16:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.602+0000 7fdde0a00640 1 -- 172.21.15.57:0/2435022901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc1135d0 con 0x7fdddc108990 2024-02-28T16:16:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.602+0000 7fdde0a00640 1 -- 172.21.15.57:0/2435022901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc113af0 con 0x7fdddc108990 2024-02-28T16:16:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.604+0000 7fdde0a00640 1 -- 172.21.15.57:0/2435022901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc064480 con 0x7fdddc108990 2024-02-28T16:16:33.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.605+0000 7fddd2000640 1 -- 172.21.15.57:0/2435022901 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 39) v1 ==== 91485+0+0 (secure 0 0 0) 0x7fddcc00dd40 con 0x7fdddc108990 2024-02-28T16:16:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.605+0000 7fddd2000640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fddc006d750 0x7fddc006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.606+0000 7fddd2000640 1 -- 172.21.15.57:0/2435022901 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fddcc08cf90 con 0x7fdddc108990 2024-02-28T16:16:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.606+0000 7fddd3e00640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fddc006d750 0x7fddc006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.607+0000 7fddd3e00640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fddc006d750 0x7fddc006fc00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fddc4000c00 tx=0x7fddc4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:33.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.610+0000 7fddd2000640 1 -- 172.21.15.57:0/2435022901 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fddcc056660 con 0x7fdddc108990 2024-02-28T16:16:33.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.828+0000 7fdde0a00640 1 -- 172.21.15.57:0/2435022901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdddc10fb60 con 0x7fdddc108990 2024-02-28T16:16:33.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.829+0000 7fddd2000640 1 -- 172.21.15.57:0/2435022901 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v103) v1 ==== 81+0+2305 (secure 0 0 0) 0x7fddcc059d20 con 0x7fdddc108990 2024-02-28T16:16:33.821 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6828/3861545073 2024-02-29T16:11:21.561856+0000 2024-02-28T16:16:33.821 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6827/1436733447 2024-02-29T16:10:49.544938+0000 2024-02-28T16:16:33.821 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6801/3389594762 2024-02-29T15:50:16.193611+0000 2024-02-28T16:16:33.821 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/1871958144 2024-02-29T15:49:35.637547+0000 2024-02-28T16:16:33.821 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/3728594338 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:33.821 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:0/4142702720 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:33.821 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/3926246244 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:33.821 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/810130858 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/3171524924 2024-02-29T15:49:35.637547+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/794302018 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6800/3389594762 2024-02-29T15:50:16.193611+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:0/1921033756 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:6829/3858637717 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/1819633079 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2510955053 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6829/3861545073 2024-02-29T16:11:21.561856+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2729792809 2024-02-29T15:50:16.193611+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/509992026 2024-02-29T15:50:16.193611+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6801/1609955238 2024-02-29T15:49:35.637547+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/4184139864 2024-02-29T15:49:35.637547+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/3955176243 2024-02-29T15:51:51.209781+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:0/3563981670 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:33.822 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:6828/3858637717 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/4078846536 2024-02-29T15:50:16.193611+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6800/2828490283 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6801/2828490283 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6800/1609955238 2024-02-29T15:49:35.637547+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6800/4162336432 2024-02-29T15:51:51.209781+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/961475533 2024-02-29T16:01:00.964498+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6801/4162336432 2024-02-29T15:51:51.209781+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:0/3414157439 2024-02-29T16:03:12.188113+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/429066936 2024-02-29T15:51:51.209781+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2044423401 2024-02-29T15:51:51.209781+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/1211502049 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6826/1436733447 2024-02-29T16:10:49.544938+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6800/3297260515 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:33.823 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/4173475219 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:33.824 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6801/3297260515 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:33.824 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2332815594 2024-02-29T16:04:33.669357+0000 2024-02-28T16:16:33.824 INFO:teuthology.orchestra.run.smithi057.stderr:listed 39 entries 2024-02-28T16:16:33.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.832+0000 7fdde0a00640 1 -- 172.21.15.57:0/2435022901 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fddc006d750 msgr2=0x7fddc006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.832+0000 7fdde0a00640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fddc006d750 0x7fddc006fc00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fddc4000c00 tx=0x7fddc4009da0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.832+0000 7fdde0a00640 1 -- 172.21.15.57:0/2435022901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdddc108990 msgr2=0x7fdddc119220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.832+0000 7fdde0a00640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdddc108990 0x7fdddc119220 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fddcc002a50 tx=0x7fddcc004600 comp rx=0 tx=0).stop 2024-02-28T16:16:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.832+0000 7fdde0a00640 1 -- 172.21.15.57:0/2435022901 shutdown_connections 2024-02-28T16:16:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.832+0000 7fdde0a00640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.57:6800/2269634640,v1:172.21.15.57:6801/2269634640] conn(0x7fddc006d750 0x7fddc006fc00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.832+0000 7fdde0a00640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdddc109330 0x7fdddc119760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.832+0000 7fdde0a00640 1 --2- 172.21.15.57:0/2435022901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdddc108990 0x7fdddc119220 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.832+0000 7fdde0a00640 1 -- 172.21.15.57:0/2435022901 >> 172.21.15.57:0/2435022901 conn(0x7fdddc072210 msgr2=0x7fdddc073d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.833+0000 7fdde0a00640 1 -- 172.21.15.57:0/2435022901 shutdown_connections 2024-02-28T16:16:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-02-28T16:16:33.833+0000 7fdde0a00640 1 -- 172.21.15.57:0/2435022901 wait complete. 2024-02-28T16:16:33.842 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi057.front.sepia.ceph.com... 2024-02-28T16:16:33.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:16:33.843 DEBUG:teuthology.orchestra.run.smithi057:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-02-28T16:16:33.937 INFO:teuthology.orchestra.run:waiting for 300 2024-02-28T16:16:34.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:33 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2306866281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:16:34.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:33 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/615700115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:16:34.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:34.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:33 smithi057 ceph-mon[93219]: from='client.? 172.21.15.57:0/2435022901' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:16:34.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:33 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2306866281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:16:34.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:33 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/615700115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:16:34.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:34.214 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:33 smithi087 ceph-mon[82628]: from='client.? 172.21.15.57:0/2435022901' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:34 smithi057 ceph-mon[93219]: pgmap v417: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:35.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:34 smithi087 ceph-mon[82628]: pgmap v417: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:37.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:37 smithi057 ceph-mon[93219]: pgmap v418: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:37.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:37 smithi087 ceph-mon[82628]: pgmap v418: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:39.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:39 smithi057 ceph-mon[93219]: pgmap v419: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:39.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:39 smithi087 ceph-mon[82628]: pgmap v419: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:41.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:41 smithi057 ceph-mon[93219]: pgmap v420: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:41.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:41 smithi087 ceph-mon[82628]: pgmap v420: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:43.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:43 smithi057 ceph-mon[93219]: pgmap v421: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:43.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:43 smithi087 ceph-mon[82628]: pgmap v421: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:45.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:45 smithi057 ceph-mon[93219]: pgmap v422: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:45.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:45 smithi087 ceph-mon[82628]: pgmap v422: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:47.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:47 smithi057 ceph-mon[93219]: pgmap v423: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:47.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:47 smithi087 ceph-mon[82628]: pgmap v423: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:49.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:49 smithi057 ceph-mon[93219]: pgmap v424: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:49.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:49.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:49 smithi087 ceph-mon[82628]: pgmap v424: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:49.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:51.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:51 smithi057 ceph-mon[93219]: pgmap v425: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:51.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:51 smithi087 ceph-mon[82628]: pgmap v425: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:16:53.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:53 smithi057 ceph-mon[93219]: pgmap v426: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:53.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:53 smithi087 ceph-mon[82628]: pgmap v426: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:16:55.426 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:55 smithi057 ceph-mon[93219]: pgmap v427: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:55.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:55 smithi087 ceph-mon[82628]: pgmap v427: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:57.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:57 smithi057 ceph-mon[93219]: pgmap v428: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:57.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:57 smithi087 ceph-mon[82628]: pgmap v428: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:16:59.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:16:59 smithi057 ceph-mon[93219]: pgmap v429: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:16:59.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:16:59 smithi087 ceph-mon[82628]: pgmap v429: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:01.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:01 smithi057 ceph-mon[93219]: pgmap v430: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:17:01.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:01 smithi087 ceph-mon[82628]: pgmap v430: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:17:03.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:03 smithi057 ceph-mon[93219]: pgmap v431: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:17:03.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:03 smithi087 ceph-mon[82628]: pgmap v431: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:17:04.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:04.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:05.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:05 smithi057 ceph-mon[93219]: pgmap v432: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:05.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:05 smithi087 ceph-mon[82628]: pgmap v432: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:07.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:07 smithi057 ceph-mon[93219]: pgmap v433: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:17:07.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:07 smithi087 ceph-mon[82628]: pgmap v433: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:17:09.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:09 smithi057 ceph-mon[93219]: pgmap v434: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:09.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:09 smithi087 ceph-mon[82628]: pgmap v434: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:11.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:11 smithi057 ceph-mon[93219]: pgmap v435: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:17:11.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:11 smithi087 ceph-mon[82628]: pgmap v435: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:17:13.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:13 smithi057 ceph-mon[93219]: pgmap v436: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:17:13.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:13 smithi087 ceph-mon[82628]: pgmap v436: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:17:15.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:15 smithi057 ceph-mon[93219]: pgmap v437: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:15.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:15 smithi087 ceph-mon[82628]: pgmap v437: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:17.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:17 smithi057 ceph-mon[93219]: pgmap v438: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:17:17.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:17 smithi087 ceph-mon[82628]: pgmap v438: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:17:19.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:19 smithi057 ceph-mon[93219]: pgmap v439: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:19.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:19.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:19 smithi087 ceph-mon[82628]: pgmap v439: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:19.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:21.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:21 smithi057 ceph-mon[93219]: pgmap v440: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:17:21.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:21 smithi087 ceph-mon[82628]: pgmap v440: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:17:23.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:23 smithi057 ceph-mon[93219]: pgmap v441: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:17:23.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:23 smithi087 ceph-mon[82628]: pgmap v441: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:17:24.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:24 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:24.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:24 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:25.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:25 smithi057 ceph-mon[93219]: pgmap v442: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:25.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:25.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:25.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:25 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:17:25.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:25 smithi087 ceph-mon[82628]: pgmap v442: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:25.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:25.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:25.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:25 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:17:27.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:27 smithi057 ceph-mon[93219]: pgmap v443: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:17:27.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:27 smithi087 ceph-mon[82628]: pgmap v443: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:17:29.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:29 smithi087 ceph-mon[82628]: pgmap v444: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:30.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:29 smithi057 ceph-mon[93219]: pgmap v444: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:31.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:31 smithi087 ceph-mon[82628]: pgmap v445: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:17:32.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:31 smithi057 ceph-mon[93219]: pgmap v445: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:17:33.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:33 smithi087 ceph-mon[82628]: pgmap v446: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:17:34.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:33 smithi057 ceph-mon[93219]: pgmap v446: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:17:34.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:35.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:35.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:35 smithi087 ceph-mon[82628]: pgmap v447: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:36.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:35 smithi057 ceph-mon[93219]: pgmap v447: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:37.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:37 smithi087 ceph-mon[82628]: pgmap v448: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:17:38.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:37 smithi057 ceph-mon[93219]: pgmap v448: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:17:40.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:39 smithi057 ceph-mon[93219]: pgmap v449: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:17:40.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:39 smithi087 ceph-mon[82628]: pgmap v449: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:17:42.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:41 smithi057 ceph-mon[93219]: pgmap v450: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-28T16:17:42.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:41 smithi087 ceph-mon[82628]: pgmap v450: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-28T16:17:43.115 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:42 smithi087 ceph-mon[82628]: pgmap v451: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-28T16:17:43.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:42 smithi057 ceph-mon[93219]: pgmap v451: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-28T16:17:45.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:45 smithi057 ceph-mon[93219]: pgmap v452: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:17:45.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:45 smithi087 ceph-mon[82628]: pgmap v452: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:17:47.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:47 smithi057 ceph-mon[93219]: pgmap v453: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:17:47.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:47 smithi087 ceph-mon[82628]: pgmap v453: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:17:49.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:49 smithi057 ceph-mon[93219]: pgmap v454: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:49.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:49.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:49 smithi087 ceph-mon[82628]: pgmap v454: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:49.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:51.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:51 smithi057 ceph-mon[93219]: pgmap v455: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:17:51.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:51 smithi087 ceph-mon[82628]: pgmap v455: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:17:53.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:53 smithi057 ceph-mon[93219]: pgmap v456: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:17:53.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:53 smithi087 ceph-mon[82628]: pgmap v456: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:17:55.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:55 smithi057 ceph-mon[93219]: pgmap v457: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:55.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:55 smithi087 ceph-mon[82628]: pgmap v457: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:57.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:57 smithi057 ceph-mon[93219]: pgmap v458: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:17:57.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:57 smithi087 ceph-mon[82628]: pgmap v458: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:17:59.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:17:59 smithi057 ceph-mon[93219]: pgmap v459: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:17:59.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:17:59 smithi087 ceph-mon[82628]: pgmap v459: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:01.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:01 smithi057 ceph-mon[93219]: pgmap v460: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:01.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:01 smithi087 ceph-mon[82628]: pgmap v460: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:03.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:03 smithi057 ceph-mon[93219]: pgmap v461: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:03.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:03 smithi087 ceph-mon[82628]: pgmap v461: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:04.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:04.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:05.428 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:05 smithi057 ceph-mon[93219]: pgmap v462: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:05.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:05 smithi087 ceph-mon[82628]: pgmap v462: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:07.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:07 smithi057 ceph-mon[93219]: pgmap v463: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:07.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:07 smithi087 ceph-mon[82628]: pgmap v463: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:09.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:09 smithi057 ceph-mon[93219]: pgmap v464: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:09.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:09 smithi087 ceph-mon[82628]: pgmap v464: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:11.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:11 smithi087 ceph-mon[82628]: pgmap v465: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:11.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:11 smithi057 ceph-mon[93219]: pgmap v465: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:13.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:13 smithi087 ceph-mon[82628]: pgmap v466: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:13.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:13 smithi057 ceph-mon[93219]: pgmap v466: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:15.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:15 smithi087 ceph-mon[82628]: pgmap v467: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:15.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:15 smithi057 ceph-mon[93219]: pgmap v467: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:17.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:17 smithi087 ceph-mon[82628]: pgmap v468: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:17.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:17 smithi057 ceph-mon[93219]: pgmap v468: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:19.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:19 smithi057 ceph-mon[93219]: pgmap v469: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:19.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:19.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:19 smithi087 ceph-mon[82628]: pgmap v469: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:19.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:21.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:21 smithi057 ceph-mon[93219]: pgmap v470: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:21.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:21 smithi087 ceph-mon[82628]: pgmap v470: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:23.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:23 smithi057 ceph-mon[93219]: pgmap v471: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:23.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:23 smithi087 ceph-mon[82628]: pgmap v471: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:25.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:25 smithi057 ceph-mon[93219]: pgmap v472: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:25.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:25 smithi087 ceph-mon[82628]: pgmap v472: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:26.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:26 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:26.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:26 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:27.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:27 smithi057 ceph-mon[93219]: pgmap v473: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:27.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:27.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:27.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:18:27.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:27 smithi087 ceph-mon[82628]: pgmap v473: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:27.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:27.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:27.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:18:29.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:29 smithi057 ceph-mon[93219]: pgmap v474: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:29.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:29 smithi087 ceph-mon[82628]: pgmap v474: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:31.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:31 smithi057 ceph-mon[93219]: pgmap v475: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:31.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:31 smithi087 ceph-mon[82628]: pgmap v475: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:33.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:33 smithi057 ceph-mon[93219]: pgmap v476: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:33.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:33 smithi087 ceph-mon[82628]: pgmap v476: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:34.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:34.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:35.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:35 smithi057 ceph-mon[93219]: pgmap v477: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:35.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:35 smithi087 ceph-mon[82628]: pgmap v477: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:37.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:37 smithi057 ceph-mon[93219]: pgmap v478: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:37.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:37 smithi087 ceph-mon[82628]: pgmap v478: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:39.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:39 smithi057 ceph-mon[93219]: pgmap v479: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:39.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:39 smithi087 ceph-mon[82628]: pgmap v479: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:41.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:41 smithi057 ceph-mon[93219]: pgmap v480: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:41.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:41 smithi087 ceph-mon[82628]: pgmap v480: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:43.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:43 smithi057 ceph-mon[93219]: pgmap v481: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:43.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:43 smithi087 ceph-mon[82628]: pgmap v481: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:45.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:45 smithi057 ceph-mon[93219]: pgmap v482: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:45.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:45 smithi087 ceph-mon[82628]: pgmap v482: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:47.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:47 smithi057 ceph-mon[93219]: pgmap v483: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:47.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:47 smithi087 ceph-mon[82628]: pgmap v483: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:49.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:49 smithi057 ceph-mon[93219]: pgmap v484: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:49.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:49.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:49 smithi087 ceph-mon[82628]: pgmap v484: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:49.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:51.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:51 smithi057 ceph-mon[93219]: pgmap v485: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:51.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:51 smithi087 ceph-mon[82628]: pgmap v485: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:18:53.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:53 smithi057 ceph-mon[93219]: pgmap v486: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:53.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:53 smithi087 ceph-mon[82628]: pgmap v486: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:18:55.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:55 smithi057 ceph-mon[93219]: pgmap v487: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:55.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:55 smithi087 ceph-mon[82628]: pgmap v487: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:57.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:57 smithi057 ceph-mon[93219]: pgmap v488: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:57.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:57 smithi087 ceph-mon[82628]: pgmap v488: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:18:59.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:18:59 smithi057 ceph-mon[93219]: pgmap v489: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:18:59.715 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:18:59 smithi087 ceph-mon[82628]: pgmap v489: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:01.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:01 smithi057 ceph-mon[93219]: pgmap v490: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:19:01.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:01 smithi087 ceph-mon[82628]: pgmap v490: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:19:03.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:03 smithi057 ceph-mon[93219]: pgmap v491: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:19:03.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:03 smithi087 ceph-mon[82628]: pgmap v491: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:19:04.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:04.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:05.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:05 smithi087 ceph-mon[82628]: pgmap v492: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:05.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:05 smithi057 ceph-mon[93219]: pgmap v492: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:07.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:07 smithi087 ceph-mon[82628]: pgmap v493: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:19:07.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:07 smithi057 ceph-mon[93219]: pgmap v493: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:19:09.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:09 smithi087 ceph-mon[82628]: pgmap v494: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:09.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:09 smithi057 ceph-mon[93219]: pgmap v494: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:11.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:11 smithi087 ceph-mon[82628]: pgmap v495: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:19:11.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:11 smithi057 ceph-mon[93219]: pgmap v495: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:19:13.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:13 smithi087 ceph-mon[82628]: pgmap v496: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:19:13.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:13 smithi057 ceph-mon[93219]: pgmap v496: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:19:15.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:15 smithi057 ceph-mon[93219]: pgmap v497: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:15.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:15 smithi087 ceph-mon[82628]: pgmap v497: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:17.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:17 smithi057 ceph-mon[93219]: pgmap v498: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:19:17.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:17 smithi087 ceph-mon[82628]: pgmap v498: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:19:19.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:19 smithi057 ceph-mon[93219]: pgmap v499: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:19.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:19.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:19 smithi087 ceph-mon[82628]: pgmap v499: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:19.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:21.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:21 smithi057 ceph-mon[93219]: pgmap v500: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:19:21.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:21 smithi087 ceph-mon[82628]: pgmap v500: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:19:23.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:23 smithi057 ceph-mon[93219]: pgmap v501: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:19:23.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:23 smithi087 ceph-mon[82628]: pgmap v501: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:19:25.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:25 smithi057 ceph-mon[93219]: pgmap v502: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:25.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:25 smithi087 ceph-mon[82628]: pgmap v502: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:27.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:27 smithi057 ceph-mon[93219]: pgmap v503: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:19:27.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:27 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:27.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:27 smithi087 ceph-mon[82628]: pgmap v503: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:19:27.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:27 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:29.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:29 smithi057 ceph-mon[93219]: pgmap v504: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:29.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:29 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:29.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:29 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:29.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:29 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:19:29.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:29 smithi087 ceph-mon[82628]: pgmap v504: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:29.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:29 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:29.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:29 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:29.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:29 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:19:31.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:31 smithi057 ceph-mon[93219]: pgmap v505: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:19:31.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:31 smithi087 ceph-mon[82628]: pgmap v505: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:19:33.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:33 smithi057 ceph-mon[93219]: pgmap v506: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:19:33.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:33 smithi087 ceph-mon[82628]: pgmap v506: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:19:34.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:34.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:35.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:35 smithi057 ceph-mon[93219]: pgmap v507: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:35.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:35 smithi087 ceph-mon[82628]: pgmap v507: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:37.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:37 smithi057 ceph-mon[93219]: pgmap v508: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:19:37.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:37 smithi087 ceph-mon[82628]: pgmap v508: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:19:39.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:39 smithi057 ceph-mon[93219]: pgmap v509: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:39.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:39 smithi087 ceph-mon[82628]: pgmap v509: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:41.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:41 smithi057 ceph-mon[93219]: pgmap v510: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:19:41.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:41 smithi087 ceph-mon[82628]: pgmap v510: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:19:43.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:43 smithi057 ceph-mon[93219]: pgmap v511: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:19:43.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:43 smithi087 ceph-mon[82628]: pgmap v511: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:19:45.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:45 smithi057 ceph-mon[93219]: pgmap v512: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:45.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:45 smithi087 ceph-mon[82628]: pgmap v512: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:47.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:47 smithi057 ceph-mon[93219]: pgmap v513: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:19:47.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:47 smithi087 ceph-mon[82628]: pgmap v513: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:19:49.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:49 smithi057 ceph-mon[93219]: pgmap v514: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:19:49.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:49.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:49 smithi087 ceph-mon[82628]: pgmap v514: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:19:49.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:51.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:51 smithi057 ceph-mon[93219]: pgmap v515: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-28T16:19:51.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:51 smithi087 ceph-mon[82628]: pgmap v515: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-28T16:19:53.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:53 smithi057 ceph-mon[93219]: pgmap v516: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-28T16:19:53.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:53 smithi087 ceph-mon[82628]: pgmap v516: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-28T16:19:55.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:55 smithi057 ceph-mon[93219]: pgmap v517: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:19:55.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:55 smithi087 ceph-mon[82628]: pgmap v517: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-28T16:19:57.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:57 smithi057 ceph-mon[93219]: pgmap v518: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:19:57.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:57 smithi087 ceph-mon[82628]: pgmap v518: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-28T16:19:59.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:19:59 smithi057 ceph-mon[93219]: pgmap v519: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:19:59.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:19:59 smithi087 ceph-mon[82628]: pgmap v519: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:00.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:00 smithi057 ceph-mon[93219]: overall HEALTH_OK 2024-02-28T16:20:00.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:00 smithi087 ceph-mon[82628]: overall HEALTH_OK 2024-02-28T16:20:01.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:01 smithi057 ceph-mon[93219]: pgmap v520: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:01.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:01 smithi087 ceph-mon[82628]: pgmap v520: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:03.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:03 smithi057 ceph-mon[93219]: pgmap v521: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:03.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:03 smithi087 ceph-mon[82628]: pgmap v521: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:04.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:04.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:05.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:05 smithi057 ceph-mon[93219]: pgmap v522: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:05.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:05 smithi087 ceph-mon[82628]: pgmap v522: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:07.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:07 smithi087 ceph-mon[82628]: pgmap v523: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:08.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:07 smithi057 ceph-mon[93219]: pgmap v523: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:09.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:09 smithi087 ceph-mon[82628]: pgmap v524: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:10.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:09 smithi057 ceph-mon[93219]: pgmap v524: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:11.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:11 smithi087 ceph-mon[82628]: pgmap v525: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:12.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:11 smithi057 ceph-mon[93219]: pgmap v525: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:13.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:13 smithi087 ceph-mon[82628]: pgmap v526: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:14.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:13 smithi057 ceph-mon[93219]: pgmap v526: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:15.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:15 smithi087 ceph-mon[82628]: pgmap v527: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:16.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:15 smithi057 ceph-mon[93219]: pgmap v527: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:18.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:17 smithi057 ceph-mon[93219]: pgmap v528: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:18.215 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:17 smithi087 ceph-mon[82628]: pgmap v528: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:20.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:19 smithi057 ceph-mon[93219]: pgmap v529: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:20.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:20.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:19 smithi087 ceph-mon[82628]: pgmap v529: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:20.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:22.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:21 smithi057 ceph-mon[93219]: pgmap v530: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:22.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:21 smithi087 ceph-mon[82628]: pgmap v530: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:24.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:23 smithi057 ceph-mon[93219]: pgmap v531: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:24.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:23 smithi087 ceph-mon[82628]: pgmap v531: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:26.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:25 smithi057 ceph-mon[93219]: pgmap v532: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:26.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:25 smithi087 ceph-mon[82628]: pgmap v532: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:28.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:27 smithi057 ceph-mon[93219]: pgmap v533: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:28.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:27 smithi087 ceph-mon[82628]: pgmap v533: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:30.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:29 smithi057 ceph-mon[93219]: pgmap v534: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:30.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:29 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:30.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:29 smithi087 ceph-mon[82628]: pgmap v534: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:30.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:29 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:31.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:30 smithi057 ceph-mon[93219]: pgmap v535: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:31.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:30 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:31.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:30 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:31.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:30 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:20:31.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:30 smithi087 ceph-mon[82628]: pgmap v535: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:31.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:30 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:31.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:30 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:31.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:30 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:20:33.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:33 smithi057 ceph-mon[93219]: pgmap v536: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:33.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:33 smithi087 ceph-mon[82628]: pgmap v536: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:34.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:34 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:34.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:34 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:35.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:35 smithi057 ceph-mon[93219]: pgmap v537: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:35.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:35 smithi087 ceph-mon[82628]: pgmap v537: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:37.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:37 smithi057 ceph-mon[93219]: pgmap v538: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:37.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:37 smithi087 ceph-mon[82628]: pgmap v538: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:39.425 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:39 smithi057 ceph-mon[93219]: pgmap v539: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:39.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:39 smithi087 ceph-mon[82628]: pgmap v539: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:41.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:41 smithi087 ceph-mon[82628]: pgmap v540: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:41.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:41 smithi057 ceph-mon[93219]: pgmap v540: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:43.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:43 smithi087 ceph-mon[82628]: pgmap v541: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:43.674 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:43 smithi057 ceph-mon[93219]: pgmap v541: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:45.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:45 smithi087 ceph-mon[82628]: pgmap v542: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:45.674 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:45 smithi057 ceph-mon[93219]: pgmap v542: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:47.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:47 smithi087 ceph-mon[82628]: pgmap v543: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:47.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:47 smithi057 ceph-mon[93219]: pgmap v543: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:49.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:49 smithi057 ceph-mon[93219]: pgmap v544: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:49.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:49 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:49.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:49 smithi087 ceph-mon[82628]: pgmap v544: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:49.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:49 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:51.674 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:51 smithi057 ceph-mon[93219]: pgmap v545: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:51.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:51 smithi087 ceph-mon[82628]: pgmap v545: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:20:53.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:53 smithi057 ceph-mon[93219]: pgmap v546: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:53.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:53 smithi087 ceph-mon[82628]: pgmap v546: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:20:55.674 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:55 smithi057 ceph-mon[93219]: pgmap v547: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:55.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:55 smithi087 ceph-mon[82628]: pgmap v547: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:57.674 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:57 smithi057 ceph-mon[93219]: pgmap v548: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:57.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:57 smithi087 ceph-mon[82628]: pgmap v548: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:20:59.674 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:20:59 smithi057 ceph-mon[93219]: pgmap v549: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:20:59.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:20:59 smithi087 ceph-mon[82628]: pgmap v549: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:01.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:01 smithi057 ceph-mon[93219]: pgmap v550: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:21:01.713 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:01 smithi087 ceph-mon[82628]: pgmap v550: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:21:03.924 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:03 smithi057 ceph-mon[93219]: pgmap v551: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:21:03.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:03 smithi087 ceph-mon[82628]: pgmap v551: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:21:04.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:04 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:05.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:04 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:05.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:05 smithi087 ceph-mon[82628]: pgmap v552: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:06.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:05 smithi057 ceph-mon[93219]: pgmap v552: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:07.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:07 smithi087 ceph-mon[82628]: pgmap v553: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:21:08.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:07 smithi057 ceph-mon[93219]: pgmap v553: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:21:09.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:09 smithi087 ceph-mon[82628]: pgmap v554: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:10.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:09 smithi057 ceph-mon[93219]: pgmap v554: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:11.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:11 smithi087 ceph-mon[82628]: pgmap v555: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:21:12.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:11 smithi057 ceph-mon[93219]: pgmap v555: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:21:14.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:13 smithi057 ceph-mon[93219]: pgmap v556: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:21:14.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:13 smithi087 ceph-mon[82628]: pgmap v556: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:21:16.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:15 smithi057 ceph-mon[93219]: pgmap v557: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:16.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:15 smithi087 ceph-mon[82628]: pgmap v557: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:18.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:17 smithi057 ceph-mon[93219]: pgmap v558: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:21:18.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:17 smithi087 ceph-mon[82628]: pgmap v558: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:21:20.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:19 smithi057 ceph-mon[93219]: pgmap v559: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:20.175 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:19 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:20.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:19 smithi087 ceph-mon[82628]: pgmap v559: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:20.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:19 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:22.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:21 smithi057 ceph-mon[93219]: pgmap v560: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:21:22.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:21 smithi087 ceph-mon[82628]: pgmap v560: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:21:24.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:23 smithi057 ceph-mon[93219]: pgmap v561: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:21:24.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:23 smithi087 ceph-mon[82628]: pgmap v561: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:21:26.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:25 smithi057 ceph-mon[93219]: pgmap v562: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:26.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:25 smithi087 ceph-mon[82628]: pgmap v562: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:28.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:27 smithi057 ceph-mon[93219]: pgmap v563: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:21:28.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:27 smithi087 ceph-mon[82628]: pgmap v563: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-28T16:21:29.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:28 smithi057 ceph-mon[93219]: pgmap v564: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:29.213 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:28 smithi087 ceph-mon[82628]: pgmap v564: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-28T16:21:31.424 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:31 smithi057 ceph-mon[93219]: pgmap v565: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:21:31.424 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:31 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:21:31.462 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:31 smithi087 ceph-mon[82628]: pgmap v565: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-28T16:21:31.462 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:31 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:21:32.924 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:32 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:21:32.925 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:32 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:21:32.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:32 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:21:32.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:32 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:21:33.014 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-02-28T16:21:33.015 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:21:33.017 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-28T16:21:33.030 INFO:tasks.cephadm:Teardown begin 2024-02-28T16:21:33.031 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephadm.py", line 1807, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:21:33.032 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:21:33.125 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:21:33.215 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-28T16:21:33.215 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-28T16:21:33.275 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-28T16:21:33.325 INFO:tasks.cephadm:Stopping all daemons... 2024-02-28T16:21:33.325 INFO:tasks.cephadm.mon.smithi057:Stopping mon.smithi057... 2024-02-28T16:21:33.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057 2024-02-28T16:21:33.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:33 smithi057 systemd[1]: Stopping Ceph mon.smithi057 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:21:33.958 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:33 smithi057 ceph-mon[93219]: pgmap v566: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:21:33.958 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:21:33.958 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:21:33.958 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:33 smithi057 ceph-mon[93219]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:21:33.958 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:33 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057[93215]: 2024-02-28T16:21:33.918+0000 7fb8d8800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi057 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:21:33.958 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:33 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057[93215]: 2024-02-28T16:21:33.918+0000 7fb8d8800700 -1 mon.smithi057@0(leader) e3 *** Got Signal Terminated *** 2024-02-28T16:21:33.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:33 smithi087 ceph-mon[82628]: pgmap v566: 65 pgs: 65 active+clean; 153 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-28T16:21:33.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:21:33.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:21:33.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:33 smithi087 ceph-mon[82628]: from='mgr.34102 172.21.15.57:0/3666447796' entity='mgr.smithi057.upqerc' 2024-02-28T16:21:34.290 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:33 smithi057 podman[150258]: 2024-02-28 16:21:33.990885318 +0000 UTC m=+0.234157351 container died 90fe3fb47dc2e3657bc6faa93ce13f8882378bfb8e84d314a12b88ff59c731ea (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-28T16:21:34.674 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:34 smithi057 podman[150258]: 2024-02-28 16:21:34.502218588 +0000 UTC m=+0.745490635 container cleanup 90fe3fb47dc2e3657bc6faa93ce13f8882378bfb8e84d314a12b88ff59c731ea (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222) 2024-02-28T16:21:34.675 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:34 smithi057 bash[150258]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057 2024-02-28T16:21:35.174 INFO:journalctl@ceph.mon.smithi057.smithi057.stdout:Feb 28 16:21:34 smithi057 podman[150284]: 2024-02-28 16:21:34.837633929 +0000 UTC m=+0.832576294 container remove 90fe3fb47dc2e3657bc6faa93ce13f8882378bfb8e84d314a12b88ff59c731ea (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi057, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:21:35.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi057.service' 2024-02-28T16:21:35.499 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:21:35.499 INFO:tasks.cephadm.mon.smithi057:Stopped mon.smithi057 2024-02-28T16:21:35.499 INFO:tasks.cephadm.mon.smithi087:Stopping mon.smithi087... 2024-02-28T16:21:35.499 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi087 2024-02-28T16:21:35.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:35 smithi087 systemd[1]: Stopping Ceph mon.smithi087 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:21:36.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:36 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087[82624]: 2024-02-28T16:21:36.103+0000 7f6ffe600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi087 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:21:36.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:36 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087[82624]: 2024-02-28T16:21:36.103+0000 7f6ffe600700 -1 mon.smithi087@1(peon) e3 *** Got Signal Terminated *** 2024-02-28T16:21:36.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:36 smithi087 podman[119808]: 2024-02-28 16:21:36.298587367 +0000 UTC m=+0.332786207 container died d7f0d6f21c997fbee8eced862489d673fdf262cb07c9aff39dde719bff0347a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240222) 2024-02-28T16:21:36.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:36 smithi087 podman[119808]: 2024-02-28 16:21:36.896283882 +0000 UTC m=+0.930482652 container cleanup d7f0d6f21c997fbee8eced862489d673fdf262cb07c9aff39dde719bff0347a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-28T16:21:36.963 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:36 smithi087 bash[119808]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087 2024-02-28T16:21:37.463 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Feb 28 16:21:37 smithi087 podman[119822]: 2024-02-28 16:21:37.181442136 +0000 UTC m=+0.865410745 container remove d7f0d6f21c997fbee8eced862489d673fdf262cb07c9aff39dde719bff0347a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-mon-smithi087, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:21:37.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@mon.smithi087.service' 2024-02-28T16:21:37.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:21:37.859 INFO:tasks.cephadm.mon.smithi087:Stopped mon.smithi087 2024-02-28T16:21:37.859 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-28T16:21:37.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.0 2024-02-28T16:21:38.426 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:37 smithi057 systemd[1]: Stopping Ceph osd.0 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:21:38.925 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:38 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0[101931]: 2024-02-28T16:21:38.447+0000 7fd387e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:21:38.925 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:38 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0[101931]: 2024-02-28T16:21:38.447+0000 7fd387e00700 -1 osd.0 103 *** Got signal Terminated *** 2024-02-28T16:21:38.925 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:38 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0[101931]: 2024-02-28T16:21:38.447+0000 7fd387e00700 -1 osd.0 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:21:44.175 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:43 smithi057 podman[150404]: 2024-02-28 16:21:43.924134016 +0000 UTC m=+5.617379718 container died 5a9d77191a1041230e80642f9e3e46b844cfb1ccf9b116f3f0a41bba04e55aae (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10) 2024-02-28T16:21:44.674 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:44 smithi057 podman[150404]: 2024-02-28 16:21:44.358621928 +0000 UTC m=+6.051867647 container cleanup 5a9d77191a1041230e80642f9e3e46b844cfb1ccf9b116f3f0a41bba04e55aae (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10) 2024-02-28T16:21:44.675 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:44 smithi057 bash[150404]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0 2024-02-28T16:21:45.174 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:44 smithi057 podman[150422]: 2024-02-28 16:21:44.751946859 +0000 UTC m=+0.810122015 container remove 5a9d77191a1041230e80642f9e3e46b844cfb1ccf9b116f3f0a41bba04e55aae (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-02-28T16:21:45.925 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:45 smithi057 podman[150512]: 2024-02-28 16:21:45.565809615 +0000 UTC m=+0.037847765 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:21:45.925 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:45 smithi057 podman[150512]: 2024-02-28 16:21:45.694689381 +0000 UTC m=+0.166727548 container create 515f4f55f9b3e06ad29d4b2e3450df0655515adf766c8d9e960feb6712e75019 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-28T16:21:46.425 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:45 smithi057 podman[150512]: 2024-02-28 16:21:45.974105721 +0000 UTC m=+0.446143911 container init 515f4f55f9b3e06ad29d4b2e3450df0655515adf766c8d9e960feb6712e75019 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-28T16:21:46.425 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:45 smithi057 podman[150512]: 2024-02-28 16:21:45.986195768 +0000 UTC m=+0.458233942 container start 515f4f55f9b3e06ad29d4b2e3450df0655515adf766c8d9e960feb6712e75019 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:21:46.425 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:46 smithi057 podman[150512]: 2024-02-28 16:21:46.105978541 +0000 UTC m=+0.578016751 container attach 515f4f55f9b3e06ad29d4b2e3450df0655515adf766c8d9e960feb6712e75019 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-02-28T16:21:46.787 INFO:journalctl@ceph.osd.0.smithi057.stdout:Feb 28 16:21:46 smithi057 podman[150512]: 2024-02-28 16:21:46.439917837 +0000 UTC m=+0.911955967 container died 515f4f55f9b3e06ad29d4b2e3450df0655515adf766c8d9e960feb6712e75019 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-0-deactivate, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-28T16:21:47.199 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.0.service' 2024-02-28T16:21:47.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:21:47.323 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-28T16:21:47.323 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-28T16:21:47.323 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.1 2024-02-28T16:21:47.674 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:47 smithi057 systemd[1]: Stopping Ceph osd.1 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:21:48.174 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:47 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1[107479]: 2024-02-28T16:21:47.886+0000 7f5946200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:21:48.175 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:47 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1[107479]: 2024-02-28T16:21:47.886+0000 7f5946200700 -1 osd.1 103 *** Got signal Terminated *** 2024-02-28T16:21:48.175 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:47 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1[107479]: 2024-02-28T16:21:47.886+0000 7f5946200700 -1 osd.1 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:21:53.737 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:53 smithi057 podman[150616]: 2024-02-28 16:21:53.454544008 +0000 UTC m=+5.693350310 container died 676452ac2f892b62cd53c5adf51475c92bca75e542461e676d834d21ca5e7de1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-28T16:21:54.147 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:53 smithi057 podman[150616]: 2024-02-28 16:21:53.872194446 +0000 UTC m=+6.111000791 container cleanup 676452ac2f892b62cd53c5adf51475c92bca75e542461e676d834d21ca5e7de1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-28T16:21:54.147 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:53 smithi057 bash[150616]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1 2024-02-28T16:21:54.424 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:54 smithi057 podman[150635]: 2024-02-28 16:21:54.157076762 +0000 UTC m=+0.690101563 container remove 676452ac2f892b62cd53c5adf51475c92bca75e542461e676d834d21ca5e7de1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10) 2024-02-28T16:21:55.358 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:55 smithi057 podman[150724]: 2024-02-28 16:21:54.962848617 +0000 UTC m=+0.039290932 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:21:55.358 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:55 smithi057 podman[150724]: 2024-02-28 16:21:55.074816183 +0000 UTC m=+0.151258520 container create 157a70928f12c5488e2ff29fa9fd3ecd03441fbc2ee4c9c80f8d7135eba5e703 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:21:55.358 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:55 smithi057 podman[150724]: 2024-02-28 16:21:55.368192451 +0000 UTC m=+0.444634828 container init 157a70928f12c5488e2ff29fa9fd3ecd03441fbc2ee4c9c80f8d7135eba5e703 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-28T16:21:55.675 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:55 smithi057 podman[150724]: 2024-02-28 16:21:55.379533149 +0000 UTC m=+0.455975489 container start 157a70928f12c5488e2ff29fa9fd3ecd03441fbc2ee4c9c80f8d7135eba5e703 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, ceph=True, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-28T16:21:55.675 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:55 smithi057 podman[150724]: 2024-02-28 16:21:55.452715028 +0000 UTC m=+0.529157449 container attach 157a70928f12c5488e2ff29fa9fd3ecd03441fbc2ee4c9c80f8d7135eba5e703 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-02-28T16:21:56.171 INFO:journalctl@ceph.osd.1.smithi057.stdout:Feb 28 16:21:55 smithi057 podman[150724]: 2024-02-28 16:21:55.832184953 +0000 UTC m=+0.908627293 container died 157a70928f12c5488e2ff29fa9fd3ecd03441fbc2ee4c9c80f8d7135eba5e703 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-02-28T16:21:56.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.1.service' 2024-02-28T16:21:56.716 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:21:56.717 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-28T16:21:56.717 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-28T16:21:56.717 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.2 2024-02-28T16:21:57.174 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:21:56 smithi057 systemd[1]: Stopping Ceph osd.2 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:21:57.675 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:21:57 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2[113037]: 2024-02-28T16:21:57.366+0000 7f2092a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:21:57.675 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:21:57 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2[113037]: 2024-02-28T16:21:57.366+0000 7f2092a00700 -1 osd.2 103 *** Got signal Terminated *** 2024-02-28T16:21:57.675 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:21:57 smithi057 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2[113037]: 2024-02-28T16:21:57.366+0000 7f2092a00700 -1 osd.2 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:22:03.058 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:22:02 smithi057 podman[150828]: 2024-02-28 16:22:02.80504329 +0000 UTC m=+5.560840746 container died bb9a6a24a249a2f31f4cc1522c5cdb48dd8473bb77abe458d60864d977f63802 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-02-28T16:22:03.361 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:22:03 smithi057 podman[150828]: 2024-02-28 16:22:03.16844233 +0000 UTC m=+5.924239834 container cleanup bb9a6a24a249a2f31f4cc1522c5cdb48dd8473bb77abe458d60864d977f63802 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-02-28T16:22:03.361 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:22:03 smithi057 bash[150828]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2 2024-02-28T16:22:03.674 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:22:03 smithi057 podman[150845]: 2024-02-28 16:22:03.369831649 +0000 UTC m=+0.549795034 container remove bb9a6a24a249a2f31f4cc1522c5cdb48dd8473bb77abe458d60864d977f63802 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-28T16:22:04.507 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:22:04 smithi057 podman[150939]: 2024-02-28 16:22:04.10327777 +0000 UTC m=+0.039952777 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:22:04.507 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:22:04 smithi057 podman[150939]: 2024-02-28 16:22:04.220937728 +0000 UTC m=+0.157612760 container create e938929fd7f6c637bae3fe97073e175f62f43d30a34d036b2d367f39c4071c42 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-28T16:22:04.507 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:22:04 smithi057 podman[150939]: 2024-02-28 16:22:04.516814 +0000 UTC m=+0.453489072 container init e938929fd7f6c637bae3fe97073e175f62f43d30a34d036b2d367f39c4071c42 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:22:04.763 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:22:04 smithi057 podman[150939]: 2024-02-28 16:22:04.530178703 +0000 UTC m=+0.466853711 container start e938929fd7f6c637bae3fe97073e175f62f43d30a34d036b2d367f39c4071c42 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:22:04.763 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:22:04 smithi057 podman[150939]: 2024-02-28 16:22:04.774062198 +0000 UTC m=+0.710737216 container attach e938929fd7f6c637bae3fe97073e175f62f43d30a34d036b2d367f39c4071c42 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222) 2024-02-28T16:22:04.937 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:04 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:04.654+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:05.174 INFO:journalctl@ceph.osd.2.smithi057.stdout:Feb 28 16:22:04 smithi057 podman[150939]: 2024-02-28 16:22:04.991953162 +0000 UTC m=+0.928628196 container died e938929fd7f6c637bae3fe97073e175f62f43d30a34d036b2d367f39c4071c42 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:22:05.213 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:04 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:22:04.946+0000 7fab0c200700 -1 osd.3 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.344384+0000 front 2024-02-28T16:21:39.344687+0000 (oldest deadline 2024-02-28T16:22:04.044219+0000) 2024-02-28T16:22:05.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.2.service' 2024-02-28T16:22:05.813 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:22:05.813 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-28T16:22:05.813 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-28T16:22:05.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.3 2024-02-28T16:22:05.934 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:05 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:05.685+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:06.212 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:05 smithi087 systemd[1]: Stopping Ceph osd.3 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:22:06.213 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:05 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:22:05.966+0000 7fab0c200700 -1 osd.3 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.344384+0000 front 2024-02-28T16:21:39.344687+0000 (oldest deadline 2024-02-28T16:22:04.044219+0000) 2024-02-28T16:22:06.692 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:06 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:22:06.414+0000 7fab10000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:22:06.693 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:06 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:22:06.414+0000 7fab10000700 -1 osd.3 103 *** Got signal Terminated *** 2024-02-28T16:22:06.693 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:06 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:22:06.414+0000 7fab10000700 -1 osd.3 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:22:06.963 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:06 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:06.701+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:07.463 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:07 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:22:07.015+0000 7fab0c200700 -1 osd.3 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.344384+0000 front 2024-02-28T16:21:39.344687+0000 (oldest deadline 2024-02-28T16:22:04.044219+0000) 2024-02-28T16:22:07.956 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:07 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:07.695+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:08.213 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:07 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:22:07.965+0000 7fab0c200700 -1 osd.3 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.344384+0000 front 2024-02-28T16:21:39.344687+0000 (oldest deadline 2024-02-28T16:22:04.044219+0000) 2024-02-28T16:22:08.947 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:08 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:08.690+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:08.947 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:08 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:08.768+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:09.212 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:08 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:22:08.956+0000 7fab0c200700 -1 osd.3 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.344384+0000 front 2024-02-28T16:21:39.344687+0000 (oldest deadline 2024-02-28T16:22:04.044219+0000) 2024-02-28T16:22:09.936 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:09 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:09.675+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:09.937 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:09 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:09.816+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:10.213 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:09 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:22:09.946+0000 7fab0c200700 -1 osd.3 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.344384+0000 front 2024-02-28T16:21:39.344687+0000 (oldest deadline 2024-02-28T16:22:04.044219+0000) 2024-02-28T16:22:10.922 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:10 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:10.838+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:10.923 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:10 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:10.679+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:11.213 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:10 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3[91982]: 2024-02-28T16:22:10.932+0000 7fab0c200700 -1 osd.3 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.344384+0000 front 2024-02-28T16:21:39.344687+0000 (oldest deadline 2024-02-28T16:22:04.044219+0000) 2024-02-28T16:22:11.963 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:11 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:11.845+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:11.963 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:11 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:11.687+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:12.287 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:12 smithi087 podman[119944]: 2024-02-28 16:22:12.000439396 +0000 UTC m=+5.724082940 container died 8d59e4ee9f7d6488aeca5245a003ed22bf9188370400daa040d0f9fe0c325c59 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:22:12.674 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:12 smithi087 podman[119944]: 2024-02-28 16:22:12.466973754 +0000 UTC m=+6.190617310 container cleanup 8d59e4ee9f7d6488aeca5245a003ed22bf9188370400daa040d0f9fe0c325c59 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-28T16:22:12.674 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:12 smithi087 bash[119944]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3 2024-02-28T16:22:12.963 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:12 smithi087 podman[119963]: 2024-02-28 16:22:12.684696189 +0000 UTC m=+0.673233482 container remove 8d59e4ee9f7d6488aeca5245a003ed22bf9188370400daa040d0f9fe0c325c59 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T16:22:12.963 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:12 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:12.695+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:12.963 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:12 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:12.859+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:13.713 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:13 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:13.683+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:13.713 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:13 smithi087 podman[120054]: 2024-02-28 16:22:13.354463144 +0000 UTC m=+0.036270278 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:22:13.713 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:13 smithi087 podman[120054]: 2024-02-28 16:22:13.477396515 +0000 UTC m=+0.159203673 container create f3ce18c840d8b4ae347358dd3a526647eb2bd0a8fe0ae0305fdcc436f3b46482 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD) 2024-02-28T16:22:14.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:13 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:13.891+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:14.213 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:13 smithi087 podman[120054]: 2024-02-28 16:22:13.798029916 +0000 UTC m=+0.479837081 container init f3ce18c840d8b4ae347358dd3a526647eb2bd0a8fe0ae0305fdcc436f3b46482 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-02-28T16:22:14.213 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:13 smithi087 podman[120054]: 2024-02-28 16:22:13.809153318 +0000 UTC m=+0.490960483 container start f3ce18c840d8b4ae347358dd3a526647eb2bd0a8fe0ae0305fdcc436f3b46482 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-28T16:22:14.213 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:13 smithi087 podman[120054]: 2024-02-28 16:22:13.91351222 +0000 UTC m=+0.595319379 container attach f3ce18c840d8b4ae347358dd3a526647eb2bd0a8fe0ae0305fdcc436f3b46482 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:22:14.584 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:14 smithi087 podman[120054]: 2024-02-28 16:22:14.242561496 +0000 UTC m=+0.924368657 container died f3ce18c840d8b4ae347358dd3a526647eb2bd0a8fe0ae0305fdcc436f3b46482 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-28T16:22:14.851 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:14 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:14.724+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:15.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.3.service' 2024-02-28T16:22:15.121 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:14 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:14.861+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:15.122 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:15 smithi087 podman[120079]: 2024-02-28 16:22:15.017193696 +0000 UTC m=+0.753662864 container remove f3ce18c840d8b4ae347358dd3a526647eb2bd0a8fe0ae0305fdcc436f3b46482 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-28T16:22:15.122 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:15 smithi087 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-28T16:22:15.122 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:15 smithi087 systemd[1]: Stopped Ceph osd.3 for bf04dacc-d650-11ee-95c3-87774f69a715. 2024-02-28T16:22:15.122 INFO:journalctl@ceph.osd.3.smithi087.stdout:Feb 28 16:22:15 smithi087 systemd[1]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.3.service: Consumed 21.250s CPU time. 2024-02-28T16:22:15.152 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:22:15.152 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-28T16:22:15.152 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-28T16:22:15.152 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.4 2024-02-28T16:22:15.463 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:15 smithi087 systemd[1]: Stopping Ceph osd.4 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:22:15.963 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:15 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:15.833+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:15.963 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:15 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:15.692+0000 7f5009800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:22:15.963 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:15 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:15.692+0000 7f5009800700 -1 osd.4 103 *** Got signal Terminated *** 2024-02-28T16:22:15.963 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:15 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:15.692+0000 7f5009800700 -1 osd.4 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:22:15.964 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:15 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:15.712+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:15.964 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:15 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:15.712+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:51.416288+0000 front 2024-02-28T16:21:51.416504+0000 (oldest deadline 2024-02-28T16:22:15.515778+0000) 2024-02-28T16:22:17.213 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:16 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:16.743+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:17.213 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:16 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:16.743+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:51.416288+0000 front 2024-02-28T16:21:51.416504+0000 (oldest deadline 2024-02-28T16:22:15.515778+0000) 2024-02-28T16:22:17.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:16 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:16.862+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:17.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:16 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:16.862+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:18.213 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:17 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:17.723+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:18.213 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:17 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:17.723+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:51.416288+0000 front 2024-02-28T16:21:51.416504+0000 (oldest deadline 2024-02-28T16:22:15.515778+0000) 2024-02-28T16:22:18.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:17 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:17.905+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:18.214 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:17 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:17.905+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:18.963 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:18 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:18.901+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:18.963 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:18 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:18.901+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:18.963 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:18 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:18.687+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:18.963 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:18 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:18.687+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:51.416288+0000 front 2024-02-28T16:21:51.416504+0000 (oldest deadline 2024-02-28T16:22:15.515778+0000) 2024-02-28T16:22:19.963 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:19 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:19.893+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:19.963 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:19 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:19.893+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:19.963 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:19 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:19.665+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:39.213644+0000 front 2024-02-28T16:21:39.213489+0000 (oldest deadline 2024-02-28T16:22:04.413987+0000) 2024-02-28T16:22:19.963 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:19 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4[97023]: 2024-02-28T16:22:19.665+0000 7f5005a00700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:51.416288+0000 front 2024-02-28T16:21:51.416504+0000 (oldest deadline 2024-02-28T16:22:15.515778+0000) 2024-02-28T16:22:21.147 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:20 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:20.891+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:21.148 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:20 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:20.891+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:21.428 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:21 smithi087 podman[120169]: 2024-02-28 16:22:21.157995583 +0000 UTC m=+5.589893859 container died a98b26059f0afdec1b0e7cbf2b9c6eef6103d148883411bb64bd5ff98b1a2145 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10) 2024-02-28T16:22:21.692 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:21 smithi087 podman[120169]: 2024-02-28 16:22:21.679170392 +0000 UTC m=+6.111068722 container cleanup a98b26059f0afdec1b0e7cbf2b9c6eef6103d148883411bb64bd5ff98b1a2145 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:22:21.692 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:21 smithi087 bash[120169]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4 2024-02-28T16:22:22.212 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:21 smithi087 podman[120190]: 2024-02-28 16:22:21.980082865 +0000 UTC m=+0.804736877 container remove a98b26059f0afdec1b0e7cbf2b9c6eef6103d148883411bb64bd5ff98b1a2145 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-28T16:22:22.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:21 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:21.877+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:22.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:21 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:21.877+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:23.025 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:22 smithi087 podman[120274]: 2024-02-28 16:22:22.67133412 +0000 UTC m=+0.034001761 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:22:23.026 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:22 smithi087 podman[120274]: 2024-02-28 16:22:22.772812709 +0000 UTC m=+0.135480380 container create de9c1ba16b8cd28393e95d1477424624de8601541112a7e67f1d6a2cdf02c0be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True) 2024-02-28T16:22:23.026 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:22 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:22.848+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:23.026 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:22 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:22.848+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:23.463 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:23 smithi087 podman[120274]: 2024-02-28 16:22:23.03538347 +0000 UTC m=+0.398051128 container init de9c1ba16b8cd28393e95d1477424624de8601541112a7e67f1d6a2cdf02c0be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240222) 2024-02-28T16:22:23.463 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:23 smithi087 podman[120274]: 2024-02-28 16:22:23.046760809 +0000 UTC m=+0.409428453 container start de9c1ba16b8cd28393e95d1477424624de8601541112a7e67f1d6a2cdf02c0be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-02-28T16:22:23.463 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:23 smithi087 podman[120274]: 2024-02-28 16:22:23.133502699 +0000 UTC m=+0.496170426 container attach de9c1ba16b8cd28393e95d1477424624de8601541112a7e67f1d6a2cdf02c0be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-02-28T16:22:23.788 INFO:journalctl@ceph.osd.4.smithi087.stdout:Feb 28 16:22:23 smithi087 podman[120274]: 2024-02-28 16:22:23.476878174 +0000 UTC m=+0.839545812 container died de9c1ba16b8cd28393e95d1477424624de8601541112a7e67f1d6a2cdf02c0be (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-02-28T16:22:24.160 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:23 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:23.884+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:24.160 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:23 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:23.884+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:24.213 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.4.service' 2024-02-28T16:22:24.337 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:22:24.337 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-28T16:22:24.337 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-28T16:22:24.337 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.5 2024-02-28T16:22:24.712 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:24 smithi087 systemd[1]: Stopping Ceph osd.5 for bf04dacc-d650-11ee-95c3-87774f69a715... 2024-02-28T16:22:25.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:24.926+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:25.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:24.926+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:25.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:24.981+0000 7ffaf1a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:22:25.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:24.981+0000 7ffaf1a00700 -1 osd.5 103 *** Got signal Terminated *** 2024-02-28T16:22:25.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:24 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:24.981+0000 7ffaf1a00700 -1 osd.5 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:22:26.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:25 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:25.914+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:26.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:25 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:25.914+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:27.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:26 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:26.891+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:27.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:26 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:26.891+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:27.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:26 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:26.891+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6822 osd.2 since back 2024-02-28T16:22:01.497893+0000 front 2024-02-28T16:22:01.497959+0000 (oldest deadline 2024-02-28T16:22:26.197798+0000) 2024-02-28T16:22:28.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:27 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:27.904+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:28.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:27 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:27.904+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:28.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:27 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:27.904+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6822 osd.2 since back 2024-02-28T16:22:01.497893+0000 front 2024-02-28T16:22:01.497959+0000 (oldest deadline 2024-02-28T16:22:26.197798+0000) 2024-02-28T16:22:29.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:28 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:28.952+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:29.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:28 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:28.952+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:29.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:28 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:28.952+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6822 osd.2 since back 2024-02-28T16:22:01.497893+0000 front 2024-02-28T16:22:01.497959+0000 (oldest deadline 2024-02-28T16:22:26.197798+0000) 2024-02-28T16:22:30.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:29 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:29.957+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6806 osd.0 since back 2024-02-28T16:21:43.295358+0000 front 2024-02-28T16:21:43.295534+0000 (oldest deadline 2024-02-28T16:22:08.595268+0000) 2024-02-28T16:22:30.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:29 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:29.957+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6814 osd.1 since back 2024-02-28T16:21:52.096899+0000 front 2024-02-28T16:21:52.096810+0000 (oldest deadline 2024-02-28T16:22:16.196346+0000) 2024-02-28T16:22:30.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:29 smithi087 ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5[101871]: 2024-02-28T16:22:29.957+0000 7ffaedc00700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.57:6822 osd.2 since back 2024-02-28T16:22:01.497893+0000 front 2024-02-28T16:22:01.497959+0000 (oldest deadline 2024-02-28T16:22:26.197798+0000) 2024-02-28T16:22:30.713 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:30 smithi087 podman[120380]: 2024-02-28 16:22:30.454022911 +0000 UTC m=+5.664291171 container died cbdb6df47634487221ffeab4698ae7e0ffa6e4e511bd5901f83477470a015100 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:22:31.130 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:30 smithi087 podman[120380]: 2024-02-28 16:22:30.923013882 +0000 UTC m=+6.133282174 container cleanup cbdb6df47634487221ffeab4698ae7e0ffa6e4e511bd5901f83477470a015100 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240222) 2024-02-28T16:22:31.130 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:30 smithi087 bash[120380]: ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5 2024-02-28T16:22:31.462 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:31 smithi087 podman[120401]: 2024-02-28 16:22:31.140547977 +0000 UTC m=+0.665334380 container remove cbdb6df47634487221ffeab4698ae7e0ffa6e4e511bd5901f83477470a015100 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-02-28T16:22:32.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:31 smithi087 podman[120488]: 2024-02-28 16:22:31.842243625 +0000 UTC m=+0.033155550 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:22:32.213 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:31 smithi087 podman[120488]: 2024-02-28 16:22:31.991525278 +0000 UTC m=+0.182437238 container create 943be46963294f63ea97da8e5b64af8f88466da69eec9777eb497de59f44553e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-28T16:22:32.713 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:32 smithi087 podman[120488]: 2024-02-28 16:22:32.284306709 +0000 UTC m=+0.475218673 container init 943be46963294f63ea97da8e5b64af8f88466da69eec9777eb497de59f44553e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, ceph=True) 2024-02-28T16:22:32.713 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:32 smithi087 podman[120488]: 2024-02-28 16:22:32.294905382 +0000 UTC m=+0.485817373 container start 943be46963294f63ea97da8e5b64af8f88466da69eec9777eb497de59f44553e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:22:32.713 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:32 smithi087 podman[120488]: 2024-02-28 16:22:32.386062095 +0000 UTC m=+0.576974072 container attach 943be46963294f63ea97da8e5b64af8f88466da69eec9777eb497de59f44553e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-28T16:22:33.137 INFO:journalctl@ceph.osd.5.smithi087.stdout:Feb 28 16:22:32 smithi087 podman[120488]: 2024-02-28 16:22:32.726200816 +0000 UTC m=+0.917112763 container died 943be46963294f63ea97da8e5b64af8f88466da69eec9777eb497de59f44553e (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-bf04dacc-d650-11ee-95c3-87774f69a715-osd-5-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-02-28T16:22:33.588 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf04dacc-d650-11ee-95c3-87774f69a715@osd.5.service' 2024-02-28T16:22:33.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:22:33.714 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-28T16:22:33.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf04dacc-d650-11ee-95c3-87774f69a715 --force --keep-logs 2024-02-28T16:22:39.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[76008]: fuse finished with error 0 and tester_r 0 2024-02-28T16:23:03.956 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf04dacc-d650-11ee-95c3-87774f69a715 --force --keep-logs 2024-02-28T16:23:22.194 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:23:22.298 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:23:22.395 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-28T16:23:22.397 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579/remote/smithi057/crash 2024-02-28T16:23:22.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/crash -- . 2024-02-28T16:23:22.499 INFO:teuthology.orchestra.run.smithi057.stderr:tar: /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/crash: Cannot open: No such file or directory 2024-02-28T16:23:22.499 INFO:teuthology.orchestra.run.smithi057.stderr:tar: Error is not recoverable: exiting now 2024-02-28T16:23:22.505 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579/remote/smithi087/crash 2024-02-28T16:23:22.506 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/crash -- . 2024-02-28T16:23:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:tar: /var/lib/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/crash: Cannot open: No such file or directory 2024-02-28T16:23:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:tar: Error is not recoverable: exiting now 2024-02-28T16:23:22.607 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-28T16:23:22.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-28T16:23:22.715 INFO:teuthology.orchestra.run.smithi057.stdout:2024-02-28T16:10:00.000429+0000 mon.smithi057 (mon.0) 534 : cluster 3 [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T16:23:22.716 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-28T16:23:22.716 INFO:tasks.cephadm:Compressing logs... 2024-02-28T16:23:22.716 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-28T16:23:22.721 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-28T16:23:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-28T16:23:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-28T16:23:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-02-28T16:23:22.802 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.audit.log 2024-02-28T16:23:22.803 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi057.eztwsd.log 2024-02-28T16:23:22.804 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.audit.log: -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mon.smithi057.log 2024-02-28T16:23:22.805 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi057.eztwsd.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.1.log 2024-02-28T16:23:22.807 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mon.smithi057.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mgr.smithi057.upqerc.log 2024-02-28T16:23:22.809 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi057.qwatmu.log 2024-02-28T16:23:22.812 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mgr.smithi057.upqerc.log: /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi057.qwatmu.log: 91.0% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.audit.log.gz 2024-02-28T16:23:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-28T16:23:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:: No such file or directory 2024-02-28T16:23:22.813 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.0.log 2024-02-28T16:23:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-02-28T16:23:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mgr.smithi087.ewrszc.log 2024-02-28T16:23:22.814 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.cephadm.log 2024-02-28T16:23:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.audit.log 2024-02-28T16:23:22.816 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.log 2024-02-28T16:23:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mgr.smithi087.ewrszc.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-28T16:23:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi087.fzjgef.log 2024-02-28T16:23:22.818 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.cephadm.log: /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.0.log: 85.0% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.cephadm.log.gz 2024-02-28T16:23:22.818 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.4.log 2024-02-28T16:23:22.819 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.2.log 2024-02-28T16:23:22.820 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi087.fzjgef.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.5.log 2024-02-28T16:23:22.821 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mon.smithi087.log 2024-02-28T16:23:22.822 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.log: 90.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-28T16:23:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.3.log 2024-02-28T16:23:22.824 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mon.smithi087.log: 91.2% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.audit.log.gz 2024-02-28T16:23:22.825 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-volume.log 2024-02-28T16:23:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.cephadm.log 2024-02-28T16:23:22.831 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.log 2024-02-28T16:23:22.831 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi087.whebmo.log 2024-02-28T16:23:22.831 INFO:teuthology.orchestra.run.smithi087.stderr: 85.0% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.cephadm.log.gz 2024-02-28T16:23:22.832 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-volume.log 2024-02-28T16:23:22.832 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.2.log: /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-volume.log: 88.4% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.log.gz 2024-02-28T16:23:22.842 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-volume.log: /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi087.whebmo.log: 88.4% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph.log.gz 2024-02-28T16:23:22.882 INFO:teuthology.orchestra.run.smithi057.stderr: 90.8% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-volume.log.gz 2024-02-28T16:23:22.887 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mgr.smithi087.ewrszc.log.gz 2024-02-28T16:23:22.888 INFO:teuthology.orchestra.run.smithi087.stderr: 90.8% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-volume.log.gz 2024-02-28T16:23:23.294 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mgr.smithi057.upqerc.log.gz 2024-02-28T16:23:23.416 INFO:teuthology.orchestra.run.smithi087.stderr: 92.4% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mon.smithi087.log.gz 2024-02-28T16:23:24.009 INFO:teuthology.orchestra.run.smithi057.stderr: 90.4% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mon.smithi057.log.gz 2024-02-28T16:23:26.744 INFO:teuthology.orchestra.run.smithi087.stderr: 95.0% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi087.whebmo.log.gz 2024-02-28T16:23:27.327 INFO:teuthology.orchestra.run.smithi087.stderr: 93.3% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.4.log.gz 2024-02-28T16:23:29.359 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.1.log.gz 2024-02-28T16:23:30.493 INFO:teuthology.orchestra.run.smithi057.stderr: 93.0% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.2.log.gz 2024-02-28T16:23:30.942 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.0.log.gz 2024-02-28T16:23:31.146 INFO:teuthology.orchestra.run.smithi087.stderr: 93.2% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.3.log.gz 2024-02-28T16:23:31.590 INFO:teuthology.orchestra.run.smithi087.stderr: 92.9% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-osd.5.log.gz 2024-02-28T16:23:34.538 INFO:teuthology.orchestra.run.smithi057.stderr: 95.0% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi057.qwatmu.log.gz 2024-02-28T16:23:38.853 INFO:teuthology.orchestra.run.smithi057.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-02-28T16:23:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-02-28T16:23:39.537 INFO:teuthology.orchestra.run.smithi087.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-02-28T16:24:08.509 INFO:teuthology.orchestra.run.smithi087.stderr: 93.6% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi087.fzjgef.log.gz 2024-02-28T16:24:08.513 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-02-28T16:24:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m45.740s 2024-02-28T16:24:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:user 1m22.802s 2024-02-28T16:24:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m5.883s 2024-02-28T16:24:24.553 INFO:teuthology.orchestra.run.smithi057.stderr: 93.4% -- replaced with /var/log/ceph/bf04dacc-d650-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi057.eztwsd.log.gz 2024-02-28T16:24:24.556 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-02-28T16:24:24.556 INFO:teuthology.orchestra.run.smithi057.stderr:real 1m1.799s 2024-02-28T16:24:24.557 INFO:teuthology.orchestra.run.smithi057.stderr:user 1m45.730s 2024-02-28T16:24:24.557 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m7.950s 2024-02-28T16:24:24.558 INFO:tasks.cephadm:Archiving logs... 2024-02-28T16:24:24.558 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579/remote/smithi057/log 2024-02-28T16:24:24.559 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-28T16:24:39.104 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579/remote/smithi087/log 2024-02-28T16:24:39.105 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-28T16:24:50.923 INFO:tasks.cephadm:Removing cluster... 2024-02-28T16:24:50.923 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf04dacc-d650-11ee-95c3-87774f69a715 --force 2024-02-28T16:24:52.249 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf04dacc-d650-11ee-95c3-87774f69a715 --force 2024-02-28T16:24:53.453 INFO:tasks.cephadm:Removing cephadm ... 2024-02-28T16:24:53.453 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-28T16:24:53.515 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-28T16:24:53.570 INFO:tasks.cephadm:Teardown complete 2024-02-28T16:24:53.570 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-28T16:24:53.582 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:24:53.583 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-28T16:24:53.583 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-28T16:24:53.591 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-28T16:24:53.730 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-28T16:24:53.742 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-28T16:24:53.742 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T16:24:53.750 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T16:24:53.800 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2024-02-28T16:24:53.803 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-02-28T16:24:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T16:24:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-02-28T16:24:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 34 +2464us[+2451us] +/- 153ms 2024-02-28T16:24:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv02.front.sepia.ceph.com 3 6 377 33 -1045us[-1058us] +/- 57ms 2024-02-28T16:24:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +332us[ +318us] +/- 84ms 2024-02-28T16:24:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:24:53.811 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T16:24:53.812 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-02-28T16:24:53.812 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 34 +2515us[+2515us] +/- 153ms 2024-02-28T16:24:53.812 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -1036us[-1035us] +/- 57ms 2024-02-28T16:24:53.812 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +330us[ +330us] +/- 84ms 2024-02-28T16:24:53.812 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:24:53.813 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-28T16:24:53.828 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-28T16:24:53.828 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-28T16:24:53.839 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-28T16:24:54.098 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-28T16:24:54.332 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T16:24:54.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:24:54.444 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T16:24:54.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:24:54.548 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-28T16:24:54.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-28T16:24:54.570 INFO:teuthology.task.internal:Duration was 2816.963464 seconds 2024-02-28T16:24:54.570 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-28T16:24:54.580 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-28T16:24:54.580 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-28T16:24:54.588 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-28T16:24:54.752 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T16:24:54.757 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T16:24:55.261 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-28T16:24:55.261 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-02-28T16:24:55.262 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-28T16:24:55.327 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-02-28T16:24:55.327 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-28T16:24:55.409 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-28T16:24:55.409 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-28T16:24:55.417 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-28T16:24:55.516 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-28T16:24:55.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-28T16:24:55.522 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-28T16:24:56.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-28T16:24:56.346 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-28T16:24:56.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-28T16:24:56.444 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-28T16:24:56.546 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-28T16:24:56.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:24:56.567 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:24:56.666 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-02-28T16:24:56.677 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-02-28T16:24:56.736 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:24:56.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:24:56.792 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:24:56.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:24:56.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-28T16:24:56.862 INFO:teuthology.task.internal:Transferring archived files... 2024-02-28T16:24:56.863 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579/remote/smithi057 2024-02-28T16:24:56.863 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-28T16:24:56.998 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579/remote/smithi087 2024-02-28T16:24:56.998 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-28T16:24:57.109 INFO:teuthology.task.internal:Removing archive directory... 2024-02-28T16:24:57.109 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-28T16:24:57.117 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-28T16:24:57.174 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-28T16:24:57.188 INFO:teuthology.task.internal:Not uploading archives. 2024-02-28T16:24:57.188 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-28T16:24:57.199 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-28T16:24:57.200 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-28T16:24:57.208 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-28T16:24:57.258 INFO:teuthology.orchestra.run.smithi057.stdout: 393229 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 28 16:24 /home/ubuntu/cephtest 2024-02-28T16:24:57.258 INFO:teuthology.orchestra.run.smithi057.stdout: 681297 4 d--------- 2 ubuntu ubuntu 4096 Feb 28 15:58 /home/ubuntu/cephtest/mnt.0 2024-02-28T16:24:57.258 INFO:teuthology.orchestra.run.smithi057.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-02-28T16:24:57.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:24:57.261 INFO:teuthology.orchestra.run.smithi057.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-02-28T16:24:57.262 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi057 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-02-28T16:24:57.262 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-28T16:24:57.275 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-28T16:24:57.288 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:24:57.288 INFO:teuthology.nuke:Checking targets against current locks 2024-02-28T16:24:57.319 DEBUG:teuthology.nuke:shortname: smithi057 2024-02-28T16:24:57.320 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T16:24:57.341 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:23:03.650037', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPj8QBAvN1t8YrFyzG2g7GrNfctFXTOXGpmb0PfpplNoq3rlpzGZRFTRxCkCkQcrd4pWRIRlQc87B+UIDbYRsh0='} 2024-02-28T16:24:57.345 DEBUG:teuthology.nuke:shortname: smithi087 2024-02-28T16:24:57.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T16:24:57.367 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:23:03.651767', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKL9ZoRu0zHniRHkNU7d2M8Q1i2NrrBRQHfVbC/Eqb6sWb+0uCI2RGnwbnIIlSz0shY26lSeuM+ZIIT2XiepQE0='} 2024-02-28T16:24:57.387 INFO:teuthology.orchestra.console.smithi057:Power off 2024-02-28T16:24:57.387 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T16:24:57.410 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2024-02-28T16:24:57.411 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:24:57.425 INFO:teuthology.orchestra.console.smithi087:Power off 2024-02-28T16:24:57.426 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T16:24:57.440 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-02-28T16:24:57.460 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2024-02-28T16:24:57.461 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:24:57.521 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-02-28T16:25:01.442 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:25:01.522 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:25:01.556 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-02-28T16:25:01.633 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-02-28T16:25:05.560 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:25:05.633 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:25:05.670 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-02-28T16:25:05.743 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-02-28T16:25:05.772 INFO:teuthology.orchestra.console.smithi057:Power off completed 2024-02-28T16:25:09.744 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:25:09.853 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-02-28T16:25:09.954 INFO:teuthology.orchestra.console.smithi087:Power off completed 2024-02-28T16:25:10.059 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2816.9634640216827 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default host.a-kernel-sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 host.b-kernel-sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 owner: scheduled_vshankar@teuthology status: fail success: false 2024-02-28T16:25:10.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:25:10.148 INFO:teuthology.run:FAIL